Representing data quality in sensor data streaming environments

Research output: Contribution to journalResearch articleContributedpeer-review

Contributors

Abstract

Sensors in smart-item environments capture data about product conditions and usage to support business decisions as well as production automation processes. A challenging issue in this application area is the restricted quality of sensor data due to limited sensor precision and sensor failures. Moreover, data stream processing to meet resource constraints in streaming environments introduces additional noise and decreases the data quality. In order to avoid wrong business decisions due to dirty data, quality characteristics have to be captured, processed, and provided to the respective business task. However, the issue of how to efficiently provide applications with information about data quality is still an open research problem. In this article, we address this problem by presenting a flexible model for the propagation and processing of data quality. The comprehensive analysis of common data stream processing operators and their impact on data quality allows a fruitful data evaluation and diminishes incorrect business decisions. Further, we propose the data quality model control to adapt the data quality granularity to the data stream interestingness.

Details

Original languageEnglish
Article number10
Number of pages28
JournalJournal of Data and Information Quality
Volume1
Issue number2
Publication statusPublished - 1 Sept 2009
Peer-reviewedYes

External IDs

ORCID /0000-0001-8107-2775/work/199961252

Keywords

Research priority areas of TU Dresden

DFG Classification of Subject Areas according to Review Boards

Subject groups, research areas, subject areas according to Destatis

Keywords

  • Data quality, Data stream processing, Smart items