CoChat

Sensor data quality: a systematic review

Open access
Teh, Hui Yie, Kempa-Liehr, Andreas W., Wang, Kevin I-Kai · 2020 · Journal of Big Data

The DOI matches its Crossref record; 104 of the 104 references it cites were found in a registry or an index.

Abstract

Sensor data quality plays a vital role in Internet of Things (IoT) applications as they are rendered useless if the data quality is bad. This systematic review aims to provide an introduction and guide for researchers who are interested in quality-related issues of physical sensor data. The process and results of the systematic review are presented which aims to answer the following research questions: what are the different types of physical sensor data errors, how to quantify or detect those errors, how to correct them and what domains are the solutions in. Out of 6970 literatures obtained from three databases (ACM Digital Library, IEEE Xplore and ScienceDirect) using the search string refined via topic modelling, 57 publications were selected and examined. Results show that the different types of sensor data errors addressed by those papers are mostly missing data and faults e.g. outliers, bias and drift. The most common solutions for error detection are based on principal component analysis (PCA) and artificial neural network (ANN) which accounts for about 40% of all error detection papers found in the study. Similarly, for fault correction, PCA and ANN are among the most common, along with Bayesian Networks. Missing values on the other hand, are mostly imputed using Association Rule Mining. Other techniques include hybrid solutions that combine several data science methods to detect and correct the errors. Through this systematic review, it is found that the methods proposed to solve physical sensor data errors cannot be directly compared due to the non-uniform evaluation process and the high use of non-publicly available datasets. Bayesian data analysis done on the 57 selected publications also suggests that publications using publicly available datasets for method evaluation have higher citation rates.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s40537-020-0285-1

Cites

104 of 104 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

4 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 104 references

Research works printed but not linked: 2

  1. Kofod-Petersen A. How to do a structured literature review in computer science. (2015).
  2. Blei DM, Lafferty JD. Topic models. In: Ashok N, Srivastava MS, editors. Text mining. Classification, clustering, and applications. Chapman and Hall/CRC: New York; 2009. p. 71–93.

Cited by

See all 377

Metadata

Authors
Teh, H. Y., Kempa-Liehr, A. W., & Wang, K. I.-K.
Affiliations
University of Auckland (NZ)
Corresponding author
Kempa-Liehr, Andreas W.
Venue
Journal of Big Data
Published
2020-02-11
Volume
7
Issue
1
ISSN
2196-1115 (ISSN-L)
OpenAlex
W3013886221
Cited by
377
References
103
Citations by year
2026: 86 · 2025: 107 · 2024: 76 · 2023: 46 · 2022: 27 · 2021: 27 · 2020: 8
FWCI
3.66
Type
journal article
Language
en
Open access
Licence
Locations
  • Journal Of Big Data (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • Deutsche Forschungsgemeinschaft
  • Albert-Ludwigs-Universität Freiburg
Topics
  • Physical Sciences › Engineering › Control and Systems Engineering › Fault Detection and Control Systems
  • Physical Sciences › Computer Science › Information Systems › Data Quality and Management
  • Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
Keywords
sensor data quality, Internet of Things, missing data, outlier detection, error detection, fault repair, missing data imputation, principal component analysis, artificial neural networks, Bayesian networks, association rule mining, public datasets

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Sensor data quality: a systematic review. https://app.cochat.ai/papers/10.1186/s40537-020-0285-1
The paper
Teh, H. Y., Kempa-Liehr, A. W., & Wang, K. I.-K. (2020). Sensor data quality: a systematic review. Journal of Big Data. https://doi.org/10.1186/s40537-020-0285-1

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.