Quality control in weather monitoring with dynamic linear models
Open accessAbstract
Decisions in agriculture are frequently based on weather. With an increase in the availability and affordability of off-the-shelf weather stations, farmers able to acquire localised weather information. However, with uncertainty in the sensor and installation quality, farmers are at risk of making poor decisions based on incorrect data. We present an automated approach to perform quality control on weather sensors. Our approach uses time-series modelling and data fusion with Bayesian principles to provide predictions with uncertainty quantification. These predictions and uncertainty are used to estimate the validity of a sensor observation. We test on temperature, wind, and humidity data and achieve error hit rates above 80% and false negative rates below 11%.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
No references could be resolved yet.
Research works printed but not linked: 13
- [1][1] Carson Kai-Sang Leung, Mark Anthony F. Mateo, and Andrew J. Nadler. An effectivemultilayer model for controlling the quality of data. In 11th International Database Engineering and Applications Symposium (IDEAS 2007) , pages 28-36, 2007. doi: 10.1109/IDEAS.2007. 4318086. - · DOI
- [2][2] Kenneth G. Hubbard, Nathaniel B. Guttman, Jinsheng You, and Zhirong Chen. An improved qc process for temperature in the daily cooperative weather observations. Journal of Atmospheric and Oceanic Technology , 24(2):206 - 213, 2007. doi: 10.1175/JTECH1963.1. - · DOI
- [3][3] Mark Anthony F. Mateo and Carson Kai-Sang Leung. Design and development of a prototype system for detecting abnormal weather observations. In Proceedings of the 2008 C3S2E Conference , C3S2E '08, page 45-59, New York, NY, USA, 2008. Association for Computing Machinery. ISBN 9781605581019. doi: 10.1145/1370256.1370264. - · DOI
- [4][4] E. Beele, M. Reyniers, R. Aerts, and B. Somers. Quality control and correction method for air temperature data from a citizen science weather station network in leuven, belgium. Earth System Science Data , 14(10):4681-4717, 2022. doi: 10.5194/essd-14-4681-2022. - · DOI
- [5][5] Fred Meier, Daniel Fenner, Tom Grassmann, Marco Otto, and Dieter Scherer. Crowdsourcing air temperature from citizen weather stations for urban climate research. Urban Climate , 19: 170-191, 2017. ISSN 2212-0955. doi: https://doi.org/10.1016/j.uclim.2017.01.006. - · DOI
- [6][6] Adrien Napoly, Tom Grassmann, Fred Meier, and Daniel Fenner. Development and application of a statistically-based quality control for crowdsourced air temperature data. Frontiers in Earth Science , 6, 2018. ISSN 2296-6463. doi: 10.3389/feart.2018.00118. - · DOI
- [7][7] K.P. Murphy. Machine Learning: A Probabilistic Perspective . Adaptive Computation and Machine Learning series. MIT Press, 2012. ISBN 9780262018029. -
- [8][8] Jo-Anne Ting, Evangelos Theodorou, and Stefan Schaal. Learning an outlier-robust kalman filter. In Joost N. Kok, Jacek Koronacki, Raomon Lopez de Mantaras, Stan Matwin, Dunja Mladenic, and Andrzej Skowron, editors, Machine Learning: ECML 2007 , pages 748-756, Berlin, Heidelberg, 2007. Springer Berlin Heidelberg. ISBN 978-3-540-74958-5. -
- [9][9] Fan Zhang and Yu Liu. Study on quality control method of using the kalman filtering. In 2009 International Conference on E-Business and Information System Security , pages 1-5, 2009. doi: 10.1109/EBISS.2009.5138092. - · DOI
- [10][10] Soojin Roh, Marc G. Genton, Mikyoung Jun, Istvan Szunyogh, and Ibrahim Hoteit. Observation quality control with a robust ensemble kalman filter. Monthly Weather Review , 141(12): 4414 - 4428, 2013. doi: 10.1175/MWR-D-13-00091.1. - · DOI
- [11][11] G. Evensen. Data Assimilation: The Ensemble Kalman Filter . Earth and Environmental Science. Springer Berlin Heidelberg, 2009. ISBN 9783642037115. -
- [12][12] M. West and J. Harrison. Bayesian Forecasting and Dynamic Models . Springer Series in Statistics. Springer New York, 2006. ISBN 9780387227771. -
- [13][13] A.V. Oppenheim and R.W. Schafer. Discrete-time Signal Processing . Prentice-Hall signal processing series. Pearson, 2010. ISBN 9780132067096. -
Cited by
Sorted by citations
Zamantakonè Ki, G., Bawindsom Kébré, M., Somda, W., Gandema, S., & Dabilgou, F. (2026) · Environmental Research Communications · doi:10.1088/2515-7620/ae68f0 · Cited by 1 · see citing works
- Authors
- Dabrowski, J. J., Rahman, A., Li, M., Shao, Q., Bakar, S., Powell, A., & Henderson, B.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2211.04528
- OpenAlex
- W4308756426
- Cited by
- 1
- References
- 0
- Citations by year
- 2023: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Life Sciences › Agricultural and Biological Sciences › Plant Science › Smart Agriculture and AI
- Physical Sciences › Engineering › Control and Systems Engineering › Advanced Sensor and Control Systems
- Physical Sciences › Earth and Planetary Sciences › Geology › Environmental Monitoring and Data Management
- Keywords
- weather monitoring, dynamic linear models, Bayesian fusion, uncertainty quantification, sensor validation, agricultural decision support, temperature, wind, humidity, time series modeling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
