Objective quality control of observations using Bayesian methods. Theory, and a practical implementation
The DOI matches its Crossref record.
Abstract
This work attempts to provide a theoretical framework for the quality control of data from a large variety of types of observations, with different accuracies and reliabilities. Bayes' theorem is introduced, and is used in a simple example with Gaussian error distributions to derive the well‐known formula for the combination of data with errors. A simple model is proposed whereby the error in each datum is either from a known Gaussian distribution, or a gross error, in which case the observation gives no useful information. Bayes' theorem is applied to this, and it is shown that usual operational practice, which is to reject outlying data and to treat the rest as if their errors are Gaussian, is a reasonable approximation to the correct Bayesian analysis. Appropriate rejection criteria are derived in terms of the observational error and the prior probability of a gross error. These ideas have been implemented in a computer program to check pressure, wind, temperature and position data from ships, weather ships, buoys and coastal synoptic reports. Historical information on the accuracies and reliabilities of various classifications of observation is used to provide prior estimates of observational errors and the prior probabilities of gross error. The latter are then updated in the light of information from a current forecast, and from nearby observations (allowing for the inaccuracies and possible gross errors in these) to give new estimates. The final probabilities can be used to reject or accept the data in an objective analysis. Results from trials of this system are given. It is shown to be possible using an archive generated by the system to update the prior error statistics necessary to make the method truly objective. Some practical case studies are shown, and compared with careful human quality control.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Atmospheric Modeling, Data Assimilation and Predictability
Kalnay, E. (2002) · doi:10.1017/cbo9780511802270 · Cited by 3,391
Quality Control and Flux Sampling Problems for Tower and Aircraft Data
Vickers, D., & Mahrt, L. (1997) · Journal of Atmospheric and Oceanic Technology · doi:10.1175/1520-0426(1997)014<0512:qcafsp>2.0.co;2 · Cited by 1,659
Data Assimilation in Meteorology and Oceanography
Ghil, M., & Malanotte-Rizzoli, P. (1991) · Advances in Geophysics · doi:10.1016/s0065-2687(08)60442-2 · Cited by 919
The potential of the ensemble Kalman filter for NWP—a comparison with 4D‐Var
Lorenc, A. C. (2003) · Quarterly Journal of the Royal Meteorological Society · doi:10.1256/qj.02.132 · Cited by 751
Self-citationPost-Field Data Quality Control
Foken, T., Göockede, M., Mauder, M., Mahrt, L., Amiro, B., & Munger, W. (2006) · Atmospheric and Oceanographic Sciences Library · doi:10.1007/1-4020-2265-4_9 · Cited by 704
Metadata
- Authors
- Lorenc, A. C., & Hammon, O.
- Venue
- Quarterly Journal of the Royal Meteorological Society
- Publisher
- Wiley
- Published
- 1988-01
- Volume
- 114
- Issue
- 480
- Pages
- 515-543
- ISSN
- 0035-9009 (ISSN-L)
- 1477-870X
- OpenAlex
- W2032649356
- Cited by
- 157
- References
- 0
- FWCI
- 1.41
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Objective quality control of observations using Bayesian methods. Theory, and a practical implementation. https://app.cochat.ai/papers/10.1002/qj.49711448012
- The paper
- Lorenc, A. C., & Hammon, O. (1988). Objective quality control of observations using Bayesian methods. Theory, and a practical implementation. Quarterly Journal of the Royal Meteorological Society. https://doi.org/10.1002/qj.49711448012
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.