Benchmarking homogenization algorithms for monthly data
Open accessPublished version of a preprint
The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Abstract
The COST (European Cooperation in Science and Technology) Action ES0601: advances in homogenization methods of climate series: an integrated approach (HOME) has executed a blind intercomparison and validation study for monthly homogenization algorithms. Time series of monthly temperature and precipitation were evaluated because of their importance for climate studies and because they represent two important types of statistics (additive and multiplicative). The algorithms were validated against a realistic benchmark dataset. The benchmark contains real inhomogeneous data as well as simulated data with inserted inhomogeneities. Random independent break-type inhomogeneities with normally distributed breakpoint sizes were added to the simulated datasets. To approximate real world conditions, breaks were introduced that occur simultaneously in multiple station series within a simulated network of station data. The simulated time series also contained outliers, missing data periods and local station trends. Further, a stochastic nonlinear global (network-wide) trend was added. Participants provided 25 separate homogenized contributions as part of the blind study. After the deadline at which details of the imposed inhomogeneities were revealed, 22 additional solutions were submitted. These homogenized datasets were assessed by a number of performance metrics including (i) the centered root mean square error relative to the true homogeneous value at various averaging scales, (ii) the error in linear trend estimates and (iii) traditional contingency skill scores. The metrics were computed both using the individual station series as well as the network average regional series. The performance of the contributions depends significantly on the error metric considered. Contingency scores by themselves are not very informative. Although relative homogenization algorithms typically improve the homogeneity of temperature data, only the best ones improve precipitation data. Training the users on homogenization software was found to be very important. Moreover, state-of-the-art relative homogenization algorithms developed to work with an inhomogeneous reference are shown to perform best. The study showed that automatic algorithms can perform as well as manual ones.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures








Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For instance, [5, 6] demonstrated that inconsistencies in data collection practices contribute to significant biases in climate datasets, affecting the accuracy of climate modelling and predictive analyses. These biases can propagate through climate models, reducing the reliability of future projections, especially in data-scarce regions.”
From Exploratory data analysis of Burkina Faso’s Raw daily meteorological records (1981–2021): data quality insights and potential outlier screening (2026) · cites this paper as [5]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The PHA has undergone extensive evaluation and benchmarking (e.g., Menne and Williams 2009; Venema et al. 2012; Williams et al. 2012) and has been shown to be effective at finding a wide variety of shifts in realistic simulated monthly temperature datasets.”
From The Global Historical Climatology Network Monthly Temperature Dataset, Version 4 (2018) · cites this paper as Venema et al. 2012
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Long-term station records are often subjected to inhomogeneities due to factors like station relocation, observation time change, instrument change, and surrounding environment change (Venema et al., 2012).”
From SCDNA: a serially complete precipitation and temperature dataset for North America from 1979 to 2018 (2020) · cites this paper as Venema et al., 2012
The cited source says what the claim attributes to it.
In the citing paper
“Different methods could generate different estimates of inhomogeneities as shown by many comparison studies (e.g., Beaulieu et al., 2008; Reeves et al., 2007; Venema et al., 2012).”
From SCDNA: a serially complete precipitation and temperature dataset for North America from 1979 to 2018 (2020) · cites this paper as Venema et al., 2012
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Locally Weighted Regression: An Approach to Regression Analysis by Local Fitting
Cleveland, W. S., & Devlin, S. J. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478639 · Cited by 5,742
Solomon, S. (2007) · Medical Entomology and Zoology · Cited by 4,149
IPCC (2007): Climate Change The Physical Science Basis
Solomon, S. (2007) · AGU Fall Meeting Abstracts · Cited by 3,476
Observations: Surface and Atmospheric Climate Change
Trenberth, K. E., Jones, P. D., Ambenje, P., Bojariu, R., Easterling, D. R., Tank, A. K., Parker, D., Rahimzadeh, F., Renwick, J. A., Rusticucci, M., et al. (2007) · elib (German Aerospace Center) · Cited by 2,370
A homogeneity test applied to precipitation data.
Alexandersson, H. (1986) · Journal of Climatology · doi:10.1002/joc.3370060607 · Cited by 1,858
Improved Surrogate Data for Nonlinearity Tests
Schreiber, T., & Schmitz, A. (1996) · Physical Review Letters · doi:10.1103/physrevlett.77.635 · Cited by 1,506
Some methods for testing the homogeneity of rainfall records
Buishand, T. A. (1982) · Journal of Hydrology · doi:10.1016/0022-1694(82)90066-x · Cited by 1,234
HISTALP—historical instrumental climatological surface time series of the Greater Alpine Region
Auer, I., Böhm, R., Jurkovic, A., Lipa, W., Orlik, A., Potzmann, R., Schöner, W., Ungersböck, M., Matulla, C., Briffa, K., et al. (2007) · International Journal of Climatology · doi:10.1002/joc.1377 · Cited by 1,133
Self-citationHomogeneity adjustments ofin situ atmospheric climate data: a review
Peterson, T. C., Easterling, D. R., Karl, T. R., Groisman, P., Nicholls, N., Plummer, N., Torok, S., Auer, I., Boehm, R., Gullett, D., et al. (1998) · International Journal of Climatology · doi:10.1002/(sici)1097-0088(19981115)18:13<1493::aid-joc329>3.0.co;2-t · Cited by 789
Self-citationHOMOGENIZATION OF SWEDISH TEMPERATURE DATA. PART I: HOMOGENEITY TEST FOR LINEAR TRENDS
ALEXANDERSSON, H., & MOBERG, A. (1997) · International Journal of Climatology · doi:10.1002/(sici)1097-0088(199701)17:1<25::aid-joc103>3.0.co;2-j · Cited by 669
Research works printed but not linked: 8
- Domonkos, P.: Testing of homogenisation methods: purposes, tools and problems of implementation. Proceedings of the 5 th Semi- nar and Quality Control in Climatological Databases, edited by:
- HMS: Hungarian Meteorological Service. Proceedings of the First Seminar for homogenization of Surface Climatological Data, Bu- dapest, Hungary, 6-12 October 1996, p. 44, 1996.
- Mestre, O.: Step-by-step procedures for choosing a model with change-points. In Proceedings of the second seminar for ho- mogenisation of surface climatological data, Budapest, Hungary, WCDMP-No.41, WMO-TD No. 962, 15-26, 1999.
- Szentimrey, T.: Multiple Analysis of Series for homogenization (MASH). Proceedings of the second seminar for homogenization of surface climatological data, Budapest, Hungary, WMO, WCDMP-No. 41, 27-46, 1999.
- Szentimrey, T.: Development of MASH homogenization pro- cedure for daily data. Proceedings of the fifth seminar for homogenization and quality control in climatological databases, Budapest, Hungary, 2006, WCDMP-No. 71, 123-130, 2008.
- WMO: Proceedings of the Second Seminar for homogenization of Surface Climatological Data. Budapest, Hungary, 9-13 Novem- ber 1998, p. 214, 1999.
- WMO: Proceedings of the Fifth Seminar for homogenization and Quality Control in Climatological Databases. Budapest, Hungary, 29 May–2 June 2006. Climate Data and Monitoring WCDMP- No 71, WMO/TD- No. 1493, 2006.
- WMO: Fourth Seminar for homogenization and Quality Control in Climatological Databases. Budapest, Hungary, 6-10 October 2003, WCDMP-No 56, WMO-TD No. 1236, p. 243, 2004. WMO: Proceedings of the Fifth Seminar for homogenization and Quality Control in Climatological Databases. Budapest, Hun- gary, 29 May-2 June 2006. Climate Data and Monitoring WCDMP-No 71, WMO/TD-No. 1493, 2006. WMO: Proceedings of the Sixth Seminar for homogenization and Quality Control in Climatological Databases. Budapest, Hun- gary, 26-30 2008, edited by: Lakatos, M., Szentimrey, T., Bihari, Z., and Szalai, S., WCDMP-No. 76, WMO/TD-NO. 1576, 2011.
Cited by
Items 401–407 of 407
Bini, M., & Luppichini, M. (2026) · Theoretical and Applied Climatology · doi:10.1007/s00704-026-06599-9
Planning to cope with tropical and subtropical climate change
Tiepolo, M., Ponte, E., Cristofori, E., Tiepolo, M., Ponte, E., & Cristofori, E. I. (2016) · PORTO@Iris · Cited by 4
Nájera, J. B., Martinez, M. J. M., Albores, M. Á. G., & Méndez-Bahena, A. (2025) · Foro de estudios de guerrero. · doi:10.62384/fesgro.v11.1.14
An integrated framework for assessing the fidelity of climate reanalysis data for urban applications
Zokaei, A. (2026) · Spectrum Research Repository (Concordia University)
Jims, A., Marjuk, M. S., & Philip, F. M. (2026) · International Journal of Climatology · doi:10.1002/joc.70643
Are Climate Changes and Extremes Responsible for Changes in Vegetation Phenology in South Africa?
Cramer, M. D., Hawkins, H., von Holdt, J. R. C., & Hoffman, M. T. (2026) · Austral Ecology · doi:10.1111/aec.70302
Leštianska, A., Fleischer, P., Merganičová, K., & Střelcová, K. (2026) · Agricultural and Forest Meteorology · doi:10.1016/j.agrformet.2026.111591
Metadata
- Authors
- Venema, V. K. C., Mestre, O., Aguilar, E., Auer, I., Guijarro, J. A., Domonkos, P., Vertacnik, G., Szentimrey, T., Stepanek, P., Zahradnicek, P., Viarre, J., Müller-Westermeier, G., Lakatos, M., Williams, C. N., Menne, M. J., Lindau, R., Rasol, D., Rustemeier, E., Kolokythas, K., Marinova, T., Andresen, L., Acquaotta, F., Fratianni, S., Cheval, S., Klancar, M., Brunetti, M., Gruber, C., Prohom Duran, M., Likso, T., Esteban, P., & Brandsma, T.
- Affiliations
- University of Bonn (DE)
- École Nationale de la Météorologie (FR)
- Universitat Rovira i Virgili (ES)
- Central Institution for Meteorology and Geodynamics (AT)
- Agencia Estatal de Meteorología (ES)
- Hungarian Meteorological Service (HU)
- National Oceanic and Atmospheric Administration (US)
- Croatian Meteorological and Hydrological Service (HR)
- University of Patras (GR)
- Bulgarian Academy of Sciences (BG)
- Norwegian Meteorological Institute (NO)
- University of Turin (IT)
- National Institute for Research and Development in Environmental Protection (RO)
- Slovenian Environment Agency (SI)
- Institute of Atmospheric Sciences and Climate (IT)
- Universitat de Barcelona (ES)
- Royal Netherlands Meteorological Institute (NL)
- ORCID
- Venue
- Climate of the Past
- Publisher
- Copernicus GmbH
- Published
- 2012-01-10
- Volume
- 8
- Issue
- 1
- Pages
- 89-115
- ISSN
- 1814-9324 (ISSN-L)
- 1814-9332
- OpenAlex
- W2734645652
- Cited by
- 368
- References
- 50
- Citations by year
- 2026: 14 · 2025: 21 · 2024: 19 · 2023: 22 · 2022: 23 · 2021: 23 · 2020: 20 · 2019: 21 · 2018: 28 · 2017: 25 · 2016: 35 · 2015: 32 · 2014: 33 · 2013: 25 · 2012: 25
- FWCI
- 30.58
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Climate of the past (publishedVersion, cc-by)
- Institutional Research Information System University of Turin (University of Turin) (submittedVersion, cc-by)
- Institutional Research Information System University of Turin (University of Turin) (submittedVersion, other-oa)
- ASEP (submittedVersion, public-domain)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- European Commission
- Deutsche Forschungsgemeinschaft
- Topics
- Physical Sciences › Environmental Science › Global and Planetary Change › Climate variability and models
- Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Precipitation Measurement and Analysis
- Physical Sciences › Environmental Science › Environmental Engineering › Urban Heat Island Mitigation
- Keywords
- monthly temperature data, linear trend estimation, station network
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.