The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Root-mean-square error (RMSE) or mean absolute error (MAE): when to use them or not
Open accessAbstract
Abstract. The root-mean-squared error (RMSE) and mean absolute error (MAE) are widely used metrics for evaluating models. Yet, there remains enduring confusion over their use, such that a standard practice is to present both, leaving it to the reader to decide which is more relevant. In a recent reprise to the 200-year debate over their use, Willmott and Matsuura (2005) and Chai and Draxler (2014) give arguments for favoring one metric or the other. However, this comparison can present a false dichotomy. Neither metric is inherently better: RMSE is optimal for normal (Gaussian) errors, and MAE is optimal for Laplacian errors. When errors deviate from these distributions, other metrics are superior.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Analysis of Transformations
Box, G. E. P., & Cox, D. R. (1964) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1964.tb00553.x · Cited by 15,052
Chai, T., & Draxler, R. R. (2014) · Geoscientific Model Development · doi:10.5194/gmd-7-1247-2014 · Cited by 7,178 · cited 12×
“Chai and Draxler (2014) were correct that RMSE is optimal for normally distributed errors, though wrongly suggest that MAE only applies to uniformly distributed errors.”
BackgroundMethodInfluentialHuber, P. J. (1981) · Wiley Series in Probability and Statistics · doi:10.1002/0471725250 · Cited by 7,066 · cited 2×
“In fact, the debate over squared versus absolute error terms had emerged, was subsequently forgotten, and reemerged over the preceding two centuries (Boscovich, 1757; Gauss, 1816; Laplace, 1818; Eddington, 1914; Fisher, 1920), with history given by (Stigler, 1973, 1984), making it one of the oldest questions in statis…”
BackgroundResultWillmott, C., & Matsuura, K. (2005) · Climate Research · doi:10.3354/cr030079 · Cited by 6,512 · cited 2×
“Though Willmott and Matsuura (2005) and Willmott et al. (2009) were correct that MAE is more robust, there are better alternatives.”
BackgroundProbability Theory: The Logic of Science
Jaynes, E. T. (2003) · doi:10.1017/cbo9780511790423 · Cited by 4,045
On the mathematical foundations of theoretical statistics
Fisher, R. A. (1922) · Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character · doi:10.1098/rsta.1922.0009 · Cited by 4,039
The Influence Curve and its Role in Robust Estimation
Hampel, F. R. (1974) · Journal of the American Statistical Association · doi:10.1080/01621459.1974.10482962 · Cited by 2,706
Alternatives to the Median Absolute Deviation
Rousseeuw, P. J., & Croux, C. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476408 · Cited by 1,949
Alternatives to the Median Absolute Deviation
Rousseeuw, P. J., & Croux, C. (1993) · Journal of the American Statistical Association · doi:10.2307/2291267 · Cited by 1,466
Kullback-Leibler information as a basis for strong inference in ecological studies
Burnham, K. P., & Anderson, D. R. (2001) · Wildlife Research · doi:10.1071/wr99107 · Cited by 926
Cited by
Advances and prospects of deep learning for medium-range extreme weather forecasting
Olivetti, L., & Messori, G. (2024) · Geoscientific Model Development · doi:10.5194/gmd-17-2347-2024 · Cited by 65
End-to-end cryo-EM complex structure determination with high accuracy and ultra-fast speed
Wang, J., Tan, C., Gao, Z., Zhang, G., Zhang, Y., & Li, S. Z. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-01056-0 · Cited by 8
Zhang, W., Wei, X., Huang, W.-C., Hui, Z., Wang, C., Gong, M., & Yu, P. S. (2026) · arXiv · doi:10.48550/arxiv.2603.25973
“The best MAE/RMSE often comes from the most semantically aligned single source (notably Electronics ), while mixing in less-related domains can introduce distracting or conflicting information to hinder the prediction.”
Influential
Metadata
- Authors
- Hodson, T. O.
- Venue
- Geoscientific Model Development
- Publisher
- Copernicus GmbH
- Published
- 2022-07-19
- Volume
- 15
- Issue
- 14
- Pages
- 5481-5487
- ISSN
- 1991-959X (ISSN-L)
- 1991-9603
- OpenAlex
- W4285794683
- Cited by
- 2,269
- References
- 19
- FWCI
- 157.35
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Root-mean-square error (RMSE) or mean absolute error (MAE): when to use them or not. https://app.cochat.ai/papers/10.5194/gmd-15-5481-2022
- The paper
- Hodson, T. O. (2022). Root-mean-square error (RMSE) or mean absolute error (MAE): when to use them or not. Geoscientific Model Development. https://doi.org/10.5194/gmd-15-5481-2022
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.