The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Mean Squared Error, Deconstructed
Open accessAbstract
As science becomes increasingly cross‐disciplinary and scientific models become increasingly cross‐coupled, standardized practices of model evaluation are more important than ever. For normally distributed data, mean squared error (MSE) is ideal as an objective measure of model performance, but it gives little insight into what aspects of model performance are “good” or “bad.” This apparent weakness has led to a myriad of specialized error metrics, which are sometimes aggregated to form a composite score. Such scores are inherently subjective, however, and while their components may be interpretable, the composite itself is not. We contend that, a better approach to model benchmarking and interpretation is to decompose MSE into interpretable components. To demonstrate the versatility of this approach, we outline some fundamental types of decomposition and apply them to predictions at 1,021 streamgages across the conterminous United States from three streamflow models. Through this demonstration, we hope to show that each component in a decomposition represents a distinct concept, like “season” or “variability,” and that simple decompositions can be combined to represent more complex concepts, like “seasonal variability,” creating an expressive language through which to interrogate models and data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879
River flow forecasting through conceptual models part I — A discussion of principles
Nash, J. E., & Sutcliffe, J. V. (1970) · Journal of Hydrology · doi:10.1016/0022-1694(70)90255-6 · Cited by 23,674
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1998) · Springer Series in Statistics · doi:10.1007/978-1-4612-1694-0_15 · Cited by 17,781
An algorithm for the machine calculation of complex Fourier series
Cooley, J. W., & Tukey, J. W. (1965) · Mathematics of Computation · doi:10.1090/s0025-5718-1965-0178586-1 · Cited by 13,154
Gupta, H. V., Kling, H., Yilmaz, K. K., & Martinez, G. F. (2009) · Journal of Hydrology · doi:10.1016/j.jhydrol.2009.08.003 · Cited by 6,758
Neural Networks and the Bias/Variance Dilemma
Geman, S., Bienenstock, E., & Doursat, R. (1992) · Neural Computation · doi:10.1162/neco.1992.4.1.1 · Cited by 3,578 · cited 1×
“A classic example being the decomposition of MSE into bias and variance (Geman et al., 1992),”
BackgroundSTL : A Seasonal-Trend Decomposition Procedure Based on Loess
Cleveland, R. B. (1990) · Medical Entomology and Zoology · Cited by 2,244
Development and test of the distributed HBV-96 hydrological model
Lindström, G., Johansson, B., Persson, M., Gardelin, M., & Bergström, S. (1997) · Journal of Hydrology · doi:10.1016/s0022-1694(97)00041-3 · Cited by 1,131
One decade of multi-objective calibration approaches in hydrological modelling: a review
Efstratiadis, A., & Koutsoyiannis, D. (2010) · Hydrological Sciences Journal · doi:10.1080/02626660903526292 · Cited by 479
Cited by
Root-mean-square error (RMSE) or mean absolute error (MAE): when to use them or not
Hodson, T. O. (2022) · Geoscientific Model Development · doi:10.5194/gmd-15-5481-2022 · Cited by 2,269
Self-citation
Metadata
- Authors
- Hodson, T. O., Over, T. M., & Foks, S. S.
- Venue
- Journal of Advances in Modeling Earth Systems
- Publisher
- American Geophysical Union (AGU)
- Published
- 2021-12
- Volume
- 13
- Issue
- 12
- ISSN
- 1942-2466 (ISSN-L)
- OpenAlex
- W3216316500
- Cited by
- 278
- References
- 16
- FWCI
- 7.18
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Mean Squared Error, Deconstructed. https://app.cochat.ai/papers/10.1029/2021ms002681
- The paper
- Hodson, T. O., Over, T. M., & Foks, S. S. (2021). Mean Squared Error, Deconstructed. Journal of Advances in Modeling Earth Systems. https://doi.org/10.1029/2021ms002681
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.