The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Comparing Simulated and Measured Values Using Mean Squared Deviation and its Components
Abstract
When output (x) of a mechanistic model is compared with measurement (y), it is common practice to calculate the correlation coefficient between x and y, and to regress y on x. There are, however, problems in this approach. The assumption of the regression, that y is linearly related to x, is not guaranteed and is unnecessary for the x–y comparison. The correlation and regression coefficients are not explicitly related to other commonly used statistics [e.g., root mean squared deviation (RMSD)]. We present an approach based on the mean squared deviation (MSD = RMSD 2) and show that it is better suited to the x–y comparison than regression. Mean squared deviation is the sum of three components: squared bias (SB), squared difference between standard deviations (SDSD), and lack of correlation weighted by the standard deviations (LCS). To show examples, the MSD‐based analysis was applied to simulation vs. measurement comparisons in literature, and the results were compared with those from regression analysis. The analysis of MSD clearly identified the simulation vs. measurement contrasts with larger deviation than others; the correlation–regression approach tended to focus on the contrasts with lower correlation and regression line far from the equality line. It was also shown that results of the MSD‐based analysis were easier to interpret than those of regression analysis. This is because the three MSD components are simply additive and all constituents of the MSD components are explicit. This approach will be useful to quantify the deviation of calculated values obtained with this model from measurements.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2005) · Technometrics · doi:10.1198/tech.2005.s303 · Cited by 17,923
Hahn, G. J., Draper, N., & Smith, H. (1982) · Technometrics · doi:10.2307/1267833 · Cited by 5,773
Applied Regression Analysis (2nd ed).
de Carvalho, J. F., Draper, N. R., & Smith, H. (1981) · Journal of the American Statistical Association · doi:10.2307/2287608 · Cited by 3,044
Verification, Validation, and Confirmation of Numerical Models in the Earth Sciences
Oreskes, N., Shrader-Frechette, K., & Belitz, K. (1994) · Science · doi:10.1126/science.263.5147.641 · Cited by 3,010
Introduction to The Theory of Statistics.
Theobald, C. M., & Larson, H. J. (1974) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2345153 · Cited by 762
Mean squared error of prediction as a criterion for evaluating and comparing system models
Wallach, D., & Goffinet, B. (1989) · Ecological Modelling · doi:10.1016/0304-3800(89)90035-5 · Cited by 315
Addiscott, T. M., & Whitmore, A. P. (1987) · The Journal of Agricultural Science · doi:10.1017/s0021859600081089 · Cited by 306
Jamieson, P. D., Porter, J. R., Goudriaan, J., Ritchie, J. T., van Keulen, H., & Stol, W. (1998) · Field Crops Research · doi:10.1016/s0378-4290(97)00060-9 · Cited by 262
A Sunflower Simulation Model: I. Model Development
Chapman, S. C., Hammer, G., & Meinke, H. (1993) · Agronomy Journal · doi:10.2134/agronj1993.00021962008500030038x · Cited by 157
Evaluation of Two Maize Models for Nine U.S. Locations
Kiniry, J. R., Williams, J. R., Vanderlip, R. L., Atwood, J. D., Reicosky, D. C., Mulliken, J., Cox, W. J., Mascagni, H. J., Hollinger, S. E., & Wiebold, W. J. (1997) · Agronomy Journal · doi:10.2134/agronj1997.00021962008900030009x · Cited by 145
Cited by
How to evaluate models: Observed vs. predicted or predicted vs. observed?
Piñeiro, G., Perelman, S., Guerschman, J. P., & Paruelo, J. M. (2008) · Ecological Modelling · doi:10.1016/j.ecolmodel.2008.05.006 · Cited by 891
Assessment of the adequacy of mathematical models
Tedeschi, L. O. (2006) · Agricultural Systems · doi:10.1016/j.agsy.2005.11.004 · Cited by 754
Yang, J. M., Yang, J. Y., Liu, S., & Hoogenboom, G. (2014) · Agricultural Systems · doi:10.1016/j.agsy.2014.01.008 · Cited by 355
Rötter, R. P., Palosuo, T., Kersebaum, K. C., Angulo, C., Bindi, M., Ewert, F., Ferrise, R., Hlavinka, P., Moriondo, M., Nendel, C., et al. (2012) · Field Crops Research · doi:10.1016/j.fcr.2012.03.016 · Cited by 349
Dong, Y.-W., Liao, M.-L., Meng, X.-L., & Somero, G. N. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1718910115 · Cited by 318
Model Evaluation by Comparison of Model‐Based Predictions and Measured Values
Gauch, H. G., Hwang, J. T. G., & Fick, G. W. (2003) · Agronomy Journal · doi:10.2134/agronj2003.1442 · Cited by 317
Regional yield estimation for winter wheat with MODIS-NDVI data in Shandong, China
Ren, J., Chen, Z., Zhou, Q., & Tang, H. (2008) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2007.11.003 · Cited by 312
Description and evaluation of the rice growth model ORYZA2000 under nitrogen-limited conditions
Bouman, B. A. M., & van Laar, H. H. (2006) · Agricultural Systems · doi:10.1016/j.agsy.2004.09.011 · Cited by 305
Modeling approaches to estimate effective leaf area index from aerial discrete-return LIDAR
Richardson, J. J., Moskal, L. M., & Kim, S.-H. (2009) · Agricultural and Forest Meteorology · doi:10.1016/j.agrformet.2009.02.007 · Cited by 279
Performance of CERES-Rice and CERES-Wheat models in rice–wheat systems: A review
Timsina, J., & Humphreys, E. (2006) · Agricultural Systems · doi:10.1016/j.agsy.2005.11.007 · Cited by 272
Li, L., Flora, J. R. V., Caicedo, J. M., & Berge, N. D. (2015) · Bioresource Technology · doi:10.1016/j.biortech.2015.03.054 · Cited by 57
Li, L., Wang, Y., Xu, J., Flora, J. R. V., Hoque, S., & Berge, N. D. (2018) · Bioresource Technology · doi:10.1016/j.biortech.2018.04.066 · Cited by 57
Impact of generated solar radiation on simulated crop growth and yield
Garcia y Garcia, A., Guerra, L. C., & Hoogenboom, G. (2008) · Ecological Modelling · doi:10.1016/j.ecolmodel.2007.08.003 · Cited by 49
EVALUATION OF THE EPIC MODEL FOR SIMULATING CROP YIELD AND IRRIGATION DEMAND
Guerra, L. C., Hoogenboom, G., Boken, V. K., Hook, J. E., Thomas, D. L., & Harrison, K. A. (2004) · Transactions of the ASAE · doi:10.13031/2013.17794 · Cited by 23
Richardson, A., & Reddy, K. (2004) · Climate Research · doi:10.3354/cr027085 · Cited by 9
Valuation of Climate Performance of a Low-Tech Greenhouse in Costa Rica
Rojas-Rishor, A., Flores-Velazquez, J., Villagran, E., & Aguilar-Rodríguez, C. E. (2022) · Processes · doi:10.3390/pr10040693 · Cited by 9
SimClone: Detecting Tabular Data Clones Using Value Similarity
Yang, X., Rajbahadur, G. K., Lin, D., Wang, S., & Jiang, Z. M. (. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3676961 · Cited by 3
Metadata
- Authors
- Kobayashi, K., & Salam, M. U.
- Venue
- Agronomy Journal
- Publisher
- Wiley
- Published
- 2000-03
- Volume
- 92
- Issue
- 2
- Pages
- 345-352
- ISSN
- 0002-1962 (ISSN-L)
- 1435-0645
- OpenAlex
- W1987874405
- Cited by
- 591
- References
- 10
- FWCI
- 8.82
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.