The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index; 4 of the 8 sources its claims cite were checked for support.
Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature
Open accessPublished version of a preprint
Abstract
Abstract. Both the root mean square error (RMSE) and the mean absolute error (MAE) are regularly employed in model evaluation studies. Willmott and Matsuura (2005) have suggested that the RMSE is not a good indicator of average model performance and might be a misleading indicator of average error, and thus the MAE would be a better metric for that purpose. While some concerns over using RMSE raised by Willmott and Matsuura (2005) and Willmott et al. (2009) are valid, the proposed avoidance of RMSE in favor of MAE is not the solution. Citing the aforementioned papers, many researchers chose MAE over RMSE to present their model evaluation statistics when presenting or adding the RMSE measures could be more beneficial. In this technical note, we demonstrate that the RMSE is not ambiguous in its meaning, contrary to what was claimed by Willmott et al. (2009). The RMSE is more appropriate to represent model performance than the MAE when the error distribution is expected to be Gaussian. In addition, we show that the RMSE satisfies the triangle inequality requirement for a distance metric, whereas Willmott et al. (2009) indicated that the sums-of-squares-based statistics do not satisfy this rule. In the end, we discussed some circumstances where using the RMSE will be more beneficial. However, we do not contend that the RMSE is superior over the MAE. Instead, a combination of metrics, including but certainly not limited to RMSEs and MAEs, are often required to assess model performance.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
This technical note argues against the recommendation by Willmott and Matsuura (2005) and Willmott et al. (2009) to abandon RMSE in favor of MAE, showing that RMSE is not ambiguous in meaning and is more appropriate when errors are expected to be Gaussian. The authors also demonstrate that RMSE satisfies the triangle inequality required of a distance metric, contrary to the earlier claims, while concluding that a combination of metrics is often needed.
Key findings
- RMSE is not ambiguous in its meaning, contrary to Willmott et al. (2009); it is more appropriate than MAE when the error distribution is expected to be Gaussian, whereas MAE suits uniformly distributed errors.
- Using randomly generated zero-mean, unit-variance Gaussian pseudo-errors, RMSEs converge to the true standard deviation (SE = 1) once n ≥ 100, with standard deviation within 5% of truth; MAEs converge to 0.8, approximating the expectation of √(2/π). Neither metric is robust at n = 4 or n = 10.
- RMSE satisfies the triangle inequality required for a distance metric: the example in Willmott et al. (2009) (d(a,c)=4, d(a,b)=2, d(b,c)=3) actually represents the MSE, not the RMSE, and the L2-norm proof in Eqs. (5)–(7) shows RMSE does satisfy it.
- RMSE has practical advantages: it avoids absolute values (useful for gradients/sensitivities and data assimilation cost functions) and is generally better at discriminating among model results by weighting unfavorable conditions more heavily.
Methods
- Technical note / commentary design: no new observational dataset; the argument is analytical, using norm theory (L1- and L2-norms linked to MAE and RMSE) and a proof of the triangle inequality for the L2-norm.
- A Monte Carlo-style demonstration: five sets of pseudo-errors of size n = 4, 10, 100, 1000, 10 000, and 1000 000 drawn from a zero-mean, unit-variance Gaussian distribution with different random seeds, comparing RMSEs and MAEs (Table 1).
- Reference to prior empirical example: Chai et al. (2009) reported RMSE-to-MAE ratios of 1.63 to 2.29 for model NO2 column predictions versus SCIAMACHY satellite observations.
Limitations
- Stated by the authors: the analysis assumes unbiased errors and does not consider uncertainties from observation errors or the method used to compare model and observations; all statistics are less useful with limited sample sizes (e.g., n = 4 or 10), where presenting the errors themselves may be more appropriate; for non-normal distributions, additional moments (mean, variance, skewness, flatness) are needed; outliers several orders larger than other samples may justifiably be removed when sample numbers are limited, and systematic errors may need removal before computing RMSEs.
- Evident from the text: the demonstration relies on synthetic Gaussian pseudo-errors rather than real model–observation comparisons, so the convergence results are conditional on the Gaussian assumption; the authors explicitly do not claim RMSE is superior to MAE, so the note offers guidance rather than a definitive metric selection rule.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
14 Own interpretation · 6 No basis given · 4 Supported · 3 Sources not found · 3 Own result · 1 No full text of the sources · 1 Not checked yet
Every source the paper cites for this claim was checked and supports it.
In the paper
“Using hypothetical sets of four errors, Willmott and Matsuura (2005) demonstrated that while keeping the MAE as a constant of 2.0, the RMSE varies from 2.0 to 4.0.”
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > 1 Introduction
What the sources say
- Supportedcites Willmott and Matsuura (2005) source
Table 1 identifies five hypothetical sets of four errors, and Section 3 says their RMSE increases as the error magnitudes become more variable. The paper gives the bounds as MAE ≤ RMSE ≤ √n × MAE; with four errors and an MAE of 2.0, those bounds are 2.0 and 4.0. Page numbers are unavailable in our copy. (LLM, conf=0.90)
boostedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In addition, we show that the RMSE satisfies the triangle inequality requirement for a distance metric, whereas Willmott et al. (2009) indicated that the sums-ofsquares-based statistics do not satisfy this rule.”
- Also stated in: § 3 Triangle inequality of a metric · boosted
“This proves that RMSE satisfies the triangle inequality required for a distance function metric.”
- Also stated in: § 4 Summary and discussion · boosted
“In addition, we demonstrate that the RMSE satisfies the triangle inequality required for a distance function metric.”
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > Abstract
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 3 Triangle inequality of a metric · boosted
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When the sample size reaches 100 or above, using the calculated RMSEs one can re-construct the error distribution close to its “truth” or “exact solution”, with its standard deviation within 5 % to its truth (i.e., SE = 1).”
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > 2 Interpretation of RMSE and MAE
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: The errors are unbiased and follow a normal distribution when presenting the RMSE.
- The authors state this as an assumption: The uncertainties brought in by observation errors or the method used to compare model and observations are not considered.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For instance, Table 1 shows that neither the RMSEs nor the MAEs are robust when only 4 or 10 samples are used to calculate those values.”
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > 2 Interpretation of RMSE and MAE
plainn = 10- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: The errors are unbiased and follow a normal distribution when presenting the RMSE.
- The authors state this as an assumption: The uncertainties brought in by observation errors or the method used to compare model and observations are not considered.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The RMSE is more appropriate to represent model performance than the MAE when the error distribution is expected to be Gaussian.”
- Also stated in: § 1 Introduction · plain
“When the error distribution is expected to be Gaussian and there are enough samples, the RMSE has an advantage over the MAE to illustrate the error distribution.”
- Also stated in: § 4 Summary and discussion · plain
“We present that the RMSE is not ambiguous in its meaning, and it is more appropriate to use than the MAE when model errors follow a normal distribution.”
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: Model errors are likely to have a normal distribution rather than a uniform distribution.
- Also stated in: § 1 Introduction · plain
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Giving higher weighting to the unfavorable conditions, the RMSE usually is better at revealing model performance differences.”
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > 4 Summary and discussion
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“The L1-norm and L2-norm are closely related to the MAE and the RMSE, respectively, as shown in Eqs. ( 3) and ( 4): Horn and Johnson, 1990).”
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > 3 Triangle inequality of a metric
What the sources say
- Not matchedcites Horn and Johnson, 1990
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
In the paper
“In this technical note, we demonstrate that the RMSE is not ambiguous in its meaning, contrary to what was claimed by Willmott et al. (2009).”
- Also stated in: § 4 Summary and discussion · plain
“We present that the RMSE is not ambiguous in its meaning, and it is more appropriate to use than the MAE when model errors follow a normal distribution.”
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > Abstract
What the sources say
- Not matchedcites Willmott et al. (2009)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4 Summary and discussion · plain
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“One distinct advantage of RMSEs over MAEs is that RM-SEs avoid the use of absolute value, which is highly undesirable in many mathematical calculations.”
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > 4 Summary and discussion
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Similarly, one can readily show that, for several sets of errors with the same RMSE, the MAE would vary from set to set.”
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > 1 Introduction
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Probably not a substantial claim. 10
- It may state two separate claims as one. 2
- The quote only partly states this claim. 1
Every source the paper cites for this claim was checked and supports it.
In the paper
“They summarized that the RMSE tends to become increasingly larger than the MAE (but not necessarily in a monotonic fashion) as the distribution of error magnitudes becomes more variable.”
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > 1 Introduction
What the sources say
- Supportedcites Willmott and Matsuura (2005) source
The Concluding Remarks state the attributed point directly, including the qualification that the increase need not be monotonic. (LLM, conf=0.95)
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“They concluded that the RMSE varies with the variability of the the error magnitudes and the total-error or averageerror magnitude (MAE), and the sample size n.”
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > 1 Introduction
What the sources say
- Supportedcites Willmott and Matsuura (2005) source
The Concluding Remarks state that RMSE depends on error-magnitude variability, MAE, and the square root of sample size. The claim says it varies with sample size n, which accurately conveys that dependence without asserting that the relationship is linear. (LLM, conf=0.93)
boostedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Willmott and Matsuura (2005) have simply proved that the RMSE is not equivalent to the MAE, and one cannot easily derive the MAE value from the RMSE (and vice versa).”
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > 1 Introduction
What the sources say
- Supportedcites Willmott and Matsuura (2005) source
Section 3 describes an inconsistent relationship between MAE and RMSE, including cases where RMSE changes with error-magnitude variance. Section 4 explains that RMSE depends on MAE, the distribution of error magnitudes, and the number of errors. This supports the claim that the measures are not equivalent and that one cannot generally derive either value from the other alone. (LLM, conf=0.90)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Table 1 shows that the MAEs converge to 0.8, an approximation to the expectation of 2 π .”
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > 2 Interpretation of RMSE and MAE
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The quote only partly states this claim.
- The authors state this as an assumption: The errors are unbiased and follow a normal distribution when presenting the RMSE.
- The authors state this as an assumption: The uncertainties brought in by observation errors or the method used to compare model and observations are not considered.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“When both metrics are calculated, the RMSE is by definition never smaller than the MAE.”
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > 1 Introduction
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The MAE is suitable to describe uniformly distributed errors.”
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > 2 Interpretation of RMSE and MAE
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For other kinds of distributions, more statistical moments of model errors, such as mean, variance, skewness, and flatness, are needed to provide a complete picture of the model error variation.”
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > 4 Summary and discussion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
In the paper
“The ratio of RMSE to MAE ranged from 1.63 to 2.29 (see Table 1 of Chai et al., 2009).”
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > 1 Introduction
What the sources say
- Not checked — no full text of the sourcecites Chai et al., 2009 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In many of the model sensitivity studies that use only RMSE, a detailed interpretation is not critical because variations of the same model will have similar error distributions.”
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > 4 Summary and discussion
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“As every statistical measure condenses a large number of data into a single value, it only provides one projection of the model errors emphasizing a certain aspect of the error characteristics of the model performance.”
- Also stated in: § 4 Summary and discussion · plain
“As stated earlier, any single metric provides only one projection of the model errors and, therefore, only emphasizes a certain aspect of the error characteristics.”
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > 1 Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
- Also stated in: § 4 Summary and discussion · plain
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A combination of metrics, including but certainly not limited to RMSEs and MAEs, are often required to assess model performance.”
- Also stated in: § 4 Summary and discussion · plain
“A combination of metrics, including but certainly not limited to RMSEs and MAEs, are often required to assess model performance.”
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
- Also stated in: § 4 Summary and discussion · plain
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“While the MAE gives the same weight to all errors, the RMSE penalizes variance as it gives errors with larger absolute values more weight than errors with smaller absolute values.”
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > 1 Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
The authors state this as an assumption.
The errors are unbiased and follow a normal distribution when presenting the RMSE.
“The underlying assumption when presenting the RMSE is that the errors are unbiased and follow a normal distribution.”
“We also assume the error sample set is unbiased.”
The paper relies on this without support.
Model errors are likely to have a normal distribution rather than a uniform distribution.
“Because model errors are likely to have a normal distribution rather than a uniform distribution, the RMSE is a better metric to present than the MAE for such a type of data.”
The authors state this as an assumption.
The uncertainties brought in by observation errors or the method used to compare model and observations are not considered.
“The uncertainties brought in by observation errors or the method used to compare model and observations are not considered here.”
The paper relies on this without support.
There are often hundreds of observations available to calculate model statistics.
“Fortunately, there are often hundreds of observations available to calculate model statistics, unlike the examples with n = 4 (Willmott and Matsuura, 2005) and n = 10 ( Willmott et al., 2009).”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > 4 Summary and discussion
“| 4 | 0.92, 0.65, 1.48, 1.02, 0.79 0.70, 0.57, 1.33, 1.16, 0.76 | |”
§ Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature > 1 Introduction
“When both metrics are calculated, the RMSE is by definition never smaller than the MAE.”
Citations
Cites
Horn, R. A., & Johnson, C. R. (1985) · Cited by 22,203
David, F. N., & Tukey, J. W. (1977) · Biometrics · doi:10.2307/2529486 · Cited by 12,707
Willmott, C., & Matsuura, K. (2005) · Climate Research · doi:10.3354/cr030079 · Cited by 6,512 · cited 4×
“Further, Willmott et al. (2009) concluded that the sums-of-squaresbased error statistics such as the RMSE and the standard error have inherent ambiguities and recommended the use of alternates such as the MAE.”
BackgroundMethodInfluentialHuber, P. J., & Ronchetti, E. M. (2009) · Wiley series in probability and statistics · doi:10.1002/9780470434697 · Cited by 1,823
Ambiguities inherent in sums-of-squares-based error statistics
Willmott, C. J., Matsuura, K., & Robeson, S. M. (2008) · Atmospheric Environment · doi:10.1016/j.atmosenv.2008.10.005 · Cited by 212 · cited 1×
“Fortunately, there are often hundreds of observations available to calculate model statistics, unlike the examples with n= 4 (Willmott and Matsuura, 2005) and n= 10 (Willmott et al., 2009).”
BackgroundMcKeen, S. A., Wilczak, J. M., Grell, G., et al. (2005) · Journal of Geophysical Research Atmospheres · doi:10.1029/2005jd005858 · Cited by 208
Savage, N., Agnew, P., Davis, L. S., Ordóñez, C., Thorpe, R., Johnson, C. E., O’Connor, F. M., & Dalvi, M. (2013) · Geoscientific model development · doi:10.5194/gmd-6-353-2013 · Cited by 128
Taylor, M. H., Lösch, M., Wenzel, M., et al. (2013) · Journal of Climate · doi:10.1175/jcli-d-13-00089.1 · Cited by 93
Chai, T., Kim, H. C., Lee, P., et al. (2013) · Geoscientific model development · doi:10.5194/gmd-6-1831-2013 · Cited by 87
Self-citationA multi-physics ensemble of present-day climate regional simulations over the Iberian Peninsula
Jerez, S., Montávez, J. P., Jiménez‐Guerrero, P., et al. (2012) · Climate Dynamics · doi:10.1007/s00382-012-1539-1 · Cited by 80 · cited 2×
“(2009) (e.g., Taylor et al., 2013; Chatterjee et al., 2013; Jerez et al., 2013).”
Method
Cited by
Sorted by citations
Items 5,701–5,800 of 7,174
Forecast of the price of jasmine rice with Data Mining Techniques
Comemuang, C., & Orosram, W. (2022) · Journal of Applied Science · doi:10.14416/j.appsci.2022.01.020
Tú, L. H., & Watanabe, H. (2022) · Journal of Hydro-meteorology · doi:10.36335/vnjhm.2022(10).55-63
Year-ahead Ambient Temperature Forecasting in Pharmaceutical Transport Lanes Thermal Conditions
van den Berg, A. P. B., Bootsma, L. R., Bovenberg, T. F. A., Moerbeek, A. R., de Jong, E., Khalil, S., Koch, T., & Dugundji, E. R. (2022) · Procedia Computer Science · doi:10.1016/j.procs.2022.03.035
Nguyen, H.-S., Thi, T. N. P., & Huynh, C.-D. (2022) · Indonesian Journal of Electrical Engineering and Computer Science · doi:10.11591/ijeecs.v28.i1.pp567-576
Parapar, J., Martín-Rodilla, P., Losada, D. E., & Crestani, F. (2022) · Studies in computational intelligence · doi:10.1007/978-3-031-04431-1_14
Algoritmos de Regressão Aplicados à Predição de Casos de Arboviroses no Cariri Paraibano
Lima, J. G. D. S., Prata, P. L. G., Filho, J. G. L., et al. (2022) · doi:10.5753/sbsi_estendido.2022.222294
Estimating the Temperature on the Reinforcing Bars of Composite Slabs Under Fire Conditions
Balsa, C., & Piloto, P. A. G. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16474-3_1
Predicting Swarm Equatorial Plasma Bubbles Via Supervised Machine LearningPreprint
Reddy, S. A., Forsyth, C., Aruliah, A., Kataria, D., Smith, A., Bortnik, J., Aa, E., & Lewis, G. (2022) · arXiv.org · doi:10.48550/arxiv.2209.13482 · Cited by 1
Xu, C., Tian, J., Liu, Z., et al. (2022) · Research Square · doi:10.21203/rs.3.rs-2033451/v1
Evaluating Diversification in Group Recommender Systems
de Oliveira, A. C., & Dur�ão, F. A. (2022) · Annals of Computer Science and Information Systems · doi:10.15439/2022f75
Properties and Microstructure of Concrete with Manufactured Sand
Jiang, Z. (2022) · Springer eBooks · doi:10.1007/978-981-19-6313-1_4
Hartanta, A. J. S. (2022) · Jurnal Teknologi Informatika dan Komputer · doi:10.37012/jtik.v8i1.817
Krishnan, C. N. V., & Wu, M. (2022) · Journal of risk and financial management · doi:10.2139/ssrn.4221934
Role of Knowledge Data Science During COVID‐19 Pandemic
Kumari, H., & Suresh, D. S. (2022) · doi:10.1002/9781119865339.ch14
Vulnerability of rice and maize yield in response to the climate and aerosol variability over IndiaPreprint
GUPTA, D. K. D., Pramanick, S., & Singh, A. K. (2022) · Research Square · doi:10.21203/rs.3.rs-2204861/v1
Molecular Dynamics forecasting of transmembrane Regions in GPRCs by Recurrent Neural Networks
López-Correa, J. M., König, C., & Vellido, A. (2022) · IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI ...) · doi:10.1109/bhi56158.2022.9926945
Xia, I., Singirikonda, N., Hellman, L., et al. (2022) · Research Square · doi:10.21203/rs.3.rs-1969585/v1
Optimal Parameters for Spatial Distribution Modeling of Global Horizontal Solar Radiation in Iraq
Aljaff, M. A. (2022) · Mağallaẗ al-tarbiyaẗ wa-al-ʻilm · doi:10.33899/edusj.2022.135381.1269
Asahina, T., Shimba, K., Kotani, K., & Jimbo, Y. (2022) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2022.109764
Abdulqader, N. N., İşgör, B. S., Genç, A. N., et al. (2022) · Nature Environment and Pollution Technology · doi:10.46488/nept.2022.v21i04.034
Saǧır, S., & ERBAY, Ş. (2022) · Muş Alparslan Üniversitesi Fen Bilimleri Dergisi · doi:10.18586/msufbd.1176184
System vulnerability modeling and assessment in seismic-prone areas using machine learning
Chen, W. (2022) · doi:10.32657/10356/163040 · Cited by 1
Yaddarabullah, Y., & Hermawan, E. (2022) · JISA(Jurnal Informatika dan Sains) · doi:10.31326/jisa.v5i2.1431
On the Feasibility of Machine Learning Models for Customer Spending Prediction Problem
Hoang, K. N., Thanh, L. B., Thuy, T. N. T., Quoc, C. N., & Dang, T. T. (2022) · Communications in computer and information science · doi:10.1007/978-981-19-8069-5_35
PAN RAM Bootstrapping Regressor - A New RAM-Based Architecture for Regression Problems
de Souza, S. M., de Lima, K. P., Lins, A. J. D. C. C., et al. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-21689-3_40
Kasyan, E. A., & Немирович-Данченко, М. М. (2021) · Proceedings of Tomsk State University of Control Systems and Radioelectronics · doi:10.21293/1818-0442-2021-24-3-74-79
An Exploratory Study on Hindcasting with Analogue Ensembles of Principal Components
Balsa, C., Breve, M. M., Rodrigues, C. V., et al. (2022) · Communications in computer and information science · doi:10.1007/978-3-031-20319-0_36
Developed conjugate gradient method in training neural networks to predict verholst model results
alfahady, N. H., Abbo, K. K., & Mahmood, E. M. N. (2022) · AIP conference proceedings · doi:10.1063/5.0093796
Gao, S., Jin, B., & Tao, Z. (2022) · Financial Engineering and Risk Management · doi:10.23977/ferm.2022.050615
Developing Energy Demand Forecasting Methods
Takano, W. Y., & Asada, E. N. (2022) · Springer eBooks · doi:10.1007/978-3-030-72322-4_47-1
A Comparison Study of Fuzzy Transform based Approximation Methods
Min, H.-J., & Jung, H.-Y. (2022) · Joint International Conference on Soft Computing and Intelligent Systems and International Symposium on Advanced Intelligent Systems (SCIS&ISIS) · doi:10.1109/scisisis55246.2022.10002076
Hybrid Filtering Algorithm in Event Manager Partner Recommendation System
Devi, Z. M., Setiawan, N. A., Adji, T. B., et al. (2022) · International Conference on Sustainable Information Engineering and Technology (SIET) · doi:10.1145/3568231.3568248
Modeling surface current circulation in outer Ambon Bay, Moluccas - Indonesia
Noya, Y. A., & Soumokil, R. W. G. (2023) · AIP conference proceedings · doi:10.1063/5.0116526
Raspberry-based Low-resolution Thermal image system using a Smoothing Filter-based Kalman
López-Pérez, M. A., Flores-Fuentes, A. A., Pena-Eguiluz, R., et al. (2022) · IEEE International Autumn Meeting on Power, Electronics and Computing (ROPEC) · doi:10.1109/ropec55836.2022.10018775
Secondary iron ion contamination of water in the water supply network
Wojtkowska, M., & Potyralla, M. (2022) · Desalination and Water Treatment · doi:10.5004/dwt.2022.28970
The Application of Machine Learning for Predicting Global Seismicity
Shkuratskyy, V., Usman, A. B., & O’Dea, M. (2023) · Advances in computer and electrical engineering book series · doi:10.4018/978-1-6684-6937-8.ch011
Suniada, K. I. (2023) · Journal of Marine and Aquatic Sciences · doi:10.24843/jmas.2022.v08.i01.p07
Learning-based wildfire tracking with unmanned aerial vehicles
Jia, Q. (2022) · MOspace Institutional Repository (University of Missouri) · doi:10.32469/10355/93968
Ahmaddoost-rozdari, R., Mahjub, H., Poorolajal, J., & Soltanian, A. (2022) · Iranian South Medical Journal · doi:10.52547/ismj.25.4.340
Conv-LSTM Model for Gold Price Prediction
Sihite, R. M. F., Saadah, S., & Yunanto, P. E. (2022) · International Conference on Software Engineering and Information Technology (ICoSEIT) · doi:10.1109/icoseit55604.2022.10029976
Proceedings of the 5th International Conference on Numerical Modelling in Engineering
Wahab, M. M. A. (2023) · Lecture notes in civil engineering · doi:10.1007/978-981-19-8429-7
Basak, R., Gupta, K. K., Gohil, P. P., Dey, S., & Pandey, K. M. (2023) · Materials Today Proceedings · doi:10.1016/j.matpr.2023.02.088
Internet of Things (IoT) for Soil Moisture Detection Using Time Series Model
Setiawan, I., Junaidi, J., Fadjryani, F., et al. (2022) · Jurnal Online Informatika · doi:10.15575/join.v7i2.951
Face Age Feature Analysis Based on Improved Conditional Adversarial Auto-encoder (I-CAAE)
Li, J.-L. L. J.-L., Li, X.-G. J. J.-L., Jiang, L. H. X.-G., et al. (2023) · 電腦學刊 · doi:10.53106/199115992023023401005
Measuring trends and regimes of rainfall with the use of seasonality patterns in IranPreprint
Javari, M. (2023) · Research Square · doi:10.21203/rs.3.rs-2614090/v1
Tian, J., Qian, Z., Xie, Q., et al. (2022) · International Conference on Machine Learning and Machine Intelligence (MLMI) · doi:10.1145/3568199.3568219
Kill Two Birds with One Stone: Solving Deblurring And Super Resolution with One Neural Network
Feng, M. (2022) · International Conference on Machine Learning and Natural Language Processing (MLNLP) · doi:10.1145/3578741.3578796
Y90 Radyoembolizasyon Tedavisinde Makine Öğrenmesi ile Aktivite Tahmini
Tanyildizi-Kökkülünk, H., Alataş, E., & Tanyıldızı, H. (2023) · Fırat Üniversitesi Mühendislik Bilimleri Dergisi · doi:10.35234/fumbd.1162466
Sharma, A., Sajjad, H., Saha, T. K., Masroor, M., Sharma, Y., & Kumari, G. (2023) · Research Square · doi:10.21203/rs.3.rs-2642250/v1
Explaining the Performance of Collaborative Filtering Methods with Optimal Data Characteristics
Poudel, S., & Bikdash, M. U. (2023) · International Journal on Cybernetics & Informatics · doi:10.5121/ijci.2023.120221
OPABP-Optimizing Parameters, to Improve Accuracy in Bug Prediction using Machine Learning
Srivastava, N., Agarwal, M., Arora, S., et al. (2022) · International Conference on Artificial Intelligence and Speech Technology (AIST) · doi:10.1109/aist55798.2022.10064852
Rasolroveicy, M., & Fokaefs, M. (2023) · doi:10.36227/techrxiv.22312024
Penetration of DWT & ANFIS to Power Transmission Disturbances
Ahmad, S., Zakri, A. A., Oktaviandri, M., et al. (2023) · International Journal of Electrical Energy and Power System Engineering · doi:10.31258/ijeepse.6.1.105-110
Shahne, M. Z., Noori, A., & Attar, M. A. (2023) · Research Square · doi:10.21203/rs.3.rs-2692377/v1
Daki, H., Saad, B., Hannani, A. E., et al. (2023) · Lecture notes in networks and systems · doi:10.1007/978-3-031-28387-1_26
Plavcan, D., Lukau, E., Klafft, M., et al. (2022) · Springer eBooks · doi:10.1007/978-3-658-39796-8_3
Assessing the robustness of multi-criterial recommendation systems
Tekmattla, P., & Valluru, S. T. (2023) · doi:10.1109/aisc56616.2023.10085184
West, R., Bonin, F., Thomas, J., Wright, A. J., Aonghusa, P. M., Gleize, M., Hou, Y., O’Mara-Eves, A., Hastings, J., Johnston, M., et al. (2023) · doi:10.31234/osf.io/wzn2b
Enhancing Resolution of Inferring Hi-C Data Integrating U-Net and ResNet Networks
Zhao, F., Li, N., & Zhong, C. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-29927-8_18
Mewada, S. R., Patel, F. N., & Degadwala, S. (2023) · International Journal of Scientific Research in Computer Science Engineering and Information Technology · doi:10.32628/cseit2139028
Long Short Time Memory in the forecast of financial indices in the Brazilian market (Ibovespa)
Sanchez, M. A. Z. (2022) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.45.2022.tde-12042023-150020
Reverse survival model (RSM): a pipeline for explaining predictions of deep survival models
Rezaei, M. R., Fard, R. S., Pourjafari, E., Ziaei, N., Sameizadeh, A., Shafiee, M., Alavinia, M., Abolghasemian, M., & Sajadi, N. (2023) · Applied Intelligence · doi:10.1007/s10489-023-04577-6
Xia, I., Singirikonda, N., Hellman, L., et al. (2022) · Journal of Student Research · doi:10.47611/jsrhs.v11i4.3710
Implementation of Exploratory Data Analysis on Weather Data
Adivarekar, S., Nanwani, S., Mandal, N., & Sarode, T. (2023) · International Conference on Communication System, Computing and IT Applications (CSCITA) · doi:10.1109/cscita55725.2023.10104864
Solar Energy Forecasting Based on Complex Valued Auto-encoder and Recurrent Neural Network
Rhouma, A., & Said, Y. (2023) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2023.0140443
Predicting temperatures inside a steel slab reheating furnace using Deep Learning
Lima, R. D. S., Scárdua, L. A., & de Almeida, G. M. (2023) · Seven Editora eBooks · doi:10.56238/alookdevelopv1-016
Sharma, R., Eratalay, M. H., Lapitskaya, D., & Nõu, A. (2023) · International Journal of Computational Economics and Econometrics · doi:10.1504/ijcee.2023.10056253
Hydraulic performance of a locally used drip irrigation systems
Rawwash, J., & Alwan, H. H. (2023) · AIP conference proceedings · doi:10.1063/5.0137314
Estimation of Scots pine bark biomass delivered to the wood industry in Northern Germany
Berendt, F., Bajalan, I., Wenig, C., et al. (2023) · Central European Forestry Journal · doi:10.2478/forj-2022-0019
Temperature anomaly detection in Battery Energy Storage System (BESS) using machine learning methods
Utama, P. H. K., Febrina, V. R., Haq, I. N., et al. (2023) · AIP conference proceedings · doi:10.1063/5.0122384
Image stitching using sigmoid function to create perception mask
Ma, M., & Wang, J. (2023) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-230006
Performance of ANN in Predicting the Tensile and Shear Strength of Al-Steel Explosive Clads
Saravanan, & Kumararaja, K. (2023) · Journal of Manufacturing Engineering · doi:10.37255/jme.v18i1pp026-029
Chezzi, A., Colucci, M., Gagić, R., et al. (2023) · Časopis Pomorskog fakulteta Kotor - Journal of Maritime Sciences · doi:10.56080/jms230504
Deák, T., Dobos, E., & Kovács, Z. K. (2023) · IOP Conference Series Earth and Environmental Science · doi:10.1088/1755-1315/1189/1/012025
Billy, U. (2023) · Trends in Renewable Energy · doi:10.17737/tre.2023.9.2.00158
PERBANDINGAN PREDIKSI CURAH HUJAN KUMULATIF BULANAN DENGAN VARIASI WAKTU JEDA (TIME LAG)
Simanjuntak, P. P., & Rozzy, A. F. (2023) · ORBITA Jurnal Pendidikan dan Ilmu Fisika · doi:10.31764/orbita.v9i1.13950
Predicting Cryptocurrency Returns Using Classification and Regression Machine Learning ModelsPreprint
ALSHEHRI, A. S. (2023) · doi:10.31237/osf.io/aecvj
Sitar, N., Dadgostari, F., Whitaker, B. M., et al. (2023) · Intermountain Engineering, Technology and Computing (IETC) · doi:10.1109/ietc57902.2023.10152286
ANALISIS PERFORMANSI ALAT OTOMASI PENYARINGAN AIR SISA PENCUCIAN SURIMI: STUDI KASUS
Kusuma, H. A., Sunardi, U., Nugraha, S., et al. (2023) · TEKTRIKA - Jurnal Penelitian dan Pengembangan Telekomunikasi Kendali Komputer Elektrik dan Elektronika · doi:10.25124/tektrika.v7i2.5815
Qaderi, F., Matan, S., & Khataei, B. (2023) · Iranian Journal of Science and Technology Transactions of Civil Engineering · doi:10.1007/s40996-023-01158-y
Avaliação de Técnicas de Detecção de Pedestres para Veículos Autônomos
Reis, G., Junior, W. V. L., do Rosário, D. L., et al. (2023) · doi:10.5753/wperformance.2023.230699
Coastline Accuracy Assessment Developed By Using Multi Data Source
Oktaviani, N., Hartanto, P., Dewi, R. S., et al. (2023) · Journal of Applied Geospatial Information · doi:10.30871/jagi.v7i1.4761
Adel, S. H., Fatah, K. S., & Sulaiman, M. S. (2023) · Iraqi Journal of Science · doi:10.24996/ijs.2023.64.6.33
Kenoly, T., Wijaya, T., Ramdhani, A., et al. (2023) · Springer proceedings in physics · doi:10.1007/978-981-19-9768-6_44
Ahmed, A. A. M., Jui, S. J. J., AL‐Musaylh, M. S., et al. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4500555
Aieb, A., Liotta, A., & Kadri, I. (2023) · doi:10.3390/engproc2023039055
Study of Coastline Shifts on the West Coast of Lampung Using Remote Sensing Data
Fadly, R., Dewi, C., & Fajriyanto, F. (2023) · JURNAL GEOCELEBES · doi:10.20956/geocelebes.v7i1.23183
Huan, N. H., & Hieu, N. T. D. (2019) · Vietnam Journal of Marine Science and Technology · doi:10.15625/1859-3097/18/4a/13641
Using deep learning via long-short-term memory model prediction of COVID-19 situation in India
Rout, S. K., Sahu, B., Das, A. K., Mohanty, S. N., & Sharma, A. K. (2023) · Elsevier eBooks · doi:10.1016/b978-0-443-19413-9.00010-2
An Adaptive Numerical Approach for Solving Multimodal Transportation Problem in ChinaPreprint
Aljanabi, M. R., Borna, K., & Ghanbari, S. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4537551
Towards an Intelligent Model for Evaluating Serious Games
Omari, K. (2023) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v18i15.40957
MEMILIH KANAL CITRA SENTINEL 2 TERBAIK UNTUK DETEKSI INTRUSI AIR LAUT DI KELURAHAN WAY URANG
Aulia, M., Ghazali, M. F., Dermawan, A., et al. (2023) · JURNAL SAINS INFORMASI GEOGRAFIS · doi:10.31314/jsig.v6i1.1594
Software-Based Mass Customization of Artificial Neural Networks and its Benefits
Rosch-Grace, D., & Straub, J. (2022) · International Conference on Computational Science and Computational Intelligence (CSCI) · doi:10.1109/csci58124.2022.00026
Williamson, R., del Rincón, J. M., Koidis, A., et al. (2023) · Proceedings - IEEE Symposium on Computers and Communications/IEEE Symposium on Computers and Communications · doi:10.1109/iscc58397.2023.10218310
Metadata
- Authors
- Chai, T., & Draxler, R. R.
- Affiliations
- National Oceanic and Atmospheric Administration (US)
- Venue
- Geoscientific Model Development
- Publisher
- Copernicus GmbH
- Published
- 2014-06-30
- Volume
- 7
- Issue
- 3
- Pages
- 1247-1250
- ISSN
- 1991-959X (ISSN-L)
- 1991-9603
- OpenAlex
- W2102148524
- Semantic Scholar
- 8c42db1839098b46f18265907464c16e49bb7a1c
- Cited by
- 7,178
- References
- 12
- Citations by year
- 2026: 1015 · 2025: 1120 · 2024: 980 · 2023: 873 · 2022: 751 · 2021: 683 · 2020: 538 · 2019: 411 · 2018: 324 · 2017: 235 · 2016: 175 · 2015: 59 · 2014: 13
- FWCI
- 106.31
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Geoscientific model development (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Oceanic and Atmospheric Administration (NA09NES4400006)
- Topics
- Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations
- Physical Sciences › Environmental Science › Water Science and Technology › Hydrology and Watershed Management Studies
- Social Sciences › Decision Sciences › Management Science and Operations Research › Forecasting Techniques and Applications
- Keywords
- root mean square error, mean absolute error, model evaluation metrics, error distribution, Gaussian errors, triangle inequality, distance measures, model evaluation, hydrological model evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-17, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-17 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
