The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Forecasting for COVID-19 has failed
Open accessAbstract
Epidemic forecasting has a dubious track-record, and its failures became more prominent with COVID-19. Poor data input, wrong modeling assumptions, high sensitivity of estimates, lack of incorporation of epidemiological features, poor past evidence on effects of available interventions, lack of transparency, errors, lack of determinacy, consideration of only one or a few dimensions of the problem at hand, lack of expertise in crucial disciplines, groupthink and bandwagon effects, and selective reporting are some of the causes of these failures. Nevertheless, epidemic forecasting is unlikely to be abandoned. Some (but not all) of these problems can be fixed. Careful modeling of predictive distributions rather than focusing on point estimates, considering multiple dimensions of impact, and continuously reappraising models based on their validated performance may help. If extreme values are considered, extremes should be considered for the consequences of multiple dimensions of impact so as to continuously calibrate predictive insights and decision-making. When major decisions (e.g. draconian lockdowns) are based on forecasts, the harms (in terms of health, economy, and society at large) and the asymmetry of risks need to be approached in a holistic fashion, considering the totality of the evidence.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Collaborative, T. O., Williamson, E., Walker, A. J., Bhaskaran, K., Bacon, S., Bates, C., Morton, C. E., Curtis, H. J., Mehrkar, A., Evans, D., et al. (2020) · doi:10.1101/2020.05.06.20092999 · Cited by 6,674 · cited 3×
“Based on available prognostic models (e.g. Williamson et al. (2020)), this prognostic classification should be readily attainable.”
InfluentialFactors associated with COVID-19-related death using OpenSAFELY
Williamson, E. J., Walker, A. J., Bhaskaran, K., Bacon, S., Bates, C., Morton, C. E., Curtis, H. J., Mehrkar, A., Evans, D., Inglesby, P., et al. (2020) · Nature · doi:10.1038/s41586-020-2521-4 · Cited by 6,674
Estimating the effects of non-pharmaceutical interventions on COVID-19 in Europe
Flaxman, S., Mishra, S., Gandy, A., Unwin, H. J. T., Mellan, T. A., Coupland, H., Whittaker, C., Zhu, H., Berah, T., Eaton, J. W., et al. (2020) · Nature · doi:10.1038/s41586-020-2405-7 · Cited by 3,350
Presymptomatic SARS-CoV-2 Infections and Transmission in a Skilled Nursing Facility
Arons, M. M., Hatfield, K. M., Reddy, S. C., Kimball, A., James, A., Jacobs, J. R., Taylor, J., Spicer, K., Bardossy, A. C., Oakley, L. P., et al. (2020) · New England Journal of Medicine · doi:10.1056/nejmoa2008457 · Cited by 2,052
Asymptomatic Transmission, the Achilles’ Heel of Current Strategies to Control Covid-19
Gandhi, M., Yokoe, D. S., & Havlir, D. V. (2020) · New England Journal of Medicine · doi:10.1056/nejme2009758 · Cited by 1,094
Reduced Rate of Hospital Admissions for ACS during Covid-19 Outbreak in Northern Italy
De Filippo, O., D’Ascenzo, F., Angelini, F., Bocchino, P. P., Conrotto, F., Saglietto, A., Secco, G. G., Campo, G., Gallone, G., Verardi, R., et al. (2020) · New England Journal of Medicine · doi:10.1056/nejmc2009166 · Cited by 1,020
Physical interventions to interrupt or reduce the spread of respiratory viruses
Jefferson, T., Del Mar, C. B., Dooley, L., Ferroni, E., Al-Ansary, L. A., Bawazeer, G. A., van Driel, M. L., Nair, N. S., Jones, M. A., Thorning, S., et al. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006207.pub4 · Cited by 805
Huff, D., & Geis, I. (1954) · Cited by 762
The Foot-and-Mouth Epidemic in Great Britain: Pattern of Spread and Impact of Interventions
Ferguson, N. M., Donnelly, C. A., & Anderson, R. M. (2001) · Science · doi:10.1126/science.1061020 · Cited by 671
Tools for Statistical Inference
Rukhin, A. L. (1997) · Technometrics · doi:10.1080/00401706.1997.10485139 · Cited by 659
Cited by
Forecasting: theory and practice
Petropoulos, F., Apiletti, D., Assimakopoulos, V., Babai, M. Z., Barrow, D. K., Ben Taieb, S., Bergmeir, C., Bessa, R. J., Bijak, J., Boylan, J. E., et al. (2022) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2021.11.001 · Cited by 921
Covasim: An agent-based model of COVID-19 dynamics and interventions
Kerr, C. C., Stuart, R. M., Mistry, D., Abeysuriya, R. G., Rosenfeld, K., Hart, G. R., Núñez, R. C., Cohen, J. A., Selvaraj, P., Hagedorn, B., et al. (2021) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1009149 · Cited by 685
Overcoming COVID-19 in China despite shortcomings of the public health system: what can we learn?
Wang, M. M., & Fleßa, S. (2021) · Health Economics Review · doi:10.1186/s13561-021-00319-x · Cited by 6
Prognostic models for COVID-19 needed updating to warrant transportability over time and space
van Klaveren, D., Zanos, T. P., Nelson, J., Levy, T. J., Park, J. G., Retel Helmrich, I. R. A., Rietjens, J. A. C., Basile, M. J., Hajizadeh, N., Lingsma, H. F., et al. (2022) · BMC Medicine · doi:10.1186/s12916-022-02651-3 · Cited by 5
Metadata
- Authors
- Ioannidis, J. P. A., Cripps, S., & Tanner, M. A.
- Venue
- International Journal of Forecasting
- Publisher
- Elsevier BV
- Published
- 2022-04
- Volume
- 38
- Issue
- 2
- Pages
- 423-438
- ISSN
- 0169-2070 (ISSN-L)
- OpenAlex
- W3080376427
- Cited by
- 430
- References
- 36
- FWCI
- 12.21
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Forecasting for COVID-19 has failed. https://app.cochat.ai/papers/10.1016/j.ijforecast.2020.08.004
- The paper
- Ioannidis, J. P. A., Cripps, S., & Tanner, M. A. (2022). Forecasting for COVID-19 has failed. International Journal of Forecasting. https://doi.org/10.1016/j.ijforecast.2020.08.004
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.