Cited by 120Mosquito-borne diseases and controlClimate Change and Health ImpactsMathematical and Theoretical Epidemiology and Ecology Models

Evaluating the performance of infectious disease forecasts: A comparison of climate-driven and seasonal dengue forecasts for Mexico

Open access
Johansson, Michael A., Reich, Nicholas G., Hota, Aditi, Brownstein, John S., Santillana, Mauricio·2016·Scientific Reports

Abstract

Dengue viruses, which infect millions of people per year worldwide, cause large epidemics that strain healthcare systems. Despite diverse efforts to develop forecasting tools including autoregressive time series, climate-driven statistical and mechanistic biological models, little work has been done to understand the contribution of different components to improved prediction. We developed a framework to assess and compare dengue forecasts produced from different types of models and evaluated the performance of seasonal autoregressive models with and without climate variables for forecasting dengue incidence in Mexico. Climate data did not significantly improve the predictive power of seasonal autoregressive models. Short-term and seasonal autocorrelation were key to improving short-term and long-term forecasts, respectively. Seasonal autoregressive models captured a substantial amount of dengue variability, but better models are needed to improve dengue forecasting. This framework contributes to the sparse literature of infectious disease prediction model evaluation, using state-of-the-art validation techniques such as out-of-sample testing and comparison to an appropriate reference model.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/srep33707

Cites

61 of 61 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Disease surveillance and outbreak forecasting systems can be built from web data and specially-designed apps, in addition to traditional surveys.

    “Disease surveillance and outbreak forecasting systems can be built from web data and specially-designed apps, in addition to traditional surveys [394,467,627].”

    From Tackling climate change with machine learning (2023) · cites this paper as [394]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 1

  1. Rua-Uribe G. L., Suarez-Acosta C., Chauca J., Ventosilla P. & Almanza R. Modelling the effect of local climatic variability on dengue transmission in Medellin (Colombia) by means of time series analysis. Biomedica: revista del Instituto Nacional de Salud 33 Suppl 1, 142– 152 (2013). 24652258

Cited by

Sorted by citations

Authors
Johansson, M. A., Reich, N. G., Hota, A., Brownstein, J. S., & Santillana, M.
Affiliations
  • Centers for Disease Control and Prevention (US)
  • University of Massachusetts Amherst (US)
  • Boston Children's Hospital (US)
Corresponding author
  • Johansson, Michael A.
  • Santillana, Mauricio
Venue
Scientific Reports
Published
2016-09-26
Volume
6
Issue
1
Pages
33707-33707
ISSN
2045-2322 (ISSN-L)
OpenAlex
W2525587339
Cited by
120
References
60
Citations by year
2026: 10 · 2025: 12 · 2024: 11 · 2023: 5 · 2022: 11 · 2021: 10 · 2020: 25 · 2019: 15 · 2018: 12 · 2017: 8 · 2016: 1
FWCI
11.90
Type
journal article
Language
en
Open access
Locations
  • Scientific Reports (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
  • ScholarWorks@UMassAmherst (University of Massachusetts Amherst) (submittedVersion, cc-by)
Funders
  • National Institutes of Health
  • National Institute of General Medical Sciences (U54GM088558)
  • National Institute of Allergy and Infectious Diseases (R01AI102939, R21AI115173, AI102939)
  • U.S. National Library of Medicine (R01LM010812)
Topics
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Mosquito-borne diseases and control
  • Physical Sciences › Environmental Science › Health, Toxicology and Mutagenesis › Climate Change and Health Impacts
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Mathematical and Theoretical Epidemiology and Ecology Models
Keywords
dengue, infectious disease forecasting, seasonal autoregressive model, dengue incidence, forecast evaluation, autocorrelation, out-of-sample validation, Mexico

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review