Phenomenological forecasting of disease incidence using heteroskedastic Gaussian processes: A dengue case study
Open accessThe DOI matches its Crossref record; 36 of the 38 references it cites were found in a registry or an index, and 2 are not checked yet.
Abstract
of peak week, peak incidence during that week, and total season incidence across each of several seasons. our team was one of the winners of that competition, outperforming other teams in multiple targets/locales. In this paper we report on our methodology, a large component of which, surprisingly, ignores the known biology of epidemics at large-for example, relationships between dengue transmission and environmental factors-and instead relies on flexible nonparametric nonlinear Gaussian process (GP) regression fits that "memorize" the trajectories of past seasons, and then "match" the dynamics of the unfolding season to past ones in real-time. Our phenomenological approach has advantages in situations where disease dynamics are less well understood, or where measurements and forecasts of ancillary covariates like precipitation are unavailable, and/or where the strength of association with cases are as yet unknown. In particular, we show that the GP approach generally outperforms a more classical generalized linear (autoregressive) model (GLM) that we developed to utilize abundant covariate information. We illustrate variations of our method(s) on the two benchmark locales alongside a full summary of results submitted by other contest competitors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Variance models were developed for heteroscedastic data scenarios and have been used for decades [13, 14, 18, 40] in fields as diverse as macroeconomics [13], epidemiology [23] and ecology [37].”
From A Bayesian framework to model variance of grain yield response to plant density (2025) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Design and Analysis of Computer Experiments
Sacks, J., Welch, W. J., Mitchell, T. J., & Wynn, H. P. (1989) · Statistical Science · doi:10.1214/ss/1177012413 · Cited by 6,919
Cressie, N. A. C. (1993) · Wiley Series in Probability and Statistics · doi:10.1002/9781119115151 · Cited by 6,507
Strictly Proper Scoring Rules, Prediction, and Estimation
Gneiting, T., & Raftery, A. E. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001437 · Cited by 5,793 · cited 2×
“le range of values { for each of thirteen weeks evenly spanning the season (i.e., one forecast every 4 weeks, starting from week zero). Competition evaluation focused on logarithmic scores (following Gneiting and Raftery, 2007, Example 3) over just the rst 24 weeks. As an example of forecasts for the three targets, re…”
BackgroundMethodMatheron, G. (1963) · Economic Geology · doi:10.2113/gsecongeo.58.8.1246 · Cited by 4,845 · cited 2×
“Gaussian process (GP) regression is an established nonparametric modeling apparatus originating in the spatial statistics literature, where it is also known as kriging [Cressie (1993), Matheron (1963)].”
BackgroundMethodAn Improved In Situ and Satellite SST Analysis for Climate
Reynolds, R. W., Rayner, N. A., Smith, T. M., Stokes, D. C., & Wang, W. (2002) · Journal of Climate · doi:10.1175/1520-0442(2002)015<1609:aiisas>2.0.co;2 · Cited by 4,559 · cited 2×
“Our team obtained current monthly SOI and sea surface temperatures [Reynolds et al. (2002)] and aligned these with the weekly case data to augment our data set.”
MethodMaking and Evaluating Point Forecasts
Gneiting, T. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.r10138 · Cited by 1,154 · cited 3×
“For example, median week, median highest observed weekly incidence, and median sum over the weeks, respectively, are appropriate under the mean-absolute error metric used for contest evaluation [Gneiting (2011)]. However, medians may not be appropriate, for example, when incidences are multimodal (see, e.g, 1998/1999…”
BackgroundMethodModern Applied Statistics with S-Plus
Venables, W. N., & Ripley, B. D. (1994) · Statistics and Computing · doi:10.1007/978-1-4899-2819-1 · Cited by 806
Mordecai, E. A., Cohen, J. M., Evans, M. V., Gudapati, P., Johnson, L. R., Lippi, C. A., Miazgowicz, K., Murdock, C. C., Rohr, J. R., Ryan, S. J., et al. (2017) · PLOS Neglected Tropical Diseases · doi:10.1371/journal.pntd.0005568 · Cited by 785 · cited 2×
“For vector-borne disease, the value of R0 depends on vector (here mosquito) traits such as mortality rates, biting rates, reproduction, etc. Full details of parameterized versions of R0 from data are given by Mordecai et al. (2017).”
BackgroundSelf-citationImpact of daily temperature fluctuations on dengue virus transmission by Aedes aegypti
Lambrechts, L., Paaijmans, K. P., Fansiri, T., Carrington, L. B., Kramer, L. D., Thomas, M. B., & Scott, T. W. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1101377108 · Cited by 710 · cited 1×
“…covariates, as it is widely known that environmental factors impact the dynamics of mosquito vectors and thus transmission [e.g., Barrera, Amador and MacKay (2011), Johansson, Cummings and Glass (2009), Lambrechts et al. (2011), Moore et al. (1978), Stewart-Ibarra et al. (2013), Xu et al. (2016)].”
Background
Research works printed but not linked: 3
- BINOIS, M., GRAMACY, R. B. and LUDKOVSKI, M. (2016). Practical heteroskedastic Gaussian process modeling for large simulation experiments. arXiv preprint, arXiv:1611.05902. · arXiv
- JOHNSON, L. R., GRAMACY, R. B., COHEN, J., MORDECAI, E., MURDOCK, C., ROHR, J., RYAN, S. J., STEWART-IBARRA, A. M. and WEIKEL, D. (2018). Supplement to 'Phenomenological forecasting of disease incidence using heteroskedastic Gaussian processes: A dengue case study.' DOI:10.1214/17-AOAS1090SUPPA, DOI:10.1214/17-AOAS1090SUPPB. · doi:10.1214/17-aoas1090suppb
- GRAMACY, R. B. (2014). laGP : Local approximate Gaussian process regression. R package version 1.1-4. · doi:10.32614/cran.package.lagp
Cited by
An open challenge to advance probabilistic forecasting for dengue epidemics
Johansson, M. A., Apfeldorf, K. M., Dobson, S., Devita, J., Buczak, A. L., Baugher, B., Moniz, L. J., Bagley, T., Babin, S. M., Guven, E., et al. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1909865116 · Cited by 218
“Ensemble approaches were used by almost half the teams (7 of 16) (20, 21, 30) and on average, had better calibration and higher forecast skill than forecasts generated from single models.”
Self-citationBartlow, A. W., Manore, C., Xu, C., Kaufeld, K. A., Del Valle, S., Ziemann, A., Fairchild, G., & Fair, J. M. (2019) · Veterinary Sciences · doi:10.3390/vetsci6020040 · Cited by 162
Understanding how temperature shifts could impact infectious disease
Rohr, J. R., & Cohen, J. M. (2020) · PLoS Biology · doi:10.1371/journal.pbio.3000938 · Cited by 144
Self-citationForecasting dengue epidemics using a hybrid methodology
Chakraborty, T., Chattopadhyay, S., & Ghosh, I. (2019) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2019.121266 · Cited by 125
The Role of Vector Trait Variation in Vector-Borne Disease Dynamics
Cator, L. J., Johnson, L. R., Mordecai, E. A., Moustaid, F. E., Smallwood, T. R. C., LaDeau, S. L., Johansson, M. A., Hudson, P. J., Boots, M., Thomas, M. B., et al. (2020) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2020.00189 · Cited by 135
“Under the previous approach, abundance (V) is directly associated with temperature by fitting a time-series model or where abundance is assumed, a priori, to follow a sinusoidal function (Bacaër and Guernaoui, 2006; Bacaër, 2007; Bacaër and Ouifki, 2007; Bacaër and Ait Dads, 2012; Hoshi et al., 2014; Johnson et al., 2…”
BackgroundMethodSelf-citation
Metadata
- Authors
- Johnson, L. R., Gramacy, R. B., Cohen, J., Mordecai, E., Murdock, C., Rohr, J., Ryan, S. J., Stewart-Ibarra, A. M., & Weikel, D.
- Affiliations
- Virginia Tech (US)
- University of South Florida (US)
- Stanford University (US)
- University of Georgia (US)
- University of Florida (US)
- University of Michigan (US)
- ORCID
- Venue
- The Annals of Applied Statistics
- Publisher
- Institute of Mathematical Statistics
- Published
- 2018-03-01
- Volume
- 12
- Issue
- 1
- Pages
- 27-66
- ISSN
- 1932-6157 (ISSN-L)
- 1941-7330
- PMC
- PMC11017302
- OpenAlex
- W2585052966
- Cited by
- 42
- References
- 37
- Citations by year
- 2026: 2 · 2025: 6 · 2024: 2 · 2023: 2 · 2022: 5 · 2021: 6 · 2020: 9 · 2019: 7 · 2018: 3
- FWCI
- 5.96
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- The Annals of Applied Statistics (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- arXiv (Cornell University) (submittedVersion)
- Project Euclid (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (R01GM109499, 1640780, 1241889, R01TW010286-01, 1518681, 1521702)
- U.S. Department of Defense
- U.S. Department of Health and Human Services
- U.S. Department of Homeland Security
- U.S. Department of Commerce
- Australian Government
- National Science and Technology Council
- National Institutes of Health (EF-1241889)
- National Oceanic and Atmospheric Administration
- Stanford Woods Institute for the Environment
- National Institute of General Medical Sciences (R01GM109499)
- Fogarty International Center (R01TW010286)
- Stanford University Center for Innovation in Global Health
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Mosquito-borne diseases and control
- Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- Health Sciences › Medicine › Epidemiology › Data-Driven Disease Surveillance
- Keywords
- disease incidence forecasting, dengue, nonparametric regression, phenological forecasting, epidemic dynamics, seasonal occurrence, generalized linear models, forecasting competitions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Phenomenological forecasting of disease incidence using heteroskedastic Gaussian processes: A dengue case study. https://app.cochat.ai/papers/10.1214/17-aoas1090
- The paper
- Johnson, L. R., Gramacy, R. B., Cohen, J., Mordecai, E., Murdock, C., Rohr, J., Ryan, S. J., Stewart-Ibarra, A. M., & Weikel, D. (2018). Phenomenological forecasting of disease incidence using heteroskedastic Gaussian processes: A dengue case study. The Annals of Applied Statistics. https://doi.org/10.1214/17-aoas1090
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.