The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Practical considerations for measuring the effective reproductive number, Rt
Open accessAbstract
Estimation of the effective reproductive number R t is important for detecting changes in disease transmission over time. During the Coronavirus Disease 2019 (COVID-19) pandemic, policy makers and public health officials are using R t to assess the effectiveness of interventions and to inform policy. However, estimation of R t from available data presents several challenges, with critical implications for the interpretation of the course of the pandemic. The purpose of this document is to summarize these challenges, illustrate them with examples from synthetic data, and, where possible, make recommendations. For near real-time estimation of R t , we recommend the approach of Cori and colleagues, which uses data from before time t and empirical estimates of the distribution of time between infections. Methods that require data from after time t , such as Wallinga and Teunis, are conceptually and methodologically less suited for near real-time estimation, but may be appropriate for retrospective analyses of how individuals infected at different time points contributed to the spread. We advise caution when using methods derived from the approach of Bettencourt and Ribeiro, as the resulting R t estimates may be biased if the underlying structural assumptions are not met. Two key challenges common to all approaches are accurate specification of the generation interval and reconstruction of the time series of new infections from observations occurring long after the moment of transmission. Naive approaches for dealing with observation delays, such as subtracting delays sampled from a distribution, can introduce bias. We provide suggestions for how to mitigate this and other technical challenges and highlight open problems in R t estimation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Early dynamics of transmission and control of COVID-19: a mathematical modelling study
Kucharski, A. J., Russell, T. W., Diamond, C., Liu, Y., Edmunds, J., Funk, S., Eggo, R. M., Sun, F., Jit, M., Munday, J. D., et al. (2020) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(20)30144-4 · Cited by 2,671
Self-citationQuantifying SARS-CoV-2 transmission suggests epidemic control with digital contact tracing
Ferretti, L., Wymant, C., Kendall, M., Zhao, L., Nurtay, A., Abeler-Dörner, L., Parker, M., Bonsall, D., & Fraser, C. (2020) · Science · doi:10.1126/science.abb6936 · Cited by 2,512
Pan, A., Liu, L., Wang, C., Guo, H., Hao, X., Wang, Q., Huang, J., He, N., Yu, H., Lin, X., et al. (2020) · JAMA · doi:10.1001/jama.2020.6130 · Cited by 1,931
A New Framework and Software to Estimate Time-Varying Reproduction Numbers During Epidemics
Cori, A., Ferguson, N. M., Fraser, C., & Cauchemez, S. (2013) · American Journal of Epidemiology · doi:10.1093/aje/kwt133 · Cited by 1,530 · cited 8×
“If the fraction 222 of infections observed is constant over time, Rt point estimates will remain accurate and unbiased despite 223 incomplete observation [12, 14].”
BackgroundMethodInfluentialTransmission Dynamics and Control of Severe Acute Respiratory Syndrome
Lipsitch, M., Cohen, T., Cooper, B., Robins, J. M., Ma, S., James, L., Gopalakrishna, G., Chew, S. K., Tan, C. C., Samore, M. H., et al. (2003) · Science · doi:10.1126/science.1086616 · Cited by 1,485
Self-citationHow generation intervals shape the relationship between growth rates and reproductive numbers
Wallinga, J., & Lipsitch, M. (2007) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2006.3754 · Cited by 1,213
Self-citationWallinga, J. (2004) · American Journal of Epidemiology · doi:10.1093/aje/kwh255 · Cited by 1,197
Self-citationSerial interval of novel coronavirus (COVID-19) infections
Nishiura, H., Linton, N. M., & Akhmetzhanov, A. R. (2020) · International Journal of Infectious Diseases · doi:10.1016/j.ijid.2020.02.060 · Cited by 1,083
Inferring the effectiveness of government interventions against COVID-19
Brauner, J. M., Mindermann, S., Sharma, M., Johnston, D., Salvatier, J., Gavenčiak, T., Stephenson, A. B., Leech, G., Altman, G., Mikulik, V., et al. (2021) · Science · doi:10.1126/science.abd9338 · Cited by 1,065
Inferring change points in the spread of COVID-19 reveals the effectiveness of interventions
Dehning, J., Zierenberg, J., Spitzner, F. P., Wibral, M., Neto, J. P., Wilczek, M., & Priesemann, V. (2020) · Science · doi:10.1126/science.abb9789 · Cited by 819
Ganyani, T., Kremer, C., Chen, D., Torneri, A., Faes, C., Wallinga, J., & Hens, N. (2020) · Eurosurveillance · doi:10.2807/1560-7917.es.2020.25.17.2000257 · Cited by 640
Self-citationSerial Interval of COVID-19 among Publicly Reported Confirmed Cases
Du, Z., Xu, X., Wu, Y., Wang, L., Cowling, B. J., & Meyers, L. A. (2020) · Emerging Infectious Diseases · doi:10.3201/eid2606.200357 · Cited by 636
Estimating the effects of non-pharmaceutical interventions on COVID-19 in Europe
Flaxman, S. R., Mishra, S., Gandy, A., Unwin, H. J. T., Mellan, T. A., Coupland, H., Whittaker, C., Zhu, H., Berah, T., Eaton, J. W., et al. (2020) · Spiral (Imperial College London) · doi:10.25561/77731 · Cited by 589
Estimating Individual and Household Reproduction Numbers in an Emerging Epidemic
Fraser, C. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000758 · Cited by 492
Improved inference of time-varying reproduction numbers during infectious disease outbreaks
Thompson, R. N., Stockwin, J. E., van Gaalen, R. D., Polonsky, J. A., Kamvar, Z. N., Demarsh, P. A., Dahlqwist, E., Li, S., Miguel, E., Jombart, T., et al. (2019) · Epidemics · doi:10.1016/j.epidem.2019.100356 · Cited by 492
Self-citationEvidence for transmission of COVID-19 prior to symptom onset
Tindale, L. C., Stockdale, J. E., Coombe, M., Garlock, E. S., Lau, W. Y. V., Saraswat, M., Zhang, L., Chen, D., Wallinga, J., & Colijn, C. (2020) · eLife · doi:10.7554/elife.57149 · Cited by 452
Self-citationAbbott, S., Hellewell, J., Thompson, R. N., Sherratt, K., Gibbs, H. P., Bosse, N. I., Munday, J. D., Meakin, S., Doughty, E. L., Chun, J. Y., et al. (2020) · Wellcome Open Research · doi:10.12688/wellcomeopenres.16006.1 · Cited by 335
Self-citationSerial interval of SARS-CoV-2 was shortened over time by nonpharmaceutical interventions
Ali, S. T., Wang, L., Lau, E. H. Y., Xu, X.-K., Du, Z., Wu, Y., Leung, G. M., & Cowling, B. J. (2020) · Science · doi:10.1126/science.abc9004 · Cited by 331
Inference Based on Retrospective Ascertainment: An Analysis of the Data on Transfusion-Related AIDS
Kalbfleisch, J. D., & Lawless, J. F. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478780 · Cited by 317
Real Time Bayesian Estimation of the Epidemic Potential of Emerging Infectious Diseases
Bettencourt, L. M. A., & Ribeiro, R. M. (2008) · PLoS ONE · doi:10.1371/journal.pone.0002185 · Cited by 302
A note on generation times in epidemic models
Svensson, Å. (2007) · Mathematical Biosciences · doi:10.1016/j.mbs.2006.10.010 · Cited by 269
White, L. F., Wallinga, J., Finelli, L., Reed, C., Riley, S., Lipsitch, M., & Pagano, M. (2009) · Influenza and Other Respiratory Viruses · doi:10.1111/j.1750-2659.2009.00106.x · Cited by 240
Self-citationSpatio-Temporal Analysis of Epidemic Phenomena Using the R Package surveillance
Meyer, S., Held, L., & Höhle, M. (2017) · Journal of Statistical Software · doi:10.18637/jss.v077.i11 · Cited by 208
Real-time Estimates in Early Detection of SARS
Cauchemez, S., Boëlle, P.-Y., Donnelly, C. A., Ferguson, N. M., Thomas, G., Leung, G. M., Hedley, A. J., Anderson, R. M., & Valleron, A.-J. (2006) · Emerging Infectious Diseases · doi:10.3201/eid1201.050593 · Cited by 168
Spatio-Temporal Analysis of Epidemic Phenomena Using the R Package surveillance
Meyer, S., Held, L., & Höhle, M. (2017) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-146027 · Cited by 152
Potential for large outbreaks of Ebola virus disease
Camacho, A., Kucharski, A. J., Funk, S., Breman, J. G., Piot, P., & Edmunds, W. J. (2014) · Epidemics · doi:10.1016/j.epidem.2014.09.003 · Cited by 149
Self-citationEstimating in Real Time the Efficacy of Measures to Control Emerging Communicable Diseases
Cauchemez, S., Boëlle, P., Thomas, G., & Valleron, A. (2006) · American Journal of Epidemiology · doi:10.1093/aje/kwj274 · Cited by 147
A method of non‐parametric back‐projection and its application to aids data
Becker, N. G., Watson, L. F., & Carlin, J. B. (1991) · Statistics in Medicine · doi:10.1002/sim.4780101005 · Cited by 142
Estimation in emerging epidemics: biases and remedies
Britton, T., & Tomba, G. S. (2019) · Journal of The Royal Society Interface · doi:10.1098/rsif.2018.0670 · Cited by 139
Monitoring Count Time Series in R : Aberration Detection in Public Health Surveillance
Salmon, M., Schumacher, D., & Höhle, M. (2016) · Journal of Statistical Software · doi:10.18637/jss.v070.i10 · Cited by 126
Nowcasting by Bayesian Smoothing: A flexible, generalizable model for real-time epidemic tracking
McGough, S. F., Johansson, M. A., Lipsitch, M., & Menzies, N. A. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007735 · Cited by 121
Self-citationEquivalence of the Erlang-Distributed SEIR Epidemic Model and the Renewal Equation
Champredon, D., Dushoff, J. G., & Earn, D. J. D. (2018) · SIAM Journal on Applied Mathematics · doi:10.1137/18m1186411 · Cited by 113
Bayesian nowcasting during the STEC O104:H4 outbreak in Germany, 2011
Höhle, M., & der Heiden, M. A. (2014) · Biometrics · doi:10.1111/biom.12194 · Cited by 101
Estimation and worldwide monitoring of the effective reproductive number of SARS-CoV-2
Huisman, J. S., Scire, J., Angst, D. C., Li, J., Neher, R. A., Maathuis, M. H., Bonhoeffer, S., & Stadler, T. (2022) · eLife · doi:10.7554/elife.71345 · Cited by 101
Self-citationNowcasting the COVID‐19 pandemic in Bavaria
Günther, F., Bender, A., Katz, K., Küchenhoff, H., & Höhle, M. (2020) · Biometrical Journal · doi:10.1002/bimj.202000112 · Cited by 95
Reconstructing influenza incidence by deconvolution of daily mortality time series
Goldstein, E., Dushoff, J., Ma, J., Plotkin, J. B., Earn, D. J. D., & Lipsitch, M. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0902958106 · Cited by 94
Self-citationPitzer, V. E., Chitwood, M. H., Havumaki, J., Menzies, N. A., Perniciaro, S., Warren, J. L., Weinberger, D. M., & Cohen, T. (2021) · American Journal of Epidemiology · doi:10.1093/aje/kwab089 · Cited by 86
Intrinsic and realized generation intervals in infectious-disease transmission
Champredon, D., & Dushoff, J. G. (2015) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2015.2026 · Cited by 74
Estimating the early death toll of COVID-19 in the United StatesPreprint
Weinberger, D., Cohen, T., Crawford, F. W., Mostashari, F., Olson, D., Pitzer, V., Reich, N., Russi, M., Simonsen, L., Watkins, A. E., et al. (2020) · medRxiv · doi:10.1101/2020.04.15.20066431 · Cited by 74
Scire, J., Nadeau, S., Vaughan, T. G., Brupbacher, G., Fuchs, S., Sommer, J., Koch, K., Misteli, R., Mundorff, L., Götz, T., et al. (2020) · Swiss Medical Weekly · doi:10.4414/smw.2020.20271 · Cited by 71
Self-citationAssessing the impact of non-pharmaceutical interventions on SARS-CoV-2 transmission in Switzerland
Lemaitre, J. C., Perez‐Saez, J., Azman, A. S., Rinaldo, A., & Fellay, J. (2020) · Swiss Medical Weekly · doi:10.4414/smw.2020.20295 · Cited by 71
Park, S. W., Champredon, D., Weitz, J. S., & Dushoff, J. G. (2019) · Epidemics · doi:10.1016/j.epidem.2018.12.002 · Cited by 64
Chitwood, M. H., Russi, M., Gunasekera, K. S., Havumaki, J., Klaassen, F., Pitzer, V. E., Salomon, J. A., Swartwood, N. A., Warren, J. L., Weinberger, D. M., et al. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010465 · Cited by 60
van de Kassteele, J., Eilers, P. H. C., & Wallinga, J. (2019) · Epidemiology · doi:10.1097/ede.0000000000001050 · Cited by 57
Self-citationEpiNow2: Estimate and Forecast Real-Time Infection Dynamics
Abbott, S., Hellewell, J., Sherratt, K., Gostic, K. M., Hickson, J., Badr, H. S., DeWitt, M., Azam, J. M., Lison, A., & Funk, S. (2020) · doi:10.32614/cran.package.epinow2 · Cited by 52
Self-citationUsing information theory to optimise epidemic models for real-time prediction and estimation
Parag, K. V., & Donnelly, C. A. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007990 · Cited by 48
EpiEstim: Estimate Time Varying Reproduction Numbers from Epidemic Curves
Cori, A. (2012) · doi:10.32614/cran.package.epiestim · Cited by 45
Hens, N., Calatayud, L., Kurkela, S., Tamme, T., & Wallinga, J. (2012) · American Journal of Epidemiology · doi:10.1093/aje/kws006 · Cited by 44
Self-citationInferring generation-interval distributions from contact-tracing data
Park, S. W., Champredon, D., & Dushoff, J. G. (2020) · Journal of The Royal Society Interface · doi:10.1098/rsif.2019.0719 · Cited by 24
Marschner, I. C. (2020) · Epidemiology and Infection · doi:10.1017/s0950268820001065 · Cited by 21
Determining the dynamics of influenza transmission by age
White, L. F., Archer, B. N., & Pagano, M. (2014) · Emerging Themes in Epidemiology · doi:10.1186/1742-7622-11-4 · Cited by 18
Self-citationThe impact of prior information on estimates of disease transmissibility using Bayesian tools
Moser, C. B., Gupta, M., Archer, B. N., & White, L. F. (2015) · PLOS ONE · doi:10.1371/journal.pone.0118762 · Cited by 11 · cited 1×
“Joint 287 estimation of both Rt and the generation interval is possible, depending on data quality and magnitude 288 of Rt [41, 42].”
Self-citationPark, S. W., Sun, K., Champredon, D., Li, M., Bolker, B. M., Earn, D. J. D., Weitz, J. S., Grenfell, B. T., & Dushoff, J. G. (2020) · medRxiv · doi:10.1101/2020.06.04.20122713 · Cited by 5
Cited by
Inferring change points in the spread of COVID-19 reveals the effectiveness of interventions
Dehning, J., Zierenberg, J., Spitzner, F. P., Wibral, M., Neto, J. P., Wilczek, M., & Priesemann, V. (2020) · Science · doi:10.1126/science.abb9789 · Cited by 819
Covasim: An agent-based model of COVID-19 dynamics and interventions
Kerr, C. C., Stuart, R. M., Mistry, D., Abeysuriya, R. G., Rosenfeld, K., Hart, G. R., Núñez, R. C., Cohen, J. A., Selvaraj, P., Hagedorn, B., et al. (2021) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1009149 · Cited by 685
Sixteen novel lineages of SARS-CoV-2 in South Africa
Tegally, H., Wilkinson, E., Lessells, R. J., Giandhari, J., Pillay, S., Msomi, N., Mlisana, K., Bhiman, J. N., von Gottberg, A., Walaza, S., et al. (2021) · Nature Medicine · doi:10.1038/s41591-021-01255-3 · Cited by 349
Serial interval of SARS-CoV-2 was shortened over time by nonpharmaceutical interventions
Ali, S. T., Wang, L., Lau, E. H. Y., Xu, X.-K., Du, Z., Wu, Y., Leung, G. M., & Cowling, B. J. (2020) · Science · doi:10.1126/science.abc9004 · Cited by 331
Tracking R of COVID-19: A new real-time estimation using the Kalman filter
Arroyo-Marioli, F., Bullano, F., Kucinskas, S., & Rondón-Moreno, C. (2021) · PLOS ONE · doi:10.1371/journal.pone.0244474 · Cited by 320
Metadata
- Authors
- Gostic, K. M., McGough, L., Baskerville, E. B., Abbott, S., Joshi, K., Tedijanto, C., Kahn, R., Niehus, R., Hay, J. A., De Salazar, P. M., Hellewell, J., Meakin, S., Munday, J. D., Bosse, N. I., Sherrat, K., Thompson, R. N., White, L. F., Huisman, J. S., Scire, J., Bonhoeffer, S., Stadler, T., Wallinga, J., Funk, S., Lipsitch, M., & Cobey, S.
- Venue
- PLOS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2020-12-10
- Volume
- 16
- Issue
- 12
- Pages
- e1008409
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W3111883190
- Cited by
- 570
- References
- 53
- FWCI
- 13.89
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.