Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 231

The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.

Understanding the effectiveness of government interventions against the resurgence of COVID-19 in Europe

Open access
Sharma, Mrinank, Mindermann, Sören, Rogers-Smith, Charlie, Leech, Gavin, Snodin, Benedict, Ahuja, Janvi, Sandbrink, Jonas B., Monrad, Joshua Teperowski, Altman, George, Dhaliwal, Gurpreet, Finnveden, Lukas, Norman, Alexander John, Oehm, Sebastian B., Sandkühler, Julia Fabienne, Aitchison, Laurence, Gavenčiak, Tomáš, Mellan, Thomas, Kulveit, Jan, Chindelevitch, Leonid, Flaxman, Seth, Gal, Yarin, Mishra, Swapnil, Bhatt, Samir, Brauner, Jan Markus · 2021 · Nature Communications

Published version of a preprint

Abstract

European governments use non-pharmaceutical interventions (NPIs) to control resurging waves of COVID-19. However, they only have outdated estimates for how effective individual NPIs were in the first wave. We estimate the effectiveness of 17 NPIs in Europe’s second wave from subnational case and death data by introducing a flexible hierarchical Bayesian transmission model and collecting the largest dataset of NPI implementation dates across Europe. Business closures, educational institution closures, and gathering bans reduced transmission, but reduced it less than they did in the first wave. This difference is likely due to organisational safety measures and individual protective behaviours—such as distancing—which made various areas of public life safer and thereby reduced the effect of closing them. Specifically, we find smaller effects for closing educational institutions, suggesting that stringent safety measures made schools safer compared to the first wave. Second-wave estimates outperform previous estimates at predicting transmission in Europe’s third wave.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41467-021-26013-4

Cites

9 of 9 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 9 references

Research works printed but not linked: 51

  1. Flaxman, S. et al. Imperial College COVID-19 Response Team, A. C. Ghani, C. A. Donnelly, S. Riley, M. A. C. Vollmer, N. M. Ferguson, L. C. Okell, S. Bhatt, Estimating the effects of non-pharmaceutical interventions on COVID-19 in Europe. Nature 584, 257–261 (2020). · DOI · Paper page
  2. Brauner, J. M. et al. Inferring the effectiveness of government interventions against COVID-19. Science 371, eabd9338 (2021). · DOI · Paper page
  3. Hsiang, S. et al. The effect of large-scale anti-contagion policies on the COVID-19 pandemic. Nature 584, 262–267 (2020). · DOI · Paper page
  4. Looi, M.-K. Covid-19: is a second wave hitting Europe? Br. Med. J. 371, m4113 (2020). · DOI
  5. Griffin, S. Covid-19: second wave death rate is doubling fortnightly but is lower and slower than in March. Br. Med. J. 371, m4092 (2020). · doi:10.1136/bmj.m4092
  6. Moore, S., Hill, E. M., Tildesley, M. J., Dyson, L. & Keeling, M. J. Vaccination and non-pharmaceutical interventions for COVID-19: a mathematical modelling study. Lancet Infect. Dis. https://doi.org/10.1016/S1473-3099(21)00143-2 (2021). · DOI · Paper page
  7. Burki, T. K. Challenges in the rollout of COVID-19 vaccines worldwide. Lancet Respir. Med. https://doi.org/10.1016/S2213-2600(21)00129-6 (2021). · doi:10.1016/s2213-2600(21)00129-6
  8. He, Z. et al. Seroprevalence and humoral immune durability of anti-SARS-CoV-2 antibodies in Wuhan, China: a longitudinal, population-level, cross-sectional study. Lancet 397, 1075–1084 (2021). · DOI · Paper page
  9. Banholzer, N. et al. Estimating the effects of non-pharmaceutical interventions on the number of new infections with COVID-19 during the first epidemic wave. Preprint at bioRxiv https://doi.org/10.1101/2021.01.15.21249884 (2021). · DOI
  10. Liu, Y., Morgenstern, C., Kelly, J., Lowe, R. CMMID COVID-19 Working Group, Jit, M. The impact of non-pharmaceutical interventions on SARS-CoV-2 transmission across 130 countries and territories. BMC Med. https://doi.org/10.1186/s12916-020-01872-8 (2021). · DOI · Paper page
  11. Sharma, M. et al. How robust are the estimated effects of nonpharmaceutical interventions against COVID-19? Preprint at arXiv http://arxiv.org/abs/2007.13454 (2020). · arXiv
  12. Li, Y. et al. Usher Network for COVID-19 Evidence Reviews (UNCOVER) group, The temporal association of introducing and lifting non-pharmaceutical interventions with the time-varying reproduction number (R) of SARS-CoV-2: a modelling study across 131 countries. Lancet Infect. Dis. 21, 193–202 (2021). · DOI · Paper page
  13. Laydon DJ, Mishra S, Hinsley WR, et al.Modelling the impact of the tier system on SARS-CoV-2 transmission in the UK between the first and second national lockdowns. BMJ Open. 11, e050346 (2021). https://doi.org/10.1136/bmjopen-2021-050346. · DOI
  14. Manica, M. et al. Impact of tiered restrictions on human activities and the epidemiology of the second wave of COVID-19 in Italy. Preprint at medRxiv https://www.medrxiv.org/content/10.1101/2021.01.10.21249532v2.full-text (2021). · doi:10.1101/2021.01.10.21249532v2.full-text
  15. Schuessler, A. A. Ecological inference. Proc. Natl Acad. Sci. USA 96, 10578–10581 (1999). · DOI
  16. Cheng, C., Barceló, J., Hartnett, A. S., Kubinec, R. & Messerschmidt, L. COVID-19 government response event dataset (CoronaNet v.1.0). Nat. Hum. Behav. 4, 756–768 (2020). · DOI · Paper page
  17. Zheng, Q. et al. HIT-COVID collaboration, HIT-COVID, a global database tracking public health interventions to COVID-19. Sci. Data 7, 286 (2020). · DOI
  18. Desvars-Larrive, A. et al. A structured open dataset of government interventions in response to COVID-19. Sci. Data 7, 285 (2020). · DOI · Paper page
  19. Hale, T., Petherick, A., Phillips, T., Webster, S., Kira, B. Oxford COVID-19 Government Response Tracker, Blavatnik School of Government. Working Paper (2020).
  20. Soltesz, K. et al. On the sensitivity of non-pharmaceutical intervention models for SARS-CoV-2 spread estimation. Preprint at medRxiv https://doi.org/10.1101/2020.06.10.20127324 (2020). · doi:10.1101/2020.06.10.20127324
  21. Ward, H. Antibody prevalence for SARS-CoV-2 in England following first peak of the pandemic: REACT2 study in 100,000 adults. Preprint at medRxiv https://doi.org/10.1101/2020.08.12.20173690 (2020). · doi:10.1101/2020.08.12.20173690
  22. Wright, L., Steptoe, A., Fancourt, D. Trajectories of compliance with COVID-19 related guidelines: longitudinal analyses of 50,000 UK adults. Preprint at bioRxiv https://doi.org/10.1101/2021.04.13.21255336 (2021). · DOI
  23. Mishra, S. et al. A COVID-19 model for local authorities of the United Kingdom. Preprint at medRxiv https://doi.org/10.1101/2020.11.24.20236661 (2020). · DOI
  24. Russell, T. W. et al. CMMID COVID-19 working group, reconstructing the early global dynamics of under-ascertained COVID-19 cases and infections. BMC Med 18, 332 (2020). · DOI · Paper page
  25. Winship, C. & Western, B. Multicollinearity and model misspecification. Sociol. Sci. 3, 627–649 (2016). · DOI
  26. Dormann, C. F. et al. Collinearity: a review of methods to deal with it and a simulation study evaluating their performance. Ecography 36, 27–46 (2013). · DOI · Paper page
  27. Fetzer, T. Subsidizing the Spread of Covid19: Evidence From the UK’s Eat-out To-help-out Scheme (University of Warwick, Department of Economics, 2020). · DOI
  28. Wong, F. & Collins, J. J. Evidence that coronavirus superspreading is fat-tailed. Proc. Natl Acad. Sci. USA 117, 29416–29418 (2020). · DOI
  29. Kwon, K. S. et al. Evidence of long-distance droplet transmission of SARS-CoV-2 by direct air flow in a restaurant in Korea. J. Korean Med. Sci. 35, e415 (2020). · DOI
  30. Hunter, P. R., Brainard, J. S., Grant, A. The effectiveness of the three tier system of local restrictions for control of COVID-19. Preprint at medRxiv https://doi.org/10.1101/2020.11.22.20236422 (2020). · DOI
  31. Otte Im Kampe, E., Lehfeld, A.-S., Buda, S., Buchholz, U., Haas, W. Surveillance of COVID-19 school outbreaks, Germany, March to August 2020. Euro Surveill. https://doi.org/10.2807/1560-7917.ES.2020.25.38.2001645 (2020). · DOI
  32. Torres, J. P. et al. Severe acute respiratory syndrome coronavirus 2 antibody prevalence in blood in a large school community subject to a coronavirus disease 2019 outbreak: a cross-sectional study. Clin. Infect. Dis. 955, e458–e465 (2020). · DOI
  33. Stein-Zamir, C. et al. A large COVID-19 outbreak in a high school 10 days after schools’ reopening, Israel, May 2020. Euro Surveill. https://doi.org/10.2807/1560-7917.ES.2020.25.29.2001352 (2020). · DOI · Paper page
  34. Fontanet, A. et al. SARS-CoV-2 infection in schools in a northern French city: a retrospective serological cohort study in an area of high transmission, France, January to April 2020. Euro Surveill. 26, https://doi.org/10.2807/1560-7917.ES.2021.26.15.2001695 (2021). · DOI · Paper page
  35. Fontanet, A., Grant, R., Greve-Isdahl, M. & Sridhar, D. Covid-19: Keeping schools as safe as possible. Br. Med. J. 372, n524 (2021). · DOI
  36. Alyssa, B. et al. Passing the Test: A Model-Based Analysis of Safe School-Reopening Strategies. Ann Intern Med. 174, 1090–1100 (2021). [Epub ahead of print 8 June 2021]. https://doi.org/10.7326/M21-0600 · DOI
  37. Landeros, A. et al. An examination of school reopening strategies during the SARS-CoV-2 pandemic. PLoS ONE. 16(5), e0251242 (2021). https://doi.org/10.1371/journal.pone.0251242. · DOI
  38. Dong, Y. et al. Epidemiology of COVID-19 among children in China. Pediatrics https://doi.org/10.1542/peds.2020-0702 (2020). · DOI · Paper page
  39. Munday, J. D. et al. C. C.-19 W. Group. Estimating the impact of reopening schools on the reproduction number of SARS-CoV-2 in England, using weekly contact survey data. Preprint at medRxiv https://doi.org/10.1101/2021.03.06.21252964 (2021). · doi:10.1101/2021.03.06.21252964
  40. Rosenbaum, P. R. & Rubin, D. B. Assessing sensitivity to an unobserved binary covariate in an observational study with binary outcome. J. R. Stat. Soc. 45, 212–218 (1983). · DOI · Paper page
  41. George, E. P. Box, Sampling and Bayes’ Inference in Scientific Modelling and Robustness. J. R. Stat. Soc. Ser. A 143, 383–430 (1980). · DOI · Paper page
  42. Mishra, S. et al. COVID-19 genomics UK (COG-UK) consortium, changing composition of SARS-CoV-2 lineages and rise of delta variant in England. EClinicalMedicine 39, 101064 (2021). · DOI
  43. Manica, M. et al. Effectiveness of regional restrictions in reducing SARS-CoV-2 transmission during the second wave of COVID-19, Italy. Preprint at medRxiv https://doi.org/10.1101/2021.01.10.21249532 (2021). · DOI
  44. Fraser, C. Estimating individual and household reproduction numbers in an emerging epidemic. PLoS ONE 2, e758 (2007). · DOI · Paper page
  45. Bellman, R. & Harris, T. On age-dependent binary branching processes. Ann. Math. 55, 280–295 (1952). · DOI
  46. Champredon, D., Dushoff, J. & Earn, D. J. D. Equivalence of the Erlang-distributed SEIR epidemic model and the renewal equation. SIAM J. Appl. Math. 78, 3258–3278 (2018). · DOI
  47. Riley, S. et al. Resurgence of SARS-CoV-2: detection by community viral surveillance. Science 372, 990–995 (2021). · DOI
  48. Phan, D., Pradhan, N., Jankowiak, M. Composable effects for flexible and accelerated probabilistic programming in NumPyro. Preprint at arXiv http://arxiv.org/abs/1912.11554 (2019). · arXiv
  49. Hoffman, M. D. & Gelman, A. The No-U-Turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo. J. Mach. Learn. Res. 15, 1593–1623 (2014).
  50. Banholzer, N. et al. Estimating the effects of non-pharmaceutical interventions on the number of new infections with COVID-19 during the first epidemic wave. PLoS ONE 16, e0252827 (2021). · DOI
  51. Challen, R., Brooks-Pollock, E., Tsaneva-Atanasova, K., Danon, L. Meta-analysis of the SARS-CoV-2 serial interval and the impact of parameter uncertainty on the COVID-19 reproduction number. Preprint at medRxiv https://www.medrxiv.org/content/10.1101/2020.11.17.20231548v1.abstract (2020). · doi:10.1101/2020.11.17.20231548

Cited by

See all 231

Metadata

Authors
Sharma, M., Mindermann, S., Rogers-Smith, C., Leech, G., Snodin, B., Ahuja, J., Sandbrink, J. B., Monrad, J. T., Altman, G., Dhaliwal, G., Finnveden, L., Norman, A. J., Oehm, S. B., Sandkühler, J. F., Aitchison, L., Gavenčiak, T., Mellan, T., Kulveit, J., Chindelevitch, L., Flaxman, S., Gal, Y., Mishra, S., Bhatt, S., & Brauner, J. M.
Venue
Nature Communications
Published
2021-10-05
Volume
12
Issue
1
Pages
5820-5820
ISSN
2041-1723 (ISSN-L)
OpenAlex
W3201866125
Cited by
231
References
9
FWCI
19.28
Type
journal article
Language
en
Open access
gold
Licence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Understanding the effectiveness of government interventions against the resurgence of COVID-19 in Europe. https://app.cochat.ai/papers/10.1038/s41467-021-26013-4
The paper
Sharma, M., Mindermann, S., Rogers-Smith, C., Leech, G., Snodin, B., Ahuja, J., Sandbrink, J. B., Monrad, J. T., Altman, G., Dhaliwal, G., Finnveden, L., Norman, A. J., Oehm, S. B., Sandkühler, J. F., Aitchison, L., Gavenčiak, T., Mellan, T., Kulveit, J., Chindelevitch, L., . . . Brauner, J. M. (2021). Understanding the effectiveness of government interventions against the resurgence of COVID-19 in Europe. Nature Communications. https://doi.org/10.1038/s41467-021-26013-4

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.