Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index; 2 of the 8 sources its claims cite were checked for support.

The epidemiological impact of the NHS COVID-19 app

Open access

Abstract

The COVID-19 pandemic has seen the emergence of digital contact tracing to help to prevent the spread of the disease. A mobile phone app records proximity events between app users, and when a user tests positive for COVID-19, their recent contacts can be notified instantly. Theoretical evidence has supported this new public health intervention 1-6, but its epidemiological impact has remained uncertain 7. Here we investigate the impact of the National Health Service (NHS) COVID-19 app for England and Wales, from its launch on 24 September 2020 to the end of December 2020. It was used regularly by approximately 16.5 million users (28% of the total population), and sent approximately 1.7 million exposure notifications: 4.2 per index case consenting to contact tracing. We estimated that the fraction of individuals notified by the app who subsequently showed symptoms and tested positive (the secondary attack rate (SAR)) was 6%, similar to the SAR for manually traced close contacts. We estimated the number of cases averted by the app using two complementary approaches: modelling based on the notifications and SAR gave an estimate of 284,000 (central 95% range of sensitivity analyses 108,000-450,000), and statistical comparison of matched neighbouring local authorities gave an estimate of 594,000 (95% confidence interval 317,000-914,000). Approximately one case was averted for each case consenting to notification of their contacts. We estimated that for every percentage point increase in app uptake, the number of cases could be reduced by 0.8% (using modelling) or 2.3% (using statistical analysis). These findings support the continued development and deployment of such apps in populations that are awaiting full protection from vaccines.

Overview

CoChat Summary

TL;DR

The NHS COVID-19 app for England and Wales was used regularly by approximately 16.5 million people and sent about 1.7 million exposure notifications from launch to end-December 2020, with an estimated secondary attack rate of 6% among notified users. Two complementary analyses estimated 284,000 cases averted by modelling and 594,000 by matched-neighbours regression, supporting digital contact tracing as an additional public-health intervention.

Key findings

  • The app was regularly used by approximately 16.5 million users (28% of the total population) and sent approximately 1.7 million exposure notifications: 4.2 per index case consenting to contact tracing. The estimated secondary attack rate among notified individuals was 6.02% (confidence interval 5.96–6.09%; sensitivity analyses suggested roughly 5–7%).
  • Cases averted during phases 1 and 2 combined were estimated at 284,000 (central 95% sensitivity range 108,000–450,000) using modelling and 594,000 (95% CI 317,000–914,000) using matched-neighbours regression. Corresponding deaths averted were 4,200 (1,600–6,600) and 8,700 (4,700–13,500), against 1,892,000 actual cases and 32,500 actual deaths in the period.
  • For every percentage point increase in app uptake, cases were estimated to fall by 0.8% using modelling or 2.3% using statistical analysis. The effect was larger in phase 2, after an upgrade to the app’s risk-scoring function.
  • Scenario projections for phase 2 included: increasing uptake to 35.9% for all lower tier local authorities (11% modelling, 21.0% statistical reduction), increasing uptake by 20 percentage points (24% modelling, 41.5% statistical), switching to opt-out notification (6.6% modelling), improving quarantine adherence by 20 percentage points (6.8% modelling), and reducing time to test result by one day (3.6% modelling).

Methods

  • Observational analysis of NHS COVID-19 app data for England and Wales from launch on 24 September 2020 to 31 December 2020, aggregated at lower tier local authority level, with case data from coronavirus.data.gov.uk and analysis phases defined around app changes.
  • Two complementary approaches: a mechanistic model linking notifications, secondary attack rate, timing of notification relative to transmission, and quarantine adherence (central assumption of 61% overall quarantine effectiveness) to estimate cases averted; and a matched-neighbours regression comparing adjacent LTLAs within the same phase-0 case quintile, adjusting for rural/urban score, local GDP, and poverty, with a placebo regression to assess confounding.
  • The secondary attack rate was estimated with a probabilistic model using iPhone data from December 2020–January 2021 and a Poisson likelihood; deaths averted were derived using a case fatality rate of 1.47% (27,922 deaths / 1,891,777 cases).

Limitations

  • The paper states the main limitation is that this is an observational study with no randomized or systematic experiment producing different app uptake rates; residual confounding could mean the statistical estimate is too high, while a genuine indirect effect of app use could mean the modelling estimate is too low, so an effect size between the two estimates seems most likely.
  • The paper states that epidemic dynamics for individual LTLAs were difficult to interpret because the period included staggered local restrictions, a national lockdown, the Christmas holiday season, and emergence of the more infectious B.1.1.7 variant; it did not model time-varying reproduction numbers and suggests future hierarchical modelling.
  • The text makes evident additional uncertainties: quarantine adherence is critical but difficult to assess reliably, with cited surveys ranging from 11% proper adherence to greater than 80% recent adherence; Android user-number fluctuations are described as unexplained; and sensitivity analyses suggested greater uncertainty in the SAR than the likelihood-profile confidence interval alone.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1038/s41586-021-03606-z

Cites

33 of 33 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

2 Valid · 0 Not valid · 6 Not checked · 46 Own results and interpretations

26 more claims

Create a free account to see all 54 claims and to verify the 6 references still open.

See all claims — free account
  • It may state two separate claims as one. 11
  • Probably not a substantial claim. 16

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 30 references

Cited by

See all 271

Metadata

Authors
Wymant, C., Ferretti, L., Tsallis, D., Charalambides, M., Abeler-Dörner, L., Bonsall, D., Hinch, R., Kendall, M., Milsom, L., Ayres, M., Holmes, C., Briers, M., & Fraser, C.
Affiliations
  • University of Oxford (GB)
  • The Alan Turing Institute (GB)
  • University of Warwick (GB)
Corresponding author
Fraser, Christophe
Venue
Nature
Published
2021-05-12
Volume
594
Issue
7863
Pages
408-412
ISSN
  • 0028-0836 (ISSN-L)
  • 1476-4687
OpenAlex
W3163076983
Cited by
271
References
30
Citations by year
2026: 13 · 2025: 18 · 2024: 50 · 2023: 63 · 2022: 73 · 2021: 52
FWCI
53.74
Type
journal article
Language
en
Open access
Licence
Locations
  • Nature (publishedVersion)
  • PubMed (publishedVersion)
  • Warwick Research Archive Portal (University of Warwick) (acceptedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
  • Lirias (KU Leuven) (submittedVersion)
Funders
  • Li Ka Shing Foundation
  • National Institute for Health and Care Research (NIHR-INF-1687)
  • Department of Health and Social Care
  • Nature
  • Medical Research Council (MR/R015600/1, MC_PC_19012)
  • Engineering and Physical Sciences Research Council (EP/R018561/1)
Topics
  • Physical Sciences › Computer Science › Information Systems › COVID-19 Digital Contact Tracing
  • Physical Sciences › Mathematics › Modeling and Simulation › COVID-19 epidemiological studies
  • Health Sciences › Medicine › Epidemiology › Data-Driven Disease Surveillance
Keywords
digital contact tracing, COVID-19 pandemic, secondary attack rate, case averted, exposure notification, mobile application, contact tracing, SARS-CoV-2 transmission, app uptake, public health interventions
MeSH terms
COVID-19, England, Humans, Mortality, National Health Programs, Quarantine, Wales, Contact Tracing, Basic Reproduction Number, Mobile Applications

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The epidemiological impact of the NHS COVID-19 app. https://app.cochat.ai/papers/10.1038/s41586-021-03606-z
The paper
Wymant, C., Ferretti, L., Tsallis, D., Charalambides, M., Abeler-Dörner, L., Bonsall, D., Hinch, R., Kendall, M., Milsom, L., Ayres, M., Holmes, C., Briers, M., & Fraser, C. (2021). The epidemiological impact of the NHS COVID-19 app. Nature. https://doi.org/10.1038/s41586-021-03606-z

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.