The DOI matches its Crossref record; 87 of the 91 references it cites were found in a registry or an index; 29 of the 95 sources its claims cite were checked for support.
Digital technologies in the public-health response to COVID-19
Open accessAbstract
Digital technologies are being harnessed to support the public-health response to COVID-19 worldwide, including population surveillance, case identification, contact tracing and evaluation of interventions on the basis of mobility data and communication with the public. These rapid responses leverage billions of mobile phones, large online datasets, connected devices, relatively low-cost computing resources and advances in machine learning and natural language processing. This Review aims to capture the breadth of digital innovations for the public-health response to COVID-19 worldwide and their limitations, and barriers to their implementation, including legal, ethical and privacy barriers, as well as organizational and workforce barriers. The future of public health is likely to become increasingly digital, and we review the need for the alignment of international strategies for the regulation, evaluation and use of digital technologies to strengthen pandemic management, and future preparedness for COVID-19 and other infectious diseases.
Overview
CoChat Summary
TL;DR
This is a review of how digital technologies were being used in the COVID-19 response for surveillance, rapid case identification, interrupting transmission, and public communication. The authors argue these tools can strengthen public-health systems, but only as part of an integrated, evaluated, and privacy-preserving strategy.
Key findings
- The paper identifies four main public-health uses for digital technologies in COVID-19: digital epidemiological surveillance, rapid case identification, interrupting community transmission, and public communication.
- For surveillance, the authors note that online data systems such as ProMED-mail, GPHIN, HealthMap, EIOS, and EPI-BRAIN are increasingly integrated into formal surveillance; in the UK, confirmed cases represented an estimated 4.7% of symptomatic COVID-19 cases when only hospitalized patients and healthcare workers were routinely tested.
- For case identification, the paper states that an estimated 80% of COVID-19 cases are mild or asymptomatic, supporting widespread testing and digital symptom reporting; it also reports that the COVID-19 symptom-tracker app had been downloaded by 3.9 million people in the UK and USA.
- For contact tracing and mobility analysis, the authors note that contact-tracing apps had been launched in at least 40 countries, TraceTogether uptake in Singapore had reached only 30% by June 2020, and one Italian mobility analysis estimated a 50% reduction in total trips between provinces in the week after lockdown announcement.
- The paper also reports broad digital reach relevant to public messaging: 4.1 billion people accessed the internet and there were 5.2 billion unique mobile subscribers, with 67% of the global population subscribed to mobile devices, 65% of those as smartphones, and 3.8 billion people actively using social media as of January 2020.
Methods
- Narrative review article synthesizing published studies, preprints, reports, and public datasets on digital technologies used in the COVID-19 public-health response worldwide.
- Focuses on four functional areas: surveillance, case identification, transmission interruption, and public communication, with examples drawn from specific countries, apps, and data systems.
- Uses descriptive comparison rather than original experimental analysis or meta-analysis; the main approach is critical synthesis of benefits, limitations, and implementation barriers.
Limitations
- The paper explicitly states that it is too early to fully quantify the added value of digital technologies to the pandemic response, and that many interventions had not yet been peer-reviewed, rigorously tested, or evaluated with digital health evidence frameworks.
- The authors state there is no evidence of the effectiveness of COVID-19 contact-tracing apps at the time of writing, including no empirical estimates for case yield, compliance, reduction in R value, or comparison with traditional methods.
- Evident from the text: because this is a review, conclusions depend on heterogeneous external sources and many examples are presented as early or preliminary, so the strength of evidence varies across technologies.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
21 Valid · 3 Not valid · 38 Not checked · 25 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Case identification by online symptom reporting, as seen in Singapore 48 and the UK 49 , is traditionally used for surveillance, but it now offers advice on isolation and referrals to further healthcare services, such as video assessments 50 and testing.”
What the sources say
- Not matchedcites [48] Singapore COVID-19 Symptom Checker. https://sgcovidcheck.gov.sg/ (2020).
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites [49] NHS 111 online. https://111.nhs.uk/covid-19/ (2020).
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites [50] Greenhalgh, T., Koh, G. C. H. & Car, J. Covid-19: a remote assessment in primary care. Br. Med. J. 368, m1182 (2020). source
Citation 50 is attached to “video assessments,” not to the claims about online symptom reporting in Singapore and the UK. In “What you should cover,” the paper discusses when video consultation is appropriate for patients with suspected COVID-19; its case example also offers a patient a video consultation. (LLM, conf=0.91)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Similarly, digital technologies also have been deployed in the COVID-19 pandemic 13,14 (Table 1) to strengthen each of the four public-health measures noted above.”
What the sources say
- Partly supportedcites [13] Ting, D. S. W., Carin, L., Dzau, V. & Wong, T. Y. Digital technology and COVID-19. Nat. Med. 26, 459–461 (2020). sourceExperimental — accuracy not yet measured
The paper’s “Monitoring, surveillance, detection and prevention of COVID-19” section describes digital tracking, screening and public communication, supporting three of the measures in substance. Its Table 1 also lists detection and prevention applications, but the copy does not establish that digital technologies were deployed to interrupt community transmission specifically; it describes quarantine and contact tracing as traditional measures. (LLM, conf=0.82)
- Partly supportedcites [14] McCall, B. COVID-19 and artificial intelligence: protecting health-care workers and curbing the spread. Lancet Digit Health 2, e166–e167 (2020). sourceExperimental — accuracy not yet measured
In the section “COVID-19 and artificial intelligence: protecting health-care workers and curbing the spread” (page unavailable), McCall describes digital outbreak tracking, AI-assisted rapid identification of possible COVID-19 cases, and models that might inform border checks. The paper does not describe digital technology deployed for public communication, and it presents some transmission-control uses as potential rather than established. It therefore does not support the claim that deployment strengthened each of the four measures. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Models for COVID-19 (ref. 33 ), building on previously established internet search algorithms for influenza 34 , are included in Public Health England's weekly reports 35 .”
What the sources say
- Supportedcites [33] Lampos, V. et al. Tracking COVID-19 using online search. Preprint at https://arxiv.org/abs/2003.08086 (2020). source
The Introduction describes the paper’s COVID-19 models using online search data and places them in the context of earlier influenza models. The Discussion states that Public Health England incorporated the paper’s unsupervised models into its weekly COVID-19 surveillance reports. (LLM, conf=0.93)
- Supportedcites [34] Lampos, V. et al. Advances in nowcasting influenza-like illness rates using search query logs. Sci. Rep. 5, 12760 (2015). source
Reference 34 is attached to the previously established internet-search algorithms for influenza, not to the COVID-19 models or Public Health England reports. The Abstract describes using search-engine logs to predict influenza-like illness rates, and Results > Query-only models describes the paper’s flu-related search-query model. (LLM, conf=0.92)
- Not matchedcites [35] Public Health England. Weekly Coronavirus Disease 2019 (COVID-19) Surveillance Report https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/888254/COVID19_Epidemiological_Summary_w22_Final.pdf (2020).
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“After case identification and isolation, rapid tracing and quarantining of contacts is needed to prevent further transmission 70 .”
What the sources say
- Partly supportedcites [70] Fraser, C., Riley, S., Anderson, R. M. & Ferguson, N. M. Factors that make an infectious disease outbreak controllable. Proc. Natl Acad. Sci. USA 101, 6146–6151 (2004). sourceExperimental — accuracy not yet measured
The Results and Conclusions passage says contact tracing needs to be added to isolation for diseases with sufficiently high presymptomatic or asymptomatic transmission, and can reduce transmission. But the paper does not say it is always needed: its comparison of diseases says isolation alone can control SARS, while tracing and quarantine are predicted to be insufficient for influenza. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Online data and social media have had an ongoing, important role in public communication 101 since the first reports of an unusual influenza-like illness resistant to conventional treatment methods emerged in China 102 .”
What the sources say
- Not checked — no full text of the sourcecites [101] Merchant, R. M. & Lurie, N. Social media and emergency preparedness in response to novel coronavirus. J. Am. Med. Assoc. 323, 2011–2012 (2020). source
- Partly supportedcites [102] Green, A. Li Wenliang. Lancet 395, 682 (2020). sourceExperimental — accuracy not yet measured
The cited paper’s “Li Wenliang” section reports that Li warned fellow doctors in Wuhan about patients with SARS-like symptoms, including through WeChat. It does not describe the illness as influenza-like or say it resisted conventional treatment. The citation marked 102 follows the description of the first reports, while citation 101 follows the broader claim about online communication. (LLM, conf=0.88)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
27 more claims · 5 with their cited sources checked
Create a free account to see all 87 claims and to verify the 15 references still open.
- It may state two separate claims as one. 41
- Probably not a substantial claim. 25
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“there is limited research carried out on the economic/fiscal impact mHealth solutions have had in this unique time [27, 28].”
From A prospective observational real world feasibility study assessing the role of app-based remote patient monitoring in reducing primary care clinician workload during the COVID pandemic (2021) · cites this paper as [27]
Experimental — accuracy not yet measured
Citations
Cites
A novel coronavirus from patients with pneumonia in China, 2019
Zhu, N., Zhang, D., Wang, W., Li, X., Yang, B., Song, J., Zhao, X., Huang, B., Shi, W., Lu, R., et al. (2020) · New England Journal of Medicine · doi:10.1056/nejmoa2001017 · Cited by 28,244
A new coronavirus associated with human respiratory disease in China
Wu, F., Zhao, S., Yu, B., Chen, Y.-M., Wang, W., Song, Z.-G., Hu, Y., Tao, Z.-W., Tian, J.-H., Pei, Y.-Y., et al. (2020) · Nature · doi:10.1038/s41586-020-2008-3 · Cited by 11,688
The effect of travel restrictions on the spread of the 2019 novel coronavirus (COVID-19) outbreak
Chinazzi, M., Davis, J. T., Ajelli, M., Gioannini, C., Litvinova, M., Merler, S., Pastore y Piontti, A., Mu, K., Rossi, L., Sun, K., et al. (2020) · Science · doi:10.1126/science.aba9757 · Cited by 3,694
Wynants, L., Van Calster, B., Bonten, M. M., Collins, G. S., Debray, T. P., De Vos, M., Haller, M. C., Heinze, G., Moons, K. G., Riley, R. D., et al. (2020) · doi:10.1101/2020.03.24.20041020 · Cited by 3,070
The effect of human mobility and control measures on the COVID-19 epidemic in China
Kraemer, M. U. G., Yang, C.-H., Gutierrez, B., Wu, C.-H., Klein, B., Pigott, D. M., Open COVID-19 Data Working Group, du Plessis, L., Faria, N. R., Li, R., et al. (2020) · Science · doi:10.1126/science.abb4218 · Cited by 2,950
Quantifying SARS-CoV-2 transmission suggests epidemic control with digital contact tracing
Ferretti, L., Wymant, C., Kendall, M., Zhao, L., Nurtay, A., Abeler-Dörner, L., Parker, M., Bonsall, D., & Fraser, C. (2020) · Science · doi:10.1126/science.abb6936 · Cited by 2,512
Online mental health services in China during the COVID-19 outbreak
Liu, S., Yang, L., Zhang, C., Xiang, Y.-T., Liu, Z., Hu, S., & Zhang, B. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30077-8 · Cited by 1,992
The International Telecommunication Union
Jones, R. W. (2002) · IEEE Antennas and Propagation Society International Symposium 1997. Digest · doi:10.1109/aps.1997.631791 · Cited by 1,909
Health equity in England: the Marmot review 10 years on
Marmot, M. (2020) · BMJ · doi:10.1136/bmj.m693 · Cited by 1,834 · cited 1×
“Public health has long been under-funded compared with the funding of other areas of health 145 .”
ResultDiagnosing COVID-19: The Disease and Tools for Detection
Udugama, B., Kadhiresan, P., Kozlowski, H. N., Malekjahani, A., Osborne, M., Li, V. Y. C., Chen, H., Mubareka, S., Gubbay, J. B., & Chan, W. C. W. (2020) · ACS Nano · doi:10.1021/acsnano.0c02624 · Cited by 1,754
Research works printed but not linked: 1
- Ada Lovelace Institute. Exit through the App Store? A rapid evidence review on the technical considerations and societal implications of using technology to transition from the COVID-19 crisis. https://www.adalovelaceinstitute.org/our-work/covid-19/covid-19-exit-through-the-app-store/ (2020).
Cited by
Symptoms, complications and management of long COVID: a review
Aiyegbusi, O. L., Hughes, S. E., Turner, G., Rivera, S. C., McMullan, C., Chandan, J. S., Haroon, S., Price, G., Davies, E. H., Nirantharakumar, K., et al. (2021) · Journal of the Royal Society of Medicine · doi:10.1177/01410768211032850 · Cited by 969
“Digital technologies are currently being used for the public health response to the COVID-19 pandemic through population surveillance, case identification, contact tracing and evaluation of interventions.(86) A study found up to 30.”
MethodFederated learning for predicting clinical outcomes in patients with COVID-19
Dayan, I., Roth, H. R., Zhong, A., Harouni, A., Gentili, A., Abidin, A. Z., Liu, A., Costa, A. B., Wood, B. J., Tsai, C.-S., et al. (2021) · Nature Medicine · doi:10.1038/s41591-021-01506-3 · Cited by 842
Himeur, Y., Ghanem, K., Alsalemi, A., Bensaali, F., & Amira, A. (2021) · Applied Energy · doi:10.1016/j.apenergy.2021.116601 · Cited by 660
“To that end, the use of RS for supporting human decision making has recently received increased interest [259, 260].”
BackgroundNon-pharmaceutical interventions during the COVID-19 pandemic: A review
Perra, N. (2021) · Physics Reports · doi:10.1016/j.physrep.2021.02.001 · Cited by 531
“ct of digital technology Here, we nd two reviews that highlight the incredible opportunities oered by digital technologies to capture behaviors, their changes and inform modeling as well as policies [363, 364]. Interestingly, they also discuss the issues linked to privacy, legal, ethical concerns and biases in the dat…”
BackgroundInfluentialInformation technology solutions, challenges, and suggestions for tackling the COVID-19 pandemic
He, W., Zhang, Z. (., & Li, W. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2020.102287 · Cited by 463
Metadata
- Authors
- Budd, J., Miller, B. S., Manning, E. M., Lampos, V., Zhuang, M., Edelstein, M., Rees, G., Emery, V. C., Stevens, M. M., Keegan, N., Short, M. J., Pillay, D., Manley, E., Cox, I. J., Heymann, D., Johnson, A. M., & McKendry, R. A.
- Affiliations
- London Centre for Nanotechnology (GB)
- University College London (GB)
- Chatham House (GB)
- University of Surrey (GB)
- Imperial College London (GB)
- Newcastle University (GB)
- Department for International Trade (GB)
- University of Leeds (GB)
- University of Copenhagen (DK)
- London School of Hygiene & Tropical Medicine (GB)
- Corresponding author
- McKendry, Rachel A.
- ORCID
- Venue
- Nature Medicine
- Published
- 2020-08-01
- Volume
- 26
- Issue
- 8
- Pages
- 1183-1192
- ISSN
- 1078-8956 (ISSN-L)
- 1546-170X
- OpenAlex
- W3047747926
- Cited by
- 1,195
- References
- 91
- Citations by year
- 2026: 67 · 2025: 140 · 2024: 177 · 2023: 223 · 2022: 279 · 2021: 256 · 2020: 52
- FWCI
- 29.35
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature Medicine (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Research at the University of Copenhagen (University of Copenhagen) (submittedVersion)
- Spiral (Imperial College London) (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Funders
- RCUK | Engineering and Physical Sciences Research Council (EP/R00529X/1, EP/R018391/1)
- RCUK | Medical Research Council (MC_PC_19070)
- Topics
- Physical Sciences › Computer Science › Information Systems › COVID-19 Digital Contact Tracing
- Health Sciences › Medicine › Epidemiology › Data-Driven Disease Surveillance
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- COVID-19 pandemic, digital health technologies, public health response, contact tracing, population surveillance, case finding, mobility data, privacy and ethics, implementation barriers, pandemic preparedness, digital health applications, symptom monitoring, machine learning, natural language processing
- MeSH terms
- Machine Learning, Betacoronavirus, COVID-19, SARS-CoV-2, Humans, Natural Language Processing, Pneumonia, Viral, Population Surveillance, Public Health, Coronavirus Infections, Privacy, Pandemics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Digital technologies in the public-health response to COVID-19. https://app.cochat.ai/papers/10.1038/s41591-020-1011-4
- The paper
- Budd, J., Miller, B. S., Manning, E. M., Lampos, V., Zhuang, M., Edelstein, M., Rees, G., Emery, V. C., Stevens, M. M., Keegan, N., Short, M. J., Pillay, D., Manley, E., Cox, I. J., Heymann, D., Johnson, A. M., & McKendry, R. A. (2020). Digital technologies in the public-health response to COVID-19. Nature Medicine. https://doi.org/10.1038/s41591-020-1011-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.