Effectiveness of contact tracing apps for SARS-CoV-2: a rapid systematic review
Open accessAbstract
Objective: To systematically review evidence on effectiveness of contact tracing apps (CTAs) for SARS-CoV-2 on epidemiological and clinical outcomes. Design: Rapid systematic review. Data sources: EMBASE (OVID), MEDLINE (PubMed), BioRxiv and MedRxiv were searched up to 28 October 2020. Study selection: Studies, both empirical and model-based, assessing effect of CTAs for SARS-CoV-2 on reproduction number (R), total number of infections, hospitalisation rate, mortality rate, and other epidemiologically and clinically relevant outcomes, were eligible for inclusion. Data extraction: Empirical and model-based studies were critically appraised using separate checklists. Data on type of study (ie, empirical or model-based), sample size, (simulated) time horizon, study population, CTA type (and associated interventions), comparator and outcomes assessed, were extracted. The most important findings were extracted and narratively summarised. Specifically for model-based studies, characteristics and values of important model parameters were collected. Results: 2140 studies were identified, of which 17 studies (2 empirical, 15 model-based studies) were eligible and included in this review. Both empirical studies were observational (non-randomised) studies and at high risk of bias, most importantly due to risk of confounding. Risk of bias of model-based studies was considered low for 12 out of 15 studies. Most studies demonstrated beneficial effects of CTAs on R, total number of infections and mortality rate. No studies assessed effect on hospitalisation. Effect size was dependent on model parameters values used, but in general, a beneficial effect was observed at CTA adoption rates of 20% or higher. Conclusions: CTAs have the potential to be effective in reducing SARS-CoV-2 related epidemiological and clinical outcomes, though effect size depends on other model parameters (eg, proportion of asymptomatic individuals, or testing delays), and interventions after CTA notification. Methodologically sound comparative empirical studies on effectiveness of CTAs are required to confirm findings from model-based studies.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Critical appraisal skills programme
Singh, J. (2013) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.107697 · Cited by 2,571 · see citing works
Quantifying SARS-CoV-2 transmission suggests epidemic control with digital contact tracing
Ferretti, L., Wymant, C., Kendall, M., Zhao, L., Nurtay, A., Abeler-Dörner, L., Parker, M., Bonsall, D., & Fraser, C. (2020) · Science · doi:10.1126/science.abb6936 · Cited by 2,512 · see citing works
Nußbaumer-Streit, B., Mayr, V., Dobrescu, A. I., Chapman, A. L., Persad, E., Klerings, I., Wagner, G., Siebert, U., Christof, C., Zachariah, C., et al. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013574 · Cited by 951 · see citing works
Kucharski, A. J., Klepac, P., Conlan, A. J. K., Kissler, S. M., Tang, M. L., Fry, H., Gog, J. R., Edmunds, W. J., Emery, J. C., Medley, G., et al. (2020) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(20)30457-6 · Cited by 900 · see citing works
Impact of delays on effectiveness of contact tracing strategies for COVID-19: a modelling study
Kretzschmar, M. E., Rozhnova, G., Bootsma, M. C. J., van Boven, M., van de Wijgert, J. H. H. M., & Bonten, M. J. M. (2020) · The Lancet Public Health · doi:10.1016/s2468-2667(20)30157-2 · Cited by 697 · see citing works
Self-citationBraithwaite, I., Callender, T., Bullock, M., & Aldridge, R. W. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30184-9 · Cited by 318 · see citing works
Digital contact tracing technologies in epidemics: a rapid review
Anglemyer, A. T., Moore, T. H., Parker, L., Chambers, T. J., Grady, A., Chiu, K., Parry, M. F., Wilczynska, M., Flemyng, E., & Bero, L. A. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013699 · Cited by 204 · see citing works
Davalbhakta, S., Advani, S., Kumar, S., Agarwal, V., Bhoyar, S., Fedirko, E., Misra, D. P., Goel, A., Gupta, L., & Agarwal, V. (2020) · Journal of Medical Systems · doi:10.1007/s10916-020-01633-3 · Cited by 199 · see citing works
Chen, C.-M., Jyan, H.-W., Chien, S.-C., Jen, H.-H., Hsu, C.-Y., Lee, P.-C., Lee, C.-F., Yang, Y.-T., Chen, M., Chen, S. L., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/19540 · Cited by 168 · see citing works
Bidirectional contact tracing could dramatically improve COVID-19 control
Bradshaw, W. J., Alley, E. C., Huggins, J. H., Lloyd, A. L., & Esvelt, K. M. (2021) · Nature Communications · doi:10.1038/s41467-020-20325-7 · Cited by 166 · see citing works
An Agent-Based Modeling of COVID-19: Validation, Analysis, and Recommendations
Shamil, M. S., Farheen, F., Ibtehaz, N., Khan, I. M., & Rahman, M. S. (2021) · Cognitive Computation · doi:10.1007/s12559-020-09801-w · Cited by 118 · see citing works
Endo, A., Leclerc, Q. J., Knight, G. M., Medley, G. F., Atkins, K. E., Funk, S., & Kucharski, A. J. (2020) · Wellcome Open Research · doi:10.12688/wellcomeopenres.16344.3 · Cited by 98 · see citing works
Grimm, V., Mengel, F., & Schmidt, M. (2021) · Scientific Reports · doi:10.1038/s41598-021-83540-2 · Cited by 94 · see citing works
Scott, N., Palmer, A. Y., Delport, D., Abeysuriya, R., Stuart, R. M., Kerr, C. C., Mistry, D., Klein, D. J., Sacks‐Davis, R., Heath, K., et al. (2020) · The Medical Journal of Australia · doi:10.5694/mja2.50845 · Cited by 88 · see citing works
Kendall, M., Milsom, L. H., Abeler‐Dörner, L., Wymant, C., Luca Ferretti, A., Briers, M., Holmes, C. C., Bonsall, D., Abeler, J., & Fraser, C. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30241-7 · Cited by 83 · see citing works
An Agent Based Modeling of COVID-19: Validation, Analysis, and RecommendationsPreprint
Shamil, M. S., Farheen, F., Ibtehaz, N., et al. (2020) · medRxiv · doi:10.1101/2020.07.05.20146977 · Cited by 50 · see citing works
Stemming the flow: how much can the Australian smartphone app help to control COVID-19?
Currie, D. J., Peng, C., Lyle, D. M., Jameson, B., & Frommer, M. S. (2020) · Public Health Research & Practice · doi:10.17061/phrp3022009 · Cited by 37 · see citing works
Ferrari, A., Santus, E., Cirillo, D., Ponce-de-León, M., Marino, N., Ferretti, M. T., Chadha, A. S., Mavridis, N., & Valencia, A. (2021) · npj Digital Medicine · doi:10.1038/s41746-020-00374-4 · Cited by 36 · see citing works
The impact of digital contact tracing on the SARS-CoV-2 pandemic—a comprehensive modelling study
Pollmann, T. R., Pollmann, J., Wiesinger, C., Haack, C., Shtembari, L., Turcati, A., Neumair, B., Meighen-Berger, S. A., Zattera, G., Neumair, B., et al. (2021) · EPJ Data Science · doi:10.1140/epjds/s13688-021-00290-x · Cited by 32 · see citing works
Kurita, J., Sugawara, T., & Ohkusa, Y. (2020) · Journal of Infection and Chemotherapy · doi:10.1016/j.jiac.2020.08.012 · Cited by 31 · see citing works
Digital Herd Immunity and COVID-19Preprint
Bulchandani, V. B., Shivam, S., Moudgalya, S., et al. (2020) · medRxiv · doi:10.1101/2020.04.15.20066720 · Cited by 29 · see citing works
Universal Shelter-in-Place Versus Advanced Automated Contact Tracing and Targeted Isolation
Nuzzo, A., Tan, C. O., Raskar, R., DeSimone, D. C., Kapa, S., & Gupta, R. (2020) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2020.06.027 · Cited by 17 · see citing works
Grimm, V., Mengel, F., & Schmidt, M. (2020) · medRxiv · doi:10.1101/2020.04.24.20078113 · Cited by 15 · see citing works
The impact of digital contact tracing on the SARS-CoV-2 pandemic - a comprehensive modelling studyPreprint
Pollmann, T. R., Pollmann, J., Wiesinger, C., et al. (2020) · medRxiv · doi:10.1101/2020.09.13.20192682 · Cited by 15 · see citing works
Risk assessment via layered mobile contact tracing for epidemiological interventionPreprint
Guttal, V., Krishna, S., & Siddharthan, R. (2020) · medRxiv · doi:10.1101/2020.04.26.20080648 · Cited by 12 · see citing works
Digital Proximity Tracing in the COVID-19 Pandemic on Empirical Contact NetworksPreprint
Cencetti, G., Santin, G., Longa, A., et al. (2020) · Research Square · doi:10.21203/rs.3.rs-41017/v1 · Cited by 12 · see citing works
Endo, A., Leclerc, Q. J., Knight, G. M., et al. (2020) · medRxiv · doi:10.1101/2020.08.01.20166595 · Cited by 9 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- [6]Cochrane Effective Practice and Organisation of Care (EPOC). EPOC Resources for review authors [Internet], 2017. Available: https://epoc.cochrane.org/resources/epoc-resources-review-authors
Cited by
Sorted by citations
The Lancet Commission on lessons for the future from the COVID-19 pandemic
Sachs, J. D., Karim, S. S. A., Aknin, L., Allen, J., Brosbøl, K., Colombo, F., Barron, G. C., Espinosa, M. F., Gaspar, V., Gaviria, A., et al. (2022) · The Lancet · doi:10.1016/s0140-6736(22)01585-9 · Cited by 842 · see citing works
- Authors
- Jenniskens, K., Bootsma, M. C. J., Damen, J. A. A. G., Oerbekke, M. S., Vernooij, R. W. M., Spijker, R., Moons, K. G. M., Kretzschmar, M. E. E., & Hooft, L.
- Affiliations
- Utrecht University (NL)
- University Medical Center Utrecht (NL)
- Corresponding author
- Jenniskens, Kevin
- ORCID
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2021-07
- Volume
- 11
- Issue
- 7
- Pages
- e050519
- ISSN
- 2044-6055 (ISSN-L)
- PMC
- PMC8277487
- OpenAlex
- W3177533180
- Cited by
- 40
- References
- 28
- Citations by year
- 2026: 1 · 2025: 5 · 2024: 10 · 2023: 8 · 2022: 15 · 2021: 1
- FWCI
- 1.30
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMJ Open (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Pure Amsterdam UMC (acceptedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- Utrecht University Repository (Utrecht University) (submittedVersion, cc-by-nc)
- Funders
- Rijksinstituut voor Volksgezondheid en Milieu (Not applicable)
- Topics
- Physical Sciences › Computer Science › Information Systems › COVID-19 Digital Contact Tracing
- Physical Sciences › Mathematics › Modeling and Simulation › COVID-19 epidemiological studies
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- contact tracing apps, SARS-CoV-2, COVID-19 pandemic, reproduction number, infection control, mortality, hospitalization, model-based simulation, asymptomatic transmission, digital contact tracing
- MeSH terms
- COVID-19, SARS-CoV-2, Humans, Bias, Contact Tracing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
