Internet search patterns reveal clinical course of COVID-19 disease progression and pandemic spread across 32 countries
Open accessPublished version of a preprint
The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Effective public health response to novel pandemics relies on accurate and timely surveillance of pandemic spread, as well as characterization of the clinical course of the disease in affected individuals. We sought to determine whether Internet search patterns can be useful for tracking COVID-19 spread, and whether these data could also be useful in understanding the clinical progression of the disease in 32 countries across six continents. Temporal correlation analyses were conducted to characterize the relationships between a range of COVID-19 symptom-specific search terms and reported COVID-19 cases and deaths for each country from January 1 through April 20, 2020. Increases in COVID-19 symptom-related searches preceded increases in reported COVID-19 cases and deaths by an average of 18.53 days (95% CI 15.98–21.08) and 22.16 days (20.33–23.99), respectively. Cross-country ensemble averaging was used to derive average temporal profiles for each search term, which were combined to create a search-data-based view of the clinical course of disease progression. Internet search patterns revealed a clear temporal pattern of disease progression for COVID-19: Initial symptoms of fever, dry cough, sore throat and chills were followed by shortness of breath an average of 5.22 days (3.30–7.14) after initial symptom onset, matching the clinical course reported in the medical literature. This study shows that Internet search data can be useful for characterizing the detailed clinical course of a disease. These data are available in real-time at population scale, providing important benefits as a complementary resource for tracking pandemics, especially before widespread laboratory testing is available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Parable of Google Flu: Traps in Big Data Analysis
Lazer, D., Kennedy, R., King, G., & Vespignani, A. (2014) · Science · doi:10.1126/science.1248506 · Cited by 2,523
Li, C., Chen, L. J., Chen, X., Zhang, M., Pang, C. P., & Chen, H. (2020) · Eurosurveillance · doi:10.2807/1560-7917.es.2020.25.10.2000199 · Cited by 313
Association of the COVID-19 pandemic with internet search volumes: a Google Trends™ analysis
Effenberger, M., Kronbichler, A., Shin, J. I., Mayer, G., Tilg, H., & Perco, P. (2020) · International Journal of Infectious Diseases · doi:10.1016/j.ijid.2020.04.033 · Cited by 270
Husnayain, A., Fuad, A., & Su, E. C.-Y. (2020) · International Journal of Infectious Diseases · doi:10.1016/j.ijid.2020.03.021 · Cited by 249
Use of Google Trends to investigate loss-of-smell-related searches during the COVID-19 outbreak
Walker, A., Hopkins, C., & Surda, P. (2020) · International Forum of Allergy & Rhinology · doi:10.1002/alr.22580 · Cited by 216 · cited 1×
“Belgium, France, Germany, Hungary, Ireland, Italy, Netherlands, Poland, Spain, Sweden, Switzerland, United Kingdom”
Tracking COVID-19 using online search
Lampos, V., Majumder, M. S., Yom-Tov, E., Edelstein, M., Moura, S., Hamada, Y., Rangaka, M. X., McKendry, R. A., & Cox, I. J. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00384-w · Cited by 164
Tracking COVID-19 in Europe: infodemiology approach
Mavragani, A. (2020) · JMIR Public Health and Surveillance · doi:10.2196/18941 · Cited by 145
Strzelecki, A. (2020) · Brain Behavior and Immunity · doi:10.1016/j.bbi.2020.04.042 · Cited by 114 · cited 1×
“Belgium, France, Germany, Hungary, Ireland, Italy, Netherlands, Poland, Spain, Sweden, Switzerland, United Kingdom”
Research works printed but not linked: 34
- Fineberg, H. V. Pandemic preparedness and response–lessons from the H1N1 influenza of 2009. N. Engl. J. Med. 370, 1335–1342 (2014). · DOI · Paper page
- Balter, S. et al. Pandemic (H1N1) 2009 surveillance for severe illness and response, New York, New York, USA, April-July 2009. Emerg. Infect. Dis. 16, 1259–1264 (2010). · DOI
- Peto, J. Covid-19 mass testing facilities could end the epidemic rapidly. BMJ 368, m1163 (2020). · DOI · Paper page
- Godlee, F. The burning building. BMJ 368, m1101 (2020). · DOI
- Sheridan, C. Fast, portable tests come online to curb coronavirus pandemic. Nat. Biotechnol. https://doi.org/10.1038/d41587-020-00010-2. (2020). · doi:10.1038/d41587-020-00010-2
- Xu, M. et al. COVID-19 diagnostic testing: technology perspective. Clin. Transl. Med. 10, e158 (2020).
- Fagherazzi, G., Goetzinger, C., Rashid, M. A., Aguayo, G. A. & Huiart, L. Digital health strategies to fight COVID-19 worldwide: challenges, recommendations, and a call for papers. J. Med. Internet Res. 22, e19284 (2020). · DOI · Paper page
- Alicino, C. et al. Assessing Ebola-related web search behaviour: insights and implications from an analytical study of Google Trends-based query volumes. Infect. Dis. Poverty 4, 54 (2015). · DOI · Paper page
- Kandula, S. & Shaman, J. Reappraising the utility of Google Flu Trends. PLoS Comput. Biol. 15, e1007258 (2019). · DOI
- Shin, S.-Y. et al. High correlation of Middle East respiratory syndrome spread with Google search and Twitter trends in Korea. Sci. Rep. 6, 32920 (2016). · DOI · Paper page
- Santangelo, O. E. et al. Digital epidemiology: assessment of measles infection through Google Trends mechanism in Italy. Ann. Ig. 31, 385–391 (2019).
- Reis, B. Y. & Brownstein, J. S. Measuring the impact of health policies using Internet search patterns: the case of abortion. BMC Public Health 10, 514 (2010). · DOI · Paper page
- Barak-Corren, Y. & Reis, B. Y. Internet activity as a proxy for vaccination compliance. Vaccine 33, 2395–2398 (2015). vol. · DOI
- Jarynowski, A., Wojta-Kempa, M. & Belik, V. Perception of emergent epidemic of COVID-2019/SARS CoV-2 on the Polish Internet. https://doi.org/10.1101/2020.03.29.20046789 (2020). · doi:10.1101/2020.03.29.20046789
- Strzelecki, A. & Rizun, M. Infodemiological study using Google Trends on Coronavirus epidemic in Wuhan. China Int. J. Online Biomed. Eng. 16, 139 (2020). · DOI · Paper page
- Ayyoubzadeh, S. M., Ayyoubzadeh, S. M., Zahedi, H., Ahmadi, M. & R Niakan Kalhori, S. Predicting COVID-19 incidence through analysis of Google Trends data in Iran: data mining and deep learning pilot study. JMIR Public Health Surveill. 6, e18828 (2020). · DOI · Paper page
- Yuan, X. et al. Trends and prediction in daily incidence and deaths of COVID-19 in the United States: a search-interest based model. medRxiv https://doi.org/10.1101/2020.04.15.20064485. (2020). · DOI
- Hoerger, M. et al. Impact of the COVID-19 pandemic on mental health: real-time surveillance using Google Trends. Psychol. Trauma 12, 567–568 (2020). · DOI
- Rajan, A. et al. Association of search query interest in gastrointestinal symptoms With COVID-19 diagnosis in the United States: infodemiology study. JMIR Public Health Surveill. 6, e19354 (2020). · DOI
- Pier, M. M., Pasick, L. J., Benito, D. A., Alnouri, G. & Sataloff, R. T. Otolaryngology-related google search trends during the COVID-19 pandemic. Am. J. Otolaryngol. 41, 102615 (2020). · DOI
- Ahmad, I., Flanagan, R. & Staller, K. Increased internet search interest for GI symptoms may predict COVID-19 cases in U.S. hotspots. Clin. Gastroenterol. Hepatol. https://doi.org/10.1016/j.cgh.2020.06.058. (2020). · DOI
- Senecal, C., Gulati, R. & Lerman, A. Google trends insights into reduced acute coronary syndrome admissions during the COVID-19 pandemic: infodemiology study. JMIR Cardio. 4, e20426 (2020). · DOI
- Liu, J., Weitzman, E. R. & Chunara, R. Assessing behavior stage progression from social media data. 2017 ACM Conference on Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. Association for Computing Machinery, New York, NY, United States (2017). · DOI · Paper page
- Wu, Q. et al. Seasonality and global public interest in psoriasis: an infodemiology study. Postgrad. Med. J. 96, 139–143 (2020). · DOI
- Arora, V. S., McKee, M. & Stuckler, D. Google trends: opportunities and limitations in health and health policy research. Health Policy 123, 338–341 (2019). · DOI · Paper page
- Wang, D. et al. Clinical characteristics of 138 hospitalized patients with 2019 novel coronavirus–infected pneumonia in Wuhan, China. JAMA 323, 1061 (2020). · DOI · Paper page
- Tan, S. C. Clinical and epidemiological characteristics of Coronavirus Disease 2019 (COVID-19) patients. medRxiv https://doi.org/10.1101/2020.04.02.20050989. (2019). · DOI
- Cohen, P. A., Hall, L. E., John, J. N. & Rapoport, A. B. The early natural history of SARS-CoV-2 infection: clinical observations from an urban, ambulatory COVID-19 clinic. Mayo Clin. Proc. 95, 1124–1126 (2020). · DOI
- Huang, C. et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet 395, 497–506 (2020). · DOI · Paper page
- Benjamin Lucas Brendan Elliot. Online Information Search During COVID-19. Preprint at arXiv https://arxiv.org/pdf/2004.07183.pdf (2020). · arXiv
- Lin, Y.-H., Liu, C.-H. & Chiu, Y.-C. Google searches for the keywords of ‘wash hands’ predict the speed of national spread of COVID-19 outbreak among 21 countries. Brain Behav. Immunity https://doi.org/10.1016/j.bbi.2020.04.020. (2020). · DOI · Paper page
- Din, H. N., McDaniels-Davidson, C., Nodora, J. & Madanat, H. Profiles of a health information-seeking population and the current digital divide: cross-sectional analysis of the 2015-2016 California health interview survey. J. Med. Internet Res. 21, e11931 (2019). · DOI · Paper page
- McCloud, R. F., Okechukwu, C. A., Sorensen, G. & Viswanath, K. Beyond access: barriers to internet health information seeking among the urban poor. J. Am. Med. Inform. Assoc. 23, 1053–1059 (2016). · DOI · Paper page
- Wogu, J. O. et al. Mass media reportage of Lassa fever in Nigeria: a viewpoint. J. Int. Med. Res. 48, 300060518821552 (2020).
Cited by
Stadler, M., Bannert, M., & Sailer, M. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108386 · Cited by 262
COVID-19 Symptom-Related Google Searches and Local COVID-19 Incidence in Spain: Correlational Study
Jimenez, A. J., Estevez-Reboredo, R. M., Santed, M. A., & Ramos, V. (2020) · Journal of Medical Internet Research · doi:10.2196/23518 · Cited by 47
Changes to public health surveillance methods due to the COVID-19 pandemic: scoping review
Clark, E. C., Neumann, S., Hopkins, S., Kostopoulos, A., Hagerman, L., & Dobbins, M. (2024) · JMIR Public Health and Surveillance · doi:10.2196/49185 · Cited by 42
Metadata
- Authors
- Lu, T., & Reis, B. Y.
- Venue
- npj Digital Medicine
- Published
- 2021-02-11
- Volume
- 4
- Issue
- 1
- Pages
- 22-22
- ISSN
- 2398-6352 (ISSN-L)
- OpenAlex
- W3128563569
- Cited by
- 35
- References
- 8
- FWCI
- 4.75
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Internet search patterns reveal clinical course of COVID-19 disease progression and pandemic spread across 32 countries. https://app.cochat.ai/papers/10.1038/s41746-021-00396-6
- The paper
- Lu, T., & Reis, B. Y. (2021). Internet search patterns reveal clinical course of COVID-19 disease progression and pandemic spread across 32 countries. npj Digital Medicine. https://doi.org/10.1038/s41746-021-00396-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.