Correlations of Online Search Engine Trends With Coronavirus Disease (COVID-19) Incidence: Infodemiology Study
Open accessPublished version of a preprint
The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The coronavirus disease (COVID-19) is the latest pandemic of the digital age. With the internet harvesting large amounts of data from the general population in real time, public databases such as Google Trends (GT) and the Baidu Index (BI) can be an expedient tool to assist public health efforts. OBJECTIVE: The aim of this study is to apply digital epidemiology to the current COVID-19 pandemic to determine the utility of providing adjunctive epidemiologic information on outbreaks of this disease and evaluate this methodology in the case of future pandemics. METHODS: An epidemiologic time series analysis of online search trends relating to the COVID-19 pandemic was performed from January 9, 2020, to April 6, 2020. BI was used to obtain online search data for China, while GT was used for worldwide data, the countries of Italy and Spain, and the US states of New York and Washington. These data were compared to real-world confirmed cases and deaths of COVID-19. Chronologic patterns were assessed in relation to disease patterns, significant events, and media reports. RESULTS: Worldwide search terms for shortness of breath, anosmia, dysgeusia and ageusia, headache, chest pain, and sneezing had strong correlations (r>0.60, P<.001) to both new daily confirmed cases and deaths from COVID-19. GT COVID-19 (search term) and GT coronavirus (virus) searches predated real-world confirmed cases by 12 days (r=0.85, SD 0.10 and r=0.76, SD 0.09, respectively, P<.001). Searches for symptoms of diarrhea, fever, shortness of breath, cough, nasal obstruction, and rhinorrhea all had a negative lag greater than 1 week compared to new daily cases, while searches for anosmia and dysgeusia peaked worldwide and in China with positive lags of 5 days and 6 weeks, respectively, corresponding with widespread media coverage of these symptoms in COVID-19. CONCLUSIONS: This study demonstrates the utility of digital epidemiology in providing helpful surveillance data of disease outbreaks like COVID-19. Although certain online search trends for this disease were influenced by media coverage, many search terms reflected clinical manifestations of the disease and showed strong correlations with real-world cases and deaths.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Similarly, the growing interest in the current COVID-19 pandemic and online information search about COVID-19 were reported in many countries in Asia, Europe, and the United States [16, 45–48].”
From Digital health literacy, online information-seeking behaviour, and satisfaction of Covid-19 information among the university students of East and South-East Asia (2022) · cites this paper as [46]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Online search engines harvest a huge quantity of real-time data from the public and this has led to an interest in utilizing this data for public health use during possible infectious disease outbreaks [4].”
From Global Interest in Telehealth During COVID-19 Pandemic: An Analysis of Google Trends™ (2020) · cites this paper as [4]
In the citing paper
“Google Trends™ is one such example of Big Data information surveillance tools used for the analysis and interpretation of temporal and geographical trends of online search terms using the Google™ search engine [4].”
From Global Interest in Telehealth During COVID-19 Pandemic: An Analysis of Google Trends™ (2020) · cites this paper as [4]
In the citing paper
“As these searches are time stamped, the timing of these searches can be correlated to a certain public event or confirmed disease spread and can be used to predict the dissemination of disease from these events [4].”
From Global Interest in Telehealth During COVID-19 Pandemic: An Analysis of Google Trends™ (2020) · cites this paper as [4]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Clinical characteristics of coronavirus disease 2019 in China
Guan, W.-J., Ni, Z.-Y., Hu, Y., Liang, W.-H., Ou, C.-Q., He, J.-X., Liu, L., Shan, H., Lei, C.-L., Hui, D. S. C., et al. (2020) · New England Journal of Medicine · doi:10.1056/nejmoa2002032 · Cited by 30,246
A novel coronavirus outbreak of global health concern
Wang, C., Horby, P. W., Hayden, F. G., & Gao, G. F. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30185-9 · Cited by 7,700 · cited 1×
“Key concepts were presented to the research group, and a preliminary list of search terms was compiled using COVID-19 nomenclature and symptomatology [22-27].”
MethodNeurologic manifestations of hospitalized patients with coronavirus disease 2019 in Wuhan, China
Mao, L., Jin, H., Wang, M., Hu, Y., Chen, S., He, Q., Chang, J., Hong, C., Zhou, Y., Wang, D., et al. (2020) · JAMA Neurology · doi:10.1001/jamaneurol.2020.1127 · Cited by 7,166
On a measure of lack of fit in time series models
LJUNG, G. M., & BOX, G. E. P. (1978) · Biometrika · doi:10.1093/biomet/65.2.297 · Cited by 6,668 · cited 1×
“Autocorrelation functions and partial autocorrelation functions were assessed, and the Ljung-Box statistic was used to examine the residuals from the time series models to evaluate the lack of fit [35].”
MethodStraightforward Statistics for the Behavioral Sciences.
Wuensch, K. L., & Evans, J. D. (1996) · Journal of the American Statistical Association · doi:10.2307/2291607 · Cited by 2,409 · cited 1×
“These symptoms may better represent patients developing disease, rather than those simply curious about the virus and its symptoms [41,42].”
BackgroundEysenbach, G. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1157 · Cited by 1,351 · cited 1×
“His work in the field has led to the concept of information epidemiology, which has been termed infodemiology [2,3].”
BackgroundIntroduction to Time Series and Forecasting
Brockwell, P. J., & Davis, R. A. (2016) · Springer Texts in Statistics · doi:10.1007/978-3-319-29854-2 · Cited by 1,183
Mavragani, A., Ochoa, G., & Tsagarakis, K. P. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9366 · Cited by 390 · cited 1×
“In a recent systematic review, Mavragani et al [13] identified over 100 peer-reviewed papers studying health-related phenomena using GT data, demonstrating trending in search volumes with time related to the population’s increased use of the internet search engines in seeking information regarding their health.”
BackgroundCOVID‐19 Anosmia Reporting Tool: Initial Findings
Kaye, R., Chang, C. W. D., Kazahaya, K., Brereton, J., & Denneny, J. C. (2020) · Otolaryngology–Head and Neck Surgery · doi:10.1177/0194599820922992 · Cited by 389
Is Google Trends a reliable tool for digital epidemiology? Insights from different clinical settings
Cervellin, G., Comelli, I., & Lippi, G. (2017) · Journal of Epidemiology and Global Health · doi:10.1016/j.jegh.2017.06.001 · Cited by 328 · cited 2×
“This was observed in our study with better reliability seen in those symptoms of COVID-19 with less media coverage [38,45].”
MethodLi, C., Chen, L. J., Chen, X., Zhang, M., Pang, C. P., & Chen, H. (2020) · Eurosurveillance · doi:10.2807/1560-7917.es.2020.25.10.2000199 · Cited by 313 · cited 2×
“Key concepts were presented to the research group, and a preliminary list of search terms was compiled using COVID-19 nomenclature and symptomatology [22-27].”
BackgroundMethodHusnayain, A., Fuad, A., & Su, E. C.-Y. (2020) · International Journal of Infectious Diseases · doi:10.1016/j.ijid.2020.03.021 · Cited by 249 · cited 1×
“Key concepts were presented to the research group, and a preliminary list of search terms was compiled using COVID-19 nomenclature and symptomatology [22-27].”
MethodUse of Google Trends to investigate loss-of-smell-related searches during the COVID-19 outbreak
Walker, A., Hopkins, C., & Surda, P. (2020) · International Forum of Allergy & Rhinology · doi:10.1002/alr.22580 · Cited by 216 · cited 8×
“Similarly, on March 8, both an International Women’s Day March and a Vox party rally were taking place with thousands of people in attendance.”
BackgroundInfluentialDean, R. T., & Dunsmuir, W. T. M. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0611-2 · Cited by 215
Chow, E. J., Schwartz, N. G., Tobolowsky, F. A., Zacks, R. L. T., Huntington-Frazier, M., Reddy, S. C., & Rao, A. K. (2020) · JAMA · doi:10.1001/jama.2020.6637 · Cited by 181
Bernardo, T. M., Rajic, A., Young, I., Robiadek, K., Pham, M. T., & Funk, J. A. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2740 · Cited by 163 · cited 1×
“The zoonotic infections influenza H5H1 in 1997 and severe acute respiratory syndrome (SARS) in 2002 led to significant interests in using advances in technology and data harvesting to assist in disease prediction, surveillance, and mitigation [1].”
BackgroundData mining from web search queries: A comparison of google trends and baidu index
Vaughan, L. Q., & Chen, Y. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23201 · Cited by 143 · cited 2×
“Both platforms do not provide the exact methodology by which they generate search data, and the study population responsible for the searches cannot be determined [21].”
BackgroundShin, S.-Y., Seo, D.-W., An, J., Kwak, H., Kim, S.-H., Gwack, J., & Jo, M.-W. (2016) · Scientific Reports · doi:10.1038/srep32920 · Cited by 124 · cited 2×
“Previous epidemics have supported the use of internet searches for outbreak surveillance, suggesting that this method of surveillance may deserve more investment by public health agencies with development for the sole purposes of health care [4-7,9].”
BackgroundReappraising the utility of Google Flu Trends
Kandula, S., & Shaman, J. L. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007258 · Cited by 123 · cited 1×
“With online search engines harvesting large amounts of data from the general population in real time and providing the information publicly, interest has risen in the potential for public health use of these data during impending outbreaks [4-10].”
BackgroundMajumder, M. S., Santillana, M., Mekaru, S. R., McGinnis, D. P., Khan, K., & Brownstein, J. S. (2016) · JMIR Public Health and Surveillance · doi:10.2196/publichealth.5814 · Cited by 121
Barros, J. M., Duggan, J., & Rebholz-Schuhmann, D. (2020) · Journal of Medical Internet Research · doi:10.2196/13680 · Cited by 111
Correlation between Google Trends on dengue fever and national surveillance report in Indonesia
Husnayain, A., Fuad, A., & Lazuardi, L. (2019) · Global Health Action · doi:10.1080/16549716.2018.1552652 · Cited by 107 · cited 2×
“Previous epidemics have supported the use of internet searches for outbreak surveillance, suggesting that this method of surveillance may deserve more investment by public health agencies with development for the sole purposes of health care [4-7,9].”
BackgroundEnd-Stage Heart Failure With COVID-19
Dong, N., Cai, J., Zhou, Y., Liu, J., & Li, F. (2020) · JACC Heart Failure · doi:10.1016/j.jchf.2020.04.001 · Cited by 107
SARS and Population Health Technology
Eysenbach, G. (2003) · Journal of Medical Internet Research · doi:10.2196/jmir.5.2.e14 · Cited by 88 · cited 1×
“His work in the field has led to the concept of information epidemiology, which has been termed infodemiology [2,3].”
BackgroundInterpreting “Google Flu Trends” data for pandemic H1N1 influenza: The New Zealand experience
Wilson, N., Mason, K., Tobias, M., Peacey, M., Huang, Q. S., & Baker, M. (2009) · Eurosurveillance · doi:10.2807/ese.14.44.19386-en · Cited by 78 · cited 2×
“Previous epidemics have supported the use of internet searches for outbreak surveillance, suggesting that this method of surveillance may deserve more investment by public health agencies with development for the sole purposes of health care [4-7,9].”
BackgroundWhy do people Google epilepsy?
Brigo, F., Igwe, S. C., Ausserer, H., Nardone, R., Tezzon, F., Bongiovanni, L. G., & Trinka, E. (2013) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2013.11.020 · Cited by 76
2019 Novel Coronavirus (COVID-19)
Pasqualoni, S. (2020) · doi:10.2172/1602724 · Cited by 43
Notifiable infectious disease surveillance with data collected by search engine
Zhou, X., & Shen, H. (2010) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/jzus.c0910371 · Cited by 32 · cited 1×
“In 2010, Zhou and Shen [14] reported that Baidu search queries and news articles were 10-40 days ahead of official epidemiology for several infectious diseases in China.”
BackgroundDigital epidemiology: assessment of measles infection through Google Trends mechanism in Italy.
Santangelo, O. E., Provenzano, S., Piazza, D., Giordano, D., Calamusa, G., & Firenze, A. (2020) · PubMed · doi:10.7416/ai.2019.2300 · Cited by 30 · cited 2×
“Previous epidemics have supported the use of internet searches for outbreak surveillance, suggesting that this method of surveillance may deserve more investment by public health agencies with development for the sole purposes of health care [4-7,9].”
BackgroundSuppli, C. H., Rasmussen, M., Valentiner‐Branth, P., Mølbak, K., & Krause, T. G. (2017) · Eurosurveillance · doi:10.2807/1560-7917.es.2017.22.17.30522 · Cited by 20
Duong, V. (2017) · Wiley eBooks · doi:10.1002/9781119368755.index · Cited by 10
Temporal lobe epilepsy? Things are not always what they seem
Doležalová, I., Brázdil, M., & Kahane, P. (2017) · Epileptic Disorders · doi:10.1684/epd.2017.0897 · Cited by 9
(2013) · Palgrave Macmillan eBooks · doi:10.1057/9781137346056.0007 · Cited by 1
Research works printed but not linked: 2
- Bieler D "A biological bomb": soccer match in Italy linked to epicenter of deadly outbreak The Washington Post 2020 3 25
- Goldstein J McKinley J Coronavirus in N.Y.: Manhattan woman is first confirmed case in the state The New York Times 2020 3 01
Cited by
Li, C., Chen, L. J., Chen, X., Zhang, M., Pang, C. P., & Chen, H. (2020) · Eurosurveillance · doi:10.2807/1560-7917.es.2020.25.10.2000199 · Cited by 313
Chow, E. J., Schwartz, N. G., Tobolowsky, F. A., Zacks, R. L. T., Huntington-Frazier, M., Reddy, S. C., & Rao, A. K. (2020) · JAMA · doi:10.1001/jama.2020.6637 · Cited by 181
Wong, M. Y. Z., Gunasekeran, D. V., Nusinovici, S., Sabanayagam, C., Yeo, K. K., Cheng, C.-Y., & Tham, Y.-C. (2021) · JMIR Public Health and Surveillance · doi:10.2196/24445 · Cited by 115
“In the current climate of the COVID-19 pandemic, these tools have recently been used to investigate the overall public interest in COVID-19 [17], public fear of COVID-19 symptoms [18], and changes in behavioral attitudes toward activies such as social distancing and hand washing [19].”
End-Stage Heart Failure With COVID-19
Dong, N., Cai, J., Zhou, Y., Liu, J., & Li, F. (2020) · JACC Heart Failure · doi:10.1016/j.jchf.2020.04.001 · Cited by 107
Htay, M. N. N., Parial, L. L., Tolabing, M. C., Dadaczynski, K., Okan, O., Leung, A. Y. M., & Su, T. T. (2022) · PLOS ONE · doi:10.1371/journal.pone.0266276 · Cited by 78
Metadata
- Authors
- Higgins, T. S., Wu, A. W., Sharma, D., Illing, E. A., Rubel, K., Ting, J. Y., & Snot Force Alliance
- Affiliations
- University of Louisville (US)
- Cedars-Sinai Medical Center (US)
- Indiana University Indianapolis (US)
- Corresponding author
- Higgins, Thomas S
- Venue
- JMIR Public Health and Surveillance
- Publisher
- JMIR Publications Inc.
- Published
- 2020-05-21
- Volume
- 6
- Issue
- 2
- Pages
- e19702
- ISSN
- 2369-2960 (ISSN-L)
- PMC
- PMC7244220
- OpenAlex
- W3024129393
- Cited by
- 129
- References
- 33
- Citations by year
- 2026: 5 · 2025: 6 · 2024: 11 · 2023: 20 · 2022: 26 · 2021: 30 · 2020: 31
- FWCI
- 19.17
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Public Health and Surveillance (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- IUScholarWorks (Indiana University) (submittedVersion, cc-by)
- Publisher
- Topics
- Health Sciences › Medicine › Epidemiology › Data-Driven Disease Surveillance
- Physical Sciences › Mathematics › Modeling and Simulation › COVID-19 epidemiological studies
- Health Sciences › Medicine › Oncology › COVID-19 and healthcare impacts
- Keywords
- COVID-19 pandemic, digital epidemiology, internet search trends, Google Trends, Baidu Index, COVID-19 incidence, COVID-19 mortality, anosmia, dysgeusia, media coverage, disease surveillance, pandemic
- MeSH terms
- COVID-19, Humans, Pneumonia, Viral, Incidence, Coronavirus Infections, Internet, Search Engine, Pandemics, Public Health Surveillance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.