Google Trends in Infodemiology and Infoveillance: Methodology Framework
Open accessPublished version of a preprint
The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Abstract
Internet data are being increasingly integrated into health informatics research and are becoming a useful tool for exploring human behavior. The most popular tool for examining online behavior is Google Trends, an open tool that provides information on trends and the variations of online interest in selected keywords and topics over time. Online search traffic data from Google have been shown to be useful in analyzing human behavior toward health topics and in predicting disease occurrence and outbreaks. Despite the large number of Google Trends studies during the last decade, the literature on the subject lacks a specific methodology framework. This article aims at providing an overview of the tool and data and at presenting the first methodology framework in using Google Trends in infodemiology and infoveillance, including the main factors that need to be taken into account for a strong methodology base. We provide a step-by-step guide for the methodology that needs to be followed when using Google Trends and the essential aspects required for valid results in this line of research. At first, an overview of the tool and the data are presented, followed by an analysis of the key methodological points for ensuring the validity of the results, which include selecting the appropriate keyword(s), region(s), period, and category. Overall, this article presents and analyzes the key points that need to be considered to achieve a strong methodological basis for using Google Trends data, which is crucial for ensuring the value and validity of the results, as the analysis of online queries is extensively integrated in health research in the big data era.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures










Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Furthermore, using specific search topics without any search category restrictions proves beneficial for capturing the general interest of diverse populations [34,35].”
From Public and Research Interest in Telemedicine From 2017 to 2022: Infodemiology Study of Google Trends Data and Bibliometric Analysis of Scientific Literature (2024) · cites this paper as [34]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Google Trends™ enables its users to extract the present and archived data of any selected keywords searched via Google™ from 2004 onwards which can be localized over different regions and periods [11].”
From Global Interest in Telehealth During COVID-19 Pandemic: An Analysis of Google Trends™ (2020) · cites this paper as [11]
In the citing paper
“It is worth mentioning that search topics are a group of terms that share the same concept across languages, covering an array of variations, typos, and related searches [34,35].”
From Public and Research Interest in Telemedicine From 2017 to 2022: Infodemiology Study of Google Trends Data and Bibliometric Analysis of Scientific Literature (2024) · cites this paper as [34]
In the citing paper
“For this reason, the “+” feature of Google Trends™ can be utilized which enables the user to include the synonymous or related words of a search term. This creates a combination of keywords that takes into account all possible search requests for a health topic of interest to carry out a detailed analysis [11].”
From Global Interest in Telehealth During COVID-19 Pandemic: An Analysis of Google Trends™ (2020) · cites this paper as [11]
In the citing paper
“Google Trends™ has become a popular tool in analyzing the public’s interest in health topics and predicting human behavior during disease outbreaks [11].”
From Global Interest in Telehealth During COVID-19 Pandemic: An Analysis of Google Trends™ (2020) · cites this paper as [11]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Eysenbach, G. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1157 · Cited by 1,351 · cited 3×
“…and determinants of information in an electronic medium, specifically the Internet, or in a population, with the ultimate aim to inform public health and public policy” [1], and “Infoveillance,” defined as “the longitudinal tracking of infodemiology metrics for surveillance and trend analysis” [2].”
BackgroundMethodThe use of google trends in health care research: a systematic review
Nuti, S. V., Wayda, B., Ranasinghe, I., Wang, S., Dreyer, R. P., Chen, S. I., & Murugiah, K. (2014) · PLoS ONE · doi:10.1371/journal.pone.0109583 · Cited by 1,086 · cited 1×
“Nevertheless, data from several online sources are being widely used to monitor disease outbreaks and occurrence, mainly from Google [3-7] and social media [8-12].”
BackgroundQuantifying Trading Behavior in Financial Markets Using Google Trends
Preis, T., Moat, H. S., & Stanley, H. E. (2013) · Scientific Reports · doi:10.1038/srep01684 · Cited by 948
Digital disease detection - harnessing the Web for public health surveillance
Brownstein, J. S., Freifeld, C. C., & Madoff, L. C. (2009) · New England Journal of Medicine · doi:10.1056/nejmp0900702 · Cited by 819
Google Trends: A Web‐Based Tool for Real‐Time Surveillance of Disease Outbreaks
Carneiro, H. A., & Mylonakis, E. (2009) · Clinical Infectious Diseases · doi:10.1086/630200 · Cited by 808
Jun, S.-P., Yoo, H. S., & Choi, S. (2018) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2017.11.009 · Cited by 530
Salathé, M., Bengtsson, L., Bodnar, T. J., Brewer, D. D., Brownstein, J. S., Buckee, C., Campbell, E. M., Cattuto, C., Khandelwal, S., Mabry, P. L., et al. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002616 · Cited by 500 · cited 1×
“Over the past decade, Web-based data are used extensively in digital epidemiology, with online sources playing a central role in health informatics [1,2,52].”
BackgroundInfodemiology: tracking flu-related searches on the web for syndromic surveillance.
Eysenbach, G. (2006) · Europe PMC (PubMed Central) · Cited by 418
Infodemiology and Infoveillance
Eysenbach, G. (2011) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2011.02.006 · Cited by 414
Mavragani, A., Ochoa, G., & Tsagarakis, K. P. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9366 · Cited by 390 · cited 1×
“Nevertheless, data from several online sources are being widely used to monitor disease outbreaks and occurrence, mainly from Google [3-7] and social media [8-12].”
BackgroundSelf-citationInfluenza Forecasting with Google Flu Trends
Dugas, A. F., Jalalpour, M., Gel, Y., Levin, S., Torcaso, F., Igusa, T., & Rothman, R. E. (2013) · PLoS ONE · doi:10.1371/journal.pone.0056176 · Cited by 343
Researching Mental Health Disorders in the Era of Social Media: Systematic Review
Wongkoblap, A., Vadillo, M. A., & Curcin, V. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7215 · Cited by 268
Quantifying the Advantage of Looking Forward
Preis, T., Moat, H. S., Stanley, H. E., & Bishop, S. R. (2012) · Scientific Reports · doi:10.1038/srep00350 · Cited by 185
Measuring the Public Agenda using Search Engine Queries
Scharkow, M., & Vogelgesang, J. (2011) · International Journal of Public Opinion Research · doi:10.1093/ijpor/edq048 · Cited by 171
Bernardo, T. M., Rajic, A., Young, I., Robiadek, K., Pham, M. T., & Funk, J. A. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2740 · Cited by 163
A Google-based approach for monitoring suicide risk
Solano, P., Ustulin, M., Pizzorno, E., Vichi, M., Pompili, M., Serafini, G., & Amore, M. (2016) · Psychiatry Research · doi:10.1016/j.psychres.2016.10.030 · Cited by 130
Ricard, B. J., Marsch, L. A., Crosier, B., & Hassanpour, S. (2018) · Journal of Medical Internet Research · doi:10.2196/11817 · Cited by 95
Lu, F. S., Hou, S., Baltrusaitis, K., Shah, M., Leskovec, J., Sosic, R., Hawkins, J., Brownstein, J., Conidi, G., Gunn, J., et al. (2018) · JMIR Public Health and Surveillance · doi:10.2196/publichealth.8950 · Cited by 94
Too Far to Care? Measuring Public Attention and Fear for Ebola Using Twitter
van Lent, L. G., Sungur, H., Kunneman, F. A., van de Velde, B., & Das, E. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7219 · Cited by 92
YES or NO: Predicting the 2015 GReferendum results using Google Trends
Mavragani, A., & Tsagarakis, K. P. (2016) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2016.04.028 · Cited by 87
Self-citationAssociation Between Cancer Incidence and Mortality in Web-Based Data in China: Infodemiology Study
Xu, C., Wang, Y., Yang, H., Hou, J., Sun, L. N., Zhang, X., Cao, X., Hou, Y., Wang, L., Cai, Q., et al. (2019) · Journal of Medical Internet Research · doi:10.2196/10677 · Cited by 83
Phillips, C. A., Barz Leahy, A., Li, Y., Schapira, M. M., Bailey, L. C., & Merchant, R. M. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.8870 · Cited by 81
Vaccine Images on Twitter: Analysis of What Images are Shared
Chen, T., & Dredze, M. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.8221 · Cited by 77
Wakamiya, S., Kawai, Y., & Aramaki, E. (2018) · JMIR Public Health and Surveillance · doi:10.2196/publichealth.8627 · Cited by 75
Internet Search and Krokodil in the Russian Federation: An Infoveillance Study
Zheluk, A., Quinn, C., & Meylakhs, P. A. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3203 · Cited by 71
Foroughi, F., Lam, A. K.-Y., Lim, M. S. C., Saremi, N., & Ahmadvand, A. (2016) · JMIR Cancer · doi:10.2196/cancer.5212 · Cited by 65
Vasconcellos-Silva, P. R., Carvalho, D. B. F., Trajano, V. D. S., Rocque, L. D. L., Sawada, A. C. M. B., & Juvanhol, L. L. (2017) · JMIR Public Health and Surveillance · doi:10.2196/publichealth.7015 · Cited by 65
Roccetti, M., Marfia, G., Salomoni, P., Prandi, C., Zagari, R. M., Gningaye Kengni, F. L., Bazzoli, F., & Montagnani, M. (2017) · JMIR Public Health and Surveillance · doi:10.2196/publichealth.7004 · Cited by 58
Hswen, Y., Gopaluni, A., Brownstein, J. S., & Hawkins, J. B. (2019) · JMIR mhealth and uhealth · doi:10.2196/12264 · Cited by 58
Du, J., Tang, L., Xiang, Y., Zhi, D., Xu, J., Song, H.-Y., & Tao, C. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9413 · Cited by 53
Álvarez-Mon, M. Á., Asúnsolo, Á., Fraile‐Μartinez, O., Quintero, J., Ferre, F., Pereira-Sánchez, V., Ortuño, F., & Álvarez‐Mon, M. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9582 · Cited by 53
Estimating influenza attack rates in the United States using a participatory cohort
Chunara, R., Goldstein, E., Patterson-Lomba, O., & Brownstein, J. S. (2015) · Scientific Reports · doi:10.1038/srep09540 · Cited by 51
The Internet and the Anti-Vaccine Movement: Tracking the 2017 EU Measles Outbreak
Mavragani, A., & Ochoa, G. (2018) · Big Data and Cognitive Computing · doi:10.3390/bdcc2010002 · Cited by 48
Self-citationMonitoring public interest toward pertussis outbreaks: an extensive Google Trends–based analysis
Gianfredi, V., Bragazzi, N. L., Mahamid, M., Bisharat, B., Mahroum, N., Amital, H., & Adawi, M. (2018) · Public Health · doi:10.1016/j.puhe.2018.09.001 · Cited by 48
Predicting referendum results in the Big Data Era
Mavragani, A., & Tsagarakis, K. P. (2019) · Journal Of Big Data · doi:10.1186/s40537-018-0166-z · Cited by 46
Self-citationSewalk, K. C., Tuli, G., Hswen, Y., Brownstein, J. S., & Hawkins, J. B. (2018) · Journal of Medical Internet Research · doi:10.2196/10043 · Cited by 44
Bragazzi, N. L., & Mahroum, N. (2019) · JMIR Public Health and Surveillance · doi:10.2196/13142 · Cited by 44
Tracking search engine queries for suicide in the United Kingdom, 2004–2013
Arora, V. S., Stuckler, D., & McKee, M. (2016) · Public Health · doi:10.1016/j.puhe.2015.10.015 · Cited by 43
Farhadloo, M., Winneg, K., Chan, M.-P. S., Hall Jamieson, K., & Albarracin, D. (2018) · JMIR Public Health and Surveillance · doi:10.2196/publichealth.8186 · Cited by 42
Detection of Cases of Noncompliance to Drug Treatment in Patient Forum Posts: Topic Model Approach
Abdellaoui, R., Foulquié, P., Texier, N., Faviez, C., Burgun, A., & Schück, S. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9222 · Cited by 40
Jones, J., Pradhan, M. P., Hosseini, M., Kulanthaivel, A., & Hosseini, M. (2018) · JMIR Medical Informatics · doi:10.2196/medinform.9162 · Cited by 39
Tracking Dabbing Using Search Query Surveillance: A Case Study in the United States
Zhang, Z., Zheng, X., Zeng, D. D., & Leischow, S. J. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5802 · Cited by 38
Gamma, A., Schleifer, R., Weinmann, W., Buadze, A., & Liebrenz, M. (2016) · PLoS ONE · doi:10.1371/journal.pone.0166566 · Cited by 38
Mejova, Y., Weber, I. G., & Fernández-Luque, L. (2018) · JMIR Public Health and Surveillance · doi:10.2196/publichealth.7217 · Cited by 38
Chen, S., Xu, Q., Buchenberger, J. D., Bagavathi, A., Fair, G., Shaikh, S., & Krishnan, S. (2018) · JMIR Public Health and Surveillance · doi:10.2196/10827 · Cited by 38
Forecasting AIDS prevalence in the United States using online search traffic data
Mavragani, A., & Ochoa, G. (2018) · Journal Of Big Data · doi:10.1186/s40537-018-0126-7 · Cited by 37
Self-citationSubregional Nowcasts of Seasonal Influenza Using Search Trends
Kandula, S., Hsu, D., & Shaman, J. L. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7486 · Cited by 36
Tana, J., Kettunen, J. A., Eirola, E., & Paakkonen, H. J. (2018) · JMIR Mental Health · doi:10.2196/mental.9152 · Cited by 36
Poirier, C., Lavenu, A., Bertaud, V., Campillo‐Gimenez, B., Chazard, E., Cuggia, M., & Bouzillé, G. (2018) · JMIR Public Health and Surveillance · doi:10.2196/11361 · Cited by 36
Infodemiology of systemic lupus erythematous using Google Trends
Radin, M., & Sciascia, S. (2017) · Lupus · doi:10.1177/0961203317691372 · Cited by 34
Digital disease detection and participatory surveillance: overview and perspectives for Brazil
Leal-Neto, O. B., Dimech, G. S., Libel, M., de Oliveira, W. K., & Ferreira, J. P. (2016) · Revista de Saúde Pública · doi:10.1590/s1518-8787.2016050006201 · Cited by 31
Simpson, S. S., Adams, N., Brugman, C. M., & Conners, T. J. (2018) · JMIR Public Health and Surveillance · doi:10.2196/publichealth.7726 · Cited by 31
Mavragani, A., Sampri, A., Sypsa, K., & Tsagarakis, K. P. (2018) · JMIR Public Health and Surveillance · doi:10.2196/publichealth.8726 · Cited by 31
Self-citationHookah-Related Posts to Twitter From 2017 to 2018: Thematic Analysis
Allem, J.-P., Dharmapuri, L., Leventhal, A. M., Unger, J. B., & Cruz, T. B. (2018) · Journal of Medical Internet Research · doi:10.2196/11669 · Cited by 31
Huesch, M. D., Chetlen, A. L., Segel, J. E., & Schetter, S. E. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7508 · Cited by 28
Keller, M. S., Mosadeghi, S., Cohen, E. R., Kwan, J., & Spiegel, B. M. R. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9870 · Cited by 28
Watad, ., Watad, S., Mahroum, N., Sharif, Κ., Amital, H., Bragazzi, N. L., & Adawi, M. (2019) · JMIR Public Health and Surveillance · doi:10.2196/publichealth.9176 · Cited by 27
Monitoring Interest in Herpes Zoster Vaccination: Analysis of Google Search Data
Berlinberg, E. J., Deiner, M. S., Porco, T. C., & Acharya, N. R. (2018) · JMIR Public Health and Surveillance · doi:10.2196/10180 · Cited by 24
Infoveillance of infectious diseases in USA: STDs, tuberculosis, and hepatitis
Mavragani, A., & Ochoa, G. (2018) · Journal Of Big Data · doi:10.1186/s40537-018-0140-9 · Cited by 23
Self-citationPark, S. H., & Hong, S. H. (2018) · Journal of Medical Internet Research · doi:10.2196/11085 · Cited by 20
Mavragani, A., Sypsa, K., Sampri, A., & Tsagarakis, K. P. (2016) · Water · doi:10.3390/w8110542 · Cited by 19
Self-citationOdlum, M. L., Yoon, S., Broadwell, P. M., Brewer, R., & Kuang, D. (2018) · JMIR Public Health and Surveillance · doi:10.2196/10262 · Cited by 19
Wang, H.-W., & Chen, D. (2018) · JMIR Public Health and Surveillance · doi:10.2196/publichealth.7314 · Cited by 17
Google Flu Trends includes 14 European countries.
(2009) · PubMed · Cited by 14
Research works printed but not linked: 2
- 10.2807/ese.14.40.19352-en · doi:10.2807/ese.14.40.19352-en
- Eysenbach, G, 2006, AMIA Annu Symp Proc, 244
Cited by
COVID-19-Related Web Search Behaviors and Infodemic Attitudes in Italy: Infodemiological Study.
Rovetta, A., & Bhagavathula, A. S. (2020) · JMIR Public Health and Surveillance · doi:10.2196/19374 · Cited by 291
Association of the COVID-19 pandemic with internet search volumes: a Google Trends™ analysis
Effenberger, M., Kronbichler, A., Shin, J. I., Mayer, G., Tilg, H., & Perco, P. (2020) · International Journal of Infectious Diseases · doi:10.1016/j.ijid.2020.04.033 · Cited by 270
Infodemiology and Infoveillance: Scoping Review
Mavragani, A. (2020) · Journal of Medical Internet Research · doi:10.2196/16206 · Cited by 229
Self-citationIs the COVID-19 lockdown nudging people to be more active: a big data analysis
Ding, D., del Pozo Cruz, B., Green, M. A., & Bauman, A. E. (2020) · British Journal of Sports Medicine · doi:10.1136/bjsports-2020-102575 · Cited by 213
Han, S. H., Safeek, R., Ockerman, K., Trieu, N., Mars, P., Klenke, A., Furnas, H., & Sorice-Virk, S. (2023) · Aesthetic Surgery Journal · doi:10.1093/asj/sjad211 · Cited by 210
Metadata
- Authors
- Mavragani, A., & Ochoa, G.
- Affiliations
- University of Stirling (GB)
- Corresponding author
- Mavragani, Amaryllis
- Venue
- JMIR Public Health and Surveillance
- Publisher
- JMIR Publications Inc.
- Published
- 2019-05-29
- Volume
- 5
- Issue
- 2
- Pages
- e13439
- ISSN
- 2369-2960 (ISSN-L)
- PMC
- PMC6660120
- OpenAlex
- W2947051005
- Cited by
- 520
- References
- 64
- Citations by year
- 2026: 79 · 2025: 59 · 2024: 55 · 2023: 76 · 2022: 103 · 2021: 83 · 2020: 59 · 2019: 4
- FWCI
- 47.17
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Public Health and Surveillance (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Stirling Online Research Repository (University of Stirling) (submittedVersion, cc-by)
- Topics
- Health Sciences › Medicine › Epidemiology › Data-Driven Disease Surveillance
- Social Sciences › Transportation › Human Mobility and Location-Based Analysis
- Social Sciences › Health › Social Media in Health Education
- Keywords
- Google Trends, infodemiology, infoveillance, internet search data, search query analysis, methodological framework, keyword selection, data validity, health behavior, epidemic forecasting
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.