Cited by 98Data-Driven Disease SurveillanceInfluenza Virus Research StudiesArtificial Intelligence in Healthcare

FluBreaks: Early Epidemic Detection from Google Flu Trends

Open access
Pervaiz, Fahad, Pervaiz, Mansoor, Abdur Rehman, Nabeel, Saif, Umar·2012·Journal of Medical Internet Research

Abstract

BACKGROUND: The Google Flu Trends service was launched in 2008 to track changes in the volume of online search queries related to flu-like symptoms. Over the last few years, the trend data produced by this service has shown a consistent relationship with the actual number of flu reports collected by the US Centers for Disease Control and Prevention (CDC), often identifying increases in flu cases weeks in advance of CDC records. However, contrary to popular belief, Google Flu Trends is not an early epidemic detection system. Instead, it is designed as a baseline indicator of the trend, or changes, in the number of disease cases. OBJECTIVE: To evaluate whether these trends can be used as a basis for an early warning system for epidemics. METHODS: We present the first detailed algorithmic analysis of how Google Flu Trends can be used as a basis for building a fully automated system for early warning of epidemics in advance of methods used by the CDC. Based on our work, we present a novel early epidemic detection system, called FluBreaks (dritte.org/flubreaks), based on Google Flu Trends data. We compared the accuracy and practicality of three types of algorithms: normal distribution algorithms, Poisson distribution algorithms, and negative binomial distribution algorithms. We explored the relative merits of these methods, and related our findings to changes in Internet penetration and population size for the regions in Google Flu Trends providing data. RESULTS: Across our performance metrics of percentage true-positives (RTP), percentage false-positives (RFP), percentage overlap (OT), and percentage early alarms (EA), Poisson- and negative binomial-based algorithms performed better in all except RFP. Poisson-based algorithms had average values of 99%, 28%, 71%, and 76% for RTP, RFP, OT, and EA, respectively, whereas negative binomial-based algorithms had average values of 97.8%, 17.8%, 60%, and 55% for RTP, RFP, OT, and EA, respectively. Moreover, the EA was also affected by the region's population size. Regions with larger populations (regions 4 and 6) had higher values of EA than region 10 (which had the smallest population) for negative binomial- and Poisson-based algorithms. The difference was 12.5% and 13.5% on average in negative binomial- and Poisson-based algorithms, respectively. CONCLUSIONS: We present the first detailed comparative analysis of popular early epidemic detection algorithms on Google Flu Trends data. We note that realizing this opportunity requires moving beyond the cumulative sum and historical limits method-based normal distribution approaches, traditionally employed by the CDC, to negative binomial- and Poisson-based algorithms to deal with potentially noisy search query data from regions with varying population and Internet penetrations. Based on our work, we have developed FluBreaks, an early warning system for flu epidemics using Google Flu Trends.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/jmir.2102

Cites

26 of 26 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Disease surveillance and outbreak forecasting systems can be built from web data and specially-designed apps, in addition to traditional surveys.

    “Disease surveillance and outbreak forecasting systems can be built from web data and specially-designed apps, in addition to traditional surveys [394,467,627].”

    From Tackling climate change with machine learning (2023) · cites this paper as [627]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 1

  1. [25]Fact Monster Pearson Education 2012 2012-03-08 U.S. Population by State, 1790 to 2010 http://www.factmonster.com/ipka/A0004986.html

Cited by

Sorted by citations

Authors
Pervaiz, F., Pervaiz, M., Abdur Rehman, N., & Saif, U.
Affiliations
Lahore University of Management Sciences (PK)
Corresponding author
Pervaiz, Fahad
Venue
Journal of Medical Internet Research
Published
2012-10-04
Volume
14
Issue
5
Pages
e125
ISSN
1438-8871 (ISSN-L)
OpenAlex
W2129813704
Cited by
98
References
26
Citations by year
2026: 3 · 2025: 3 · 2024: 3 · 2023: 5 · 2022: 12 · 2021: 7 · 2020: 7 · 2019: 12 · 2018: 5 · 2017: 6 · 2016: 9 · 2015: 9 · 2014: 6 · 2013: 11
FWCI
6.23
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Medical Internet Research (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • University of Michigan
  • York University
Topics
  • Health Sciences › Medicine › Epidemiology › Data-Driven Disease Surveillance
  • Health Sciences › Medicine › Epidemiology › Influenza Virus Research Studies
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Keywords
Google Flu Trends, influenza surveillance, early epidemic detection, search data, Poisson distribution, negative binomial distribution, normal distribution, population size effects, internet penetration, automated detection algorithm, false positives and false negatives, cumulative sum control chart
MeSH terms
Centers for Disease Control and Prevention, U.S., Disease Outbreaks, Humans, Influenza, Human, Population Surveillance, United States

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review