The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index; 5 of the 8 sources its claims cite were checked for support.
The Parable of Google Flu: Traps in Big Data Analysis
Open accessAbstract
Large errors in flu prediction were largely avoidable, which offers lessons for the use of big data.
Overview
CoChat Summary
TL;DR
The paper uses the failure of Google Flu Trends (GFT) to illustrate two traps in big data analysis: “big data hubris” and algorithm dynamics. It argues that GFT’s large flu-prediction errors were largely avoidable and that big data should supplement, not replace, traditional data and methods.
Key findings
- In February 2013, GFT predicted more than double the proportion of doctor visits for influenza-like illness (ILI) than the CDC; from 21 August 2011 to 1 September 2013, GFT reported overly high flu prevalence in 100 out of 108 weeks, and it overshot the 2011–2012 season by more than 50%.
- GFT errors were not random: they showed temporal autocorrelation and seasonality, meaning last week’s errors predicted this week’s errors and error direction/magnitude varied with time of year.
- Simple alternatives outperformed GFT: out-of-sample mean absolute error was 0.486 for GFT, 0.311 for lagged CDC, and 0.232 for combined GFT and CDC; all differences were statistically significant at P < 0.05. Even 3-week-old CDC data did better than GFT at projecting current flu prevalence.
- The authors attribute GFT’s problems to overfitting (initial GFT matched 50 million search terms to 1152 data points and missed the nonseasonal 2009 H1N1 pandemic) and to “algorithm dynamics,” including Google search algorithm changes and user behavior changes.
Methods
- Design: policy forum/case study comparing GFT estimates with CDC ILI surveillance data and alternative forecasting models.
- Data/sample: GFT and CDC flu prevalence estimates, including the period from 21 August 2011 to 1 September 2013; the initial GFT methodology reportedly fit 50 million search terms to 1152 data points.
- Main analysis: comparison of GFT alone, lagged CDC data with 52-week seasonality variables, and a combined GFT + CDC model using lagged CDC estimates, lagged GFT error, and seasonality variables; reported mean absolute error and statistical significance; Google Correlate used to examine correlated search terms. Supplementary materials contain data and methods.
Limitations
- The paper states that GFT never documented the 45 search terms used, released examples appear misleading, and Google Correlate is limited to national-level data whereas GFT was developed using regional correlations; therefore the original GFT analyses cannot be replicated from the information provided.
- The paper states that Google cannot make its full data available to outsiders because of privacy issues, though it argues there is no such constraint on derivative, aggregated data.
- Evident from the text: this is a commentary/policy forum rather than a full empirical article, with key data and methods placed in supplementary materials; the quantitative comparison depends on GFT and CDC data and model specifications not fully detailed in the main text.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
2 Valid · 2 Not valid · 2 Not checked · 8 Own results and interpretations
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“This ad hoc method of throwing out peculiar search terms failed when GFT completely missed the nonseasonal 2009 infl uenza A–H1N1 pandemic ( 2, 14).”
What the sources say
- Partly supportedcites [2] sourceExperimental — accuracy not yet measured
The Discussion (page unavailable) says the original GFT model missed the spring 2009 pandemic wave, supporting the claim about its failure to detect the nonseasonal outbreak. It does not say GFT completely missed the entire 2009 pandemic. The Introduction describes automated selection of the original model’s search terms, not an ad hoc method of throwing out peculiar terms. (LLM, conf=0.86)
- Disputedcites [14] S. Cook et al., PLOS ONE 6, e23610 (2011). sourceExperimental — accuracy not yet measured
The Abstract (Methodology/Principal Findings) says the original GFT model underestimated the magnitude of illness during the 2009 H1N1 pandemic, not that it completely missed it. The Abstract (Conclusions) says both models performed well during the pandemic, although the updated model performed better. The Discussion notes that pandemic-specific queries were excluded, but does not describe this as an ad hoc method of throwing out peculiar terms. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“Oddly, the few search terms offered in the papers ( 14) do not seem to be strongly related with either GFT or the CDC data (SM)—we surmise that the authors felt an unarticulated need to cloak the actual search terms identifi ed.”
What the sources say
- Disputedcites [14] S. Cook et al., PLOS ONE 6, e23610 (2011). sourceExperimental — accuracy not yet measured
The Results section (‘Search Behavior During pH1N1’; page unavailable) says that all three search queries shown in Figure 3 closely tracked CDC ILINet data before the pandemic, and ‘symptoms of flu’ continued to do so during it. The paper does report that the bronchitis and pneumonia queries underestimated ILINet data during the pandemic, but that does not support the broad claim that the offered terms were not strongly related to the data. (LLM, conf=0.87)
Checked by a reasoning model — may be wrong.
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The Internet has opened the way for improving standard surveys, experiments, and health reporting ( 35).”
What the sources say
- Partly supportedcites [35] A. J. Berinsky et al., Polit. Anal. 20, 351–368 (2012). sourceExperimental — accuracy not yet measured
Section 2 describes using an Internet platform to run surveys with embedded experiments, and the Conclusion says MTurk can make experimental research easier and less expensive. The paper does not address improvements to health reporting; the disease scenario in section 4.3.2 is a framing experiment, not health reporting. Page numbers are unavailable in our copy. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Although not widely reported until 2013, the new GFT has been persistently overestimating flu prevalence for a much longer time.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“From 21 August 2011 to 1 September 2013, GFT reported overly high fl u prevalence 100 out of 108 weeks.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
3 more claims
Create a free account to see all 14 claims and every source verdict.
- It may state two separate claims as one. 5
- Probably not a substantial claim. 2
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Google Trends predicted more than twice the number of influenza-like illnesses than the CDC in February 2013 46 .”
From Unrepresentative big surveys significantly overestimated US vaccine uptake (2021) · cites this paper as [46]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This was one of the main reasons behind the failure of Google Flu Trends, since the data used for training the model in the first few years was not representative of the trends in subsequent years [15].”
From Theory-Guided Data Science: A New Paradigm for Scientific Discovery from Data (2017) · cites this paper as [15]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Social data research often relies on counting entities. These entities can be users, links, or messages, and the description is a summary of these counts (Lazer et al., 2014; Salganik, 2017). Yet, simple counts can mislead if it is unclear what is counted and how.”
From Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries (2019) · cites this paper as Lazer et al., 2014
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This unintelligibility is also subject to functional biases (section 4.1), as it depends on the mechanisms available on each social platform (e.g., having a like button, but not a dislike one), as well as to variations in platform algorithms and mechanisms in response to users actions (Lazer et al., 2014).”
From Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries (2019) · cites this paper as Lazer et al., 2014
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“It also includes temporal validity, which captures to what extent constructs change over time (Howison et al., 2011) and may invalidate previous conclusions about societal and/or platform phenomena; e.g., see the case of Google Flu Trends (Lazer et al., 2014).”
From Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries (2019) · cites this paper as Lazer et al., 2014
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 14 MARCH 2014 VOL 343 SCIENCE www.sciencemag.org 1204
“The 2009 version of GFT has weathered other media panics related to the fl u, including the 2005–2006 influenza A/H5N1 ("bird flu") outbreak”
“GFT engineers updated the algorithm in 2009, and this model has run ever since”
Citations
Cites
boyd, D., & Crawford, K. (2012) · Information, Communication & Society · doi:10.1080/1369118x.2012.678878 · Cited by 5,479
Twitter mood predicts the stock market
Bollen, J., Mao, H., & Zeng, X. (2011) · Journal of Computational Science · doi:10.1016/j.jocs.2010.12.007 · Cited by 5,206
Detecting influenza epidemics using search engine query data
Ginsberg, J., Mohebbi, M. H., Patel, R. S., Brammer, L., Smolinski, M. S., & Brilliant, L. (2009) · Nature · doi:10.1038/nature07634 · Cited by 4,295
Cohen, D. (1998) · The Women's Review of Books · doi:10.2307/4022859 · Cited by 4,261
Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012) · Political Analysis · doi:10.1093/pan/mpr057 · Cited by 4,008
Big Data : The Management Revolution
マカフィー, ア., ブリニョルフソン, エ., & 有賀, 裕. (2013) · Harvard business review · Cited by 3,549
Lazer, D., Pentland, A., Adamic, L., Aral, S., Barabási, A.-L., Brewer, D., Christakis, N., Contractor, N., Fowler, J., Gutmann, M., et al. (2009) · Science · doi:10.1126/science.1167742 · Cited by 3,365
Self-citationPredicting Elections with Twitter: What 140 Characters Reveal about Political Sentiment
Tumasjan, A., Sprenger, T., Sandner, P., & Welpe, I. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14009 · Cited by 2,649
Multiscale mobility networks and the spatial spreading of infectious diseases
Balcan, D., Colizza, V., Gonçalves, B., Hu, H., Ramasco, J. J., & Vespignani, A. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0906910106 · Cited by 1,380
Self-citationPredicting consumer behavior with web search
Goel, S., Hofman, J. M., Lahaie, S., Pennock, D. M., & Watts, D. J. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1005962107 · Cited by 636
Research works printed but not linked: 4
- McAfee A., Brynjolfsson E., Harv. Bus. Rev. 90, 60 (2012).
- Copeland P., et al.., Int. Soc. Negl. Trop. Dis. 2013, 3 (2013).
- Mustafaraj E., Metaxas P., in Proceedings of the Web-Sci10, Raleigh, NC, 26 and 27 April 2010 (Web Science Trust, 2010); http://journal.webscience.org/317/.
- Ratkiewicz J., et al.., in Proceedings of 5th International AAAI Conference on Weblogs and Social Media, San Francisco, CA, 7 to 11 August 2011 (AAAI, 2011), p. 297–304.
Cited by
Items 2,401–2,500 of 2,514
Morgenstern, J., Rosella, L. C., Daley, M. J., Goel, V., Schünemann, H. J., & Piggott, T. (2021) · Figshare · doi:10.6084/m9.figshare.13534369
Romero-Álvarez, D., Parikh, N., Osthus, D., Martinez, K. M., Generous, N., del Valle, S., & Manore, C. A. (2020) · Figshare · doi:10.6084/m9.figshare.12051255
Romero-Alvarez, D., Parikh, N., Osthus, D., Martinez, K. M., Generous, N., del Valle, S., & Manore, C. A. (2020) · Figshare · doi:10.6084/m9.figshare.12051240
Romero-Alvarez, D., Parikh, N., Osthus, D., Martinez, K. M., Generous, N., del Valle, S., & Manore, C. A. (2020) · Figshare · doi:10.6084/m9.figshare.12051261
Pawson, D. L., & Vance, D. J. (2004) · INFM-OAR (INFN Catania) · doi:10.5281/zenodo.169036
Morgenstern, J., Rosella, L. C., Daley, M. J., Goel, V., Schünemann, H. J., & Piggott, T. (2021) · Figshare · doi:10.6084/m9.figshare.13534360
Romero-Alvarez, D., Parikh, N., Osthus, D., Martinez, K. M., Generous, N., del Valle, S., & Manore, C. A. (2020) · Figshare · doi:10.6084/m9.figshare.12051279
Morgenstern, J., Rosella, L. C., Daley, M. J., Goel, V., Schünemann, H. J., & Piggott, T. (2021) · Figshare · doi:10.6084/m9.figshare.13534354
Behnert, J., Lajic, D., & Bauer, P. C. (2024) · Figshare · doi:10.6084/m9.figshare.26682340
Romero-Alvarez, D., Parikh, N., Osthus, D., Martinez, K. M., Generous, N., del Valle, S., & Manore, C. A. (2020) · Figshare · doi:10.6084/m9.figshare.12051249
Additional file 1 of Measuring sustainable tourism with online platform data
Hoffmann, F. J., Braesemann, F., & Teubner, T. (2022) · Figshare · doi:10.6084/m9.figshare.20336821
Morgenstern, J., Rosella, L. C., Daley, M. J., Goel, V., Schünemann, H. J., & Piggott, T. (2021) · Figshare · doi:10.6084/m9.figshare.13534357
Romero-Alvarez, D., Parikh, N., Osthus, D., Martinez, K. M., Generous, N., del Valle, S., & Manore, C. A. (2020) · Figshare · doi:10.6084/m9.figshare.12051258
Romero-Alvarez, D., Parikh, N., Osthus, D., Martinez, K. M., Generous, N., del Valle, S., & Manore, C. A. (2020) · Figshare · doi:10.6084/m9.figshare.12051288
(2025) · Duke University Press eBooks · doi:10.1215/9781478061700-001
(2025) · Duke University Press eBooks · doi:10.1215/9781478061700-004
(2025) · Duke University Press eBooks · doi:10.1215/9781478061700-003
Collu, S. (2025) · Duke University Press eBooks · doi:10.1215/9781478061700-002
Machine Learning in Public Health and the Prediction-Intervention Gap
Grote, T., & Buchholz, O. (2025) · Synthese Library/Synthese library · doi:10.1007/978-3-032-03083-2_22 · Cited by 2
DIGITAL EPIDEMIOLOGY IN CENTRAL ASIA: USING SEARCH DATA TO MONITOR INFLUENZA-LIKE ILLNESS TRENDS
Meirzhankyzy, M. A. (2025) · International Journal of Innovative Technologies in Social Science · doi:10.31435/ijitss.4(48).2025.4726
A.Chitra, Umamageshwari, R., Sharmila, L., R.Anitha, Suriya, B., & Rajalakshmi, N. R. (2025) · International Conference on IoT Based Control Networks and Intelligent Systems (ICICNIS) · doi:10.1109/icicnis66685.2025.11315830
Scaunasu, M. (2026) · Lecture notes in business information processing · doi:10.1007/978-3-032-11651-2_10
Çakmakçı, Y., Helvacı, N., Hurma, H., & Akkuzu, İ. (2025) · Yüzüncü Yıl Üniversitesi Tarım Bilimleri Dergisi · doi:10.29133/yyutbd.1683675
Chan, Y. F. (2026) · Journal of International Consumer Marketing · doi:10.1080/08961530.2025.2609081
“To triangulate qualitative findings, we collected Google Trends data for five hotwords (NFT, GG, chill, emo, FWB) across six countries from January 2019 through December 2024 (900 monthly data points), following best practices for digital trace data validation (Lazer et al. 2014).”
Kuran, E. C., & Kuran, U. (2026) · Social Science Computer Review · doi:10.1177/08944393261419796
Big Data Management in the Era of Artificial Intelligence
Abu‐Zidan, F. M., & Eid, H. (2026) · Hot topics in acute care surgery and trauma · doi:10.1007/978-3-032-09357-8_26 · Cited by 1
Cuciniello, R., Ricciardi, G. E., Ancona, A., Napoli, D. D., Din, C. T., Castagna, A., Renzi, C., Rezza, G., Moro, M., & Chiecca, G. (2026) · Annali di Igiene Medicina Preventiva e di Comunità · doi:10.7416/ai.2026.17959
Luo, S., Yu, R., Qiu, C., Ghosh, R., Ladwig, R., Hanson, P. O., Xie, Y., & Jia, X. (2025) · Proceedings · doi:10.1109/icdm65498.2025.00060 · Cited by 6
“As a result, models trained on existing datasets often fail to generalize under atypical conditions, such as extreme weather events or rare ecological phenomena, due to overfitting or the lack of relevant training examples [11].”
Validity, data sources in the digital age
Drost, E. A. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-26629-4.00201-x
Algorithmic Segmentation of the Electorate: New Clustering Practices in Political Consulting
P'yanov, M. P. (2026) · Право и политика · doi:10.7256/2454-0706.2026.2.78365
Association of Pediatric Influenza with Weather: Analysis and Prediction in Tianjin, China
Ding, J., Han, S. Q., Yao, Q., et al. (2026) · 气象学报:英文版 · doi:10.1007/s13351-026-5098-5
“The evaluation metrics on the test set were excellent, but we did not adopt this scheme because of the limitations of continuous commercial data accessibility, data noise, and interference induced by search behavior (Lazer et al., 2014).”
Kong, D., Pan, H., Wu, H. Y., & Chen, J. (2026) · Frontiers in Pediatrics · doi:10.3389/fped.2026.1659176
“…transformative potential across multiple domains: AI-powered epidemic prediction models (e.g., influenza trend analysis via big data) (28–32), rapid pathogen genome sequencing and variant tracking (exemplified by AlphaFold’s viral protein structure prediction) (33–37), and intelligent…”
Go, S., Jung, J., & Lee, G. (2026) · 국토계획 · doi:10.17208/jkpa.2026.02.61.1.68
Good science is not only about data: are you asking the right question?
Dîrzu, D. S. (2026) · Research Connections · doi:10.1093/rescon/vmag025
Google-Search Data for Psychological Scientists: A Tutorial and Best Practices
Moon, J. W., & Barlev, M. (2026) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459251409146 · Cited by 2
“Google Flu Trends showed much early promise, as we described above, but it has become a cautionary tale about using big data for prediction (Lazer et al., 2014).”
Adedeji, A., & Umel, A. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-26629-4.00301-4
Meta user movement data for analysing disaster-related mobility: sensitivity, bias, and usabilityPreprint
Constance, G., Aurélia, H., Devillet, G., et al. (2026) · Research Square · doi:10.21203/rs.3.rs-7705588/v1
Sibony, O. (2017) · theses.fr (ABES) · doi:10.70675/094d953bz4038z4e8dzae9azf970240217f0 · Cited by 2
Input noise injection for supervised machine learning, with applications on genomic and image data
Khalfaoui, B. (2019) · theses.fr (ABES) · doi:10.70675/2026ab7fzf56cz4bd4z85daz4cbfb2fbc88a
Souifi, A. (2022) · theses.fr (ABES) · doi:10.70675/787cdc9fzd54cz4296z9c71z923533b7b33f
Sociological education in Russia: Methodological challenges and practical guidelines for reform
Meshcheryakova, N. N. (2026) · Вестник Российского университета дружбы народов. Серия: Социология · doi:10.22363/2313-2272-2026-26-1-108-117
Guerra, J., Fernández, S., Benavides, D., Caranqui-Sánchez, V., & Meneses, M. (2026) · Tourism and Hospitality · doi:10.3390/tourhosp7040113
Zhang, S. (2026) · Springer eBooks · doi:10.1007/978-981-95-8228-0_7
The Opacity of the Body and the Light of Metaphors
Ferrarello, S. (2026) · Numanities - arts and humanities in progress · doi:10.1007/978-3-032-12213-1_8
Gaddis, S. M., Porter, N. D., & Verdery, A. M. (2017) · OSF Preprints (OSF Preprints)
Modern Healthcare: 3D Digital Imaging for Precision Diagnosis and Treatment
Kavitha, J., Sharmila, L., Bellinta, K. N. A., et al. (2025) · International Conference on Sustainable Computing and Smart Systems (ICSCSS) · doi:10.1109/icscss64956.2025.11500954
The Pause That Wasn't Hesitation: Validating What Platform Traces Really MeanPreprint
Zhong, Z. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6749798
Overview of Behavioural Data Science
Pogrebna, G. (2026) · Cambridge University Press eBooks · doi:10.1017/9781108939010.005
Pogrebna, G., & Hills, T. T. (2026) · Cambridge University Press eBooks · doi:10.1017/9781108939010.007
The ABCs of Behavioural Influence
Hills, T. T. (2026) · Cambridge University Press eBooks · doi:10.1017/9781108939010.011
Introduction to Behavioural Data Science
Pogrebna, G., & Hills, T. T. (2026) · Cambridge University Press eBooks · doi:10.1017/9781108939010.003
Sun, J. (2026) · Journal of big data and computing. · doi:10.62517/jbdc.202601116
Tuan, D. A., & Uyen, P. V. N. (2026) · International Journal of Biometeorology · doi:10.1007/s00484-026-03241-1
“Integrating these elements is likely to improve both calibration and short-horizon discrimination, and will determine readiness for operational deployment (Kraemer et al. 2015; Lowe et al. 2018; Hyndman and Athanasopoulos 2018; Lazer et al. 2014; Wesolowski et al. 2015).”
Die Survey-Praxis I – Schätzen unter Realbedingungen
Quatember, A., & Templ, M. (2026) · Statistik und ihre Anwendungen · doi:10.1007/978-3-662-73198-7_3
Moradkasani, S., Amiri, F. B., & Esmaeili, S. (2026) · Bacteria · doi:10.3390/bacteria5020034 · Cited by 4
“Additionally, model performance often deteriorates after deployment [239], and training datasets remain biased toward data from high-income countries, limiting the applicability of models in low-resource settings.”
Social data as a disaster management tool
Yu, D., & Knoble, C. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-27672-9.00006-9
Cooper, J. A., & Reid, S. C. (2026) · Spatial Demography · doi:10.1007/s40980-026-00164-8
“For instance, Google’s continually evolving search algorithms likely impact Google Trends metrics in ways that are difficult to predict (Lazer et al., 2014).”
InfluentialFally, M., & Mathioudakis, A. G. (2026) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2026.06.012
Cheng, L., Li, K., & Xiong, L. (2026) · Frontiers in Political Science · doi:10.3389/fpos.2026.1823018
Positioning value: mapping the logics of persuasion in Science, with evidence from AI research
Tamang, T. (2026) · Theory and Society · doi:10.1007/s11186-026-09710-1
“However, as the case of Google Flu Trends famously illustrated (Lazer et al., 2014), a gap persists between the potential of these tools and their theoretically grounded application.”
Academia and industry in the age of artificial intelligence: a narrative review
Bernstam, E. V., Johnson, T. R., & Alahdab, F. (2026) · BMJ Digital Health & AI · doi:10.1136/bmjdh-2026-000047
AI in variant analysis: fast track to genetic diagnoses
Wilk, E. J., Taluri, S., Howton, T. C., Crumley, A. B., Mrug, M. M., & Lasseigne, B. N. (2026) · Human Genetics · doi:10.1007/s00439-026-02847-0 · Cited by 2
“Overreliance on large, uncurated datasets can introduce bias, inaccuracies, and outdated information, leading to large errors in predictions (Lazer et al. 2014 ; Ross and Swetlitz 2018 ; Xing et al. 2025 ; Field - house 2025 ; Kessler et al. 2016 ) and AI “hallucinations” Page 5 of 9 54 Human…”
Artificial Intelligence for Hantavirus Outbreak Risk Prediction for Public Health Systems
Amakeh, E., & Bukhari, S. (2026) · Journal of Climate Innovation and Technology · doi:10.67303/jcit.v1i1.9
Data Ethnography: Cultivating Reflexive Sensibilities through the Cultural Analysis of Data
Poirier, L. (2026) · Journal of Statistics and Data Science Education · doi:10.1080/26939169.2026.2697726
Sun, Q., Bahati, J., Zhao, H., Hu, Z., Su, Y., Wang, X., Zhihong, D., Zhan, Z., Rui, J., Zhao, Z., et al. (2026) · BMC Infectious Diseases · doi:10.1186/s12879-026-13811-8
Computational Approaches and the Future of Urban Crime Research
Campedelli, G. M., Jelveh, Z., Chalfin, A. J., Semenza, D. C., Piza, E. L., Zumel, A. A., Lepri, B., & Sharkey, P. T. (2026) · Nature · doi:10.1038/s41586-026-10622-4 · Cited by 2
“Yet it is important to recognize a series of limitations that accompany these new forms of data 57,58 .”
Babamahmoodi, A., Babamahmoodi, F., & Marjani, M. (2026) · International Journal of Infection · doi:10.5812/iji-169286
“AI tools showed strong performance for forecasting and diagnostic support in data-rich settings but were brittle under distribution shift, as illustrated by the post hoc deterioration of Google Flu Trends (18) and COVID-era performance decay of clinical AI (19). mHealth platforms, particularly SMS-based tools usable o…”
InfluentialGonzaga, A. (2026) · IEEE International Conference on Automatic Control and Intelligent Systems (I2CACIS) · doi:10.1109/i2cacis69435.2026.11600298
“Digital and syndromic indicators can improve timeliness, but they can also become unstable when treated as direct measurements of disease burden [6], [7].”
Is Gun Demand National? Evidence from Google Searches and NICS Background Checks
Johnson, D., Elliott, S., Dooley, B. D., & Stickle, B. (2026) · Journal of Quantitative Criminology · doi:10.1007/s10940-026-09679-1
Khelil, H., Palumbo, R., & Roviello, G. N. (2026) · Pathogens · doi:10.3390/pathogens15070761
“Yet, over-reliance on behavioral data can introduce bias and noise, as demonstrated by the Google Flu Trends case [158], which exemplifies the pitfalls of unvalidated large-scale models.”
Frieri, F. R., & Orelli, R. L. (2026) · Public Money & Management · doi:10.1080/09540962.2026.2703173
Applications of artificial intelligence in infectious diseases
Barua, K., & Dasgupta, S. B. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-43934-6.00005-5
Thumfart, J. (2026) · Digital Society · doi:10.1007/s44206-026-00275-1
“The case of Google Flu Trends has been interpreted as a parable for “traps in big data analysis” (Lazer et al., 2014).”
InfluentialOgbu, D. O. F., & Igwama, G. T. (2026) · Global Journal of Medical Research · doi:10.34257/gjmrk259014
Integrating surveillance, mobility, and genomic data in pandemic models
Lazebnik, T. (2026) · Elsevier eBooks · doi:10.1016/b978-0-44-355525-1.00015-1
(2026) · Elsevier eBooks · doi:10.1016/b978-0-44-355525-1.00020-5
Tharayil, A. S., Budhewar, A. S., Andy, A., et al. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-9033-8.ch006
Machine Learning Approaches for Outbreak Detection and Forecasting
Ojo, A. O., & Izah, S. C. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-9033-8.ch005
Francis, D. L., & Reddy, S. S. P. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1843782 · Cited by 2
Mahmud, A., Arshed, M., Kazi, A. K., Kiran, M. K., & Ashraf, W. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-8402-3.ch005
Preserving Privacy in the Age of Intelligent Machines
Dean, B., & Kisselburgh, L. G. (2026) · Springer eBooks · doi:10.1007/978-3-032-12201-8_5
Paradigms, ontologies, and systems thinking
Vallero, D. A. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-44925-3.00015-6
Tuấn, Đ. A. (2026) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2026.106675
Aubry, P., Quaintenne, G., Guillemain, M., et al. (2026) · Ecological Modelling · doi:10.1016/j.ecolmodel.2026.111793
Zhu, W., & Fei, Y. (2026) · Frontiers in Sustainable Food Systems · doi:10.3389/fsufs.2026.1933197
Towards Climate-Adaptive Urban Health Surveillance: Integrating AI and IoT for Moroccan Smart Cities
Lahlouh, A., Chenal, J., Abdem, S. A. E., Almouctar, M. A. S., Bounabi, M., & Brahmi, R. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-28573-7_21
The Listening Coefficient: A Diagnostic Framework for Feedback Integrity
Bryan, D. (2026) · Systems Research and Behavioral Science · doi:10.1002/sres.70151
Yu, T. (2026) · Research Square · doi:10.21203/rs.3.rs-10373671/v1
Verma, A., Kodali, P., Saxena, A., & Veena, V. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-4050-8.ch008 · Cited by 1
Nayak, S. (2026) · Research Square · doi:10.21203/rs.3.rs-10849586/v1
Islam, M. M., Noor, F. M., Singh, V., Lam, T., Hu, W., & Cortés-Ramírez, J. (2026) · Public Health · doi:10.1016/j.puhe.2026.106491
Artificial intelligence and scientific methodology: continuity, disruption, and the next revolution
Hounkonnou, M. N., & Warin, T. (2026) · Ethics Medicine and Public Health · doi:10.1016/j.jemep.2026.101323
Assembling Topic Models: Material Political Economy and the Genealogy of an Algorithm
Zhang, B. (2026) · Social Studies of Science · doi:10.1177/03063127261469570
Ethical Issues in a Research Infrastructure for Empirical Social Sciences
Caporale, C., Sciolli, G., & Zagarella, R. M. (2026) · Springer eBooks · doi:10.1007/978-3-032-29575-0_4
Metadata
- Authors
- Lazer, D., Kennedy, R., King, G., & Vespignani, A.
- Affiliations
- Northeastern University (US)
- Harvard University (US)
- Corresponding author
- Lazer, David
- Venue
- Science
- Published
- 2014-03-14
- Volume
- 343
- Issue
- 6176
- Pages
- 1203-1205
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2068181924
- Semantic Scholar
- 00d681cfff7f0224ace607e515f4ed510e792df9
- Cited by
- 2,523
- References
- 30
- Citations by year
- 2026: 113 · 2025: 101 · 2024: 121 · 2023: 150 · 2022: 168 · 2021: 229 · 2020: 273 · 2019: 261 · 2018: 272 · 2017: 249 · 2016: 271 · 2015: 219 · 2014: 91
- FWCI
- 208.16
- Type
- journal article
- Language
- en
- Open access
- green
- dash.harvard.edu
- Licence
- cc-by
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
- Topics
- Health Sciences › Medicine › Epidemiology › Data-Driven Disease Surveillance
- Social Sciences › Decision Sciences › Information Systems and Management › Big Data Technologies and Applications
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- Google Flu Trends, influenza surveillance, big data, prediction error, data quality
- MeSH terms
- Centers for Disease Control and Prevention, U.S., Data Collection, Data Interpretation, Statistical, Disease Outbreaks, Humans, Influenza, Human, Office Visits, Prognosis, United States, Social Media
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.