The Parable of Google Flu: Traps in Big Data Analysis
Open accessThe DOI matches its Crossref record; 30 of the 31 references it cites were found in a registry or an index; 5 of the 8 sources its claims cite were checked for support.
Abstract
Large errors in flu prediction were largely avoidable, which offers lessons for the use of big data.
Overview
CoChat Summary
TL;DR
The paper uses the failure of Google Flu Trends (GFT) to illustrate two traps in big data analysis: “big data hubris” and algorithm dynamics. It argues that GFT’s large flu-prediction errors were largely avoidable and that big data should supplement, not replace, traditional data and methods.
Key findings
- In February 2013, GFT predicted more than double the proportion of doctor visits for influenza-like illness (ILI) than the CDC; from 21 August 2011 to 1 September 2013, GFT reported overly high flu prevalence in 100 out of 108 weeks, and it overshot the 2011–2012 season by more than 50%.
- GFT errors were not random: they showed temporal autocorrelation and seasonality, meaning last week’s errors predicted this week’s errors and error direction/magnitude varied with time of year.
- Simple alternatives outperformed GFT: out-of-sample mean absolute error was 0.486 for GFT, 0.311 for lagged CDC, and 0.232 for combined GFT and CDC; all differences were statistically significant at P < 0.05. Even 3-week-old CDC data did better than GFT at projecting current flu prevalence.
- The authors attribute GFT’s problems to overfitting (initial GFT matched 50 million search terms to 1152 data points and missed the nonseasonal 2009 H1N1 pandemic) and to “algorithm dynamics,” including Google search algorithm changes and user behavior changes.
Methods
- Design: policy forum/case study comparing GFT estimates with CDC ILI surveillance data and alternative forecasting models.
- Data/sample: GFT and CDC flu prevalence estimates, including the period from 21 August 2011 to 1 September 2013; the initial GFT methodology reportedly fit 50 million search terms to 1152 data points.
- Main analysis: comparison of GFT alone, lagged CDC data with 52-week seasonality variables, and a combined GFT + CDC model using lagged CDC estimates, lagged GFT error, and seasonality variables; reported mean absolute error and statistical significance; Google Correlate used to examine correlated search terms. Supplementary materials contain data and methods.
Limitations
- The paper states that GFT never documented the 45 search terms used, released examples appear misleading, and Google Correlate is limited to national-level data whereas GFT was developed using regional correlations; therefore the original GFT analyses cannot be replicated from the information provided.
- The paper states that Google cannot make its full data available to outsiders because of privacy issues, though it argues there is no such constraint on derivative, aggregated data.
- Evident from the text: this is a commentary/policy forum rather than a full empirical article, with key data and methods placed in supplementary materials; the quantitative comparison depends on GFT and CDC data and model specifications not fully detailed in the main text.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
2 Valid · 2 Not valid · 2 Not checked · 8 Own results and interpretations
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“This ad hoc method of throwing out peculiar search terms failed when GFT completely missed the nonseasonal 2009 infl uenza A–H1N1 pandemic ( 2, 14).”
What the sources say
- Partly supportedcites [2] matched to “Reassessing Google Flu Trends Data for Detection of Seasonal and Pandemic Influenza: A Comparative Epidemiological Study at Three Geographic Scales” (2013) sourceExperimental — accuracy not yet measured
The Discussion (page unavailable) says the original GFT model missed the spring 2009 pandemic wave, supporting the claim about its failure to detect the nonseasonal outbreak. It does not say GFT completely missed the entire 2009 pandemic. The Introduction describes automated selection of the original model’s search terms, not an ad hoc method of throwing out peculiar terms. (LLM, conf=0.86)
- Disputedcites [14] S. Cook et al., PLOS ONE 6, e23610 (2011). sourceExperimental — accuracy not yet measured
The Abstract (Methodology/Principal Findings) says the original GFT model underestimated the magnitude of illness during the 2009 H1N1 pandemic, not that it completely missed it. The Abstract (Conclusions) says both models performed well during the pandemic, although the updated model performed better. The Discussion notes that pandemic-specific queries were excluded, but does not describe this as an ad hoc method of throwing out peculiar terms. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“Oddly, the few search terms offered in the papers ( 14) do not seem to be strongly related with either GFT or the CDC data (SM)—we surmise that the authors felt an unarticulated need to cloak the actual search terms identifi ed.”
What the sources say
- Disputedcites [14] S. Cook et al., PLOS ONE 6, e23610 (2011). sourceExperimental — accuracy not yet measured
The Results section (‘Search Behavior During pH1N1’; page unavailable) says that all three search queries shown in Figure 3 closely tracked CDC ILINet data before the pandemic, and ‘symptoms of flu’ continued to do so during it. The paper does report that the bronchitis and pneumonia queries underestimated ILINet data during the pandemic, but that does not support the broad claim that the offered terms were not strongly related to the data. (LLM, conf=0.87)
Checked by a reasoning model — may be wrong.
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The Internet has opened the way for improving standard surveys, experiments, and health reporting ( 35).”
What the sources say
- Partly supportedcites [35] A. J. Berinsky et al., Polit. Anal. 20, 351–368 (2012). sourceExperimental — accuracy not yet measured
Section 2 describes using an Internet platform to run surveys with embedded experiments, and the Conclusion says MTurk can make experimental research easier and less expensive. The paper does not address improvements to health reporting; the disease scenario in section 4.3.2 is a framing experiment, not health reporting. Page numbers are unavailable in our copy. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Although not widely reported until 2013, the new GFT has been persistently overestimating flu prevalence for a much longer time.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“From 21 August 2011 to 1 September 2013, GFT reported overly high fl u prevalence 100 out of 108 weeks.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
3 more claims
Create a free account to see all 14 claims and every source verdict.
- It may state two separate claims as one. 5
- Probably not a substantial claim. 2
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Google Trends predicted more than twice the number of influenza-like illnesses than the CDC in February 2013 46 .”
From Unrepresentative big surveys significantly overestimated US vaccine uptake (2021) · cites this paper as [46]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This was one of the main reasons behind the failure of Google Flu Trends, since the data used for training the model in the first few years was not representative of the trends in subsequent years [15].”
From Theory-Guided Data Science: A New Paradigm for Scientific Discovery from Data (2017) · cites this paper as [15]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Social data research often relies on counting entities. These entities can be users, links, or messages, and the description is a summary of these counts (Lazer et al., 2014; Salganik, 2017). Yet, simple counts can mislead if it is unclear what is counted and how.”
From Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries (2019) · cites this paper as Lazer et al., 2014
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This unintelligibility is also subject to functional biases (section 4.1), as it depends on the mechanisms available on each social platform (e.g., having a like button, but not a dislike one), as well as to variations in platform algorithms and mechanisms in response to users actions (Lazer et al., 2014).”
From Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries (2019) · cites this paper as Lazer et al., 2014
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“It also includes temporal validity, which captures to what extent constructs change over time (Howison et al., 2011) and may invalidate previous conclusions about societal and/or platform phenomena; e.g., see the case of Google Flu Trends (Lazer et al., 2014).”
From Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries (2019) · cites this paper as Lazer et al., 2014
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 14 MARCH 2014 VOL 343 SCIENCE www.sciencemag.org 1204
“The 2009 version of GFT has weathered other media panics related to the fl u, including the 2005–2006 influenza A/H5N1 ("bird flu") outbreak”
“GFT engineers updated the algorithm in 2009, and this model has run ever since”
Citations
Cites
boyd, D., & Crawford, K. (2012) · Information, Communication & Society · doi:10.1080/1369118x.2012.678878 · Cited by 5,479
Twitter mood predicts the stock market
Bollen, J., Mao, H., & Zeng, X. (2011) · Journal of Computational Science · doi:10.1016/j.jocs.2010.12.007 · Cited by 5,206
Detecting influenza epidemics using search engine query data
Ginsberg, J., Mohebbi, M. H., Patel, R. S., Brammer, L., Smolinski, M. S., & Brilliant, L. (2009) · Nature · doi:10.1038/nature07634 · Cited by 4,295
Cohen, D. (1998) · The Women's Review of Books · doi:10.2307/4022859 · Cited by 4,261
Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012) · Political Analysis · doi:10.1093/pan/mpr057 · Cited by 4,008
Big Data : The Management Revolution
マカフィー, ア., ブリニョルフソン, エ., & 有賀, 裕. (2013) · Harvard business review · Cited by 3,549
Lazer, D., Pentland, A., Adamic, L., Aral, S., Barabási, A.-L., Brewer, D., Christakis, N., Contractor, N., Fowler, J., Gutmann, M., et al. (2009) · Science · doi:10.1126/science.1167742 · Cited by 3,365
Self-citationPredicting Elections with Twitter: What 140 Characters Reveal about Political Sentiment
Tumasjan, A., Sprenger, T., Sandner, P., & Welpe, I. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14009 · Cited by 2,649
Multiscale mobility networks and the spatial spreading of infectious diseases
Balcan, D., Colizza, V., Gonçalves, B., Hu, H., Ramasco, J. J., & Vespignani, A. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0906910106 · Cited by 1,380
Self-citationPredicting consumer behavior with web search
Goel, S., Hofman, J. M., Lahaie, S., Pennock, D. M., & Watts, D. J. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1005962107 · Cited by 636
Research works printed but not linked: 7
- A. McAfee, E. Brynjolfsson, Harv. Bus. Rev. 90, 60 (2012).
- AAAI Conference on Weblogs and Social Media, Atlanta, Georgia, 11 to 15 July 2010 (Association for Advancement of Artifi cial Intelligence, 2010), pp. 178.
- P. Copeland et al., Int. Soc. Negl. Trop. Dis. 2013, 3
- I. M. Hall et al., Epidemiol. Infect. 135, 372 (2007).
- E. Mustafaraj, P. Metaxas, in Proceedings of the Web- Sci10, Raleigh, NC, 26 and 27 April 2010 (Web Science Trust, 2010); http://journal.webscience.org/317/.
- J. Ratkiewicz et al., in Proceedings of 5th International AAAI Conference on Weblogs and Social Media, San Francisco, CA, 7 to 11 August 2011 (AAAI, 2011), p. 297–304.
- 2013; http://chronicle.com/article/Researchers-Struggle- to-Secure/141591/.
Cited by
Items 1,701–1,800 of 2,513
Principled Bayesian Minimum Divergence InferencePreprint
Jewson, J., Smith, J. Q., & Holmes, C. C. (2018) · arXiv (Cornell University) · Cited by 3
Crowdbreaks: Tracking Health Trends using Public Social Media Data and CrowdsourcingPreprint
Mueller, M., & Salathé, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.05491 · Cited by 4
“Shortly after, it was discontinued [8, 9].”
Analyzing the Impact of GDPR on Data Scientists Using the InfoQ FrameworkPreprint
Shmueli, G., & Greene, T. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3183625 · Cited by 3
Porter, N. D., Verdery, A. M., & Gaddis, S. M. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2844155 · Cited by 3
Katsikopoulos, K. V., Şimşek, Ö., Buckmann, M., & Gigerenzer, G. (2022) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2021.10.011 · Cited by 3
Does Negative News Reporting on the Economy Get Reflected in Companies’ Business Situation?Preprint
Iselin, D. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2620292 · Cited by 3
Observer Effect in Social Media UsePreprint
Saha, K., Gupta, P., Mark, G. J., Kıcıman, E., & Choudhury, M. D. (2023) · Research Square · doi:10.21203/rs.3.rs-2492994/v1 · Cited by 3
Digitally Connected Diagnostics Data in the Future of Public Health
Mugahid, D., Hoffmann, T., Olejarz, J. W., Molinaro, R. J., Cooper, C., Atun, R. A., Grad, Y. H., Fortune, S. M., Sampath, R., & Onnela, J.-P. “. (2023) · GEN Biotechnology · doi:10.1089/genbio.2023.0016 · Cited by 2
Valentin, S. (2020) · theses.fr (ABES) · doi:10.70675/1ae1bb91z29caz4ddezb996z595f55e995fe · Cited by 12
Seasonal Trends in Pediatric Respiratory Illnesses
Tse, G., & McLean, L. J. (2021) · Pediatric Emergency Care · doi:10.1097/pec.0000000000002442 · Cited by 3
“AlthoughGoogle Flu Trends performed well initially, it was found to overestimate influenza activity, which was at least partially secondary to algorithmic errors.(15) Google Flu Trends has since stopped collecting and publishing data on influenza.”
BackgroundLassi, A. (2023) · Revista Ciencias Sociales · doi:10.29166/csociales.v1i44.4213 · Cited by 5
Media, Digital Engagement, and the Dynamics of Attitude Change Toward Foreigners in Switzerland
Reveilhac, M. (2025) · Journal of International Migration and Integration / Revue de l integration et de la migration internationale · doi:10.1007/s12134-025-01264-y · Cited by 5
“…GT data is aggregated and anonymized, making it impossible to directly correlate search behavior (Mellon, 2013); Interpreting search intent is challenging because searches for migration-related terms do not necessarily indicate a stance on the issue (Carneiro & Mylonakis, 2009; Lazer et al., 2014).”
Northcott, R. (2025) · doi:10.1093/9780191944352.001.0001 · Cited by 4
A Forecast Model for COVID-19 Spread Trends Using Blog and GPS Data from Smartphones
Susuta, R., Yamada, K., Hideki Takayasu, C., & Takayasu, M. (2025) · Entropy · doi:10.3390/e27070686 · Cited by 2
“Initially showing high accuracy in forecasting influenza outbreaks, its performance declined over time, underscoring the necessity of updating models to maintain their forecasting power [20–22].”
Elder, L. H., & Onufriev, A. V. (2025) · The Journal of Physical Chemistry B · doi:10.1021/acs.jpcb.5c02263 · Cited by 2
Advancing Sustainability Through Social Media: A Comprehensive Survey
Singh, S. S., Kumar, S., Kishor, A., & Zomaya, A. Y. (2025) · IEEE Transactions on Sustainable Computing · doi:10.1109/tsusc.2025.3591527 · Cited by 4
Kümmerle, H., & Thumfart, J. (2025) · Global Studies Quarterly · doi:10.1093/isagsq/ksaf089 · Cited by 3
Revisiting big data optimism: risks of data-driven black box algorithms for society
Mahajan, S., & Helbing, D. (2026) · Ethics and Information Technology · doi:10.1007/s10676-026-09888-z · Cited by 9
Rees, E. E., Sotoodeh, M., Denis-Robichaud, J., Carabin, H., & de Montigny, S. (2026) · Epidemics · doi:10.1016/j.epidem.2026.100891 · Cited by 2
Transforming Public Health Practice with Artificial Intelligence: A Framework-Driven Approach
Oleribe, O. O., Uzoaru, F., Tarfa, A., Olaniran, O. H., & Taylor-Robinson, S. D. (2026) · Healthcare · doi:10.3390/healthcare14030385 · Cited by 4
“Similarly, Google Flu Trends significantly overestimated influenza prevalence and was eventually discontinued due to its reliance on proxy signals without proper epidemiologic grounding, algorithm drift as user behavior changed, and lack of transparency and external validation [77].”
Real–time digital prescriptions unlock influenza dynamics: evidence from 21 million transactions
Shen, R., Xu, X., Yang, L., Wang, Z., Yang, R., Liu, X., Xu, Z., Jiang, H., Sun, N., Wang, D., et al. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02513-9 · Cited by 2
The Impact of Big Data and Knowledge Management on R&D Projects from Automotive Industry
Palade, H. C., Nicolaescu, S. Ş., & Kifor, C. V. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-25159-2_17 · Cited by 2
Risiko-Management in der Produktion
Romeike, F., & Hager, P. (2020) · Springer eBooks · doi:10.1007/978-3-658-29446-5_6 · Cited by 2
Neither Black nor Box (Un)knowing Algorithms
Bucher, T. (2018) · Oxford University Press eBooks · doi:10.1093/oso/9780190493028.003.0003 · Cited by 5
Challenges in Causal Inference from Personal Monitoring Devices
Wiktorski, T. (2018) · Annals of Computer Science and Information Systems · doi:10.15439/2018f378 · Cited by 2
“in their Science paper [6] suggest changes to approaches to data analysis based on the problems”
MethodBias in Machine Learning und Konsequenzen für die Anwendung in der Marktforschung
Jörgens, D., Rieder, Y., & Sinzinger, F. L. (2020) · Springer eBooks · doi:10.1007/978-3-658-28664-4_11 · Cited by 2
Big Data e ciência de dados: uma revisão crítica de questões para a pesquisa educacional
Daniel, B. K., Maia, T. M. D. S. D. A., & da Silva, D. G. (2020) · PerCursos · doi:10.5965/1984724621452020080 · Cited by 6
The Rise of Digital Media and the Retooling of Politics
Jungherr, A. M., Rivero, G., & Gayo-Avello, D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108297820.001 · Cited by 3
Forecasting Daily MRT Passenger Flow in Taipei Based on Google Search Queries
Jie, H., Zou, H., & Xu, Q. (2021) · International Symposium on Computer Science and Intelligent Control (ISCSIC) · doi:10.1109/iscsic54682.2021.00020 · Cited by 4
Chun, W. H. K. (2021) · Springer eBooks · doi:10.1007/978-3-030-65497-9_3 · Cited by 2
Introduction: Programmed Sociality
Bucher, T. (2018) · Oxford University Press eBooks · doi:10.1093/oso/9780190493028.003.0001 · Cited by 2
Integration of survey data and digital footprints: an overview of the main methodological approaches
Saponova, A. V., & Куликов, С. (2022) · Sociology methodology methods mathematical modeling (Sociology 4M) · doi:10.19181/4m.2021.53.4 · Cited by 4
Mejova, Y. (2022) · Springer eBooks · doi:10.1007/978-3-031-16624-2_15 · Cited by 2
Ren, J., & Wang, H. (2023) · Elsevier eBooks · doi:10.1016/b978-0-44-318679-0.00010-7 · Cited by 2
Causality Network of Infectious Disease Revealed With Causal Decomposition
Sun, J., Yuan, K., Chen, C., Xu, H., Wang, H., Zhi, Y., Peng, S., Peng, C., Huang, N. E., Huang, G., et al. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3268081 · Cited by 6
“of doctor visits for ILI than the CDC reported during the influenza season in 2013 [34], [35], [36].”
BackgroundBienvenido, H. P., Gázquez, D. D. H., & Maceiras, S. D. (2023) · Teknokultura Revista de Cultura Digital y Movimientos Sociales · doi:10.5209/tekn.83875 · Cited by 12
De, S., Jangra, S., Agarwal, V., Johnson, J., & Sastry, N. R. (2023) · Studies in computational intelligence · doi:10.1007/978-981-99-7184-8_6 · Cited by 4
Use of Telehealth Information for Early Detection: Insights From the COVID-19 Pandemic
Haenchen, S. D., McCabe, B. K., Mack, W. J., et al. (2024) · American Journal of Public Health · doi:10.2105/ajph.2023.307499 · Cited by 2
Ayers, J. W., Poliak, A., Beros, N. T., Paul, M., Dredze, M., Hogarth, M. A., & Smith, D. M. (2024) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2024.01.016 · Cited by 2
The digital trail of Ukraine’s 2022 refugee exodus
Wycoff, N., Singh, L., Arab, A., Donato, K. M., & Marahrens, H. (2024) · Journal of Computational Social Science · doi:10.1007/s42001-024-00304-4 · Cited by 4
“Yet using these data to predict social or behavioral phenomena is not without its pit-falls [27] and ethical complexities [28, 29].”
Allen, M. R., Portillo-Wightman, G., Zhu, Z., Poliak, A., Smith, D. M., Dredze, M. H., & Ayers, J. W. (2024) · Drug Safety · doi:10.1007/s40264-024-01481-x · Cited by 3
“The promise of social media-fueled drug safety monitoring [36] has not been met, in part, because the level of computational sophistication to effectively screen billions of posts has not been achieved [37, 38].”
Check Your Audio Data: Nkululeko for Bias Detection
Burkhardt, F., Atmaja, B. T., Derington, A., Eyben, F., & Schuller, B. W. (2024) · International Conference on Speech Database and Assessments · doi:10.1109/o-cocosda64382.2024.10800580 · Cited by 3
Towards energy-efficient cities: How does the sharing economy contribute?
Chen, P., Wu, Y., & Chu, Z. (2025) · Energy · doi:10.1016/j.energy.2025.135622 · Cited by 6
Thinking Through the Materiality of Big Data: An Outward‐Looking Approach to Data Infrastructure
Zhang, M., Xu, J., Zhao, P., & Chung, C. K. L. (2025) · Tijdschrift voor Economische en Sociale Geografie · doi:10.1111/tesg.70005 · Cited by 3
A Knowledge-Guided Adversarial Defense for Resisting Malicious Visual Manipulation
Zhou, D., Su, Z., Liu, D., Liu, T., Wang, N., & Gao, X. (2025) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2025.3573294 · Cited by 4
Semantic Geographic Space: From Big Data to Ecosystems of Data
Pileggi, S. F., & Amor, R. (2015) · Studies in big data · doi:10.1007/978-3-319-11056-1_12 · Cited by 2
Martin, L. J. (2016) · Epidemiology and Infection · doi:10.1017/s0950268816002636 · Cited by 2
The Internet in China: New Methods and Opportunities
Zhang, Y. (2017) · Journal of Chinese Political Science · doi:10.1007/s11366-017-9526-3 · Cited by 2
“…researchers and China scholars have been debating the promise and perils of big data, but a consensus is that big-data studies should be concerned with internal validity, external validity, measurement reliability, and other key aspects of empirical social science research [19, 25, 26, 35, 44, 52].”
BackgroundQuelle place pour la data science et les big data au sein de la statistique publique ?
Combes, S., & Givord, P. (2018) · Revue française des affaires sociales · doi:10.3917/rfas.174.0117 · Cited by 2
Complex Big Data Analysis Based on Multi-granularity Generalized Functions
Zhang, X., & Zhang, J. (2018) · International Journal of Online and Biomedical Engineering (iJOE) · doi:10.3991/ijoe.v14i04.8368 · Cited by 2
Google Big Data: charakterystyka i zastosowanie w naukach społecznych
Turner, A., Zieliński, M. W., & Słomczyński, K. M. (2018) · Studia Socjologiczne · doi:10.24425/122482 · Cited by 4
Torres, F. A. T. (2020) · PubMed Central · Cited by 2
The Long Game: Technological Innovation and the Transformation of Business Performance
Matthias, O., & Fouweather, I. (2021) · International Journal of Technology and Human Interaction · doi:10.4018/ijthi.2021040104 · Cited by 2
Beattie, J. R. (2021) · Journal of Raman Spectroscopy · doi:10.1002/jrs.6240 · Cited by 2
Monitoring event-driven dynamics on Twitter: a case study in Belarus
Rice, N. M., Horne, B. D., Luther, C. A., Borycz, J., Allard, S. L., Ruck, D. J., Fitzgerald, M., Манаев, О. Т., Prins, B., Taylor, M., et al. (2022) · SN Social Sciences · doi:10.1007/s43545-022-00330-x · Cited by 5
Public Health – Global Health: neu denken, neu konzipieren
(2018) · De Gruyter eBooks · doi:10.1515/9783110563269-003 · Cited by 2
Syllabus for Data Management and Practice, Part I, Winter 2015
Borgman, C. L. (2015) · Cited by 3
Ontological analysis for dynamic data model exploration
Hobbs, M., Luca, C., Fatima, A., et al. (2015) · Anglia Ruskin Research Online (Anglia Ruskin University) · doi:10.1285/i2037-3627v5n1p42 · Cited by 2
“Lazer et al. (2014) describe some of the pitfalls when relying on data volume without taking sufficient account of existing statistical techniques but also show how large data can be used for previously unsupportable analysis, such as fine grain location data, to enhance the predictive power of the…”
MethodK -Nearest Neighbor Intervals Based AP Clustering Algorithm for Large Incomplete Data
Lu, C. Z., Song, S., & Wu, C. (2015) · Mathematical Problems in Engineering · doi:10.1155/2015/535932 · Cited by 2
e-Reasoning: Between Digital Humanities and e-science
Bueno-Soler, J., & Carnielli, W. A. (2014) · IEEE International Conference on eScience · doi:10.1109/escience.2014.79 · Cited by 2
Webster, M., & Kumar, V. S. (2014) · Clinical Chemistry · doi:10.1373/clinchem.2014.226845 · Cited by 2
“Mandl was not involved in the Science report, but in a phone interview with Clinical Chemistry says he believes the authors’ critique of Google is appropriate, “as it was in part against Google for not appropriately tweaking in the face of new data.””
BackgroundInfluentialOn the uncertainty of individual prediction because of sampling predictors
Shen, C., & Li, X. (2015) · Statistics in Medicine · doi:10.1002/sim.6849 · Cited by 2
Artificial prediction markets for online prediction
Jahedpari, F. (2015) · International Conference on Artificial Intelligence · Cited by 2
Using Data Mining to Teach Applied Statistics and Correlation
Hartnett, J. L. (2016) · Teaching of Psychology · doi:10.1177/0098628316636292 · Cited by 4
“Data mining has also gained much attention because of fears about intrusive data collection, such as private health data (Pettypiece & Robertson, 2014), as well as what can happen when data mining does not result in accurate findings (Lazer, Kennedy, King, & Vespignani, 2014).”
BackgroundConvertino, M., & Hedberg, C. W. (2014) · PLoS Currents · doi:10.1371/currents.outbreaks.a73b658ef9785c259a845bff014b9fac · Cited by 2
The Big Data Era and an Integrated Mode of Inquiry for Social Policy-Relevant Research
Mader, N. (2015) · The Knowledge Bank (The Ohio State University) · Cited by 2
From open source communications to knowledge
Preece, A. D., Roberts, C. H., Rogers, D., et al. (2016) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2224533 · Cited by 2
Reuse of data from smart medical devices for quality control and evidence-based medicine
Sliwa, J. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-803663-1.00009-7 · Cited by 2
Seeing Chinese Cities Through Big Data and Statistics
Wu, J. S., & Zhang, R. (2016) · Springer geography · doi:10.1007/978-3-319-40902-3_17 · Cited by 2
Collective Attention on the Web
Bauckhage, C., & Kersting, K. (2016) · now publishers, Inc. eBooks · doi:10.1561/9781680832051 · Cited by 2
A Study on Validity Detection for Shipping Decision in the Mail-order Industry
Takahashi, M., Azuma, H., & Tsuda, K. (2017) · Procedia Computer Science · doi:10.1016/j.procs.2017.08.007 · Cited by 3
Ohnishi, T., & Shimano, K. (2018) · Reports in Advances of Physical Sciences · doi:10.1142/s2424942418500056 · Cited by 3
Tracing Tourism Geographies with Google Trends: A Dutch Case Study
Ballatore, A., Scheider, S., & Spierings, B. (2019) · Lecture notes in geoinformation and cartography · doi:10.1007/978-3-030-14745-7_9 · Cited by 2
Computer Performance Determination System Based on Big Data Distributed File
Lu, K. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-15235-2_117 · Cited by 2
The End of the Virtual? A Hermeneutical Approach to Digitality
Romele, A. (2019) · Numanities - arts and humanities in progress · doi:10.1007/978-3-030-24751-5_11 · Cited by 2
Definicja i granice prawnej ochrony prywatności w epoce analityki big data
Rojszczak, M. (2019) · Ruch Prawniczy Ekonomiczny i Socjologiczny · doi:10.14746/rpeis.2019.81.1.8 · Cited by 2
Using Google Search Data for Sunburn as a Surrogate for Sunburn Prevalence in the United States.
Hopkins, Z. H., Carlisle, R. P., & Secrest, A. M. (2019) · Europe PMC (PubMed Central) · Cited by 2
Artamonova, Y. D. (2020) · Outlines of global transformations politics economics law · doi:10.23932/2542-0240-2020-13-2-7 · Cited by 2
Comment: Automated Analyses: Because We Can, Does It Mean We Should?
Shortreed, S. M., & Moodie, E. E. M. (2020) · Statistical Science · doi:10.1214/20-sts773 · Cited by 3
Risk Forecasting in the Light of Big Data
Kernchen, R. (2020) · Journal of risk analysis and crisis response · doi:10.2991/jracr.k.201230.001 · Cited by 8
Bodó, B., & van de Velde, B. (2019) · Springer eBooks · doi:10.1007/978-3-030-16065-4_20 · Cited by 2
Bennett, A. T., Gregory, W. T., Boniface, E. R., et al. (2021) · Urogynecology · doi:10.1097/spv.0000000000000980 · Cited by 2
“Algorithm dynamics, the changes made by GA’s engineers over time, affect how data are gathered, so validity of the data is opaque and changing.(13) We also relied on the geographic location of users as identified by GA; the accuracy of these algorithms is not precisely known, but the accuracy of a different digital pl…”
MethodOn Enhanced Ensemble Learning for Multimodal Remote Sensing Data Analysis by Capacity Optimization
Chlaily, S., Ienco, D., Jutten, C., et al. (2021) · doi:10.1109/ssp49050.2021.9513780 · Cited by 2
“Nonetheless, it has been proved, either in remote sensing [5, 4] or in other data science research fields [3, 8], that processing more data and records does not always result in detailed information extraction because of nonidealities, mismatches and estimation imperfections [5, 9, 10].”
BackgroundPhase I: CSDS as an Emerging Profession—Diagnostic Literature Analysis
Mongeau, S., & Hajdasinski, A. (2021) · Springer eBooks · doi:10.1007/978-3-030-74896-8_2 · Cited by 3
Severo, M., & Romele, A. (2015) · Presses des Mines eBooks · doi:10.4000/books.pressesmines.1995 · Cited by 2
Genner, S. (2016) · vdf Hochschulverlag AG an der ETH Zürich eBooks · doi:10.3218/3800-2 · Cited by 3
Health Data Pools: Case-Studies and Involved Interests
Schneider, G. (2022) · Munich studies on innovation and competition · doi:10.1007/978-3-030-95427-7_3 · Cited by 2
Big Data Approaches to the Study of Digital Media
Schroeder, R., & Cowls, J. (2019) · Springer eBooks · doi:10.1007/978-94-024-1555-1_13 · Cited by 2
Big Data Analysis Techniques for Visualization of Genomics in Medicinal Plants
Kumar, H., Chandramohan, V., Simon, S. M., Yadav, R. S., & Kumar, S. B. (2019) · IGI Global eBooks · doi:10.4018/978-1-5225-8903-7.ch032 · Cited by 2
Trübner, M., & Mühlichen, A. (2019) · Springer eBooks · doi:10.1007/978-3-658-21308-4_9 · Cited by 2
Study on the Risk of Transmission of COVID‐19 Based on Population Migration
Hu, X. (2022) · Wireless Communications and Mobile Computing · doi:10.1155/2022/1646626 · Cited by 2
Challenges and Countermeasures of Arab Immigrants and International Trade in the Era of Big Data
Huang, Y., & Shao, M. (2022) · Mathematical Problems in Engineering · doi:10.1155/2022/1025453 · Cited by 2
An essay on the differences and linkages between data science and information science
Ye, F. Y., & Ma, F. (2023) · Data and Information Management · doi:10.1016/j.dim.2023.100032 · Cited by 7
Anonymity and Online Search: Measuring the Privacy Impact Of Google’s 2012 Privacy Policy Change
Cooper, J. (2023) · Review of Law & Economics · doi:10.1515/rle-2023-0042 · Cited by 3
Kmetty, Z., Kollányi, B., & Boros, K. (2024) · SN Computer Science · doi:10.1007/s42979-024-03553-2 · Cited by 6
Using Crowd-Based Data Selection to Improve the Predictive Power of Search Trend Data
Brynjolfsson, E., Geva, T., & Reichman, S. (2014) · Journal of the Association for Information Systems · Cited by 2
A Research on Characteristics and Development Trend of Sports Communication in the Era of Big Data
Shi, M. (2015) · The Open Cybernetics & Systemics Journal · doi:10.2174/1874110x01509012279 · Cited by 3
“Professor Huang Shengmin [3], a famous communication expert at the Communication University of China, who wrote a book named how about the TV in the big data era, in this book he think that through changing the human data processing methods, ideas and abilities big data affect all aspects of human social life, in the…”
BackgroundUsing Predictive Analytics to Reduce Uncertainty in Enterprise Risk Management
Ghasemkhani, H., Reichman, S., & Westerman, G. F. (2015) · International Conference on Information Systems · Cited by 2
Big Data - Towards a New Techno-Determinism?
Strauß, S. (2015) · ISIS Summit: The Information Society at the Crossroads · doi:10.3390/isis-summit-vienna-2015-t3.3008 · Cited by 4
Development of a Modelling Script of Time Series Suitable for Data Mining
Sanz‐Fernández, V., Cabrera‐Castro, R., Muñoz‐Lechuga, R., et al. (2016) · Open Journal of Statistics · doi:10.4236/ojs.2016.64047 · Cited by 2
Metadata
- Authors
- Lazer, D., Kennedy, R., King, G., & Vespignani, A.
- Affiliations
- Northeastern University (US)
- Harvard University (US)
- Corresponding author
- Lazer, David
- Venue
- Science
- Published
- 2014-03-14
- Volume
- 343
- Issue
- 6176
- Pages
- 1203-1205
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2068181924
- Semantic Scholar
- 00d681cfff7f0224ace607e515f4ed510e792df9
- Cited by
- 2,523
- References
- 30
- Citations by year
- 2026: 113 · 2025: 101 · 2024: 121 · 2023: 150 · 2022: 168 · 2021: 229 · 2020: 273 · 2019: 261 · 2018: 272 · 2017: 249 · 2016: 271 · 2015: 219 · 2014: 91
- FWCI
- 208.16
- Type
- journal article
- Language
- en
- Open access
- green
- dash.harvard.edu
- Licence
- cc-by
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
- Topics
- Health Sciences › Medicine › Epidemiology › Data-Driven Disease Surveillance
- Social Sciences › Decision Sciences › Information Systems and Management › Big Data Technologies and Applications
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- Google Flu Trends, influenza surveillance, big data, prediction error, data quality
- MeSH terms
- Centers for Disease Control and Prevention, U.S., Data Collection, Data Interpretation, Statistical, Disease Outbreaks, Humans, Influenza, Human, Office Visits, Prognosis, United States, Social Media
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.