The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Combining Search, Social Media, and Traditional Data Sources to Improve Influenza Surveillance
Open accessAbstract
We present a machine learning-based methodology capable of providing real-time ("nowcast") and forecast estimates of influenza activity in the US by leveraging data from multiple data sources including: Google searches, Twitter microblogs, nearly real-time hospital visit records, and data from a participatory surveillance system. Our main contribution consists of combining multiple influenza-like illnesses (ILI) activity estimates, generated independently with each data source, into a single prediction of ILI utilizing machine learning ensemble approaches. Our methodology exploits the information in each data source and produces accurate weekly ILI predictions for up to four weeks ahead of the release of CDC's ILI reports. We evaluate the predictive ability of our ensemble approach during the 2013-2014 (retrospective) and 2014-2015 (live) flu seasons for each of the four weekly time horizons. Our ensemble approach demonstrates several advantages: (1) our ensemble method's predictions outperform every prediction using each data source independently, (2) our methodology can produce predictions one week ahead of GFT's real-time estimates with comparable accuracy, and (3) our two and three week forecast estimates have comparable accuracy to real-time predictions using an autoregressive model. Moreover, our results show that considerable insight is gained from incorporating disparate data streams, in the form of social media and crowd sourced data, into influenza predictions in all time horizons.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Support Vector Regression Machines
Drucker, H., Burges, C. J. C., Kaufman, L., Smola, A. J., & Vapnik, V. N. (1996) · Cited by 4,658
Detecting influenza epidemics using search engine query data
Ginsberg, J., Mohebbi, M. H., Patel, R. S., Brammer, L., Smolinski, M. S., & Brilliant, L. (2009) · Nature · doi:10.1038/nature07634 · Cited by 4,295
The Parable of Google Flu: Traps in Big Data Analysis
Lazer, D., Kennedy, R., King, G., & Vespignani, A. (2014) · Science · doi:10.1126/science.1248506 · Cited by 2,523
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00117832 · Cited by 1,912
Signorini, A., Segre, A. M., & Polgreen, P. M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0019467 · Cited by 1,235
Using Internet Searches for Influenza Surveillance
Polgreen, P. M., Chen, Y., Pennock, D. M., & Nelson, F. D. (2008) · Clinical Infectious Diseases · doi:10.1086/593098 · Cited by 566
Butler, D. (2013) · Nature · doi:10.1038/494155a · Cited by 514
Cited by
Statistical physics of vaccination
Wang, Z., Bauch, C. T., Bhattacharyya, S., d'Onofrio, A., Manfredi, P., Perc, M., Perra, N., Salathé, M., & Zhao, D. (2016) · Physics Reports · doi:10.1016/j.physrep.2016.10.006 · Cited by 872
Jusup, M., Holme, P., Kanazawa, K., Takayasu, M., Romić, I., Wang, Z., Geček, S., Lipić, T., Podobnik, B., Wang, L., et al. (2022) · Physics Reports · doi:10.1016/j.physrep.2021.10.005 · Cited by 643
Ayyoubzadeh, S. M., Ayyoubzadeh, S. M., Zahedi, H., Ahmadi, M., & R Niakan Kalhori, S. (2020) · JMIR Public Health and Surveillance · doi:10.2196/18828 · Cited by 378
Accurate estimation of influenza epidemics using Google search data via ARGO
Yang, S., Santillana, M., & Kou, S. C. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1515373112 · Cited by 373
Self-citationSocial Media– and Internet-Based Disease Surveillance for Public Health
Aiello, A. E., Renson, A., & Zivich, P. N. (2020) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040119-094402 · Cited by 349
Public Health Surveillance Systems: Recent Advances in Their Use and Evaluation
Groseclose, S. L., & Buckeridge, D. L. (2017) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031816-044348 · Cited by 320
Framing COVID-19: How we conceptualize and discuss the pandemic on Twitter
Wicke, P., & Bolognesi, M. M. (2020) · PLOS ONE · doi:10.1371/journal.pone.0240010 · Cited by 296
Big Data for Infectious Disease Surveillance and Modeling
Bansal, S., Chowell, G., Simonsen, L., Vespignani, A., & Viboud, C. (2016) · Journal of Infectious Diseases · doi:10.1093/infdis/jiw400 · Cited by 255
Tracking COVID-19 using online search
Lampos, V., Majumder, M. S., Yom-Tov, E., Edelstein, M., Moura, S., Hamada, Y., Rangaka, M. X., McKendry, R. A., & Cox, I. J. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00384-w · Cited by 164
Srinivas, S., & Ravindran, A. R. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.02.022 · Cited by 147
Johansson, M. A., Reich, N. G., Hota, A., Brownstein, J. S., & Santillana, M. (2016) · Scientific Reports · doi:10.1038/srep33707 · Cited by 120
Self-citationVolkova, S., Ayton, E., Porterfield, K., & Corley, C. D. (2017) · PLOS ONE · doi:10.1371/journal.pone.0188941 · Cited by 100
“The addition of social media features to several of these models such as the linear autoregressive model, has improved the performance of the models over ILI data alone (Paul et al., 2014; Broniatowski et al., 2013; Santillana et al., 2015).”
MethodLu, F. S., Nguyen, A. T., Link, N. B., Davis, J. T., Chinazzi, M., Xiong, X., Vespignani, A., Lipsitch, M., & Santillana, M. (2020) · doi:10.1101/2020.04.18.20070821 · Cited by 87
“Incorporating estimates from influenza and COVID-19 forecasting and participatory surveillance systems may prove useful in future studies as well [34, 35, 36, 37, 38, 39].”
Self-citationLearning from Large-Scale Wearable Device Data for Predicting the Epidemic Trend of COVID-19
Zhu, G., Li, J., Meng, Z., Yu, Y., Li, Y., Tang, X., Dong, Y., Sun, G., Zhou, R., Wang, H., et al. (2020) · Discrete Dynamics in Nature and Society · doi:10.1155/2020/6152041 · Cited by 77
The use of social media for health research purposes: scoping review
Bour, C., Ahne, A., Schmitz, S., Perchoux, C., Dessenne, C., & Fagherazzi, G. (2021) · Journal of Medical Internet Research · doi:10.2196/25736 · Cited by 56
Discovering foodborne illness in online restaurant reviews
Effland, T., Lawson, A., Balter, S., Devinney, K., Reddy, V., Waechter, H., Gravano, L., & Hsu, D. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx093 · Cited by 55
Enhancing Situational Awareness to Prevent Infectious Disease Outbreaks from Becoming Catastrophic
Lipsitch, M., & Santillana, M. (2019) · Current Topics in Microbiology and Immunology · doi:10.1007/82_2019_172 · Cited by 34
Self-citation
Metadata
- Authors
- Santillana, M., Nguyen, A. T., Dredze, M., Paul, M. J., Nsoesie, E. O., & Brownstein, J. S.
- Venue
- PLOS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-10-29
- Volume
- 11
- Issue
- 10
- Pages
- e1004513
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W2148330046
- Cited by
- 420
- References
- 41
- FWCI
- 26.15
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.