The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
National and Local Influenza Surveillance through Twitter: An Analysis of the 2012-2013 Influenza Epidemic
Open accessAbstract
Social media have been proposed as a data source for influenza surveillance because they have the potential to offer real-time access to millions of short, geographically localized messages containing information regarding personal well-being. However, accuracy of social media surveillance systems declines with media attention because media attention increases "chatter" - messages that are about influenza but that do not pertain to an actual infection - masking signs of true influenza prevalence. This paper summarizes our recently developed influenza infection detection algorithm that automatically distinguishes relevant tweets from other chatter, and we describe our current influenza surveillance system which was actively deployed during the full 2012-2013 influenza season. Our objective was to analyze the performance of this system during the most recent 2012-2013 influenza season and to analyze the performance at multiple levels of geographic granularity, unlike past studies that focused on national or regional surveillance. Our system's influenza prevalence estimates were strongly correlated with surveillance data from the Centers for Disease Control and Prevention for the United States (r = 0.93, p < 0.001) as well as surveillance data from the Department of Health and Mental Hygiene of New York City (r = 0.88, p < 0.001). Our system detected the weekly change in direction (increasing or decreasing) of influenza prevalence with 85% accuracy, a nearly twofold increase over a simpler model, demonstrating the utility of explicitly distinguishing infection tweets from other chatter.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Time Series Analysis Forecasting and Control.
Bartholomew, D. J., Box, G. E. P., & Jenkins, G. M. (1971) · Operational Research Quarterly (1970-1977) · doi:10.2307/3008255 · Cited by 6,716
Time Series Analysis: Forecasting and Control.
Anderson, O. D., Box, G. E. P., & Jenkins, G. M. (1978) · The Statistician · doi:10.2307/2988198 · Cited by 5,298
Detecting influenza epidemics using search engine query data
Ginsberg, J., Mohebbi, M. H., Patel, R. S., Brammer, L., Smolinski, M. S., & Brilliant, L. (2009) · Nature · doi:10.1038/nature07634 · Cited by 4,295
Digital disease detection - harnessing the Web for public health surveillance
Brownstein, J. S., Freifeld, C. C., & Madoff, L. C. (2009) · New England Journal of Medicine · doi:10.1056/nejmp0900702 · Cited by 819
Salathé, M., & Khandelwal, S. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002199 · Cited by 530
Cook, S., Conrad, C., Fowlkes, A. L., & Mohebbi, M. H. (2011) · PLoS ONE · doi:10.1371/journal.pone.0023610 · Cited by 381
Separating Fact from Fear: Tracking Flu Infections on Twitter
Lamb, A., Paul, M. J., & Dredze, M. H. (2013) · Cited by 310
Self-citationGoogle Flu Trends: Correlation With Emergency Department Influenza Rates and Crowding Metrics
Dugas, A. F., Hsieh, Y.-H., Levin, S. R., Pines, J. M., Mareiniss, D. P., Mohareb, A., Gaydos, C. A., Perl, T. M., & Rothman, R. E. (2012) · Clinical Infectious Diseases · doi:10.1093/cid/cir883 · Cited by 222
How Social Media Will Change Public Health
Dredze, M. (2012) · IEEE Intelligent Systems · doi:10.1109/mis.2012.76 · Cited by 207
Self-citationInfluenza A (H7N9) and the Importance of Digital Epidemiology
Salathé, M., Freifeld, C. C., Mekaru, S. R., Tomasulo, A. F., & Brownstein, J. S. (2013) · New England Journal of Medicine · doi:10.1056/nejmp1307752 · Cited by 169
Cited by
Concepts of Artificial Intelligence for Computer-Assisted Drug Discovery
Yang, X., Wang, Y., Byrne, R., Schneider, G., & Yang, S. (2019) · Chemical Reviews · doi:10.1021/acs.chemrev.8b00728 · Cited by 1,022
Statistical physics of vaccination
Wang, Z., Bauch, C. T., Bhattacharyya, S., d'Onofrio, A., Manfredi, P., Perc, M., Perra, N., Salathé, M., & Zhao, D. (2016) · Physics Reports · doi:10.1016/j.physrep.2016.10.006 · Cited by 872
Big Data Research in Information Systems: Toward an Inclusive Research Agenda
University of Virginia, Abbasi, A., Sarker, S., University of Virginia, Aalto University, Chiang, R., & University of Cincinnati (2016) · Journal of the Association for Information Systems · doi:10.17705/1jais.00423 · Cited by 688
“Such information has important implications for “real-time” predictive analytics in various application areas, ranging from finance to health (Bollen, Mao, & Zeng, 2011; Broniatowski, Paul, & Dredze, 2014).”
BackgroundJusup, M., Holme, P., Kanazawa, K., Takayasu, M., Romić, I., Wang, Z., Geček, S., Lipić, T., Podobnik, B., Wang, L., et al. (2022) · Physics Reports · doi:10.1016/j.physrep.2021.10.005 · Cited by 643
Combining Search, Social Media, and Traditional Data Sources to Improve Influenza Surveillance
Santillana, M., Nguyen, A. T., Dredze, M., Paul, M. J., Nsoesie, E. O., & Brownstein, J. S. (2015) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004513 · Cited by 420
Self-citationSeasonal Influenza Infections and Cardiovascular Disease Mortality
Nguyen, J. L., Yang, W., Ito, K., Matte, T. D., Shaman, J., & Kinney, P. L. (2016) · JAMA Cardiology · doi:10.1001/jamacardio.2016.0433 · Cited by 397
Social Media– and Internet-Based Disease Surveillance for Public Health
Aiello, A. E., Renson, A., & Zivich, P. N. (2020) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040119-094402 · Cited by 349
Public Health Surveillance Systems: Recent Advances in Their Use and Evaluation
Groseclose, S. L., & Buckeridge, D. L. (2017) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031816-044348 · Cited by 320
A new twenty-first century science for effective epidemic response
Bedford, J., Farrar, J., Ihekweazu, C., Kang, G., Koopmans, M., & Nkengasong, J. (2019) · Nature · doi:10.1038/s41586-019-1717-y · Cited by 313
Sentiment analysis on Twitter: A text mining approach to the Syrian refugee crisis
Öztürk, N., & Ayvaz, S. (2018) · Telematics and Informatics · doi:10.1016/j.tele.2017.10.006 · Cited by 290
Forecasting sales in the supply chain: Consumer analytics in the big data era
Boone, T., Ganeshan, R., Jain, A., & Sanders, N. R. (2019) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2018.09.003 · Cited by 271
Data, privacy, and the greater good
Horvitz, E., & Mulligan, D. (2015) · Science · doi:10.1126/science.aac4520 · Cited by 267
A survey of Twitter research: Data model, graph structure, sentiment analysis and attacks
Antonakaki, D., Fragopoulou, P., & Ioannidis, S. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114006 · Cited by 265
Social media, big data, and mental health: current advances and ethical implications
Conway, M., & O’Connor, D. (2016) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2016.01.004 · Cited by 231
A tale of cities: urban biases in volunteered geographic information
Hecht, B., & Stephens, M. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14554 · Cited by 215
Using online social networks to track a pandemic: a systematic review
Al-garadi, M. A., Khan, M. S., Varathan, K. D., Mujtaba, G., & Al-Kabsi, A. M. (2016) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2016.05.005 · Cited by 166
Birnbaum, M. L., Ernala, S. K., Rizvi, A. F., De Choudhury, M., & Kane, J. M. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7956 · Cited by 168
Advances in nowcasting influenza-like illness rates using search query logs
Lampos, V., Miller, A. C., Crossan, S., & Stefansen, C. (2015) · Scientific Reports · doi:10.1038/srep12760 · Cited by 143
Online and Social Media Data As an Imperfect Continuous Panel Survey
Diaz, F., Gamon, M., Hofman, J. M., Kıcıman, E., & Rothschild, D. (2016) · PLOS ONE · doi:10.1371/journal.pone.0145406 · Cited by 131
“[68] and others attempt to solve this particular problem for influenza with a more nuanced approach to the data, but this lacks of out-of-sample robustness is still dominant in both academic research and practice.”
BackgroundJia, Q., Guo, Y., Wang, G., & Barnes, S. J. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17176161 · Cited by 117
Volkova, S., Ayton, E., Porterfield, K., & Corley, C. D. (2017) · PLOS ONE · doi:10.1371/journal.pone.0188941 · Cited by 100
“The addition of social media features to several of these models such as the linear autoregressive model, has improved the performance of the models over ILI data alone (Paul et al., 2014; Broniatowski et al., 2013; Santillana et al., 2015).”
MethodWakamiya, S., Kawai, Y., & Aramaki, E. (2018) · JMIR Public Health and Surveillance · doi:10.2196/publichealth.8627 · Cited by 75
Primack, B. A., & Escobar-Viera, C. G. (2017) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/j.chc.2016.12.007 · Cited by 71
Historical Roots of Dissemination and Implementation Science
Dearing, J. W., & Kee, K. F. (2012) · Dissemination and Implementation Research in HealthTranslating Science to Practice · doi:10.1093/acprof:oso/9780199751877.003.0003 · Cited by 67
Deploying nEmesis: Preventing Foodborne Illness by Data Mining Social Media
Sadilek, A., Kautz, H., DiPrete, L., Labus, B., Portman, E., Teitel, J., & Silenzio, V. (2017) · AI Magazine · doi:10.1609/aimag.v38i1.2711 · Cited by 56
Exploiting big data for critical care research
Docherty, A. B., & Lone, N. I. (2015) · Current Opinion in Critical Care · doi:10.1097/mcc.0000000000000228 · Cited by 42
Identification of affective valence of Twitter generated sentiments during the COVID-19 outbreak
Mittal, R., Mittal, A., & Aggarwal, I. (2021) · Social Network Analysis and Mining · doi:10.1007/s13278-021-00828-x · Cited by 23
Khan, Y., Leung, G. J., Belanger, P., Gournis, E., Buckeridge, D. L., Liu, L., Li, Y., & Johnson, I. L. (2018) · Canadian Journal of Public Health · doi:10.17269/s41997-018-0059-0 · Cited by 11
“2013; Broniatowski et al.”
Background
Metadata
- Authors
- Broniatowski, D. A., Paul, M. J., & Dredze, M.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-12-09
- Volume
- 8
- Issue
- 12
- Pages
- e83672
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2033640210
- Cited by
- 442
- References
- 13
- FWCI
- 24.21
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.