The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Discovering Health Topics in Social Media Using Topic Models
Open accessAbstract
By aggregating self-reported health statuses across millions of users, we seek to characterize the variety of health information discussed in Twitter. We describe a topic modeling framework for discovering health topics in Twitter, a social media website. This is an exploratory approach with the goal of understanding what health topics are commonly discussed in social media. This paper describes in detail a statistical topic model created for this purpose, the Ailment Topic Aspect Model (ATAM), as well as our system for filtering general Twitter data based on health keywords and supervised classification. We show how ATAM and other topic models can automatically infer health topics in 144 million Twitter messages from 2011 to 2013. ATAM discovered 13 coherent clusters of Twitter messages, some of which correlate with seasonal influenza (r = 0.689) and allergies (r = 0.810) temporal surveillance data, as well as exercise (r = .534) and obesity (r = -.631) related geographic survey data in the United States. These results demonstrate that it is possible to automatically discover topics that attain statistically significant correlations with ground truth data, despite using minimal human supervision and no historical data to train the model, in contrast to prior work. Additionally, these results demonstrate that a single general-purpose model can identify many different health topics in social media.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Advances in neural information processing systems 7
Cios, K., & Shields, M. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,059
Stochastic relaxation, gibbs distributions, and the bayesian restoration of images.
Geman, S., & Geman, D. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767596 · Cited by 17,949
Blei, D. M., Ng, A. Y., & Jordan, M. I. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0082 · Cited by 12,223
Griffiths, T. L., & Steyvers, M. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307752101 · Cited by 6,049
Blei, D. M. (2012) · Communications of the ACM · doi:10.1145/2133806.2133826 · Cited by 5,516
Earthquake shakes Twitter users: real-time event detection by social sensors
Sakaki, T., Okazaki, M., & Matsuo, Y. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772777 · Cited by 3,640
Predicting Elections with Twitter: What 140 Characters Reveal about Political Sentiment
Tumasjan, A., Sprenger, T., Sandner, P., & Welpe, I. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14009 · Cited by 2,649
From Tweets to Polls: Linking Text Sentiment to Public Opinion Time Series
O'Connor, B., Balasubramanyan, R., Routledge, B., & Smith, N. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14031 · Cited by 1,923
(2009) · Cited by 1,900
Predicting Depression via Social Media
De Choudhury, M., Gamon, M., Counts, S., & Horvitz, E. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v7i1.14432 · Cited by 1,579
Uncertainty in Artificial Intelligence
(1992) · Elsevier eBooks · doi:10.1016/c2013-0-12606-2 · Cited by 1,425
Diurnal and seasonal mood vary with work, sleep, and daylength across diverse cultures
Golder, S. A., & Macy, M. W. (2011) · Science · doi:10.1126/science.1202775 · Cited by 1,155
Robust Sentiment Detection on Twitter from Biased and Noisy Data
Barbosa, L., & Feng, J. (2010) · International Conference on Computational Linguistics · Cited by 1,090
The Behavioral Risk Factor Surveillance System
(2002) · PsycEXTRA Dataset · doi:10.1037/e616792007-002 · Cited by 987
Stochastic relaxation, Gibbs distributions and the Bayesian restoration of images*
Geman, S., & Geman, D. (1993) · Journal of Applied Statistics · doi:10.1080/02664769300000058 · Cited by 983
You Are What You Tweet: Analyzing Twitter for Public Health
Paul, M., & Dredze, M. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14137 · Cited by 947
Self-citationEstimating a Dirichlet Distribution
Minka, T. P. (2000) · Cited by 778
Amazon Mechanical Turk: Gold Mine or Coal Mine?
Fort, K., Adda, G., & Cohen, K. B. (2011) · Computational Linguistics · doi:10.1162/coli_a_00057 · Cited by 761
Understanding the Demographics of Twitter Users
Mislove, A., Lehmann, S., Ahn, Y.-Y., Onnela, J.-P., & Rosenquist, J. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14168 · Cited by 759
Dissemination of health information through social networks: Twitter and antibiotics
Scanfeld, D., Scanfeld, V., & Larson, E. L. (2010) · American Journal of Infection Control · doi:10.1016/j.ajic.2009.11.004 · Cited by 702
Twitter Catches The Flu: Detecting Influenza Epidemics using Twitter
Aramaki, E., Maskawa, S., & Morita, M. (2011) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · Cited by 691
Towards detecting influenza epidemics by analyzing Twitter messages
Culotta, A. (2010) · Proceedings of the First Workshop on Social Media Analytics · doi:10.1145/1964858.1964874 · Cited by 608
Streaming First Story Detection with application to Twitter
Petrović, S., Osborne, M., & Lavrenko, V. P. (2010) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 573
Election Forecasts With Twitter: How 140 Characters Reflect the Political Landscape
Tumasjan, A., Sprenger, T. O., Sandner, P. G., & Welpe, I. M. (2011) · Social Science Computer Review · doi:10.1177/0894439310386557 · Cited by 447
Chunara, R., Andrews, J. R., & Brownstein, J. S. (2012) · The American Society of Tropical Medicine and Hygiene · doi:10.4269/ajtmh.2012.11-0597 · Cited by 436
On Smoothing and Inference for Topic Models
Asuncion, A., Welling, M., Smyth, P., & Teh, Y. W. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1205.2662 · Cited by 434
Example selection for bootstrapping statistical parsers
Steedman, M., Hwa, R., Clark, S., Osborne, M., Sarkar, A., Hockenmaier, J., Ruhlen, P., Baker, S., & Crim, J. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073476 · Cited by 364
Separating Fact from Fear: Tracking Flu Infections on Twitter
Lamb, A., Paul, M. J., & Dredze, M. H. (2013) · Cited by 310
Self-citationTracking the flu pandemic by monitoring the social web
Lampos, V., & Cristianini, N. (2010) · 2010 2nd International Workshop on Cognitive Information Processing · doi:10.1109/cip.2010.5604088 · Cited by 304
Creating Speech and Language Data With Amazon’s Mechanical Turk
Callison-Burch, C., & Dredze, M. H. (2010) · Cited by 294
Self-citationA cross-collection mixture model for comparative text mining
Zhai, C., Velivelli, A., & Yu, B. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014150 · Cited by 272
Moreno, M. A. (2012) · Archives of Pediatrics & Adolescent Medicine · doi:10.1001/archpediatrics.2011.180 · Cited by 235
Public Health Surveillance of Dental Pain via Twitter
Heaivilin, N., Gerbert, B., Page, J. E., & Gibbs, J. L. (2011) · Journal of Dental Research · doi:10.1177/0022034511415273 · Cited by 229
Distributed Inference for Latent Dirichlet Allocation
Newman, D. J., Smyth, P., Welling, M., & Asuncion, A. (2007) · Cited by 215
How Social Media Will Change Public Health
Dredze, M. (2012) · IEEE Intelligent Systems · doi:10.1109/mis.2012.76 · Cited by 207
Self-citationModeling General and Specific Aspects of Documents with a Probabilistic Topic Model
Chemudugunta, C., Smyth, P., & Steyvers, M. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0035 · Cited by 186
Modeling Spread of Disease from Social Interactions
Sadilek, A., Kautz, H., & Silenzio, V. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v6i1.14235 · Cited by 167
Carmen: A Twitter Geolocation System with Applications to Public Health
Dredze, M. H., Paul, M. J., Bergsma, S., & Tran, H. T. (2013) · Cited by 156
Self-citationCould Behavioral Medicine Lead the Web Data Revolution?
Ayers, J. W., Althouse, B. M., & Dredze, M. H. (2014) · JAMA · doi:10.1001/jama.2014.1505 · Cited by 130
Self-citationOnline Social Networks and Smoking Cessation: A Scientific Research Agenda
Cobb, N. K., Graham, A. L., Byron, M., NIAURA, R. S., Abrams, D. B., & Participants, W. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1911 · Cited by 119
A Two-Dimensional Topic-Aspect Model for Discovering Multi-Faceted Topics
Paul, M. J., & Gîrju, R. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7669 · Cited by 113
Self-citationDecoding twitter: Surveillance and trends for cardiac arrest and resuscitation communication
Bosley, J. C., Zhao, N. W., Hill, S., Shofer, F. S., Asch, D. A., Becker, L. B., & Merchant, R. M. (2012) · Resuscitation · doi:10.1016/j.resuscitation.2012.10.017 · Cited by 108
Lightweight methods to estimate influenza rates and alcohol sales volume from Twitter messages
Culotta, A. (2012) · Language Resources and Evaluation · doi:10.1007/s10579-012-9185-0 · Cited by 103
Cross-cultural analysis of blogs and forums with mixed-collection topic models
Paul, M. J., & Gîrju, R. (2009) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1699648.1699687 · Cited by 96
Self-citationA Practical Approach for Content Mining of Tweets
Yoon, S., Elhadad, N., & Henry, S. B. (2013) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2013.02.025 · Cited by 95
Finding Complex Biological Relationships in Recent PubMed Articles Using Bio-LDA
Wang, H., Ding, Y., Tang, J., Dong, X., He, B., Qiu, J., & Wild, D. J. (2011) · PLoS ONE · doi:10.1371/journal.pone.0017243 · Cited by 90
Ahmed, A. A., & Xing, E. P. (2018) · Figshare · doi:10.1184/r1/6476366 · Cited by 67
Mixed Membership Markov Models for Unsupervised Conversation Modeling
Paul, M. J. (2012) · Cited by 36
Self-citationDrug Extraction from the Web: Summarizing Drug Experiences with Multi-Dimensional Topic Models
Paul, M. J., & Dredze, M. H. (2013) · Cited by 29
Self-citation
Cited by
Xue, J., Chen, J., Chen, C., Zheng, C., Li, S., & Zhu, T. (2020) · PLOS ONE · doi:10.1371/journal.pone.0239441 · Cited by 332
Curiskis, S. A., Drake, B., Osborn, T. R., & Kennedy, P. J. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2019.04.002 · Cited by 304
Topic Modeling Using Latent Dirichlet allocation: A Survey
Chauhan, U., & Shah, A. (2022) · ACM Computing Surveys · doi:10.1145/3462478 · Cited by 270
Advances in nowcasting influenza-like illness rates using search query logs
Lampos, V., Miller, A. C., Crossan, S., & Stefansen, C. (2015) · Scientific Reports · doi:10.1038/srep12760 · Cited by 143
A novel surveillance approach for disaster mental health
Gruebner, O., Lowe, S. R., Sykora, M., Shankardass, K., Subramanian, S. V., & Galea, S. (2017) · PLOS ONE · doi:10.1371/journal.pone.0181233 · Cited by 105
Metadata
- Authors
- Paul, M. J., & Dredze, M.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-08-01
- Volume
- 9
- Issue
- 8
- Pages
- e103408
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2079591709
- Cited by
- 269
- References
- 50
- FWCI
- 15.95
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.