The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Twitter as a Tool for Health Research: A Systematic Review
Open accessAbstract
Background. Researchers have used traditional databases to study public health for decades. Less is known about the use of social media data sources, such as Twitter, for this purpose. Objectives. To systematically review the use of Twitter in health research, define a taxonomy to describe Twitter use, and characterize the current state of Twitter in health research. Search methods. We performed a literature search in PubMed, Embase, Web of Science, Google Scholar, and CINAHL through September 2015. Selection criteria. We searched for peer-reviewed original research studies that primarily used Twitter for health research. Data collection and analysis. Two authors independently screened studies and abstracted data related to the approach to analysis of Twitter data, methodology used to study Twitter, and current state of Twitter research by evaluating time of publication, research topic, discussion of ethical concerns, and study funding source. Main results. Of 1110 unique health-related articles mentioning Twitter, 137 met eligibility criteria. The primary approaches for using Twitter in health research that constitute a new taxonomy were content analysis (56%; n = 77), surveillance (26%; n = 36), engagement (14%; n = 19), recruitment (7%; n = 9), intervention (7%; n = 9), and network analysis (4%; n = 5). These studies collectively analyzed more than 5 billion tweets primarily by using the Twitter application program interface. Of 38 potential data features describing tweets and Twitter users, 23 were reported in fewer than 4% of the articles. The Twitter-based studies in this review focused on a small subset of data elements including content analysis, geotags, and language. Most studies were published recently (33% in 2015). Public health (23%; n = 31) and infectious disease (20%; n = 28) were the research fields most commonly represented in the included studies. Approximately one third of the studies mentioned ethical board approval in their articles. Primary funding sources included federal (63%), university (13%), and foundation (6%). Conclusions. We identified a new taxonomy to describe Twitter use in health research with 6 categories. Many data elements discernible from a user’s Twitter profile, especially demographics, have been underreported in the literature and can provide new opportunities to characterize the users whose data are analyzed in these studies. Twitter-based health research is a growing field funded by a diversity of organizations. Public health implications. Future work should develop standardized reporting guidelines for health researchers who use Twitter and policies that address privacy and ethical concerns in social media research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Heart Disease and Stroke Statistics—2015 Update: A Report From the American Heart Association
Mozaffarian, D., Benjamin, E. J., Go, A. S., Arnett, D. K., Blaha, M. J., Cushman, M., de Ferranti, S., Després, J.-P., Fullerton, H. J., Howard, V. J., et al. (2015) · Circulation · doi:10.1161/cir.0000000000000152 · Cited by 5,797
Webb, T. L., Joseph, J., Yardley, L., & Michie, S. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1376 · Cited by 2,517
Moorhead, S. A., Hazlett, D. E., Harrison, L., Carroll, J. K., Irwin, A., & Hoving, C. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.1933 · Cited by 2,517
McGuire, S. (2014) · Advances in Nutrition · doi:10.3945/an.114.007211 · Cited by 1,122
Computational Intelligence and Neuroscience
(2022) · Computational Intelligence and Neuroscience · doi:10.1155/8483 · Cited by 956
“But the data is already public”: on the ethics of research in Facebook
Zimmer, M. (2010) · Ethics and Information Technology · doi:10.1007/s10676-010-9227-5 · Cited by 900
Social Media: A Review and Tutorial of Applications in Medicine and Health Care
Grajales III, F. J., Sheps, S., Ho, K., Novak-Lauscher, H., & Eysenbach, G. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.2912 · Cited by 737
Maher, C. A., Lewis, L. K., Ferrar, K., Marshall, S., De Bourdeaudhuij, I., & Vandelanotte, C. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.2952 · Cited by 733
Nwankwo, T., Yoon, S. S., Burt, V. L., & Gu, Q. (2013) · PubMed · Cited by 689
Classifying latent user attributes in twitter
Rao, D., Yarowsky, D., Shreevats, A., & Gupta, M. (2010) · Proceedings of the 2nd international workshop on Search and mining user-generated contents · doi:10.1145/1871985.1871993 · Cited by 655
Discriminating Gender on Twitter
Burger, J. D., Henderson, J. C., Kim, G., & Zarrella, G. (2011) · Cited by 580
Utilizing social media data for pharmacovigilance: A review
Sarker, A., Ginn, R., Nikfarjam, A., O’Connor, K., Smith, K., Jayaraman, S., Upadhaya, T., & Gonzalez, G. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.02.004 · Cited by 497
Chunara, R., Andrews, J. R., & Brownstein, J. S. (2012) · The American Society of Tropical Medicine and Hygiene · doi:10.4269/ajtmh.2012.11-0597 · Cited by 436
Neiger, B. L., Thackeray, R., Van Wagenen, S. A., Hanson, C. L., West, J. H., Barnes, M. D., & Fagen, M. C. (2012) · Health Promotion Practice · doi:10.1177/1524839911433467 · Cited by 407
Social media use among patients and caregivers: a scoping review
Hamm, M. P., Chisholm, A., Shulhan, J., Milne, A., Scott, S. D., Given, L. M., & Hartling, L. (2013) · BMJ Open · doi:10.1136/bmjopen-2013-002819 · Cited by 345
Charles-Smith, L. E., Reynolds, T. L., Cameron, M. A., Conway, M., Lau, E. H. Y., Olsen, J. M., Pavlin, J. A., Shigematsu, M., Streichert, L. C., Suda, K. J., et al. (2015) · PLOS ONE · doi:10.1371/journal.pone.0139701 · Cited by 324
(2014) · doi:10.3726/978-1-4539-1170-9 · Cited by 307
Democrats, republicans and starbucks afficionados: user classification in twitter
Pennacchiotti, M., & Popescu, A.-M. (2011) · Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2020408.2020477 · Cited by 282
Bones, body parts, and sex appeal: An analysis of #thinspiration images on popular social media
Ghaznavi, J., & Taylor, L. D. (2015) · Body Image · doi:10.1016/j.bodyim.2015.03.006 · Cited by 271
Ethical challenges of big data in public health
Vayena, E., Salathé, M., Madoff, L. C., & Brownstein, J. S. (2015) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1003904 · Cited by 268
Turner-McGrievy, G., & Tate, D. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1841 · Cited by 263
Wong, W. C., Cheung, C. S., & Hart, G. J. (2008) · Emerging Themes in Epidemiology · doi:10.1186/1742-7622-5-23 · Cited by 257
VELASCO, E., AGHENEZA, T., DENECKE, K., KIRCHNER, G., & ECKMANNS, T. (2014) · The Milbank Quarterly · doi:10.1111/1468-0009.12038 · Cited by 256
Neiger, B. L., Thackeray, R., Burton, S. H., Giraud-Carrier, C. G., & Fagen, M. C. (2013) · Health Promotion Practice · doi:10.1177/1524839912469378 · Cited by 200
A systematic examination of the use of Online social networking sites for sexual health promotion
Gold, J., Pedrana, A. E., Sacks-Davis, R., Hellard, M. E., Chang, S., Howard, S., Keogh, L., Hocking, J. S., & Stoove, M. A. (2011) · BMC Public Health · doi:10.1186/1471-2458-11-583 · Cited by 182
Balatsoukas, P., Kennedy, C. M., Buchan, I., Powell, J., & Ainsworth, J. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3662 · Cited by 173
Research challenges and opportunities in mapping social media and Big Data
Tsou, M.-H. (2015) · Cartography and Geographic Information Science · doi:10.1080/15230406.2015.1059251 · Cited by 168
Twitter user profiling based on text and community mining for market analysis
Ikeda, K., Hattori, G., Ono, C., Asoh, H., & Teruo Higashino, Y. (2013) · Knowledge-Based Systems · doi:10.1016/j.knosys.2013.06.020 · Cited by 158
Cancer patients on Twitter: a novel patient community on social media
Sugawara, Y., Narimatsu, H., Hozawa, A., Shao, L., Otani, K., & Fukao, A. (2012) · BMC Research Notes · doi:10.1186/1756-0500-5-699 · Cited by 155
Kass‐Hout, T., & Alhinnawi, H. (2013) · British Medical Bulletin · doi:10.1093/bmb/ldt028 · Cited by 148
Social media use by community-based organizations conducting health promotion: a content analysis
Ramanadhan, S., Mendez, S. R., Rao, M., & Viswanath, K. (2013) · BMC Public Health · doi:10.1186/1471-2458-13-1129 · Cited by 146
Inferring the demographics of search users: social data meets search queries
Bi, B., Shokouhi, M., Kosiński, M., & Graepel, T. (2013) · International World Wide Web Conference (WWW) · doi:10.1145/2488388.2488401 · Cited by 144
Himelboim, I., & Han, J. Y. (2013) · Journal of Health Communication · doi:10.1080/10810730.2013.811321 · Cited by 141
Social Media Adoption in Local Health Departments Nationwide
Harris, J. K., Mueller, N. L., & Snider, D. (2013) · American Journal of Public Health · doi:10.2105/ajph.2012.301166 · Cited by 141
Social media and pharmacovigilance: A review of the opportunities and challenges
Sloane, R., Osanlou, O., Lewis, D. J., Bollegala, D., Maskell, S. R., & Pirmohamed, M. (2015) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.12717 · Cited by 139
Social Media Use by Health Care Professionals and Trainees: A Scoping Review
Hamm, M. P., Chisholm, A., Shulhan, J., Milne, A., Scott, S. D., Klassen, T. P., & Hartling, L. (2013) · Academic Medicine · doi:10.1097/acm.0b013e31829eb91c · Cited by 136
Social Media in Health — What are the Safety Concerns for Health Consumers?
Lau, A. Y. S., Gabarrón, E., Fernández-Luque, L., & Armayones, M. (2012) · Health Information Management Journal · doi:10.1177/183335831204100204 · Cited by 128
Neiger, B. L., Thackeray, R., Burton, S. H., Thackeray, C. R., & Reese, J. H. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2775 · Cited by 119
Adverse Drug Reaction Identification and Extraction in Social Media: A Scoping Review
Lardon, J., Abdellaoui, R., Bellet, F., Asfari, H., Souvignet, J., Texier, N., Jaulent, M., Beyens, M., Burgun, A., & Cédric Bousquet, B. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4304 · Cited by 119
Veale, H., Sacks‐Davis, R., Weaver, E. R., Pedrana, A. E., Stoove, M. A., & Hellard, M. E. (2015) · BMC Public Health · doi:10.1186/s12889-015-1396-z · Cited by 104
#Schizophrenia: Use and misuse on Twitter
Joseph, A., Tandon, N., Yang, L. H., Duckworth, K., Torous, J. B., Seidman, L. J., & Keshavan, M. S. (2015) · Schizophrenia Research · doi:10.1016/j.schres.2015.04.009 · Cited by 103
Twitter and the health reforms in the English National Health Service
King, D., Ramirez-Cano, D., Greaves, F., Vlaev, I., Beales, S., & Darzi, A. W. (2013) · Health Policy · doi:10.1016/j.healthpol.2013.02.005 · Cited by 95
Social Network Sites as a Mode to Collect Health Data: A Systematic Review
Alshaikh, F., Ramzan, F., Rawaf, S., & Majeed, A. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3050 · Cited by 75
Health communication research in the digital age: A systematic review
Hu, Y. (2015) · Journal of Communications In Healthcare · doi:10.1080/17538068.2015.1107308 · Cited by 74
Leveraging Social Networks for Toxicovigilance
Chary, M. A., Genes, N. G., McKenzie, A. T., & Manini, A. F. (2013) · Journal of Medical Toxicology · doi:10.1007/s13181-013-0299-6 · Cited by 58
Twitter Sentiment Predicts Affordable Care Act Marketplace Enrollment
Wong, C. A., Sap, M., Schwartz, A., Town, R., Baker, T., Ungar, L., & Merchant, R. M. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3812 · Cited by 47
Self-citationUsing Twitter to Measure Public Discussion of Diseases: A Case Study
Weeg, C., Schwartz, H. A., Hill, S., Merchant, R. M., Arango, C. S., & Ungar, L. (2015) · JMIR Public Health and Surveillance · doi:10.2196/publichealth.3953 · Cited by 46
Self-citationHarris, J. K., Choucair, B., Maier, R., Jolani, N., & Bernhardt, J. M. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.2972 · Cited by 41
Twitter and society : an introduction
Weller, K., Bruns, A., Burgess, J., Mahrt, M., & Puschmann, C. (2014) · QUT ePrints (Queensland University of Technology) · Cited by 39
Roger, V. L., Boerwinkle, E., Crapo, J. D., Douglas, P. S., Epstein, J. A., Granger, C. B., Greenland, P., Kohane, I. S., & Psaty, B. M. (2015) · American Journal of Epidemiology · doi:10.1093/aje/kwv011 · Cited by 36
Exploring multiple evidence to infer users’ location in Twitter
Rodrigues, É. C., Assunção, R., Pappa, G. L., de Oliveira, D. R. R., & Meira, W. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.05.066 · Cited by 26
Turner‐McGrievy, G. M., & Tate, D. F. (2014) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2014.01.002 · Cited by 23
Cited by
Social Media Use for Health Purposes: Systematic Review
Chen, J., & Wang, Y. (2021) · Journal of Medical Internet Research · doi:10.2196/17917 · Cited by 1,073
Top concerns of tweeters during the COVID-19 pandemic: Infoveillance study
Abd-Alrazaq, A., Alhuwail, D., Househ, M., Hamdi, M., & Shah, Z. (2020) · Journal of Medical Internet Research · doi:10.2196/19016 · Cited by 774
What social media told us in the time of COVID-19: A scoping review
Tsao, S.-F., Chen, H., Tisseverasinghe, T., Yang, Y., Li, L., & Butt, Z. A. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30315-0 · Cited by 816
Machine learning and natural language processing in mental health: systematic review
Le Glaz, A., Haralambous, Y., Kim-Dufor, D.-H., Lenca, P., Billot, R., Ryan, T. C., Marsh, J., DeVylder, J., Walter, M., Berrouiguet, S., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/15708 · Cited by 576
“For instance, Sinnenberg et al [36] published a systematic review about Twitter as a tool for health research that included 137 different studies and analyzed over 5 billion tweets using ML; Castro et al [37] have processed 4.2 million EHRs spanning a period of over 20 years.”
InfluentialGarcia, K., & Berton, L. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2020.107057 · Cited by 369
Metadata
- Authors
- Sinnenberg, L., Buttenheim, A. M., Padrez, K., Mancheno, C., Ungar, L., & Merchant, R. M.
- Venue
- American Journal of Public Health
- Publisher
- American Public Health Association
- Published
- 2017-01
- Volume
- 107
- Issue
- 1
- Pages
- e1-e8
- ISSN
- 0090-0036 (ISSN-L)
- 1541-0048
- OpenAlex
- W2553110962
- Cited by
- 634
- References
- 55
- FWCI
- 8.15
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.