Cited by 91Mental Health via WritingSentiment Analysis and Opinion MiningData-Driven Disease Surveillance

Recent Advances in Using Natural Language Processing to Address Public Health Research Questions Using Social Media and ConsumerGenerated Data

Open access
Conway, Mike, Hu, Mengke, Chapman, Wendy W.·2019·Yearbook of Medical Informatics

Abstract

Objective: We present a narrative review of recent work on the utilisation of Natural Language Processing (NLP) for the analysis of social media (including online health communities) specifically for public health applications. Methods: We conducted a literature review of NLP research that utilised social media or online consumer-generated text for public health applications, focussing on the years 2016 to 2018. Papers were identified in several ways, including PubMed searches and the inspection of recent conference proceedings from the Association of Computational Linguistics (ACL), the Conference on Human Factors in Computing Systems (CHI), and the International AAAI (Association for the Advancement of Artificial Intelligence) Conference on Web and Social Media (ICWSM). Popular data sources included Twitter, Reddit, various online health communities, and Facebook. Results: In the recent past, communicable diseases (e.g., influenza, dengue) have been the focus of much social media-based NLP health research. However, mental health and substance use and abuse (including the use of tobacco, alcohol, marijuana, and opioids) have been the subject of an increasing volume of research in the 2016 - 2018 period. Associated with this trend, the use of lexicon-based methods remains popular given the availability of psychologically validated lexical resources suitable for mental health and substance abuse research. Finally, we found that in the period under review “modern" machine learning methods (i.e. deep neural-network-based methods), while increasing in popularity, remain less widely used than “classical" machine learning methods.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1055/s-0039-1677918

Cites

112 of 112 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • BlueDot appears to have been the first to notice the epidemic in Wuhan, many hours before Chinese officials and other foreign organizations and agencies.

    “BlueDot, a Toronto-based start-up that uses an AI-enhanced surveillance gadget, appears to have been the first to notice the epidemic in Wuhan, many hours before Chinese officials and other foreign organizations and agencies (Conway et al. 2019).”

    From Blockchain and Artificial Intelligence Technology in E-Health (2021) · cites this paper as Conway et al. 2019

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 3

  1. [70]Khanpour H Caragea CFine-grained emotion detection in health-related online posts. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics; 2018. p. 1160-6. Available from: http://aclweb.org/anthology/D18-1147
  2. [100]Hwang J D Hollingshead KCrazy mad nutters: the language of mental health. In: Proceedings of the Third Workshop on Computational Lingusitics and Clinical Psychology. Association for Computational Linguistics; 2016. p. 52-62. Available from: http://aclweb.org/anthology/W16-0306
  3. [103]Benton A Coppersmith G Dredze MEthical research protocols for social media health research. In: Proceedings of the First ACL Workshop on Ethics in Natural Language Processing. Association for Computational Linguistics; 2017. p. 94-102. Available from: http://aclweb.org/anthology/W17-1612

Cited by

Sorted by citations

Authors
Conway, M., Hu, M., & Chapman, W. W.
Affiliations
University of Utah (US)
Corresponding author
Conway, Mike
Venue
Yearbook of Medical Informatics
Published
2019-08
Volume
28
Issue
01
Pages
208-217
ISSN
  • 0943-4747 (ISSN-L)
  • 2364-0502
OpenAlex
W2968719776
Cited by
91
References
112
Citations by year
2026: 3 · 2025: 9 · 2024: 11 · 2023: 13 · 2022: 18 · 2021: 22 · 2020: 11 · 2019: 3 · 2018: 1
FWCI
16.95
Type
journal article
Language
en
Open access
Locations
  • Yearbook of Medical Informatics (publishedVersion, cc-by-nc-nd)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by-nc-nd)
  • PubMed Central (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
  • Minerva Access (University of Melbourne) (submittedVersion, cc-by-nc-nd)
Funders
  • National Institutes of Health
  • National Institute on Drug Abuse (R21DA043775)
Topics
  • Social Sciences › Psychology › Social Psychology › Mental Health via Writing
  • Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
  • Health Sciences › Medicine › Epidemiology › Data-Driven Disease Surveillance
Keywords
natural language processing, social media, public health, online health communities, Twitter, Reddit, Facebook, infectious diseases, influenza surveillance, dengue, mental health, substance use, substance abuse, lexicon-based methods, deep neural network, classical machine learning
MeSH terms
Patient Generated Health Data, Health Services Research, Humans, Natural Language Processing, Public Health, Bibliometrics, Social Media, Public Health Surveillance

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review