Health Advice from Internet Discussion Forums: How Bad Is Dangerous?
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Concerns over online health information-seeking behavior point to the potential harm incorrect, incomplete, or biased information may cause. However, systematic reviews of health information have found few examples of documented harm that can be directly attributed to poor quality information found online. OBJECTIVE: The aim of this study was to improve our understanding of the quality and quality characteristics of information found in online discussion forum websites so that their likely value as a peer-to-peer health information-sharing platform could be assessed. METHODS: A total of 25 health discussion threads were selected across 3 websites (Reddit, Mumsnet, and Patient) covering 3 health conditions (human immunodeficiency virus [HIV], diabetes, and chickenpox). Assessors were asked to rate information found in the discussion threads according to 5 criteria: accuracy, completeness, how sensible the replies were, how they thought the questioner would act, and how useful they thought the questioner would find the replies. RESULTS: In all, 78 fully completed assessments were returned by 17 individuals (8 were qualified medical doctors, 9 were not). When the ratings awarded in the assessments were analyzed, 25 of the assessments placed the discussion threads in the highest possible score band rating them between 5 and 10 overall, 38 rated them between 11 and 15, 12 rated them between 16 and 20, and 3 placed the discussion thread they assessed in the lowest rating band (21-25). This suggests that health threads on Internet discussion forum websites are more likely than not (by a factor of 4:1) to contain information of high or reasonably high quality. Extremely poor information is rare; the lowest available assessment rating was awarded only 11 times out of a possible 353, whereas the highest was awarded 54 times. Only 3 of 78 fully completed assessments rated a discussion thread in the lowest possible overall band of 21 to 25, whereas 25 of 78 rated it in the highest of 5 to 10. Quality assessments differed depending on the health condition (chickenpox appeared 17 times in the 20 lowest-rated threads, HIV twice, and diabetes once). Although assessors tended to agree on which discussion threads contained good quality information, what constituted poor quality information appeared to be more subjective. CONCLUSIONS: Most of the information assessed in this study was considered by qualified medical doctors and nonmedically qualified respondents to be of reasonably good quality. Although a small amount of information was assessed as poor, not all respondents agreed that the original questioner would have been led to act inappropriately based on the information presented. This suggests that discussion forum websites may be a useful platform through which people can ask health-related questions and receive answers of acceptable quality.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Eysenbach, G., Powell, J., Kuss, O., & Sa, E.-R. (2002) · JAMA · doi:10.1001/jama.287.20.2691 · Cited by 1,871 · cited 1×
“The medical/scientific completeness of the information [9,10,44]; 3.”
ZIEBLAND, S., & WYKE, S. (2012) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2012.00662.x · Cited by 554
Are Physicians Ready for Patients With Internet-Based Health Information?
Ahmad, F., Hudak, P. L., Bercovitz, K., Hollenberg, E., & Levinson, W. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.3.e22 · Cited by 283 · cited 2×
“…in the questions because, although many previous studies have criticized online health information for being of poor or variable quality [11,14,15], far less have found actual evidence of poor information leading to inappropriate or dangerous health decisions being made [16,17,45,46].”
Sociotechnical Challenges and Progress in Using Social Media for Health
Munson, S. A., Cavusoglu, H., Frisch, L., & Fels, S. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2792 · Cited by 57 · cited 1×
“The more designers, owners, operators, and users of online discussion forums are aware of what these influences are likely to be, the more able they will be to consider how they can influence users’ choices [33,34].”
Cited by
Consumer health information seeking in social media: a literature review
Zhao, Y., & Zhang, J. (2017) · Health Information & Libraries Journal · doi:10.1111/hir.12192 · Cited by 607
How patients’ use of social media impacts their interactions with healthcare professionals
Benetoli, A., Chen, T. F., & Aslani, P. (2018) · Patient Education and Counseling · doi:10.1016/j.pec.2017.08.015 · Cited by 185
Khelfaoui, I., Xie, Y., Hafeez, M., Ahmed, D., Degha, H. E., & Meskher, H. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19127338 · Cited by 24
“[35] assessed the health advice provided by weblogs and online forums.”
Backgroundvan Mierlo, T., Li, X., Hyatt, D., & Ching, A. T. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6330 · Cited by 14
“Background Digital health social networks (DHSNs), otherwise known as discussion forums or peer-to-peer support groups, are in abundance [1-8].”
Background
Metadata
- Authors
- Cole, J., Watkins, C., & Kleine, D.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2016-01-06
- Volume
- 18
- Issue
- 1
- Pages
- e4
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2228517709
- Cited by
- 129
- References
- 4
- FWCI
- 32.56
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.