A large-scale quantitative analysis of latent factors and sentiment in online doctor reviews
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Online physician reviews are a massive and potentially rich source of information capturing patient sentiment regarding healthcare. We analyze a corpus comprising nearly 60,000 such reviews with a state-of-the-art probabilistic model of text. We describe a probabilistic generative model that captures latent sentiment across aspects of care (eg, interpersonal manner). We target specific aspects by leveraging a small set of manually annotated reviews. We perform regression analysis to assess whether model output improves correlation with state-level measures of healthcare. We report both qualitative and quantitative results. Model output correlates with state-level measures of quality healthcare, including patient likelihood of visiting their primary care physician within 14 days of discharge (p=0.03), and using the proposed model better predicts this outcome (p=0.10). We find similar results for healthcare expenditure. Generative models of text can recover important information from online physician reviews, facilitating large-scale analyses of such reviews.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Basics of Qualitative Research (3rd ed.): Techniques and Procedures for Developing Grounded Theory
Corbin, J., & Strauss, A. (2008) · SAGE · doi:10.4135/9781452230153 · Cited by 12,136
Beswick, A. D., Wylde, V., Gooberman-Hill, R., Blom, A., & Dieppe, P. (2012) · BMJ Open · doi:10.1136/bmjopen-2011-000435 · Cited by 1,450
Harnessing the cloud of patient experience: using social media to detect poor quality healthcare
Greaves, F., Ramirez-Cano, D., Millett, C., Darzi, A., & Donaldson, L. (2013) · BMJ Quality & Safety · doi:10.1136/bmjqs-2012-001527 · Cited by 272
Content of Weblogs Written by Health Professionals
Lagu, T., Kaufman, E. J., Asch, D. A., & Armstrong, K. (2008) · Journal of General Internal Medicine · doi:10.1007/s11606-008-0726-6 · Cited by 255
Cited by
A Survey of Deep Active Learning
Ren, P., Xiao, Y., Chang, X., Huang, P.-Y., Li, Z., Gupta, B. B., Chen, X., & Wang, X. (2022) · ACM Computing Surveys · doi:10.1145/3472291 · Cited by 1,169
Mining opinions from instructor evaluation reviews: a deep learning approach
Onan, A. (2020) · Computer Applications in Engineering Education · doi:10.1002/cae.22179 · Cited by 270
“These user‐ generated text documents include hotel reviews [82], product reviews [23], movie reviews [75], and doctor reviews [80], among the others.”
BackgroundWakamiya, S., Kawai, Y., & Aramaki, E. (2018) · JMIR Public Health and Surveillance · doi:10.2196/publichealth.8627 · Cited by 75
Metadata
- Authors
- Wallace, B. C., Paul, M. J., Sarkar, U., Trikalinos, T. A., & Dredze, M.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2014-11
- Volume
- 21
- Issue
- 6
- Pages
- 1098-1103
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W2153673727
- Cited by
- 114
- References
- 4
- FWCI
- 7.92
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A large-scale quantitative analysis of latent factors and sentiment in online doctor reviews. https://app.cochat.ai/papers/10.1136/amiajnl-2014-002711
- The paper
- Wallace, B. C., Paul, M. J., Sarkar, U., Trikalinos, T. A., & Dredze, M. (2014). A large-scale quantitative analysis of latent factors and sentiment in online doctor reviews. Journal of the American Medical Informatics Association. https://doi.org/10.1136/amiajnl-2014-002711
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.