Associations between internet-based patient ratings and conventional surveys of patient experience in the English NHS: an observational study
Open accessThe DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Objective: Unsolicited web-based comments by patients regarding their healthcare are increasing, but controversial. The relationship between such online patient reports and conventional measures of patient experience (obtained via survey) is not known. The authors examined hospital level associations between web-based patient ratings on the National Health Service (NHS) Choices website, introduced in England during 2008, and paper-based survey measures of patient experience. The authors also aimed to compare these two methods of measuring patient experience. Design: The authors performed a cross-sectional observational study of all (n=146) acute general NHS hospital trusts in England using data from 9997 patient web-based ratings posted on the NHS Choices website during 2009/2010. Hospital trust level indicators of patient experience from a paper-based survey (five measures) were compared with web-based patient ratings using Spearman's rank correlation coefficient. The authors compared the strength of associations among clinical outcomes, patient experience survey results and NHS Choices ratings. Results: Web-based ratings of patient experience were associated with ratings derived from a national paper-based patient survey (Spearman ρ=0.31–0.49, p<0.001 for all). Associations with clinical outcomes were at least as strong for online ratings as for traditional survey measures of patient experience. Conclusions: Unsolicited web-based patient ratings of their care, though potentially prone to many biases, are correlated with survey measures of patient experience. They may be useful tools for patients when choosing healthcare providers and for clinicians to improve the quality of their services.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Lagu, T., Hannon, N. S., Rothberg, M. B., & Lindenauer, P. K. (2010) · Journal of General Internal Medicine · doi:10.1007/s11606-010-1383-0 · Cited by 290
Kadry, B., Chu, L. F., Kadry, B., Gammas, D., & Macario, A. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1960 · Cited by 244
Cited by
Examining the Role of Patient Experience Surveys in Measuring Health Care Quality
Anhang Price, R., Elliott, M. N., Zaslavsky, A. M., Hays, R. D., Lehrman, W. G., Rybowski, L., Edgman-Levitan, S., & Cleary, P. D. (2014) · Medical Care Research and Review · doi:10.1177/1077558714541480 · Cited by 859
Use of Sentiment Analysis for Capturing Patient Experience From Free-Text Comments Posted Online
Greaves, F., Ramirez-Cano, D., Millett, C., Darzi, A., & Donaldson, L. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2721 · Cited by 321
Self-citationHarnessing the cloud of patient experience: using social media to detect poor quality healthcare
Greaves, F., Ramirez-Cano, D., Millett, C., Darzi, A., & Donaldson, L. (2013) · BMJ Quality & Safety · doi:10.1136/bmjqs-2012-001527 · Cited by 272
“15 23 A more sophisticated method to examine the potential as an early warning system would be to identify, through traditional means, future cases of poorly performing hospitals, and collect corresponding data on how patients described these institutions on the internet.”
MethodSelf-citationLocock, L., Robert, G., Boaz, A., Vougioukalou, S., Shuldham, C., Fielden, J., Ziebland, S., Gager, M., Tollyfield, R., & Pearcey, J. (2014) · Health Services and Delivery Research · doi:10.3310/hsdr02040 · Cited by 138
Social Media and Rating Sites as Tools to Understanding Quality of Care: A Scoping Review
Verhoef, L. M., Van de Belt, T. H., Engelen, L. J., Schoonhoven, L., & Kool, R. B. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3024 · Cited by 130
Metadata
- Authors
- Greaves, F., Pape, U. J., King, D., Darzi, A., Majeed, A., Wachter, R. M., & Millett, C.
- Venue
- BMJ Quality & Safety
- Publisher
- BMJ
- Published
- 2012-04-20
- Volume
- 21
- Issue
- 7
- Pages
- 600-605
- ISSN
- 1475-3898 (ISSN-L)
- 2044-5415
- 2044-5423
- OpenAlex
- W2108397944
- Cited by
- 119
- References
- 2
- FWCI
- 18.39
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Associations between internet-based patient ratings and conventional surveys of patient experience in the English NHS: an observational study. https://app.cochat.ai/papers/10.1136/bmjqs-2012-000906
- The paper
- Greaves, F., Pape, U. J., King, D., Darzi, A., Majeed, A., Wachter, R. M., & Millett, C. (2012). Associations between internet-based patient ratings and conventional surveys of patient experience in the English NHS: an observational study. BMJ Quality & Safety. https://doi.org/10.1136/bmjqs-2012-000906
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.