Cited by 244Patient Satisfaction in HealthcareHealth Literacy and Information AccessibilitySocial Media in Health Education

Analysis of 4999 Online Physician Ratings Indicates That Most Patients Give Physicians a Favorable Rating

Open access
Kadry, Bassam, Chu, Larry F, Kadry, Bayan, Gammas, Danya, Macario, Alex·2011·Journal of Medical Internet Research

Abstract

BACKGROUND: Many online physician-rating sites provide patients with information about physicians and allow patients to rate physicians. Understanding what information is available is important given that patients may use this information to choose a physician. OBJECTIVES: The goals of this study were to (1) determine the most frequently visited physician-rating websites with user-generated content, (2) evaluate the available information on these websites, and (3) analyze 4999 individual online ratings of physicians. METHODS: On October 1, 2010, using Google Trends we identified the 10 most frequently visited online physician-rating sites with user-generated content. We then studied each site to evaluate the available information (eg, board certification, years in practice), the types of rating scales (eg, 1-5, 1-4, 1-100), and dimensions of care (eg, recommend to a friend, waiting room time) used to rate physicians. We analyzed data from 4999 selected physician ratings without identifiers to assess how physicians are rated online. RESULTS: The 10 most commonly visited websites with user-generated content were HealthGrades.com, Vitals.com, Yelp.com, YP.com, RevolutionHealth.com, RateMD.com, Angieslist.com, Checkbook.org, Kudzu.com, and ZocDoc.com. A total of 35 different dimensions of care were rated by patients in the websites, with a median of 4.5 (mean 4.9, SD 2.8, range 1-9) questions per site. Depending on the scale used for each physician-rating website, the average rating was 77 out of 100 for sites using a 100-point scale (SD 11, median 76, range 33-100), 3.84 out of 5 (77%) for sites using a 5-point scale (SD 0.98, median 4, range 1-5), and 3.1 out of 4 (78%) for sites using a 4-point scale (SD 0.72, median 3, range 1-4). The percentage of reviews rated ≥75 on a 100-point scale was 61.5% (246/400), ≥4 on a 5-point scale was 57.74% (2078/3599), and ≥3 on a 4-point scale was 74.0% (740/1000). The patient's single overall rating of the physician correlated with the other dimensions of care that were rated by patients for the same physician (Pearson correlation, r = .73, P < .001). CONCLUSIONS: Most patients give physicians a favorable rating on online physician-rating sites. A single overall rating to evaluate physicians may be sufficient to assess a patient's opinion of the physician. The optimal content and rating method that is useful to patients when visiting online physician-rating sites deserves further study. Conducting a qualitative analysis to compare the quantitative ratings would help validate the rating instruments used to evaluate physicians.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/jmir.1960

Cites

36 of 36 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 5

  1. [2]Taylor H Harris Interactive 2010 8 4 2011-10-03 Press release: "Cyberchondriacs" on the Rise? Those who go online for healthcare information continues to increase http://www.harrisinteractive.com/vault/HI-Harris-Poll-Cyberchondriacs-2010-08-04.pdf
  2. [10]Brayer T Opposing Views, Inc 2010 7 7 2011-02-22 Doctor Sues Online Review Sites for Bad Ratings http://www.opposingviews.com/i/doctor-sues-online-review-sites-for-bad-ratings
  3. [30]Holbrook AL Krosnick JA Pfent A The causes and consequences of response rates in surveys by the news media and government contractor survey research Firms Lepkowski JM, Tucker C, Brick JM, de Leeuw ED, Japec L, Lavrakas PJ, Link MW, Sangster RL, editors. Advances in Telephone Survey Methodology 2008 Hoboken, NJ John Wiley & Sons 499 679
  4. [51]Anonymous United States Court of Appeals for the District of Columbia Circuit 2008 5 1 2011-10-03 Consumers’ Checkbook v. United States Department of Health and Human Services http://www.ama-assn.org/ama1/pub/upload/mm/395/consumers-checkbook-ama-brief.pdf
  5. [52]Boodman SG The Washington Post 2009 7 21 2011-11-09 To Quell Criticism, Some Doctors Require Patients to Sign 'Gag Orders' http://www.usatoday.com/news/health/2009-03-05-doctor-reviews_N.htm 11648038

Cited by

Sorted by citations

Authors
Kadry, B., Chu, L. F., Kadry, B., Gammas, D., & Macario, A.
Affiliations
  • Stanford Medicine (US)
  • Creighton University (US)
Corresponding author
Kadry, Bassam
Venue
Journal of Medical Internet Research
Published
2011-11-16
Volume
13
Issue
4
Pages
e95
ISSN
1438-8871 (ISSN-L)
OpenAlex
W2050545314
Cited by
244
References
36
Citations by year
2026: 5 · 2025: 6 · 2024: 4 · 2023: 12 · 2022: 18 · 2021: 18 · 2020: 26 · 2019: 32 · 2018: 31 · 2017: 17 · 2016: 19 · 2015: 21 · 2014: 13 · 2013: 13 · 2012: 7
FWCI
20.17
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Medical Internet Research (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Health Sciences › Health Professions › General Health Professions › Patient Satisfaction in Healthcare
  • Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
  • Social Sciences › Health › Social Media in Health Education
Keywords
online physician ratings, patient reviews, user-generated content, physician rating websites, patient satisfaction, rating scales, dimensions of care, physician selection, Healthgrades, Yelp, Google Trends, health information seeking, patient-provider communication, physician-patient relationship, patient satisfaction survey
MeSH terms
Adult, Humans, Physician-Patient Relations, Physicians, United States, Patient Satisfaction, Internet, Social Media

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review