The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
How valid and reliable are patient satisfaction data? An analysis of 195 studies
Abstract
OBJECTIVE: To assess the properties of validity and reliability of instruments used to assess satisfaction in a broad sample of health service user satisfaction studies, and to assess the level of awareness of these issues among study authors. DESIGN: Examination and analysis of 195 papers published in 1994 in 139 journals. The following databases were searched: British Nursing Index, CINAHL, EMBASE, MedLine, Popline, and PsycLIT. MAIN MEASURES: Number and types of strategies used for content, criterion, and construct validity, and for stability and internal consistency. Associations between validity/reliability and other study characteristics. RESULTS: Eighty-nine (46%) of the 195 studies reported some validity or reliability data; 76 reported some element of content validity; 14 reported criterion validity, with patient's intent to return the most commonly used criterion; four reported construct validity. Thirty-four studies reported internal consistency reliability, 31 of which used Cronbach's coefficient alpha; eight studies reported test-retest reliability. Only 11 studies (6% of the 181 quantitative studies) reported content validity and criterion or construct validity and reliability. 'New' instruments designed specifically for the reported study demonstrated significantly less evidence for reliability/validity than did 'old' instruments. CONCLUSION: With few exceptions, the study instruments in this sample demonstrated little evidence of reliability or validity. Moreover, study authors exhibited a poor understanding of the importance of these properties in the assessment of satisfaction. Researchers must be aware that this is poor research practice, and that lack of a reliable and valid assessment instrument casts doubt on the credibility of satisfaction findings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
Health Measurement Scales: A Practical Guide to Their Development and Use
Streiner, D. L., Norman, G. R., & Cairney, J. (1989) · Cited by 9,595
Assessment of client/patient satisfaction: development of a general scale
Larsen, D. L., Attkisson, C. C., Hargreaves, W. A., & Nguyen, T. D. (1979) · Evaluation and Program Planning · doi:10.1016/0149-7189(79)90094-6 · Cited by 2,887
A Brief Measure of Social Support: Practical and Theoretical Implications
Sarason, I. G., Sarason, B. R., Shearin, E. N., & Pierce, G. R. (1987) · Journal of Social and Personal Relationships · doi:10.1177/0265407587044007 · Cited by 1,977
The definition of quality and approaches to its assessment
Donabedian, A. (1980) · Health Administration Press eBooks · Cited by 1,747
The client satisfaction questionnaire
Attkisson, C. C., & Zwick, R. (1982) · Evaluation and Program Planning · doi:10.1016/0149-7189(82)90074-x · Cited by 1,743
Patient satisfaction: A review of issues and concepts
Sitzia, J., & Wood, N. (1997) · Social Science & Medicine · doi:10.1016/s0277-9536(97)00128-7 · Cited by 1,690
Self-citationNursing research : the application of qualitative approaches
Morse, J. M., & Field, P. (1996) · Medical Entomology and Zoology · Cited by 1,475
Patient satisfaction: A valid concept?
Williams, B. (1994) · Social Science & Medicine · doi:10.1016/0277-9536(94)90247-x · Cited by 1,145
Hall, J. A., & Dornan, M. C. (1990) · Social Science & Medicine · doi:10.1016/0277-9536(90)90205-7 · Cited by 945
Cited by
Crow, R., Gage, H., Hampson, S., Hart, J., Kimber, A., Storey, L., & Thomas, H. (2002) · Health Technology Assessment · doi:10.3310/hta6320 · Cited by 1,270
A critical review of patient satisfaction
Gill, L., & White, L. (2009) · Leadership in Health Services · doi:10.1108/17511870910927994 · Cited by 400
Predictors of patient satisfaction with hospital health care
Quintana, J. M., González, N., Bilbao, A., Aizpuru, F., Escobar, A., Esteban, C., San-Sebastián, J. A., de-la-Sierra, E., & Thompson, A. (2006) · BMC Health Services Research · doi:10.1186/1472-6963-6-102 · Cited by 385
Patient satisfaction revisited: A multilevel approach
Hekkert, K. D., Cihangir, S., Kleefstra, S. M., van den Berg, B., & Kool, R. B. (2009) · Social Science & Medicine · doi:10.1016/j.socscimed.2009.04.016 · Cited by 311
Alrubaiee, L., & Alkaa'ida, F. (2011) · International Journal of Marketing Studies · doi:10.5539/ijms.v3n1p103 · Cited by 264
Metadata
- Authors
- Sitzia, J.
- Venue
- International Journal for Quality in Health Care
- Publisher
- Oxford University Press (OUP)
- Published
- 1999-08-01
- Volume
- 11
- Issue
- 4
- Pages
- 319-328
- ISSN
- 1353-4505 (ISSN-L)
- 1464-3677
- OpenAlex
- W2115375689
- Cited by
- 515
- References
- 44
- FWCI
- 17.07
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: How valid and reliable are patient satisfaction data? An analysis of 195 studies. https://app.cochat.ai/papers/10.1093/intqhc/11.4.319
- The paper
- Sitzia, J. (1999). How valid and reliable are patient satisfaction data? An analysis of 195 studies. International Journal for Quality in Health Care. https://doi.org/10.1093/intqhc/11.4.319
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.