The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Patient-centered insights: using health care complaints to reveal hot spots and blind spots in quality and safety
Abstract
Policy Points: Health care complaints contain valuable data on quality and safety; however, there is no reliable method of analysis to unlock their potential. We demonstrate a method to analyze health care complaints that provides reliable insights on hot spots (where harm and near misses occur) and blind spots (before admissions, after discharge, systemic and low‐level problems, and errors of omission). Systematic analysis of health care complaints can improve quality and safety by providing patient‐centered insights that localize issues and shed light on difficult‐to‐monitor problems. Context: The use of health care complaints to improve quality and safety has been limited by a lack of reliable analysis tools and uncertainty about the insights that can be obtained. The Healthcare Complaints Analysis Tool, which we developed, was used to analyze a benchmark national data set, conceptualize a systematic analysis, and identify the added value of complaint data. Methods: We analyzed 1,110 health care complaints from across England. “Hot spots” were identified by mapping reported harm and near misses onto stages of care and underlying problems. “Blind spots” concerning difficult‐to‐monitor aspects of care were analyzed by examining access and discharge problems, systemic problems, and errors of omission. Findings: The tool showed moderate to excellent reliability. There were 1.87 problems per complaint (32% clinical, 32% relationships, and 34% management). Twenty‐three percent of problems entailed major or catastrophic harm, with significant regional variation (17%‐31%). Hot spots of serious harm were safety problems during examination, quality problems on the ward, and institutional problems during admission and discharge. Near misses occurred at all stages of care, with patients and family members often being involved in error detection and recovery. Complaints shed light on 3 blind spots: (1) problems arising when entering and exiting the health care system; (2) systemic failures pertaining to multiple distributed and often low‐level problems; and (3) errors of omission, especially failure to acknowledge and listen to patients raising concerns. Conclusions: The analysis of health care complaints reveals valuable and uniquely patient‐centered insights on quality and safety. Hot spots of harm and near misses provide an alternative data source on adverse events and critical incidents. Analysis of entry‐exit, systemic, and omission problems provides insight on blind spots that may otherwise be difficult to monitor. Benchmark data and analysis scripts are downloadable as supplementary files.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In addition, aggregate patient reports can identify vulnerabilities in organizational processes.37”
From A patient and family reporting system for perceived ambulatory note mistakes: experience at 3 U.S. healthcare centers (2019) · cites this paper as [37]
In the citing paper
“Respondents asked for new technical capabilities such as templates, checkboxes, and other systematic online solutions that may not only improve individual EHRs, but also facilitate organizational learning through aggregation of patient reports.31”
From Speaking up about patient-perceived serious visit note errors: Patient and family experiences and recommendations (2021) · cites this paper as [31]
In the citing paper
“Respondents asked for new technical capabilities such as templates, checkboxes, and other systematic online solutions that may not only improve individual EHRs, but also facilitate organizational learning through aggregation of patient reports.31”
From Speaking up about patient-perceived serious visit note errors: Patient and family experiences and recommendations (2021) · cites this paper as [31]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mixing Qualitative and Quantitative Methods: Triangulation in Action.
Jick, T. D. (1979) · Administrative Science Quarterly · doi:10.2307/2392366 · Cited by 7,103
The quality of health care delivered to adults in the United States
McGlynn, E. A., Asch, S. M., Adams, J., Keesey, J., Hicks, J., DeCristofaro, A., & Kerr, E. A. (2003) · New England Journal of Medicine · doi:10.1056/nejmsa022615 · Cited by 5,079
Medical error—the third leading cause of death in the US
Makary, M. A., & Daniel, M. (2016) · BMJ · doi:10.1136/bmj.i2139 · Cited by 3,264
Abductive Analysis: Theorizing Qualitative Research
Tavory, I., & Timmermans, S. (2014) · doi:10.7208/chicago/9780226180458.001.0001 · Cited by 1,726
WHAT’S MEASURED IS WHAT MATTERS: TARGETS AND GAMING IN THE ENGLISH PUBLIC HEALTH CARE SYSTEM
BEVAN, G., & HOOD, C. (2006) · Public Administration · doi:10.1111/j.1467-9299.2006.00600.x · Cited by 1,580
Research works printed but not linked: 88
- 10.1136/qhc.11.1.76 · DOI · Paper page
- 10.1136/qshc.2005.013847 · DOI
- 10.1136/bmjqs-2015-004337 · DOI
- 10.1136/bmjqs-2013-002437 · DOI · Paper page
- 10.1016/S0196-0644(87)80522-X · doi:10.1016/s0196-0644(87)80522-x
- 10.1111/j.1445-2197.2012.06240.x · doi:10.1111/j.1445-2197.2012.06240.x
- 10.1136/bmjqs-2017-007463 · doi:10.1136/bmjqs-2017-007463
- 10.1111/j.1467-9930.1994.tb00120.x · DOI
- 10.1136/qshc.3.3.123 · DOI
- 10.1111/hex.12373 · DOI
- 10.1503/cmaj.060429 · DOI
- 10.1136/bmjopen-2011-000489 · DOI
- 10.1111/j.1468-0009.2009.00574.x · doi:10.1111/j.1468-0009.2009.00574.x
- 10.1111/j.1440-172X.2012.02057.x · doi:10.1111/j.1440-172x.2012.02057.x
- 10.1111/j.1471-0528.1996.tb09635.x · doi:10.1111/j.1471-0528.1996.tb09635.x
- 10.1097/00001888-200402000-00008 · DOI
- 10.1136/bmjqs-2012-001691 · DOI
- 10.1016/j.amjmed.2005.01.060 · DOI · Paper page
- Cunningham W, 2004, The immediate and long‐term impact on New Zealand doctors who receive patient complaints, N Z Med J Online, 117
- 10.1056/NEJMp1211775 · DOI · Paper page
- 10.1136/qshc.2007.022897 · doi:10.1136/qshc.2007.022897
- 10.1016/S1553-7250(10)36059-4 · DOI
- Francis R., 2013, Report of the Mid Staffordshire NHS Foundation Trust Public Inquiry
- 10.1001/jamasurg.2016.5703 · DOI
- 10.1097/MLR.0b013e3181589ba4 · DOI
- 10.1001/jama.287.22.2951 · DOI · Paper page
- 10.1136/qshc.2006.018861 · DOI
- 10.1136/bmj.316.7138.1154 · DOI · Paper page
- 10.1136/qshc.2004.010553 · DOI
- 10.1111/j.1475-6773.2008.00918.x · DOI · Paper page
- 10.1111/j.1468-0009.2012.00674.x · DOI
- 10.1186/1472-6963-11-49 · DOI
- 10.1136/bmj.39031.507153.AE · DOI · Paper page
- 10.1136/bmj.320.7237.759 · DOI · Paper page
- 10.1111/1468-0009.12166 · DOI · Paper page
- 10.1076/1566-0974(200003)7:1;1-V;FT003 · DOI · Paper page
- 10.2307/41166166 · DOI · Paper page
- 10.1093/intqhc/mzn030 · DOI
- 10.1186/1472-6963-13-156 · DOI · Paper page
- 10.1016/j.ijnurstu.2015.02.012 · DOI · Paper page
- Davis RE, 2012, Hospital patients’ reports of medical errors and undesirable events in their health care, J Eval Clin Pract, 19, 875, 10.1111/j.1365-2753.2012.01867.x · DOI
- 10.1136/bmjqs-2015-004596 · DOI
- 10.1093/intqhc/mzw139 · DOI
- 10.1093/intqhc/mzw003 · DOI
- 10.1097/PTS.0000000000000297 · DOI
- 10.1016/j.jcjq.2017.04.008 · DOI
- 10.1002/j.0022-0337.2017.81.3.tb06277.x · doi:10.1002/j.0022-0337.2017.81.3.tb06277.x
- 10.1136/bmj.325.7372.1094 · DOI
- 10.4236/jgis.2014.61003 · doi:10.4236/jgis.2014.61003
- Gawande A, 2011, The hot spotters, New Yorker, 86, 40
- 10.1136/qshc.2007.023622 · DOI · Paper page
- 10.1016/S0003-4975(00)02592-3 · DOI · Paper page
- 10.1287/mnsc.1080.0869 · DOI · Paper page
- 10.2307/41165243 · DOI · Paper page
- 10.1017/S1481803500010484 · DOI
- 10.1136/qhc.12.1.2 · DOI
- 10.4081/jphr.2013.e27 · DOI · Paper page
- 10.1086/220526 · DOI
- 10.1177/0018726714530012 · DOI
- 10.1111/j.1467-6486.1988.tb00039.x · DOI · Paper page
- 10.1046/j.1532-5415.2003.51185.x · DOI · Paper page
- 10.1136/bmj.320.7237.791 · DOI · Paper page
- 10.1111/j.1365-2044.2007.05427.x · DOI
- 10.1016/j.ccc.2004.07.006 · DOI
- 10.1207/S15327108IJAP1002_5 · DOI
- GillespieA ReaderTW.Healthcare Complaints Analysis Tool.London United Kingdom:London School of Economics and Politics;2016.http://qualitysafety.bmj.com/content/qhc/suppl/2016/01/05/bmjqs-2015-004596.DC1/bmjqs-2015-004596supp_new.pdf. Accessed July 4 2017.
- National Patient Safety Agency, 2008, A Risk Matrix for Risk Managers
- 10.1136/qhc.12.6.411 · doi:10.1136/qhc.12.6.411
- Friendly M, 2016, Discrete Data Analysis with R: Visualization and Modeling Techniques for Categorical and Count Data
- 10.1198/106186007X237856 · DOI · Paper page
- 10.1177/146879410100100307 · DOI · Paper page
- R Core Team, 2017, R: A Language and Environment for Statistical Computing
- 10.7326/0003-4819-114-4-325 · DOI · Paper page
- 10.1046/j.1365-2648.1997.19970251233.x · DOI
- 10.1002/jhm.2054 · DOI · Paper page
- 10.1136/bmj.320.7237.768 · DOI · Paper page
- 10.1136/jech-2017-209195 · DOI
- 10.1136/qshc.2009.039743 · DOI · Paper page
- 10.1016/j.jcrc.2006.07.001 · DOI · Paper page
- Creswell JW, 2011, Designing and Conducting Mixed Methods Research
- 10.1016/j.socscimed.2015.07.027 · DOI
- Ettorchi‐Tardy A, 2012, Benchmarking: a method for continuous quality improvement in health, Healthc Policy, 7, e101
- 10.1093/intqhc/mzi087 · DOI
- 10.1097/PTS.0b013e31823cba94 · DOI
- 10.1136/bmjqs-2016-005476 · DOI
- 10.1136/bmjqs-2016-005570 · DOI
- 10.1111/jocn.12664 · DOI
- 10.1136/bmjqs-2017-006847 · DOI
Cited by
Busch, S. H., & Kyanko, K. A. (2020) · Health Affairs · doi:10.1377/hlthaff.2019.01501 · Cited by 53
Lam, B. D., Bourgeois, F., Dong, Z. J., & Bell, S. K. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa293 · Cited by 29
Bourgeois, F. C., Fossa, A., Gerard, M., Davis, M. E., Taylor, Y. J., Connor, C. D., Vaden, T., McWilliams, A., Spencer, M. D., Folcarelli, P., et al. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz142 · Cited by 25
Gaps in the coordination of care for people living with dementia
Kern, L. M., Riffin, C., Phongtankuel, V., Aucapina, J. E., Banerjee, S., Ringel, J. B., Tobin, J. N., Fisseha, S., Meiri, H., Bell, S. K., et al. (2024) · Journal of the American Geriatrics Society · doi:10.1111/jgs.19105 · Cited by 19
Metadata
- Authors
- GILLESPIE, A., & READER, T. W.
- Affiliations
- London School of Economics
- Venue
- The Milbank Quarterly
- Publisher
- Wiley
- Published
- 2018-09
- Volume
- 96
- Issue
- 3
- Pages
- 530-567
- ISSN
- 0887-378X
- 1468-0009
- Cited by
- 111
- References
- 5
- Language
- en
- Funders
- the London School of Economics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Patient-centered insights: using health care complaints to reveal hot spots and blind spots in quality and safety. https://app.cochat.ai/papers/10.1111/1468-0009.12338
- The paper
- GILLESPIE, A., & READER, T. W. (2018). Patient-centered insights: using health care complaints to reveal hot spots and blind spots in quality and safety. The Milbank Quarterly. https://doi.org/10.1111/1468-0009.12338
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.