The measurement of active errors: methodological issues.
Open accessAbstract
The value of research in any topic area turns on its validity. Patient safety research has revealed--or, at least, given renewed urgency to--a raft of methodological issues. The meaning and thus the value of empirical research in this field is contingent on getting the methodology right. The need for good methods for the measurement of error is necessary whenever an inference is intended and, since inferences lie at the heart of research and management, there is a huge need to understand better how to make measurements that are meaningful, precise, and accurate. In this paper we consider issues relating to the measurement of error and the need for more research.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Taylor, K. M. G., Nettleton, S., & Harding, G. (2010) · Taylor & Francis eBooks · doi:10.4324/9780203381175_chapter_9 · Cited by 14,635 · see citing works
On Being Sane in Insane Places
ROSENHAN, D. L. (1973) · Science · doi:10.1126/science.179.4070.250 · Cited by 2,104 · see citing works
Peabody, J. W., Luck, J., Glassman, P., Dresselhaus, T., & Lee, M. (2000) · Journal of the American Medical Association (JAMA) · doi:10.1001/jama.283.13.1715 · Cited by 1,311 · see citing works
A look into the nature and causes of human errors in the intensive care unit
Donchin, Y., Gopher, D., Olin, M., Badihi, Y., Bieski, M., Sprung, C. L., Pizov, R., & Cotev, S. (1995) · Critical Care Medicine · doi:10.1097/00003246-199502000-00015 · Cited by 838 · see citing works
Process versus outcome indicators in the assessment of quality of health care
Mant, J. (2001) · International Journal for Quality in Health Care · doi:10.1093/intqhc/13.6.475 · Cited by 607 · see citing works
Estimating Hospital Deaths Due to Medical Errors
Hayward, R. A., & Hofer, T. P. (2001) · JAMA · doi:10.1001/jama.286.4.415 · Cited by 589 · see citing works
Measuring errors and adverse events in health care
Thomas, E. J., & Petersen, L. A. (2003) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2003.20147.x · Cited by 456 · see citing works
Franklin, B. D., Barber, N., & Schachter, M. (2000) · BMJ Quality & Safety · doi:10.1136/qhc.9.4.232 · Cited by 416 · see citing works
Mant, J., & Hicks, N. (1995) · BMJ · doi:10.1136/bmj.311.7008.793 · Cited by 303 · see citing works
Quality-of-Care Assessment: Choosing a Method for Peer Review
Brook, R. H., & Appel, F. A. (1973) · New England Journal of Medicine · doi:10.1056/nejm197306212882504 · Cited by 279 · see citing works
The Reliability of Medical Record Review for Estimating Adverse Event Rates
Thomas, E. J., Lipsitz, S. R., Studdert, D. M., & Brennan, T. A. (2002) · Annals of Internal Medicine · doi:10.7326/0003-4819-136-11-200206040-00009 · Cited by 259 · see citing works
A look into the nature and causes of human errors in the intensive care unit
Donchin, Y. (2003) · BMJ Quality & Safety · doi:10.1136/qhc.12.2.143 · Cited by 244 · see citing works
Explaining variations in hospital death rates. Randomness, severity of illness, quality of care
Park, R. E. (1990) · JAMA · doi:10.1001/jama.264.4.484 · Cited by 220 · see citing works
The Reliability of Peer Assessments of Quality of Care
Goldman, R. L. (1992) · JAMA · doi:10.1001/jama.1992.03480070074034 · Cited by 209 · see citing works
An evaluation of adverse incident reporting
Stanhope, N., Crowley‐Murphy, M., Vincent, C. A., O’Connor, A. M., & Taylor‐Adams, S. E. (1999) · Journal of Evaluation in Clinical Practice · doi:10.1046/j.1365-2753.1999.00146.x · Cited by 180 · see citing works
Changes in Quality of Care for Five Diseases Measured by Implicit Review, 1981 to 1986
Rubenstein, L. V. (1990) · JAMA · doi:10.1001/jama.1990.03450150074034 · Cited by 160 · see citing works
Reliability and Validity of Judgments Concerning Adverse Events Suffered by Hospitalized Patients
Brennan, T. A., Localio, R. J., & Laird, N. M. (1989) · Medical Care · doi:10.1097/00005650-198912000-00006 · Cited by 150 · see citing works
Explaining Variations in Hospital Death Rates
Park, R. E. (1990) · JAMA · doi:10.1001/jama.1990.03450040080035 · Cited by 145 · see citing works
Hofer, T. P., Kerr, E. A., & Hayward, R. A. (2001) · PubMed · Cited by 124 · see citing works
Discussion Between Reviewers Does Not Improve Reliability of Peer Review of Hospital Quality
Hofer, T. P., Bernstein, S. J., DeMonner, S. M., & Hayward, R. A. (2000) · Medical Care · doi:10.1097/00005650-200002000-00005 · Cited by 85 · see citing works
Estimating Hospital Deaths Due to Medical Errors: Preventability Is in the Eye of the Reviewer
Diaz, J. H. (2002) · Survey of Anesthesiology · doi:10.1097/00132586-200206000-00061 · Cited by 65 · see citing works
On being sane in insane places
ROSENHAN, D. L. (1974) · Clinical Social Work Journal · doi:10.1007/bf01785781 · Cited by 54 · see citing works
Explaining Variations in Hospital Death Rates
Redelmeier, D. A. (1991) · JAMA · doi:10.1001/jama.1991.03460040034014 · Cited by 49 · see citing works
Using standardized patients to measure professional performance of physicians
Beaulieu, M. (2003) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzg037 · Cited by 45 · see citing works
The Leeds University maternity audit project
Wilson, B. L., Thornton, J., Hewison, J., Lilford, R. J., Watt, I., Braunholtz, D., & ROBINSON, M. (2002) · International Journal for Quality in Health Care · doi:10.1093/oxfordjournals.intqhc.a002609 · Cited by 40 · see citing works
Self-citationThe reliability of peer assessments of quality of care
Rl, G. (1992) · JAMA · doi:10.1001/jama.267.7.958 · Cited by 36 · see citing works
VERHO, H. (2003) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzg030 · Cited by 32 · see citing works
Changes in quality of care for five diseases measured by implicit review, 1981 to 1986
Rubenstein, L. V. (1990) · JAMA · doi:10.1001/jama.264.15.1974 · Cited by 32 · see citing works
Hospital Medication Administration Errors: Their simulation, observation and severity assessment
Bs, D. (1999) · Doctoral thesis, University of London. · Cited by 16 · see citing works
A continuous quality improvement approach to medication administration
Bechtel, G. A., Vertrees, J. L., & Swartzberg, B. B. (1993) · Journal of Nursing Care Quality · doi:10.1097/00001786-199304000-00010 · Cited by 12 · see citing works
Identifying Poor-Quality Hospitals with Mortality Rates
Ash, A. S. (1996) · Medical Care · doi:10.1097/00005650-199608000-00001 · Cited by 9 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- Dubois R, Rogers WH, Moxley J, et al. Hospital inpatient mortality: is it a product of quality? N Engl J Med 1987;317:674-80.
- Michel P, Quenon JL, Sarasqueta AM, et al. L'estimation du risque ´iatrogene graves dans les establissements de sante ´en France: les enseignements d'une e ´tude pilote dans la region Aquitaine. Etudes et Resultats 2003;219:1-8.
- Gigone D, Hastie R. The common knowledge effect: information sharing and group judgement. J Personality Soc Psychol 1993;65:959-74.
- ii12 Lilford, Mohammed, Braunholtz, et al www.qshc.com on July 14, 2023 by guest. Protected by copyright. http://qualitysafety.bmj.com/ Qual Saf Health Care: first published as 10.1136/qhc.12.suppl_2.ii8 on 26 November 2003. Downloaded from · DOI
Cited by
Sorted by citations
The incidence and nature of in-hospital adverse events: a systematic review
de Vries, E. N., Ramrattan, M. A., Smorenburg, S. M., Gouma, D. J., & Boermeester, M. A. (2008) · BMJ Quality & Safety · doi:10.1136/qshc.2007.023622 · Cited by 1,787 · see citing works
Zegers, M., de Bruijne, M. C., Wagner, C., Hoonhout, L. H. F., Waaijman, R., Smits, M., Hout, F. A. G., Zwaan, L., Christiaans-Dingelhoff, I., Timmermans, D. R. M., et al. (2009) · BMJ Quality & Safety · doi:10.1136/qshc.2007.025924 · Cited by 473 · see citing works
Shapiro, M. J. (2004) · BMJ Quality & Safety · doi:10.1136/qshc.2003.005447 · Cited by 465 · see citing works
Lilford, R., Mohammed, M. A., Spiegelhalter, D., & Thomson, R. (2004) · The Lancet · doi:10.1016/s0140-6736(04)15901-1 · Cited by 448 · see citing works
Self-citationCreating High Reliability in Health Care Organizations
Pronovost, P. J., Berenholtz, S. M., Goeschel, C. A., Needham, D. M., Sexton, J. B., Thompson, D. A., Lubomski, L. H., Marsteller, J. A., Makary, M. A., & Hunt, E. A. (2006) · Health Services Research · doi:10.1111/j.1475-6773.2006.00567.x · Cited by 410 · see citing works
Use of process measures to monitor the quality of clinical practice
Lilford, R. J., Brown, C., & Nicholl, J. P. (2007) · BMJ · doi:10.1136/bmj.39317.641296.ad · Cited by 269 · see citing works
Self-citationImproving patient safety by identifying latent failures in successful operations
Catchpole, K. C., Giddings, A. E. B., Wilkinson, M., Hirst, G., Dale, T., & de Leval, M. R. (2007) · Surgery · doi:10.1016/j.surg.2007.01.033 · Cited by 269 · see citing works
Debriefing Medical Teams: 12 Evidence-Based Best Practices and Tips
Eduardo Salas, A., Klein, C. R., King, H. B., Salisbury, M. L., Augenstein, J. S., Birnbach, D. J., Robinson, D. W., & Upshaw, C. (2008) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(08)34066-5 · Cited by 252 · see citing works
Zegers, M., de Bruijne, M. C., de Keizer, B., Merten, H., Groenewegen, P., van der Wal, G., & Wagner, C. (2011) · Patient Safety in Surgery · doi:10.1186/1754-9493-5-13 · Cited by 207 · see citing works
Identification of systems failures in successful paediatric cardiac surgery
Catchpole, K. C., Giddings, A. E. B., de Leval, M. R., Peek, G. J., Godden, P., Utley, M., Gallivan, S., Hirst, G., & Dale, T. (2006) · Ergonomics · doi:10.1080/00140130600568865 · Cited by 183 · see citing works
Greenwald, J. L., Denham, C. R., & Jack, B. W. (2007) · Journal of Patient Safety · doi:10.1097/01.jps.0000236916.94696.12 · Cited by 163 · see citing works
French national survey of inpatient adverse events prospectively assessed with ward staff
Michel, P., Quenon, J. L., Djihoud, A., Tricaud-Vialle, S., & de Sarasqueta, A.-M. (2007) · BMJ Quality & Safety · doi:10.1136/qshc.2005.016964 · Cited by 155 · see citing works
Lilford, R. J., Chilton, P. J., Hemming, K., Girling, A. J., Taylor, C. A., & Barach, P. (2010) · BMJ · doi:10.1136/bmj.c4413 · Cited by 146 · see citing works
Self-citationDirect medical costs of adverse events in Dutch hospitals
Hoonhout, L. H. F., de Bruijne, M. C., Wagner, C., Zegers, M., Waaijman, R., Spreeuwenberg, P. M. M., Asscheman, H., van der Wal, G., & van Tulder, M. W. (2009) · BMC Health Services Research · doi:10.1186/1472-6963-9-27 · Cited by 136 · see citing works
Pitches, D. W., Mohammed, M. A., & Lilford, R. J. (2007) · BMC Health Services Research · doi:10.1186/1472-6963-7-91 · Cited by 133 · see citing works
Self-citationQuality of patient record keeping: an indicator of the quality of care?
Zegers, M., de Bruijne, M. C., Spreeuwenberg, P. M. M., Wagner, C., Groenewegen, P., & van der Wal, G. (2011) · BMJ Quality & Safety · doi:10.1136/bmjqs.2009.038976 · Cited by 129 · see citing works
Vlayen, A., Verelst, S., Bekkering, G. E., Schrooten, W., Hellings, J., & Claes, N. (2011) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2010.01612.x · Cited by 117 · see citing works
Impact of adverse events on outcomes in intensive care unit patients*
Garrouste-Orgeas, M., Timsit, J., Soufir, L., Tafflet, M., Adrie, C., Philippart, F., Zahar, J., Clec’h, C., Goldgran-Tolédano, D., Jamali, S., et al. (2008) · Critical Care Medicine · doi:10.1097/ccm.0b013e31817b879c · Cited by 103 · see citing works
Hanskamp‐Sebregts, M., Zegers, M., Vincent, C. A., van Gurp, P. J. M., de Vet, H. C. W., & Wollersheim, H. C. H. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-011078 · Cited by 103 · see citing works
Brown, C., Hofer, T., Johal, A., Thomson, R., Nicholl, J., Franklin, B. D., & Lilford, R. J. (2008) · Quality and Safety in Health Care · doi:10.1136/qshc.2007.023655 · Cited by 100 · see citing works
Self-citationThe incidence of adverse events among home care patients
Sears, N. A., Baker, G. R., Barnsley, J., & Shortt, S. E. D. (2013) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzs075 · Cited by 97 · see citing works
Active surveillance using electronic triggers to detect adverse events in hospitalized patients
Szekendi, M. K. (2006) · BMJ Quality & Safety · doi:10.1136/qshc.2005.014589 · Cited by 96 · see citing works
Haller, G., Myles, P. S., Wolfe, R. S., Weeks, A. M., Stoelwinder, J. U., & McNeil, J. J. (2005) · Anesthesiology · doi:10.1097/00000542-200512000-00004 · Cited by 92 · see citing works
Zegers, M., de Bruijne, M. C., Wagner, C., Groenewegen, P., van der Wal, G., & de Vet, H. C. W. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.03.004 · Cited by 87 · see citing works
Lyubovnikova, J., West, M. A., Dawson, J., & Carter, M. R. (2014) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2014.992421 · Cited by 88 · see citing works
Evaluating eHealth: How to Make Evaluation More Methodologically Robust
Lilford, R. J., Foster, J., & Pringle, M. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000186 · Cited by 79 · see citing works
Self-citationVeterans Affairs intensive care unit risk adjustment model: Validation, updating, recalibration*
Render, M. L., Deddens, J. A., Freyberg, R. W., Almenoff, P. L., Connors, A. F., Wagner, D. P., & Hofer, T. P. (2008) · Critical Care Medicine · doi:10.1097/ccm.0b013e318169f290 · Cited by 76 · see citing works
Gaal, S., Verstappen, W. H. J. M., Wolters, R. J., Lankveld, H., van Weel, C., & Wensing, M. (2011) · Implementation Science · doi:10.1186/1748-5908-6-37 · Cited by 70 · see citing works
Gates, P., Baysari, M. T., Mumford, V., Raban, M. Z., & Westbrook, J. I. (2019) · Drug Safety · doi:10.1007/s40264-019-00823-4 · Cited by 69 · see citing works
Klopotowska, J. E., Wierenga, P. C., Stuijt, C. C. M., Arisz, L., Dijkgraaf, M. G. W., Kuks, P. F. M., Asscheman, H., de Rooij, S. E., Lie‐A‐Huen, L., Smorenburg, S. M., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0071045 · Cited by 68 · see citing works
A Web-based Tool for the Comprehensive Unit-based Safety Program (CUSP)
Pronovost, P. J., King, J., Holzmueller, C. G., Sawyer, M. D., Bivens, S., Michael, M., Haig, K., Paine, L. A., Moore, D., & Miller, M. R. (2006) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(06)32017-x · Cited by 53 · see citing works
Team Play in Surgical Education: A Simulation-Based Study
Marr, M. C., Hemmert, K. C., Nguyen, A. H., Combs, R., Annamalai, A., Miller, G., Pachter, H. L., Turner, J. W., Rifkind, K., & Cohen, S. M. (2011) · Journal of surgical education · doi:10.1016/j.jsurg.2011.07.002 · Cited by 44 · see citing works
West, J. (2005) · BMJ Quality & Safety · doi:10.1136/qshc.2004.011478 · Cited by 44 · see citing works
A prospective study of patient safety incidents in gastrointestinal endoscopy
Matharoo, M. K., Haycock, A., Sevdalis, N., & Thomas‐Gibson, S. (2016) · Endoscopy International Open · doi:10.1055/s-0042-117219 · Cited by 37 · see citing works
Simulation‐based Education to Ensure Provider Competency Within the Health Care System
Griswold, S., Fralliccardi, A., Boulet, J. R., Moadel, T., Franzen, D., Auerbach, M. A., Hart, D. E., Goswami, V., Hui, J., & Gordon, J. A. (2017) · Academic Emergency Medicine · doi:10.1111/acem.13322 · Cited by 38 · see citing works
Berenholtz, S. M., & Pronovost, P. J. (2007) · Critical Care Clinics · doi:10.1016/j.ccc.2007.05.003 · Cited by 35 · see citing works
Patient safety in Dutch primary care: a study protocol
Harmsen, M., Gaal, S., van Dulmen, S., de Feijter, E., Giesen, P. H. J., Jacobs, A., Martijn, L., Mettes, T. G., Verstappen, W. H. J. M., der Sanden, M. W. G. N., et al. (2010) · Implementation Science · doi:10.1186/1748-5908-5-50 · Cited by 31 · see citing works
Andrés, J. M. A., Ramírez, R. L., Remón, C. A., de Castro, M. T. G. V., Bolúmar, F., Hernández‐Aguado, I., López‐Fresneña, N., Pérez, C. D.-A., García, E. T., Michel, P., et al. (2017) · BMJ Open · doi:10.1136/bmjopen-2017-016546 · Cited by 26 · see citing works
Gaal, S., Hartman, C., Giesen, P. H. J., van Weel, C., Verstappen, W. H. J. M., & Wensing, M. (2011) · The Annals of Family Medicine · doi:10.1370/afm.1308 · Cited by 24 · see citing works
Quality and safety of care provided by emergency care practitioners
O’Hara, R., O'Keeffe, C. A., Mason, S. M., Coster, J. E., & Hutchinson, A. (2011) · Emergency Medicine Journal · doi:10.1136/emj.2010.104190 · Cited by 24 · see citing works
Quality and Safety on an Acute Surgical Ward
Kreckler, S. M., Catchpole, K. C., New, S., Handa, A. I., & McCulloch, P. G. (2009) · Annals of Surgery · doi:10.1097/sla.0b013e3181bd54c2 · Cited by 21 · see citing works
Reliability of indicators of nursing care quality: testing interexaminer agreement and reliability
Vituri, D. W., & Évora, Y. D. M. (2014) · Revista Latino-Americana de Enfermagem · doi:10.1590/0104-1169.3262.2407 · Cited by 21 · see citing works
Medical Care Safety - Problems and Perspectives
Voskanyan, Y., Shikina, I., Kidalov, F., & Davidov, D. (2020) · Lecture Notes in Networks and Systems · doi:10.1007/978-3-030-22493-6_26 · Cited by 20 · see citing works
Freeth, D., Sandall, J., Allan, T. F., Warburton, F. G., Berridge, E., Mackintosh, N. J., Rogers, M., & Abbott, S. (2012) · Health Technology Assessment · doi:10.3310/hta16250 · Cited by 20 · see citing works
Identifying and Reducing Errors in the Operating Theatre
Catchpole, K., & de Leval, P. M. (2004) · Journal of Blindness Innovation and Research · doi:10.1201/9780203494172.ch63 · Cited by 20 · see citing works
van Oldenrijk, J., Schafroth, M. U., Bhandari, M., Runne, W. C., & Poolman, R. W. (2008) · BMC Musculoskeletal Disorders · doi:10.1186/1471-2474-9-93 · Cited by 19 · see citing works
How safe is my intensive care unit? Methods for monitoring and measurement
Berenholtz, S. M., Pustavoitau, A., Schwartz, S. J., & Pronovost, P. J. (2007) · Current Opinion in Critical Care · doi:10.1097/mcc.0b013e3282f1bb44 · Cited by 19 · see citing works
The surgical admissions proforma: Does it make a difference?
Ehsanullah, J., Ahmad, U. N., Solanki, K., Healy, J., & Kadoglou, N. (2015) · Annals of Medicine and Surgery · doi:10.1016/j.amsu.2015.01.004 · Cited by 19 · see citing works
Sears, N. A., Blais, R., Spinks, M., Paré, M., & Baker, G. R. (2017) · BMC Health Services Research · doi:10.1186/s12913-017-2351-8 · Cited by 17 · see citing works
Elaboration, validation and reliability of the safety protocol for pediatric thirst management
Pierotti, I., do Nascimento, L. A., Rossetto, E. G., Furuya, R. K., & Fonseca, L. F. (2020) · Revista Latino-Americana de Enfermagem · doi:10.1590/1518-8345.3333.3321 · Cited by 16 · see citing works
Patient safety in midwifery-led care in the Netherlands
Martijn, L., Jacobs, A., Maassen, I., Buitendijk, S. E., & Wensing, M. (2011) · Midwifery · doi:10.1016/j.midw.2011.10.013 · Cited by 16 · see citing works
Risk management in the healthcare safety management system
Voskanyan, Y., Shikina, I. B., Kidalov, F., Рудольфович, Д. Д., & Abrosimova, T. (2021) · Journal of Digital Science · doi:10.33847/2686-8296.3.1_4 · Cited by 15 · see citing works
Smith, P. F. (2017) · PubMed Central · Cited by 14 · see citing works
Golfieri, R., Pescarini, L., Fileni, A., Silverio, R., Saccavini, C., Visconti, D., Morana, G., & Centonze, M. (2010) · La radiologia medica · doi:10.1007/s11547-010-0578-0 · Cited by 13 · see citing works
Kayden, S. R., Anderson, P. D., Freitas, R., & Platz, E. (2014) · Cambridge University Press eBooks · doi:10.1017/cbo9781139030557.008 · Cited by 13 · see citing works
Board Quality Scorecards: Measuring Improvement
Goeschel, C. A., Berenholtz, S. M., Culbertson, R., Jin, L. X., & Pronovost, P. J. (2011) · American Journal of Medical Quality · doi:10.1177/1062860610389324 · Cited by 13 · see citing works
Zegers, M., Hanskamp‐Sebregts, M., Wollersheim, H. C. H., & Vincent, C. A. (2020) · Wiley eBooks · doi:10.1002/9781119488620.ch16 · Cited by 11 · see citing works
Scarpis, E., Cautero, P., Tullio, A., Mellace, F., Farneti, F., Londero, C., Cocconi, R., & Brunelli, L. (2023) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzad094 · Cited by 9 · see citing works
Bion, J., Aldridge, C., Girling, A. J., Rudge, G. M., Beet, C., Evans, T., Temple, R. M., Roseveare, C., Clancy, M., Boyal, A., et al. (2017) · BMJ Open · doi:10.1136/bmjopen-2017-018747 · Cited by 9 · see citing works
Self-citationMultifactorial model of adverse events and medical safety management
Voskanyan, Y., Shikina, I. B., Andreeva, O., Kidalov, F., & Рудольфович, Д. Д. (2020) · Journal of Digital Science · doi:10.33847/2686-8296.2.1_3 · Cited by 9 · see citing works
How to assure the quality of clinical records? A 7-year experience in a large academic hospital
Scarpis, E., Brunelli, L., Tricarico, P., Poletto, M., Panzera, A., Londero, C., Castriotta, L., & Brusaferro, S. (2021) · PLoS ONE · doi:10.1371/journal.pone.0261018 · Cited by 9 · see citing works
Retrospective medical record evaluation
Verelst, S., Jacques, J., den Heede, K. V., Gillet, P., Kolh, P. H., Vleugels, A., & Sermeus, W. (2012) · International Journal of Health Care Quality Assurance · doi:10.1108/09526861211270613 · Cited by 8 · see citing works
Five years after To Err Is Human
Pronovost, P. J., Sexton, B. J., & Thompson, D. (2005) · Journal of Critical Care · doi:10.1016/j.jcrc.2004.12.001 · Cited by 8 · see citing works
Health status assessment using reverse supply chain data
Antai, I., & Mutshinda, C. M. (2010) · Management Research Review · doi:10.1108/01409171011015801 · Cited by 7 · see citing works
Detection of Adverse Events in Administrative Data
Gillet, P., Kolh, P. H., Sermeus, W., Vleugels, A., Jacques, J., den Heede, K. V., Devriese, S., Vrijens, F., & Verelst, S. (2008) · Cited by 7 · see citing works
Paramedic Myocardial Infarction Care with Fibrinolytics: a Process Map and Hazard Analysis
Jensen, J. L., Walker, M., Denike, D., Matthews, V., Boudreau, C., Hill, W., & Travers, A. H. (2013) · Prehospital Emergency Care · doi:10.3109/10903127.2013.804136 · Cited by 6 · see citing works
Lektip, C., Lapmanee, S., Petsirasan, R., Chaipinyo, K., Lektip, S., & Nawarat, J. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19095187 · Cited by 4 · see citing works
Wrong Site Surgery: A Critical Incident Analysis of a near Miss
Tichanow, S. (2016) · Journal of Perioperative Practice · doi:10.1177/1750458916026001-202 · Cited by 4 · see citing works
Hannan, E., Ahmad, A., O’Brien, A., Ramjit, S., Mansoor, S., & Toomey, D. P. (2021) · Irish Journal of Medical Science (1971 -) · doi:10.1007/s11845-020-02475-1 · Cited by 4 · see citing works
The English Patient Safety Research Programme: A Commissioner's Tale
Lilford, R. J. (2010) · Journal of Health Services Research & Policy · doi:10.1258/jhsrp.2009.009088 · Cited by 4 · see citing works
Self-citationAssessment of Modern Health Care Opportunities in Management of Medical Care Safety
Voskanyan, Y., Shikina, I. B., Kidalov, F., & Рудольфович, Д. Д. (2019) · Acta Scientific Medical Sciences · doi:10.31080/asms.2019.03.0438 · Cited by 3 · see citing works
Wittayapun, Y., Nawarat, J., Lapmanee, S., Mackenzie, L. A., & Lektip, C. (2023) · F1000Research · doi:10.12688/f1000research.126690.3 · Cited by 3 · see citing works
Commentary on Sharek: Adverse Events and Errors-Important to Differentiate and Difficult to Measure
Hofer, T. P. (2011) · Health Services Research · doi:10.1111/j.1475-6773.2010.01231.x · Cited by 3 · see citing works
Unbeck, M. (2012) · Figshare · Cited by 3 · see citing works
Can the Heinrich ratio be used to predict harm from medication errors
Taxis, K., Gallivan, S., Barber, N., & Franklin, B. D. (2006) · UCL Discovery (University College London) · Cited by 3 · see citing works
Wittayapun, Y., Nawarat, J., Lapmanee, S., Mackenzie, L. A., & Lektip, C. (2023) · F1000Research · doi:10.12688/f1000research.126690.4 · Cited by 2 · see citing works
Shah, J. N., Maharjan, S., & Shah, S. (2017) · Journal of Nepal Health Research Council · doi:10.3126/jnhrc.v15i2.18159 · Cited by 1 · see citing works
Sathia, A., & Ghadge, V. (2025) · Cureus · doi:10.7759/cureus.94052 · Cited by 1 · see citing works
Measuring and Improving Safety
Winters, B. D., Pronovost, P. J., Miller, M. R., & Hunt, E. A. (2010) · Springer eBooks · doi:10.1007/978-0-387-92853-1_3 · Cited by 1 · see citing works
Tuchtklachten tegen huisartsen
Gaal, S., Verstappen, W. H. J. M., Giesen, P. H. J., Wensing, M., & van Weel, C. (2012) · Huisarts en Wetenschap · doi:10.1007/s12445-012-0121-8 · Cited by 1 · see citing works
Measuring and Improving Safety
Pronovost, P. J., Miller, M. R., Winters, B. D., & Hunt, E. A. (2006) · Springer eBooks · doi:10.1007/0-387-27921-0_1 · Cited by 1 · see citing works
Value of an orthopaedic admission proforma
Akasha, M., Boughton, O. R., & Cleary, M. S. (2024) · BMJ Open Quality · doi:10.1136/bmjoq-2022-002159 · Cited by 1 · see citing works
Patient safety and risk prevention
Zegers, M., Wollersheim, H. C. H., Wensing, M., Vincent, C. A., & Grol, R. P. T. M. (2013) · Wiley eBooks · doi:10.1002/9781118525975.ch16 · Cited by 1 · see citing works
Sécurité, vigilance, traçabilité
Fialon, P., Puntous, M., Roger, I., Guérot, E., Tourtier, Y., Labrousse, J., Biour, M., Soufir, L., Garrouste-Orgeas, M., Vesin, A., et al. (2009)
Pronovost, P. J., Holzmueller, C. G., Sawyer, M. D., Bivens, S., Michael, M., Haig, K., Paine, L. A., Moore, D., & Miller, M. R. (2006)
5 De epidemiologie van medische fouten, medische: weten we wel wat we meten?
Giard, R. W. M. (2006) · Bohn Stafleu van Loghum eBooks · doi:10.1007/978-90-368-1100-2_5
An Exploratory Cohort Study of Process and Outcome
Kreckler, S. M., Catchpole, K. C., New, S., Handa, A. I., & McCulloch, P. G. (2009)
A study of adverse events in Chinese hospitals
Chen, N. (2017) · Figshare · doi:10.4225/03/58ae66974cda0
Modern principles of management of patient safety (systematic review)
Voskanyan, Y. (2018) · Sechenov Medical Journal · doi:10.47093/2218-7332_2018.3.17-24
Winters, B. D., Pronovost, P. J., Miller, M. R., & Hunt, E. A. (2017) · Springer eBooks · doi:10.1007/978-3-319-39391-9_4
Flaws in Operator Reasoning and Decision Making Underlying Medical Error and Harm
(2010) · Productivity Press eBooks · doi:10.1201/9781439836958-c6
Wittayapun, Y., Nawarat, J., Lapmanee, S., Mackenzie, L. A., & Lektip, C. (2023) · F1000Research · doi:10.12688/f1000research.126690.1
Wittayapun, Y., Nawarat, J., Lapmanee, S., Mackenzie, L. A., & Lektip, C. (2023) · F1000Research · doi:10.12688/f1000research.126690.2
Mansouri, A., Moazzeni, K., Valeh, M., Heidari, K., & Hadjibabaie, M. (2024) · PLoS ONE · doi:10.1371/journal.pone.0307753
- Authors
- Lilford, R. J.
- Affiliations
- University of Birmingham (GB)
- Corresponding author
- Lilford, R J
- ORCID
- Lilford, R J
- Venue
- Quality and Safety in Health Care
- Publisher
- BMJ
- Published
- 2003-12-01
- Volume
- 12
- Issue
- 90002
- Pages
- 8ii-12
- ISSN
- 1475-3898 (ISSN-L)
- 1475-3901
- PMC
- PMC1765778
- OpenAlex
- W2038071321
- Cited by
- 101
- References
- 31
- Citations by year
- 2025: 1 · 2024: 2 · 2023: 5 · 2022: 1 · 2021: 3 · 2020: 3 · 2019: 6 · 2018: 1 · 2017: 8 · 2016: 3 · 2015: 1 · 2014: 4 · 2013: 5 · 2012: 4
- FWCI
- 7.53
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- BMJ Quality & Safety (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion)
- Topics
- Health Sciences › Health Professions › Emergency Medical Services › Patient Safety and Medication Errors
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Health Sciences › Health Professions › Health Information Management › Healthcare Quality and Management
- Keywords
- patient safety, error measurement, measurement validity, methodological issues, patient safety research
- MeSH terms
- United Kingdom, Health Services Research, Humans, Outcome and Process Assessment, Health Care, Sensitivity and Specificity, Medical Errors, Empirical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
