The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Effectiveness of routine reporting to identify minor and serious adverse outcomes in surgical patients
Open accessAbstract
OBJECTIVE: To assess the effectiveness of routine reporting to identify surgical adverse outcomes in comparison with retrospective medical record review. DESIGN: Independent assessment of two methods applied to one sample. Surgeons and surgical residents routinely reported all adverse outcomes for patients in their care during admission. A trained research assistant, blinded to the surgeons' reporting data, retrospectively reviewed the medical records of selected patients and registered all adverse outcomes identified from paper or electronic patient records. SETTING: Dutch university hospital. STUDY SAMPLE: A 5% sample of patients (N = 150) discharged in 2002 was taken; oversampling of patients undergoing reoperations, sick patients (ASA >or=3), and those undergoing technically complex surgery was done to increase the yield of adverse outcomes. MAIN OUTCOME MEASURES: The number of adverse outcomes identified by each method was compared with the total number identified by either method. This was done both for all adverse outcomes and for serious adverse outcomes. RESULTS: Routine reporting identified fewer adverse outcomes than medical record review (62.5% v 78.2%). Complete agreement was achieved in only 40.7% of adverse outcomes. Routine reporting identified slightly more serious adverse outcomes (84.8% v 79.5% of the total), but this difference was not statistically significant. Extrapolating these results to the total number of admissions in 2002, routine reporting underestimated the annual adverse outcome incidence by 1.8% (increasing from 14.5% to 16.3%) and the incidence of serious adverse outcomes by 0.3% (increasing from 6.9% to 7.2%). CONCLUSIONS: Neither method identified all adverse outcomes. Routine reporting underestimated the incidence of minor events but was as accurate as record review in identifying serious adverse outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prior work has shown that self-reported errors are corroborated in the medical record >80% of the time35 and produce similar or lower estimates of medical error compared with retrospective chart review.36 37”
From National improvements in resident physician-reported patient safety after limiting first-year resident physicians’ extended duration work shifts: a pooled analysis of prospective cohort studies (2023) · cites this paper as [37]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Brennan, T. A., Leape, L. L., Laird, N. M., Hebert, L., Localio, A. R., Lawthers, A. G., Newhouse, J. P., Weiler, P. C., & Hiatt, H. H. (1991) · New England Journal of Medicine · doi:10.1056/nejm199102073240604 · Cited by 4,627
American Society of Anesthesiologists
Marx, G. F. (1982) · Obstetric Anesthesia Digest · doi:10.1097/00132582-198203000-00028 · Cited by 1,899
New classification of physical status
Dripps, R. B. (1963) · Anesthesiology · Cited by 1,676
The incidence and nature of surgical adverse events in Colorado and Utah in 1992
Gawande, A. A., Thomas, E. J., Zinner, M. J., & Brennan, T. A. (1999) · Surgery · doi:10.1067/msy.1999.98664 · Cited by 977
Brennan, T. A. (2004) · Quality and Safety in Health Care · doi:10.1136/qshc.2002.003822 · Cited by 942
American Society of Anesthesiologists
National Cancer Institute (2020) · Definitions · doi:10.32388/s4rn7s · Cited by 705
Estimating Hospital Deaths Due to Medical Errors: Preventability Is in the Eye of the Reviewer
Hayward, R. A., & Hofer, T. P. (2001) · JAMA · doi:10.1001/jama.286.4.415 · Cited by 584
Adverse events in surgical patients in Australia
KABLE, A. K., GIBBERD, R. W., & SPIGELMAN, A. D. (2002) · International Journal for Quality in Health Care · doi:10.1093/intqhc/14.4.269 · Cited by 450
Michel, P., Quenon, J. L., de Sarasqueta, A. M., & Scemama, O. (2004) · BMJ · doi:10.1136/bmj.328.7433.199 · Cited by 372
Physician Reporting Compared with Medical-Record Review to Identify Adverse Medical Events
O'Neil, A. C., Petersen, L. A., Cook, E. F., Bates, D. W., Lee, T. H., & Brennan, T. A. (1993) · Annals of Internal Medicine · doi:10.7326/0003-4819-119-5-199309010-00004 · Cited by 315
Research works printed but not linked: 1
- [8]8. Kievit J, Jeekel J, Sanders FBM. Adverse outcome registration and quality improvement (in Dutch). Med Contact 1999;54:1363-5.
Cited by
Effect of a comprehensive surgical safety system on patient outcomes
de Vries, E. N., Prins, H. A., Crolla, R. M. P. H., den Outer, A. J., van Andel, G., van Helden, S. H., Schlack, W. S., van Putten, M. A., Gouma, D. J., Dijkgraaf, M. G. W., et al. (2010) · New England Journal of Medicine · doi:10.1056/nejmsa0911535 · Cited by 998
Stavropoulou, C., Doherty, C., & Tosey, P. (2015) · Milbank Quarterly · doi:10.1111/1468-0009.12166 · Cited by 239
Prevention of Surgical Malpractice Claims by Use of a Surgical Safety Checklist
de Vries, E. N., Eikens-Jansen, M. P., Hamersma, A. M., Smorenburg, S. M., Gouma, D. J., & Boermeester, M. A. (2011) · Annals of Surgery · doi:10.1097/sla.0b013e3182068880 · Cited by 111
Rebasa, P., Mora, L., Luna, A., Montmany, S., Vallverdú, H., & Navarro, S. (2008) · World Journal of Surgery · doi:10.1007/s00268-008-9848-6 · Cited by 50
“[18], which concluded that prospective recording of AE provides no benefit.”
BackgroundFunctional status as a prognostic factor for primary revascularization for critical limb ischemia
Flu, H. C., Lardenoye, J.-W. H. P., Veen, E. J., Henegouwen, D. P. V. B., & Hamming, J. F. (2010) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2009.08.051 · Cited by 44
Perioperative Workflow: Barriers to Efficiency, Risks, and Satisfaction
Fowler, P. H., Craig, J. B., Fredendall, L. D., & Damali, U. (2008) · AORN Journal · doi:10.1016/j.aorn.2007.07.001 · Cited by 40
Weaver, M. D., Landrigan, C. P., Sullivan, J. P., O'Brien, C. S., Qadri, S., Viyaran, N., Czeisler, C. A., & Barger, L. K. (2023) · BMJ Quality & Safety · doi:10.1136/bmjqs-2021-014375 · Cited by 35
de Vos, M. S., Hamming, J. F., Chua-Hendriks, J. J. C., & de Mheen, P. J. M. (2018) · BMJ Quality & Safety · doi:10.1136/bmjqs-2017-007457 · Cited by 31
“18 Moreover, incident, AE and complaint rates closely resembled those in other studies.”
The importance of experienced adverse outcomes on patients' future choice of a hospital for surgery
de Mheen, P. J. M., Dijs-Elsinga, J., Otten, W., Versluijs, M. M., Smeets, H. J., van der Made, W. J., Vree, R., & Kievit, J. (2010) · BMJ Quality & Safety · doi:10.1136/qshc.2008.031690 · Cited by 30
“In addition, in-hospital minor adverse outcomes may be missed if busy doctors forget to report them.”
Current Factors of Fragility and Delirium in Vascular Surgery
Raats, J. W., Lepper, C. C. H. A. V. H.-D., Feitsma, M. T., Meij, H. J., Ho, G. H., Mulder, P. G. H., & van der Laan, L. (2015) · Annals of Vascular Surgery · doi:10.1016/j.avsg.2015.01.005 · Cited by 27
Meningioma surgery in younger and older adults: patient profile and surgical outcomes
Slot, K.-A. M., Peters, J. V. M., Vandertop, W. P., Verbaan, D., & Peerdeman, S. M. (2017) · European Geriatric Medicine · doi:10.1007/s41999-017-0015-1 · Cited by 25
“Complications were defined as ‘‘unintended and unwanted events or conditions during, or within, 30 days following medical treatment, so harmful for the patient’s health that adjustment of medical treatment is needed, or that irreversible damage occurs’’ [23].”
BackgroundOutcome of elective treatment of abdominal aortic aneurysm in elderly patients
de Leur, K., Flu, H. C., Ho, G. H., de Groot, H. G. W., Veen, E. J., & van der Laan, L. (2015) · International Journal of Surgery · doi:10.1016/j.ijsu.2015.02.001 · Cited by 23
Long-term outcome of ruptured abdominal aortic aneurysm: impact of treatment and age
Raats, J. W., Flu, H. C., Ho, G. H., Veen, E. J., Vos, D., van der Laan, L., & Steyerberg, E. W. (2014) · Clinical Interventions in Aging · doi:10.2147/cia.s64718 · Cited by 23
Complications in Multitrauma Patients in a Dutch Level 1 Trauma Center
Saltzherr, T. P., Visser, A., Ponsen, K. J., Luitse, J. S. K., & Goslings, J. C. (2010) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/ta.0b013e3181cb85bb · Cited by 22
Adverse outcomes after discharge: occurrence, treatment and determinants
de Mheen, P. J. M., van Duijn‐Bakker, N., & Kievit, J. (2008) · BMJ Quality & Safety · doi:10.1136/qshc.2007.023309 · Cited by 21
“It was also shown that only 10% of these were captured by our routine reporting system, although it was higher for adverse outcomes requiring readmission (still only 25%), which has been shown to be effective in identifying in-hospital adverse outcomes.(12) Of the postdischarge adverse outcomes missed in the routine r…”
BackgroundInfluentialGrant, C. M., Ludbrook, G., Hampson, E. A., Semenov, R. A., & Willis, R. (2008) · Anaesthesia and Intensive Care · doi:10.1177/0310057x0803600213 · Cited by 21
Patient and procedure-related risk factors for adverse events after infrainguinal bypass
Flu, H. C., Ploeg, A. J., de Mheen, P. J. M., Veen, E. J., Lange, C. P. E., Breslau, P. J., Roukema, J. A., Hamming, J. F., & Lardenoye, J.-W. H. P. (2010) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2009.09.055 · Cited by 20
“Risk factors of AEs.”
InfluentialRegistration of surgical adverse outcomes: a reliability study in a university hospital
Ubbink, D. T., Visser, A., Gouma, D. J., & Goslings, J. C. (2012) · BMJ Open · doi:10.1136/bmjopen-2012-000891 · Cited by 20
“0 100% (11) 73% (8) 9% (1) 18% (2) 55% (6) 64% (7)”
de Vos, M. S., Hamming, J. F., & de Mheen, P. J. M. (2017) · Journal of Patient Safety · doi:10.1097/pts.0000000000000440 · Cited by 20
“The process for routine adverse event reporting, implemented in 1997, has been described in previous publications, including its effectiveness being similar to record review.(17,19) Surgeons reported all AEs prospectively during admission or at patient discharge, and assigned severity levels reflecting consequences fo…”
MethodFlu, H. C., Lardenoye, J.-W. H. P., Veen, E. J., Aquarius, A. E., Henegouwen, D. P. V. B., & Hamming, J. F. (2009) · Annals of Vascular Surgery · doi:10.1016/j.avsg.2009.06.012 · Cited by 19
“37 This definition did not change during the study period.”
BackgroundMethodde Mheen, P. J. M., van Duijn‐Bakker, N., & Kievit, J. (2007) · Postgraduate Medical Journal · doi:10.1136/qshc.2006.021071 · Cited by 19
de Vos, M. D., Hamming, J., Boosman, H., & de Mheen, P. J. M.-V. (2019) · Journal of patient safety · doi:10.1097/pts.0000000000000581 · Cited by 12
Measuring safety of healthcare: an exercise in futility?
Sauro, K. M., Ghali, W. A., & Stelfox, H. T. (2019) · BMJ Quality & Safety · doi:10.1136/bmjqs-2019-009824 · Cited by 15
van Schie, P., van Bodegom‐Vos, L., Zijdeman, T. M., Nelissen, R. G. H. H., & de Mheen, P. J. M. (2022) · BMJ Quality & Safety · doi:10.1136/bmjqs-2021-014472 · Cited by 15
Adverse events in total knee arthroplasty: Results of a physician independent survey in 260 patients
Kirschner, S., Lützner, J., Günther, K., Eberlein-Gonska, M., & Krummenauer, F. (2010) · Patient Safety in Surgery · doi:10.1186/1754-9493-4-12 · Cited by 15
“Routine reporting by physicians identified fewer events than medical record review[15].”
BackgroundImpact of Complications After Surgery for Colorectal Liver Metastasis on Patient Survival
Schepers, A., Mieog, S., van de Burg, B. B., van Schaik, J., Liefers, G., & de Mheen, P. J. M. (2010) · Journal of Surgical Research · doi:10.1016/j.jss.2010.07.022 · Cited by 15
Effects of study methodology on adverse outcome occurrence and mortality
de Mheen, P. J. M., Hollander, E.-J. F., & Kievit, J. (2007) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzm039 · Cited by 15
Retrospective record review in proactive patient safety work – identification of no-harm incidents
Schildmeijer, K. G. I., Unbeck, M., Muren, O., Perk, J., Härenstam, K. P., & Nilsson, L. M. (2013) · BMC Health Services Research · doi:10.1186/1472-6963-13-282 · Cited by 14
“It is a frequently used method in healthcare practice to identify AEs [5,17,18], and in this respect superior to different incidentreporting systems [8,9,19-21].”
MethodHow do we know that we are doing a good job – Can we measure the quality of our work?
Gisvold, S. E., & Fasting, S. (2011) · Best practice & research. Clinical anaesthesiology · doi:10.1016/j.bpa.2011.02.010 · Cited by 14
Nurse Reports of Adverse Events During Sedation Procedures at a Pediatric Hospital
Lightdale, J. R., Mahoney, L. B., Fredette, M. E., Valim, C., Wong, S., & DiNardo, J. A. (2009) · Journal of PeriAnesthesia Nursing · doi:10.1016/j.jopan.2009.07.004 · Cited by 13
van Schie, P., van Bodegom‐Vos, L., Zijdeman, T. M., Gosens, T., Nelissen, R. G. H. H., & de Mheen, P. J. M. (2024) · The Journal of Arthroplasty · doi:10.1016/j.arth.2024.06.064 · Cited by 11
Adverse Events after Treatment of Patients with Acute Limb Ischemia
van der Slegt, J., Flu, H. C., Veen, E. J., Ho, G. H., de Groot, H. G. W., Vos, L. D., & van der Laan, L. (2014) · Annals of Vascular Surgery · doi:10.1016/j.avsg.2014.10.022 · Cited by 10
“This definition was confirmed by the Association of Surgeons of the Netherlands (ASN) and has been chosen with the explicit aim of excluding subjective judgment on cause and effect, and right or wrong (12, 15-18).”
MethodKrukerink, M., Kievit, J., & de Mheen, P. J. M. (2009) · BMC Infectious Diseases · doi:10.1186/1471-2334-9-176 · Cited by 10
“A previous study has shown that such a routine reporting system is an effective method to identify adverse outcomes [ 11 ].”
MethodQuality of Care and Analyses of Surgical Complications
Visser, A., Ubbink, D. T., van Wijngaarden, A. K. S., Gouma, D. J., & Goslings, J. C. (2012) · Digestive Surgery · doi:10.1159/000344007 · Cited by 8
Alimohamad, H., Yilmaz, D., de Mheen, P. J. M., Jansen, J. C., Hamming, J. F., & Schepers, A. (2023) · International Journal of Surgery · doi:10.1097/js9.0000000000000689 · Cited by 8
“…primary outcome was nerve injury, de fi ned as postoperative nerve impairment, which was reported by physicians as a postoperative complication during routine clinical practice, collected in the complication registry, which has previously been shown to be valid compared with record review [20,21] .”
ResultLarson, M., Low, R. M., Adler, J. A., Schortz, L., Shaw, S. P., Blackie, K., Grace, K., Hsu, Y., & Wu, A. M. (2025) · Journal of the American Veterinary Medical Association · doi:10.2460/javma.24.08.0523 · Cited by 6
First Experience of a Novel Femorocrural Expanded Polytetrafluoroethylene Bypass Graft
Tuijp, S. J., Flu, H. C., Donker, J. M. W., Veen, E. J., Ho, G. H., de Groot, H. G., van der Waal, J. C., & van der Laan, L. (2013) · Annals of Vascular Surgery · doi:10.1016/j.avsg.2013.04.024 · Cited by 3
Detecting Adverse Events in Dermatologic Surgery
PINNEY, D., PEARCE, D. J., & Feldman, S. R. (2009) · Dermatologic Surgery · doi:10.1111/j.1524-4725.2009.01378.x · Cited by 3
“5% to 66% of events in a similar patient population.(10,11) Put differently, routine reporting failed to identify 38% of AEs.”
BackgroundUnbeck, M. (2012) · Figshare · Cited by 3
Laan, B. J., Godfried, M. H., & Geerlings, S. E. (2021) · Journal of Infection Prevention · doi:10.1177/17571774211012455 · Cited by 2
“In contrast, the nationwide routine reporting of surgical adverse events in The Netherlands is integrated in daily clinical practice, which results in a registration of 85% of serious adverse events (Marang-van de Mheen et al, 2005).”
BackgroundDiscrepancy in Reporting of Perioperative Complications
Gomes, N. V., Polutak, A., Schindler, C., Weber, W. P., Steiner, L. A., Rosenthal, R., & Dell‐Kuster, S. (2023) · Annals of Surgery · doi:10.1097/sla.0000000000005807 · Cited by 2
Patients’ willingness to complete written incident report forms in one UK tertiary cancer hospital
Doherty, C., Stavropoulou, C., & Dickinson, L. (2015) · Clinical Risk · doi:10.1177/1356262215616013 · Cited by 1
Flu, H. C., Lardenoye, J.-W. H. P., Veen, E. J., Aquarius, A. E., Henegouwen, D. P. V. B., & Hamming, J. F. (2009) · Anales de Cirugía Vascular · doi:10.1016/j.acvsp.2009.11.018
“Clasificaci on de Fontaine(30,31) 0,257 III 49 (46) 36 (50) 13 (38) IV 57 (54) 36 (50) 21 (62) Clasificaci on TASC(1,2) Lesiones femoropopl ıteas 0,805 Tipo B 39 (37) 26 (36) 13 (38) Tipo C 16 (15) 12 (17) 4 (12) Tipo D 51 (48) 34 (47) 17 (50) Procedimientos primarios 106 (82) 72 (100) 34 (60) 0,817 ATP 39 (37) 26 (36…”
Morbidité et mortalité d'origine cardiaque après revascularisation pour ischémie critique
Flu, H. C., Lardenoye, J.-W. H. P., Veen, E. J., Aquarius, A. E., Henegouwen, D. P. V. B., & Hamming, J. F. (2009) · Annales de Chirurgie Vasculaire · doi:10.1016/j.acvfr.2010.02.014
Quality of Provided Care in Vascular Surgery
Hamming, J. F., & Flu, H. C. (2008)
Voluntary Incident Reporting in Health Care
Markes, A. R., & Diab, M. (2025) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.24.00880
Metadata
- Authors
- Marang-van de Mheen, P. J.
- Venue
- Quality and Safety in Health Care
- Publisher
- BMJ
- Published
- 2005-10-01
- Volume
- 14
- Issue
- 5
- Pages
- 378-382
- ISSN
- 1475-3898 (ISSN-L)
- 1475-3901
- PMC
- PMC1744069
- OpenAlex
- W2123150039
- Cited by
- 46
- References
- 18
- Citations by year
- 2025: 2 · 2024: 1 · 2023: 2 · 2022: 2 · 2021: 1 · 2019: 2 · 2018: 1 · 2017: 2 · 2015: 4 · 2014: 2 · 2013: 2 · 2012: 3
- FWCI
- 3.37
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- BMJ Quality & Safety (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Patient Safety and Medication Errors
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Toxicology › Pharmacovigilance and Adverse Drug Reactions
- Health Sciences › Nursing › Leadership and Management › Hospital Admissions and Outcomes
- Keywords
- adverse surgical outcomes, serious adverse events, outcome ascertainment, underreporting, surgical quality
- MeSH terms
- Adult, Age Factors, Aged, Female, Humans, Male, Medical Audit, Medical Records, Middle Aged, Netherlands, Reoperation, Retrospective Studies, Risk Factors, Risk Management, Surgery Department, Hospital, Surgical Procedures, Operative, Treatment Outcome, Outcome Assessment, Health Care
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.