The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Evaluating policy and service interventions: framework to guide selection and interpretation of study end points
Abstract
The effect of many cost effective policy and service interventions cannot be detected at the level of the patient. This new framework could help improve the design (especially choice of primary end point) and interpretation of evaluative studies
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Indeed, choice of appropriate methods for such evaluations remains a contested issue [29,30].”
Citations
Cites
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995
Incidence of Adverse Events and Negligence in Hospitalized Patients
Brennan, T. A., Leape, L. L., Laird, N. M., Hebert, L. E., Localio, A. R., Lawthers, A. G., Newhouse, J. P., Weiler, P. C., & Hiatt, H. H. (1991) · New England Journal of Medicine · doi:10.1056/nejm199102073240604 · Cited by 4,631
An Intervention to Decrease Catheter-Related Bloodstream Infections in the ICU
Pronovost, P., Needham, D., Berenholtz, S., Sinopoli, D., Chu, H., Cosgrove, S., Sexton, B., Hyzy, R., Welsh, R., Roth, G., et al. (2006) · New England Journal of Medicine · doi:10.1056/nejmoa061115 · Cited by 4,387
Effect of Reducing Interns' Work Hours on Serious Medical Errors in Intensive Care Units
Landrigan, C. P., Rothschild, J. M., Cronin, J. W., Kaushal, R., Burdick, E., Katz, J. T., Lilly, C. M., Stone, P. H., Lockley, S. W., Bates, D. W., et al. (2004) · New England Journal of Medicine · doi:10.1056/nejmoa041406 · Cited by 1,760 · cited 1×
“However, as the signal (change in outcome due to intervention) diminishes in relation to the noise (changes in outcome due to uncontrolled sources of variation), a study based on process measurement will become more cost effective. Such was the case in Landrigan’s study of the effects of fatigue on the quality of care…”
BackgroundA look into the nature and causes of human errors in the intensive care unit
Donchin, Y., Gopher, D., Olin, M., Badihi, Y., Bieski, M., Sprung, C. L., Pizov, R., & Cotev, S. (1995) · Critical Care Medicine · doi:10.1097/00003246-199502000-00015 · Cited by 838
Sazawal, S., & Black, R. (2003) · Lancet. Infectious Diseases (Print) · doi:10.1016/s1473-3099(03)00737-0 · Cited by 485
Publication Bias: The Problem That Won't Go Away
DICKERSIN, K., & MIN, Y. (1993) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1993.tb26343.x · Cited by 427
Campbell, M. K., Fayers, P. M., & Grimshaw, J. M. (2005) · Clinical Trials · doi:10.1191/1740774505cn071oa · Cited by 275
Ethical issues in the design and conduct of cluster randomised controlled trials
Edwards, S., Braunholtz, D., Lilford, R. J., & Stevens, A. J. (1999) · BMJ · doi:10.1136/bmj.318.7195.1407 · Cited by 256
Self-citationMethods to reduce the impact of intraclass correlation in group-randomized trials.
Murray, D. M., & Blitstein, J. L. (2003) · Evaluation Review · doi:10.1177/0193841x02239019 · Cited by 221
Flagged first, then by citations
Cited by
Sorted by citations
Items 101–146 of 146
A perioperative safety and quality change management model and case study: Muda Health
Barach, P. R., Wiggin, H., Risner, P., Johnson, J. K., Patrishkoff, D., Kurra, S., Southern, B., & Popovich, E. (2023) · Elsevier eBooks · doi:10.1016/b978-0-323-66179-9.00009-9 · Cited by 3
Self-citationPatient Transitions and Handovers Across the Continuum of Surgical Care
Woods, D. M., & McElroy, L. M. (2017) · Springer eBooks · doi:10.1007/978-3-319-44010-1_36 · Cited by 3
Lilford, R. J., Nepogodiev, D., Chilton, P. J., Watson, S., Erlangga, D., Diggle, P. J., Girling, A. J., & Sculpher, M. J. (2021) · BMJ Global Health · doi:10.1136/bmjgh-2020-004723 · Cited by 3
Self-citationImproving Pediatric Cardiac Care with Continuous Quality Improvement Methods and Tools
Johnson, J. K., & Barach, P. R. (2014) · Springer eBooks · doi:10.1007/978-1-4471-6566-8_3 · Cited by 3
Self-citationUK medical education should include training in point-of-care ultrasound
Apenteng, P. N., & Lilford, R. J. (2023) · BMJ · doi:10.1136/bmj.p574 · Cited by 3
Self-citationFuture direction for healthcare based on big data analytics
Sousa, M. J., Barach, P. R., & Pesqueira, A. M. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-91907-4.00022-4 · Cited by 2
Self-citationClinical audit of leg ulceration prevalence in a community area: a case study of good practice
Hindley, J. (2014) · British Journal of Community Nursing · doi:10.12968/bjcn.2014.19.sup9.s33 · Cited by 2
African primary care research: Reviewing the literature
Ross, A. J., & Mash, R. J. (2014) · African Journal of Primary Health Care & Family Medicine · doi:10.4102/phcfm.v6i1.584 · Cited by 2
Perioperative Risk and Management of Surgical Patients
Levett, J. M., Mellott, S., Smith, A. L., Fasone, J. M., Labovitz, S. S., Labovitz, J., & Dotan, D. B. (2017) · Springer eBooks · doi:10.1007/978-3-319-44010-1_33 · Cited by 2
Diagnostic Error in Surgery and Surgical Services
Graber, M. L., Sánchez, J. A., & Barach, P. R. (2017) · Springer eBooks · doi:10.1007/978-3-319-44010-1_25 · Cited by 2
Self-citationHow Regulators Assess and Accredit Safety and Quality in Surgical Services
Leyshon, S., Bach, T. L., Turk, E., Orr, A., Ray-Sannerud, B., & Barach, P. (2017) · Springer eBooks · doi:10.1007/978-3-319-44010-1_45 · Cited by 1
Self-citationBruce, C. R., Harrison, P., Vinh, T. M., Manoharan, A. G., Giammattei, C., Bliven, C., Shallcross, J. A., Khleif, A., Tran, N., Sol, J. R., et al. (2022) · ACI Open · doi:10.1055/s-0042-1754011 · Cited by 2
Self-citationComment on: The case for ‘conservative pharmacotherapy’
Hamilton, F., Albur, M., Noel, A., & MacGowan, A. P. (2021) · Journal of Antimicrobial Chemotherapy · doi:10.1093/jac/dkab153 · Cited by 2
Mian, D. B., Guié, P., Horo, A., Edele, A. K. A., Virginie, K. K., Bruno, A., Seydou, K., Sarah, R., Boni, S., & Burke Thomas, F. (2023) · Gynecology and Obstetrics Clinical Medicine · doi:10.1016/j.gocm.2023.08.004 · Cited by 1
Kim, Y., Melzer, A., Kim, S., & Barach, P. R. (2024) · Springer eBooks · doi:10.1007/978-3-031-68574-3_8 · Cited by 1
Self-citationScott, P., de Keizer, N. F., Georgiou, A., Hyppönen, H., Craven, C. K., & Rigby, M. (2015) · Cited by 1
How Not to Run an Incident Investigation
Cassin, B. R., & Barach, P. R. (2017) · Springer eBooks · doi:10.1007/978-3-319-44010-1_41 · Cited by 1
Self-citationPreventing Venous Thromboembolism Across the Surgical Care Continuum
Kodadek, L. M., & Haut, E. R. (2017) · Springer eBooks · doi:10.1007/978-3-319-44010-1_29 · Cited by 1
Multi-institutional Learning and Collaboration to Improve Quality and Safety
Johnson, J. K., Minami, C. A., Dahlke, A. R., & Bilimoria, K. Y. (2017) · Springer eBooks · doi:10.1007/978-3-319-44010-1_42 · Cited by 1
Global Surgery: Progress and Challenges in Surgical Quality and Patient Safety
Pettengell, C., Williams, S., & Darzi, A. W. (2017) · Springer eBooks · doi:10.1007/978-3-319-44010-1_50 · Cited by 1
Warm, E. J., Ahmad, Y., Kinnear, B., Kelleher, M., Sall, D. R., Wells, A., & Barach, P. R. (2021) · Academic Medicine · doi:10.1097/acm.0000000000004066 · Cited by 1
Self-citationEvaluating the impact of family physicians within the district health system of South Africa
Pressentin, V., & Botho, K. (2017) · Cited by 1
Mumford, V., Greenfield, D., Hogden, A., Debono, D. S., Forde, K., Westbrook, J. I., & Braithwaite, J. (2015) · BMC Research Notes · doi:10.1186/s13104-015-1330-6
“This broad approach to quality improvement reflects the goals of the accreditation program within an overarching safety and quality framework [6].”
BackgroundGuidet, B., Valentin, A., & Flaatten, H. K. (2016) · Cambridge University Press eBooks · doi:10.1017/cbo9781316218563.013
Ahmed, Z. (2016) · UCL Discovery (University College London)
The Role of Architecture and Physical Environment in Hospital Safety Design
Cadenhead, C. D., Waggener, L. T., & Goswami, B. (2017) · Springer eBooks · doi:10.1007/978-3-319-44010-1_12
Risk Factors and Epidemiology of Surgical Safety
Groene, O. (2017) · Springer eBooks · doi:10.1007/978-3-319-44010-1_2
“The model is important for an understanding of a systems perspective on latent and active errors, and the complex relationship between wider management processes, clinical processes, and patient outcomes [6].”
BackgroundLessons Learned from Anesthesia Registries About Surgical Safety and Reliability
Dutton, R. P. (2017) · Springer eBooks · doi:10.1007/978-3-319-44010-1_43
The Burning Platform: Improving Surgical Quality and Keeping Patients Safe
Sánchez, J. A., & Lobdell, K. W. (2017) · Springer eBooks · doi:10.1007/978-3-319-44010-1_1
The Next Training Frontier: Improving Patient Safety Research Skills
Urman, R. D., Barach, P. R., & Shapiro, F. E. (2018) · ASA Monitor · doi:10.1097/01.asm.0001076892.93780.4a
Self-citationHow to prepare your research proposal
Mash, R. J. (2018) · CRC Press eBooks · doi:10.1201/9781351014519-12
Research in Pediatric Cardiology
Lipshultz, S. E., Adams, M. J., & Barach, P. R. (2023) · Springer eBooks · doi:10.1007/978-3-030-42937-9_7-1
Self-citationGoswami, S. (2024) · International Journal of Innovative Research in Computer Science & Technology · doi:10.55524/ijircst.2024.12.2.17
Singh, B., Lipunga, G., Thangavelu, P., Dhar, S., Cronemberger, L. F., Abhilash, K. P. P., Abraham, A. M., de Brito, C. A. A., Ferreira, M. L. B., Chandrashekar, N., et al. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4870376
Self-citationResearch in Pediatric Cardiology
Lipshultz, S. E., Adams, M. J., & Barach, P. R. (2024) · Springer eBooks · doi:10.1007/978-3-031-07563-6_7
Self-citationViner, A., Deeks, O., Nayyar, P., Allison, J., Murray, S. R., Ainslie, K., Cockburn, N., Lilford, R. J., & Magowan, B. (2025) · NIHR Open Research · doi:10.3310/nihropenres.13791.1
Self-citationAyorinde, A., Williams, I., Mannion, R., Song, F., Skrybant, M., Lilford, R. J., & Chen, Y.-F. (2020) · Figshare · doi:10.6084/m9.figshare.12413774
Self-citationHunter, R. F., Adlakha, D., Cardwell, C., Cupples, M. E., Donnelly, M., Ellis, G., Gough, A., Hutchinson, G., Kearney, T., Longo, A., et al. (2021) · Figshare · doi:10.6084/m9.figshare.16909515
Ayorinde, A., Williams, I., Mannion, R., Song, F., Skrybant, M., Lilford, R. J., & Chen, Y.-F. (2020) · Figshare · doi:10.6084/m9.figshare.12413768
Self-citationAujla, N., Ilori, T., Irabor, A. E., Obimakinde, A. M., Owoaje, E., Fayehun, O. A., Ajisola, M. M., Bolaji, S. O., Watson, S. I., Hofer, T. P., et al. (2021) · Figshare · doi:10.6084/m9.figshare.14650574
Self-citationSheppard, D., Clarke, E., Hemming, K., Martin, J., & Lilford, R. J. (2021) · Figshare · doi:10.6084/m9.figshare.13632923
Self-citationHunter, R. F., Adlakha, D., Cardwell, C., Cupples, M., Donnelly, M., Ellis, G., Gough, A., Hutchinson, G., Kearney, T., Longo, A., et al. (2021) · Figshare · doi:10.6084/m9.figshare.16909518
Sheppard, D., Clarke, E., Hemming, K., Martin, J., & Lilford, R. J. (2021) · Figshare · doi:10.6084/m9.figshare.13632926
Self-citationHunter, R. F., Adlakha, D., Cardwell, C., Cupples, M., Donnelly, M., Ellis, G., Gough, A., Hutchinson, G., Kearney, T., Longo, A., et al. (2021) · Figshare · doi:10.6084/m9.figshare.16909521
Hunter, R. F., Adlakha, D., Cardwell, C., Cupples, M., Donnelly, M., Ellis, G., Gough, A., Hutchinson, G., Kearney, T., Longo, A., et al. (2021) · Figshare · doi:10.6084/m9.figshare.16909524
Mohr, H., Johnson, J. K., & Barach, P. R. (2026) · Health informatics · doi:10.1007/978-3-032-16657-9_20
Self-citation
Metadata
- Authors
- Lilford, R. J., Chilton, P. J., Hemming, K., Girling, A. J., Taylor, C. A., & Barach, P.
- Affiliations
- University of Birmingham (GB)
- University Medical Center Utrecht (NL)
- Corresponding author
- Lilford, R. J.
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2010-08-27
- Volume
- 341
- Issue
- aug27 1
- Pages
- c4413-c4413
- ISSN
- 0007-1447 (ISSN-L)
- 0959-8138
- 1468-5833
- OpenAlex
- W1996547462
- Cited by
- 146
- References
- 31
- Citations by year
- 2026: 1 · 2025: 5 · 2024: 5 · 2023: 5 · 2022: 6 · 2021: 17 · 2020: 11 · 2019: 4 · 2018: 19 · 2017: 19 · 2016: 10 · 2015: 10 · 2014: 8 · 2013: 4 · 2012: 13
- FWCI
- 19.39
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- BMJ (publishedVersion)
- PubMed (publishedVersion)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion)
- Funders
- Engineering and Physical Sciences Research Council (GR/S29874/01, EP/F063822/1)
- Topics
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Keywords
- health policy evaluation, health service interventions, evaluation framework, cost-effectiveness
- MeSH terms
- Bayes Theorem, Cost-Benefit Analysis, Health Policy, Program Evaluation, Biomarkers, Organizational Policy, Outcome Assessment, Health Care, Process Assessment, Health Care, Publication Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review