Cited by 586Health Policy Implementation ScienceEvaluation and Performance AssessmentHealthcare Quality and Management

The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.

Research designs for studies evaluating the effectiveness of change and improvement strategies

Open access

Eccles, M·2003·Quality and Safety in Health Care

Open this paper in CoChat — free account Open PDF

Abstract

The methods of evaluating change and improvement strategies are not well described. The design and conduct of a range of experimental and non-experimental quantitative designs are considered. Such study designs should usually be used in a context where they build on appropriate theoretical, qualitative and modelling work, particularly in the development of appropriate interventions. A range of experimental designs are discussed including single and multiple arm randomised controlled trials and the use of more complex factorial and block designs. The impact of randomisation at both group and individual levels and three non-experimental designs (uncontrolled before and after, controlled before and after, and time series analysis) are also considered. The design chosen will reflect both the needs (and resources) in any particular circumstances and also the purpose of the evaluation. The general principle underlying the choice of evaluative design is, however, simple-those conducting such evaluations should use the most robust design possible to minimise bias and maximise generalisability.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1136/qhc.12.1.47

Cites

24 of 24 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Untitled work
(1963) · Medical Entomology and Zoology · Cited by 15,085
Untitled work
(1979) · Medical Entomology and Zoology · Cited by 11,252
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,091
Framework for design and evaluation of complex interventions to improve health
Campbell, M. (2000) · BMJ · doi:10.1136/bmj.321.7262.694 · Cited by 3,474
Clinical Trials: A Practical Approach.
Hill, I. D., & Pocock, S. (1984) · Biometrics · doi:10.2307/2531186 · Cited by 2,918
The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis.
Lipsey, M. W., & Wilson, D. B. (1993) · American Psychologist · doi:10.1037/0003-066x.48.12.1181 · Cited by 2,033
Effectiveness and Efficiency: Random Reflections on Health Services
L'Etang, H. (1973) · Public Health · doi:10.1016/s0033-3506(73)80082-4 · Cited by 1,905
Explanatory and Pragmatic Attitudes in Therapeutical Trials
Schwartz, D., & Lellouch, J. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.01.012 · Cited by 1,253
Design and Analysis of Cluster Randomization Trials in Health Research
DONNER, A. P., & Klar, N. S. (2000) · Cited by 1,236
Time-Series Analysis: Regression Techniques.
Pampel, F. C., & Ostrom, C. W. (1980) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2065616 · Cited by 499

Show all 24 references

Research works printed but not linked: 6

Murray DM. The design and analysis of group randomised trials. Oxford: Oxford University Press, 1998.
Cochran WG, Cox GM. Experimental design. New York: Wiley, 1957.
Eccles M, McColl E, Steen N, et al. A cluster randomised controlled trial of computerised evidence based guidelines for angina and asthma in primary care. BMJ 2002;325:941-7.
Matowe L, Ramsay C, Grimshaw JM, et al. Influence of the Royal College of Radiologists' guidelines on referrals from general practice: a time series analysis. Clin Radiol 2002;57:575-8.
Grilli R, Ramsay CR, Minozi S. Mass media interventions: effects on health services utilisation In: Cochrane Collaboration. The Cochrane Library. Oxford: Update Software, 2002.
Grilli R, Freemantle N, Minozzi S, et al. Impact of mass media on health services utilisation. In: Cochrane Collaboration. The Cochrane Library. Issue 3. Oxford: Update Software, 1998.

Sorted by citations

Developing and Evaluating Complex Interventions: New Guidance
Craig, P., Dieppe, P. A., MacIntyre, S., Michie, S., Nazareth, I., & Petticrew, M. P. (2006) · UCL Discovery (University College London) · Cited by 1,878
Qualitative and Mixed Methods Provide Unique Contributions to Outcomes Research
Curry, L. A., Nembhard, I. M., & Bradley, E. H. (2009) · Circulation · doi:10.1161/circulationaha.107.742775 · Cited by 1,175
Local opinion leaders: effects on professional practice and health care outcomes
Flodgren, G., Parmelli, E., Doumit, G., Gattellari, M., O'Brien, M. A., Grimshaw, J., & Eccles, M. P. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000125.pub4 · Cited by 1,070
Self-citation
A systematic review of primary prevention strategies for sexual violence perpetration
DeGue, S. A., Valle, L. A., Holt, M. K., Massetti, G. M., Matjasko, J. L., & Tharp, A. T. (2014) · Aggression and Violent Behavior · doi:10.1016/j.avb.2014.05.004 · Cited by 781
Interventions targeting social isolation in older people: a systematic review
Dickens, A. P., Richards, S. H., Greaves, C. J., & Campbell, J. L. (2011) · BMC Public Health · doi:10.1186/1471-2458-11-647 · Cited by 767
Educational and Organizational Interventions to Improve the Management of Depression in Primary Care: A Systematic Review
Gilbody, S., Whitty, P., Grimshaw, J., & Thomas, R. (2003) · JAMA · doi:10.1001/jama.289.23.3145 · Cited by 749
Evidence-Based Quality Improvement: The State Of The Science
Shojania, K. G., & Grimshaw, J. (2005) · Health Affairs · doi:10.1377/hlthaff.24.1.138 · Cited by 684
Patterns of intra-cluster correlation from primary care research to inform study design and analysis
Adams, G., Gulliford, M. C., Ukoumunne, O. C., Eldridge, S., Chinn, S., & Campbell, M. J. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2003.12.013 · Cited by 602
Is realist evaluation keeping its promise? A review of published empirical studies in the field of health systems research
Marchal, B., van Belle, S., van Olmen, J., Hoerée, T., & Kegels, G. (2012) · Evaluation · doi:10.1177/1356389012442444 · Cited by 476
Leadership and organizational change for implementation (LOCI): a randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation
Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Hurlburt, M. S. (2015) · Implementation Science · doi:10.1186/s13012-014-0192-y · Cited by 435
Application of statistical process control in healthcare improvement: systematic review
Thor, J., Lundberg, J., Ask, J., Olsson, J., Carli, C., Härenstam, K. P., & Brommels, M. (2007) · BMJ Quality & Safety · doi:10.1136/qshc.2006.022194 · Cited by 432
Experimental and quasi-experimental designs in implementation research
Miller, C. J., Smith, S. N., & Pugatch, M. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2019.06.027 · Cited by 373
“widespread implementation of policy mandates, quality improvement initiatives, or dissemination campaigns (Eccles et al., 2003).”
BackgroundInfluential
Systematic review of the application of quality improvement methodologies from the manufacturing industry to surgical healthcare
Nicolay, C., Purkayastha, S., Greenhalgh, A., Benn, J. J., Chaturvedi, S., Phillips, N., & Darzi, A. W. (2011) · British journal of surgery · doi:10.1002/bjs.7803 · Cited by 348
Clinical implications of congenital uterine anomalies: a meta-analysis of comparative studies
Venetis, C. A., Papadopoulos, S. P., Campo, R., Gordts, S., Tarlatzis, B. C., & Grimbizis, G. F. (2014) · Reproductive BioMedicine Online · doi:10.1016/j.rbmo.2014.09.006 · Cited by 332
Assessing risk of bias in a non‐randomized study
Sterne, J. A., Hernán, M. A., McAleenan, A., Reeves, B. C., & Higgins, J. P. (2019) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9781119536604.ch25 · Cited by 330
How to study improvement interventions: a brief overview of possible study types
Portela, M. C., Pronovost, P. J., Woodcock, T. M., Carter, P., & Dixon‐Woods, M. (2015) · BMJ Quality & Safety · doi:10.1136/bmjqs-2014-003620 · Cited by 345
Systematic reviews of the effectiveness of quality improvement strategies and programmes
Grimshaw, J. (2003) · BMJ Quality & Safety · doi:10.1136/qhc.12.4.298 · Cited by 290
Methods for exploring implementation variation and local context within a cluster randomised community intervention trial
Hawe, P., Shiell, A., Riley, T., & Gold, L. H. (2004) · Journal of Epidemiology & Community Health · doi:10.1136/jech.2003.014415 · Cited by 287
Achieving Rapid Door-To-Balloon Times
Bradley, E. H., Curry, L. A., Webster, T. R., Mattera, J. A., Roumanis, S. A., Radford, M. J., McNamara, R. L., Barton, B. A., Berg, D. N., & Krumholz, H. M. (2006) · Circulation · doi:10.1161/circulationaha.105.590133 · Cited by 281
De-implementing wisely: developing the evidence base to reduce low-value care
Grimshaw, J., Patey, A. M., Kirkham, K. R., Hall, A. M., Dowling, S. K., Rodondi, N., Ellen, M., Kool, R. B., van Dulmen, S. A., Kerr, E. A., et al. (2020) · BMJ Quality & Safety · doi:10.1136/bmjqs-2019-010060 · Cited by 288
Determinants of the intracluster correlation coefficient in cluster randomized trials: the case of implementation research
Campbell, M. K., Fayers, P. M., & Grimshaw, J. M. (2005) · Clinical Trials · doi:10.1191/1740774505cn071oa · Cited by 275
A systematic review of implementation strategies for assessment, prevention, and management of ICU delirium and their effect on clinical outcomes
Trogrlić, Z., van der Jagt, M., Bakker, J., Balas, M. C., Ely, E. W., van der Voort, P. H. J., & Ista, E. (2015) · Critical Care · doi:10.1186/s13054-015-0886-9 · Cited by 271
Effect of Patient-Centered Transitional Care Services on Clinical Outcomes in Patients Hospitalized for Heart Failure
Spall, H. G. C. V., Lee, S. F., Xie, F., Oz, U. E., Perez, R., Mitoff, P. R., Maingi, M., Tjandrawidjaja, M. C., Heffernan, M., Zia, M. I., et al. (2019) · JAMA · doi:10.1001/jama.2019.0710 · Cited by 264
Study Designs for Effectiveness and Translation Research
Mercer, S. L., DeVinney, B. J., Fine, L. J., Green, L. W., & Dougherty, D. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.04.005 · Cited by 222
Rehabilitation Interventions for Postintensive Care Syndrome
Mehlhorn, J., Freytag, A., Schmidt, K. F. R., Brunkhorst, F. M., Graf, J., Troitzsch, U., Schlattmann, P., Wensing, M., & Gensichen, J. S. (2014) · Critical Care Medicine · doi:10.1097/ccm.0000000000000148 · Cited by 235
Evaluating the impact of prediction models: lessons learned, challenges, and recommendations
Kappen, T. H., van Klei, W. A., van Wolfswinkel, L., Kalkman, C. J., Vergouwe, Y., & Moons, K. G. M. (2018) · Diagnostic and Prognostic Research · doi:10.1186/s41512-018-0033-6 · Cited by 215
Local opinion leaders: effects on professional practice and health care outcomes
Flodgren, G., Parmelli, E., Doumit, G. D., Gattellari, M., O’Brien, M. A., Grimshaw, J., & Eccles, M. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000125.pub3 · Cited by 191
Self-citation
Improving quality of care. A systematic review on how medical registries provide information feedback to health care providers
van der Veer, S. N., de Keizer, N. F., Ravelli, A. C. J., Tenkink, S., & Jager, K. J. (2010) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2010.01.011 · Cited by 184
Prevention of Central Line-Associated Bloodstream Infections Through Quality Improvement Interventions: A Systematic Review and Meta-analysis
Blot, K. Y., Bergs, J., Vogelaers, D., Blot, S. I., & Vandijck, D. M. (2014) · Clinical Infectious Diseases · doi:10.1093/cid/ciu239 · Cited by 186
Using clinical simulation to study how to improve quality and safety in healthcare
Lamé, G., & Dixon‐Woods, M. (2018) · BMJ Simulation & Technology Enhanced Learning · doi:10.1136/bmjstel-2018-000370 · Cited by 201
Realist RCTs of complex interventions – An oxymoron
Marchal, B., Westhorp, G., Wong, G., Belle, S. V., Greenhalgh, T., Kegels, G., & Pawson, R. (2013) · Social Science & Medicine · doi:10.1016/j.socscimed.2013.06.025 · Cited by 168
What Is Implementation Research?
Bhattacharyya, O. K., Reeves, S., & Zwarenstein, M. (2009) · Research on Social Work Practice · doi:10.1177/1049731509335528 · Cited by 162
Primary care models for treating opioid use disorders: What actually works? A systematic review
Lagisetty, P., Klasa, K., Bush, C. A., Heisler, M., Chopra, V., & Bohnert, A. S. B. (2017) · PLoS ONE · doi:10.1371/journal.pone.0186315 · Cited by 155
Models, Strategies, and Tools.
Sales, A. E., Smith, J. L., Curran, G. M., & Kochevar, L. K. (2006) · Journal of General Internal Medicine · doi:10.1111/j.1525-1497.2006.00362.x · Cited by 171
Developing standards for reporting implementation studies of complex interventions (StaRI): a systematic review and e-Delphi
Pinnock, H., Epiphaniou, E., Sheikh, A., Griffiths, C., Eldridge, S., Craig, P., & Taylor, S. J. (2015) · Implementation Science · doi:10.1186/s13012-015-0235-z · Cited by 128
Impact of a team and leaders-directed strategy to improve nurses’ adherence to hand hygiene guidelines: A cluster randomised trial
Huis, A. M. P., Schoonhoven, L., Grol, R. P. T. M., Donders, R., Hulscher, M., & van Achterberg, T. (2012) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2012.08.004 · Cited by 143
Partners in Caregiving in a Special Care Environment: Cooperative Communication Between Staff and Families on Dementia Units
Robison, J., Curry, L. C., Gruman, C., Porter, M., Henderson, C., & Pillemer, K. A. (2007) · The Gerontologist · doi:10.1093/geront/47.4.504 · Cited by 139
Knowledge translation research: the science of moving research into policy and practice.
Curran, J., Grimshaw, J., Hayden, J., & Campbell, B. (2011) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.20124 · Cited by 130
How to Use an Article About Quality Improvement
Fan, E., Laupacis, A., Pronovost, P. J., Guyatt, G. H., & Needham, D. M. (2010) · JAMA · doi:10.1001/jama.2010.1692 · Cited by 137
Closing the Gap between Injury Prevention Research and Community Safety Promotion Practice: Revisiting the Public Health Model
Hanson, D., Finch, C. F., Allegrante, J. P., & Sleet, D. A. (2012) · Public Health Reports · doi:10.1177/003335491212700203 · Cited by 131
Educational interventions designed to develop nurses’ cultural competence: A systematic review
Oikarainen, A., Mikkonen, K., Kenny, A. J., Tomietto, M., Tuomikoski, A., Meriläinen, M. H., Miettunen, J., & Kääriäinen, M. (2019) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2019.06.005 · Cited by 143
Systematic review of public-targeted communication interventions to improve antibiotic use
Cross, E. L. A., Tolfree, R., & Kipping, R. (2017) · Journal of Antimicrobial Chemotherapy · doi:10.1093/jac/dkw520 · Cited by 118
What are effective strategies for the implementation of care bundles on ICUs: a systematic review
Borgert, M. J., Goossens, A., & Dongelmans, D. A. (2015) · Implementation Science · doi:10.1186/s13012-015-0306-1 · Cited by 117
The role of organizational research in implementing evidence-based practice: QUERI Series
Yano, E. M. (2008) · Implementation Science · doi:10.1186/1748-5908-3-29 · Cited by 112
Integrated electronic decision support increases cardiovascular disease risk assessment four fold in routine primary care practice
Wells, S., Furness, S., Rafter, N., Horn, E., Whittaker, R., Stewart, A., Moodabe, K., Roseman, P., Selak, V., Bramley, D., et al. (2008) · European Journal of Cardiovascular Prevention & Rehabilitation · doi:10.1097/hjr.0b013e3282f13af4 · Cited by 109
Interventions to reduce nurses’ medication administration errors in inpatient settings: A systematic review and meta-analysis
Berdot, S., Roudot, M., Schramm, C., Katsahian, S., Durieux, P., & Sabatier, B. (2015) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2015.08.012 · Cited by 110
Effectiveness of implementation interventions in improving physician adherence to guideline recommendations in heart failure: a systematic review
Shanbhag, D., Graham, I. D., Harlos, K., Haynes, R. B., Gabizon, I., Connolly, S. J., & Spall, H. G. C. V. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-017765 · Cited by 113
A proposed method of bias adjustment for meta-analyses of published observational studies
Thompson, S., Ekelund, U., Jebb, S., Lindroos, A. K., Mander, A., Sharp, S., Turner, R., & Wilks, D. (2011) · International Journal of Epidemiology · doi:10.1093/ije/dyq248 · Cited by 101
Impact of STROBE Statement Publication on Quality of Observational Study Reporting: Interrupted Time Series versus Before-After Analysis
Bastuji‐Garin, S., Sbidian, É., Gaudy‐Marqueste, C., Ferrat, É., Roujeau, J., Richard, M. A., Canouï‐Poitrine, F., & on behalf of the European Dermatology Network (EDEN) (2013) · PLoS ONE · doi:10.1371/journal.pone.0064733 · Cited by 104
Secular trends and evaluation of complex interventions: the rising tide phenomenon
Chen, Y., Hemming, K., Stevens, A. J., & Lilford, R. J. (2015) · BMJ Quality & Safety · doi:10.1136/bmjqs-2015-004372 · Cited by 102
Efficacy of Group-Based Organised Physical Activity Participation for Social Outcomes in Children with Autism Spectrum Disorder: A Systematic Review and Meta-analysis
Howells, K., Sivaratnam, C. S., May, T., Lindor, E., McGillivray, J., & Rinehart, N. (2019) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-019-04050-9 · Cited by 99
An integrative review of the current evidence on the relationship between hand hygiene interventions and the incidence of health care–associated infections
Backman, C., Zoutman, D., & Marck, P. (2008) · American Journal of Infection Control · doi:10.1016/j.ajic.2007.08.007 · Cited by 99
Soft regulations in pharmaceutical policy making
Wettermark, B., Godman, B., Jacobsson, B., & Haaijer‐Ruskamp, F. M. (2009) · Applied Health Economics and Health Policy · doi:10.1007/bf03256147 · Cited by 96
Efficacy of low-level laser therapy applied at acupuncture points in knee osteoarthritis: a randomised double-blind comparative trial
Rashoud, A. S. A., Abboud, R., Wang, W., & Wigderowitz, C. A. (2013) · Physiotherapy · doi:10.1016/j.physio.2013.09.007 · Cited by 104
Reducing blood culture contamination in the emergency department: an interrupted time series quality improvement study
Self, W. H., Speroff, T., Grijalva, C. G., McNaughton, C. D., Ashburn, J., Liu, D., Arbogast, P. G., Russ, S., Storrow, A. B., & Talbot, T. R. (2013) · Academic Emergency Medicine · doi:10.1111/acem.12057 · Cited by 92
Interventions for reducing medication errors in children in hospital
Maaskant, J. M., Vermeulen, H., Apampa, B., Fernando, B., Ghaleb, M. A., Neubert, A. C., Thayyil, S., & Soe, A. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006208.pub3 · Cited by 92
Good epidemiological practice: a narrative review of appropriate scientific methods to evaluate the impact of antimicrobial stewardship interventions
de Kraker, M. E. A., Abbas, M., Huttner, B. D., & Harbarth, S. (2017) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2017.05.019 · Cited by 93
‘Best practice’ in developing and evaluating palliative and end-of-life care services: A meta-synthesis of research methods for the MORECare project
Evans, C., Harding, R., Higginson, I. J., & MORECare, O. B. O. (2013) · Palliative Medicine · doi:10.1177/0269216312467489 · Cited by 93
Review: What Can We Learn From Quality Improvement Research?
Alexander, J. A., & Hearld, L. R. (2009) · Medical Care Research and Review · doi:10.1177/1077558708330424 · Cited by 91
Psychological and Physical Interventions for the Management of Cancer-Related Pain in Pediatric and Young Adult Patients: An Integrative Review
Jibb, L., Nathan, P. C., Stevens, B., Seto, E., Cafazzo, J. A., Stephens, N., Yohannes, L., & Stinson, J. (2015) · Oncology nursing forum · doi:10.1188/15.onf.e339-e357 · Cited by 91
Building an academic-community partnered network for clinical services research: the Community Health Improvement Collaborative (CHIC).
Wells, K. B., Staunton, A., Norris, K. C., Bluthenthal, R. N., Chung, B., Gelberg, L., Jones, L., Kataoka, S., Koegel, P., Miranda, J. M., et al. (2006) · PubMed · Cited by 89
Compulsory community treatment to reduce readmission to hospital and increase engagement with community care in people with mental illness: a systematic review and meta-analysis
Barnett, P., Matthews, H., Lloyd-Evans, B., Mackay, E., Pilling, S., & Johnson, S. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30382-1 · Cited by 89
Building an ethical environment improves patient privacy and satisfaction in the crowded emergency department: a quasi-experimental study
Lin, Y., Lee, W. C., Kuo, L., Cheng, Y.-C., Lin, C., Lin, H.-L., Chen, C.-W., & Lin, T. (2013) · BMC Medical Ethics · doi:10.1186/1472-6939-14-8 · Cited by 87
The effectiveness of peer and community health worker-led self-management support programs for improving diabetes health-related outcomes in adults in low- and-middle-income countries: a systematic review
Werfalli, M., Raubenheimer, P. J., Engel, M. E., Musekiwa, A., Bobrow, K., Peer, N., Hoegfeldt, C. A., Kalula, S., Kengne, A. P., & Levitt, N. S. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01377-8 · Cited by 100
Patient Navigation: Development of a Protocol for Describing What Navigators Do
Parker, V. A., Clark, J. A., Leyson, J., Calhoun, E. A., Carroll, J. K., Freund, K. M., & Battaglia, T. A. (2010) · Health Services Research · doi:10.1111/j.1475-6773.2009.01079.x · Cited by 85
Systematic Review of the Application of Lean and Six Sigma Quality Improvement Methodologies in Radiology
Amaratunga, T., & Dobranowski, J. (2016) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2016.02.033 · Cited by 94
The demonstration of a theory-based approach to the design of localized patient safety interventions
Taylor, N., Lawton, R., Slater, B., & Foy, R. (2013) · Implementation Science · doi:10.1186/1748-5908-8-123 · Cited by 77
Interrupted Time-Series Analysis of Regulations to Reduce Paracetamol (Acetaminophen) Poisoning
Morgan, O. W., Griffiths, C., & Majeed, A. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040105 · Cited by 82
Improving attitudes towards children with disabilities in a school context: a cluster randomized intervention study
Godeau, E., Vignes, C., Sentenac, M., Ehlinger, V., NAVARRO, F., Grandjean, H., & Arnaud, C. (2010) · Developmental Medicine & Child Neurology · doi:10.1111/j.1469-8749.2010.03731.x · Cited by 79
Improving Papanicolaou test quality and reducing medical errors by using Toyota production system methods
Raab, S. S., Andrew-Jaja, C., Condel, J. L., & Dabbs, D. J. (2006) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2005.06.069 · Cited by 75
Effect of guideline based computerised decision support on decision making of multidisciplinary teams: cluster randomised trial in cardiac rehabilitation
Goud, R., de Keizer, N. F., ter Riet, G., Wyatt, J. C., Hasman, A., Hellemans, I. M., & Peek, N. B. (2009) · BMJ · doi:10.1136/bmj.b1440 · Cited by 81
Gaze-based assistive technology in daily activities in children with severe physical impairments–An intervention study
Borgestig, M., Sandqvist, J. L., Ahlsten, G., Falkmer, T., & Hemmingsson, H. (2016) · Developmental Neurorehabilitation · doi:10.3109/17518423.2015.1132281 · Cited by 76
An examination of the rigor and value of final scholarly projects completed by DNP nursing students
Roush, K. M., & Tesoro, M. G. (2018) · Journal of Professional Nursing · doi:10.1016/j.profnurs.2018.03.003 · Cited by 75
Perioperative care bundles for the prevention of surgical-site infections: meta-analysis
Wolfhagen, N., Boldingh, Q. J. J., Boermeester, M. A., & de Jonge, S. W. (2022) · British journal of surgery · doi:10.1093/bjs/znac196 · Cited by 79
Evaluating the effectiveness of care integration strategies in different healthcare systems in Latin America: the EQUITY-LA II quasi-experimental study protocol
Vázquez, M. L., Vargas, Í., Unger, J., Paepe, P. D., Mogollón‐Pérez, A., Samico, I., de Albuquerque, P. C., Eguiguren, P., Cisneros, A.-I., Rovere, M., et al. (2015) · BMJ Open · doi:10.1136/bmjopen-2014-007037 · Cited by 74
Ventilator Bundle and Its Effects on Mortality Among ICU Patients: A Meta-Analysis*
Pileggi, C., Mascaro, V., Bianco, A., Nobile, C. G. A., & Pavía, M. (2018) · Critical Care Medicine · doi:10.1097/ccm.0000000000003136 · Cited by 75
The effectiveness of regionalization of perinatal care services - a systematic review
Rashidian, A., Omidvari, A., Vali, Y., Mortaz, S., Nooraie, R. Y., Jafarı, M., & Bhutta, Z. A. (2014) · Public Health · doi:10.1016/j.puhe.2014.08.005 · Cited by 72
Rooming-in for Infants at Risk of Neonatal Abstinence Syndrome
McKnight, S., Coo, H., Davies, G., Holmes, B., Newman, A., Newton, L., & Dow, K. E. (2015) · American Journal of Perinatology · doi:10.1055/s-0035-1566295 · Cited by 71
Characteristics of successful primary school-based experiential nutrition programmes: a systematic literature review
Charlton, K., Comerford, T., Deavin, N., & Walton, K. (2021) · Public Health Nutrition · doi:10.1017/s1368980020004024 · Cited by 90
Effect evaluation of a supervised versus non‐supervised implementation of an oral health care guideline in nursing homes: a cluster randomised controlled clinical trial
Visschere, L. D., Schols, J. M. G. A., van der Putten, G., Baat, C. D., & Vanobbergen, J. (2010) · Gerodontology · doi:10.1111/j.1741-2358.2010.00418.x · Cited by 70
Effectiveness of Interventions Designed to Prevent Female Genital Mutilation/Cutting: A Systematic Review
Berg, R. C., & Denison, E. (2012) · Studies in Family Planning · doi:10.1111/j.1728-4465.2012.00311.x · Cited by 70
Improving the use of research evidence in guideline development: 16. Evaluation
Oxman, A. D., Schünemann, H. J., & Fretheim, A. (2006) · Health Research Policy and Systems · doi:10.1186/1478-4505-4-28 · Cited by 73
Effectiveness of a Hospital-Based Computerized Decision Support System on Clinician Recommendations and Patient Outcomes
Moja, L., Friz, H. P., Capobussi, M., Kwag, K. H., Banzi, R., Ruggiero, F. M., González‐Lorenzo, M., Liberati, E. G., Mangia, M., Nyberg, P. M., et al. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.17094 · Cited by 70
Improving cardiovascular risk management: a randomized, controlled trial on the effect of a decision support tool for patients and physicians
van Steenkiste, B., van der Weijden, T., Stoffers, J., Kester, A. D. M., Timmermans, D. R. M., & Grol, R. P. T. M. (2007) · European Journal of Cardiovascular Prevention & Rehabilitation · doi:10.1097/01.hjr.0000239475.71805.1e · Cited by 69
Effectiveness studies: advantages and disadvantages
Möller, H. (2011) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2011.13.2/hmoeller · Cited by 71
Antiseptic barrier cap effective in reducing central line-associated bloodstream infections: A systematic review and meta-analysis
holt, A. F. V. I. ’., Helder, O. K., Vos, M. D., Schafthuizen, L., Sülz, S., van den Hoogen, A., & Ista, E. (2017) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2017.01.007 · Cited by 68
Men’s Involvement in a Parenting Programme to Reduce Child Maltreatment and Gender-Based Violence: Formative Evaluation in Uganda
Siu, G., Wight, D., Seeley, J., Namutebi, C., Sekiwunga, R., Zalwango, F., & Kasule, S. (2017) · European Journal of Development Research · doi:10.1057/s41287-017-0103-6 · Cited by 75
The development of a theory-based intervention to promote appropriate disclosure of a diagnosis of dementia
Foy, R., Francis, J. J., Johnston, M., Eccles, M., Lecouturier, J., Bamford, C., & Grimshaw, J. (2007) · BMC Health Services Research · doi:10.1186/1472-6963-7-207 · Cited by 66
Self-citation
Effectiveness of pharmacovigilance: multifaceted educational intervention related to the knowledge, skills and attitudes of multidisciplinary hospital staff
Varallo, F. R., Planeta, C. S., & Mastroianni, P. D. C. (2017) · Clinics · doi:10.6061/clinics/2017(01)09 · Cited by 66
“Get Smart Colorado”
Gonzales, R., Corbett, K. K., Wong, S. L., Glazner, J. E., Deas, A. M., Leeman-Castillo, B. A., Maselli, J. H., Sebert-Kuhlmann, A. K., Wigton, R. S., Flores, E. T., et al. (2008) · Medical Care · doi:10.1097/mlr.0b013e3181653d2e · Cited by 70
Charting a course for health services research at the National Institute on Drug Abuse
Compton, W. M., Stein, J. B., Robertson, E. B., Pintello, D., Pringle, B., & Volkow, N. D. (2005) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2005.05.008 · Cited by 65
Methods for evaluation of small scale quality improvement projects
Harvey, G. (2003) · BMJ Quality & Safety · doi:10.1136/qhc.12.3.210 · Cited by 65
Taking PROs and patient-centered care seriously: incremental and disruptive ideas for incorporating PROs in oncology practice
Donaldson, M. S. (2008) · Quality of Life Research · doi:10.1007/s11136-008-9414-6 · Cited by 64
Methodologies to evaluate the effectiveness of knowledge translation interventions: a primer for researchers and health care managers
Bhattacharyya, O. K., Estey, E. A., & Zwarenstein, M. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.02.022 · Cited by 63
Changing practice in dementia care in the community: developing and testing evidence-based interventions, from timely diagnosis to end of life (EVIDEM)
Iliffe, S., Wilcock, J., Drennan, V. M., Goodman, C. M., Griffin, M., Knapp, M. R. J., Lowery, D., Manthorpe, J., Rait, G., & Warner, J. P. (2015) · Programme Grants for Applied Research · doi:10.3310/pgfar03030 · Cited by 66
Evaluating medical tourism enablers with interpretive structural modeling
Debata, B. R., Sreekumar, S., Patnaik, B., & Mahapatra, S. S. (2013) · Benchmarking An International Journal · doi:10.1108/bij-10-2011-0079 · Cited by 63
Factors influencing antibiotic prophylaxis for surgical site infection prevention in general surgery: a review of the literature.
Gagliardi, A. R., Fenech, D. S., Eskicioglu, C., Nathens, A. B., & McLeod, R. S. (2009) · Europe PMC (PubMed Central) · Cited by 63
Ethical issues in implementation research: a discussion of the problems in achieving informed consent
Hutton, J. L., Eccles, M., & Grimshaw, J. (2008) · Implementation Science · doi:10.1186/1748-5908-3-52 · Cited by 62
Self-citation
The value of monitoring frozen section-permanent section correlation data over time.
Raab, S. S., Tworek, J. A., Souers, R. J., & Zarbo, R. J. (2006) · PubMed · doi:10.5858/2006-130-337-tvomfs · Cited by 50
Impact on hospital admissions of an integrated primary care model for very frail elderly patients
de Stampa, M., Vedel, I., Buyck, J.-F., Lapointe, L., Bergman, H., Béland, F., & Ankri, J. (2014) · Archives of Gerontology and Geriatrics · doi:10.1016/j.archger.2014.01.005 · Cited by 60

Authors: Eccles, M.
Affiliations: Newcastle University (GB)
Corresponding author: Eccles, M
ORCID: Eccles, M
Venue: Quality and Safety in Health Care
Publisher: BMJ
Published: 2003-02-01
Volume: 12
Issue: 1
Pages: 47-52
ISSN: 1475-3898 (ISSN-L)
1475-3901
DOI: 10.1136/qhc.12.1.47
PMC: PMC1743658
OpenAlex: W2046947214
Cited by: 586
References: 24
Citations by year: 2026: 8 · 2025: 11 · 2024: 16 · 2023: 21 · 2022: 16 · 2021: 24 · 2020: 34 · 2019: 44 · 2018: 31 · 2017: 40 · 2016: 35 · 2015: 44 · 2014: 32 · 2013: 24 · 2012: 23
FWCI: 35.41
Type: journal article
Language: en
Open access: hybrid
doi.org
Licence: other-oa
Locations: BMJ Quality & Safety (publishedVersion, other-oa)
PubMed Central (publishedVersion)
PubMed (publishedVersion)
Funders: Newcastle University
University of Aberdeen
Topics: Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
Social Sciences › Public Administration › Evaluation and Performance Assessment
Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Quality and Management
Keywords: research design, improvement measures, randomized controlled trials, factorial design, block designs, before-after study, time series analysis, bias, generalizability, intervention development
MeSH terms: United Kingdom, Health Services Research, Humans, Organizational Innovation, Research Design, State Medicine, Reproducibility of Results, Program Evaluation, Cluster Analysis, Randomized Controlled Trials as Topic, Total Quality Management

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Research designs for studies evaluating the effectiveness of change and improvement strategies

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks