The DOI matches its Crossref record; 141 of the 141 references it cites were found in a registry or an index.
Designing and undertaking randomised implementation trials: guide for researchers
Open accessAbstract
Implementation science is the study of methods to promote the systematic uptake of evidence based interventions into practice and policy to improve health. Despite the need for high quality evidence from implementation research, randomised trials of implementation strategies often have serious limitations. These limitations include high risks of bias, limited use of theory, a lack of standard terminology to describe implementation strategies, narrowly focused implementation outcomes, and poor reporting. This paper aims to improve the evidence base in implementation science by providing guidance on the development, conduct, and reporting of randomised trials of implementation strategies. Established randomised trial methods from seminal texts and recent developments in implementation science were consolidated by an international group of researchers, health policy makers, and practitioners. This article provides guidance on the key components of randomised trials of implementation strategies, including articulation of trial aims, trial recruitment and retention strategies, randomised design selection, use of implementation science theory and frameworks, measures, sample size calculations, ethical review, and trial reporting. It also focuses on topics requiring special consideration or adaptation for implementation trials. We propose this guide as a resource for researchers, healthcare and public health policy makers or practitioners, research funders, and journal editors with the goal of advancing rigorous conduct and reporting of randomised trials of implementation strategies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
RoB 2: a revised tool for assessing risk of bias in randomised trials
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., Cates, C. J., Cheng, H.-Y., Corbett, M. S., Eldridge, S. M., et al. (2019) · BMJ · doi:10.1136/bmj.l4898 · Cited by 34,787
Evidence based medicine: what it is and what it isn't
Sackett, D. L., Rosenberg, W. M. C., Gray, J. A. M., Haynes, R. B., & Richardson, W. S. (1996) · BMJ · doi:10.1136/bmj.312.7023.71 · Cited by 15,769
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
(2002) · Cited by 13,211
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548
Social Foundations of Thought and Action
Bandura, A. (2002) · The Health Psychology Reader · doi:10.4135/9781446221129.n6 · Cited by 9,902
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721
Michie, S., Richardson, M., Johnston, M., Abraham, C., Francis, J., Hardeman, W., Eccles, M. P., Cane, J., & Wood, C. E. (2013) · Annals of Behavioral Medicine · doi:10.1007/s12160-013-9486-6 · Cited by 7,629
Process evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204
Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., & Kirchner, J. E. (2015) · Implementation Science · doi:10.1186/s13012-015-0209-1 · Cited by 4,963
Self-citationCane, J., O’Connor, D., & Michie, S. (2012) · Implementation Science · doi:10.1186/1748-5908-7-37 · Cited by 4,888
Making sense of implementation theories, models and frameworks
Nilsen, P. (2015) · Implementation Science · doi:10.1186/s13012-015-0242-0 · Cited by 4,447
Curran, G. M., Bauer, M., Mittman, B., Pyne, J. M., & Stetler, C. (2012) · Medical Care · doi:10.1097/mlr.0b013e3182408812 · Cited by 4,058
Yeh, M.-L. (2014) · Journal of Nursing Research · doi:10.1097/jnr.0000000000000065 · Cited by 3,829
Evaluating non-randomised intervention studies
Deeks, J., Dinnes, J., D'Amico, R., Sowden, A., Sakarovitch, C., Song, F., Petticrew, M., & Altman, D. (2003) · Health Technology Assessment · doi:10.3310/hta7270 · Cited by 2,907
Psychometric assessment of three newly developed implementation outcome measures
Weiner, B. J., Lewis, C. C., Stanick, C., Powell, B. J., Dorsey, C. N., Clary, A. S., Boynton, M. H., & Halko, H. (2017) · Implementation Science · doi:10.1186/s13012-017-0635-3 · Cited by 2,819
Self-citationImplementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585
Self-citationMoher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2012) · International Journal of Surgery · doi:10.1016/j.ijsu.2011.10.001 · Cited by 2,345
A theory of organizational readiness for change
Weiner, B. J. (2009) · Implementation Science · doi:10.1186/1748-5908-4-67 · Cited by 2,268
Welcome to Implementation Science
Eccles, M. P., & Mittman, B. S. (2006) · Implementation Science · doi:10.1186/1748-5908-1-1 · Cited by 2,254
Implementing, Embedding, and Integrating Practices: An Outline of Normalization Process Theory
May, C., & Finch, T. (2009) · Sociology · doi:10.1177/0038038509103208 · Cited by 2,115
The Challenge of Innovation Implementation
Klein, K. J., & Sorra, J. S. (1996) · The Academy of Management Review · doi:10.2307/259164 · Cited by 2,113
Improvising Organizational Transformation Over Time: A Situated Change Perspective
Orlikowski, W. J. (1996) · Information Systems Research · doi:10.1287/isre.7.1.63 · Cited by 1,952
The PRECIS-2 tool: designing trials that are fit for purpose
Loudon, K., Treweek, S., Sullivan, F., Donnan, P., Thorpe, K. E., & Zwarenstein, M. (2015) · BMJ · doi:10.1136/bmj.h2147 · Cited by 1,846
An introduction to implementation science for the non-specialist
Bauer, M. S., Damschroder, L., Hagedorn, H., Smith, J., & Kilbourne, A. M. (2015) · BMC Psychology · doi:10.1186/s40359-015-0089-9 · Cited by 1,611
Standards for Reporting Implementation Studies (StaRI) Statement
Pinnock, H., Barwick, M., Carpenter, C. R., Eldridge, S., Grandes, G., Griffiths, C. J., Rycroft-Malone, J., Meissner, P., Murray, E., Patel, A., et al. (2017) · BMJ · doi:10.1136/bmj.i6795 · Cited by 1,446
The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting
Hemming, K., Haines, T. P., Chilton, P. J., Girling, A. J., & Lilford, R. J. (2015) · BMJ · doi:10.1136/bmj.h391 · Cited by 1,410
Time to retire the theory of planned behaviour
Sniehotta, F. F., Presseau, J., & Araújo-Soares, V. (2014) · Health Psychology Review · doi:10.1080/17437199.2013.869710 · Cited by 1,406
Self-citationBridging Research and Practice
Tabak, R. G., Khoong, E. C., Chambers, D. A., & Brownson, R. C. (2012) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.05.024 · Cited by 1,386
Dissemination and Implementation Research in HealthTranslating Science to Practice
Brownson, R. C., Colditz, G. A., & Proctor, E. K. (2012) · doi:10.1093/acprof:oso/9780199751877.001.0001 · Cited by 1,355
French, S. D., Green, S. E., O’Connor, D. A., McKenzie, J. E., Francis, J. J., Michie, S., Buchbinder, R., Schattner, P., Spike, N., & Grimshaw, J. M. (2012) · Implementation Science · doi:10.1186/1748-5908-7-38 · Cited by 1,338
Self-citationQualitative methods in implementation research: An introduction
Hamilton, A. B., & Finley, E. P. (2019) · Psychiatry Research · doi:10.1016/j.psychres.2019.112516 · Cited by 1,315
Research co-design in health: a rapid overview of reviews
Slattery, P., Saeri, A. K., & Bragge, P. (2020) · Health Research Policy and Systems · doi:10.1186/s12961-020-0528-9 · Cited by 1,313
A compilation of strategies for implementing clinical innovations in health and mental health
Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., Glass, J. E., & York, J. L. (2012) · Medical Care Research and Review · doi:10.1177/1077558711430690 · Cited by 1,069
Self-citationMethods to Improve the Selection and Tailoring of Implementation Strategies
Powell, B. J., Beidas, R. S., Lewis, C. C., Aarons, G. A., McMillen, J. C., Proctor, E. K., & Mandell, D. S. (2017) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-015-9475-6 · Cited by 967
Self-citationStudying complexity in health services research: desperately seeking an overdue paradigm shift
Greenhalgh, T., & Papoutsi, C. (2018) · BMC Medicine · doi:10.1186/s12916-018-1089-4 · Cited by 962
The stepped wedge trial design: a systematic review
Brown, C. A., & Lilford, R. J. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-54 · Cited by 907
Clinical Research to Clinical Practice — Lost in Translation?
Lenfant, C. (2003) · New England Journal of Medicine · doi:10.1056/nejmsa035507 · Cited by 898
Plint, A. C., Moher, D., Morrison, A., Schulz, K., Altman, D. G., Hill, C., & Gaboury, I. (2006) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2006.tb00557.x · Cited by 872
Braithwaite, J., Churruca, K., Long, J. C., Ellis, L. A., & Herkes, J. (2018) · BMC Medicine · doi:10.1186/s12916-018-1057-z · Cited by 845
Demystifying theory and its use in improvement
Davidoff, F., Dixon-Woods, M., Leviton, L., & Michie, S. (2015) · BMJ Quality & Safety · doi:10.1136/bmjqs-2014-003627 · Cited by 714
Knowledge Translation in Health Care: Moving from Evidence to Practice
(2009) · International Journal of Health Care Quality Assurance · doi:10.1108/ijhcqa.2009.06222fae.002 · Cited by 694
Stirman, S. W., Miller, C. J., Toder, K., & Calloway, A. (2013) · Implementation Science · doi:10.1186/1748-5908-8-65 · Cited by 691
Treweek, S., Lockhart, P., Pitkethly, M., Cook, J. A., Kjeldstrøm, M., Johansen, M., Taskila, T. K., Sullivan, F. M., Wilson, S., Jackson, C., et al. (2013) · BMJ Open · doi:10.1136/bmjopen-2012-002360 · Cited by 623
Lewis, C. C., Klasnja, P., Powell, B. J., Lyon, A. R., Tuzzio, L., Jones, S., Walsh-Bailey, C., & Weiner, B. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00136 · Cited by 588
Self-citationBonell, C., Fletcher, A., Morton, M., Lorenc, T., & Moore, L. (2012) · Social Science & Medicine · doi:10.1016/j.socscimed.2012.08.032 · Cited by 582
A "SMART" Design for Building Individualized Treatment Sequences
Lei, H., Nahum-Shani, I., Lynch, K., Oslin, D., & Murphy, S. A. (2012) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032511-143152 · Cited by 557
Grant, A., Treweek, S., Dreischulte, T., Foy, R., & Guthrie, B. (2013) · Trials · doi:10.1186/1745-6215-14-15 · Cited by 541
Self-citationStrategies to improve recruitment to randomised trials
Treweek, S., Pitkethly, M., Cook, J., Fraser, C., Mitchell, E., Sullivan, F., Jackson, C., Taskila, T. K., & Gardner, H. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000013.pub6 · Cited by 521
An Overview of Research and Evaluation Designs for Dissemination and Implementation
Brown, C. H., Curran, G., Palinkas, L. A., Aarons, G. A., Wells, K. B., Jones, L., Collins, L. M., Duan, N., Mittman, B. S., Wallace, A., et al. (2017) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031816-044215 · Cited by 509
Improving Patient Care: The Implementation of Change in Health Care
(2013) · doi:10.1002/9781118525975 · Cited by 506
Ten recommendations for using implementation frameworks in research and practice
Moullin, J. C., Dickson, K. S., Stadnick, N. A., Albers, B., Nilsen, P., Broder-Fingert, S., Mukasa, B., & Aarons, G. A. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00023-7 · Cited by 488
Knowledge Translation in Health Care
(2013) · Wiley eBooks · doi:10.1002/9781118413555 · Cited by 476
Hemming, K., Taljaard, M., McKenzie, J. E., Hooper, R., Copas, A., Thompson, J. A., Dixon-Woods, M., Aldcroft, A., Doussau, A., Grayling, M., et al. (2018) · BMJ · doi:10.1136/bmj.k1614 · Cited by 475
Self-citationBirken, S. A., Powell, B. J., Shea, C. M., Haines, E. R., Alexis Kirk, M., Leeman, J., Rohweder, C., Damschroder, L., & Presseau, J. (2017) · Implementation Science · doi:10.1186/s13012-017-0656-y · Cited by 471
Self-citationAlmirall, D., Nahum-Shani, I., Sherwood, N. E., & Murphy, S. A. (2014) · Translational Behavioral Medicine · doi:10.1007/s13142-014-0265-0 · Cited by 453
Campbell, M., Snowdon, C., Francis, D., Elbourne, D., McDonald, A., Knight, R., Entwistle, V, Garcia, J., Roberts, I., Grant, A., et al. (2007) · Health Technology Assessment · doi:10.3310/hta11480 · Cited by 433
Methods for sample size determination in cluster randomized trials
Rutterford, C., Copas, A., & Eldridge, S. (2015) · International Journal of Epidemiology · doi:10.1093/ije/dyv113 · Cited by 429
Action, actor, context, target, time (AACTT): a framework for specifying behaviour
Presseau, J., McCleary, N., Lorencatto, F., Patey, A. M., Grimshaw, J. M., & Francis, J. J. (2019) · Implementation Science · doi:10.1186/s13012-019-0951-x · Cited by 411
Self-citationDesigning theoretically-informed implementation interventions
The Improved Clinical Effectiveness through Behavioural Research Group (ICEBeRG) (2006) · Implementation Science · doi:10.1186/1748-5908-1-4 · Cited by 380
Experimental and quasi-experimental designs in implementation research
Miller, C. J., Smith, S. N., & Pugatch, M. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2019.06.027 · Cited by 373
A systematic review of empirical studies examining mechanisms of implementation in health
Lewis, C. C., Boyd, M. R., Walsh-Bailey, C., Lyon, A. R., Beidas, R., Mittman, B., Aarons, G. A., Weiner, B. J., & Chambers, D. A. (2020) · Implementation Science · doi:10.1186/s13012-020-00983-3 · Cited by 363
McKibbon, K. A., Lokker, C., Wilczynski, N. L., Ciliska, D., Dobbins, M., Davis, D. A., Haynes, R. B., & Straus, S. E. (2010) · Implementation Science · doi:10.1186/1748-5908-5-16 · Cited by 345
Reporting of Multi-Arm Parallel-Group Randomized Trials: Extension of the CONSORT 2010 Statement
Juszczak, E., Altman, D. G., Hopewell, S., & Schulz, K. (2019) · JAMA · doi:10.1001/jama.2019.3087 · Cited by 324
Patient and Stakeholder Engagement in the PCORI Pilot Projects: Description and Lessons Learned
Forsythe, L. P., Ellis, L. E., Edmundson, L., Sabharwal, R., Rein, A., Konopka, K., & Frank, L. (2016) · Journal of General Internal Medicine · doi:10.1007/s11606-015-3450-z · Cited by 323
ADJUSTING FOR NON-COMPLIANCE AND CONTAMINATION IN RANDOMIZED CLINICAL TRIALS
CUZICK, J., EDWARDS, R., & SEGNAN, N. (1997) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19970515)16:9<1017::aid-sim508>3.0.co;2-v · Cited by 309
Mant, J., & Hicks, N. (1995) · BMJ · doi:10.1136/bmj.311.7008.793 · Cited by 303
Campbell, M. K., Mollison, J., & Grimshaw, J. M. (2001) · Statistics in Medicine · doi:10.1002/1097-0258(20010215)20:3<391::aid-sim800>3.0.co;2-z · Cited by 299
Self-citationColquhoun, H. L., Squires, J. E., Kolehmainen, N., Fraser, C., & Grimshaw, J. M. (2017) · Implementation Science · doi:10.1186/s13012-017-0560-5 · Cited by 283
Self-citationHawe, P., Shiell, A., Riley, T., & Gold, L. (2004) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2003.014415 · Cited by 283
Kabisch, M., Ruckes, C., Seibert‐Grafe, M., & Blettner, M. (2011) · Deutsches Ärzteblatt international · doi:10.3238/arztebl.2011.0663 · Cited by 269
Internal and external validity of cluster randomised trials: systematic review of recent trials
Eldridge, S., Ashby, D., Bennett, C., Wakelin, M., & Feder, G. (2008) · BMJ · doi:10.1136/bmj.39517.495764.25 · Cited by 224
Eccles, M., Steen, N., Grimshaw, J., Thomas, L., McNamee, P., Soutter, J., Wilsdon, J., Matowe, L., Needham, G., Gilbert, F., et al. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04564-5 · Cited by 222
Self-citationWolfenden, L., Jones, J., Williams, C. M., Finch, M., Wyse, R. J., Kingsland, M., Tzelepis, F., Wiggers, J., Williams, A. J., Seward, K., et al. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011779.pub2 · Cited by 220
Self-citationForsythe, L., Heckert, A., Margolis, M. K., Schrandt, S., & Frank, L. (2018) · Quality of Life Research · doi:10.1007/s11136-017-1581-x · Cited by 214
Chilcott, J., Lloyd Jones, M., Wight, J., Forman, K., Wray, J., Beverley, C., & Tappenden, P. (2003) · Health Technology Assessment · doi:10.3310/hta7040 · Cited by 210
A Three-Step Approach to Teaching Logic Models
RENGER, R. (2002) · The American Journal of Evaluation · doi:10.1016/s1098-2140(02)00230-8 · Cited by 204
T-CaST: an implementation theory comparison and selection tool
Birken, S. A., Rohweder, C. L., Powell, B. J., Shea, C. M., Scott, J., Leeman, J., Grewe, M. E., Alexis Kirk, M., Damschroder, L., Aldridge, W. A., et al. (2018) · Implementation Science · doi:10.1186/s13012-018-0836-4 · Cited by 194
Self-citationWolfenden, L., Barnes, C., Jones, J., Finch, M., Wyse, R. J., Kingsland, M., Tzelepis, F., Grady, A., Hodder, R. K., Booth, D., et al. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011779.pub3 · Cited by 190
Self-citationA review and critique of modelling in prioritising and designing screening programmes
Karnon, J., Goyder, E., Tappenden, P., McPhie, S., Towers, I., Brazier, J., & Madan, J. (2007) · Health Technology Assessment · doi:10.3310/hta11520 · Cited by 184
Crossing the Global Quality Chasm: Improving Health Care Worldwide
Committee on Improving the Quality of Health Care Globally, Board on Global Health, Board on Health Care Services, Division, H. A. M., & National Academies of Sciences, E. (2018) · National Academies Press eBooks · doi:10.17226/25152 · Cited by 179
Statistical primer: sample size and power calculations—why, when and how?†
Hickey, G. L., Grant, S. W., Dunning, J., & Siepe, M. (2018) · European Journal of Cardio-Thoracic Surgery · doi:10.1093/ejcts/ezy169 · Cited by 178
Sussman, J. B., & Hayward, R. A. (2010) · BMJ · doi:10.1136/bmj.c2073 · Cited by 176
Role of patient and public involvement in implementation research: a consensus study
Gray-Burrows, K. A., Willis, T. A., Foy, R., Rathfelder, M., Bland, P., Chin, A., Hodgson, S., Ibegbuna, G., Prestwich, G., Samuel, K., et al. (2018) · BMJ Quality & Safety · doi:10.1136/bmjqs-2017-006954 · Cited by 176
Self-citationHemming, K., & Taljaard, M. (2020) · International Journal of Epidemiology · doi:10.1093/ije/dyaa077 · Cited by 176
Self-citationWolfenden, L., Nathan, N. K., Sutherland, R., Yoong, S. L., Hodder, R. K., Wyse, R. J., Delaney, T., Grady, A., Fielding, A., Tzelepis, F., et al. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011677.pub2 · Cited by 171
Self-citationMcKay, H., Naylor, P.-J., Lau, E., Gray, S. M., Wolfenden, L., Milat, A., Bauman, A., Race, D., Nettlefold, L., & Sims-Gould, J. (2019) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-019-0868-4 · Cited by 169
Self-citationContamination in trials of educational interventions
Keogh-Brown, M., Bachmann, M., Shepstone, L., Hewitt, C., Howe, A., Ramsay, C., Song, F., Miles, J., Torgerson, D., Miles, S., et al. (2007) · Health Technology Assessment · doi:10.3310/hta11430 · Cited by 168
Quantitative approaches for the evaluation of implementation research studies
Smith, J. D., & Hasan, M. M. (2019) · Psychiatry Research · doi:10.1016/j.psychres.2019.112521 · Cited by 166
Lane-Fall, M. B., Curran, G. M., & Beidas, R. S. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0783-z · Cited by 161
Bias in identifying and recruiting participants in cluster randomised trials: what can be done?
Eldridge, S., Kerry, S., & Torgerson, D. J. (2009) · BMJ · doi:10.1136/bmj.b4006 · Cited by 159
Coincidence analysis: a new method for causal inference in implementation science
Whitaker, R., Sperber, N. R., Baumgärtner, M., Thiem, A., Cragun, D. L., Damschroder, L. J., Miech, E. J., Slade, A., & Birken, S. A. (2020) · Implementation Science · doi:10.1186/s13012-020-01070-3 · Cited by 159
Routinely collected data for randomized trials: promises, barriers, and implications
Cord, K. A. M., Salman, R. A., Treweek, S. P., Gardner, H., Strech, D., Whiteley, W. N., Ioannidis, J. P. A., & Hemkens, L. G. (2018) · Trials · doi:10.1186/s13063-017-2394-5 · Cited by 157
Lewis, C. C., Stanick, C. F., Martinez, R. G., Weiner, B. J., Kim, M., Barwick, M., & Comtois, K. A. (2016) · Implementation Science · doi:10.1186/s13012-014-0193-x · Cited by 155
Preventing Bias in Cluster Randomised Trials
Giraudeau, B., & Ravaud, P. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000065 · Cited by 150
Finch, M., Jones, J. Z., Yoong, S. L., Wiggers, J., & Wolfenden, L. (2016) · Obesity Reviews · doi:10.1111/obr.12392 · Cited by 140
Self-citationSquires, J. E., Aloisio, L. D., Grimshaw, J., Bashir, K., Dorrance, K., Coughlin, M., Hutchinson, A. M., Francis, J., Michie, S., Sales, A. E., et al. (2019) · Implementation Science · doi:10.1186/s13012-019-0900-8 · Cited by 133
Self-citationByng, R., Norman, I. J., Redfern, S., & Jones, R. H. (2008) · BMC Health Services Research · doi:10.1186/1472-6963-8-274 · Cited by 125
When is informed consent required in cluster randomized trials in health research?
McRae, A. D., Weijer, C., Binik, A., Grimshaw, J., Boruch, R. F., Brehaut, J., Donner, A. P., Eccles, M., Saginur, R., White, A., et al. (2011) · Trials · doi:10.1186/1745-6215-12-202 · Cited by 121
Self-citationAn updated protocol for a systematic review of implementation-related measures
Lewis, C. C., Mettert, K. D., Dorsey, C. N., Martinez, R. G., Weiner, B. J., Nolen, E., Stanick, C., Halko, H., & Powell, B. J. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0728-3 · Cited by 118
Self-citationClinton-McHarg, T., Yoong, S. L., Tzelepis, F., Regan, T., Fielding, A., Skelton, E., Kingsland, M., Ooi, J. Y., & Wolfenden, L. (2016) · Implementation Science · doi:10.1186/s13012-016-0512-5 · Cited by 116
Self-citationLapointe‐Shaw, L., Bouck, Z., Howell, N. A., Lange, T., Orchanian‐Cheff, A., Austin, P. C., Ivers, N. M., Redelmeier, D. A., & Bell, C. M. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0578-7 · Cited by 110
Self-citationDeveloping multicomponent interventions using fractional factorial designs
Chakraborty, B., Collins, L. M., Strecher, V. J., & Murphy, S. A. (2009) · Statistics in Medicine · doi:10.1002/sim.3643 · Cited by 107
Do complexity-informed health interventions work? A scoping review
Brainard, J. S., & Hunter, P. R. (2015) · Implementation Science · doi:10.1186/s13012-016-0492-5 · Cited by 104
Brown, C., Hofer, T., Johal, A., Thomson, R., Nicholl, J., Franklin, B. D., & Lilford, R. J. (2008) · Quality and Safety in Health Care · doi:10.1136/qshc.2007.023655 · Cited by 100
Substantial risks associated with few clusters in cluster randomized and stepped wedge designs
Taljaard, M., Teerenstra, S., Ivers, N. M., & Fergusson, D. A. (2016) · Clinical Trials · doi:10.1177/1740774516634316 · Cited by 100
Self-citationMagill, N., Knight, R., McCrone, P., Ismail, K., & Landau, S. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0646-z · Cited by 100
Real-world studies no substitute for RCTs in establishing efficacy
Gerstein, H. C., McMurray, J., & Holman, R. R. (2019) · The Lancet · doi:10.1016/s0140-6736(18)32840-x · Cited by 97
Taljaard, M., Weijer, C., Grimshaw, J., Eccles, M. P., & the Ottawa Ethics of Cluster Randomised Trials Consensus Group (2013) · BMJ · doi:10.1136/bmj.f2838 · Cited by 90
Self-citationDe-implementation: A concept analysis
Upvall, M. J., & Bourgault, A. M. (2018) · Nursing Forum · doi:10.1111/nuf.12256 · Cited by 90
Murtagh, M. J., Thomson, R. G., May, C. R., Rapley, T., Heaven, B., Graham, R. H., Kaner, E., Stobbart, L., & Eccles, M. P. (2007) · BMJ Quality & Safety · doi:10.1136/qshc.2006.018499 · Cited by 89
Grimshaw, J., Zwarenstein, M., Tetroe, J., Godin, G., Graham, I. D., Lemyre, L., Eccles, M., Johnston, M., Francis, J., Hux, J. E., et al. (2007) · Implementation Science · doi:10.1186/1748-5908-2-38 · Cited by 87
Self-citationFarrin, A. J., Russell, I. T., Torgerson, D. J., & Underwood, M. R. (2005) · Clinical Trials · doi:10.1191/1740774505cn073oa · Cited by 83
Jones, J. Z., Wyse, R., Finch, M., Lecathelinais, C., Wiggers, J., Marshall, J. M., Falkiner, M., Pond, N., Yoong, S. L., Hollis, J., et al. (2015) · Implementation Science · doi:10.1186/s13012-015-0340-z · Cited by 81
Self-citationIvers, N. M., Schwalm, J.-D., Bouck, Z., McCready, T., Taljaard, M., Grace, S. L., Cunningham, J., Bosiak, B., Presseau, J., Witteman, H. O., et al. (2020) · BMJ · doi:10.1136/bmj.m1731 · Cited by 76
Self-citationSimpson, K. M. J., Porter, K. A., McConnell, E. S., Colon-Emeric, C. S., Daily, K. A., Stalzer, A., & Anderson, R. A. (2013) · Implementation Science · doi:10.1186/1748-5908-8-2 · Cited by 71
Liddy, C. E., Hogg, W. E., Singh, J., Taljaard, M., Russell, G. M., Armstrong, C. D., Akbari, A., Dahrouge, S., & Grimshaw, J. (2015) · Implementation Science · doi:10.1186/s13012-015-0341-y · Cited by 68
Self-citationMcIntyre, S. A., Francis, J., Gould, N. J., & Lorencatto, F. (2018) · Translational Behavioral Medicine · doi:10.1093/tbm/iby110 · Cited by 63
Hutton, J. L., Eccles, M., & Grimshaw, J. (2008) · Implementation Science · doi:10.1186/1748-5908-3-52 · Cited by 62
Self-citationWho is the research subject in cluster randomized trials in health research?
McRae, A. D., Weijer, C., Binik, A., White, A., Grimshaw, J., Boruch, R. F., Brehaut, J., Donner, A. P., Eccles, M., Saginur, R., et al. (2011) · Trials · doi:10.1186/1745-6215-12-183 · Cited by 61
Self-citationGrimshaw, J., Presseau, J., Tetroe, J., Eccles, M., Francis, J., Godin, G., Graham, I. D., Hux, J. E., Johnston, M., Légaré, F., et al. (2014) · Implementation Science · doi:10.1186/1748-5908-9-86 · Cited by 50
Self-citationContamination in complex healthcare trials: the falls in care homes (FinCH) study experience
Robinson, K., Allen, F. A., Darby, J., Fox, C., Gordon, A. L., Horne, J. C., Leighton, P. A., Sims, E. J., & Logan, P. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-00925-z · Cited by 49
Yoong, S. L., Wolfenden, L., Clinton‐McHarg, T., Waters, E., Pettman, T. L., Steele, E. J., & Wiggers, J. (2014) · Journal of Public Health · doi:10.1093/pubmed/fdu006 · Cited by 48
Self-citationReducing research waste and improving research impact
Wolfenden, L., Ziersch, A. M., Robinson, P. M., Lowe, J. B., & Wiggers, J. (2015) · Australian and New Zealand Journal of Public Health · doi:10.1111/1753-6405.12467 · Cited by 48
Self-citationJohnson, J. E., Stirman, S. W., Sikorskii, A. E., Miller, T. R., King, A., Blume, J. L., Pham, X., Simas, T. A. M., Poleshuck, E. L., Weinberg, R. J., et al. (2018) · Implementation Science · doi:10.1186/s13012-018-0807-9 · Cited by 48
Wolfenden, L., Reilly, K., Kingsland, M., Grady, A., Williams, C. M., Nathan, N., Sutherland, R., Wiggers, J., Jones, J. Z., Hodder, R. K., et al. (2018) · Preventive Medicine · doi:10.1016/j.ypmed.2018.11.014 · Cited by 46
Self-citationPresseau, J., Grimshaw, J., Tetroe, J., Eccles, M., Francis, J., Godin, G., Graham, I. D., Hux, J. E., Johnston, M., Légaré, F., et al. (2015) · Implementation Science · doi:10.1186/s13012-016-0485-4 · Cited by 45
Self-citationHodder, R. K., Wolfenden, L., Kamper, S. J., Lee, H., Williams, A. J., O’Brien, K. M., & Williams, C. M. (2016) · Best Practice & Research Clinical Rheumatology · doi:10.1016/j.berh.2017.05.002 · Cited by 45
Self-citationFoy, R., Penney, G. C., Grimshaw, J. M., Ramsay, C. R., Walker, A. E., MacLennan, G., Stearns, S. C., McKenzie, L., & Glasier, A. (2004) · BJOG: An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.2004.00168.x · Cited by 44
Self-citationHamilton, A. B., Mittman, B. S., Campbell, D., Hutchinson, C. S., Liu, H., Moss, N. J., & Wyatt, G. E. (2018) · BMC Health Services Research · doi:10.1186/s12913-017-2791-1 · Cited by 40
Willis, T. A., Collinson, M., Glidewell, L., Farrin, A. J., Holland, M., Meads, D. M., Hulme, C. T., Petty, D. R., Alderson, S. L., Hartley, S., et al. (2020) · PLoS Medicine · doi:10.1371/journal.pmed.1003045 · Cited by 38
Self-citationPresseau, J., Mackintosh, J. E., Hawthorne, G., Francis, J., Johnston, M., Grimshaw, J., Steen, N., Coulthard, T., Brown, H., Kaner, E., et al. (2018) · Implementation Science · doi:10.1186/s13012-018-0754-5 · Cited by 36
Self-citationPrinciples and procedures for data and safety monitoring in pragmatic clinical trials
Simon, G. E., Shortreed, S. M., Rossom, R. C., Penfold, R. B., Sperl‐Hillen, J. M., & O’Connor, P. J. (2019) · Trials · doi:10.1186/s13063-019-3869-3 · Cited by 35
for the AFFINITIE programme, Hartley, S., Foy, R., Walwyn, R. E. A., Cicero, R., Farrin, A. J., Francis, J., Lorencatto, F., Gould, N. J., Grant‐Casey, J., et al. (2017) · Implementation Science · doi:10.1186/s13012-017-0614-8 · Cited by 33
Self-citationExplanatory and pragmatic clinical trials A primer and application to a recent asthma trial
Sackett, D. L. (2011) · Polskie Archiwum Medycyny Wewnętrznej · doi:10.20452/pamw.1071 · Cited by 32
Cutting edge or blunt instrument: how to decide if a stepped wedge design is right for you
Hooper, R., & Eldridge, S. M. (2020) · BMJ Quality & Safety · doi:10.1136/bmjqs-2020-011620 · Cited by 27
Wolfenden, L., Williams, C. M., Kingsland, M., Yoong, S. L., Nathan, N., Sutherland, R., & Wiggers, J. (2020) · Australian and New Zealand Journal of Public Health · doi:10.1111/1753-6405.13023 · Cited by 16
Self-citationHewitt, C. E., Torgerson, D. J., & Miles, J. N. V. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.12.002 · Cited by 14
Accommodating quality and service improvement research within existing ethical principles
Goldstein, C. E., Weijer, C., Brehaut, J., Campbell, M., Fergusson, D. A., Grimshaw, J., Hemming, K., Horn, A. R., & Taljaard, M. (2018) · Trials · doi:10.1186/s13063-018-2724-2 · Cited by 12
Self-citationLord, P. A., Willis, T. A., Carder, P., West, R. M., & Foy, R. (2016) · Family Practice · doi:10.1093/fampra/cmw003 · Cited by 8
Self-citation
Research works printed but not linked: 4
- 10.1002/9781119488620 · doi:10.1002/9781119488620
- 10.1177/109821400202300409 · doi:10.1177/109821400202300409 · Paper page
- Ajzen I . Attitudes, personality, and behaviour. McGraw-Hill Education (UK), 2005;1-144.
- 10.5465/AMR.1996.9704071863 · doi:10.5465/amr.1996.9704071863 · Paper page
Cited by
Ten years of implementation outcomes research: a scoping review
Proctor, E. K., Bunger, A. C., Lengnick-Hall, R., Gerke, D. R., Martin, J. K., Phillips, R. J., & Swanson, J. C. (2023) · Implementation Science · doi:10.1186/s13012-023-01286-z · Cited by 424
“Although some have questioned testing implementation outcomes as dependent variables [55], rigorous trials of implementation strategies are important for learning how to achieve acceptability, feasibility, adoption, and sustainment.”
BackgroundReflections on 10 years of effectiveness-implementation hybrid studies
Curran, G. M., Landes, S. J., McBain, S. A., Pyne, J. M., Smith, J. D., Fernandez, M. E., Chambers, D. A., & Mittman, B. S. (2022) · Frontiers in Health Services · doi:10.3389/frhs.2022.1053496 · Cited by 299
Beidas, R. S., Dorsey, S., Lewis, C. C., Lyon, A. R., Powell, B. J., Purtle, J., Saldana, L., Shelton, R. C., Stirman, S. W., & Lane-Fall, M. B. (2022) · Implementation Science · doi:10.1186/s13012-022-01226-3 · Cited by 230
Self-citationNathan, N., Powell, B. J., Shelton, R. C., Laur, C. V., Wolfenden, L., Hailemariam, M., Yoong, S. L., Sutherland, R., Kingsland, M., Waltz, T. J., et al. (2022) · Frontiers in Health Services · doi:10.3389/frhs.2022.905909 · Cited by 105
Self-citationBalis, L. E., Houghtaling, B., & Harden, S. M. (2022) · Translational Behavioral Medicine · doi:10.1093/tbm/ibac061 · Cited by 63
Metadata
- Authors
- Wolfenden, L., Foy, R., Presseau, J., Grimshaw, J. M., Ivers, N. M., Powell, B. J., Taljaard, M., Wiggers, J., Sutherland, R., Nathan, N., Williams, C. M., Kingsland, M., Milat, A., Hodder, R. K., & Yoong, S. L.
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2021-01-18
- Volume
- 372
- Pages
- m3721
- ISSN
- 1756-1833 (ISSN-L)
- OpenAlex
- W3125372746
- Cited by
- 270
- References
- 141
- FWCI
- 52.95
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.