The DOI matches its Crossref record; 325 of the 325 references it cites were found in a registry or an index.
Framework for the development and evaluation of complex interventions: gap analysis, workshop and consultation-informed update
Open accessAbstract
Background: The Medical Research Council published the second edition of its framework in 2006 on developing and evaluating complex interventions. Since then, there have been considerable developments in the field of complex intervention research. The objective of this project was to update the framework in the light of these developments. The framework aims to help research teams prioritise research questions and design, and conduct research with an appropriate choice of methods, rather than to provide detailed guidance on the use of specific methods. Methods: There were four stages to the update: (1) gap analysis to identify developments in the methods and practice since the previous framework was published; (2) an expert workshop of 36 participants to discuss the topics identified in the gap analysis; (3) an open consultation process to seek comments on a first draft of the new framework; and (4) findings from the previous stages were used to redraft the framework, and final expert review was obtained. The process was overseen by a Scientific Advisory Group representing the range of relevant National Institute for Health Research and Medical Research Council research investments. Results: Key changes to the previous framework include (1) an updated definition of complex interventions, highlighting the dynamic relationship between the intervention and its context; (2) an emphasis on the use of diverse research perspectives: efficacy, effectiveness, theory-based and systems perspectives; (3) a focus on the usefulness of evidence as the basis for determining research perspective and questions; (4) an increased focus on interventions developed outside research teams, for example changes in policy or health services delivery; and (5) the identification of six ‘core elements’ that should guide all phases of complex intervention research: consider context; develop, refine and test programme theory; engage stakeholders; identify key uncertainties; refine the intervention; and economic considerations. We divide the research process into four phases: development, feasibility, evaluation and implementation. For each phase we provide a concise summary of recent developments, key points to address and signposts to further reading. We also present case studies to illustrate the points being made throughout. Limitations: The framework aims to help research teams prioritise research questions and design and conduct research with an appropriate choice of methods, rather than to provide detailed guidance on the use of specific methods. In many of the areas of innovation that we highlight, such as the use of systems approaches, there are still only a few practical examples. We refer to more specific and detailed guidance where available and note where promising approaches require further development. Conclusions: This new framework incorporates developments in complex intervention research published since the previous edition was written in 2006. As well as taking account of established practice and recent refinements, we draw attention to new approaches and place greater emphasis on economic considerations in complex intervention research. We have introduced a new emphasis on the importance of context and the value of understanding interventions as ‘events in systems’ that produce effects through interactions with features of the contexts in which they are implemented. The framework adopts a pluralist approach, encouraging researchers and research funders to adopt diverse research perspectives and to select research questions and methods pragmatically, with the aim of providing evidence that is useful to decision-makers. Future work: We call for further work to develop relevant methods and provide examples in practice. The use of this framework should be monitored and the move should be made to a more fluid resource in the future, for example a web-based format that can be frequently updated to incorporate new material and links to emerging resources. Funding: This project was jointly funded by the Medical Research Council (MRC) and the National Institute for Health Research (Department of Health and Social Care 73514).
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Designing and Conducting Mixed Methods Research
Robinson, P. (2007) · Australian and New Zealand Journal of Public Health · doi:10.1111/j.1753-6405.2007.00096.x · Cited by 23,258
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-8-200710160-00010 · Cited by 17,796
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
Methods for the Economic Evaluation of Health Care Programmes
Drummond, M. E., Sculpher, M. J., Torrance, G. W., O’Brien, B. J., & Stoddart, G. L. (2005) · doi:10.1093/oso/9780198529446.001.0001 · Cited by 13,648
Standards for Reporting Qualitative Research: A Synthesis of Recommendations
O’Brien, B. C., Harris, I. B., Beckman, T. J., Reed, D. A., & Cook, D. A. (2014) · Academic Medicine · doi:10.1097/acm.0000000000000388 · Cited by 12,211
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995
Self-citationHoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548
Beneficial Effect of Carotid Endarterectomy in Symptomatic Patients with High-Grade Carotid Stenosis
(1991) · New England Journal of Medicine · doi:10.1056/nejm199108153250701 · Cited by 8,368
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448
SPIRIT 2013 Statement: Defining Standard Protocol Items for Clinical Trials
Chan, A.-W., Tetzlaff, J. M., Altman, D. G., Laupacis, A., Gøtzsche, P. C., Krleža-Jerić, K., Hróbjartsson, A., Mann, H., Dickersin, K., Berlin, J. A., et al. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-158-3-201302050-00583 · Cited by 7,363
(2014) · The SAGE Encyclopedia of Action Research · doi:10.4135/9781446294406.n148 · Cited by 7,250
Process evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204
Self-citationNeufeld, A., & Ryan, A. G. (1988) · Canadian Journal of Program Evaluation · doi:10.3138/cjpe.3.006 · Cited by 5,913
Skivington, K., Matthews, L., Simpson, S. A., Craig, P., Baird, J., Blazeby, J. M., Boyd, K. A., Craig, N., French, D. P., McIntosh, E., et al. (2021) · BMJ · doi:10.1136/bmj.n2061 · Cited by 5,808
Self-citationCochrane Handbook for Systematic Reviews of Interventions
Higgins, J. P. T., Green, S., & Ben Van Den, A. (2020) · International Coaching Psychology Review · doi:10.53841/bpsicpr.2020.15.2.123 · Cited by 5,670
Abadie, A., Diamond, A., & Hainmueller, J. (2010) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.ap08746 · Cited by 5,513
Making sense of implementation theories, models and frameworks
Nilsen, P. (2015) · Implementation Science · doi:10.1186/s13012-015-0242-0 · Cited by 4,447
Methods for the economic evaluation of health care programmes
Wilson, S. H. (1987) · Journal of Epidemiology and Community Health · doi:10.1136/jech.41.4.355-a · Cited by 4,275
Curran, G. M., Bauer, M., Mittman, B., Pyne, J. M., & Stetler, C. (2012) · Medical Care · doi:10.1097/mlr.0b013e3182408812 · Cited by 4,058
Consort 2010 statement: extension to cluster randomised trials
Campbell, M. K., Piaggio, G., Elbourne, D. R., Altman, D. G., & for the CONSORT Group (2012) · BMJ · doi:10.1136/bmj.e5661 · Cited by 3,510
Framework for design and evaluation of complex interventions to improve health
Campbell, M. (2000) · BMJ · doi:10.1136/bmj.321.7262.694 · Cited by 3,474
Soft Systems Methodology in Action
Gough, T. G. (1991) · Journal of the Operational Research Society · doi:10.1057/jors.1991.157 · Cited by 3,414
CONSORT 2010 statement: extension to randomised pilot and feasibility trials.
Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · BMJ · doi:10.1136/bmj.i5239 · Cited by 3,404
Realist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190
Decision Modelling For Health Economic Evaluation
Briggs, A., Claxton, K., & Sculpher, M. (2006) · doi:10.1093/oso/9780198526629.001.0001 · Cited by 3,153
Configurational Comparative Methods: Qualitative Comparative Analysis (QCA) and Related Techniques
Rihoux, B., & Ragin, C. (2009) · SAGE Publications · doi:10.4135/9781452226569 · Cited by 3,089
(2009) · Choice Reviews Online · doi:10.5860/choice.46-6156 · Cited by 3,071
Sanders, G. D., Neumann, P. J., Basu, A., Brock, D. W., Feeny, D., Krahn, M., Kuntz, K. M., Meltzer, D. O., Owens, D. K., Prosser, L. A., et al. (2016) · JAMA · doi:10.1001/jama.2016.12195 · Cited by 3,069
Interrupted time series regression for the evaluation of public health interventions: a tutorial
Lopez Bernal, J., Cummins, S., & Gasparrini, A. (2016) · International Journal of Epidemiology · doi:10.1093/ije/dyw098 · Cited by 3,049
Effectiveness and efficiency of guideline dissemination and implementation strategies
Grimshaw, J., Thomas, R., MacLennan, G., Fraser, C., Ramsay, C., Vale, L., Whitty, P., Eccles, M., Matowe, L., Shirran, L., et al. (2004) · Health Technology Assessment · doi:10.3310/hta8060 · Cited by 3,044
CONSORT 2010 statement: extension to randomised pilot and feasibility trials
on behalf of the PAFS consensus group, Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · Pilot and Feasibility Studies · doi:10.1186/s40814-016-0105-8 · Cited by 2,843
Bellg, A. J., Treatment Fidelity Workgroup of the NIH Behavior Change Consortium, Borrelli, B., Resnick, B., Hecht, J., Minicucci, D. S., Ory, M., Ogedegbe, G., Orwig, D., Ernst, D., et al. (2004) · Health Psychology · doi:10.1037/0278-6133.23.5.443 · Cited by 2,620
The challenge of complexity in health care
Plsek, P. E., & Greenhalgh, T. (2001) · BMJ · doi:10.1136/bmj.323.7313.625 · Cited by 2,578
RE-AIM Planning and Evaluation Framework: Adapting to New Science and Practice With a 20-Year Review
Glasgow, R. E., Harden, S. M., Gaglio, B., Rabin, B., Smith, M. L., Porter, G. C., Ory, M. G., & Estabrooks, P. A. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00064 · Cited by 2,528
Women as Policy Makers: Evidence from a Randomized Policy Experiment in India
Chattopadhyay, R., & Duflo, E. (2004) · Econometrica · doi:10.1111/j.1468-0262.2004.00539.x · Cited by 2,284
Welcome to Implementation Science
Eccles, M. P., & Mittman, B. S. (2006) · Implementation Science · doi:10.1186/1748-5908-1-1 · Cited by 2,254
Pharmaceutical industry sponsorship and research outcome and quality: systematic review
Lexchin, J., Bero, L. A., Djulbegovic, B., & Clark, O. (2003) · BMJ · doi:10.1136/bmj.326.7400.1167 · Cited by 2,147
Planning health promotion programs an intervention mapping approach
Bartholomew, L. K., Parcel, G. S., Kok, G., & Gottlieb, N. (2006) · Research Publications (Maastricht University) · Cited by 2,040
Staniszewska, S., Brett, J., Simera, I., Seers, K., Mockford, C., Goodlad, S., Altman, D. G., Moher, D., Barber, R., Denegri, S., et al. (2017) · BMJ · doi:10.1136/bmj.j3453 · Cited by 1,983
The PRECIS-2 tool: designing trials that are fit for purpose
Loudon, K., Treweek, S., Sullivan, F., Donnan, P., Thorpe, K. E., & Zwarenstein, M. (2015) · BMJ · doi:10.1136/bmj.h2147 · Cited by 1,846
Understanding and misunderstanding randomized controlled trials
Deaton, A., & Cartwright, N. (2018) · Social Science & Medicine · doi:10.1016/j.socscimed.2017.12.005 · Cited by 1,841
Planning Health Promotion Programs: An Intervention Mapping Approach
Hicking-Woodison, L. (2017) · Nursing Standard · doi:10.7748/ns.32.6.33.s38 · Cited by 1,841
Improving the reporting of pragmatic trials: An extension of the CONSORT statement
Zwarenstein, M., Treweek, S., Gagnier, J. J., Altman, D. G., Tunis, S., Haynes, B., Oxman, A. D., Moher, D., & groups, F. T. C. A. P. T. I. H. (. (2008) · BMJ · doi:10.1136/bmj.a2390 · Cited by 1,813
Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement
Husereau, D., Drummond, M., Petrou, S., Carswell, C., Moher, D., Greenberg, D., Augustovski, F., Briggs, A. H., Mauskopf, J., Loder, E., et al. (2013) · BMJ · doi:10.1136/bmj.f1049 · Cited by 1,776
Guetterman, T. C., Fetters, M. D., & Creswell, J. W. (2015) · The Annals of Family Medicine · doi:10.1370/afm.1865 · Cited by 1,740
Moodie, R., Stuckler, D., Monteiro, C., Sheron, N., Neal, B., Thamarangsi, T., Lincoln, P., & Casswell, S. (2013) · The Lancet · doi:10.1016/s0140-6736(12)62089-3 · Cited by 1,663
Developing core outcome sets for clinical trials: issues to consider
Williamson, P. R., Altman, D. G., Blazeby, J. M., Clarke, M., Devane, D., Gargon, E., & Tugwell, P. (2012) · Trials · doi:10.1186/1745-6215-13-132 · Cited by 1,661
Self-citationStaniszewska, S., Brett, J., Simera, I., Seers, K., Mockford, C., Goodlad, S., Altman, D. G., Moher, D., Barber, R., Denegri, S., et al. (2017) · Research Involvement and Engagement · doi:10.1186/s40900-017-0062-2 · Cited by 1,643
An introduction to implementation science for the non-specialist
Bauer, M. S., Damschroder, L., Hagedorn, H., Smith, J., & Kilbourne, A. M. (2015) · BMC Psychology · doi:10.1186/s40359-015-0089-9 · Cited by 1,611
Guidance on how to develop complex interventions to improve health and healthcare
O"Cathain, A., Croot, L., Duncan, E., Rousseau, N., Sworn, K., Turner, K. M., Yardley, L., & Hoddinott, P. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-029954 · Cited by 1,591
Three techniques for integrating data in mixed methods studies
O'Cathain, A., Murphy, E., & Nicholl, J. (2010) · BMJ · doi:10.1136/bmj.c4587 · Cited by 1,584
Mann, C. J. (2003) · Emergency Medicine Journal · doi:10.1136/emj.20.1.54 · Cited by 1,558
Boutron, I., Altman, D. G., Moher, D., Schulz, K. F., Ravaud, P., & for the CONSORT NPT Group* (2017) · Annals of Internal Medicine · doi:10.7326/m17-0046 · Cited by 1,538
Murray, E., Treweek, S., Pope, C., MacFarlane, A., Ballini, L., Dowrick, C., Finch, T., Kennedy, A., Mair, F., O'Donnell, C., et al. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-63 · Cited by 1,478
Designing Difference in Difference Studies: Best Practices for Public Health Policy Research
Wing, C., Simon, K., & Bello-Gomez, R. A. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-013507 · Cited by 1,470
Jayne, D., Pigazzi, A., Marshall, H., Croft, J., Corrigan, N., Copeland, J., Quirke, P., West, N., Rautio, T., Thomassen, N., et al. (2017) · JAMA · doi:10.1001/jama.2017.7219 · Cited by 1,450
Standards for Reporting Implementation Studies (StaRI) Statement
Pinnock, H., Barwick, M., Carpenter, C. R., Eldridge, S., Grandes, G., Griffiths, C. J., Rycroft-Malone, J., Meissner, P., Murray, E., Patel, A., et al. (2017) · BMJ · doi:10.1136/bmj.i6795 · Cited by 1,446
Self-citationHow to increase value and reduce waste when research priorities are set
Chalmers, I., Bracken, M. B., Djulbegovic, B., Garattini, S., Grant, J., Gülmezoglu, A. M., Howells, D. W., Ioannidis, J. P. A., & Oliver, S. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62229-1 · Cited by 1,436
The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting
Hemming, K., Haines, T. P., Chilton, P. J., Girling, A. J., & Lilford, R. J. (2015) · BMJ · doi:10.1136/bmj.h391 · Cited by 1,410
A pragmatic–explanatory continuum indicator summary (PRECIS): a tool to help trial designers
Thorpe, K. E., Zwarenstein, M., Oxman, A. D., Treweek, S., Furberg, C. D., Altman, D. G., Tunis, S., Bergel, E., Harvey, I., Magid, D. J., et al. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.12.011 · Cited by 1,389
Reporting of Patient-Reported Outcomes in Randomized Trials: The CONSORT PRO Extension
Calvert, M., Blazeby, J., Altman, D. G., Revicki, D. A., Moher, D., Brundage, M. D., & CONSORT PRO Group, F. T. (2013) · JAMA · doi:10.1001/jama.2013.879 · Cited by 1,386
Self-citationFrench, S. D., Green, S. E., O’Connor, D. A., McKenzie, J. E., Francis, J. J., Michie, S., Buchbinder, R., Schattner, P., Spike, N., & Grimshaw, J. M. (2012) · Implementation Science · doi:10.1186/1748-5908-7-38 · Cited by 1,338
Soft systems methodology: a thirty year retrospective
Checkland, P. (2000) · Systems Research and Behavioral Science · doi:10.1002/1099-1743(200011)17:1+<::aid-sres374>3.0.co;2-o · Cited by 1,266
The need for a complex systems model of evidence for public health
Rutter, H., Savona, N., Glonti, K., Bibby, J., Cummins, S., Finegood, D. T., Greaves, F., Harper, L., Hawe, P., Moore, L., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)31267-9 · Cited by 1,260
Self-citationComplex interventions: how “out of control” can a randomised controlled trial be?
Hawe, P., Shiell, A., & Riley, T. (2004) · BMJ · doi:10.1136/bmj.328.7455.1561 · Cited by 1,244
Theorising interventions as events in systems
Hawe, P., Shiell, A., & Riley, T. (2009) · American Journal of Community Psychology · doi:10.1007/s10464-009-9229-9 · Cited by 1,143
The Quality Implementation Framework: A Synthesis of Critical Steps in the Implementation Process
Meyers, D. C., Durlak, J. A., & Wandersman, A. (2012) · American Journal of Community Psychology · doi:10.1007/s10464-012-9522-x · Cited by 1,102
Collins, L. M., Murphy, S. A., & Strecher, V. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.01.022 · Cited by 1,082
Greenhalgh, T., Hinton, L., Finlay, T., Macfarlane, A., Fahy, N., Clyde, B., & Chant, A. (2019) · Health Expectations · doi:10.1111/hex.12888 · Cited by 1,059
Pfadenhauer, L. M., Gerhardus, A., Mozygemba, K., Lysdahl, K. B., Booth, A., Hofmann, B., Wahlster, P., Polus, S., Burns, J., Brereton, L., et al. (2017) · Implementation Science · doi:10.1186/s13012-017-0552-5 · Cited by 1,016
Studying complexity in health services research: desperately seeking an overdue paradigm shift
Greenhalgh, T., & Papoutsi, C. (2018) · BMC Medicine · doi:10.1186/s12916-018-1089-4 · Cited by 962
Soft Systems Methodology in Action
Rosenhead, J. (1991) · European Journal of Information Systems · doi:10.1057/ejis.1991.37 · Cited by 958
Craig, P., Cooper, C., Gunnell, D., Haw, S., Lawson, K., Macintyre, S., Ogilvie, D., Petticrew, M., Reeves, B., Sutton, M., et al. (2012) · Journal of Epidemiology and Community Health · doi:10.1136/jech-2011-200375 · Cited by 912
Self-citationPurposeful Program Theory: Effective Use of Theories of Change and Logic Models
Funnell, S., & Rogers, P. (2011) · RMIT Research Repository (RMIT University Library) · Cited by 897
RAMESES II reporting standards for realist evaluations
Wong, G., Westhorp, G., Manzano, A., Greenhalgh, J., Jagosh, J., & Greenhalgh, T. (2016) · BMC Medicine · doi:10.1186/s12916-016-0643-1 · Cited by 880
Michie, S., Yardley, L., West, R., Patrick, K., & Greaves, F. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7126 · Cited by 865
Unpacking black boxes: mechanisms and theory building in evaluation
Astbury, B., & Leeuw, F. L. (2010) · American Journal of Evaluation · doi:10.1177/1098214010371972 · Cited by 850
Evaluating Digital Health Interventions
Murray, E., Hekler, E. B., Andersson, G., Collins, L. M., Doherty, A., Hollis, C., Rivera, D. E., West, R., & Wyatt, J. C. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.06.008 · Cited by 847
Calvert, M., Kyte, D., Mercieca-Bebber, R., Slade, A., Chan, A.-W., King, M. T., and the SPIRIT-PRO Group, Hunn, A., Bottomley, A., Regnault, A., et al. (2018) · JAMA · doi:10.1001/jama.2017.21903 · Cited by 814
Self-citationThokala, P., Devlin, N., Marsh, K., Baltussen, R., Boysen, M., Kalo, Z., Longrenn, T., Mussen, F., Peacock, S., Watkins, J., et al. (2016) · Value in Health · doi:10.1016/j.jval.2015.12.003 · Cited by 739
De Silva, M. J., Breuer, E., Lee, L., Asher, L., Chowdhary, N., Lund, C., & Patel, V. (2014) · Trials · doi:10.1186/1745-6215-15-267 · Cited by 738
Ramsey, S., Willke, R., Briggs, A., Brown, R., Buxton, M., Chawla, A., Cook, J., Glick, H., Liljas, B., Petitti, D., et al. (2005) · Value in Health · doi:10.1111/j.1524-4733.2005.00045.x · Cited by 720
Demystifying theory and its use in improvement
Davidoff, F., Dixon-Woods, M., Leviton, L., & Michie, S. (2015) · BMJ Quality & Safety · doi:10.1136/bmjqs-2014-003627 · Cited by 714
Health sector reform and public sector health worker motivation: a conceptual framework
Franco, L. M., Bennett, S., & Kanfer, R. (2002) · Social Science & Medicine · doi:10.1016/s0277-9536(01)00094-6 · Cited by 710
A Primer on Effectiveness and Efficacy Trials
Singal, A. G., Higgins, P. D. R., & Waljee, A. K. (2014) · Clinical and Translational Gastroenterology · doi:10.1038/ctg.2013.13 · Cited by 698
Philips, Z., Ginnelly, L., Sculpher, M., Claxton, K., Golder, S., Riemsma, R., Woolacoot, N., & Glanville, J. (2004) · Health Technology Assessment · doi:10.3310/hta8360 · Cited by 697
Stirman, S. W., Miller, C. J., Toder, K., & Calloway, A. (2013) · Implementation Science · doi:10.1186/1748-5908-8-65 · Cited by 691
Michie, S., Wood, C. E., Johnston, M., Abraham, C., Francis, J. J., & Hardeman, W. (2015) · Health Technology Assessment · doi:10.3310/hta19990 · Cited by 680
Complexity Theory and the Social Sciences
Byrne, D. (2002) · Routledge eBooks · doi:10.4324/9780203003916 · Cited by 673
Development of a self-report measure of capability wellbeing for adults: the ICECAP-A
Al-Janabi, H., N Flynn, T., & Coast, J. (2012) · Quality of Life Research · doi:10.1007/s11136-011-9927-2 · Cited by 666
Diepeveen, S., Ling, T., Suhrcke, M., Roland, M., & Marteau, T. M. (2013) · BMC Public Health · doi:10.1186/1471-2458-13-756 · Cited by 656
Gottfredson, D. C., Cook, T. D., Gardner, F. E. M., Gorman-Smith, D., Howe, G. W., Sandler, I. N., & Zafft, K. M. (2015) · Prevention Science · doi:10.1007/s11121-015-0555-x · Cited by 627
Crocker, J. C., Ricci-Cabello, I., Parker, A., Hirst, J. A., Chant, A., Petit-Zeman, S., Evans, D., & Rees, S. (2018) · BMJ · doi:10.1136/bmj.k4738 · Cited by 624
A Conceptual Framework for Adaptive Preventive Interventions
Collins, L. M., Murphy, S. A., & Bierman, K. L. (2004) · Prevention Science · doi:10.1023/b:prev.0000037641.26017.00 · Cited by 608
Campbell, R., Starkey, F., Holliday, J., Audrey, S., Bloor, M., Parry-Langdon, N., Hughes, R., & Moore, L. (2008) · The Lancet · doi:10.1016/s0140-6736(08)60692-3 · Cited by 583
Self-citationBonell, C., Fletcher, A., Morton, M., Lorenc, T., & Moore, L. (2012) · Social Science & Medicine · doi:10.1016/j.socscimed.2012.08.032 · Cited by 582
Self-citationTaxonomy of approaches to developing interventions to improve health: a systematic methods overview
O’Cathain, A., Croot, L., Sworn, K., Duncan, E., Rousseau, N., Turner, K., Yardley, L., & Hoddinott, P. (2019) · Pilot and Feasibility Studies · doi:10.1186/s40814-019-0425-6 · Cited by 576
Craig, P., Katikireddi, S. V., Leyland, A., & Popham, F. (2017) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031816-044327 · Cited by 570
Self-citationA "SMART" Design for Building Individualized Treatment Sequences
Lei, H., Nahum-Shani, I., Lynch, K., Oslin, D., & Murphy, S. A. (2012) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032511-143152 · Cited by 557
Grant, A., Treweek, S., Dreischulte, T., Foy, R., & Guthrie, B. (2013) · Trials · doi:10.1186/1745-6215-14-15 · Cited by 541
Guidelines for the Content of Statistical Analysis Plans in Clinical Trials
Gamble, C., Krishan, A., Stocken, D., Lewis, S., Juszczak, E., Doré, C., Williamson, P. R., Altman, D. G., Montgomery, A., Lim, P., et al. (2017) · JAMA · doi:10.1001/jama.2017.18556 · Cited by 536
Complexity theory and the social sciences: an introduction
(1999) · Choice Reviews Online · doi:10.5860/choice.36-5014 · Cited by 521
Caro, J. J., Briggs, A. H., Siebert, U., & Kuntz, K. M. (2012) · Medical Decision Making · doi:10.1177/0272989x12454577 · Cited by 520
An introduction to effectiveness-implementation hybrid designs
Landes, S. J., McBain, S. A., & Curran, G. M. (2019) · Psychiatry Research · doi:10.1016/j.psychres.2019.112513 · Cited by 516
Implementation research: new imperatives and opportunities in global health
Theobald, S., Brandes, N., Gyapong, M., El-Saharty, S., Proctor, E., Diaz, T., Wanji, S., Elloker, S., Raven, J., Elsey, H., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(18)32205-0 · Cited by 514
Noyes, J., Booth, A., Moore, G., Flemming, K., Tunçalp, Ö., & Shakibazadeh, E. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000893 · Cited by 497
Six steps in quality intervention development (6SQuID)
Wight, D., Wimbush, E., Jepson, R., & Doi, L. (2016) · Journal of Epidemiology and Community Health · doi:10.1136/jech-2015-205952 · Cited by 496
Marsh, K., IJzerman, M., Thokala, P., Baltussen, R., Boysen, M., Kaló, Z., Lönngren, T., Mussen, F., Peacock, S., Watkins, J., et al. (2016) · Value in Health · doi:10.1016/j.jval.2015.12.016 · Cited by 484
Duncan, E., O'Cathain, A., Rousseau, N., Croot, L., Sworn, K., Turner, K. M., Yardley, L., & Hoddinott, P. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-033516 · Cited by 481
Hemming, K., Taljaard, M., McKenzie, J. E., Hooper, R., Copas, A., Thompson, J. A., Dixon-Woods, M., Aldcroft, A., Doussau, A., Grayling, M., et al. (2018) · BMJ · doi:10.1136/bmj.k1614 · Cited by 475
Moore, G. F., Evans, R. E., Hawkins, J., Littlecott, H., Melendez-Torres, G. J., Bonell, C., & Murphy, S. (2019) · Evaluation · doi:10.1177/1356389018803219 · Cited by 471
Improving reporting of meta-ethnography: the eMERGe reporting guidance
France, E. F., Cunningham, M., Ring, N., Uny, I., Duncan, E. A. S., Jepson, R. G., Maxwell, M., Roberts, R. J., Turley, R. L., Booth, A., et al. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0600-0 · Cited by 469
Kubisch, J. P. C. A. A. C. (1998) · Cited by 461
Almirall, D., Nahum-Shani, I., Sherwood, N. E., & Murphy, S. A. (2014) · Translational Behavioral Medicine · doi:10.1007/s13142-014-0265-0 · Cited by 453
Smoke-free Legislation and Hospitalizations for Acute Coronary Syndrome
Pell, J. P., Haw, S., Cobbe, S., Newby, D. E., Pell, A. C. H., Fischbacher, C., McConnachie, A., Pringle, S., Murdoch, D., Dunn, F., et al. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa0706740 · Cited by 446
Salisbury, C., Man, M.-S., Bower, P., Guthrie, B., Chaplin, K., Gaunt, D. M., Brookes, S., Fitzpatrick, B., Gardner, C., Hollinghurst, S., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(18)31308-4 · Cited by 414
Can We Systematically Review Studies That Evaluate Complex Interventions?
Shepperd, S., Lewin, S., Straus, S., Clarke, M., Eccles, M. P., Fitzpatrick, R., Wong, G., & Sheikh, A. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000086 · Cited by 408
McKee, M., Britton, A., Black, N., McPherson, K., Sanderson, C., & Bain, C. (1999) · BMJ · doi:10.1136/bmj.319.7205.312 · Cited by 399
Hunt, K., Wyke, S., Gray, C. M., Anderson, A. S., Brady, A., Bunn, C., Donnan, P. T., Fenwick, E., Grieve, E., Leishman, J., et al. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62420-4 · Cited by 394
Conceptualizing a Model: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force–2
Roberts, M., Russell, L. B., Paltiel, A. D., Chambers, M., McEwan, P., & Krahn, M. (2012) · Medical Decision Making · doi:10.1177/0272989x12454941 · Cited by 389
A systematic review of adaptations of evidence-based public health interventions globally
Escoffery, C., Lebow-Skelley, E., Haardoerfer, R., Boing, E., Udelson, H., Wood, R., Hartman, M., Fernandez, M. E., & Mullen, P. D. (2018) · Implementation Science · doi:10.1186/s13012-018-0815-9 · Cited by 386
RAMESES publication standards: realist syntheses
Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R. (2013) · Journal of Advanced Nursing · doi:10.1111/jan.12095 · Cited by 385
Theories of Change and Realistic Evaluation: Peas in a Pod or Apples and Oranges?
Blamey, A., & Mackenzie, M. (2007) · Evaluation · doi:10.1177/1356389007082129 · Cited by 383
The Patient-as-Partner Approach in Health Care: A Conceptual Framework for a Necessary Transition
Karazivan, P., Dumez, V., Flora, L., Pomey, M.-P., Del Grande, C., Ghadiri, D. P., Fernandez, N., Jouet, E., Las Vergnas, O., & Lebel, P. (2015) · Academic Medicine · doi:10.1097/acm.0000000000000603 · Cited by 381
Evidence for public health policy on inequalities: 1: The reality according to policymakers
Petticrew, M., Whitehead, M., Macintyre, S. J., Graham, H., & Egan, M. (2004) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2003.015289 · Cited by 380
Self-citationA Proposal to Speed Translation of Healthcare Research Into Practice
Kessler, R., & Glasgow, R. E. (2011) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2011.02.023 · Cited by 376
Agent-Based Modeling in Public Health: Current Applications and Future Directions
Tracy, M., Cerdá, M., & Keyes, K. M. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-014317 · Cited by 376
Craig, P., Di Ruggiero, E., Frohlich, K. L., Mykhalovskiy, E., White, M., on behalf of the Canadian Institutes of Health Research (CIHR)–National Institute for Health Research (NIHR) Context Guidance Authors Group (listed alphabetically), Campbell, R., Cummins, S., Edwards, N., Hunt, K., et al. (2018) · doi:10.3310/cihr-nihr-01 · Cited by 370
Self-citationThe Green Book: Central Government Guidance on Appraisal and Evaluation
Hurst, M. (2019) · Journal of Mega Infrastructure & Sustainable Development · doi:10.1080/24724718.2019.1607713 · Cited by 358
The person-based approach to enhancing the acceptability and feasibility of interventions
Yardley, L., Ainsworth, B., Arden-Close, E., & Muller, I. (2015) · Pilot and Feasibility Studies · doi:10.1186/s40814-015-0033-z · Cited by 346
‘Dark logic’: theorising the harmful consequences of public health interventions
Bonell, C., Jamal, F., Melendez-Torres, G. J., & Cummins, S. (2015) · Journal of Epidemiology and Community Health · doi:10.1136/jech-2014-204671 · Cited by 345
Robling, M., Bekkers, M.-J., Bell, K., Butler, C. C., Cannings-John, R., Channon, S., Martin, B. C., Gregory, J. W., Hood, K., Kemp, A., et al. (2016) · The Lancet · doi:10.1016/s0140-6736(15)00392-x · Cited by 338
Karnon, J., Stahl, J., Brennan, A., Caro, J. J., Mar, J., & Möller, J. (2012) · Medical Decision Making · doi:10.1177/0272989x12455462 · Cited by 336
Using Cost-Effectiveness Analysis to Address Health Equity Concerns
Cookson, R., Mirelman, A. J., Griffin, S., Asaria, M., Dawkins, B., Norheim, O. F., Verguet, S., & J. Culyer, A. (2017) · Value in Health · doi:10.1016/j.jval.2016.11.027 · Cited by 327
on behalf of the CONSORT-SPI Group, Montgomery, P., Grant, S., Mayo-Wilson, E., Macdonald, G., Michie, S., Hopewell, S., & Moher, D. (2018) · Trials · doi:10.1186/s13063-018-2733-1 · Cited by 327
Development of a framework for the co-production and prototyping of public health interventions
Hawkins, J., Madden, K., Fletcher, A., Midgley, L., Grant, A., Cox, G., Moore, L., Campbell, R., Murphy, S., Bonell, C., et al. (2017) · BMC Public Health · doi:10.1186/s12889-017-4695-8 · Cited by 310
Self-citationChanging clinical behaviour by making guidelines specific
Michie, S., & Johnston, M. (2004) · BMJ · doi:10.1136/bmj.328.7435.343 · Cited by 309
Holmes, J., Meng, Y., Meier, P. S., Brennan, A., Angus, C., Campbell-Burton, A., Guo, Y., Hill-McManus, D., & Purshouse, R. C. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62417-4 · Cited by 307
Bonell, C., Allen, E., Warren, E., McGowan, J., Bevilacqua, L., Jamal, F., Legood, R., Wiggins, M., Opondo, C., Mathiot, A., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(18)31782-3 · Cited by 302
Kreif, N., Grieve, R., Hangartner, D., Turner, A. J., Nikolova, S., & Sutton, M. (2016) · Health Economics · doi:10.1002/hec.3258 · Cited by 301
Screening and brief intervention for obesity in primary care: a parallel, two-arm, randomised trial
Aveyard, P., Lewis, A., Tearne, S., Hood, K., Christian-Brown, A., Adab, P., Begh, R., Jolly, K., Daley, A., Farley, A., et al. (2016) · The Lancet · doi:10.1016/s0140-6736(16)31893-1 · Cited by 297
Agent-Based Models in Empirical Social Research
Bruch, E., & Atwell, J. (2015) · Sociological Methods & Research · doi:10.1177/0049124113506405 · Cited by 296
Regression Discontinuity Designs in Epidemiology: Causal Inference Without Randomized Trials
Bor, J., Moscoe, E., Mutevedzi, P., Newell, M.-L., & Bärnighausen, T. (2014) · Epidemiology · doi:10.1097/ede.0000000000000138 · Cited by 291
Group model building: problem structuring, policy simulation and decision support
Andersen, D. F., Vennix, J. A. M., Richardson, G. P., & Rouwette, E. A. J. A. (2007) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2602339 · Cited by 288
Systems Concepts in Action: A Practitioner's Toolkit
Williams, B., & Hummelbrunner, R. (2010) · Stanford University Press eBooks · doi:10.1515/9780804776554 · Cited by 285
Randomised controlled trial of nasal nicotine spray in smoking cessation
Sutherland, G., Stapleton, J. A., Russell, M. A. H., Jarvis, M. J., Hajek, P., Belcher, M., & Feyerabend, C. (1992) · The Lancet · doi:10.1016/0140-6736(92)91403-u · Cited by 284
Haugen, A. S., Søfteland, E., Almeland, S. K., Sevdalis, N., Vonen, B., Eide, G. E., Nortvedt, M. W., & Harthug, S. (2015) · Annals of Surgery · doi:10.1097/sla.0000000000000716 · Cited by 282
A Community Based Systems Diagram of Obesity Causes
Allender, S., Owen, B., Kuhlberg, J., Lowe, J., Nagorcka-Smith, P., Whelan, J., & Bell, C. (2015) · PLOS ONE · doi:10.1371/journal.pone.0129683 · Cited by 274
Formulating questions to explore complex interventions within qualitative evidence synthesis
Booth, A., Noyes, J., Flemming, K., Moore, G., Tunçalp, Ö., & Shakibazadeh, E. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-001107 · Cited by 258
Gallagher, R., & Appenzeller, T. (1999) · Science · doi:10.1126/science.284.5411.79 · Cited by 257
Collinson, F. J., Jayne, D. G., Pigazzi, A., Tsang, C., Barrie, J. M., Edlin, R., Garbett, C., Guillou, P., Holloway, I., Howard, H., et al. (2012) · International Journal of Colorectal Disease · doi:10.1007/s00384-011-1313-6 · Cited by 255
Adaptive trial designs: a review of barriers and opportunities
Kairalla, J. A., Coffey, C. S., Thomann, M. A., & Muller, K. E. (2012) · Trials · doi:10.1186/1745-6215-13-145 · Cited by 249
When are complex interventions 'complex'? When are simple interventions 'simple'?
Petticrew, M. (2011) · The European Journal of Public Health · doi:10.1093/eurpub/ckr084 · Cited by 249
Self-citationHallingberg, B., Turley, R., Segrott, J., Wight, D., Craig, P., Moore, L., Murphy, S., Robling, M., Simpson, S. A., & Moore, G. (2018) · Pilot and Feasibility Studies · doi:10.1186/s40814-018-0290-8 · Cited by 248
Self-citationKarnon, J., Stahl, J., Brennan, A., Caro, J. J., Mar, J., & Möller, J. (2012) · Value in Health · doi:10.1016/j.jval.2012.04.013 · Cited by 240
Quasi-experimental study designs series—paper 4: uses and value
Bärnighausen, T., Tugwell, P., Røttingen, J.-A., Shemilt, I., Rockers, P., Geldsetzer, P., Lavis, J., Grimshaw, J., Daniels, K., Brown, A., et al. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.03.012 · Cited by 240
CONSORT extension for reporting N-of-1 trials (CENT) 2015 Statement
Vohra, S., Shamseer, L., Sampson, M., Bukutu, C., Schmid, C. H., Tate, R., Nikles, J., Zucker, D. R., Kravitz, R., Guyatt, G., et al. (2015) · BMJ · doi:10.1136/bmj.h1738 · Cited by 239
Moore, G. F., & Evans, R. E. (2017) · SSM - Population Health · doi:10.1016/j.ssmph.2016.12.005 · Cited by 235
Olds, D. L., Kitzman, H. J., Cole, R. E., Hanks, C. A., Arcoleo, K. J., Anson, E. A., Luckey, D. W., Knudtson, M. D., Henderson, C. R., Bondy, J., et al. (2010) · Archives of Pediatrics & Adolescent Medicine · doi:10.1001/archpediatrics.2010.49 · Cited by 227
N-of-1 Trials in the Medical Literature: A Systematic Review
Gabler, N. B., Duan, N., Vohra, S., & Kravitz, R. L. (2011) · Medical Care · doi:10.1097/mlr.0b013e318215d90d · Cited by 226
Building Realist Program Theory for Large Complex and Messy Interventions
Shearn, K., Allmark, P., Piercy, H., & Hirst, J. (2017) · International Journal of Qualitative Methods · doi:10.1177/1609406917741796 · Cited by 217
Development of the ACTIVE framework to describe stakeholder involvement in systematic reviews
Pollock, A., Campbell, P., Struthers, C., Synnot, A., Nunn, J., Hill, S., Goodare, H., Morris, J., Watts, C., & Morley, R. (2019) · Journal of Health Services Research & Policy · doi:10.1177/1355819619841647 · Cited by 217
Akhtar, P. C., Currie, D. B., Currie, C. E., & Haw, S. J. (2007) · BMJ · doi:10.1136/bmj.39311.550197.ae · Cited by 214
Haw, S. J., & Gruer, L. (2007) · BMJ · doi:10.1136/bmj.39315.670208.47 · Cited by 210
Exploring Uncertainty in Cost-Effectiveness Analysis
Claxton, K. (2008) · PharmacoEconomics · doi:10.2165/00019053-200826090-00008 · Cited by 210
Evaluating patient and public involvement in research
Boivin, A., Richards, T., Forsythe, L., Grégoire, A., L’Espérance, A., Abelson, J., & Carman, K. L. (2018) · BMJ · doi:10.1136/bmj.k5147 · Cited by 208
COOKSON, R., DRUMMOND, M., & WEATHERLY, H. (2009) · Health Economics, Policy and Law · doi:10.1017/s1744133109004903 · Cited by 207
Reduced Mortality with Hospital Pay for Performance in England
Sutton, M., Nikolova, S., Boaden, R., Lester, H., McDonald, R., & Roland, M. (2012) · New England Journal of Medicine · doi:10.1056/nejmsa1114951 · Cited by 207
Evaluating the Health Impact of Large-Scale Public Policy Changes: Classical and Novel Approaches
Basu, S., Meghani, A., & Siddiqi, A. (2017) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031816-044208 · Cited by 204
Petticrew, M., Knai, C., Thomas, J., Rehfuess, E. A., Noyes, J., Gerhardus, A., Grimshaw, J. M., Rutter, H., & McGill, E. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000899 · Cited by 204
Self-citationOgilvie, D., Adams, J., Bauman, A., Gregg, E. W., Panter, J., Siegel, K. R., Wareham, N. J., & White, M. (2020) · Journal of Epidemiology and Community Health · doi:10.1136/jech-2019-213085 · Cited by 203
Self-citationSmith, R. D., Keogh-Brown, M. R., Barnett, T., & Tait, J. (2009) · BMJ · doi:10.1136/bmj.b4571 · Cited by 201
McDonald, S., Quinn, F., Vieira, R., O’Brien, N., White, M., Johnston, D. W., & Sniehotta, F. F. (2017) · Health Psychology Review · doi:10.1080/17437199.2017.1316672 · Cited by 200
Self-citationRehfuess, E. A., Stratil, J. M., Scheel, I. B., Portela, A., Norris, S. L., & Baltussen, R. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000844 · Cited by 200
Cook, J. A., Julious, S. A., Sones, W., Hampson, L. V., Hewitt, C., Berlin, J. A., Ashby, D., Emsley, R., Fergusson, D. A., Walters, S. J., et al. (2018) · Trials · doi:10.1186/s13063-018-2884-0 · Cited by 197
TIDieR-PHP: a reporting guideline for population health and policy interventions
Campbell, M., Katikireddi, S. V., Hoffmann, T., Armstrong, R., Waters, E., & Craig, P. (2018) · BMJ · doi:10.1136/bmj.k1079 · Cited by 197
Self-citationAdvancing complexity science in healthcare research: the logic of logic models
Mills, T., Lawton, R., & Sheard, L. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0701-4 · Cited by 190
Context and implementation: A concept analysis towards conceptual maturity
Pfadenhauer, L. M., Mozygemba, K., Gerhardus, A., Hofmann, B., Booth, A., Lysdahl, K. B., Tummers, M., Burns, J., & Rehfuess, E. A. (2015) · Zeitschrift für Evidenz, Fortbildung und Qualität im Gesundheitswesen · doi:10.1016/j.zefq.2015.01.004 · Cited by 189
Peden, C. J., Stephens, T., Martin, G., Kahan, B. C., Thomson, A., Rivett, K., Wells, D., Richardson, G., Kerry, S., Bion, J., et al. (2019) · The Lancet · doi:10.1016/s0140-6736(18)32521-2 · Cited by 189
Self-citationRaine, R., Fitzpatrick, R., Barratt, H., Bevan, G., Black, N., Boaden, R., Bower, P., Campbell, M., Denis, J.-L., Devers, K., et al. (2016) · Health Services and Delivery Research · doi:10.3310/hsdr04160 · Cited by 186
Self-citationKey design considerations for adaptive clinical trials: a primer for clinicians
Thorlund, K., Haggstrom, J., Park, J. J., & Mills, E. J. (2018) · BMJ · doi:10.1136/bmj.k698 · Cited by 182
Synthetic control methodology as a tool for evaluating population-level health interventions
Bouttell, J., Craig, P., Lewsey, J., Robinson, M., & Popham, F. (2018) · Journal of Epidemiology and Community Health · doi:10.1136/jech-2017-210106 · Cited by 182
Self-citationDeveloping and evaluating complex interventions
Sutton, C. (2014) · Maternal & Child Nutrition · doi:10.1111/mcn.12127 · Cited by 173
Dimairo, M., Pallmann, P., Wason, J. M. S., Todd, S., Jaki, T., Julious, S. A., Mander, A., Weir, C. J., König, F., Walton, M. K., et al. (2020) · BMJ · doi:10.1136/bmj.m115 · Cited by 171
Miller, G., Pinto, D., & Vera‐Hernández, M. (2013) · American Economic Journal Applied Economics · doi:10.1257/app.5.4.61 · Cited by 169
Continuous Evaluation of Evolving Behavioral Intervention Technologies
Mohr, D. C., Cheung, K., Schueller, S. M., Hendricks Brown, C., & Duan, N. (2013) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2013.06.006 · Cited by 168
Gray, C. M., Hunt, K., Mutrie, N., Anderson, A. S., Leishman, J., Dalgarno, L., & Wyke, S. (2013) · BMC Public Health · doi:10.1186/1471-2458-13-232 · Cited by 154
Borek, A. J., Abraham, C., Greaves, C. J., Gillison, F., Tarrant, M., Morgan-Trimmer, S., McCabe, R., & Smith, J. R. (2019) · Health Psychology Review · doi:10.1080/17437199.2019.1625282 · Cited by 152
Lewin, S. A., Hendry, M., Chandler, J., Oxman, A. D., Michie, S., Shepperd, S., Reeves, B. C., Tugwell, P., Hannes, K., Rehfuess, E. A., et al. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0349-x · Cited by 152
Whole of Systems Trial of Prevention Strategies for Childhood Obesity: WHO STOPS Childhood Obesity
Allender, S. E., Millar, L., Hovmand, P. S., Bell, C., Moodie, M., Carter, R., Swinburn, B. A., Strugnell, C., Lowe, J., de la Haye, K., et al. (2016) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph13111143 · Cited by 149
Cook, J. A., Julious, S. A., Sones, W., Hampson, L. V., Hewitt, C., Berlin, J. A., Ashby, D., Emsley, R., Fergusson, D. A., Walters, S. J., et al. (2018) · BMJ · doi:10.1136/bmj.k3750 · Cited by 148
Program sustainability begins with the first events
Pluye, P., Potvin, L., Denis, J.-L., Pelletier, J., & Mannoni, C. (2005) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2004.10.003 · Cited by 147
Quantifying a Systems Map: Network Analysis of a Childhood Obesity Causal Loop Diagram
McGlashan, J., Johnstone, M., Creighton, D., de la Haye, K., & Allender, S. E. (2016) · PLoS ONE · doi:10.1371/journal.pone.0165459 · Cited by 146
Guise, J., Chang, C., Butler, M., Viswanathan, M., & Tugwell, P. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.06.011 · Cited by 145
Taking account of context in systematic reviews and guidelines considering a complexity perspective
Booth, A., Moore, G. F., Flemming, K., Garside, R., Rollins, N. C., Tunçalp, Ö., & Noyes, J. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000840 · Cited by 145
McGill, E., Marks, D., Er, V., Penney, T. L., Petticrew, M. P., & Egan, M. (2020) · PLoS Medicine · doi:10.1371/journal.pmed.1003368 · Cited by 144
Self-citationEvaluation of two school smoking education programmes under normal classroom conditions.
Nutbeam, D., Macaskill, P., Smith, C., Simpson, J. M., & Catford, J. (1993) · BMJ · doi:10.1136/bmj.306.6870.102 · Cited by 140
Cited by
Skivington, K., Matthews, L., Simpson, S. A., Craig, P., Baird, J., Blazeby, J. M., Boyd, K. A., Craig, N., French, D. P., McIntosh, E., et al. (2021) · BMJ · doi:10.1136/bmj.n2061 · Cited by 5,808
Self-citationWorld guidelines for falls prevention and management for older adults: a global initiative
Montero-Odasso, M., van der Velde, N., Martin, F. C., Petrovic, M., Tan, M. P., Ryg, J., Aguilar-Navarro, S., Alexander, N. B., Becker, C., Blain, H., et al. (2022) · Age and Ageing · doi:10.1093/ageing/afac205 · Cited by 1,756
Vetrovsky, T., Borowiec, A., Juřík, R., Wahlich, C., Śmigielski, W., Steffl, M., Tufano, J. J., Drygas, W., Stastny, P., Harris, T., et al. (2022) · British Journal of Sports Medicine · doi:10.1136/bjsports-2021-105198 · Cited by 68
Evans, R., MacDonald, S., Trubey, R., Noyes, J., Robling, M., Willis, S., Boffey, M., Wooders, C., Vinnicombe, S., & Melendez-Torres, G. J. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02260-y · Cited by 29
Mobilising context as complex and dynamic in evaluations of complex health interventions
Murdoch, J., Paparini, S., Papoutsi, C., James, H., Greenhalgh, T., & Shaw, S. E. (2023) · BMC Health Services Research · doi:10.1186/s12913-023-10354-5 · Cited by 23
Metadata
- Authors
- Skivington, K., Matthews, L., Simpson, S. A., Craig, P., Baird, J., Blazeby, J. M., Boyd, K. A., Craig, N., French, D. P., McIntosh, E., Petticrew, M., Rycroft-Malone, J., White, M., & Moore, L.
- Venue
- Health Technology Assessment
- Published
- 2021-09
- Volume
- 25
- Issue
- 57
- Pages
- 1-132
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W3157335401
- Cited by
- 522
- References
- 325
- FWCI
- 87.00
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.