The DOI matches its Crossref record; 325 of the 325 references it cites were found in a registry or an index.
Framework for the development and evaluation of complex interventions: gap analysis, workshop and consultation-informed update
Open accessAbstract
Background: The Medical Research Council published the second edition of its framework in 2006 on developing and evaluating complex interventions. Since then, there have been considerable developments in the field of complex intervention research. The objective of this project was to update the framework in the light of these developments. The framework aims to help research teams prioritise research questions and design, and conduct research with an appropriate choice of methods, rather than to provide detailed guidance on the use of specific methods. Methods: There were four stages to the update: (1) gap analysis to identify developments in the methods and practice since the previous framework was published; (2) an expert workshop of 36 participants to discuss the topics identified in the gap analysis; (3) an open consultation process to seek comments on a first draft of the new framework; and (4) findings from the previous stages were used to redraft the framework, and final expert review was obtained. The process was overseen by a Scientific Advisory Group representing the range of relevant National Institute for Health Research and Medical Research Council research investments. Results: Key changes to the previous framework include (1) an updated definition of complex interventions, highlighting the dynamic relationship between the intervention and its context; (2) an emphasis on the use of diverse research perspectives: efficacy, effectiveness, theory-based and systems perspectives; (3) a focus on the usefulness of evidence as the basis for determining research perspective and questions; (4) an increased focus on interventions developed outside research teams, for example changes in policy or health services delivery; and (5) the identification of six ‘core elements’ that should guide all phases of complex intervention research: consider context; develop, refine and test programme theory; engage stakeholders; identify key uncertainties; refine the intervention; and economic considerations. We divide the research process into four phases: development, feasibility, evaluation and implementation. For each phase we provide a concise summary of recent developments, key points to address and signposts to further reading. We also present case studies to illustrate the points being made throughout. Limitations: The framework aims to help research teams prioritise research questions and design and conduct research with an appropriate choice of methods, rather than to provide detailed guidance on the use of specific methods. In many of the areas of innovation that we highlight, such as the use of systems approaches, there are still only a few practical examples. We refer to more specific and detailed guidance where available and note where promising approaches require further development. Conclusions: This new framework incorporates developments in complex intervention research published since the previous edition was written in 2006. As well as taking account of established practice and recent refinements, we draw attention to new approaches and place greater emphasis on economic considerations in complex intervention research. We have introduced a new emphasis on the importance of context and the value of understanding interventions as ‘events in systems’ that produce effects through interactions with features of the contexts in which they are implemented. The framework adopts a pluralist approach, encouraging researchers and research funders to adopt diverse research perspectives and to select research questions and methods pragmatically, with the aim of providing evidence that is useful to decision-makers. Future work: We call for further work to develop relevant methods and provide examples in practice. The use of this framework should be monitored and the move should be made to a more fluid resource in the future, for example a web-based format that can be frequently updated to incorporate new material and links to emerging resources. Funding: This project was jointly funded by the Medical Research Council (MRC) and the National Institute for Health Research (Department of Health and Social Care 73514).
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–325 of 325
Flemming, K., Booth, A., Hannes, K., Cargo, M., & Noyes, J. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.10.022 · Cited by 140
Patients’ roles and rights in research
Wicks, P. J., Richards, T., Denegri, S., & Godlee, F. (2018) · BMJ · doi:10.1136/bmj.k3193 · Cited by 140
on behalf of the EPOCH trial group, Stephens, T., Peden, C. J., Pearse, R. M., Shaw, S. E., Abbott, T. E. F., Jones, E. L., Kocman, D., & Martin, G. P. (2018) · Implementation Science · doi:10.1186/s13012-018-0823-9 · Cited by 133
Mejdoubi, J., van den Heijkant, S. C. C. M., van Leerdam, F. J. M., Heymans, M. W., Crijnen, A. A. M., & Hirasing, R. A. (2015) · PLoS ONE · doi:10.1371/journal.pone.0120182 · Cited by 131
Applied Methods of Cost-benefit Analysis in Health Care
McIntosh, E., Clarke, P., Frew, E. J., & Louviere, J. J. (2010) · ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) · Cited by 130
Self-citationHull, L., Goulding, L., Khadjesari, Z., Davis, R. E., Healey, A., Bakolis, I., & Sevdalis, N. (2019) · Implementation Science · doi:10.1186/s13012-019-0897-z · Cited by 129
Managing uncertainty in the covid-19 era
Rutter, H., Wolpert, M., & Greenhalgh, T. (2020) · BMJ · doi:10.1136/bmj.m3349 · Cited by 129
Starkey, F., Audrey, S., Holliday, J., Moore, L., & Campbell, R. M. (2009) · Health Education Research · doi:10.1093/her/cyp045 · Cited by 127
Self-citationGuise, J., Butler, M. E., Chang, C., Viswanathan, M., Pigott, T., & Tugwell, P. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.06.016 · Cited by 126
Why do interventions work in some places and not others: A breastfeeding support group trial
Hoddinott, P., Britten, J., & Pill, R. (2009) · Social Science & Medicine · doi:10.1016/j.socscimed.2009.10.067 · Cited by 125
Hunt, K., Gray, C. M., MacLean, A., Smillie, S., Bunn, C., & Wyke, S. (2014) · BMC Public Health · doi:10.1186/1471-2458-14-50 · Cited by 125
A Framework for Developing the Structure of Public Health Economic Models
Squires, H., Chilcott, J. B., Akehurst, R. L., Burr, J. A., & Kelly, M. P. (2016) · Value in Health · doi:10.1016/j.jval.2016.02.011 · Cited by 116
Richards, D. A., Bazeley, P., Borglin, G., Craig, P., Emsley, R., Frost, J., Hill, J., Horwood, J. P., Hutchings, H. A., Jinks, C., et al. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-032081 · Cited by 116
Self-citationTackling 'wicked' health promotion problems: a New Zealand case study
Signal, L. N., Walton, M., Mhurchú, C. N., Maddison, R., Bowers, S., Carter, K. N., Gorton, D., Heta, C., Lanumata, T., McKerchar, C., et al. (2012) · Health Promotion International · doi:10.1093/heapro/das006 · Cited by 110
Group model building: a participatory approach to understanding and acting on systems
Siokou, C., Morgan, R., & Shiell, A. (2014) · Public Health Research & Practice · doi:10.17061/phrp2511404 · Cited by 108
Petticrew, M., Katikireddi, S., Knai, C., Cassidy, R., Hessari, N. M., Thomas, J., & Weishaar, H. (2017) · Journal of Epidemiology and Community Health · doi:10.1136/jech-2017-209710 · Cited by 105
Self-citationA practice-based tool for engaging stakeholders in future research: a synthesis of current practices
Guise, J., O’Haire, C., McPheeters, M. L., Most, C., LaBrant, L., Lee, K., Cottrell, E., & Graham, E. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.12.010 · Cited by 103
Smoking in pregnancy: The attitudes of expectant mothers
Graham, H. M. (1976) · Social Science & Medicine (1967) · doi:10.1016/0037-7856(76)90097-4 · Cited by 103
Public involvement in health research: what does ‘good’ look like in practice?
Liabo, K., Boddy, K., Bortoli, S. H. D., Irvine, J., Boult, H., Fredlund, M., Joseph, N., Bjornstad, G. J., & Morris, C. (2020) · Research Involvement and Engagement · doi:10.1186/s40900-020-0183-x · Cited by 102
Ashburn, A., Pickering, R. M., McIntosh, E., Hulbert, S., Rochester, L., Roberts, H. C., Nieuwboer, A., Kunkel, D., Goodwin, V. A., Lamb, S. E., et al. (2019) · Health Technology Assessment · doi:10.3310/hta23360 · Cited by 101
Self-citationOgilvie, D., Cummins, S., Petticrew, M. P., White, M. J., Jones, A., & Wheeler, K. (2011) · Milbank Quarterly · doi:10.1111/j.1468-0009.2011.00626.x · Cited by 100
Self-citationSystematic reviews of complex interventions: framing the review question
Squires, J. E., Valentine, J. C., & Grimshaw, J. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.05.013 · Cited by 98
Claxton, K., Cohen, J. T., & Neumann, P. J. (2005) · Health Affairs · doi:10.1377/hlthaff.24.1.93 · Cited by 93
Quasi-experimental study designs series—paper 1: introduction: two historical lineages
Bärnighausen, T., Røttingen, J., Rockers, P. C., Shemilt, I., & Tugwell, P. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.02.020 · Cited by 90
Craig, P., Cooper, C. C., Gunnell, D., Haw, S. J., Lawson, K. D., Macintrye, S., Ogilvie, D., Petticrew, M. P., Reeves, B. C., Sutton, M., et al. (2011) · ResearchOnline at James Cook University (James Cook University) · Cited by 89
Self-citationGray, C. M., Hunt, K., Mutrie, N., Anderson, A. S., Treweek, S. P., & Wyke, S. (2013) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-10-121 · Cited by 87
Presseau, J., Sniehotta, F. F., Francis, J., & Campbell, N. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-77 · Cited by 85
Mobilising modern facts: health technology assessment and the politics of evidence
May, C. R. (2006) · Sociology of Health & Illness · doi:10.1111/j.1467-9566.2006.00505.x · Cited by 82
Huis, A. M. P., Holleman, G., van Achterberg, T., Grol, R. P. T. M., Schoonhoven, L., & Hulscher, M. (2013) · Implementation Science · doi:10.1186/1748-5908-8-41 · Cited by 81
Ebenso, B., Manzano, A., Uzochukwu, B. S. C., Etiaba, E., Huss, R., Ensor, T., Newell, J. N., Onwujekwe, O. E., Ezumah, N., Hicks, J. P., et al. (2018) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2018.12.002 · Cited by 81
Situating agent-based modelling in population health research
Silverman, E., Gostoli, U., Picascia, S., Almagor, J., McCann, M., Shaw, R. J., & Angione, C. (2021) · Emerging Themes in Epidemiology · doi:10.1186/s12982-021-00102-7 · Cited by 81
Noyes, J., Gough, D., Lewin, S. A., Mayhew, A., Michie, S., Tomás Pantoja, C., Petticrew, M. P., Pottie, K. C., Rehfuess, E. A., Shemilt, I., et al. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.07.003 · Cited by 80
Self-citationHoddinott, P., Britten, J., Prescott, G. J., Tappin, D., Ludbrook, A., & Godden, D. (2009) · BMJ · doi:10.1136/bmj.a3026 · Cited by 80
Maini, R., Mounier‐Jack, S., & Borghi, J. (2018) · BMJ Global Health · doi:10.1136/bmjgh-2017-000617 · Cited by 78
Montgomery, P., Movsisyan, A., Grant, S., Macdonald, G. M., & Rehfuess, E. A. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000848 · Cited by 77
Allen, K., Pearson‐Stuttard, J., Hooton, W., Diggle, P. J., Capewell, S., & O’Flaherty, M. (2015) · BMJ · doi:10.1136/bmj.h4583 · Cited by 76
Lawless, A. P., Baum, F. E., Delany‐Crowe, T., MacDougall, C., Williams, C., McDermott, D. R., & van Eyk, H. (2017) · International Journal of Health Policy and Management · doi:10.15171/ijhpm.2017.121 · Cited by 76
Egan, M., McGill, E., Penney, T. L., de Cuevas, R. A., Er, V., Orton, L., Lock, K., Popay, J., Savona, N., Cummins, S., et al. (2019) · LSHTM Research Online (London School of Hygiene and Tropical Medicine) · Cited by 76
Self-citationHealth outcomes of youth development programme in England: prospective matched comparison study
Wiggins, M., Bonell, C. P., Sawtell, M., Austerberry, H., Burchett, H., Allen, E., & Strange, V. (2009) · BMJ · doi:10.1136/bmj.b2534 · Cited by 75
Moore, L., Hallingberg, B., Wight, D., Turley, R., Segrott, J., Craig, P., Robling, M. R., Murphy, S., Simpson, S. A., & Moore, G. F. (2018) · Journal of Epidemiology & Community Health · doi:10.1136/jech-2017-210414 · Cited by 74
Self-citationUsing Qualitative Comparative Analysis to understand complex policy problems
Blackman, T., Wistow, J., & Byrne, D. (2013) · Evaluation · doi:10.1177/1356389013484203 · Cited by 73
White, J., Hawkins, J. L., Madden, K., Grant, A., Er, V., Angel, L., Pickles, T., Kelson, M. J., Fletcher, A., Murphy, S., et al. (2017) · Public Health Research · doi:10.3310/phr05070 · Cited by 70
Self-citationMartin, G. P., Hanna, E. S., McCartney, M., & Dingwall, R. W. J. (2020) · Critical Public Health · doi:10.1080/09581596.2020.1797997 · Cited by 70
Dalkin, S. M., Lhussier, M., Williams, L., Burton, C. R., & Rycroft‐Malone, J. (2018) · Evaluation · doi:10.1177/1356389017749036 · Cited by 69
Self-citationEgan, M., McGill, E., Penney, T. L., de Cuevas, R. A., Er, V., Orton, L., White, M. J., Lock, K., Cummins, S., Savona, N., et al. (2019) · LSHTM Research Online (London School of Hygiene and Tropical Medicine) · Cited by 68
Self-citationRandell, R., Greenhalgh, J., Hindmarsh, J., Dowding, D., Jayne, D. G., Pearman, A. D., Gardner, P. H., Croft, J., & Kotzé, A. (2014) · Implementation Science · doi:10.1186/1748-5908-9-52 · Cited by 67
Hollingworth, W., Cohen, D. R., Hawkins, J., Hughes, R. A., Moore, L., Holliday, J., Audrey, S., Starkey, F., & Campbell, R. (2011) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntr155 · Cited by 67
Self-citationPlacing health: Neighbourhood renewal, health improvement and complexity
Blackman, T. (2006) · Durham Research Online (Durham University) · Cited by 66
Simpson, S. A., Matthews, L., Pugmire, J., McConnachie, A., McIntosh, E., Coulman, E., Hughes, K., Kelson, M. J., Morgan‐Trimmer, S., Murphy, S., et al. (2020) · Public Health Research · doi:10.3310/phr08030 · Cited by 66
Self-citationRandell, R., Honey, S., Hindmarsh, J., Alvarado, N., Greenhalgh, J., Pearman, A. D., Long, A., Cope, A., Gill, A., Gardner, P. H., et al. (2017) · Health Services and Delivery Research · doi:10.3310/hsdr05200 · Cited by 65
Cook, P. A., Hargreaves, S. C., Burns, E. J., de Vocht, F., Parrott, S., Coffey, M., Audrey, S., Ure, C., Duffy, P., Ottiwell, D., et al. (2018) · BMC Public Health · doi:10.1186/s12889-018-5410-0 · Cited by 65
Norris, S. L., Rehfuess, E. A., Smith, H. E., Tunçalp, Ö., Grimshaw, J., Ford, N. P., & Portela, A. G. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000963 · Cited by 64
Mukumbang, F. C., Belle, S. V., Marchal, B., & van Wyk, B. E. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-009977 · Cited by 63
Mann, C., Shaw, A., Guthrie, B., Wye, L., Man, M., Chaplin, K., & Salisbury, C. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-031438 · Cited by 63
Blackman, T., Wistow, J., & Byrne, D. (2011) · Social Science & Medicine · doi:10.1016/j.socscimed.2011.04.003 · Cited by 61
Hunt, K., Wyke, S., Bunn, C., Donnachie, C., Reid, N., & Gray, C. M. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17020584 · Cited by 61
Cost-Effectiveness Thresholds in Global Health: Taking a Multisectoral Perspective
Remme, M., Martínez-Álvarez, M., & Vassall, A. (2017) · Value in Health · doi:10.1016/j.jval.2016.11.009 · Cited by 59
A controlled evaluation of an intensive, peer- led, schools-based, anti-smoking programme
Bloor, M., Frankland, J., Parry‐Langdon, N., Robinson, M., Allerston, S., Catherine, A., Cooper, L., Gibbs, L., Gibbs, N., Hamilton-Kirkwood, L., et al. (1999) · Health Education Journal · doi:10.1177/001789699905800103 · Cited by 57
Guise, J., Butler, M., Chang, C., Viswanathan, M., Pigott, T., & Tugwell, P. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.06.017 · Cited by 57
Regression Discontinuity Designs in Health: A Systematic Review
Boon, M. H., Craig, P., Thomson, H., Campbell, M., & Moore, L. (2020) · Epidemiology · doi:10.1097/ede.0000000000001274 · Cited by 57
Self-citationFenwick, E. A. L., Palmer, S., Claxton, K., Sculpher, M., Abrams, K. R., & Sutton, A. J. (2006) · Medical Decision Making · doi:10.1177/0272989x06290493 · Cited by 56
Kypridemos, C., Collins, B., McHale, P., Bromley, H., Parvulescu, P., Capewell, S., & O’Flaherty, M. (2018) · PLoS Medicine · doi:10.1371/journal.pmed.1002573 · Cited by 56
Public involvement in research.
Williamson, T. (2013) · PubMed · Cited by 55
Legislation on smoking in enclosed public places in Scotland: how will we evaluate the impact?
Haw, S. J., Gruer, L. D., Amos, A., Currie, C., Fischbacher, C., Fong, G. T., Hastings, G., Malam, S., Pell, J. P., Scott, C., et al. (2006) · Journal of Public Health · doi:10.1093/pubmed/fdi080 · Cited by 55
Social Norms and the Consumption of Fruits and Vegetables across New York City Neighborhoods
Li, Y., Zhang, D. “., & Pagán, J. A. (2016) · Journal of Urban Health · doi:10.1007/s11524-016-0028-y · Cited by 55
Popay, J., Whitehead, M. M., Carr‐Hill, R., Dibben, C. J. L., Dixon, P., Halliday, E. C., Nazroo, J. Y., Peart, E., Povall, S., Stafford, M., et al. (2015) · Public Health Research · doi:10.3310/phr03120 · Cited by 55
Kreif, N., Grieve, R., & Sadique, Z. (2012) · Health Economics · doi:10.1002/hec.2806 · Cited by 54
Butler, M., Epstein, R. A., Totten, A., Whitlock, E. P., Ansari, M. T., Damschroder, L. J., Balk, E., Bass, E. B., Berkman, N. D., Hempel, S., et al. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.06.013 · Cited by 51
A framework for conducting economic evaluations alongside natural experiments
Deidda, M., Geue, C., Kreif, N., Dundas, R., & McIntosh, E. (2018) · Social Science & Medicine · doi:10.1016/j.socscimed.2018.11.032 · Cited by 51
Self-citationKelly, M. P., Noyes, J., Kane, R. L., Chang, C., Uhl, S., Robinson, K. A., Springs, S., Butler, M. E., & Guise, J.-M. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.06.012 · Cited by 49
Kypridemos, C., Guzman-Castillo, M., Hyseni, L., Hickey, G. L., Bandosz, P., Buchan, I. E., Capewell, S., & O’Flaherty, M. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-013791 · Cited by 49
Petticrew, M. P., McKee, M., Lock, K., Green, J., & Phillips, G. (2013) · BMJ · doi:10.1136/bmj.f4016 · Cited by 46
Self-citationRobinson, M., Geue, C., Lewsey, J., Mackay, D., McCartney, G., Curnock, E., & Beeston, C. (2014) · Addiction · doi:10.1111/add.12701 · Cited by 45
Prosaic or Profound? The Adoption of Systems Ideas by Impact Evaluation
Williams, B. (2015) · IDS Bulletin · doi:10.1111/1759-5436.12117 · Cited by 45
Villeval, M., Bidault, E., Shoveller, J., Alias, F., Basson, J.-C., Frasse, C., Génolini, J., Pons, E., Verbiguié, D., Grosclaude, P., et al. (2016) · International Journal of Public Health · doi:10.1007/s00038-016-0809-9 · Cited by 44
Spero, J. C., McQuide, P., & Matte, R. F. (2011) · Human Resources for Health · doi:10.1186/1478-4491-9-6 · Cited by 43
Holliday, J., Audrey, S., Moore, L., Parry‐Langdon, N., & Campbell, R. M. (2009) · Health Education Journal · doi:10.1177/0017896908100448 · Cited by 43
Self-citationShort-run economic effects of the Scottish smoking ban
Adda, J., Berlinski, S., & Machin, S. J. (2006) · International Journal of Epidemiology · doi:10.1093/ije/dyl258 · Cited by 43
Man, M., Chaplin, K., Mann, C., Bower, P., Brookes, S. T., Fitzpatrick, B., Guthrie, B., Shaw, A. R. G., Hollinghurst, S. P., Mercer, S. W., et al. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-011261 · Cited by 42
Using discrete choice experiments to inform the design of complex interventions
The VMMC study team, Terris‐Prestholt, F., Neke, N. M., Grund, J. M., Plotkin, M., Kuringe, E., Osaki, H., Ong, J. J., Tucker, J. D., Mshana, G. H., et al. (2019) · Trials · doi:10.1186/s13063-019-3186-x · Cited by 42
Collaborating with health economists to advance implementation science: a qualitative study
Barnett, M. L., Dopp, A. R., Klein, C. C., Ettner, S. L., Powell, B. J., & Saldana, L. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00074-w · Cited by 41
Mann, C., Shaw, A. R. G., Guthrie, B., Wye, L., Man, M., Hollinghurst, S. P., Brookes, S. T., Bower, P., Mercer, S. W., & Salisbury, C. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-011260 · Cited by 39
Iron-deficiency anaemia in rural Cambodia: community trial of a novel iron supplementation technique
Charles, C. V., Dewey, C. E., Daniell, W., & Summerlee, A. J. S. (2010) · European Journal of Public Health · doi:10.1093/eurpub/ckp237 · Cited by 38
Mukumbang, F. C., Marchal, B., Belle, S. V., & van Wyk, B. E. (2018) · Qualitative Health Research · doi:10.1177/1049732318784883 · Cited by 38
Building evidence to improve maternal and child health
Olds, D. L. (2015) · The Lancet · doi:10.1016/s0140-6736(15)00476-6 · Cited by 37
‘Pragmatic’ and ‘explanatory’ attitudes to randomised trials
Zwarenstein, M. (2017) · Journal of the Royal Society of Medicine · doi:10.1177/0141076817706303 · Cited by 36
Big-5 Quasi-Experimental designs
Tugwell, P., Knottnerus, J. A., McGowan, J., & Tricco, A. C. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.09.010 · Cited by 36
Fagg, J., Cole, T. J., Cummins, S., Goldstein, H., Stephen Morris, A., Radley, D., Sacher, P. M., & Law, C. (2014) · Journal of Epidemiology & Community Health · doi:10.1136/jech-2014-204155 · Cited by 33
Forsyth, R., Purcell, C., Barry, S., Simpson, S. A., Hunter, R. M., McDaid, L. M., Elliot, L., Bailey, J., Wetherall, K., McCann, M., et al. (2018) · Pilot and Feasibility Studies · doi:10.1186/s40814-018-0354-9 · Cited by 33
Self-citationThe appraisal of public health interventions: an overview
Fischer, A. J., Threlfall, A., Meah, S., Cookson, R., Rutter, H., & Kelly, M. P. (2013) · Journal of Public Health · doi:10.1093/pubmed/fdt076 · Cited by 32
Jabeen, S. (2017) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2017.09.005 · Cited by 30
Thorn, J. C., Man, M., Chaplin, K., Bower, P., Brookes, S. T., Gaunt, D., Fitzpatrick, B., Gardner, C., Guthrie, B., Hollinghurst, S. P., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-030110 · Cited by 28
Minnis, H., Bryce, G., Phin, L., & Wilson, P. (2010) · Clinical Child Psychology and Psychiatry · doi:10.1177/1359104510376124 · Cited by 26
Coffin, P. O., Santos, G., Behar, E., Hern, J., Walker, J. E., Matheson, T., Kinnard, E. N., Silvis, J., Vittinghoff, E., Fox, R. K., et al. (2019) · PLoS ONE · doi:10.1371/journal.pone.0217471 · Cited by 26
Craig, P., & Campbell, M. (2015) · ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) · Cited by 24
Self-citationEvaluating a complex health promotion intervention: case application of three systems methods
Rosas, S. R., & Knight, E. K. (2018) · Critical Public Health · doi:10.1080/09581596.2018.1455966 · Cited by 24
Jones, S. H., Riste, L., Barrowclough, C., Βartlett, P., Clements, C., Davies, L. M., Holland, F., Kapur, N., Lobban, F. A., Long, R., et al. (2018) · Programme Grants for Applied Research · doi:10.3310/pgfar06060 · Cited by 24
Moral entrepreneurship, the power‐knowledge nexus, and the Cochrane “crisis”
Greenhalgh, T., Özbilgin, M. F., Prainsack, B., & Shaw, S. E. (2019) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13124 · Cited by 24
Campbell, M., Moore, G. F., Evans, R., Khodyakov, D., & Craig, P. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-038965 · Cited by 24
Self-citationTurner‐Halliday, F., Kainth, G., Young‐Southward, G., Cotmore, R., Watson, N., McMahon, L., & Minnis, H. (2017) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2017.07.012 · Cited by 23
Cooper, C. (2019) · International Journal of Research & Method in Education · doi:10.1080/1743727x.2019.1667579 · Cited by 23
Douglas, F., Gray, D., & van Teijlingen, E. (2010) · BMC Health Services Research · doi:10.1186/1472-6963-10-49 · Cited by 22
Brand, S. L., Musgrove, A., Jeffcoate, W. J., & Lincoln, N. B. (2015) · Diabetic Medicine · doi:10.1111/dme.12831 · Cited by 21
Green, B. B., Coronado, G. D., Schwartz, M., Coury, J., & Baldwin, L. (2019) · Implementation Science · doi:10.1186/s13012-019-0903-5 · Cited by 20
Lack of evidence hampers human-resources policy making
Pick, W. M. (2008) · The Lancet · doi:10.1016/s0140-6736(08)60280-9 · Cited by 19
Charles, C. V. (2015) · Tropical Medicine & Surgery · doi:10.4172/2329-9088.1000195 · Cited by 17
Development of a radical foster care intervention in Glasgow, Scotland
Boyd, K., Balogun, M. O., & Minnis, H. (2015) · Health Promotion International · doi:10.1093/heapro/dav041 · Cited by 17
Self-citationImpact of Scottish Smoke-Free Legislation on Smoking Quit Attempts and Prevalence
Mackay, D., Haw, S. J., & Pell, J. P. (2011) · PLoS ONE · doi:10.1371/journal.pone.0026188 · Cited by 17
Eckenrode, J., Campa, M., Luckey, D. W., Henderson, C. R., Cole, R., Kitzman, H., Anson, E., Sidora-Arcoleo, K., Powers, J., & Olds, D. (2010) · Archives of Pediatrics & Adolescent Medicine · doi:10.1001/archpediatrics.2009.240 · Cited by 17
Pritchett, R., Fitzpatrick, B., Watson, N., Cotmore, R., Wilson, P., Bryce, G., Donaldson, J., Boyd, K., Zeanah, C. H., Norrie, J. D., et al. (2013) · The Scientific World JOURNAL · doi:10.1155/2013/838042 · Cited by 17
Self-citationHEALTH TECHNOLOGY ASSESSMENT OF PUBLIC HEALTH INTERVENTIONS: A SYNTHESIS OF METHODOLOGICAL GUIDANCE
Mathes, T., Antoine, S., Prengel, P., Bühn, S., Polus, S., & Pieper, D. (2017) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462317000228 · Cited by 17
Meyrick, J., & Gray, D. (2018) · BMJ Sexual & Reproductive Health · doi:10.1136/bmjsrh-2018-200082 · Cited by 17
McGill, E., Marks, D., Sumpter, C., & Egan, M. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010759 · Cited by 15
Miller, G., Pinto, D., & Vera‐Hernández, M. (2009) · National Bureau of Economic Research · doi:10.3386/w15456 · Cited by 15
A guide to value of information methods for prioritising research in health impact modelling
Jackson, C. H., Johnson, R., de Nazelle, A. J., Goel, R., de Sá, T. H., Tainio, M., & Woodcock, J. (2021) · Epidemiologic Methods · doi:10.1515/em-2021-0012 · Cited by 15
Deidda, M., Boyd, K., Minnis, H., Donaldson, J., Brown, K., Boyer, N. R. S., & McIntosh, E. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-020066 · Cited by 14
Self-citationConceptual modelling for health economic model development
Tappenden, P. (2012) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · Cited by 13
Sumpter, C., McGill, E., Dickie, E., Champo, E., Romeri, E., & Egan, M. (2016) · BMC Public Health · doi:10.1186/s12889-016-3117-7 · Cited by 13
Honeycutt, S., Hermstad, A. K., Carvalho, M., Arriola, K. J., Ballard, D., Escoffery, C., & Kegler, M. C. (2016) · Health Education & Behavior · doi:10.1177/1090198116673360 · Cited by 13
Return on investment, social return on investment, and the business case for prevention
Charles, J. M., Jones, A., & Lloyd-Williams, H. (2019) · Oxford University Press eBooks · doi:10.1093/med/9780198737483.003.0012 · Cited by 10
Responding to change: how did bar workers adapt to the smoke-free legislation in Scotland?
Eadie, D. R., MacAskill, S., Heim, D., & Hastings, G. (2010) · International Journal of Environmental Health Research · doi:10.1080/09603120903255279 · Cited by 9
The Minnesota SimSmoke Tobacco Control Policy Model of Smokeless Tobacco and Cigarette Use
Levy, D. T., Yuan, Z., Li, Y., Claire, A. W. S., & Schillo, B. (2019) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2019.06.003 · Cited by 9
Modeling the Paradox of Primary Care
Rose, J., Riolo, R., Hovmand, P. S., Cherng, S. T., Ferrer, R. L., Katerndahl, D. A., Jaén, C. R., Hower, T., Ruhe, M. C., Aungst, H., et al. (2012) · Springer eBooks · doi:10.1007/978-1-4614-4998-0_46 · Cited by 8
Tugwell, P., Knottnerus, J. A., & Idzerda, L. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.09.003 · Cited by 7
What is the most effective operation for adults with severe and complex obesity?
Blazeby, J. M., Byrne, J. P., & Welbourn, R. (2014) · BMJ · doi:10.1136/bmj.g1763 · Cited by 5
Self-citation
Cited by
Skivington, K., Matthews, L., Simpson, S. A., Craig, P., Baird, J., Blazeby, J. M., Boyd, K. A., Craig, N., French, D. P., McIntosh, E., et al. (2021) · BMJ · doi:10.1136/bmj.n2061 · Cited by 5,808
Self-citationWorld guidelines for falls prevention and management for older adults: a global initiative
Montero-Odasso, M., van der Velde, N., Martin, F. C., Petrovic, M., Tan, M. P., Ryg, J., Aguilar-Navarro, S., Alexander, N. B., Becker, C., Blain, H., et al. (2022) · Age and Ageing · doi:10.1093/ageing/afac205 · Cited by 1,756
Vetrovsky, T., Borowiec, A., Juřík, R., Wahlich, C., Śmigielski, W., Steffl, M., Tufano, J. J., Drygas, W., Stastny, P., Harris, T., et al. (2022) · British Journal of Sports Medicine · doi:10.1136/bjsports-2021-105198 · Cited by 68
Evans, R., MacDonald, S., Trubey, R., Noyes, J., Robling, M., Willis, S., Boffey, M., Wooders, C., Vinnicombe, S., & Melendez-Torres, G. J. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02260-y · Cited by 29
Mobilising context as complex and dynamic in evaluations of complex health interventions
Murdoch, J., Paparini, S., Papoutsi, C., James, H., Greenhalgh, T., & Shaw, S. E. (2023) · BMC Health Services Research · doi:10.1186/s12913-023-10354-5 · Cited by 23
Metadata
- Authors
- Skivington, K., Matthews, L., Simpson, S. A., Craig, P., Baird, J., Blazeby, J. M., Boyd, K. A., Craig, N., French, D. P., McIntosh, E., Petticrew, M., Rycroft-Malone, J., White, M., & Moore, L.
- Venue
- Health Technology Assessment
- Published
- 2021-09
- Volume
- 25
- Issue
- 57
- Pages
- 1-132
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W3157335401
- Cited by
- 522
- References
- 325
- FWCI
- 87.00
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.