Specifying and reporting complex behaviour change interventions: the need for a scientific method
Open accessThe DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Abstract
Complex behaviour change interventions are not well described; when they are described, the terminology used is inconsistent. This constrains scientific replication, and limits the subsequent introduction of successful interventions. Implementation Science is introducing a policy of initially encouraging and subsequently requiring the scientific reporting of complex behaviour change interventions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A small number have editorial policies stating they will not publish trials unless intervention protocols or full details are available. 26”
From Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide (2014) · cites this paper as [26]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“and this makes it difficult to search the empirical literature, conduct meta-analyses, and ultimately, to build a body of evidence that supports the use of specific strategies in particular contexts [9,64].”
From Implementation strategies: recommendations for specifying and reporting (2013) · cites this paper as [9]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Second, published descriptions of implementation strategies too often do not include sufficient detail to enable either scientific or real-world replication [1,6]”
From A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project (2015) · cites this paper as [6]
The cited source says what the claim attributes to it.
In the citing paper
“However, efforts to identify, develop, and test implementation strategies have been complicated by a lack of conceptual clarity [1,6-9].”
From A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project (2015) · cites this paper as [6]
The cited source says what the claim attributes to it.
In the citing paper
“Adopting these guidelines would address many of the current problems that make it difficult to interpret and use findings from implementation research, such as inconsistent labelling, poor descriptions, and unclear justification for specific implementation strategies [9-11,13].”
From Implementation strategies: recommendations for specifying and reporting (2013) · cites this paper as [9]
14 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.11.008 · Cited by 17,893
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-8-200710160-00010 · Cited by 17,796
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995 · cited 2×
“, [29]), but within-person or within-organisation research designs offer an efficient way to experimentally determine the function of individual components of evidence-based practices and programs [18,30-34].”
BackgroundMethodSelf-citationDiffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448
Actual causes of death in the United States
McGinnis, J. M. (1993) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1993.03510180077038 · Cited by 5,480
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04337-3 · Cited by 5,373
Actual Causes of Death in the United States, 2000
Mokdad, A. H. (2004) · JAMA · doi:10.1001/jama.291.10.1238 · Cited by 5,211
Single-Case Research Designs: Methods for Clinical and Applied Settings
Kazdin, A. E. (1982) · Cited by 3,985
(2005) · Cited by 3,748
Self-citationDes Jarlais, D. C., Lyles, C., Crepaz, N., & the TREND Group (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.361 · Cited by 2,817
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · BMC Medical Research Methodology · doi:10.1186/1471-2288-1-2 · Cited by 2,755
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · Preventive Medicine · doi:10.1016/j.ypmed.2007.08.012 · Cited by 2,698
Single-case research designs: Methods for clinical and applied settings
Hayes, S. C. (1983) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(83)90018-6 · Cited by 2,677
A taxonomy of behavior change techniques used in interventions
Abraham, C., & Michie, S. (2008) · Health Psychology · doi:10.1037/0278-6133.27.3.379 · Cited by 2,525 · cited 2×
“Using inductive and consensus methods, systematic reviews of behaviour change interventions and relevant textbooks have been analysed [14,42].”
BackgroundMethodSelf-citationBoutron, I., Moher, D., Altman, D. G., Schulz, K. F., Ravaud, P., & for the CONSORT Group* (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-4-200802190-00008 · Cited by 2,292
Effective techniques in healthy eating and physical activity interventions: A meta-regression.
Michie, S., Abraham, C., Whittington, C., McAteer, J., & Gupta, S. (2009) · Health Psychology · doi:10.1037/a0016136 · Cited by 2,229
Self-citationDeveloping and Evaluating Complex Interventions: New Guidance
Craig, P., Dieppe, P. A., MacIntyre, S., Michie, S., Nazareth, I., & Petticrew, M. P. (2006) · UCL Discovery (University College London) · Cited by 1,978
Self-citationMichie, S., Johnston, M., Francis, J., Hardeman, W., & Eccles, M. (2008) · Applied Psychology · doi:10.1111/j.1464-0597.2008.00341.x · Cited by 1,789 · cited 2×
“Intervention development methods and content are often based on simple, mostly unstated models of human behaviour or, at best, are 'informed' by theory using methods that are tenuous and intuitive rather than systematic [14,15].”
BackgroundMethodSelf-citation(1999) · Cited by 1,648
Dane, A. V., & Schneider, B. H. (1998) · Clinical Psychology Review · doi:10.1016/s0272-7358(97)00043-3 · Cited by 1,557 · cited 1×
“Reviews of nearly 1,000 behaviour change outcome studies [7-10] found that interventions were described in detail in only 5% to 30% of the experimental studies.”
BackgroundContradicted and Initially Stronger Effects in Highly Cited Clinical Research
Ioannidis, J. P. A. (2005) · JAMA · doi:10.1001/jama.294.2.218 · Cited by 1,465
Health Program Planning: An Educational and Ecological Approach
Green, L. W., & Kreuter, M. W. (1991) · Cited by 1,332
Winter, S. G., & Szulanski, G. (2001) · Organization Science · doi:10.1287/orsc.12.6.730.10084 · Cited by 1,309
Green, L. W., & Glasgow, R. E. (2006) · Evaluation & the Health Professions · doi:10.1177/0163278705284445 · Cited by 922
Eccles, M., Grimshaw, J., Walker, A., Johnston, M., & Pitts, N. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.09.002 · Cited by 917 · cited 1×
“There is increasing recognition that the design of behaviour change interventions should be based on relevant theories [4,16,17,46].”
BackgroundSelf-citationFidelity Criteria: Development, Measurement, and Validation
MOWBRAY, C. (2003) · The American Journal of Evaluation · doi:10.1016/s1098-2140(03)00057-2 · Cited by 884
Treatment fidelity in outcome studies
Moncher, F. J., & Prinz, R. J. (1991) · Clinical Psychology Review · doi:10.1016/0272-7358(91)90103-2 · Cited by 797 · cited 1×
“Reviews of nearly 1,000 behaviour change outcome studies [7-10] found that interventions were described in detail in only 5% to 30% of the experimental studies.”
BackgroundAlbarracín, D., Gillette, J. C., Earl, A. N., Glasman, L. R., Durantini, M. R., & Ho, M.-H. (2005) · Psychological Bulletin · doi:10.1037/0033-2909.131.6.856 · Cited by 792 · cited 1×
“Using theory to identify constructs (key concepts in the theory) that are causally related to behaviour, and are therefore appropriate targets for the intervention, can confer a range of benefits including potentially stronger effects [47-49].”
BackgroundInterventions to change health behaviours: evidence-based or evidence-inspired?
Michie, S., & Abraham, C. (2004) · Psychology & Health · doi:10.1080/0887044031000141199 · Cited by 784
Self-citation(2014) · Case Research in Public Management · doi:10.4324/9781315705941-10 · Cited by 766
Chorpita, B. F., Daleiden, E. L., & Weisz, J. R. (2005) · Mental Health Services Research · doi:10.1007/s11020-005-1962-6 · Cited by 717
Theoretical Approaches to Individual-Level Change in HIV Risk Behavior
Fisher, J. D., & Fisher, W. A. (2000) · Aids Prevention and Mental Health · doi:10.1007/978-1-4615-4137-0_1 · Cited by 502
Prenatal and infancy home visiting by nurses: From randomized trials to community replication
Olds, D. L. (2002) · Prevention Science · doi:10.1023/a:1019990432161 · Cited by 490 · cited 1×
“As a simple example, a core component of Multi-systemic Therapy (MST), Homebuilders, and Nurse-Family Partnership (NFP) interventions is that they are delivered in the homes of children [23-25].”
BackgroundOgrinc, G., Mooney, S. E., Estrada, C., Foster, T., Goldmann, D., Hall, L. W., Huizinga, M. M., Liu, S. K., Mills, P., Neily, J., et al. (2008) · Quality and Safety in Health Care · doi:10.1136/qshc.2008.029058 · Cited by 444
Evidence-based behavioral medicine: What is it and how do we achieve it?
Davidson, K. W., Goldstein, M., Kaplan, R. M., Kaufmann, P. G., Knatterud, G. L., Orleans, C. T., Spring, B., Trudeau, K. J., & Whitlock, E. P. (2003) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2603_01 · Cited by 408
Designing theoretically-informed implementation interventions
The Improved Clinical Effectiveness through Behavioural Research Group (ICEBeRG) (2006) · Implementation Science · doi:10.1186/1748-5908-1-4 · Cited by 380
Publication guidelines for quality improvement in health care: evolution of the SQUIRE project
Davidoff, F., Batalden, P., Stevens, D., Ogrinc, G., Mooney, S., & for the SQUIRE development group (2008) · Quality and Safety in Health Care · doi:10.1136/qshc.2008.029066 · Cited by 324 · cited 1×
“The extension of these guidelines to non-pharmacological trials [36], the TREND Statement for the transparent reporting of evaluations with non-randomised designs [37] and the STROBE Statement for strengthening the reporting of observational studies [38] all call for intervention content to be described, as do the SQU…”
MethodTREATMENT INTEGRITY IN APPLIED BEHAVIOR ANALYSIS WITH CHILDREN
Gresham, F. M., Gansle, K. A., & Noell, G. H. (1993) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1993.26-257 · Cited by 299 · cited 1×
“Reviews of nearly 1,000 behaviour change outcome studies [7-10] found that interventions were described in detail in only 5% to 30% of the experimental studies.”
BackgroundOdom, S. L., Brown, W. H., Frey, T., Karasu, N., Lee Smith-Canter, L., & Strain, P. S. (2003) · Focus on Autism and Other Developmental Disabilities · doi:10.1177/10883576030180030401 · Cited by 288
(2000) · Aids Prevention and Mental Health · doi:10.1007/978-1-4615-4137-0 · Cited by 257
Study Designs for PDSA Quality Improvement Research
Speroff, T., & OʼConnor, G. T. (2004) · Quality Management in Health Care · doi:10.1097/00019514-200401000-00002 · Cited by 253
National Institute of Health and Clinical Excellence
Smedley, J. (2006) · Occupational Medicine · doi:10.1093/occmed/kql029 · Cited by 220
Reinventing fidelity: The transfer of social technology among settings
Bauman, L. J., Stein, R. E. K., & Ireys, H. T. (1991) · American Journal of Community Psychology · doi:10.1007/bf00937995 · Cited by 208
Schoenwald, S. K., Sheidow, A. J., & Letourneau, E. J. (2004) · Journal of Clinical Child & Adolescent Psychology · doi:10.1207/s15374424jccp3301_10 · Cited by 206
Reducing Risks to Health, Promoting Healthy Life
(2002) · JAMA · doi:10.1001/jama.288.16.1974 · Cited by 197
Effectiveness of the 40 adolescent AIDS-risk reduction interventions: A quantitative review
Kim, N., Stanton, B., Li, X., Dickersin, K., & Galbraith, J. (1997) · Journal of Adolescent Health · doi:10.1016/s1054-139x(96)00169-3 · Cited by 183
Designing and implementing behaviour change interventions to improve population health
Michie, S. (2008) · Journal of Health Services Research & Policy · doi:10.1258/jhsrp.2008.008014 · Cited by 182
Self-citationKeeping families together: the homebuilders model
(1991) · Choice Reviews Online · doi:10.5860/choice.29-1208 · Cited by 135
Keeping Families Together: The Homebuilders Model
Kinney, J. M., Haapala, D. A., & Booth, C. (1991) · Cited by 115
Family-Based Empirically Supported Interventions
Sexton, T. L., & Alexander, J. F. (2002) · The Counseling Psychologist · doi:10.1177/0011000002302003 · Cited by 104
Wolf, M. M., Kirigin, K. A., Fixsen, D. L., Blase, K. A., & Braukmann, C. J. (1995) · Journal of Organizational Behavior Management · doi:10.1300/j075v15n01_04 · Cited by 97
Self-citationOdom, S. L., & Strain, P. S. (2002) · Journal of Early Intervention · doi:10.1177/105381510202500212 · Cited by 97
Sullivan, G., Blevins, D., & Kauth, M. R. (2008) · Implementation Science · doi:10.1186/1748-5908-3-33 · Cited by 51
Riley, B. L., MacDonald, J., Mansi, O., Kothari, A., Kurtz, D., vonTettenborn, L. I., & Edwards, N. C. (2008) · Implementation Science · doi:10.1186/1748-5908-3-27 · Cited by 44
Lessons Learned: What the WAY Program Can Teach Us about Program Replication.
Dale, N., Baker, A. C., & Racine, D. (2002) · Cited by 7
Research works printed but not linked: 3
- Michie S Johnston M Francis J Hardeman W Behaviour change interventions: Developing a classification system 2005 Workshop presented at the 1st annual conference of the UK Society for Behavioural Medicine, London
- James Bell Associates Family preservation and family support (FP/FS) services implementation study: Interim Report 1999 Arlington, VA: James Bell Associates
- Blase KA Fixsen DL Paine SC, Bellamy GT, Wilcox B Residential treatment for troubled children: Developing service delivery systems Human services that work: From innovation to standard practice 1984 Baltimore, MD: Paul H. Brookes Publishing 149 165
Cited by
Michie, S., van Stralen, M. M., & West, R. (2011) · Implementation Science · doi:10.1186/1748-5908-6-42 · Cited by 13,697
“The response to this is twofold: these are empirical questions and there is already evidence that characterising interventions by behaviour change techniques (BCTs) can be helpful in understanding which interventions are more or less effective [6,17]; and not to embark on this enterprise is to give up on achieving a s…”
Self-citationHoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548
Self-citationProctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721
“Understanding how to achieve implementation outcomes requires the kind of work now underway by Michie et al. (2009) advance a taxonomy of implementation strategies and reflect their demonstrated effects.”
BackgroundResultInfluentialProcess evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204
Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., & Kirchner, J. E. (2015) · Implementation Science · doi:10.1186/s13012-015-0209-1 · Cited by 4,963
“Second, published descriptions of implementation strategies too often do not include sufficient detail to enable either scientific or real-world replication [1,6], leading some to suggest guidelines for specifying and reporting implementation strategies [1,6,13,14].”
BackgroundInfluential
Metadata
- Authors
- Michie, S., Fixsen, D., Grimshaw, J. M., & Eccles, M. P.
- Affiliations
- University College London (GB)
- University of North Carolina at Chapel Hill (US)
- University of Ottawa (CA)
- Newcastle University (GB)
- Corresponding author
- Michie, Susan
- Venue
- Implementation Science
- Published
- 2009-07-16
- Volume
- 4
- Issue
- 1
- Pages
- 40-40
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC2717906
- OpenAlex
- W2110720428
- Semantic Scholar
- 3ea7cd3ac9e54c89c967e0649fe7c019177b3b26
- Cited by
- 976
- References
- 57
- Citations by year
- 2026: 22 · 2025: 27 · 2024: 66 · 2023: 46 · 2022: 67 · 2021: 53 · 2020: 85 · 2019: 62 · 2018: 80 · 2017: 66 · 2016: 61 · 2015: 66 · 2014: 61 · 2013: 130 · 2012: 38
- FWCI
- 50.23
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Implementation Science (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Carolina Digital Repository (University of North Carolina at Chapel Hill) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Funders
- Medical Research Council
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Psychology › Applied Psychology › Behavioral Health and Interventions
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Keywords
- intervention reporting, reporting guidelines, terminology consistency
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.