Active ingredients are reported more often for pharmacologic than non-pharmacologic interventions: an illustrative review of reporting practices in titles and abstracts
Open accessAbstract
Key components of healthcare interventions include 'active ingredients' (intervention components that can be specifically linked to effects on outcomes such that, were they omitted, the intervention would be ineffective). These should be reported in titles and abstracts of published reports of randomized controlled trials (RCTs). However, reporting of non-pharmacologic interventions (NPIs), particularly behaviour change interventions (BCIs), is difficult, owing to their complexity. This illustrative review compares how pharmacologic interventions (PIs), NPIs and BCIs are specified in titles and abstracts to clarify how reporting of NPIs and BCIs can be improved. MEDLINE and Embase were searched for RCTs published in the British Medical Journal, The Journal of the American Medical Association, The New England Journal of Medicine, The Lancet and Annals of Behavioral Medicine from 2009 to March 2011. All types of intervention, participant and outcome were included. A random sample of 198 studies (sampled proportionally from included journals) stratified by intervention type (PI/NPI) was taken: 98 evaluated PIs, 96 evaluated NPIs and four evaluated both. Studies were coded for the presence or absence of key components. The frequency data were analyzed using the chi-square test. Active ingredients were named in 88% titles and 95% abstracts of PI reports, and in 51% titles and 71% abstracts of NPI reports, with a significant association between intervention type and reporting of active ingredients in titles (χ2(1) = 28.90; P < 0.001) and abstracts (χ2(1) = 16.94; P < 0.001). Active ingredients were named in BCI reports in 37% titles and 56% abstracts, and in other NPI reports in 66% titles and 86% abstracts. There was also a significant association between intervention type and reporting of active ingredients in titles (χ2(1) = 6.68; P = 0.010) and abstracts (χ2(1) = 8.66; P = 0.003). Reporting practices also differed for such components as the trial setting and intervention provider. This review highlights the need for improved reporting of NPIs (particularly BCIs) and indicates that a set of agreed labels and definitions for complex NPIs could facilitate standardized reporting. This would ensure that interventions can be faithfully replicated and that evidence for interventions can be appropriately synthesized.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Titles and abstracts of published interventions have been found to mention the active components of the intervention in only 56% of published descriptions compared with over 90% in pharmacological interventions.
“Titles and abstracts of published interventions (i.e. the materials screened for inclusion in systematic reviews) have been found to mention the active components of the intervention in only 56% of published descriptions compared with over 90% in pharmacological interventions.42”
For BCIs, further information is required to specify the active ingredients.
“However, for BCIs, further information is required to specify the active ingredients, that is 'components within an intervention that can be specifically linked to its effect on outcomes such that, if they were omitted, the intervention would be ineffective'.42”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995 · cited 1× · see citing works
“Such interventions may [5]: Involve several interacting components.”
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883 · cited 2× · see citing works
“The Consolidated Standards of Reporting Trials (CONSORT) guidelines [14] were developed to improve the quality of reporting of RCTs, and specific CONSORT guidelines (Table 1) have been developed for abstracts [1] and for NPIs [2], including surgical interventions, devices, rehabilitation packages and behaviour change…”
Michie, S., Richardson, M., Johnston, M., Abraham, C., Francis, J., Hardeman, W., Eccles, M. P., Cane, J., & Wood, C. E. (2013) · Annals of Behavioral Medicine · doi:10.1007/s12160-013-9486-6 · Cited by 7,629 · cited 2× · see citing works
“Indeed, a system for specifying the exact techniques used in BCIs has recently been developed [21].”
Self-citationFramework for design and evaluation of complex interventions to improve health
Campbell, M. (2000) · BMJ · doi:10.1136/bmj.321.7262.694 · Cited by 3,474 · cited 1× · see citing works
“on the phases used to evaluate PIs [6].”
Systematic reviews: CRD's guidance for undertaking reviews in health care
Tacconelli, E. (2010) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(10)70065-7 · Cited by 3,237 · see citing works
A taxonomy of behavior change techniques used in interventions
Abraham, C., & Michie, S. (2008) · Health Psychology · doi:10.1037/0278-6133.27.3.379 · Cited by 2,525 · cited 3× · see citing works
“Specific techniques used might include goal setting, providing information on consequences of behaviour and prompting self-monitoring of behaviour [8].”
Boutron, I., Moher, D., Altman, D. G., Schulz, K. F., Ravaud, P., & for the CONSORT Group* (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-4-200802190-00008 · Cited by 2,292 · cited 6× · see citing works
“Table 1 Checklists adapted from the CONSORT extension for non-pharmacologic interventions [2]”
InfluentialDeveloping and Evaluating Complex Interventions: New Guidance
Craig, P., Dieppe, P. A., MacIntyre, S., Michie, S., Nazareth, I., & Petticrew, M. P. (2006) · UCL Discovery (University College London) · Cited by 1,877 · see citing works
Interventions to change health behaviours: evidence-based or evidence-inspired?
Michie, S., & Abraham, C. (2004) · Psychology and Health · doi:10.1080/0887044031000141199 · Cited by 783 · see citing works
Hopewell, S., Clarke, M., Moher, D., Wager, E., Middleton, P., Altman, D. G., Schulz, K. F., & and the CONSORT Group (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050020 · Cited by 674 · cited 8× · see citing works
“Background Well designed and executed randomized controlled trials (RCTs) are the gold standard for assessing intervention efficacy and effectiveness, but study synthesis, comparison and reproducibility are compromised if interventions are poorly reported [1,2].”
InfluentialTate, D. F., Jackvony, E. H., & Wing, R. R. (2003) · JAMA · doi:10.1001/jama.289.14.1833 · Cited by 666 · cited 1× · see citing works
“Study 1 [38] Study 2 [39]”
What is missing from descriptions of treatment in trials and reviews?
Glasziou, P., Meats, E., Heneghan, C., & Shepperd, S. (2008) · BMJ · doi:10.1136/bmj.39590.732037.47 · Cited by 614 · cited 4× · see citing works
“These results are in accordance with those described previously from reviews comparing full-text PI and NPI reports [18,19].”
InfluentialCan We Systematically Review Studies That Evaluate Complex Interventions?
Shepperd, S., Lewin, S., Straus, S., Clarke, M., Eccles, M. P., Fitzpatrick, R., Wong, G., & Sheikh, A. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000086 · Cited by 408 · cited 2× · see citing works
“Agreed labels (drug names) are used for the same PI [18,36], making specification more straightforward.”
Evidence-based behavioral medicine: What is it and how do we achieve it?
Davidson, K. W., Goldstein, M. G., Kaplan, R. M., Kaufmann, P. G., Knatterud, G. L., Orleans, C. T., Spring, B. J., Trudeau, K. J., & Whitlock, E. P. (2003) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2603_01 · Cited by 407 · cited 3× · see citing works
“Although Davidson and colleagues [3] proposed additional guidelines for reporting BCIs, these do not include specific recommendations for abstracts.”
Association of Journal Quality Indicators With Methodological Quality of Clinical Research Articles
Lee, K. P. (2002) · JAMA · doi:10.1001/jama.287.21.2805 · Cited by 284 · see citing works
Treatment of childhood obesity by retraining eating behaviour: Randomised controlled trial
Ford, A. L., Bergh, C., Sodersten, P., Sabin, M. A., Hollinghurst, S., Hunt, L. P., & Shield, J. P. H. (2009) · BMJ · doi:10.1136/bmj.b5388 · Cited by 214 · see citing works
Steptoe, A., Kerry, S., Rink, E., & Hilton, S. R. (2001) · American Journal of Public Health · doi:10.2105/ajph.91.2.265 · Cited by 203 · cited 1× · see citing works
“Study 1 [38] Study 2 [39]”
ORWOLL, E. S., Miller, P. D., Adachi, J. D., Brown, J. P., Adler, R. A., Kendler, D. L., Bucci-Rechtweg, C. M., Readie, A., Mesenbrink, P. G., & Weinstein, R. S. (2010) · Journal of Bone and Mineral Research · doi:10.1002/jbmr.119 · Cited by 185 · cited 1× · see citing works
“The active ingredients of a PI can usually be specified clearly in one phrase within a sentence (for example, ‘Zoledronic acid’ [16]).”
BackgroundClark, A. M. (2012) · Social Science & Medicine · doi:10.1016/j.socscimed.2012.03.035 · Cited by 169 · cited 3× · see citing works
“Provided these techniques have the potential to influence the health-related behaviour associated with heart disease (that is, causally influence outcomes) [7], they can be described as active ingredients.”
InfluentialAnalysis of quality of interventions in systematic reviews
Herbert, R., & B�, K. (2005) · BMJ · doi:10.1136/bmj.331.7515.507 · Cited by 164 · cited 1× · see citing works
“This seems low, given that the settings in which NPIs are administered are likely to interact with the intervention’s active ingredients to influence its effectiveness [40].”
Boutron, I. (2003) · JAMA · doi:10.1001/jama.290.8.1062 · Cited by 155 · cited 6× · see citing works
“This choice of a limited range of journals is in accordance with previous comparisons of reporting practices where the goal is not to be exhaustive but to highlight the issues inherent in the reporting of NPIs [18].”
InfluentialMcCance, D. R., Holmes, V. A., Maresh, M., Patterson, C., Walker, J. D., Pearson, D. W. M., & Young, I. S. (2010) · The Lancet · doi:10.1016/s0140-6736(10)60630-7 · Cited by 145 · cited 1× · see citing works
“…title: ‘ Vitamins C and E for prevention of pre-eclampsia in women with type 1 diabetes (DAPIT): a randomized placebo-controlled trial ’ [28] Non-pharmacologic intervention title: ‘ Treatment of childhood obesity by retraining eating behaviour: randomized controlled trial ’ [29] Active…”
The quality of reporting of trial abstracts is suboptimal: survey of major general medical journals
Berwanger, O., Ribeiro, R. A., Finkelsztejn, A., Watanabe, M., Suzumura, E. A., Duncan, B. B., Devereaux, P. J., & Cook, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.05.013 · Cited by 133 · cited 3× · see citing works
“The study of abstract quality is a fairly recent development [9], with most reviews focused on reporting of trial components [9,10,13].”
Smeulders, E. S. T. F., Van Haastregt, J. C. M., Ambergen, T., Uszko‐Lencer, N. H. K. M., Janssen‐Boyne, J. J. J., Gorgels, A. P. M., Stoffers, H. E. J. H., Lodewijks‐van der Bolt, C. L. B., Van Eijk, J. T. M., & Kempen, G. I. J. M. (2010) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2010.05318.x · Cited by 110 · cited 1× · see citing works
“’ [17]).”
Can, O., Yılmaz, A., Hasdogan, M., Alkaya, F., Turhan, S., Can, M., & Alanoğlu, Z. (2011) · European Journal of Anaesthesiology · doi:10.1097/eja.0b013e32833fb96f · Cited by 82 · see citing works
Dombrowski, S. U., Sniehotta, F. F., Avenell, A., & Coyne, J. (2007) · Psychology and Health · doi:10.1080/08870440701520973 · Cited by 77 · see citing works
Burns, K. E. A., Adhikari, N. K. J., Kho, M. E., Meade, M. O., Patel, R. V., Sinuff, T., & Cook, D. J. (2005) · Critical Care Medicine · doi:10.1097/01.ccm.0000178361.73895.24 · Cited by 32 · cited 4× · see citing works
“Reviews of full-text articles [18,19] and reviews of abstracts [9,10,13,41] have highlighted deficiencies in reporting.”
InfluentialRecovering from severe brain injury
Thomas, D. J. B., & Skelton-Robinson, M. (2010) · BMJ · doi:10.1136/bmj.c839 · Cited by 9 · see citing works
Writing the abstract: completeness and accuracy matter
von Elm, E. B. (2011) · European Journal of Anaesthesiology · doi:10.1097/eja.0b013e328343b160 · Cited by 2 · see citing works
Quality of abstract reporting: Caveat medicus*
Doig, G. S. (2005) · Critical Care Medicine · doi:10.1097/01.ccm.0000178290.42739.ec · Cited by 1 · see citing works
Flagged first, then by citations
2 of the 32 references couldn’t be matched to a known paper.
Research works printed but not linked: 9
- Boutron I Ravaud P Boutron I, Ravaud P, Moher D Reporting guidelines for nonpharmacological trials Randomized Clinical Trials of Nonpharmacological Treatments 2012 Florida: Chapman & Hall/CRC Press 199 210
- Thomson R ISI Web of Knowledge: Journal Citation Reports [ http://admin-apps.webofknowledge.com/JCR/JCR]
- Higgins JPT Deeks JJ Higgins JPT, Green S Chapter 7: Selecting studies and collecting data Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 2011 London: The Cochrane Collaboration [ http://www.cochrane-handbook.org/]
- Petrie A Sabin C Medical Statistics at a Glance 2005 2 Oxford: Blackwell Publishing Ltd
- Annals of Behavioral Medicine Instructions for Authors [ http://www.springer.com/medicine/journal/12160]
- The British Medical Journal Resources for Authors: Types of Article: Research [ http://www.bmj.com/about-bmj/resources-authors]
- JAMA Instructions for Authors [ http://jama.jamanetwork.com/public/instructionsForAuthors.aspx]
- The New England Journal of Medicine Author Center New Manuscripts [ http://www.nejm.org/page/author-center/manuscript-submission]
- The Lancet Information for Authors: Types of Article and Manuscript Requirements [ http://www.thelancet.com/lancet-information-for-authors/article-types-manuscript-requirements]
Cited by
Sorted by citations
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548 · see citing works
“In some literature, the term ‘active ingredient’ is used and refers to the components within an intervention that can be specifically linked to its effect on outcomes such that, if they were omitted, the intervention would be ineffective.(16) The known or supposed mechanism of action of the active component/s of the i…”
Boutron, I., Altman, D. G., Moher, D., Schulz, K. F., Ravaud, P., & for the CONSORT NPT Group* (2017) · Annals of Internal Medicine · doi:10.7326/m17-0046 · Cited by 1,538 · see citing works
Michie, S., Wood, C. E., Johnston, M., Abraham, C., Francis, J. J., & Hardeman, W. (2015) · Health Technology Assessment · doi:10.3310/hta19990 · Cited by 680 · see citing works
Self-citationHoffmann, T., Glasziou, P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2016) · Das Gesundheitswesen · doi:10.1055/s-0041-111066 · Cited by 154 · see citing works
Translational Behavioral Medicine
Spring, B. J., Pfammatter, A. F., Hoffman, S. A., & Warnick, J. L. (2017) · Springer eBooks · doi:10.1007/978-1-4614-6439-6_221-2 · Cited by 134 · see citing works
Using Qualitative Research for Complex Interventions
Thirsk, L. M., & Clark, A. M. (2017) · International Journal of Qualitative Methods · doi:10.1177/1609406917721068 · Cited by 121 · see citing works
Applying the behaviour change technique (BCT) taxonomy v1: A study of coder training
Wood, C. E., Richardson, M., Johnston, M., Abraham, C., Francis, J., Hardeman, W., & Michie, S. (2015) · Translational Behavioral Medicine · doi:10.1007/s13142-014-0290-z · Cited by 100 · see citing works
“In contrast to interventions in biomedicine, no standardised language exists for reporting the ‘ active components ’ delivered in behaviour change interventions [9].”
BackgroundSelf-citationWarran, K., Burton, A., & Fancourt, D. E. (2022) · Wellcome Open Research · doi:10.12688/wellcomeopenres.17414.2 · Cited by 87 · see citing works
Michie, S., & Johnston, M. (2017) · Implementation Science · doi:10.1186/s13012-017-0660-2 · Cited by 82 · see citing works
“Complexity is exacerbated when reporting of interventions and studies is incomplete [8], a problem that is greater for behavioural than other non-pharmacological trials [9].”
BackgroundBull, E. R., McCleary, N., Li, X., Dombrowski, S. U., Dusseldorp, E., & Johnston, M. (2018) · International Journal of Behavioral Medicine · doi:10.1007/s12529-018-9734-z · Cited by 79 · see citing works
“Many BCTs and delivery/context components could not be analysed as they were seemingly rarely used (e.g. BCT 7.1: Prompts and cues , identified in one physical activity intervention) or used in all interventions: this could reflect poor reporting of behavioral intervention content [54, 55].”
InfluentialSelf-citationRoulstone, S., Marshall, J., Powell, G. G., Goldbart, J., Wren, Y. E., Coad, J. E., Daykin, N., Powell, J. E., Lascelles, L., Hollingworth, W., et al. (2015) · Programme Grants for Applied Research · doi:10.3310/pgfar03050 · Cited by 69 · see citing works
“McCleary et al.(126) explain that techniques may constitute the active ingredients of interventions, which if omitted from an intervention will render that intervention ineffective.”
BackgroundMethodInfluentialCommunication of behaviour change interventions: Can they be recognised from written descriptions?
Johnston, M., Johnston, D. W., Wood, C. E., Hardeman, W., Francis, J., & Michie, S. (2017) · Psychology and Health · doi:10.1080/08870446.2017.1385784 · Cited by 58 · see citing works
Self-citationWood, C. E., Hardeman, W., Johnston, M., Francis, J., Abraham, C., & Michie, S. (2015) · Implementation Science · doi:10.1186/s13012-016-0448-9 · Cited by 50 · see citing works
“Randomised controlled trials of non-pharmacological interventions account for approximately one in four publications of trials [3] and the majority of these are BCIs [2].”
Self-citationBernard, P., Carayol, M., Gourlan, M., Boiché, J. C. S., Romain, A. J., Bortolon, C., Lareyre, O., & Ninot, G. (2016) · Health Education & Behavior · doi:10.1177/1090198116648667 · Cited by 41 · see citing works
“…2014; Michie & Abraham, 2004; National Institute of Health and Care Excellence, 2014), only a small proportion of interventions make available or publish manuals linking theory and behavioral change techniques (Hoffmann, Erueti, & Glasziou 2013; McCleary, Duncan, Stewart, & Francis, 2013).”
BackgroundBeresford, B., McDaid, C., Parker, A., Scantlebury, A., Spiers, G., Fairhurst, C. M., Hewitt, C. E., Wright, K. E., Dawson, V., Elphick, H., et al. (2018) · Health Technology Assessment · doi:10.3310/hta22600 · Cited by 41 · see citing works
Johnson, B. T., Michie, S., & Snyder, L. B. (2014) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000000235 · Cited by 40 · see citing works
Commissioning mental health services
Kisely, S. R. (1997) · Journal of Epidemiology & Community Health · doi:10.1136/jech.51.3.342-b · Cited by 40 · see citing works
Therapy interventions for children with neurodisabilities: a qualitative scoping study
Beresford, B., Clarke, S., & Maddison, J. (2018) · Health Technology Assessment · doi:10.3310/hta22030 · Cited by 33 · see citing works
“However, as McCleary et al.(30) argue, adopting this term for such interventions is not necessarily straightforward.”
BackgroundMethodInfluentialBar‐Zeev, Y., Bonevski, B., Lim, L. L., Twyman, L., Skelton, E., Gruppetta, M., Palazzi, K. L., Oldmeadow, C. J., & Gould, G. S. (2019) · Addictive Behaviors · doi:10.1016/j.addbeh.2019.01.002 · Cited by 31 · see citing works
Kühne, F., Ehmcke, R., Härter, M. C., & Kriston, L. (2015) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12384 · Cited by 31 · see citing works
Warran, K., Burton, A., & Fancourt, D. E. (2022) · Wellcome Open Research · doi:10.12688/wellcomeopenres.17414.1 · Cited by 96 · see citing works
Grant, A. M., Dreischulte, T., & Guthrie, B. (2017) · Implementation Science · doi:10.1186/s13012-016-0531-2 · Cited by 29 · see citing works
Reporting on Interventions: Issues and Guidelines for Rehabilitation Researchers
Dijkers, M. P. J. M. (2015) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2015.01.017 · Cited by 27 · see citing works
Michie, S., Johnston, M., & Carey, R. (2020) · Springer eBooks · doi:10.1007/978-3-030-39903-0_1661 · Cited by 27 · see citing works
Scott, C., de Barra, M., Johnston, M., de Bruin, M., SCOTT, N. W., Matheson, C., Bond, C. M., & Watson, M. C. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-036500 · Cited by 23 · see citing works
Dugdale, S., Ward, J., Hernen, J., Elison, S., Davies, G., & Donkor, D. (2016) · Substance Abuse Treatment Prevention and Policy · doi:10.1186/s13011-016-0069-y · Cited by 20 · see citing works
“…components of behavior change interventions to facilitate the effective and precise replication of delivery of such complex multi-component interventions, thereby enhancing fidelity of delivery and facilitating replicability, evaluation and synthesis of evaluation outcomes via meta-analyses [15].”
BackgroundOberjé, E. J. M., Dima, A. L., Pijnappel, F. J. J., Prins, J. M., & de Bruin, M. (2015) · Psychology and Health · doi:10.1080/08870446.2014.1001392 · Cited by 19 · see citing works
Looking for the ‘active ingredients’ in a men’s mental health promotion intervention
Pirkis, J., Schlichthorst, M., King, K., Lockley, A., Keogh, L. A., Reifels, L., Spittal, M. J., & Phelps, A. J. (2018) · Advances in Mental Health · doi:10.1080/18387357.2018.1526095 · Cited by 18 · see citing works
Developing and using ontologies in behavioural science: addressing issues raised
Michie, S., Hastings, J., Johnston, M., Hankonen, N. E., Wright, A. J., & West, R. (2023) · Wellcome Open Research · doi:10.12688/wellcomeopenres.18211.2 · Cited by 16 · see citing works
Keiller, E., Murray, A., Tjasink, M., Bourne, J., Ougrin, D., Carr, C. E., & Lau, J. Y. F. (2023) · Adolescent Research Review · doi:10.1007/s40894-023-00221-z · Cited by 15 · see citing works
“For complex interventions, which, amongst other things, may be context dependent or involve several interacting elements, identifying active ingredients is more challenging (McCleary et al., 2013).”
Michie, S., Johnston, M., & Carey, R. (2016) · Encyclopedia of Behavioral Medicine · doi:10.1007/978-1-4614-6439-6_1661-2 · Cited by 50 · see citing works
Eldridge, J. D., Hartnett, J., Lee, F. F., Sekhobo, J. P., & Edmunds, L. S. (2017) · Journal of Nutrition Education and Behavior · doi:10.1016/j.jneb.2017.04.005 · Cited by 12 · see citing works
Mueller, J., Davies, A., Jay, C., Harper, S., Blackhall, F. H., Summers, Y., Harle, A. S. M., & Todd, C. J. (2018) · British Journal of Health Psychology · doi:10.1111/bjhp.12325 · Cited by 12 · see citing works
Knittle, K. P. (2014) · Health Psychology Review · doi:10.1080/17437199.2014.900721 · Cited by 10 · see citing works
How to research the mechanisms of non-pharmacological cardiac interventions
Clark, A. M., Thirsk, L. M., Wiens, K. S., Ski, C. F., & Thompson, D. R. (2015) · International Journal of Cardiology · doi:10.1016/j.ijcard.2015.08.114 · Cited by 9 · see citing works
Johnston, M. (2021) · Health Psychology and Behavioral Medicine · doi:10.1080/21642850.2021.1939701 · Cited by 8 · see citing works
van Ierssel, J. V., Galea, O., Holte, K., Luszawski, C. A., Jenkins, E., O'Neil, J., Emery, C., Mannix, R., Schneider, K. J., Yeates, K., et al. (2023) · Journal of Sport and Health Science · doi:10.1016/j.jshs.2023.08.003 · Cited by 7 · see citing works
“8 For example, “active ingredients” of a subsymptom threshold aerobic exercise program designed to reduce post-concussion symptom burden include type of activity, equipment, frequency, duration, intensity, motivational strategies, provider expertise, whether the program was individually tailored,…”
BackgroundPromoting elderly wellbeing through indigenous music and choral performance
Netshivhambe, N. E. (2025) · EXPLORE · doi:10.1016/j.explore.2025.103145 · Cited by 8 · see citing works
Michie, S., Johnston, M., & Carey, R. (2018) · Springer eBooks · doi:10.1007/978-1-4614-6439-6_1661-3 · Cited by 5 · see citing works
Keiller, E., Hutchinson, T., Ougrin, D., Carr, C. E., & Lau, J. Y. F. (2024) · The Arts in Psychotherapy · doi:10.1016/j.aip.2024.102190 · Cited by 6 · see citing works
Dugdale, S., Ward, J., Elison, S., Davies, G., & Brown, E. (2018) · The Journal of Smoking Cessation · doi:10.1017/jsc.2018.3 · Cited by 4 · see citing works
Burton, A., Bind, R. H., Davis, R. E., Greenwood, L., Lee, C. Y., Estevao, C., Hazelgrove, K. M., Miller, C., Priestley, K., Rebecchini, L., et al. (2024) · BMC Psychology · doi:10.1186/s40359-024-02213-7 · Cited by 3 · see citing works
Blümle, A., & Meerpohl, J. J. (2016) · Cited by 3 · see citing works
Developing and using ontologies in behavioural science: addressing issues raised
Michie, S., Hastings, J., Johnston, M., Hankonen, N. E., Wright, A. J., & West, R. (2022) · Wellcome Open Research · doi:10.12688/wellcomeopenres.18211.1 · Cited by 3 · see citing works
“For example, reporting of behavioural interventions is typically less complete than for pharmacological interventions or other types of non-pharmacological interventions (McCleary et al. , 2013).”
BackgroundJones, L. (2016) · Springer eBooks · doi:10.1007/978-3-319-28267-1_1 · Cited by 3 · see citing works
Cafarella, P., Effing, T., & Chur‐Hansen, A. (2024) · Palliative & Supportive Care · doi:10.1017/s1478951524000877 · Cited by 1 · see citing works
“Commonly, NPIs are poorly reported compared with pharmacological interventions, with less detail on the intervention content (Hoffmann et al. 2013; McCleary et al. 2013).”
Technology and chronic disease management – Authors' reply
Chatterjee, S., Davies, M. J., Heller, S. R., Speight, J., Snoek, F. J., & Khunti, K. K. (2018) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(17)30440-0
Reporting Behaviour Change Interventions and Techniques
Michie, S., & Wood, C. E. (2016) · UCL Discovery (University College London)
Warran, K., Burton, A., & Fancourt, D. E. (2021) · doi:10.31235/osf.io/5pqug
Johnston, M. (2013) · Revista de PSICOLOGÍA DE LA SALUD · doi:10.21134/pssa.v1i1.882
Burton, A., Bind, R. H., Davis, R. E., Greenwood, L., Lee, C. Y., Estevao, C., Hazelgrove, K. M., Miller, C., Priestley, K., Rebecchini, L., et al. (2024) · Research Square · doi:10.21203/rs.3.rs-4177936/v1
de Vries, A., Heijne, J. C. M., de Wit, J. B. F., & den Daas, C. (2025) · PLoS ONE · doi:10.1371/journal.pone.0328467
- Authors
- McCleary, N., Duncan, E. M., Stewart, F., & Francis, J. J.
- Affiliations
- University of Aberdeen (GB)
- Corresponding author
- McCleary, Nicola
- Venue
- Trials
- Published
- 2013
- Volume
- 14
- Issue
- 1
- Pages
- 146
- ISSN
- 1745-6215 (ISSN-L)
- PMC
- PMC3663666
- OpenAlex
- W2147490738
- Cited by
- 52
- References
- 32
- Citations by year
- 2025: 2 · 2024: 4 · 2023: 3 · 2022: 3 · 2021: 2 · 2020: 2 · 2019: 1 · 2018: 8 · 2017: 7 · 2016: 7 · 2015: 7 · 2014: 4 · 2013: 1
- FWCI
- 6.98
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Trials (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Edinburgh Research Explorer (University of Edinburgh) (publishedVersion, other-oa)
- City Research Online (City University London) (acceptedVersion)
- Aberdeen University Research Archive (Aberdeen University) (submittedVersion)
- Minerva Access (University of Melbourne) (submittedVersion, cc-by)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Decision Sciences › Information Systems and Management › Academic Publishing and Open Access
- Keywords
- active ingredients, intervention reporting, non-pharmacological treatment, behaviour change interventions, pharmacological interventions, randomized controlled trials, reporting quality, intervention components, complex interventions, health information security, health information privacy, health data governance
- MeSH terms
- Abstracting and Indexing, Behavior Therapy, Pharmaceutical Preparations, Humans, Terminology as Topic, Periodicals as Topic, Bibliometrics, Chi-Square Distribution, Randomized Controlled Trials as Topic, Treatment Outcome, Guidelines as Topic, Comprehension, Information Dissemination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
