Risk of bias in randomised controlled trials of health behaviour change interventions: Evidence, practices and challenges

de Bruin, Marijn

doi:10.1080/08870446.2014.960653

Cited by 36Meta-analysis and systematic reviewsHealth Policy Implementation ScienceStatistical Methods in Clinical Trials

Risk of bias in randomised controlled trials of health behaviour change interventions: Evidence, practices and challenges

Open access

de Bruin, Marijn·2015·Psychology & Health

DOI 10.1080/08870446.2014.960653

Open this paper in CoChat — free account Open PDF

Abstract

The major strength of a randomised controlled trial (RCT) is the degree to which it can establish a causal relationship between an experimental treatment and the outcome (i.e. internal validity), a...

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1080/08870446.2014.960653

Cites

22 of 22 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

In other reviews with psychosocial interventions, the risk of bias is similarly high.
“In other reviews with psychosocial interventions, the risk of bias is similarly high (Bruin, 2015).”
From Mindfulness-Based and Mindfulness-Informed Interventions at the Workplace: A Systematic Review and Meta-Regression Analysis of RCTs (2023) · cites this paper as Bruin, 2015

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548 · see citing works
Cochrane Handbook for Systematic Reviews of Interventions
Tarsilla, M. (2010) · Journal of MultiDisciplinary Evaluation · doi:10.56645/jmde.v6i14.284 · Cited by 5,228 · see citing works
Untitled work
(2008) · Cited by 3,790 · see citing works
GRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias)
Guyatt, G. H., Oxman, A. D., Vist, G., Kunz, R., Brozek, J., Alonso-Coello, P., Montori, V., Akl, E. A., Djulbegovic, B., & Falck-Ytter, Y. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.017 · Cited by 2,798 · see citing works
Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study
Wood, L., Egger, M., Gluud, L. L., Schulz, K. F., Jüni, P., Altman, D. G., Gluud, C., Martin, R. M., Wood, A. J. G., & Sterne, J. A. C. (2008) · BMJ · doi:10.1136/bmj.39465.451748.ad · Cited by 2,538 · see citing works
Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration
Boutron, I., Moher, D., Altman, D. G., Schulz, K. F., Ravaud, P., & for the CONSORT Group* (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-4-200802190-00008 · Cited by 2,292 · see citing works
Influence of reported study design characteristics on intervention effect estimates from randomised controlled trials: combined analysis of meta-epidemiological studies
Savović, J., Jones, H., Altman, D., Harris, R., Jűni, P., Pildal, J., Als-Nielsen, B., Balk, E., Gluud, C., Gluud, L., et al. (2012) · Health Technology Assessment · doi:10.3310/hta16350 · Cited by 668 · see citing works
Standard Care Impact on Effects of Highly Active Antiretroviral Therapy Adherence Interventions: A Meta-analysis of Randomized Controlled Trials
de Bruin, M. (2010) · Archives of Internal Medicine · doi:10.1001/archinternmed.2009.536 · Cited by 181 · see citing works
Weight loss interventions in young people (18 to 25 year olds): a systematic review
Poobalan, A. S., Aucott, L. S., Precious, E., Crombie, I. K., & Smith, W. C. (2009) · Obesity Reviews · doi:10.1111/j.1467-789x.2009.00673.x · Cited by 168 · see citing works
Standard care quality determines treatment outcomes in control groups of HAART-adherence intervention studies: Implications for the interpretation and comparison of intervention effects.
de Bruin, M., Viechtbauer, W., Hospers, H. J., Schaalma, H. P., & Kok, G. (2009) · Health Psychology · doi:10.1037/a0015989 · Cited by 152 · see citing works
Differential attrition in health behaviour change trials: a systematic review and meta-analysis
Crutzen, R., Viechtbauer, W., Spigt, M., & Kotz, D. (2015) · Psychology & Health · doi:10.1080/08870446.2014.953526 · Cited by 132 · see citing works
Context effects and behaviour change techniques in randomised trials: A systematic review using the example of trials to increase adherence to physical activity in musculoskeletal pain
Bishop, F. L., Fenge-Davies, A. L., Kirby, S., & Geraghty, A. W. A. (2015) · Psychology & Health · doi:10.1080/08870446.2014.953529 · Cited by 121 · see citing works
Enhancing Reporting of Behavior Change Intervention Evaluations
Abraham, C., Johnson, B. T., de Bruin, M., & Łuszczyńska, A. (2014) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000000231 · Cited by 119 · see citing works
Percent Total Attrition: A Poor Metric for Study Rigor in Hosted Intervention Designs
Amico, K. R. (2009) · American Journal of Public Health · doi:10.2105/ajph.2008.134767 · Cited by 88 · see citing works
Evaluating complex interventions: Perspectives and issues for health behaviour change interventions
Tarquinio, C., Kivits, J., Minary, L., Coste, J., & Alla, F. (2014) · Psychology and Health · doi:10.1080/08870446.2014.953530 · Cited by 82 · see citing works
Assessment of Risk of Bias Among Pediatric Randomized Controlled Trials
Crocetti, M. T., Amin, D. D., & Scherer, R. W. (2010) · PEDIATRICS · doi:10.1542/peds.2009-3121 · Cited by 73 · see citing works
Panning for the gold in health research: Incorporating studies’ methodological quality in meta-analysis
Johnson, B. T., Low, R. E., & MacDonald, H. V. (2014) · Psychology and Health · doi:10.1080/08870446.2014.953533 · Cited by 58 · see citing works
How standard is standard care? Exploring control group outcomes in behaviour change interventions for young people with type 1 diabetes
Ayling, K., Brierley, S., Johnson, B., Heller, S. R., & Eiser, C. (2014) · Psychology and Health · doi:10.1080/08870446.2014.953528 · Cited by 55 · see citing works
Reducing the risk of bias in health behaviour change trials: Improving trial design, reporting or bias assessment criteria? A review and case study
de Bruin, M., McCambridge, J., & Prins, J. M. (2014) · Psychology and Health · doi:10.1080/08870446.2014.953531 · Cited by 53 · see citing works
Risk of bias in trial-based economic evaluations: Identification of sources and bias-reducing strategies
Evers, S., Hiligsmann, M., & Adarkwah, C. C. (2014) · Psychology and Health · doi:10.1080/08870446.2014.953532 · Cited by 48 · see citing works
Cost Effectiveness of Medication Adherence-Enhancing Interventions: A Systematic Review of Trial-Based Economic Evaluations
Oberjé, E. J. M., de Kinderen, R. J. A., Evers, S., van Woerkum, C. M. J., & de Bruin, M. (2013) · PharmacoEconomics · doi:10.1007/s40273-013-0108-8 · Cited by 44 · see citing works
From question-behaviour effects in trials to the social psychology of research participation
McCambridge, J. (2014) · Psychology and Health · doi:10.1080/08870446.2014.953527 · Cited by 40 · see citing works

Flagged first, then by citations

Sorted by citations

Mindfulness-based programmes for mental health promotion in adults in nonclinical settings: A systematic review and meta-analysis of randomised controlled trials
Galante, J., Friedrich, C., Dawson, A. F., Modrego-Alarcón, M., Gebbing, P., Delgado-Suárez, I., Gupta, R., Dean, L., Dalgleish, T., White, I. R., et al. (2021) · PLOS Medicine · doi:10.1371/journal.pmed.1003481 · Cited by 319 · see citing works
‘Let’s Move It’ – a school-based multilevel intervention to increase physical activity and reduce sedentary behaviour among older adolescents in vocational secondary schools: a study protocol for a cluster-randomised trial
Hankonen, N. E., Heino, M. T. J., Araújo‐Soares, V., Sniehotta, F. F., Sund, R., Vasankari, T. J., Absetz, P., Borodulin, K., Uutela, A. K., Lintunen, T., et al. (2016) · BMC Public Health · doi:10.1186/s12889-016-3094-x · Cited by 95 · see citing works
Mindfulness-Based and Mindfulness-Informed Interventions at the Workplace: A Systematic Review and Meta-Regression Analysis of RCTs
Michaelsen, M. M., Graser, J., Onescheit, M., Tuma, M. P., Werdecker, L., Pieper, D., & Esch, T. (2023) · Mindfulness · doi:10.1007/s12671-023-02130-7 · Cited by 70 · see citing works
Cognitive boosting interventions for impulsivity in addiction: a systematic review and meta‐analysis of cognitive training, remediation and pharmacological enhancement
Anderson, A. C., Youssef, G. J., Robinson, A. H., Lubman, D. I., & Verdejo‐García, A. (2021) · Addiction · doi:10.1111/add.15469 · Cited by 67 · see citing works
The effectiveness of behaviour change interventions to increase physical activity participation in people with multiple sclerosis: a systematic review and meta-analysis
Sangelaji, B., Smith, C. M., Paul, L., Sampath, K. K., Treharne, G. J., & Hale, L. A. (2015) · Clinical Rehabilitation · doi:10.1177/0269215515595274 · Cited by 60 · see citing works
Comparison of beliefs about e-cigarettes’ harms and benefits among never users and ever users of e-cigarettes
Tan, A. S. L., Lee, C., & Bigman, C. A. (2015) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2015.11.003 · Cited by 55 · see citing works
Risk of bias in trial-based economic evaluations: Identification of sources and bias-reducing strategies
Evers, S., Hiligsmann, M., & Adarkwah, C. C. (2014) · Psychology and Health · doi:10.1080/08870446.2014.953532 · Cited by 48 · see citing works
E‐&mHealth interventions targeting nutrition, physical activity, sedentary behavior, and/or obesity among children: A scoping review of systematic reviews and meta‐analyses
Kracht, C. L., Hutchesson, M., Ahmed, M., Müller, A. M., Ashton, L. M., Brown, H. M., DeSmet, A., Maher, C. A., Mauch, C. E., Vandelanotte, C., et al. (2021) · Obesity Reviews · doi:10.1111/obr.13331 · Cited by 37 · see citing works
Effectiveness of workplace interventions for health promotion
Virtanen, M., Lallukka, T. M., Elovainio, M. J., Steptoe, A., & Mika Kivimaki, B. (2025) · The Lancet Public Health · doi:10.1016/s2468-2667(25)00095-7 · Cited by 37 · see citing works
Animal-Assisted Interventions for the Improvement of Mental Health Outcomes in Higher Education Students: A Systematic Review of Randomised Controlled Trials
Parbery-Clark, C., Lubamba, M., Tanner, L., & McColl, E. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182010768 · Cited by 28 · see citing works
Systematic review and meta‐analysis of non‐pharmacological interventions to reduce the symptoms of mild to moderate anxiety in pregnant women
Evans, K., Morrell, C. J., & Spiby, H. (2018) · Journal of Advanced Nursing · doi:10.1111/jan.13456 · Cited by 33 · see citing works
Reviewing and interpreting the effects of brief alcohol interventions: comment on a Cochrane review about motivational interviewing for young adults
Grant, S., Pedersen, E. R., Osilla, K. C., Kulesza, M., & D’Amico, E. J. (2015) · Addiction · doi:10.1111/add.13136 · Cited by 33 · see citing works
A feasibility study with process evaluation of a preschool intervention to improve child and family lifestyle behaviours
McSweeney, L., Araújo‐Soares, V., Rapley, T., & Adamson, A. (2017) · BMC Public Health · doi:10.1186/s12889-017-4167-1 · Cited by 31 · see citing works
Reporting of interventions and “standard of care” control arms in pediatric clinical trials: a quantitative analysis
Yu, A. M., Balasubramanaiam, B., Offringa, M., & Kelly, L. E. (2018) · Pediatric Research · doi:10.1038/s41390-018-0019-7 · Cited by 31 · see citing works
Carbon capability of urban residents and its structure: Evidence from a survey of Jiangsu Province in China
Wei, J., Chen, H., Cui, X., & Long, R. (2016) · Applied Energy · doi:10.1016/j.apenergy.2016.04.068 · Cited by 28 · see citing works
Psychological Distress in Women Living with Polycystic Ovary Syndrome: The Role of Illness Perceptions.
Light, R. S., Chilcot, J., & McBride, E. (2021) · Women's Health Issues · doi:10.1016/j.whi.2020.11.003 · Cited by 33 · see citing works
Evaluating Exercise Prescription and Instructional Methods Used in Tai Chi Studies Aimed at Improving Balance in Older Adults: A Systematic Review
Wu, Y., MacDonald, H. V., & Pescatello, L. S. (2016) · Journal of the American Geriatrics Society · doi:10.1111/jgs.14242 · Cited by 27 · see citing works
Exploring reasons for variations in anxiety after testing positive for human papillomavirus with normal cytology: a comparative qualitative study
McBride, E., Marlow, L. A. V., Bennett, K. F., Stearns, S., & Waller, J. (2020) · Psycho-Oncology · doi:10.1002/pon.5540 · Cited by 23 · see citing works
Policy, system, and environmental interventions addressing obesity and diet‐related outcomes in early childhood education settings: A systematic review
Kracht, C. L., Burkart, S. A., Flanagan, E. W., Melnick, E. M., Luecking, C. T., & Neshteruk, C. D. (2023) · Obesity Reviews · doi:10.1111/obr.13547 · Cited by 23 · see citing works
The correlations of psychological status, quality of life, self-esteem, social support and body image disturbance in Chinese patients with Systemic Lupus Erythematosus
Zhao, Q., Chen, H., Yan, H., He, Y. L., Zhu, L., Fu, W., & Shen, B. (2018) · Psychology Health & Medicine · doi:10.1080/13548506.2018.1434214 · Cited by 22 · see citing works
A systematic review of behaviour change interventions to improve maternal health outcomes in sub-Saharan Africa
Muriithi, F. G., Banke-Thomas, A. O., Forbes, G., Gakuo, R. W., Thomas, E., Gallos, I. D., Devall, A., Coomarasamy, A., & Lorencatto, F. (2024) · PLOS Global Public Health · doi:10.1371/journal.pgph.0002950 · Cited by 23 · see citing works
Effects of integrated interventions on transmission risk and care continuum outcomes in persons living with HIV
Crepaz, N., Baack, B. N., Higa, D. H., & Mullins, M. M. (2015) · AIDS · doi:10.1097/qad.0000000000000879 · Cited by 20 · see citing works
A systematic review of interventions to increase physical activity and reduce sedentary behaviour following bariatric surgery
James, J., Hardeman, W., Goodall, M., Eborall, H., Sprung, V. S., Bonnett, L. J., & Wilding, J. P. H. (2021) · Physiotherapy · doi:10.1016/j.physio.2021.10.002 · Cited by 22 · see citing works
The common sense model applied to hepatitis C: a qualitative analysis of the impact of disease comparison and witnessed death on hepatitis C illness perception
Safo, S. A., Batchelder, A., Peyser, D., & Litwin, A. H. (2015) · Harm Reduction Journal · doi:10.1186/s12954-015-0054-1 · Cited by 10 · see citing works
Preventing Falls Together: Social Identification Matters for Engaging Older Adults in a Group-based Exercise Program
Steckhan, G. M., Warner, L. M., & Fleig, L. (2021) · Activities Adaptation & Aging · doi:10.1080/01924788.2020.1871540 · Cited by 9 · see citing works
N-of-1 randomised controlled trials in health psychology and behavioural medicine: A commentary on Nyman et al., 2016
McDonald, S., Araújo‐Soares, V., & Sniehotta, F. F. (2016) · Psychology and Health · doi:10.1080/08870446.2016.1145221 · Cited by 9 · see citing works
Key Considerations for Designing Clinical Studies to Evaluate Digital Health Solutions
Bolinger, E., & Tyl, B. (2024) · Journal of Medical Internet Research · doi:10.2196/54518 · Cited by 7 · see citing works
Development and validation of a web-delivered positive psychological intervention in an Indian Milieu: Lessons from a limited pilot randomized controlled trial
Choubisa, R., & Singh, K. (2018) · Cogent Psychology · doi:10.1080/23311908.2018.1488512 · Cited by 6 · see citing works
The change in quality of life for older Australians: A rural and urban comparison
Hancock, S., & Wells, Y. (2019) · Australian Journal of Rural Health · doi:10.1111/ajr.12553 · Cited by 7 · see citing works
Community‐based diet and obesity‐related policy, system, and environmental interventions for obesity prevention during the first 1000 days: A scoping review
Kracht, C. L., Neshteruk, C. D., Moding, K. J., Rolke, L. J., Wagner, B. E., Kielb, E., Ferrante, M. J., Robinson, C. M., Keinsley, J., Colella, J., et al. (2024) · Obesity Reviews · doi:10.1111/obr.13815 · Cited by 6 · see citing works
Systematic review and meta-analysis of the effect of psychological interventions on anxiety in children and youth with chronic medical conditions
Tran, S. T., Bieniak, K. H., Bedree, H., Adler, M. J., Ogunmona, S., Kovar-Gough, I., Ma, W., Thabrew, H., & Cunningham, N. R. (2024) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsae097 · Cited by 6 · see citing works
TRIal to slow the Progression Of Diabetes (TRIPOD): study protocol for a randomized controlled trial using wireless technology and incentives
Lim, R. S. M., Gardner, D. S. L., Bee, Y. M., Cheung, Y. B., Bairavi, J., Gandhi, M., Goh, S., Ho, E. T. L., Lin, X., Tan, N. C., et al. (2019) · Trials · doi:10.1186/s13063-019-3749-x · Cited by 6 · see citing works
Role of social, civic, and governance aspects in life satisfaction and psychological distress: Insights from Taiwan
Edara, I. R. (2021) · Current Psychology · doi:10.1007/s12144-020-01235-9 · Cited by 4 · see citing works
Short- and long-term effectiveness of physical activity interventions for women living with and beyond breast cancer: a systematic review and meta-analysis
Garcia, A. D., Mullan, B. A., Hill, K., Breen, L. J., & Maxwell‐Smith, C. (2026) · Breast Cancer · doi:10.1007/s12282-026-01859-y · Cited by 1 · see citing works
Bedeutung von Depression und Angst im Krankheitsmanagement von pneumologischen Berufskrankheiten
Müller, K., Kotschy-Lang, N., & Wagner, P. (2015) · Trauma und Berufskrankheit · doi:10.1007/s10039-015-0104-7
Developing intervention fidelity strategies for a behaviour change intervention delivered in primary care dental practices: The RETURN Fidelity StrategyPreprint
Lowers, V., Young, B., & Harris, R. V. (2024) · Research Square · doi:10.21203/rs.3.rs-4925848/v1

Risk of Bias in Health Behaviour Change Trials: Evidence, Practices and Challenges
Johnston, M., & de Bruin, M. (2014) · European Health Psychologist
Assessing the Overall Validity of Randomised Controlled Trials
Krauß, A. (2021) · International Studies in the Philosophy of Science · doi:10.1080/02698595.2021.2002676 · Cited by 14 · see citing works
Quantitative and Qualitative Strategies to Strengthen Internal Validity in Randomized Trials
Sidani, S., & O’Rourke, H. M. (2020) · Canadian Journal of Nursing Research · doi:10.1177/0844562120974197 · Cited by 4 · see citing works
Randomised controlled trial risk of bias
Corbett, M. S., Heirs, M. K., Rose, M., Smith, A. C., Stirk, L., Richardson, G. A., Stark, D., Swinson, D., Craig, D., & Eastwood, A. J. (2015)
Reducing the risk of bias in health behaviour change trials: Improving trial design, reporting or bias assessment criteria? A review and case study
de Bruin, M., McCambridge, J., & Prins, J. M. (2014) · Psychology and Health · doi:10.1080/08870446.2014.953531 · Cited by 53 · see citing works

Authors: de Bruin, M.
Venue: Psychology & Health
Publisher: Informa UK Limited
Published: 2014-12-09
Volume: 30
Issue: 1
Pages: 1-7
ISSN: 0887-0446 (ISSN-L)
1476-8321
DOI: 10.1080/08870446.2014.960653
OpenAlex: W2080626225
Cited by: 36
References: 22
Citations by year: 2026: 1 · 2025: 1 · 2024: 5 · 2023: 2 · 2021: 7 · 2020: 2 · 2019: 2 · 2018: 3 · 2017: 2 · 2016: 4 · 2015: 6 · 2014: 1
FWCI: 4.24
Type: journal article
Language: en
Open access: bronze
doi.org
Locations: Psychology and Health (publishedVersion)
PubMed (publishedVersion)
Aberdeen University Research Archive (Aberdeen University) (submittedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
Keywords: risk of bias, randomized controlled trials, health behavior change interventions, internal validity, causal inference, clinical trial design
MeSH terms: Health Promotion, Humans, Research Design, Risk, Health Behavior, Bias, Randomized Controlled Trials as Topic, Evidence-Based Practice

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Risk of bias in randomised controlled trials of health behaviour change interventions: Evidence, practices and challenges

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Self-check

Cites

Cited by

Related

Record

About these checks