Adverse event recording failed to reflect potential harms: a review of trial protocols of behavioral, lifestyle and psychological therapy interventions
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: To explore how potential harms are assessed in trials of behavioral, lifestyle and psychological therapy interventions. STUDY DESIGN AND SETTING: This study was a review of protocols from the National Institute of Health Research Health Technology Assessment and Public Health Research programmes. Protocols were included if the study was a randomized controlled trial and the intervention intended to change lifestyle or behavior to improve health or improve psychological outcomes. RESULTS: 95 of 151 protocols planned to record adverse events (AEs). Definitions of AEs were often not given and varied widely. Serious AEs were mostly defined using standards originally devised for pharmacological trials. Twenty-two protocols listed expected AEs. Few protocols described assessment of causation between AEs and intervention. Examples of useful AE recording practice were identified. CONCLUSION: Monitoring and recording AEs in behavioral intervention trials was variable and frequently based on reporting guidelines for pharmacological trials. This may mean potential harms are being missed. Future trials should consider: 1) Potential harms posed by the intervention 2) How to define serious AEs 3) What are expected AEs. Further research to achieve consensus on AE recording is required, including identification of core adverse outcomes in clinical areas or caused by interventions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Linden, M. (2013) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.1765 · Cited by 397
O. B. O. T. C.-S. G., Grant, S., Mayo-Wilson, E., Montgomery, P., Macdonald, G., Michie, S., Hopewell, S., & Moher, D. (2018) · Trials · doi:10.1186/s13063-018-2735-z · Cited by 348
Rozental, A., Kottorp, A., Boettcher, J., Andersson, G., & Carlbring, P. (2016) · PLOS ONE · doi:10.1371/journal.pone.0157503 · Cited by 223
Jonsson, U., Alaie, I., Parling, T., & Arnberg, F. K. (2014) · Contemporary Clinical Trials · doi:10.1016/j.cct.2014.02.005 · Cited by 175
Duggan, C., Parry, G., McMurran, M., Davidson, K., & Dennis, J. (2014) · Trials · doi:10.1186/1745-6215-15-335 · Cited by 165
Iatrogenic harm from psychological therapies—time to move on
Parry, G. D., Crawford, M. J., & Duggan, C. (2016) · British Journal of Psychiatry · doi:10.1192/bjp.bp.115.163618 · Cited by 146
Vaughan, B., Goldstein, M. H., Alikakos, M., Cohen, L. J., & Serby, M. J. (2014) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2014.01.001 · Cited by 63
Serious adverse events in randomized psychosocial treatment studies: Safety or arbitrary edicts?
Petry, N. M., Roll, J. M., Rounsaville, B. J., Ball, S. A., Stitzer, M., Peirce, J. M., Blaine, J., Kirby, K. C., McCarty, D., & Carroll, K. M. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0013679 · Cited by 44
Lobban, F., Robinson, H., Appelbe, D., Barraclough, J., Bedson, E., Collinge, L., Dodd, S., Flowers, S., Honary, M., Johnson, S., et al. (2017) · BMJ Open · doi:10.1136/bmjopen-2017-016965 · Cited by 18
McMurran, M., Crawford, M. J., Reilly, J. G., McCrone, P., Moran, P., Williams, H., Adams, C. E., Duggan, C., Delport, J., Whitham, D., et al. (2011) · Trials · doi:10.1186/1745-6215-12-198 · Cited by 14
Research works printed but not linked: 31
- Bonell, 2015, “Dark logic”: Theorising the harmful consequences of public health interventions, J Epidemiol Community Health, 69, 95, 10.1136/jech-2014-204671 · DOI · Paper page
- Lorenc, 2014, Adverse effects of public health interventions: A conceptual framework, J Epidemiol Community Health, 68, 288, 10.1136/jech-2013-203118 · DOI · Paper page
- Sundell, 2016, Trends in Methodological Quality in Controlled Trials of Psychological and Social Interventions, Res Soc Work Pract, 28, 10.1177/1049731516633297 · DOI
- Meister, 2016, Adverse event methods were heterogeneous and insufficiently reported in randomized trials on persistent depressive disorder, J Clin Epidemiol, 71, 97, 10.1016/j.jclinepi.2015.10.007 · DOI
- Wiggins, 2009, Health outcomes of youth development programme in England: prospective matched comparison study, BMJ, 339, 10.1136/bmj.b2534 · DOI · Paper page
- Evans, 2015, The unintended consequences of targeting: young people's lived experiences of social and emotional learning interventions, Br Educ Res J, 41, 381, 10.1002/berj.3155 · DOI
- Ioannidis, 2004, Better reporting of harms in randomized trials: an extension of the CONSORT statement, Ann Intern Med, 141, 781, 10.7326/0003-4819-141-10-200411160-00009 · DOI · Paper page
- Montgomery, 2018, Reporting randomised trials of social and psychological interventions: the CONSORT-SPI 2018 Extension, Trials., 19, 407, 10.1186/s13063-018-2733-1 · DOI · Paper page
- Ali, 2015, Harms, benefits, and the nature of interventions in pragmatic clinical trials, Clin Trials, 12, 467, 10.1177/1740774515597686 · DOI
- Fulton, E; Brown K. A randomised controlled feasibility trial of a tailored digital behaviour change intervention with e-referral system to increase attendance at NHS Stop Smoking Services: the MyWay project. 2018; Trial protocol Available at: https://njl-admin.nihr.ac.uk/document/download/2025878 · DOI
- Song, F, Holland, R, Barton, G, Bachman, M, Aveyard, P, Sutton, S, et al A randomised controlled trial of self-help materials for the prevention of smoking relapse. 2011. Trial protocol Available at: https://njl-admin.nihr.ac.uk/document/download/2024307 · DOI
- Stathi A et al. REACT : REtirement in ACTion A randomised controlled trial and economic evaluation of a community-based physical activity intervention to prevent mobility-related disability for retired older people. 2018. Trial protocol avilable from: https://njl-admin.nihr.ac.uk/document/download/2025815 · DOI
- Ramchandani P. Preventing enduring behavioural problems in young children through early psychological intervention: healthy start, happy start. 2017; Trial protocol Available at: https://njl-admin.nihr.ac.uk/document/download/2024719 · DOI
- Wright B. A non-inferiority randomised controlled trial comparing the clinical and cost-effectiveness of one session treatment (OST) with multi-session cognitive behavioural therapy (CBT) in children with specific phobias. 2017; Trial protocol Available at: https://njl-admin.nihr.ac.uk/document/download/2025069 · DOI
- Edwardson C. A three arm cluster randomised controlled trial to test the effectiveness and cost-effectiveness of the SMART Work & Life intervention for reducing daily sitting time in office workers: study protocol. 2018; Trial protocol Available at: https://njl-admin.nihr.ac.uk/document/download/2032171 · DOI
- Russell A. The feasibility of guided self-help for depression in adults with autism. 2017; Trial protocol Available at: https://njl-admin.nihr.ac.uk/document/download/2024942 · doi:10.1186/isrctn54650760
- Gilbody S. Collaborative care in screen-positive elders – The CASPER PLUS trial protocol. 2014; Trial protocol Available at: https://njl-admin.nihr.ac.uk/document/download/2024418 · doi:10.1186/isrctn02202951
- Wright B. ‘ASSSIST’ - autism spectrum social stories in schools trial. 2013; Trial protocol Available at: https://njl-admin.nihr.ac.uk/document/download/2024207 · doi:10.1186/isrctn96286707
- McMurran M. Psycho-education with problem solving therapy for personality disorder. 2013; Trial protocol Available at: https://njl-admin.nihr.ac.uk/document/download/2024059 · doi:10.1186/isrctn70660936
- Fletcher A. The Filter FE Challenge : pilot trial and process evaluation of a multi-level smoking prevention intervention in further education settings 2014. Trial protocol Available at: https://njl-admin.nihr.ac.uk/document/download/2025817 · doi:10.1186/isrctn19563136
- Ali A. Pilot randomised controlled trial of one to one befriending by volunteers, compared to usual care, in reducing symptoms of depression in people with intellectual disability. 2019; Trial protocol Available at: https://njl-admin.nihr.ac.uk/document/download/2029631 · doi:10.1186/isrctn63779614
- Madan I. Facilitating the return to work of NHS staff with common mental health disorders: a feasibility study [Internet]. 2019. Trial protocol Available at: https://njl-admin.nihr.ac.uk/document/download/2029530 · doi:10.1186/isrctn14621901
- Wyke S. Football Fans in Training (FFIT): a randomized controlled trial of a gender-sensitive weight loss and healthy living programme delivered to men aged 35-65 by Scottish Premier League (SPL) football clubs. 2012; Trial protocol Available at: https://njl-admin.nihr.ac.uk/document/download/2025726 · doi:10.1186/isrctn32677491
- White J. Adapting and piloting the ASSIST model of informal peer-led intervention delivery to the Talk to Frank drug prevention programme in UK secondary schools (ASSIST+Frank): intervention development and a pilot trial. 2014; Trial protocol Available at: https://njl-admin.nihr.ac.uk/document/download/2025800 · doi:10.1186/isrctn14415936
- Free C. A randomised controlled trial of an intervention delivered by mobile phone messaging to reduce sexually transmitted infections (STI) by increasing sexual health precaution behaviours in young people. 2018; Trial protocol Available at: https://njl-admin.nihr.ac.uk/document/download/2025835 · doi:10.26226/morressier.58ef94ddd462b80290b507ac
- Coulton S, Stockdale K, Marchand C, Hendrie N, Billings J, Boniface S, et al. RISKIT-CJS: Pragmatic randomised controlled trial to evaluate the substance use and risk-taking behaviour multi-component intervention to reduce effectiveness and cost effectiveness of a in adolescents involved in the criminal justice system. RISKIT-CJS. 2017; Trial protocol Available at: https://njl-admin.nihr.ac.uk/document/download/2025840 · DOI
- Cottrell D. Self-Harm Intervention, Family Therapy: a randomised controlled trial of family therapy vs. treatment as usual for young people seen after second or subsequent episodes of self-harm. 2012; Trial protocol Available at: https://njl-admin.nihr.ac.uk/document/download/2023866 · DOI
- Oquendo, 2011, Variability in the definition and reporting of adverse events in suicide prevention trials: An examination of the issues and a proposed solution, Arch Suicide Res, 15, 29, 10.1080/13811118.2011.541146 · DOI
- Ogden, 2019, Do no harm: Balancing the costs and benefits of patient outcomes in health psychology research and practice, J Health Psychol, 24, 25, 10.1177/1359105316648760 · DOI
- Datta, 2018, Serious adverse events of older adults in nursing home and community intervention trials, Contemp Clin Trials Commun, 9, 77, 10.1016/j.conctc.2017.12.004 · DOI
- Allen-Scott, 2014, A scoping review of unintended harm associated with public health interventions: towards a typology and an understanding of underlying factors, Int J Public Health, 59, 3, 10.1007/s00038-013-0526-6 · DOI
Cited by
Linden, A., Best, L., Elise, F., Roberts, D., Branagan, A., Tay, Y. B. E., Crane, L., Cusack, J., Davidson, B., Davidson, I., et al. (2023) · Autism · doi:10.1177/13623613221117931 · Cited by 78
When autism researchers disregard harms: A commentary
Dawson, M., & Fletcher-Watson, S. (2022) · Autism · doi:10.1177/13623613211031403 · Cited by 61
“In nonautism areas, a growing literature exposes and challenges inadequate attention to harms from nonpharmacological interventions (e.g. Britton et al., 2021; Papaioannou et al., 2021).”
BackgroundSystematic review and meta-analysis of adverse events in clinical trials of mental health apps
Linardon, J., Fuller-Tyszkiewicz, M., Firth, J., Goldberg, S. B., Anderson, C., McClure, Z., & Torous, J. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01388-y · Cited by 44
Mu, B.-Q., Doukhi, O., Wang, L., & Lee, D.-J. (2025) · Journal of Computational Design and Engineering · doi:10.1093/jcde/qwaf042 · Cited by 5
Metadata
- Authors
- Papaioannou, D., Cooper, C., Mooney, C., Glover, R., & Coates, E.
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2021-08
- Volume
- 136
- Pages
- 64-76
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W3133596586
- Cited by
- 60
- References
- 10
- FWCI
- 5.65
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- creativecommons.org/licenses/by-nc-nd/4.0/ (vor)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Adverse event recording failed to reflect potential harms: a review of trial protocols of behavioral, lifestyle and psychological therapy interventions. https://app.cochat.ai/papers/10.1016/j.jclinepi.2021.03.002
- The paper
- Papaioannou, D., Cooper, C., Mooney, C., Glover, R., & Coates, E. (2021). Adverse event recording failed to reflect potential harms: a review of trial protocols of behavioral, lifestyle and psychological therapy interventions. Journal of Clinical Epidemiology. https://doi.org/10.1016/j.jclinepi.2021.03.002
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.