Pilot randomised controlled trial of a remotely delivered online intervention for adolescent mental health problems in India: lessons learned about low acceptability and feasibility during the COVID-19 pandemic
Open accessAbstract
Background: ‘POD Adventures’ is a gamified problem-solving intervention delivered via smartphone app, and supported by non-specialist counsellors for a target population of secondary school students in India during the COVID-19 pandemic. Aims: To evaluate the feasibility and acceptability of undertaking a randomised controlled trial of POD Adventures when delivered online with telephone support from counsellors. Method: We conducted a parallel, two-arm, individually randomised pilot-controlled trial with 11 secondary schools in Goa, India. Participants received either the POD Adventures intervention delivered over 4 weeks or usual care comprising information about local mental health services and national helplines. Outcomes were assessed at two timepoints: baseline and 6 weeks post-randomisation. Results: Seventy-nine classroom sensitisation sessions reaching a total of 1575 students were conducted. Ninety-two self-initiated study referrals (5.8%) were received, but only 11 participants enrolled in the study. No intervention arm participants completed the intervention. Outcomes at 6 weeks were not available for intervention arm participants (n = 5), and only four control arm participants completed outcomes. No qualitative interviews or participant satisfaction measures were completed because participants could not be reached by the study team. Conclusions: Despite modifications to address barriers arising from COVID-19 restrictions, online delivery was not feasible in the study context. Low recruitment and missing feasibility and acceptability data make it difficult to draw conclusions about intervention engagement and indicative clinical outcomes. Prior findings showing high uptake, adherence and engagement with POD Adventures when delivered in a school-based context suggest that an online study and delivery posed the biggest barriers to study participation and engagement.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
An alternative digital format of problem solving proved to be feasible and acceptable with in-person guidance, but remote delivery was less viable.
“An alternative digital format of problem solving proved to be feasible and acceptable with in-person guidance, but remote delivery was less viable.”
From The Lancet Psychiatry Commission on youth mental health (2024) · cites this paper as [340]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Greenhalgh, T., Wherton, J., Papoutsi, C., Lynch, J., Hughes, G., A'Court, C., Hinder, S., Fahy, N., Procter, R., & Shaw, S. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8775 · Cited by 2,887 · see citing works
Considerations in determining sample size for pilot studies
Hertzog, M. A. (2008) · Research in Nursing & Health · doi:10.1002/nur.20247 · Cited by 2,337 · see citing works
How mental health care should change as a consequence of the COVID-19 pandemic
Moreno, C., Wykes, T., Galderisi, S., Nordentoft, M., Crossley, N., Jones, N., Cannon, M., Correll, C. U., Byrne, L., Carr, S., et al. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30307-2 · Cited by 1,840 · see citing works
Torous, J., Jän Myrick, K., Rauseo-Ricupero, N., & Firth, J. (2020) · JMIR Mental Health · doi:10.2196/18848 · Cited by 946 · see citing works
Hollis, C., Falconer, C. J., Martin, J. L., Whittington, C., Stockton, S., Glazebrook, C., & Davies, E. B. (2017) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12663 · Cited by 846 · see citing works
Mental Health Mobile Apps for Preadolescents and Adolescents: A Systematic Review.
Grist, R., Porter, J., & Stallard, P. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7332 · Cited by 518 · see citing works
Lehtimaki, S., Martic, J., Wahl, B., Foster, K. T., & Schwalbe, N. (2021) · JMIR Mental Health · doi:10.2196/25847 · Cited by 488 · see citing works
Liverpool, S., Mota, C. P., Sales, C. M. D., Čuš, A., Carletto, S., Hancheva, C., Sousa, S., Cerón, S. C., Moreno-Peral, P., Pietrabissa, G., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/16317 · Cited by 408 · see citing works
Garrido, S., Millington, C., Cheers, D., Boydell, K., Schubert, E., Meade, T., & Nguyen, Q. V. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00759 · Cited by 400 · see citing works
Grist, R., Croker, A., Denne, M., & Stallard, P. (2019) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-018-0271-8 · Cited by 287 · see citing works
The Need for a Mental Health Technology Revolution in the COVID-19 Pandemic
Figueroa, C. A., & Aguilera, A. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00523 · Cited by 227 · see citing works
Taylor, C. B., Fitzsimmons‐Craft, E. E., & Graham, A. K. (2020) · International Journal of Eating Disorders · doi:10.1002/eat.23300 · Cited by 183 · see citing works
Michelson, D., Malik, K., Parikh, R., Weiss, H. A., Doyle, A. M., Bhat, B., Sahu, R., Chilhate, B., Mathur, S., Krishna, M., et al. (2020) · The Lancet Child & Adolescent Health · doi:10.1016/s2352-4642(20)30173-5 · Cited by 121 · see citing works
Self-citationGonsalves, P. P., Hodgson, E. S., Kumar, A., Aurora, T., Chandak, Y., Sharma, R., Michelson, D., & Patel, V. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00238 · Cited by 68 · see citing works
Self-citationGonsalves, P. P., Hodgson, E. S., Bhat, B., Sharma, R., Jambhale, A., Michelson, D., & Patel, V. (2021) · Evidence Based Mental Health · doi:10.1136/ebmental-2020-300194 · Cited by 64 · see citing works
Self-citationA lost generation? COVID-19 and adolescent mental health
Hafstad, G. S., & Augusti, E.-M. (2021) · The Lancet Psychiatry · doi:10.1016/s2215-0366(21)00179-6 · Cited by 53 · see citing works
Li, W., Denson, L. A., & Dorstyn, D. S. (2018) · Australian Journal of Psychology · doi:10.1111/ajpy.12157 · Cited by 45 · see citing works
Flagged first, then by citations
Research works printed but not linked: 23
- [2]Patton GC, Sawyer SM, Santelli JS, Ross DA, Afifi R, Allen NM, Our future: a Lancet commission on adolescent health and wellbeing. Lancet 2016; 387(10036): 2423–78. 27174304 PMC5832967
- [4]Yatham S, Sivathasan S, Yoon R, da Silva TL, Ravindran AV. Depression, anxiety, and post-traumatic stress disorder among youth in low and middle income countries: a review of prevalence and treatment interventions. Asian J Psychiatr 2018; 38: 78– 91. 29117922
- [5]Patel V, Kieling C, Maulik PK, Divan G. Improving access to care for children with mental disorders: a global perspective. Arch Dis Child 2013; 98(5): 323–7. 23476001 PMC3672840
- [8]Viner RM, Russell SJ, Croker H, Packer J, Ward J, Stansfield C, School closure and management practices during coronavirus outbreaks including COVID-19: a rapid systematic review. Lancet Child Adolesc Health 2020; 4(5): 397– 404. 32272089 PMC7270629
- [9]Viner RM, Bonell C, Drake L, Jourdan D, Davies N, Baltag V, Reopening schools during the COVID-19 pandemic: governments must balance the uncertainty and risks of reopening schools against the clear harms associated with prolonged closure. Arch Dis Child 2021; 106(2): 111–3. 32747375 PMC7401577
- [10]Jones EAK, Mitra AK, Bhuiyan AR. Impact of COVID-19 on mental health in adolescents: a systematic review. Int J Environ Res Public Health 2021; 18(5): 2470. PMC7967607 33802278
- [11]Liang L, Ren H, Cao R, Hu Y, Qin Z, Li C, The effect of COVID-19 on youth mental health. Psychiatr Q 2020; 91(3): 841–52. 32319041 PMC7173777
- [12]Serlachius A, Badawy SM, Thabrew H. Psychosocial challenges and opportunities for youth with chronic health conditions during the COVID-19 pandemic. JMIR Pediatr Parent 2020; 3(2): e23057. 33001834 PMC7553787
- [22]Chorpita BF, Daleiden EL, Malik K, Gellatly R, Boustani MM, Michelson D, Design process and protocol description for a multi-problem mental health intervention within a stepped care approach for adolescents in India. Behav Res Ther 2020; 133: 103698. 32858304
- [23]Lazarus RS, Folkman S. Stress, Appraisal and Coping. Springer, 1984.
- [27]Gonsalves PP, Sharma R, Hodgson ES, Bhat B, Jambhale A, Weiss HA, A guided internet-based problem-solving intervention delivered through smartphones for secondary school pupils during the COVID-19 pandemic in India: protocol for a pilot randomized controlled trial. JMIR Res Protoc 2021; 10(10): e30339. 34586075 PMC8496682
- [28]Orkin AM, Gill PJ, Ghersi D, Campbell L, Sugarman J, Emsley R, Guidelines for reporting trial protocols and completed trials modified due to the COVID-19 pandemic and other extenuating circumstances: the CONSERVE 2021 statement. JAMA 2021; 326(3): 257–65. 34152382
- [29]Michelson D, Malik K, Krishna M, Sharma R, Mathur S, Bhat B, Development of a transdiagnostic, low-intensity, psychological intervention for common adolescent mental health problems in Indian secondary schools. Behav Res Ther 2020; 130: 103439. 31466693 PMC7322400
- [30]Weisz JR, Chorpita BF, Frye A, Ng MY, Lau N, Bearman SK, Youth top problems: using idiographic, consumer-guided assessment to identify treatment needs and to track change during psychotherapy. J Consult Clin Psychol 2011; 79(3): 369–80. 21500888
- [31]Klaufus L, Verlinden E, van der Wal M, Kösters M, Cuijpers P, Chinapaw M. Psychometric evaluation of two short versions of the Revised Child Anxiety and Depression Scale. BMC Psychiatry 2020; 20(1): 47. 32024481 PMC7003441
- [34]Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q 2004; 82(4): 581– 629. 15595944 PMC2690184
- [35]Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O, Peacock R. Storylines of research in diffusion of innovation: a meta-narrative approach to systematic review. Soc Sci Med 2005; 61(2): 417–30. 15893056
- [36]Greenhalgh T, Shaw S, Wherton J, Hughes G, Lynch J, Court C, SCALS: a fourth-generation study of assisted living technologies in their organisational, social, political and policy context. BMJ Open 2016; 6(2): e010208. PMC4762149 26880671
- [39]Upton E, Clare PJ, Aiken A, Boland VC, Torres CD, Bruno R, Changes in mental health and help-seeking among young Australian adults during the COVID-19 pandemic: a prospective cohort study. Psychol Med 2021: 1– 9. PMC8144825 33966686
- [40]Pretorius C, Chambers D, Coyle D. Young people's online help-seeking and mental health difficulties: systematic narrative review. J Med Internet Res 2019; 21(11): e13873. 31742562 PMC6891826
- [42]Cohen KA, Schleider JL. Adolescent dropout from brief digital mental health interventions within and beyond randomized trials. Internet Intervent 2022; 27: 100496. PMC8897204 35257001
- [43]McDanal R, Rubin A, Fox KR, Schleider JL. Associations of LGBTQ+ identities with acceptability and efficacy of online single-session youth mental health interventions. Behav Ther 2022; 53(2): 376–91. 35227411
- [44]Hall CL, Sanderson C, Brown BJ, Andrén P, Bennett S, Chamberlain LR, Opportunities and challenges of delivering digital clinical trials: lessons learned from a randomised controlled trial of an online behavioural intervention for children and young people. Trials 2020; 21(1): 1011. 33298127 PMC7724811
Cited by
Sorted by citations
The Lancet Psychiatry Commission on youth mental health
McGorry, P. D., Mei, C., Dalal, N., Alvarez-Jimenez, M., Blakemore, S.-J., Browne, V., Dooley, B., Hickie, I. B., Jones, P. B., McDaid, D., et al. (2024) · The Lancet Psychiatry · doi:10.1016/s2215-0366(24)00163-9 · Cited by 663 · see citing works
Self-citation
- Authors
- Gonsalves, P. P., Bhat, B., Sharma, R., Jambhale, A., Chodankar, B., Verma, M., Hodgson, E., Weiss, H. A., Leurent, B., Cavanagh, K., Fairburn, C. G., Cuijpers, P., Michelson, D., & Patel, V.
- Affiliations
- University of Sussex (GB)
- Sangath (IN)
- London School of Hygiene & Tropical Medicine (GB)
- University of Oxford (GB)
- Vrije Universiteit Amsterdam (NL)
- Harvard University (US)
- Corresponding author
- Gonsalves, Pattie P.
- ORCID
- Venue
- BJPsych Open
- Publisher
- Royal College of Psychiatrists
- Published
- 2022-12-27
- Volume
- 9
- Issue
- 1
- Pages
- e7-e7
- ISSN
- 2056-4724 (ISSN-L)
- PMC
- PMC9798210
- OpenAlex
- W4313248792
- Cited by
- 14
- References
- 17
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 3 · 2023: 6
- FWCI
- 2.65
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- BJPsych Open (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
- Sussex Research Online (University of Sussex) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- UCL Discovery (University College London) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- Funders
- Wellcome Trust (106919/A/15/Z)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Clinical Psychology › COVID-19 and Mental Health
- Social Sciences › Sociology and Political Science › Impact of Technology on Adolescents
- Keywords
- adolescent mental health, mobile application, online intervention, telephone counseling, feasibility, acceptability, COVID-19 pandemic, school mental health, high school students, participant recruitment, intervention engagement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review