The DOI matches its Crossref record; 70 of the 75 references it cites were found in a registry or an index; 29 of the 47 sources its claims cite were checked for support.
Feasibility and Preliminary Efficacy of Web-Based and Mobile Interventions for Common Mental Health Problems in Working Adults: Multi-Arm Randomized Pilot Trial
Open accessPublished version of a preprint
Abstract
Background: There is growing interest in digital platforms as a means of implementing scalable, accessible, and cost-effective mental health interventions in the workplace. However, little is known about the efficacy of such interventions when delivered to employee groups. Objective: This study aims to evaluate the feasibility and preliminary efficacy of a digital mental health platform for the workplace, which incorporates evidence-based practices such as cognitive behavioral therapy and acceptance and commitment therapy. A total of 3 brief, unguided interventions designed to address stress, anxiety, and resilience, respectively, are evaluated. The primary aim is to determine the feasibility of the study methods and interventions in preparation for a definitive randomized controlled trial. Methods: The study used a fully remote, parallel, multi-arm, external pilot randomized controlled trial, with 3 intervention arms and a no-intervention control group. Participants were working adults representative of the general UK population with respect to age, sex, and ethnicity who were recruited from a web-based participant platform. Primary outcomes included objective and self-report measures of feasibility, acceptability, engagement, transferability, relevance, and negative effects. Secondary outcomes included 4 self-report measures of mental health and well-being, completed at baseline (time point 0 [t0]), postintervention (time point 1 [t1]), and the 1-month follow-up (time point 2 [t2]). Secondary outcomes were analyzed via linear mixed-effects models using intention-to-treat principles. Preregistered criteria for progression to a definitive trial were evaluated. Results: Data were collected between January and March of 2021. A total of 383 working adult participants meeting trial eligibility were randomized, of whom 356 (93%) were retained at t2. Objective engagement data showed that 67.8% (196/289) of participants randomized to an intervention arm completed their intervention. Overall, 87.1% (203/233) of participants reported being satisfied or very satisfied with their intervention and rated the quality of their intervention as good or excellent. All intervention groups reported significantly greater improvements than the control group on at least one secondary outcome at t1, with between-group Hedges g effect sizes for the pooled interventions ranging from 0.25 (95% CI 0.05-0.46) to 0.43 (95% CI 0.23-0.64). All the improvements were maintained at t2. Conclusions: The study methods were feasible, and all preregistered criteria for progression to a definitive trial were met. Several minor protocol amendments were noted. Preliminary efficacy findings suggest that the study interventions may result in improved mental health outcomes when offered to working adults. © 2022 JMIR Publications Inc.. All Rights Reserved.
Overview
CoChat Summary
## TL;DR
This fully remote multi-arm pilot RCT found that 3 brief, unguided Unmind interventions for stress, worry, and resilience were feasible to run in UK working adults, with all preregistered progression criteria met. Preliminary efficacy favored the interventions over no intervention on at least one mental health outcome, with pooled between-group Hedges g ranging from 0.25 to 0.43 and benefits maintained at 1 month.
## Key findings
- 383 working adults were randomized; 356/383 (93%) were retained at the 1-month follow-up, and 367/383 (95.8%) completed the postintervention assessment.
- Of 289 participants randomized to an intervention, 196/289 (67.8%) completed all sessions; 203/233 (87.1%) of those providing feedback were satisfied or very satisfied, and 196/233 (84.1%) rated quality as good or excellent.
- All intervention groups improved more than control on at least one secondary outcome at postintervention; pooled effects across interventions ranged from Hedges g = 0.25 (95% CI 0.05-0.46) to 0.43 (95% CI 0.23-0.64), and improvements were maintained at 1 month.
- Specific between-group effects included:
- Combatting stress: depression at t1 g = 0.37 (95% CI 0.08-0.66, P=.01) and t2 g = 0.38 (95% CI 0.09-0.67, P=.009); anxiety at t2 g = 0.30 (95% CI 0.01-0.59, P=.04).
- Working with worry: anxiety at t1 g = 0.33 (95% CI 0.04-0.61, P=.02) and t2 g = 0.36 (95% CI 0.08-0.65, P=.01); depression effects were largest at t1 g = 0.55 (95% CI 0.26-0.84) and t2 g = 0.42 (95% CI 0.13-0.71).
- Building resilience: resilience at t2 g = 0.39 (95% CI 0.11-0.68, P=.006).
## Methods
- Fully remote, parallel, multi-arm external pilot RCT with 3 brief self-guided interventions and a no-intervention control group in a 1:1:1:1 allocation ratio.
- Participants were UK-based working adults recruited via Prolific; 383 eligible participants were randomized after baseline assessment.
- Primary outcomes covered feasibility/acceptability/engagement/transferability/relevance/negative effects; secondary outcomes were self-report measures of stress (PSS-10), anxiety (GAD-7), depression (PHQ-8), and resilience (BRS), analyzed with linear mixed-effects models under intention-to-treat principles.
## Limitations
- The paper states that the control group was passive/no-intervention rather than active, which means nonspecific placebo effects could not be separated from intervention effects.
- The paper states participants were not blinded to allocation, and the authors note the Prolific sample was entirely self-selected, limiting generalizability to working adults nationwide.
- Evident from the text: the study was a pilot trial powered for feasibility estimates, not for definitive hypothesis testing or detecting differences between intervention arms.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
18 Valid · 4 Not valid · 11 Not checked · 77 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“A longitudinal survey conducted in England suggests that symptoms of anxiety and depression tend to rise rapidly during the early stages of a lockdown but decline quickly thereafter [65]”
§ Feasibility and Preliminary Efficacy of Web-Based and Mobile Interventions for Common Mental Health Problems in Working Adults: Multi-Arm Randomized Pilot Trial > Discussion > Principal Findings
What the sources say
- Disputedcites [65] sourceExperimental — accuracy not yet measured
The Results report a sharp decline in anxiety and depressive symptoms between weeks 2 and 5 of lockdown, not a rapid rise during its early stages. The Discussion likewise says symptoms declined following the introduction of lockdown. The claim captures the subsequent decline but reverses the paper’s account of the initial trajectory. (LLM, conf=0.86)
Checked by a reasoning model — may be wrong.
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“all study outcomes and analyses were prospectively registered, precluding any selective reporting of outcomes or nonpublication of findings [69].”
§ Feasibility and Preliminary Efficacy of Web-Based and Mobile Interventions for Common Mental Health Problems in Working Adults: Multi-Arm Randomized Pilot Trial > Discussion > Strengths and Limitations
What the sources say
- Disputedcites [69] sourceExperimental — accuracy not yet measured
The Results (Analysis of Trial Characteristics) state that only 163 of 556 trials (29.3%) were prospectively registered, contrary to the claim that all were. The Discussion (Overview) also reports nonpublication among prospectively registered trials; prospective registration did not preclude it. The paper does not establish that all analyses were registered. (LLM, conf=0.90)
Checked by a reasoning model — may be wrong.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“There is now convincing evidence for the effectiveness of digital interventions when delivered in health and community settings [10]”
§ Feasibility and Preliminary Efficacy of Web-Based and Mobile Interventions for Common Mental Health Problems in Working Adults: Multi-Arm Randomized Pilot Trial > Introduction > Background and Rationale
What the sources say
- Partly supportedcites [10] sourceExperimental — accuracy not yet measured
The Discussion reports that app-supported smartphone interventions improved several mental-health outcomes across clinical and non-clinical populations, including general-population samples. It does not establish effectiveness for digital interventions broadly or specifically assess delivery in both health and community settings. (LLM, conf=0.86)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“such platforms are frequently characterized by low adherence [14-16]”
§ Feasibility and Preliminary Efficacy of Web-Based and Mobile Interventions for Common Mental Health Problems in Working Adults: Multi-Arm Randomized Pilot Trial > Introduction > Background and Rationale
What the sources say
- Partly supportedcites [14] sourceExperimental — accuracy not yet measured
The Principal Findings report poor retention among frequently installed, unguided mental health apps: median retention was 3.9% at 15 days and 3.3% at 30 days. The Inclusion and Exclusion Criteria do not identify the studied apps as for-profit, so the claim's for-profit qualifier is not established by this paper. The supplied passages have section labels but no page numbers. (LLM, conf=0.86)
- Partly supportedcites [15] sourceExperimental — accuracy not yet measured
The Results (Uptake and Usage Data; page unavailable) report low completion or sustained-use rates for several digital mental-health interventions, supporting the concern about adherence. The review does not establish that these rates characterize for-profit apps specifically; its Discussion (Summary of Evidence; page unavailable) also notes wide variation, including apps with high sustained use. (LLM, conf=0.84)
- Not checked — no full text of the sourcecites [16] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“emerging evidence that they may be effective when delivered in occupational settings [11,12]”
§ Feasibility and Preliminary Efficacy of Web-Based and Mobile Interventions for Common Mental Health Problems in Working Adults: Multi-Arm Randomized Pilot Trial > Introduction > Background and Rationale
What the sources say
- Supportedcites [11] source
The Discussion’s Implications section says the review demonstrated that workplace digital mental health interventions can improve psychological well-being and work effectiveness. The Conclusions likewise report evidence of those benefits for workers, supporting the hedged claim that digital interventions may be effective in occupational settings. (LLM, conf=0.94)
- Supportedcites [12] source
The Discussion (page not provided) concludes that e-mental health interventions can significantly improve mental health conditions in an occupational context, with small to moderate treatment effects. This supports the more cautious claim that digital interventions may be effective in occupational settings. (LLM, conf=0.93)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
55 more claims · 5 with their cited sources checked
Create a free account to see all 110 claims and every source verdict.
- Probably not a substantial claim. 21
- It may state two separate claims as one. 38
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Unmind has previously been shown to be feasible and acceptable when used by healthy participants to manage symptoms of stress and anxiety or boost resilience [30]”
From Feasibility and Preliminary Efficacy of Digital Interventions for Depressive Symptoms in Working Adults: Multiarm Randomized Controlled Trial (2023) · cites this paper as [30]
Experimental — accuracy not yet measured
Citations
Cites
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835 · cited 1×
“Analyses were performed using linear mixed-effects models (LMMs) with restricted information maximum likelihood estimation (via the lme4 package in R [57]).”
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765 · cited 2×
“91 in this study at t0) and has been validated in both the general population and primary care settings [45,46].”
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Positive psychology: An introduction.
Seligman, M. E. P., & Csikszentmihalyi, M. (2000) · American Psychologist · doi:10.1037/0003-066x.55.1.5 · Cited by 11,351 · cited 2×
“It features a broad range of content that draws on multiple evidence-based approaches such as CBT [17], MM [18], behavioral activation [19], acceptance and commitment therapy (ACT [20]), and positive psychology [21].”
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995 · cited 1×
“Therefore, guidelines suggest conducting pilot studies to test trial feasibility and estimate important trial parameters before running a definitive trial [61].”
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · BMJ · doi:10.1136/bmj.c332 · Cited by 9,329
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770 · cited 2×
“The reliable change index was computed based on methods provided by Jacobson and Truax [56], using Cronbach α as a measure of reliability and an α level of .05 (Multimedia Appendix 3).”
The brief resilience scale: Assessing the ability to bounce back
Smith, B. W., Dalen, J., Wiggins, K., Tooley, E., Christopher, P., & Bernard, J. (2008) · International Journal of Behavioral Medicine · doi:10.1080/10705500802222972 · Cited by 6,439 · cited 1×
“The Brief Resilience Scale (BRS) is a short, 6-item scale designed to assess people’s ability to bounce back or recover after stressful events [50].”
Whiteford, H. A., Degenhardt, L., Rehm, J., Baxter, A. J., Ferrari, A. J., Erskine, H. E., Charlson, F. J., Norman, R. E., Flaxman, A. D., Johns, N., et al. (2013) · The Lancet · doi:10.1016/s0140-6736(13)61611-6 · Cited by 6,006
(1999) · Cited by 5,934
The PHQ-8 as a measure of current depression in the general population
Kroenke, K., Strine, T. W., Spitzer, R. L., Williams, J. B. W., Berry, J. T., & Mokdad, A. H. (2009) · Journal of Affective Disorders · doi:10.1016/j.jad.2008.06.026 · Cited by 5,121 · cited 1×
“The PHQ-8 omits an item that assesses suicidal ideation and is more appropriate for use in nonclinical samples and settings [48].”
Löwe, B., Decker, O., Müller, S., Brähler, E., Schellberg, D., Herzog, W., & Herzberg, P. Y. (2008) · Medical Care · doi:10.1097/mlr.0b013e318160d093 · Cited by 4,527 · cited 1×
“91 in this study at t0) and has been validated in both the general population and primary care settings [45,46].”
Cognitive therapy and the emotional disorders: A. T. Beck
Paykel, E. (1987) · British Journal of Psychiatry · doi:10.1192/s0007125000214918 · Cited by 4,455
Effect size, confidence interval and statistical significance: a practical guide for biologists
Nakagawa, S., & Cuthill, I. C. (2007) · Biological Reviews · doi:10.1111/j.1469-185x.2007.00027.x · Cited by 3,835 · cited 1×
“The 95% CIs were calculated using equations 15 and 16 from Nakagawa and Cuthill [58].”
CONSORT 2010 statement: extension to randomised pilot and feasibility trials.
Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · BMJ · doi:10.1136/bmj.i5239 · Cited by 3,404
Beyond the Turk: Alternative platforms for crowdsourcing behavioral research
Peer, E., Brandimarte, L., Samat, S., & Acquisti, A. (2017) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2017.01.006 · Cited by 2,957 · cited 2×
“This may be because of the use of the Prolific recruitment platform, which is associated with high participant response rates [35], and reimbursing participants at each study assessment.”
Wherever you go, there you are: Mindfulness meditation in everyday life
Kwee, M. (1995) · Behaviour Research and Therapy · doi:10.1016/0005-7967(95)90133-7 · Cited by 2,896 · cited 2×
“It features a broad range of content that draws on multiple evidence-based approaches such as CBT [17], MM [18], behavioral activation [19], acceptance and commitment therapy (ACT [20]), and positive psychology [21].”
CONSORT 2010 statement: extension to randomised pilot and feasibility trials
on behalf of the PAFS consensus group, Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · Pilot and Feasibility Studies · doi:10.1186/s40814-016-0105-8 · Cited by 2,843 · cited 2×
“The authors followed the CONSORT (Consolidated Standards of Reporting Trials) 2010 guidelines [32] when preparing this study, including recent extensions to pilot trials [22] and multi-arm trials [33].”
Cognitive Therapy and the Emotional Disorders
Jaffe, B. (1977) · Psychosomatics · doi:10.1016/s0033-3182(77)71107-7 · Cited by 2,704 · cited 8×
“This intervention aims to help users apply evidence-based techniques to aid the cultivation of essential qualities of personal resilience, drawing upon CBT and ACT.”
InfluentialReview of the Psychometric Evidence of the Perceived Stress Scale
Lee, E.-H. (2012) · Asian Nursing Research · doi:10.1016/j.anr.2012.08.004 · Cited by 2,305 · cited 1×
“The PSS has a Cronbach α >.70 across 12 individual studies (and .91 in this study at t0) and good test–retest reliability across 4 individual studies [42].”
Mobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233
Guidance on how to develop complex interventions to improve health and healthcare
O"Cathain, A., Croot, L., Duncan, E., Rousseau, N., Sworn, K., Turner, K. M., Yardley, L., & Hoddinott, P. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-029954 · Cited by 1,591 · cited 1×
“Primary Outcome Measures Recent guidelines suggest that complex health interventions should be feasible, acceptable, engaging, transferable to other settings, and relevant [37].”
Eldridge, S. M., Lancaster, G. A., Campbell, M. J., Thabane, L., Hopewell, S., Coleman, C. L., & Bond, C. M. (2016) · PLOS ONE · doi:10.1371/journal.pone.0150205 · Cited by 1,581 · cited 1×
“Study Objective Consistent with recent guidelines on pilot trials [22,23], the primary aim of this study is to evaluate the feasibility of the study methods, and 3 separate Unmind Series that address the topics of stress, anxiety, and resilience, respectively, in preparation for a future definitive RCT.”
Computer-based psychological treatments for depression: A systematic review and meta-analysis
Richards, D., & Richardson, T. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.02.004 · Cited by 1,442 · cited 2×
“…1 month; (2) at least 30% intervention completion rates based on a previous meta-analysis of adherence to unguided psychological interventions [53]; (3) at least 75% adherence to protocol instructions (defined as the proportion of participants who refrain from engaging with ≥ 1 Series session…”
InfluentialValidation of PHQ-2 and PHQ-9 to Screen for Major Depression in the Primary Care Population
Arroll, B., Goodyear-Smith, F., Crengle, S., Gunn, J., Kerse, N., Fishman, T., Falloon, K., & Hatcher, S. (2010) · The Annals of Family Medicine · doi:10.1370/afm.1139 · Cited by 1,279 · cited 1×
“The PHQ-8 has excellent internal consistency (Cronbach α of .89 in primary care settings and .88 in this study at t0) and excellent test–retest reliability [49].”
COHEN, S., & JANICKI‐DEVERTS, D. (2012) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.2012.00900.x · Cited by 1,187 · cited 2×
“Self-reported stress levels were approximately consistent with population norms (mean PSS 17.0, SD 7.7 [55]).”
InfluentialFancourt, D., Steptoe, A., & Bu, F. (2021) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30482-x · Cited by 1,161 · cited 1×
“A longitudinal survey conducted in England suggests that symptoms of anxiety and depression tend to rise rapidly during the early stages of a lockdown but decline quickly thereafter [65], which may partly explain the changes in mental health scores reported by the control group.”
Adherence in Internet Interventions for Anxiety and Depression
Christensen, H., Griffiths, K. M., & Farrer, L. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1194 · Cited by 1,133 · cited 1×
“…data suggested that 67.8% (196/289) of randomized participants (and 196/237, 82.7% of those starting their intervention) completed all intervention sessions, which is similar to or higher than average completion rates ranging between 30% and 65% for other MHapp interventions [11,16,53,63].”
InfluentialUndertreatment of people with major depressive disorder in 21 countries
Thornicroft, G., Chatterji, S., Evans-Lacko, S., Gruber, M., Sampson, N., Aguilar-Gaxiola, S., Al-Hamzawi, A., Alonso, J., Andrade, L., Borges, G., et al. (2017) · British Journal of Psychiatry · doi:10.1192/bjp.bp.116.188078 · Cited by 1,121 · cited 1×
“This is compounded by an estimated global treatment gap of >50% for people with mental health disorders [4,5].”
Behavioral activation treatment for depression: returning to contextual roots
Jacobson, N. S., Martell, C. R., & Dimidjian, S. (2001) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.8.3.255 · Cited by 1,011 · cited 2×
“It features a broad range of content that draws on multiple evidence-based approaches such as CBT [17], MM [18], behavioral activation [19], acceptance and commitment therapy (ACT [20]), and positive psychology [21].”
Objective user engagement with mental health apps: systematic search and panel-based usage analysis
Baumel, A., Muench, F., Edan, S., & Kane, J. M. (2019) · Journal of Medical Internet Research · doi:10.2196/14567 · Cited by 965 · cited 1×
“Moreover, only a fraction of for-profit mental health apps (MHapps) are supported by empirical evidence [13], with added concerns that such platforms are frequently characterized by low adherence [14-16].”
All for One and One for All: Mental Disorders in One Dimension
Caspi, A., & Moffitt, T. E. (2018) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2018.17121383 · Cited by 918 · cited 1×
“A potential explanation for this is that different facets of mental health tend to strongly covary with one another [66], and transdiagnostic research suggests that symptoms of different mental health problems often respond to the same treatments [67].”
Mental Health Smartphone Apps: Review and Evidence-Based Recommendations for Future Developments
Bakker, D., Kazantzis, N., Rickwood, D., & Rickard, N. (2016) · JMIR Mental Health · doi:10.2196/mental.4984 · Cited by 886 · cited 1×
“There is growing interest in web and smartphone apps as a means of increasing the reach of mental health and well-being interventions [6,7].”
Linardon, J., Cuijpers, P., Carlbring, P., Messer, M., & Fuller‐Tyszkiewicz, M. (2019) · World Psychiatry · doi:10.1002/wps.20673 · Cited by 860 · cited 1×
“There is now convincing evidence for the effectiveness of digital interventions when delivered in health and community settings [10], as well as emerging evidence that they may be effective when delivered in occupational settings [11,12].”
Teare, M. D., Dimairo, M., Shephard, N., Hayman, A., Whitehead, A., & Walters, S. J. (2014) · Trials · doi:10.1186/1745-6215-15-264 · Cited by 773 · cited 1×
“This is consistent with previous guidelines suggesting that 60 to 100 participants per intervention arm are optimal for estimating binary outcomes in pilot RCTs [54].”
The Critical Relationship Between Anxiety and Depression
Kalin, N. H. (2020) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2020.20030305 · Cited by 702 · cited 1×
“Although depression was not a specific target of any of the study interventions, we chose to include it as an outcome as it is highly comorbid with stress and anxiety [28,29] and a common problem in workplace settings [3].”
Fleming, T., Bavin, L., Lucassen, M., Stasiak, K., Hopkins, S., & Merry, S. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9275 · Cited by 670 · cited 1×
“Moreover, only a fraction of for-profit mental health apps (MHapps) are supported by empirical evidence [13], with added concerns that such platforms are frequently characterized by low adherence [14-16].”
Exploring comorbidity within mental disorders among a Danish national population
Plana-Ripoll, O., Pedersen, C. B., Holtz, Y., Benros, M. E., Dalsgaard, S., de Jonge, P., Fan, C. C., Degenhardt, L., Ganna, A., Greve, A. N., et al. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.3658 · Cited by 584 · cited 1×
“A potential explanation for this is that different facets of mental health tend to strongly covary with one another [66], and transdiagnostic research suggests that symptoms of different mental health problems often respond to the same treatments [67].”
Linardon, J., & Fuller-Tyszkiewicz, M. (2020) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000459 · Cited by 573 · cited 3×
“For instance, only 7% (27/383) of participants were lost to attrition at follow-up, which compares favorably with recent meta-analyses reporting average attrition rates of 23% to 48% for MHapp trials [11,16,62].”
InfluentialWeekly change in mindfulness and perceived stress in a mindfulness-based stress reduction program
Baer, R. A., Carmody, J., & Hunsinger, M. (2012) · Journal of Clinical Psychology · doi:10.1002/jclp.21865 · Cited by 546 · cited 1×
“The original scale uses a 1-month reporting period; however, this has been shortened in several previous studies [43,44], and this study used a 2-week reporting period.”
Torous, J., Lipschitz, J., Ng, M., & Firth, J. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.167 · Cited by 546 · cited 1×
“For instance, only 7% (27/383) of participants were lost to attrition at follow-up, which compares favorably with recent meta-analyses reporting average attrition rates of 23% to 48% for MHapp trials [11,16,62].”
Furukawa, T. A., Noma, H., Caldwell, D. M., Honyashiki, M., Shinohara, K., Imai, H., Chen, P., Hunot, V., & Churchill, R. (2014) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12275 · Cited by 521 · cited 2×
“…control as (1) participants were not selected on the basis of poor mental health or seeking help for a problem, (2) recent evidence suggests that wait-list groups may introduce nocebo effects in psychotherapy trials [31], and (3) participants received monetary compensation for taking part.”
Lambert, M. (2007) · Psychotherapy Research · doi:10.1080/10503300601032506 · Cited by 461 · cited 1×
“These rates were largely equivalent between the intervention arms and the control group and are consistent with previous estimates that 5% to 10% of participants are expected to deteriorate following in-person psychotherapy [60].”
Wu, Y., Levis, B., Riehm, K. E., Saadat, N., Levis, A. W., Azar, M., Rice, D. B., Boruff, J., Cuijpers, P., Gilbody, S., et al. (2020) · Psychological Medicine · doi:10.1017/s0033291719001314 · Cited by 423
Reducing the treatment gap for mental disorders: a WPA survey
PATEL, V., MAJ, M., FLISHER, A. J., DE SILVA, M. J., KOSCHORKE, M., PRINCE, M., WPA Zonal and Member Society Representatives, Tempier, R., Riba, M., Sanchez, M., et al. (2010) · World Psychiatry · doi:10.1002/j.2051-5545.2010.tb00305.x · Cited by 420 · cited 1×
“This is compounded by an estimated global treatment gap of >50% for people with mental health disorders [4,5].”
Heber, E., Ebert, D. D., Lehr, D., Cuijpers, P., Berking, M., Nobis, S., & Riper, H. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.5774 · Cited by 408 · cited 1×
“We chose to evaluate content relating to stress and anxiety as these are highly prevalent in the workplace [3] and have been extensively studied in previous evaluations of MHapps [24-26], allowing for a comparison of the current findings to previous evidence.”
Carolan, S., Harris, P. R., & Cavanagh, K. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7583 · Cited by 385 · cited 5×
“There is now convincing evidence for the effectiveness of digital interventions when delivered in health and community settings [10], as well as emerging evidence that they may be effective when delivered in occupational settings [11,12].”
InfluentialSelf-citationConsensus statement on defining and measuring negative effects of internet interventions
Rozental, A., Andersson, G., Boettcher, J., Ebert, D. D., Cuijpers, P., Knaevelsrud, C., Ljótsson, B., Kaldo, V., Titov, N., & Carlbring, P. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.02.001 · Cited by 371 · cited 2×
“RenderX data analysis plan are reported in Multimedia Appendix 2 [40,41,55].”
Reporting of Multi-Arm Parallel-Group Randomized Trials: Extension of the CONSORT 2010 Statement
Juszczak, E., Altman, D. G., Hopewell, S., & Schulz, K. (2019) · JAMA · doi:10.1001/jama.2019.3087 · Cited by 324 · cited 1×
“The authors followed the CONSORT (Consolidated Standards of Reporting Trials) 2010 guidelines [32] when preparing this study, including recent extensions to pilot trials [22] and multi-arm trials [33].”
Stratton, E., Lampit, A., Choi, I., Calvo, R. A., Harvey, S. B., & Glozier, N. (2017) · PLOS ONE · doi:10.1371/journal.pone.0189904 · Cited by 252 · cited 4×
“Importantly, the intervention groups reported larger improvements in mental health despite significant changes in the control group, and MHapps such as Unmind may be an effective way of delivering accessible mental health support to workforces working remotely or during times of national crisis.”
InfluentialHowarth, A., Quesada, J., Silva, J., Judycki, S., & Mills, P. R. (2018) · DIGITAL HEALTH · doi:10.1177/2055207618770861 · Cited by 240
Patient experience of negative effects of psychological treatment: results of a national survey
Crawford, M. J., Thana, L., Farquharson, L., Palmer, L., Hancock, E., Bassett, P., Clarke, J., & Parry, G. D. (2016) · British Journal of Psychiatry · doi:10.1192/bjp.bp.114.162628 · Cited by 225 · cited 1×
“This question could be modified to capture lasting bad effects (refer to the study by Crawford et al [64]) with more specific clarifying questions to better differentiate harmful effects from frustration and/or lack of intervention enjoyment.”
The Foundations of Resilience: What Are the Critical Resources for Bouncing Back from Stress?
Smith, B. W., Epstein, E. M., Ortiz, J. A., Christopher, P. J., & Tooley, E. M. (2013) · The Springer Series on Human Exceptionality · doi:10.1007/978-1-4614-4939-3_13 · Cited by 210 · cited 1×
“3 be interpreted as high resilience [51].”
Tan, L., Wang, M.-J., Modini, M., Joyce, S., Mykletun, A., Christensen, H., & Harvey, S. B. (2014) · BMC Medicine · doi:10.1186/1741-7015-12-74 · Cited by 208 · cited 1×
“With fewer access barriers, digital platforms also have the potential to offer a preventative solution to common mental health problems by facilitating sustained, proactive engagement [8,9].”
Lau, N., O'Daffer, A., Colt, S., Yi-Frazier, J. P., Palermo, T. M., McCauley, E., & Rosenberg, A. R. (2020) · JMIR mhealth and uhealth · doi:10.2196/17798 · Cited by 174 · cited 1×
“Moreover, only a fraction of for-profit mental health apps (MHapps) are supported by empirical evidence [13], with added concerns that such platforms are frequently characterized by low adherence [14-16].”
Duggan, C., Parry, G., McMurran, M., Davidson, K., & Dennis, J. (2014) · Trials · doi:10.1186/1745-6215-15-335 · Cited by 165 · cited 1×
“In addition, psychological interventions should be evaluated for negative effects [38].”
Bauer, M., Glenn, T., Geddes, J., Gitlin, M., Grof, P., Kessing, L. V., Monteith, S., Faurholt-Jepsen, M., Severus, E., & Whybrow, P. C. (2020) · International Journal of Bipolar Disorders · doi:10.1186/s40345-019-0164-x · Cited by 163 · cited 1×
“There is growing interest in web and smartphone apps as a means of increasing the reach of mental health and well-being interventions [6,7].”
Phillips, E. A., Gordeev, V. S., & Schreyögg, J. (2019) · Scandinavian Journal of Work, Environment & Health · doi:10.5271/sjweh.3839 · Cited by 148 · cited 3×
“54), anxiety (Hedges g =0.34), and symptoms of depression (Hedges g =0.30) [12].”
InfluentialMore multiarm randomised trials of superiority are needed
Parmar, M. K. B., Carpenter, J., & Sydes, M. R. (2014) · The Lancet · doi:10.1016/s0140-6736(14)61122-3 · Cited by 127 · cited 1×
“We chose to include 3 intervention arms in this study as this is more efficient than performing sequential 2-arm trials and increases the proportion of participants randomized to an intervention arm [30].”
Resilience: A psychobiological construct for psychiatric disorders
Shrivastava, A., & Desousa, A. (2016) · Indian Journal of Psychiatry · doi:10.4103/0019-5545.174365 · Cited by 127 · cited 1×
“In addition, we chose to evaluate content relating to resilience, as evidence suggests that it plays an important role in the prevention of mental health problems [27] and thus may be integral to the effectiveness of a preventative platform.”
Cavanagh, K., Churchard, A., O’Hanlon, P., Mundy, T., Votolato, P., Jones, F., Gu, J., & Strauss, C. (2018) · Mindfulness · doi:10.1007/s12671-017-0856-1 · Cited by 120 · cited 1×
“The original scale uses a 1-month reporting period; however, this has been shortened in several previous studies [43,44], and this study used a 2-week reporting period.”
Self-citationPreventing depression using a smartphone app: a randomized controlled trial
Deady, M., Glozier, N., Calvo, R., Johnston, D., Mackinnon, A., Milne, D., Choi, I., Gayed, A., Peters, D., Bryant, R., et al. (2022) · Psychological Medicine · doi:10.1017/s0033291720002081 · Cited by 85 · cited 1×
“With fewer access barriers, digital platforms also have the potential to offer a preventative solution to common mental health problems by facilitating sustained, proactive engagement [8,9].”
Mewton, L., Smith, J., Rossouw, P., & Andrews, G. (2014) · Psychology Research and Behavior Management · doi:10.2147/prbm.s40879 · Cited by 57
Mbuagbaw, L., Kosa, S. D., Lawson, D. O., Stalteri, R., Olaiya, O. R., Alotaibi, A., & Thabane, L. (2019) · Pilot and Feasibility Studies · doi:10.1186/s40814-019-0500-z · Cited by 57 · cited 1×
“As per formal guidelines [52], preregistered progression criteria were defined as follows: (1) full study recruitment within 1 month; (2) at least 30% intervention completion rates based on a previous meta-analysis of adherence to unguided psychological interventions [53]; (3) at least 75%…”
The Economic Impact of Mental Disorders and Mental Health Problems in the Workplace
Pinheiro, M., Ivandić, I., & Razzouk, D. (2017) · Springer eBooks · doi:10.1007/978-3-319-55266-8_28 · Cited by 52 · cited 1×
“Background and Rationale Mental illness affects hundreds of millions of people worldwide, resulting in decreased quality of life, family and community disruption, increased health care costs, and a significant economic burden for employers [1,2].”
The peril of self-reported adherence in digital interventions: A brief example
Flett, J. A. M., Fletcher, B. C., Riordan, B. C., Patterson, T., Hayne, H., & Conner, T. S. (2019) · Internet Interventions · doi:10.1016/j.invent.2019.100267 · Cited by 42 · cited 1×
“This is important, given the recent evidence of substantial discrepancies between self-reported and objective adherence in digital interventions [68].”
Al-Durra, M., Nolan, R. P., Seto, E., Cafazzo, J. A., & Eysenbach, G. (2018) · Journal of Medical Internet Research · doi:10.2196/11924 · Cited by 32 · cited 1×
“Second, all study outcomes and analyses were prospectively registered, precluding any selective reporting of outcomes or nonpublication of findings [69].”
Tan, L., Wang, M., Modini, M., Joyce, S., Mykletun, A., Christensen, H. M., & Harvey, S. B. (2014) · BMC Medicine · doi:10.1186/s12916-014-0212-4 · Cited by 8
Skevington, S. M. (1993) · Journal of Community & Applied Social Psychology · doi:10.1002/casp.2450030111 · Cited by 6
Research works printed but not linked: 2
- Khan, S, 2017, Ann Psychiatry Ment Health, 5, 1091
- Cohen, S, 1989, The Social Psychology of Health: The Claremont Symposium on Applied Social Psychology
Cited by
Sîrbu, V., & David, D. (2024) · Clinical Psychology Review · doi:10.1016/j.cpr.2024.102515 · Cited by 25
Taylor, R. W., Male, R., Economides, M., Bolton, H., & Cavanagh, K. (2023) · JMIR Formative Research · doi:10.2196/41590 · Cited by 15
“Unmind is a digital platform designed to help working adults measure, manage, and improve their mental health and well-being and has previously been described in detail [30].”
Self-citationEconomides, M., Male, R., Bolton, H., & Cavanagh, K. (2023) · SLEEP · doi:10.1093/sleep/zsad053 · Cited by 24
Self-citationOptimizing Workplace Digital Mental Health Interventions: Systematic Review and Meta-Analysis
Stratton, E., Morris, R. W., Milton, A. C., Deady, M., Choi, I., & Glozier, N. (2025) · Journal of Medical Internet Research · doi:10.2196/71253 · Cited by 17
Herold, M., Simbula, S., & Gallucci, M. (2024) · Current Psychology · doi:10.1007/s12144-024-06534-z · Cited by 15
“…all the studies aimed to reduce physiological and perceived stress together with other mental health problems, like anxiety (Crivelli et al., 2019; Economides et al., 2022 ; Fiol-DeRoque et al., 2021; Huberty et al., 2022; Hwang et al., 2022 ; Rudics et al., 2023 ), depression (Econo - mides et…”
Influential
Metadata
- Authors
- Economides, M., Bolton, H., Male, R., & Cavanagh, K.
- Affiliations
- Unmind Ltd. (United Kingdom) (GB)
- University of Sussex (GB)
- Corresponding author
- Economides, Marcos
- Venue
- JMIR Formative Research
- Publisher
- JMIR Publications Inc.
- Published
- 2022-03-03
- Volume
- 6
- Issue
- 3
- Pages
- e34032
- ISSN
- 2561-326X (ISSN-L)
- PMC
- PMC8931651
- OpenAlex
- W3214905342
- Semantic Scholar
- 28ff682c1cfb872c56bb60ece8d0383aee770b6e
- Cited by
- 19
- References
- 75
- Citations by year
- 2026: 7 · 2025: 4 · 2024: 3 · 2023: 4
- FWCI
- 1.47
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Formative Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Sussex Research Online (University of Sussex) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Clinical Psychology › Mindfulness and Compassion Interventions
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Workplace Health and Well-being
- Keywords
- online intervention, mobile-based interventions, common mental disorders, working adults, cognitive behavioral therapy, acceptance and commitment therapy, stress, anxiety, resilience, employee well-being, feasibility, acceptability, engagement, digital mental health platforms, workplace mental health promotion, participant satisfaction, intervention transferability, adverse outcomes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.