A Pilot Evaluation of a Smartphone Application for Workplace Depression
Open accessThe DOI matches its Crossref record; 47 of the 51 references it cites were found in a registry or an index; 10 of the 28 sources its claims cite were checked for support.
Abstract
Interventions delivered via mobile apps show particular promise in tackling the burden of common mental disorders. Appropriately targeting these interventions to at-risk populations is critical to their success. This pilot study aimed to assess the usability, feasibility, acceptability, and preliminary effects of an app-based intervention designed to target depressive symptoms in a stressed working population. Anchored, a smartphone app including a 30-day program of mindfulness and cognitive and behavioural therapeutic components, was tested in a pre-post pilot study with participants recruited via social media advertisements. Eligible participants (N = 81) were Australian adults who were employed and reported elevated stress levels on a single-item screening measure. Follow-up assessment occurred 5 weeks after baseline. The primary outcome measure was change in depressive symptoms, with secondary outcomes measuring change in anxiety, wellbeing, stress, resilience, exercise, alcohol use, absenteeism, and work performance. User feedback and in-app data were analysed to assess engagement and intervention adherence. At follow-up, there were significant reductions in depressive symptoms (t61 = 6.35; p < 0.001) and anxiety symptoms (t60 = 7.35; p < 0.001), along with significantly reduced cases of likely new onset depression compared to baseline (24% vs. 6%, p = 0.012). Significant improvements were also seen in wellbeing (t60 = −5.64; p < 0.001), resilience (t60 = −3.89; p < 0.001), stress (t61 = 11.18; p < 0.001), and alcohol use (t60 = 3.40; p = 0.001). Participants reported no significant changes in work performance, absenteeism or exercise. There were satisfactory levels of app usability, feasibility, and acceptability. Most participants found the app easy to use (93.2%), understood the app content well (83.0%), and rated the app highly or very highly overall (72.9%). User feedback suggestions were predominantly focused on improving app navigation and user interface. This pilot study provides encouraging evidence that Anchored has potentially beneficial effects, and is usable, feasible, and acceptable as an app-based intervention for the working population experiencing elevated stress. Further testing of Anchored in a randomised controlled trial is required to investigate its efficacy as an intervention for workplace mental ill-health. © 2020 by the authors. Licensee MDPI, Basel, Switzerland.
Overview
CoChat Summary
## TL;DR
This pre-post pilot study tested the Anchored smartphone app in 81 employed Australian adults with elevated workplace stress and found significant improvements in depressive symptoms, anxiety, stress, wellbeing, resilience, and alcohol use after 5 weeks. The app was also rated as usable and acceptable, but the uncontrolled design means the findings are preliminary.
## Key findings
- In the baseline-to-5-week follow-up analysis, depressive symptoms decreased significantly, with PHQ-9 scores falling from moderate to mild on average; the paper reports t61 = 6.35, p < 0.001.
- Anxiety symptoms also decreased significantly (t60 = 7.35, p < 0.001), and the proportion meeting PHQ-9 caseness for likely depression fell from 24% to 6% (p = 0.012).
- Significant improvements were reported in wellbeing (t60 = −5.64, p < 0.001), resilience (t60 = −3.89, p < 0.001), stress (t61 = 11.18, p < 0.001), and self-reported alcohol use (t60 = 3.40, p = 0.001); no significant change was found for work performance, absenteeism, or exercise.
- App use and satisfaction were moderate-to-high: 86.4% completed at least one challenge day, 20.9% completed all 30 days, 93.2% found the app easy to use, and 72.9% rated it highly or very highly.
## Methods
- Pilot pre-post study conducted from October to December 2019; employed adults were recruited via social media, completed baseline and 5-week follow-up questionnaires, and app usage data were recorded.
- Eligible participants were Australian residents aged over 18, currently employed, smartphone owners, English-comprehending, and had elevated stress on the Single-item Stress Question; the sample reported for analyses was N = 81.
- Main analyses used paired-samples t-tests for pre/post outcomes, McNemar’s test for depression caseness, and linear regression to test associations between app engagement and symptom change.
## Limitations
- The paper states the study was uncontrolled, so changes could not be separated from spontaneous improvement, regression to the mean, medication effects, or concurrent psychological treatment.
- The paper states that testing prevention of new-onset depression was limited by pilot power and sample size, and that the real-world sample included participants across a range of baseline depression severity rather than a strictly non-clinical sample.
- Evident from the text: recruitment via social media may have produced a biased, potentially digitally inclined sample, and attrition was substantial (for example, 23.4% of app users failed to complete follow-up).
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
8 Valid · 1 Not valid · 14 Not checked · 36 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“In terms of intervention adherence, users completed on average almost 13 out of 30 Anchored challenge days, which compares favourably with previous studies [18].”
§ A Pilot Evaluation of a Smartphone Application for Workplace Depression > 4. Discussion
What the sources say
- Supportedcites [18] Deady, 2018, Preliminary Effectiveness of a Smartphone App to Reduce Depressive Symptoms in the Workplace: Feasibility and Acceptability Study, JMIR mHealth uHealth source
The citation supports the comparison, not the citing study’s own Anchored completion figure. In Results > Stage 2: Beta Testing (page unavailable), the cited paper reports a mean of 9.11 challenge days completed out of a 30-day challenge, so almost 13 days compares favourably. (LLM, conf=0.91)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“The SISQ is a single-item measure of current stress on a 5-point Likert scale from 1 (“Not at all”) to 5 (“Very much”) and has been validated for the screening of stress levels in a working population [25].”
§ A Pilot Evaluation of a Smartphone Application for Workplace Depression > 2. Materials and Methods > 2.4. Procedure
What the sources say
- Supportedcites [25] Wahlin, 2017, Work-related stress assessed by a text message single-item stress question, Occup. Med. source
The Methods describe the SISQ as a single stress question with responses on a 5-point Likert scale. The Abstract conclusions state that the SISQ, administered by SMS, can be used to screen stress levels in a working population. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Internet-delivered (eHealth) prevention programs can provide a cost-effective alternative to traditional approaches, by enabling wider dissemination and scalability of effective preventative strategies [4].”
§ A Pilot Evaluation of a Smartphone Application for Workplace Depression > 1. Introduction
What the sources say
- Partly supportedcites [4] Solomon, 2015, e-CBT (myCompass), Antidepressant Medication, and Face-to-Face Psychological Treatment for Depression in Australia: A Cost-Effectiveness Comparison, J. Med. Internet Res. sourceExperimental — accuracy not yet measured
The Discussion (Conclusion) reports that myCompass was cost-effective compared with usual care and face-to-face CBT, and says wider dissemination could reduce unmet need. The paper evaluates treatment for depression, not prevention programs or preventative strategies, so the claim extends its finding beyond the studied use. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Several meta-analyses of randomised controlled trials (RCTs) involving smartphone-based mental health interventions have shown significant small-to-medium effects on anxiety and depression symptoms compared to controls, across both clinical and non-clinical populations [8,9,10].”
§ A Pilot Evaluation of a Smartphone Application for Workplace Depression > 1. Introduction
What the sources say
- Not checked — no full text of the sourcecites [8] Firth, 2017, The efficacy of smartphone-based mental health interventions for depressive symptoms: A meta-analysis of randomized controlled trials, World Psychiatry source
- Partly supportedcites [9] Firth, 2017, Can smartphone mental health interventions reduce symptoms of anxiety? A meta-analysis of randomized controlled trials, J. Affect. Disord. sourceExperimental — accuracy not yet measured
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
- Supportedcites [10] Linardon, 2019, The efficacy of app-supported smartphone interventions for mental health problems: A meta-analysis of randomized controlled trials, World Psychiatry source
Split into 2 atoms — 2 confirmed, 0 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On average, users completed over a third of the challenge days (M = 12.86; SD = 11.82).”
§ A Pilot Evaluation of a Smartphone Application for Workplace Depression > 3. Results > 3.4. App Usage
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
28 more claims
Create a free account to see all 59 claims and every source verdict.
- It may state two separate claims as one. 22
- Probably not a substantial claim. 7
- The quote only partly states this claim. 2
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765
James, S. L., Abate, D., Abate, K. H., Abay, S. M., Abbafati, C., Abbasi, N., Abbastabar, H., Abd-Allah, F., Abdela, J., Abdelalim, A., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(18)32279-7 · Cited by 13,867
Stages and processes of self-change of smoking: Toward an integrative model of change.
Prochaska, J. O., & DiClemente, C. C. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.51.3.390 · Cited by 9,098 · cited 1×
“There were no significant differences in demographics or baseline symptom levels between downloaders and non-downloaders, although non-downloaders were less likely to have recently sought help for mental health issues, indicating that this group may have been in a precontemplation stage of change [47].”
BackgroundJacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770 · cited 2×
“The observed shift in mean depression scores from the moderate level to the mild level represents not only a significant reduction in depressive symptoms from pre- to post-intervention, but also a clinically significant change according to Jacobson and Truax [37] whereby post-treatment scores fall within two standard…”
MethodResultThe brief resilience scale: Assessing the ability to bounce back
Smith, B. W., Dalen, J., Wiggins, K., Tooley, E., Christopher, P., & Bernard, J. (2008) · International Journal of Behavioral Medicine · doi:10.1080/10705500802222972 · Cited by 6,439
The PHQ-9: A New Depression Diagnostic and Severity Measure
Kroenke, K., & Spitzer, R. L. (2002) · Psychiatric Annals · doi:10.3928/0048-5713-20020901-06 · Cited by 5,898
The WHO-5 well-being index: A systematic review of the literature
Topp, C. W., Østergaard, S. D., Søndergaard, S., & Bech, P. (2015) · Psychotherapy and Psychosomatics · doi:10.1159/000376585 · Cited by 4,708 · cited 3×
“WHO-5 scores range from 0 (worst possible quality of life) to 25 (best possible quality of life).”
MethodInfluentialKroenke, K., Spitzer, R. L., Williams, J. B. W., & Löwe, B. (2010) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2010.03.006 · Cited by 4,057 · cited 1×
“Anxiety symptoms were measured using the General Anxiety Disorder-7 item (GAD-7) [30], a reliable and valid 7-item measure of generalised anxiety symptoms over the previous two weeks [31].”
MethodMorris, S. B., & DeShon, R. P. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.105 · Cited by 2,502 · cited 1×
“Effect size (Cohen’s d) was calculated using mean change/baseline SD [36].”
MethodEstimating the true global burden of mental illness
Vigo, D., Thornicroft, G., & Atun, R. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00505-2 · Cited by 2,494 · cited 1×
“disorders, the true burden of mental illness has been estimated to account for up to a third of years lost to disability globally [2].”
BackgroundGarnefski, N., Kraaij, V., Schroevers, M. J., & Somsen, G. A. (2008) · Journal of Clinical Psychology in Medical Settings · doi:10.1007/s10880-008-9136-5 · Cited by 2,479
Löwe, B., Kroenke, K., Herzog, W., & Gräfe, K. (2004) · Journal of Affective Disorders · doi:10.1016/s0165-0327(03)00198-8 · Cited by 1,558 · cited 1×
“The PHQ-9 is a reliable and valid 9-item measure of depression severity over the previous two weeks and is sensitive to change [27,28].”
BackgroundValidity of the brief patient health questionnaire mood scale (PHQ-9) in the general population
Martin, A., Rief, W., Klaiberg, A., & Braehler, E. (2006) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2005.07.003 · Cited by 1,379 · cited 1×
“The PHQ-9 is a reliable and valid 9-item measure of depression severity over the previous two weeks and is sensitive to change [27,28].”
BackgroundMonitoring Depression Treatment Outcomes With the Patient Health Questionnaire-9
L??we, B., Un??tzer, J., Callahan, C. M., Perkins, A. J., & Kroenke, K. (2004) · Medical Care · doi:10.1097/00005650-200412000-00006 · Cited by 1,354 · cited 2×
“For participants who were defined as having likely MDD at baseline, the mean change in PHQ-9 score from pre- to post-intervention was over 7 points, reaching the threshold of clinical importance for individual change [40].”
BackgroundMethodThe World Health Organization Health and Work Performance Questionnaire (HPQ)
Kessler, R. C., Barber, C., Beck, A., Berglund, P., Cleary, P. D., McKenas, D., Pronk, N., Simon, G., Stang, P., Ustun, T. B., et al. (2003) · Journal of Occupational and Environmental Medicine · doi:10.1097/01.jom.0000052967.43131.51 · Cited by 1,148 · cited 2×
“Work performance and absenteeism were measured using items from the Health and Work Performance Questionnaire (HPQ) [33].”
MethodSmartphones for smarter delivery of mental health programs: A systematic review
Donker, T., Petrie, K., Proudfoot, J., Clarke, J., Birch, M.-R., & Christensen, H. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2791 · Cited by 1,136 · cited 1×
“An efficient means to provide eHealth interventions is via mobile/smartphone applications (mHealth), which have the potential to be distributed widely to maximise population reach [6].”
BackgroundSelf-citationAdherence in Internet Interventions for Anxiety and Depression
Christensen, H., Griffiths, K. M., & Farrer, L. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1194 · Cited by 1,133 · cited 1×
“This does not necessarily mean that the entire intervention must be completed to achieve positive results [42], for example some users may get what they need from the intervention within a week, and others may require the full 30-day challenge.”
BackgroundSelf-citationFirth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097
Validity of a single-item measure of stress symptoms
Elo, A.-L., Leppänen, A., & Jahkola, A. (2003) · Scandinavian Journal of Work, Environment & Health · doi:10.5271/sjweh.752 · Cited by 900 · cited 5×
“Those who failed to meet the inclusion criteria, or were not experiencing elevated stress, as defined by a score below 4 (“Rather much”) on the SISQ, were ineligible for the study and excluded.”
MethodInfluentialDesigning for Motivation, Engagement and Wellbeing in Digital Experience
Peters, D., Calvo, R. A., & Ryan, R. M. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00797 · Cited by 888 · cited 1×
“It may be that app engagement is a more critical factor for achieving the intervention effect than a simple metric of app usage [45,46].”
BackgroundA Systematic Review of the Impact of Adherence on the Effectiveness of e-Therapies
Donkin, L., Christensen, H., Naismith, S. L., Neal, B., Hickie, I. B., & Glozier, N. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1772 · Cited by 876 · cited 1×
“These results are bolstered by the finding that more intervention completion was associated with greater improvements across most of the significant outcomes (with the exception of alcohol use), which is consistent with evidence from systematic reviews showing that the level of program or module completion is positive…”
Self-citationLinardon, J., Cuijpers, P., Carlbring, P., Messer, M., & Fuller‐Tyszkiewicz, M. (2019) · World Psychiatry · doi:10.1002/wps.20673 · Cited by 860
Kocalevent, R.-D., Hinz, A., & Brähler, E. (2013) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2013.04.006 · Cited by 748 · cited 1×
“The observed shift in mean depression scores from the moderate level to the mild level represents not only a significant reduction in depressive symptoms from pre- to post-intervention, but also a clinically significant change according to Jacobson and Truax [37] whereby post-treatment scores fall within two standard…”
ResultWork stress precipitates depression and anxiety in young, working women and men
MELCHIOR, M., CASPI, A., MILNE, B. J., DANESE, A., POULTON, R., & MOFFITT, T. E. (2007) · Psychological Medicine · doi:10.1017/s0033291707000414 · Cited by 691 · cited 2×
“While workplace stress has been implicated as a causal factor in the development of depression and anxiety [15,16], evidence suggests that individual perception of work-related stress largely mediates the relationship with depression symptoms [17].”
BackgroundFirth, J., Torous, J., Nicholas, J., Carney, R., Rosenbaum, S., & Sarris, J. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.04.046 · Cited by 675
Workplace interventions for common mental disorders: A systematic meta-review
Joyce, S., Modini, M., Christensen, H., Mykletun, A., Bryant, R., Mitchell, P. B., & Harvey, S. B. (2016) · Psychological Medicine · doi:10.1017/s0033291715002408 · Cited by 525 · cited 1×
“In the workplace context, stress is a key risk factor for common mental disorders such as depression and anxiety, and targeting stressed workers is a widely used approach for implementing selective interventions in the workplace population [14].”
MethodSelf-citationSieverink, F., Kelders, S. M., & van Gemert-Pijnen, J. E. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8578 · Cited by 331 · cited 1×
“Further investigation is required to determine the minimum intervention dosage required to achieve positive change, in order to operationalise “adherence” to the Anchored intervention [43].”
BackgroundPrevention of major depression
Muñoz, R. F., Cuijpers, P., Smit, F., Barrera, A. Z., & Leykin, Y. (2010) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-033109-132040 · Cited by 326 · cited 1×
“However, it has been demonstrated that the most efficient means for population-level intervention is to target those at increased risk [13].”
BackgroundChronic psychosocial stress at work and risk of depression: evidence from prospective studies
Siegrist, J. (2008) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-008-5024-0 · Cited by 316 · cited 1×
“While workplace stress has been implicated as a causal factor in the development of depression and anxiety [15,16], evidence suggests that individual perception of work-related stress largely mediates the relationship with depression symptoms [17].”
BackgroundMobile mental health: Review of the emerging field and proof of concept study
Harrison, V., Proudfoot, J., Wee, P. P., Parker, G., Pavlovic, D. H., & Manicavasagar, V. (2011) · Journal of Mental Health · doi:10.3109/09638237.2011.608746 · Cited by 267 · cited 1×
“Apps enable flexible user engagement, allowing individuals to access interventions at their convenience and facilitating real-time monitoring of mood and behaviour [7].”
BackgroundDeady, M., Choi, I., Calvo, R. A., Glozier, N., Christensen, H., & Harvey, S. B. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1473-1 · Cited by 222 · cited 1×
“Encouragingly, a recent meta-analysis found that eHealth prevention interventions had small positive effects on symptom reduction for depression and anxiety, with similar findings for both universal and selective/indicated prevention interventions [5].”
Self-citationSpeer, D. C., & Greenbaum, P. E. (1995) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.63.6.1044 · Cited by 216 · cited 1×
“This is a recommended method to ensure that the difference in scores is not simply due to measurement error [38].”
MethodTan, L., Wang, M.-J., Modini, M., Joyce, S., Mykletun, A., Christensen, H., & Harvey, S. B. (2014) · BMC Medicine · doi:10.1186/1741-7015-12-74 · Cited by 208 · cited 2×
“A meta-analysis of work-based depression prevention programs found that various types of interventions, particularly those based on cognitive behavioural models, show evidence of an ability to reduce depressive symptoms in unselected working populations [12].”
BackgroundSelf-citationDonkin, L., Hickie, I. B., Christensen, H., Naismith, S. L., Neal, B., Cockayne, N. L., & Glozier, N. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2771 · Cited by 193 · cited 1×
“It may be that app engagement is a more critical factor for achieving the intervention effect than a simple metric of app usage [45,46].”
BackgroundSelf-citationPerceived Stress and Self‐esteem Mediate the Effects of Work‐related Stress on Depression
Lee, J., Joo, E., & Choi, K. (2013) · Stress and Health · doi:10.1002/smi.2428 · Cited by 164 · cited 1×
“While workplace stress has been implicated as a causal factor in the development of depression and anxiety [15,16], evidence suggests that individual perception of work-related stress largely mediates the relationship with depression symptoms [17].”
BackgroundTheoretical Perspectives of Adherence to Web-Based Interventions: a Scoping Review
Ryan, C., Bergin, M., & Wells, J. S. (2018) · International Journal of Behavioral Medicine · doi:10.1007/s12529-017-9678-8 · Cited by 86 · cited 1×
“User engagement, while related to intervention adherence, is a distinct concept that is just as important to consider [44].”
BackgroundPreventing depression using a smartphone app: a randomized controlled trial
Deady, M., Glozier, N., Calvo, R., Johnston, D., Mackinnon, A., Milne, D., Choi, I., Gayed, A., Peters, D., Bryant, R., et al. (2022) · Psychological Medicine · doi:10.1017/s0033291720002081 · Cited by 85 · cited 4×
“The Anchored app includes therapeutic content used successfully in previous work [20], adapted to suit a broader audience based on user feedback and expert consultation.”
BackgroundMethodInfluentialSelf-citationDeady, M., Johnston, D., Milne, D., Glozier, N., Peters, D., Calvo, R., & Harvey, S. (2018) · JMIR mHealth and uHealth · doi:10.2196/11661 · Cited by 72 · cited 5×
“The 30-day challenge and additional core features of Anchored were based on the structure of the HeadGear app, with further changes intended to improve usability and engagement, such as modified layout and addition of the physical activity and sleep tracker, based on the expressed preferences of HeadGear users [18].”
InfluentialSelf-citationWork-related stress assessed by a text message single-item stress question
Arapovic-Johansson, B., Wåhlin, C., Kwak, L., Björklund, C., & Jensen, I. (2017) · Occupational Medicine · doi:10.1093/occmed/kqx111 · Cited by 68 · cited 1×
“The SISQ is a single-item measure of current stress on a 5-point Likert scale from 1 (“Not at all”) to 5 (“Very much”) and has been validated for the screening of stress levels in a working population [25].”
BackgroundWhat is needed to eradicate the depression epidemic, and why
Ormel, J., Cuijpers, P., Jorm, A., & Schoevers, R. A. (2020) · Mental Health & Prevention · doi:10.1016/j.mhp.2019.200177 · Cited by 67 · cited 1×
“Due to the magnitude of the problem and the moderate efficacy of treatments, it is unlikely that traditional treatment alone can adequately alleviate the burden [3].”
BackgroundSolomon, D., Proudfoot, J., Clarke, J., & Christensen, H. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4207 · Cited by 55 · cited 1×
“Internet-delivered (eHealth) prevention programs can provide a cost-effective alternative to traditional approaches, by enabling wider dissemination and scalability of effective preventative strategies [4].”
BackgroundPrevention of mental disorders: a new era for workplace mental health
Mykletun, A., & Harvey, S. B. (2012) · Occupational and Environmental Medicine · doi:10.1136/oemed-2012-100846 · Cited by 46 · cited 1×
“The workplace is increasingly being recognised as a potential location for mental health intervention [11].”
BackgroundSelf-citationDesigning smartphone mental health applications for emergency service workers
Deady, M., Peters, D., Lang, H., Calvo, R., Glozier, N., Christensen, H., & Harvey, S. B. (2017) · Occupational Medicine · doi:10.1093/occmed/kqx056 · Cited by 40 · cited 3×
“An RCT of HeadGear with a large sample of workers from MDIs showed that the app was effective in the prevention of both depressive symptoms and the likely onset of new depression cases, and was associated with improvements in work performance, resilience, and wellbeing [20].”
BackgroundSelf-citationFernandez, A., Salvador-Carulla, L., Choi, I., Calvo, R., Harvey, S. B., & Glozier, N. (2018) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867417704506 · Cited by 29 · cited 1×
“Users can also complete an optional risk calculator that assesses the risk for future common mental disorders and provides participants with personalised feedback regarding this risk [23].”
BackgroundSelf-citationDeady, M., Johnston, D. A., Glozier, N., Milne, D., Choi, I., Mackinnon, A., Mykletun, A., Calvo, R. A., Gayed, A., Bryant, R., et al. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-020510 · Cited by 14 · cited 2×
“The current research team have previously piloted and evaluated through an RCT the impact of a smartphone application, HeadGear, designed to prevent depression and improve wellbeing amongst workers in high-risk, predominantly male, industries [18,19].”
MethodSelf-citation
Cited by
Jakob, R., Harperink, S., Rudolf, A. M., Fleisch, E., Haug, S., Mair, J. L., Salamanca-Sanabria, A., & Kowatsch, T. (2022) · Journal of Medical Internet Research · doi:10.2196/35371 · Cited by 446
“The following information was extracted for each included study: general study characteristics, study population characteristics, intervention characteristics, factors influencing adherence relative to intended use, and information on app use (Multimedia Appendix 3 [20,26-123]).”
BackgroundMethodInfluentialBégin, C., Berthod, J., Martinez, L. Z., & Truchon, M. (2022) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-022-00267-1 · Cited by 41
“The most prevalent one was difficulties with engagement, motivation, and participation over time in the intervention (Allexandre et al., 2016; Collins et al., 2020; Joyce et al., 2018; Kopencey, 2017).”
BackgroundPaganin, G., & Simbula, S. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18179366 · Cited by 46
Strategies for Implementing Occupational eMental Health Interventions: Scoping Review
Bernard, R. M., Toppo, C., Raggi, A., de Mul, M., de Miquel, C., Pugliese, M. T., Feltz-Cornelis, C. M. V. D., Ortiz-Tallo, A., Salvador‐Carulla, L., Lukersmith, S., et al. (2022) · Journal of Medical Internet Research · doi:10.2196/34479 · Cited by 30
“8 (33) Mood disorders and symptoms [37,38,40,42,52,57,61,63]”
BackgroundInfluentialTaylor, R. W., Male, R., Economides, M., Bolton, H., & Cavanagh, K. (2023) · JMIR Formative Research · doi:10.2196/41590 · Cited by 15
Metadata
- Authors
- Collins, D. A. J., Harvey, S. B., Lavender, I., Glozier, N., Christensen, H., & Deady, M.
- Affiliations
- Black Dog Institute (AU)
- Brain and Mind Centre, Central Clinical School, Faculty of Medicine and Health, University of Sydney, Sydney, NSW 2050, Australia
- Corresponding author
- Collins, Daniel A.J.
- Venue
- International Journal of Environmental Research and Public Health
- Publisher
- MDPI AG
- Published
- 2020-09-16
- Volume
- 17
- Issue
- 18
- Pages
- 6753
- ISSN
- 1660-4601 (ISSN-L)
- PMC
- PMC7576478
- OpenAlex
- W3085111614
- Cited by
- 37
- References
- 51
- Citations by year
- 2026: 3 · 2025: 6 · 2024: 5 · 2023: 11 · 2022: 8 · 2021: 3 · 2020: 1
- FWCI
- 5.19
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- International Journal of Environmental Research and Public Health (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- UNSWorks (University of New South Wales, Sydney, Australia) (submittedVersion, cc-by-nc-nd)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Australian Government Department of Health through The Prevention Hub (4-81K7SSM)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Clinical Psychology › Mindfulness and Compassion Interventions
- Keywords
- mobile application, work-related depression, occupational stress, mobile mental health intervention, mindfulness, cognitive behavioral therapy, depressive symptoms, anxiety, resilience, well-being, app usability, user engagement, new-onset depression, alcohol consumption, employee performance, absenteeism
- MeSH terms
- Smartphone, Adult, Australia, Depression, Feasibility Studies, Humans, Patient Acceptance of Health Care, Pilot Projects, Cognitive Behavioral Therapy, Workplace, Mindfulness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

