The DOI matches its Crossref record; 47 of the 51 references it cites were found in a registry or an index; 10 of the 28 sources its claims cite were checked for support.
A Pilot Evaluation of a Smartphone Application for Workplace Depression
Open accessAbstract
Interventions delivered via mobile apps show particular promise in tackling the burden of common mental disorders. Appropriately targeting these interventions to at-risk populations is critical to their success. This pilot study aimed to assess the usability, feasibility, acceptability, and preliminary effects of an app-based intervention designed to target depressive symptoms in a stressed working population. Anchored, a smartphone app including a 30-day program of mindfulness and cognitive and behavioural therapeutic components, was tested in a pre-post pilot study with participants recruited via social media advertisements. Eligible participants (N = 81) were Australian adults who were employed and reported elevated stress levels on a single-item screening measure. Follow-up assessment occurred 5 weeks after baseline. The primary outcome measure was change in depressive symptoms, with secondary outcomes measuring change in anxiety, wellbeing, stress, resilience, exercise, alcohol use, absenteeism, and work performance. User feedback and in-app data were analysed to assess engagement and intervention adherence. At follow-up, there were significant reductions in depressive symptoms (t61 = 6.35; p < 0.001) and anxiety symptoms (t60 = 7.35; p < 0.001), along with significantly reduced cases of likely new onset depression compared to baseline (24% vs. 6%, p = 0.012). Significant improvements were also seen in wellbeing (t60 = −5.64; p < 0.001), resilience (t60 = −3.89; p < 0.001), stress (t61 = 11.18; p < 0.001), and alcohol use (t60 = 3.40; p = 0.001). Participants reported no significant changes in work performance, absenteeism or exercise. There were satisfactory levels of app usability, feasibility, and acceptability. Most participants found the app easy to use (93.2%), understood the app content well (83.0%), and rated the app highly or very highly overall (72.9%). User feedback suggestions were predominantly focused on improving app navigation and user interface. This pilot study provides encouraging evidence that Anchored has potentially beneficial effects, and is usable, feasible, and acceptable as an app-based intervention for the working population experiencing elevated stress. Further testing of Anchored in a randomised controlled trial is required to investigate its efficacy as an intervention for workplace mental ill-health. © 2020 by the authors. Licensee MDPI, Basel, Switzerland.
Overview
CoChat Summary
## TL;DR
This pre-post pilot study tested the Anchored smartphone app in 81 employed Australian adults with elevated workplace stress and found significant improvements in depressive symptoms, anxiety, stress, wellbeing, resilience, and alcohol use after 5 weeks. The app was also rated as usable and acceptable, but the uncontrolled design means the findings are preliminary.
## Key findings
- In the baseline-to-5-week follow-up analysis, depressive symptoms decreased significantly, with PHQ-9 scores falling from moderate to mild on average; the paper reports t61 = 6.35, p < 0.001.
- Anxiety symptoms also decreased significantly (t60 = 7.35, p < 0.001), and the proportion meeting PHQ-9 caseness for likely depression fell from 24% to 6% (p = 0.012).
- Significant improvements were reported in wellbeing (t60 = −5.64, p < 0.001), resilience (t60 = −3.89, p < 0.001), stress (t61 = 11.18, p < 0.001), and self-reported alcohol use (t60 = 3.40, p = 0.001); no significant change was found for work performance, absenteeism, or exercise.
- App use and satisfaction were moderate-to-high: 86.4% completed at least one challenge day, 20.9% completed all 30 days, 93.2% found the app easy to use, and 72.9% rated it highly or very highly.
## Methods
- Pilot pre-post study conducted from October to December 2019; employed adults were recruited via social media, completed baseline and 5-week follow-up questionnaires, and app usage data were recorded.
- Eligible participants were Australian residents aged over 18, currently employed, smartphone owners, English-comprehending, and had elevated stress on the Single-item Stress Question; the sample reported for analyses was N = 81.
- Main analyses used paired-samples t-tests for pre/post outcomes, McNemar’s test for depression caseness, and linear regression to test associations between app engagement and symptom change.
## Limitations
- The paper states the study was uncontrolled, so changes could not be separated from spontaneous improvement, regression to the mean, medication effects, or concurrent psychological treatment.
- The paper states that testing prevention of new-onset depression was limited by pilot power and sample size, and that the real-world sample included participants across a range of baseline depression severity rather than a strictly non-clinical sample.
- Evident from the text: recruitment via social media may have produced a biased, potentially digitally inclined sample, and attrition was substantial (for example, 23.4% of app users failed to complete follow-up).
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
8 Valid · 1 Not valid · 14 Not checked · 36 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“In terms of intervention adherence, users completed on average almost 13 out of 30 Anchored challenge days, which compares favourably with previous studies [18].”
§ A Pilot Evaluation of a Smartphone Application for Workplace Depression > 4. Discussion
What the sources say
- Supportedcites [18] Deady, 2018, Preliminary Effectiveness of a Smartphone App to Reduce Depressive Symptoms in the Workplace: Feasibility and Acceptability Study, JMIR mHealth uHealth source
The citation supports the comparison, not the citing study’s own Anchored completion figure. In Results > Stage 2: Beta Testing (page unavailable), the cited paper reports a mean of 9.11 challenge days completed out of a 30-day challenge, so almost 13 days compares favourably. (LLM, conf=0.91)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“The SISQ is a single-item measure of current stress on a 5-point Likert scale from 1 (“Not at all”) to 5 (“Very much”) and has been validated for the screening of stress levels in a working population [25].”
§ A Pilot Evaluation of a Smartphone Application for Workplace Depression > 2. Materials and Methods > 2.4. Procedure
What the sources say
- Supportedcites [25] Wahlin, 2017, Work-related stress assessed by a text message single-item stress question, Occup. Med. source
The Methods describe the SISQ as a single stress question with responses on a 5-point Likert scale. The Abstract conclusions state that the SISQ, administered by SMS, can be used to screen stress levels in a working population. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Internet-delivered (eHealth) prevention programs can provide a cost-effective alternative to traditional approaches, by enabling wider dissemination and scalability of effective preventative strategies [4].”
§ A Pilot Evaluation of a Smartphone Application for Workplace Depression > 1. Introduction
What the sources say
- Partly supportedcites [4] Solomon, 2015, e-CBT (myCompass), Antidepressant Medication, and Face-to-Face Psychological Treatment for Depression in Australia: A Cost-Effectiveness Comparison, J. Med. Internet Res. sourceExperimental — accuracy not yet measured
The Discussion (Conclusion) reports that myCompass was cost-effective compared with usual care and face-to-face CBT, and says wider dissemination could reduce unmet need. The paper evaluates treatment for depression, not prevention programs or preventative strategies, so the claim extends its finding beyond the studied use. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Several meta-analyses of randomised controlled trials (RCTs) involving smartphone-based mental health interventions have shown significant small-to-medium effects on anxiety and depression symptoms compared to controls, across both clinical and non-clinical populations [8,9,10].”
§ A Pilot Evaluation of a Smartphone Application for Workplace Depression > 1. Introduction
What the sources say
- Not checked — no full text of the sourcecites [8] Firth, 2017, The efficacy of smartphone-based mental health interventions for depressive symptoms: A meta-analysis of randomized controlled trials, World Psychiatry source
- Partly supportedcites [9] Firth, 2017, Can smartphone mental health interventions reduce symptoms of anxiety? A meta-analysis of randomized controlled trials, J. Affect. Disord. sourceExperimental — accuracy not yet measured
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
- Supportedcites [10] Linardon, 2019, The efficacy of app-supported smartphone interventions for mental health problems: A meta-analysis of randomized controlled trials, World Psychiatry source
Split into 2 atoms — 2 confirmed, 0 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On average, users completed over a third of the challenge days (M = 12.86; SD = 11.82).”
§ A Pilot Evaluation of a Smartphone Application for Workplace Depression > 3. Results > 3.4. App Usage
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
28 more claims
Create a free account to see all 59 claims and every source verdict.
- It may state two separate claims as one. 22
- Probably not a substantial claim. 7
- The quote only partly states this claim. 2
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765
James, S. L., Abate, D., Abate, K. H., Abay, S. M., Abbafati, C., Abbasi, N., Abbastabar, H., Abd-Allah, F., Abdela, J., Abdelalim, A., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(18)32279-7 · Cited by 13,867
Stages and processes of self-change of smoking: Toward an integrative model of change.
Prochaska, J. O., & DiClemente, C. C. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.51.3.390 · Cited by 9,098 · cited 1×
“There were no significant differences in demographics or baseline symptom levels between downloaders and non-downloaders, although non-downloaders were less likely to have recently sought help for mental health issues, indicating that this group may have been in a precontemplation stage of change [47].”
BackgroundJacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770 · cited 2×
“The observed shift in mean depression scores from the moderate level to the mild level represents not only a significant reduction in depressive symptoms from pre- to post-intervention, but also a clinically significant change according to Jacobson and Truax [37] whereby post-treatment scores fall within two standard…”
MethodResultThe brief resilience scale: Assessing the ability to bounce back
Smith, B. W., Dalen, J., Wiggins, K., Tooley, E., Christopher, P., & Bernard, J. (2008) · International Journal of Behavioral Medicine · doi:10.1080/10705500802222972 · Cited by 6,439
The PHQ-9: A New Depression Diagnostic and Severity Measure
Kroenke, K., & Spitzer, R. L. (2002) · Psychiatric Annals · doi:10.3928/0048-5713-20020901-06 · Cited by 5,898
The WHO-5 well-being index: A systematic review of the literature
Topp, C. W., Østergaard, S. D., Søndergaard, S., & Bech, P. (2015) · Psychotherapy and Psychosomatics · doi:10.1159/000376585 · Cited by 4,708 · cited 3×
“WHO-5 scores range from 0 (worst possible quality of life) to 25 (best possible quality of life).”
MethodInfluentialKroenke, K., Spitzer, R. L., Williams, J. B. W., & Löwe, B. (2010) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2010.03.006 · Cited by 4,057 · cited 1×
“Anxiety symptoms were measured using the General Anxiety Disorder-7 item (GAD-7) [30], a reliable and valid 7-item measure of generalised anxiety symptoms over the previous two weeks [31].”
Method
Cited by
Jakob, R., Harperink, S., Rudolf, A. M., Fleisch, E., Haug, S., Mair, J. L., Salamanca-Sanabria, A., & Kowatsch, T. (2022) · Journal of Medical Internet Research · doi:10.2196/35371 · Cited by 446
“The following information was extracted for each included study: general study characteristics, study population characteristics, intervention characteristics, factors influencing adherence relative to intended use, and information on app use (Multimedia Appendix 3 [20,26-123]).”
BackgroundMethodInfluentialBégin, C., Berthod, J., Martinez, L. Z., & Truchon, M. (2022) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-022-00267-1 · Cited by 41
“The most prevalent one was difficulties with engagement, motivation, and participation over time in the intervention (Allexandre et al., 2016; Collins et al., 2020; Joyce et al., 2018; Kopencey, 2017).”
BackgroundPaganin, G., & Simbula, S. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18179366 · Cited by 46
Strategies for Implementing Occupational eMental Health Interventions: Scoping Review
Bernard, R. M., Toppo, C., Raggi, A., de Mul, M., de Miquel, C., Pugliese, M. T., Feltz-Cornelis, C. M. V. D., Ortiz-Tallo, A., Salvador‐Carulla, L., Lukersmith, S., et al. (2022) · Journal of Medical Internet Research · doi:10.2196/34479 · Cited by 30
“8 (33) Mood disorders and symptoms [37,38,40,42,52,57,61,63]”
BackgroundInfluentialTaylor, R. W., Male, R., Economides, M., Bolton, H., & Cavanagh, K. (2023) · JMIR Formative Research · doi:10.2196/41590 · Cited by 15
Metadata
- Authors
- Collins, D. A. J., Harvey, S. B., Lavender, I., Glozier, N., Christensen, H., & Deady, M.
- Affiliations
- Black Dog Institute (AU)
- Brain and Mind Centre, Central Clinical School, Faculty of Medicine and Health, University of Sydney, Sydney, NSW 2050, Australia
- Corresponding author
- Collins, Daniel A.J.
- Venue
- International Journal of Environmental Research and Public Health
- Publisher
- MDPI AG
- Published
- 2020-09-16
- Volume
- 17
- Issue
- 18
- Pages
- 6753
- ISSN
- 1660-4601 (ISSN-L)
- PMC
- PMC7576478
- OpenAlex
- W3085111614
- Cited by
- 37
- References
- 51
- Citations by year
- 2026: 3 · 2025: 6 · 2024: 5 · 2023: 11 · 2022: 8 · 2021: 3 · 2020: 1
- FWCI
- 5.19
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- International Journal of Environmental Research and Public Health (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- UNSWorks (University of New South Wales, Sydney, Australia) (submittedVersion, cc-by-nc-nd)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Australian Government Department of Health through The Prevention Hub (4-81K7SSM)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Clinical Psychology › Mindfulness and Compassion Interventions
- Keywords
- mobile application, work-related depression, occupational stress, mobile mental health intervention, mindfulness, cognitive behavioral therapy, depressive symptoms, anxiety, resilience, well-being, app usability, user engagement, new-onset depression, alcohol consumption, employee performance, absenteeism
- MeSH terms
- Smartphone, Adult, Australia, Depression, Feasibility Studies, Humans, Patient Acceptance of Health Care, Pilot Projects, Cognitive Behavioral Therapy, Workplace, Mindfulness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Pilot Evaluation of a Smartphone Application for Workplace Depression. https://app.cochat.ai/papers/10.3390/ijerph17186753
- The paper
- Collins, D. A. J., Harvey, S. B., Lavender, I., Glozier, N., Christensen, H., & Deady, M. (2020). A Pilot Evaluation of a Smartphone Application for Workplace Depression. International Journal of Environmental Research and Public Health. https://doi.org/10.3390/ijerph17186753
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

