The DOI matches its Crossref record; 56 of the 65 references it cites were found in a registry or an index; 16 of the 53 sources its claims cite were checked for support.
Effectiveness of mobile technologies delivering Ecological Momentary Interventions for stress and anxiety: a systematic review
Open accessAbstract
Objectives Mobile technologies may be suitable for delivering Ecological Momentary Interventions (EMI) to treat anxiety in real-time. This review aims to synthesize evidence on the effectiveness of EMI for treating anxiety conditions. Materials and Methods Four databases and the reference lists of previous studies were searched. A total of 1949 abstracts were double screened for inclusion. Sufficient studies were available to undertake a quantitative meta-analysis on EMIs on generalized anxiety symptoms. Results The 15 randomized trials and randomized controlled trials examined anxiety (n=7), stress (n=3), anxiety and stress (n=2), panic disorder (n=2), and social phobia (n=1). Eight EMIs comprised self-monitoring integrated with therapy modules, seven comprised multimedia content, and three comprised self-monitoring only. The quality of studies presented high risk of biases. Meta-analysis (n=7) demonstrated that EMIs reduced generalized anxiety compared to control and/or comparison groups (Effect Size (ES)=0.32, 95% CI, 0.12-0.53). Most EMIs targeting stress were reported effective relative to control as were the two EMIs targeting panic disorders. The EMI targeting social phobia was not effective. Discussion EMIs have potential in treating both anxiety and stress. However, few high-quality trials have been conducted for specific anxiety disorders. Further trials are needed to assess the value of EMI technologies for anxiety in enhancing existing treatments. Conclusion This study found a small significant effect of EMI studies on reducing generalized anxiety. Studies on stress demonstrated EMI was effective compared to control, with the small number of studies on panic and social phobia demonstrating mixed results. © The Author 2015.
Overview
CoChat Summary
TL;DR
This systematic review and meta-analysis found that ecological momentary interventions (EMIs) delivered via mobile technologies produced a small significant reduction in generalized anxiety compared with control/comparison groups, and most stress EMIs were effective, while evidence for panic disorder and social phobia was mixed or negative. The authors conclude EMIs are promising for anxiety and stress but that more high-quality trials are needed.
Key findings
- Meta-analysis of 7 studies on generalized anxiety showed EMIs reduced symptoms versus control/comparison groups: pooled effect size 0.32 (95% CI, 0.12–0.53, P = .002), with low heterogeneity (I² = 8%); excluding the active-control study, pooled effect size was 0.31 (95% CI, 0.07–0.55).
- The 15 randomized trials/RCTs covered anxiety/generalized anxiety, stress, anxiety and stress, panic disorder, and social phobia; 8 EMIs comprised self-monitoring integrated with therapy modules, 7 comprised multimedia content, and 3 comprised self-monitoring only.
- Most EMIs targeting stress were reported effective relative to control, but one self-monitoring mobile phone EMI was not effective for stress (d = −0.08 at post-test).
- Panic disorder findings were mixed: one 6-week CBT-plus-EMI condition was effective versus waitlist (d = 2.00) but not superior to CBT alone (d = 0.43 vs 6 weeks; d = −0.23 vs 12 weeks); the single social phobia trial found 8 sessions of group CBT plus EMI did not significantly reduce symptoms versus waitlist, whereas 12 sessions of group CBT without EMI did.
Methods
- Systematic review following PRISMA; searched Cochrane Library, PubMed, OvidSP (MEDLINE and PsycInfo), and Science Direct in January 2014, plus reference lists. From 3145 records, 1949 unique abstracts were double screened, 51 full texts were screened, and 15 papers were included.
- Included randomized trials/RCTs evaluating EMIs for anxiety symptoms, anxiety disorders, or anxiety-related outcomes such as stress/tension, with at least one control or comparison group; excluded usability/adherence-only studies, non-anxiety outcomes, laboratory-only biofeedback, ecological momentary assessment monitoring only, and non-mobile/hand-held interventions.
- Data were extracted with a pre-formulated rating sheet; study quality was assessed using Cochrane Effective Practice and Organization of Care criteria. Descriptive statistics summarized study characteristics, and a random-effects meta-analysis (Comprehensive Meta-Analysis v2.2.064) was conducted on the generalized anxiety subgroup, using post-test standardized mean differences, I², funnel plots, and trim-and-fill.
Limitations
- Stated by the authors: the review included EMIs with varying levels of therapist support; the search concept “ecological momentary intervention” may not have captured all relevant studies; only studies measuring anxiety-related outcomes were included, excluding cost-efficiency and adherence outcomes; and broad/ambiguous EMI definitions limit meaningful comparison across interventions.
- Evident from the text: most studies had unclear or high risk of bias (e.g., 11/15 [73.3%] unclear/high for sequence generation and allocation concealment; 15/15 [100%] for blinding), sample sizes were small (range 13–720, median 33.5), and heterogeneity prevented an overall quantitative meta-analysis, so only the generalized anxiety subgroup was pooled.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
14 Valid · 2 Not valid · 42 Not checked · 54 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“In the present research, the study conducted by Reid et al.38 was the only study evaluating an interactive EMI using mobile phones which failed to yield significant effects in reducing stress relative to an attention control.”
What the sources say
- Supportedcites [38] Reid, 2011, A mobile phone application for the assessment and management of youth mental health problems in primary care: a randomised controlled trial, BMC Fam Pract. source
The Results (Outcome–Intention to Treat; page unavailable) report no significant group effect or group-by-time interaction for stress, despite a decrease across both groups. The Methods describe a mobile-phone monitoring intervention and an attention comparison group. The claim that this was the 'only study' is the citing authors’ comparison across studies, not a finding attributed to Reid et al. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“an EMI using self-monitoring on mobile phones 38 was not effective relative to an attention control in reducing stress ( d = −0.08 at post-test).”
What the sources say
- Partly supportedcites [38] Reid, 2011, A mobile phone application for the assessment and management of youth mental health problems in primary care: a randomised controlled trial, BMC Fam Pract. sourceExperimental — accuracy not yet measured
The Results (Outcome–Intention to Treat; page not specified) report no significant group-by-time effect for stress, supporting the claim that the intervention was not more effective than the attention comparison. But Table 3 gives a post-test between-group effect size of d = 0.14, not −0.08. (LLM, conf=0.87)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“However, the negative findings of this study may have been due to nature of the attention control, which closely resembled the intervention. 19”
What the sources say
- Supportedcites [19] Donker, 2013, Smartphones for smarter delivery of mental health programs: a systematic review, J Med Internet Res. source
The Discussion (page not specified) links the nonsignificant finding to the attention-placebo control receiving almost the same intervention as the experimental group. The Results likewise report no significant between-group differences and describe the control intervention as largely the same. (LLM, conf=0.94)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“The effect size appears lower than reported previously for Internet-delivered cognitive behavioral therapy for anxiety. 42”
What the sources say
- Supportedcites [42] Mewton, 2014, Current perspectives on Internet-delivered cognitive behavioral therapy for adults with anxiety and related disorders, Psychol Res Behav Manag. source
The Efficacy of iCBT for anxiety disorders section reports between-group effect-size ranges for Internet-delivered CBT in adults with anxiety disorders. The citation supplies the previously reported iCBT figures; the comparison with EMIs is the citing authors’ own assessment, not a finding attributed to this review. No page number is available in our copy. (LLM, conf=0.88)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“A study evaluating a transdiagnostic EMI comprising online CBT modules and SMS reminders for treating stress and anxiety 37 was associated with lower stress levels than a waitlist control ( d = 0.34 at post-test).”
What the sources say
- Partly supportedcites [37] Proudfoot, 2013, Impact of a mobile phone and web program on symptom and functional outcomes for people with mild-to-moderate depression, anxiety and stress: a randomised controlled trial, BMC Psychiatr. sourceExperimental — accuracy not yet measured
The Methods > Interventions section describes myCompass as offering online modules derived partly from CBT and optional SMS reminders. Results > Outcomes at post-intervention reports significantly greater improvement in stress than the waitlist group. However, Table 5 in Results > Effect size gives the post-test stress effect as d = .35 using observed means or .28 using estimated marginal means, not .34; no page numbers are provided in our copy. (LLM, conf=0.90)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
69 more claims · 3 with their cited sources checked
Create a free account to see all 112 claims and every source verdict.
- Probably not a substantial claim. 22
- It may state two separate claims as one. 17
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Previous work has demonstrated that EMIs can be effective at reducing symptoms of depression and anxiety as well as related outcomes of stress and at increasing positive psychological functioning.”
From Ecological momentary interventions for depression and anxiety (2017) · cites this paper as Gee et al., 2016
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Current evidence supports that EMIs can be beneficial to reduce depression and anxiety and associated aspects of mental health such as stress, acceptance, and quality of life (Gee et al., 2016;Versluis et al., 2016).”
From Ecological momentary interventions for depression and anxiety (2017) · cites this paper as Gee et al., 2016
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Potential strategies for enhancing generalization could include additional homework assignments (Kazantzis et al., 2000), in vivo practice in new settings (Abramowitz & Arch, 2014), or utilizing technology to provide out-ofsession prompts and supports in the daily environment (Loo Gee et al., 2016;Swan et al., 2016).”
From A mixed methods study of autistic adults' mental health therapy experiences (2023) · cites this paper as Loo Gee et al., 2016
In the citing paper
“publication bias was rarely assessed for the representative effect sizes.”
From Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials (2022) · cites this paper as [49]
In the citing paper
“Evidence for ecological momentary interventions and apps compared to non-specific controls was weak or non-significant, although of similar magnitude (ds = 0.30 to 0.43 [20, 49]).”
From Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials (2022) · cites this paper as [49]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ RESULTS
“remained statistically significant (adjusted effect size = 0.27; 95% CI, −0.04 to 0.46)”
§ RESULTS
“95% CI, −0.04 to 0.46”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ RESULTS
“Seven studies delivered interventions both on-site and distally, 25,31–34,36,38”
§ RESULTS
“and three involved on-site and combined on-site and distal delivery. 31,39,41”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ RESULTS
“two of these examined indicated interventions, 35,36 and one evaluated a universal intervention. 36”
§ RESULTS
“a further five studies involved universal interventions delivered regardless of risk status and symptom levels. 25,26,29,30,34”
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Kessler, R. C., Berglund, P., Demler, O., Jin, R., Merikangas, K. R., & Walters, E. E. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.593 · Cited by 20,391
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Kessler, R. C., Chiu, W. T., Demler, O., & Walters, E. E. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.617 · Cited by 12,052
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454
Cochrane Handbook for Systematic Reviews of Interventions
Higgins, J. P. T., Green, S., & Ben Van Den, A. (2020) · International Coaching Psychology Review · doi:10.53841/bpsicpr.2020.15.2.123 · Cited by 5,670
Reducing Risks for Mental Disorders: Frontiers for Preventive Intervention Research
(1994) · doi:10.17226/2139 · Cited by 2,073
The ESEMeD/MHEDEA 2000 Investigators, Alonso, J., Angermeyer, M. C., Bernert, S., Bruffaerts, R., Brugha, T. S., Bryson, H., de Girolamo, G., de Graaf, R., Demyttenaere, K., et al. (2004) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0047.2004.00327.x · Cited by 1,819
Cited by
Philippe, T. J., Sikder, N., Jackson, A., Koblanski, M. E., Liow, E., Pilarinos, A., & Vasarhelyi, K. (2022) · JMIR Mental Health · doi:10.2196/35159 · Cited by 436
Van Ameringen, M., Turna, J., Khalesi, Z., Pullia, K., & Patterson, B. (2017) · Depression and Anxiety · doi:10.1002/da.22657 · Cited by 234
“These interventions aim to deliver interactive tools, when an immediate need (such as decreased mood or increased anxiety) is identified in real-time resultant of passive data collection (reviewed in Gee et al., 2016).”
BackgroundGoldberg, S. B., Lam, S. U., Simonsson, O., Torous, J., & Sun, S. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000002 · Cited by 237
“Gee (2016) [49] adults/ adolescents n/a ecological momentary interventions anxiety 6 Cochrane 8”
BackgroundEcological momentary interventions for mental health: A scoping review
Balaskas, A., Schueller, S. M., Cox, A. L., & Doherty, G. (2021) · PLOS ONE · doi:10.1371/journal.pone.0248152 · Cited by 235
“The selection of keywords for the search string related to mental health was informed by previous studies [5, 14, 15].”
MethodRauschenberg, C., Schick, A., Hirjak, D., Seidler, A., Paetzold, I., Apfelbacher, C., Riedel-Heller, S. G., & Reininghaus, U. (2021) · Journal of Medical Internet Research · doi:10.2196/23365 · Cited by 205
“While there is some initial evidence on the effectiveness of mHealth interventions to improve physical activity [90-95], stress appraisal [96,97], depression [26,96-100], anxiety [25,26,96,97], and alcohol and substance use [55,96,98,101-103], with small to medium effect sizes in all areas of…”
Background
Metadata
- Authors
- Loo Gee, B., Griffiths, K. M., & Gulliver, A.
- Affiliations
- National Institute for Mental Health Research, Research School of Population Health, Australian National University
- Australian National University (AU)
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2015-05-21
- Volume
- 23
- Issue
- 1
- Pages
- 221-229
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC7814930
- OpenAlex
- W1537141504
- Cited by
- 92
- References
- 65
- Citations by year
- 2026: 10 · 2025: 5 · 2024: 11 · 2023: 11 · 2022: 14 · 2021: 13 · 2020: 7 · 2019: 6 · 2018: 5 · 2017: 7 · 2016: 2 · 2015: 1
- FWCI
- 0.70
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- ANU Open Research (Australian National University) (submittedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- ecological momentary intervention, mobile health, anxiety, stress, generalized anxiety disorder, panic disorder, social anxiety disorder, self-monitoring, multimedia intervention
- MeSH terms
- Adolescent, Adult, Anxiety, Anxiety Disorders, Humans, Psychotherapy, Brief, Stress, Psychological, Panic Disorder, Telemedicine, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-27, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-27 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Effectiveness of mobile technologies delivering Ecological Momentary Interventions for stress and anxiety: a systematic review. https://app.cochat.ai/papers/10.1093/jamia/ocv043
- The paper
- Loo Gee, B., Griffiths, K. M., & Gulliver, A. (2016). Effectiveness of mobile technologies delivering Ecological Momentary Interventions for stress and anxiety: a systematic review. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocv043
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.