Effectiveness of mobile technologies delivering Ecological Momentary Interventions for stress and anxiety: a systematic review
Open accessThe DOI matches its Crossref record; 56 of the 65 references it cites were found in a registry or an index; 16 of the 53 sources its claims cite were checked for support.
Abstract
Objectives Mobile technologies may be suitable for delivering Ecological Momentary Interventions (EMI) to treat anxiety in real-time. This review aims to synthesize evidence on the effectiveness of EMI for treating anxiety conditions. Materials and Methods Four databases and the reference lists of previous studies were searched. A total of 1949 abstracts were double screened for inclusion. Sufficient studies were available to undertake a quantitative meta-analysis on EMIs on generalized anxiety symptoms. Results The 15 randomized trials and randomized controlled trials examined anxiety (n=7), stress (n=3), anxiety and stress (n=2), panic disorder (n=2), and social phobia (n=1). Eight EMIs comprised self-monitoring integrated with therapy modules, seven comprised multimedia content, and three comprised self-monitoring only. The quality of studies presented high risk of biases. Meta-analysis (n=7) demonstrated that EMIs reduced generalized anxiety compared to control and/or comparison groups (Effect Size (ES)=0.32, 95% CI, 0.12-0.53). Most EMIs targeting stress were reported effective relative to control as were the two EMIs targeting panic disorders. The EMI targeting social phobia was not effective. Discussion EMIs have potential in treating both anxiety and stress. However, few high-quality trials have been conducted for specific anxiety disorders. Further trials are needed to assess the value of EMI technologies for anxiety in enhancing existing treatments. Conclusion This study found a small significant effect of EMI studies on reducing generalized anxiety. Studies on stress demonstrated EMI was effective compared to control, with the small number of studies on panic and social phobia demonstrating mixed results. © The Author 2015.
Overview
CoChat Summary
TL;DR
This systematic review and meta-analysis found that ecological momentary interventions (EMIs) delivered via mobile technologies produced a small significant reduction in generalized anxiety compared with control/comparison groups, and most stress EMIs were effective, while evidence for panic disorder and social phobia was mixed or negative. The authors conclude EMIs are promising for anxiety and stress but that more high-quality trials are needed.
Key findings
- Meta-analysis of 7 studies on generalized anxiety showed EMIs reduced symptoms versus control/comparison groups: pooled effect size 0.32 (95% CI, 0.12–0.53, P = .002), with low heterogeneity (I² = 8%); excluding the active-control study, pooled effect size was 0.31 (95% CI, 0.07–0.55).
- The 15 randomized trials/RCTs covered anxiety/generalized anxiety, stress, anxiety and stress, panic disorder, and social phobia; 8 EMIs comprised self-monitoring integrated with therapy modules, 7 comprised multimedia content, and 3 comprised self-monitoring only.
- Most EMIs targeting stress were reported effective relative to control, but one self-monitoring mobile phone EMI was not effective for stress (d = −0.08 at post-test).
- Panic disorder findings were mixed: one 6-week CBT-plus-EMI condition was effective versus waitlist (d = 2.00) but not superior to CBT alone (d = 0.43 vs 6 weeks; d = −0.23 vs 12 weeks); the single social phobia trial found 8 sessions of group CBT plus EMI did not significantly reduce symptoms versus waitlist, whereas 12 sessions of group CBT without EMI did.
Methods
- Systematic review following PRISMA; searched Cochrane Library, PubMed, OvidSP (MEDLINE and PsycInfo), and Science Direct in January 2014, plus reference lists. From 3145 records, 1949 unique abstracts were double screened, 51 full texts were screened, and 15 papers were included.
- Included randomized trials/RCTs evaluating EMIs for anxiety symptoms, anxiety disorders, or anxiety-related outcomes such as stress/tension, with at least one control or comparison group; excluded usability/adherence-only studies, non-anxiety outcomes, laboratory-only biofeedback, ecological momentary assessment monitoring only, and non-mobile/hand-held interventions.
- Data were extracted with a pre-formulated rating sheet; study quality was assessed using Cochrane Effective Practice and Organization of Care criteria. Descriptive statistics summarized study characteristics, and a random-effects meta-analysis (Comprehensive Meta-Analysis v2.2.064) was conducted on the generalized anxiety subgroup, using post-test standardized mean differences, I², funnel plots, and trim-and-fill.
Limitations
- Stated by the authors: the review included EMIs with varying levels of therapist support; the search concept “ecological momentary intervention” may not have captured all relevant studies; only studies measuring anxiety-related outcomes were included, excluding cost-efficiency and adherence outcomes; and broad/ambiguous EMI definitions limit meaningful comparison across interventions.
- Evident from the text: most studies had unclear or high risk of bias (e.g., 11/15 [73.3%] unclear/high for sequence generation and allocation concealment; 15/15 [100%] for blinding), sample sizes were small (range 13–720, median 33.5), and heterogeneity prevented an overall quantitative meta-analysis, so only the generalized anxiety subgroup was pooled.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
14 Valid · 2 Not valid · 42 Not checked · 54 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“In the present research, the study conducted by Reid et al.38 was the only study evaluating an interactive EMI using mobile phones which failed to yield significant effects in reducing stress relative to an attention control.”
What the sources say
- Supportedcites [38] Reid, 2011, A mobile phone application for the assessment and management of youth mental health problems in primary care: a randomised controlled trial, BMC Fam Pract. source
The Results (Outcome–Intention to Treat; page unavailable) report no significant group effect or group-by-time interaction for stress, despite a decrease across both groups. The Methods describe a mobile-phone monitoring intervention and an attention comparison group. The claim that this was the 'only study' is the citing authors’ comparison across studies, not a finding attributed to Reid et al. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“an EMI using self-monitoring on mobile phones 38 was not effective relative to an attention control in reducing stress ( d = −0.08 at post-test).”
What the sources say
- Partly supportedcites [38] Reid, 2011, A mobile phone application for the assessment and management of youth mental health problems in primary care: a randomised controlled trial, BMC Fam Pract. sourceExperimental — accuracy not yet measured
The Results (Outcome–Intention to Treat; page not specified) report no significant group-by-time effect for stress, supporting the claim that the intervention was not more effective than the attention comparison. But Table 3 gives a post-test between-group effect size of d = 0.14, not −0.08. (LLM, conf=0.87)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“However, the negative findings of this study may have been due to nature of the attention control, which closely resembled the intervention. 19”
What the sources say
- Supportedcites [19] Donker, 2013, Smartphones for smarter delivery of mental health programs: a systematic review, J Med Internet Res. source
The Discussion (page not specified) links the nonsignificant finding to the attention-placebo control receiving almost the same intervention as the experimental group. The Results likewise report no significant between-group differences and describe the control intervention as largely the same. (LLM, conf=0.94)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“The effect size appears lower than reported previously for Internet-delivered cognitive behavioral therapy for anxiety. 42”
What the sources say
- Supportedcites [42] Mewton, 2014, Current perspectives on Internet-delivered cognitive behavioral therapy for adults with anxiety and related disorders, Psychol Res Behav Manag. source
The Efficacy of iCBT for anxiety disorders section reports between-group effect-size ranges for Internet-delivered CBT in adults with anxiety disorders. The citation supplies the previously reported iCBT figures; the comparison with EMIs is the citing authors’ own assessment, not a finding attributed to this review. No page number is available in our copy. (LLM, conf=0.88)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“A study evaluating a transdiagnostic EMI comprising online CBT modules and SMS reminders for treating stress and anxiety 37 was associated with lower stress levels than a waitlist control ( d = 0.34 at post-test).”
What the sources say
- Partly supportedcites [37] Proudfoot, 2013, Impact of a mobile phone and web program on symptom and functional outcomes for people with mild-to-moderate depression, anxiety and stress: a randomised controlled trial, BMC Psychiatr. sourceExperimental — accuracy not yet measured
The Methods > Interventions section describes myCompass as offering online modules derived partly from CBT and optional SMS reminders. Results > Outcomes at post-intervention reports significantly greater improvement in stress than the waitlist group. However, Table 5 in Results > Effect size gives the post-test stress effect as d = .35 using observed means or .28 using estimated marginal means, not .34; no page numbers are provided in our copy. (LLM, conf=0.90)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
69 more claims · 3 with their cited sources checked
Create a free account to see all 112 claims and every source verdict.
- Probably not a substantial claim. 22
- It may state two separate claims as one. 17
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Previous work has demonstrated that EMIs can be effective at reducing symptoms of depression and anxiety as well as related outcomes of stress and at increasing positive psychological functioning.”
From Ecological momentary interventions for depression and anxiety (2017) · cites this paper as Gee et al., 2016
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Current evidence supports that EMIs can be beneficial to reduce depression and anxiety and associated aspects of mental health such as stress, acceptance, and quality of life (Gee et al., 2016;Versluis et al., 2016).”
From Ecological momentary interventions for depression and anxiety (2017) · cites this paper as Gee et al., 2016
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Potential strategies for enhancing generalization could include additional homework assignments (Kazantzis et al., 2000), in vivo practice in new settings (Abramowitz & Arch, 2014), or utilizing technology to provide out-ofsession prompts and supports in the daily environment (Loo Gee et al., 2016;Swan et al., 2016).”
From A mixed methods study of autistic adults' mental health therapy experiences (2023) · cites this paper as Loo Gee et al., 2016
In the citing paper
“publication bias was rarely assessed for the representative effect sizes.”
From Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials (2022) · cites this paper as [49]
In the citing paper
“Evidence for ecological momentary interventions and apps compared to non-specific controls was weak or non-significant, although of similar magnitude (ds = 0.30 to 0.43 [20, 49]).”
From Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials (2022) · cites this paper as [49]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ RESULTS
“remained statistically significant (adjusted effect size = 0.27; 95% CI, −0.04 to 0.46)”
§ RESULTS
“95% CI, −0.04 to 0.46”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ RESULTS
“Seven studies delivered interventions both on-site and distally, 25,31–34,36,38”
§ RESULTS
“and three involved on-site and combined on-site and distal delivery. 31,39,41”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ RESULTS
“two of these examined indicated interventions, 35,36 and one evaluated a universal intervention. 36”
§ RESULTS
“a further five studies involved universal interventions delivered regardless of risk status and symptom levels. 25,26,29,30,34”
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Kessler, R. C., Berglund, P., Demler, O., Jin, R., Merikangas, K. R., & Walters, E. E. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.593 · Cited by 20,391
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099 · cited 1×
“Publication bias was investigated using visual inspection of funnel plots and the Tweedie trim and fill procedure.(28)”
MethodKessler, R. C., Chiu, W. T., Demler, O., & Walters, E. E. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.617 · Cited by 12,052
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454
Cochrane Handbook for Systematic Reviews of Interventions
Higgins, J. P. T., Green, S., & Ben Van Den, A. (2020) · International Coaching Psychology Review · doi:10.53841/bpsicpr.2020.15.2.123 · Cited by 5,670
Reducing Risks for Mental Disorders: Frontiers for Preventive Intervention Research
(1994) · doi:10.17226/2139 · Cited by 2,073
The ESEMeD/MHEDEA 2000 Investigators, Alonso, J., Angermeyer, M. C., Bernert, S., Bruffaerts, R., Brugha, T. S., Bryson, H., de Girolamo, G., de Graaf, R., Demyttenaere, K., et al. (2004) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0047.2004.00327.x · Cited by 1,819
Cited by
Philippe, T. J., Sikder, N., Jackson, A., Koblanski, M. E., Liow, E., Pilarinos, A., & Vasarhelyi, K. (2022) · JMIR Mental Health · doi:10.2196/35159 · Cited by 436
Van Ameringen, M., Turna, J., Khalesi, Z., Pullia, K., & Patterson, B. (2017) · Depression and Anxiety · doi:10.1002/da.22657 · Cited by 234
“These interventions aim to deliver interactive tools, when an immediate need (such as decreased mood or increased anxiety) is identified in real-time resultant of passive data collection (reviewed in Gee et al., 2016).”
BackgroundGoldberg, S. B., Lam, S. U., Simonsson, O., Torous, J., & Sun, S. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000002 · Cited by 237
“Gee (2016) [49] adults/ adolescents n/a ecological momentary interventions anxiety 6 Cochrane 8”
BackgroundEcological momentary interventions for mental health: A scoping review
Balaskas, A., Schueller, S. M., Cox, A. L., & Doherty, G. (2021) · PLOS ONE · doi:10.1371/journal.pone.0248152 · Cited by 235
“The selection of keywords for the search string related to mental health was informed by previous studies [5, 14, 15].”
MethodRauschenberg, C., Schick, A., Hirjak, D., Seidler, A., Paetzold, I., Apfelbacher, C., Riedel-Heller, S. G., & Reininghaus, U. (2021) · Journal of Medical Internet Research · doi:10.2196/23365 · Cited by 205
“While there is some initial evidence on the effectiveness of mHealth interventions to improve physical activity [90-95], stress appraisal [96,97], depression [26,96-100], anxiety [25,26,96,97], and alcohol and substance use [55,96,98,101-103], with small to medium effect sizes in all areas of…”
BackgroundColombo, D., Fernández-Álvarez, J., Patané, A., Semonella, M., Kwiatkowska, M., García-Palacios, A., Cipresso, P., Riva, G., & Botella, C. (2019) · Journal of Clinical Medicine · doi:10.3390/jcm8040465 · Cited by 194
“Still, promising results have been already shown also regarding the application of EMA and EMI to anxiety disorders [93,94] and stress-related disorders [95,96], highlighting the potential of these tools to provide psychological support in daily life and to investigate symptom fluctuations across time.”
BackgroundEcological momentary interventions for depression and anxiety
Schueller, S. M., Aguilera, A., & Mohr, D. C. (2017) · Depression and Anxiety · doi:10.1002/da.22649 · Cited by 168
“This review identified seven studieswhich produced a small pooled effect size of d= .32 (95%CI 0.12–0.53) favoring the EMIs over comparison or control conditions (Gee et al., 2016).”
BackgroundInfluentialDao, K. P., Cocker, K. A. D., Tong, H. L., Kocaballi, A. B., Chow, C. K., & Laranjo, L. (2021) · JMIR mhealth and uhealth · doi:10.2196/22890 · Cited by 149
“Previous systematic reviews on EMIs have all focused on mental health, used mostly older technologies, and did not tailor EMIs based on EMAs, having found mixed results (2 meta-analyses [23,25] showing small but positive effect sizes and another systematic review demonstrating acceptability and feasibility [24]).”
BackgroundResultCommercial Off-The-Shelf Video Games for Reducing Stress and Anxiety: Systematic Review
Pallavicini, F., Pepe, A., & Mantovani, F. (2021) · JMIR Mental Health · doi:10.2196/28150 · Cited by 115
Technology Use for Adolescent Health and Wellness
Radović, A., & Badawy, S. M. (2020) · PEDIATRICS · doi:10.1542/peds.2019-2056g · Cited by 122
Perski, O., Keller, J., Kale, D., Asiamah-Asare, B. K. Y., Schneider, V., Powell, D., Naughton, F., ten Hoor, G. A., Verboon, P., & Kwaśnicka, D. (2022) · Health Psychology Review · doi:10.1080/17437199.2022.2112258 · Cited by 122
“…et al., 2019; de Vries et al., 2021; Enkema et al., 2020; Gee et al., 2020; Goldschmidt et al., 2014; Haedt-Matt & Keel, 2011; Liu et al., 2019; Loo Gee et al., 2016; Mote & Fulford, 2020; Santangelo et al., 2014; Versluis et al., 2016; Walz et al., 2014; Yang et al., 2019), children/youth (Heron…”
Gual-Montolio, P., Jaén, I., Martínez-Borba, V., Castilla, D., & Suso-Ribera, C. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19137737 · Cited by 93
“These interventions can be used as a complement to existing psychological therapies provided by a therapist or they can be implemented as an independent intervention, for example in internet treatments [61], as well as to monitor and encourage participants to actively perform tasks (for example, by sending a notificat…”
BackgroundCommercially Available Smartphone Apps to Support Postoperative Pain Self-Management: Scoping Review
Lalloo, C., Shah, U., Birnie, K. A., Davies-Chalmers, C., Rivera, J., Stinson, J., & Campbell, F. (2017) · JMIR mHealth and uHealth · doi:10.2196/mhealth.8230 · Cited by 91
“The ability of self-management apps to target psychosocial risk factors is plausible, given existing evidence supporting the use of smartphones to effectively deliver interventions to reduce symptoms of anxiety and depression [28], particularly when strategies are available in the moment when people are engaged in the…”
BackgroundOnline and mobile technologies for self-management in bipolar disorder: A systematic review.
Gliddon, E., Barnes, S. J., Murray, G., & Michalak, E. E. (2017) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000270 · Cited by 84
Bracci, A., Lobbezoo, F., Häggman‐Henrikson, B., Colonna, A., Nykänen, L., Pollis, M., Ahlberg, J., Manfredini, D., & International Network for Orofacial Pain and Related Disorders Methodology (INfORM) (2022) · Journal of Clinical Medicine · doi:10.3390/jcm11175083 · Cited by 83
Yellowlees, P., Richard Chan, S., & Burke Parish, M. (2015) · International Review of Psychiatry · doi:10.3109/09540261.2015.1082987 · Cited by 83
van Genugten, C. R., Schuurmans, J., Lamers, F., Riese, H., Penninx, B. W. J. H., Schoevers, R. A., Riper, H. M., & Smit, J. H. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9020322 · Cited by 71
Menon, V., Rajan, T. M., & Sarkar, S. (2017) · Indian Journal of Psychological Medicine · doi:10.4103/0253-7176.198956 · Cited by 76
“[5,9] Hence, there is a need to synthesize available information to better understand the accumulated evidence, as well as the background, context, and participant characteristics in individual trials which may influence results.”
BackgroundMarciniak, M. A., Shanahan, L., Rohde, J., Schulz, A., Wackerhagen, C., Kobylińska, D., Tuescher, O., Binder, H., Walter, H., Kalisch, R., et al. (2020) · JMIR mhealth and uhealth · doi:10.2196/19836 · Cited by 66
Just-in-time adaptive ecological momentary assessment (JITA-EMA)
Schneider, S., Junghaenel, D. U., Smyth, J. M., Wen, C. K. F., & Stone, A. A. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02083-8 · Cited by 76
“Such intervention approaches have been termed Ecological Momentary Interventions (Heron & Smyth, 2010; Loo Gee et al., 2016; Versluis et al., 2016) or just-in-time adaptive interventions (JITAI; Collins et al., 2004; Nahum-Shani et al., 2015; Nahum-Shani et al., 2018).”
BackgroundMethodBatink, T., Bakker, J., Vaessen, T., Kasanova, Z., Collip, D., van Os, J., Wichers, M., Germeys, I., & Peeters, F. (2016) · JMIR mhealth and uhealth · doi:10.2196/mhealth.5437 · Cited by 48
“ESM has already successfully found its way in mHealth [13-18], showing its potential in the treatment of depression [19] and anxiety [20].”
Research Trends on Mobile Mental Health Application for General Population: A Scoping Review
Hwang, W. J., Ha, J. S., & Kim, M. J. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18052459 · Cited by 56
“Additional efforts are required to identify the best ways a mobile app can be used to address components [46] such as the development and application of methods to evaluate interactive mechanisms from physical measurements [47,48].”
BackgroundImpact of digital services on healthcare and social welfare: An umbrella review
Härkönen, H., Lakoma, S., Verho, A., Torkki, P. M., Leskelä, R., Pennanen, P., Laukka, E., & Jansson, M. M. (2024) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2024.104692 · Cited by 80
Santa Maria, D., Padhye, N., Businelle, M., Yang, Y., Jones, J., Sims, A., & Lightfoot, M. (2021) · Journal of Medical Internet Research · doi:10.2196/26704 · Cited by 36
“JITAIs have been found to significantly reduce anxiety and stress [67-69], alcohol use [70], and depressive symptoms [71], and increase pre-exposure prophylaxis (PrEP) uptake among MSM [72].”
Abedtash, H., & Holden, R. J. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx006 · Cited by 36
Tuerk, P. W., Schaeffer, C. M., Mcguire, J. F., Larsen, M. A., Capobianco, N. B., & Piacentini, J. C. (2019) · Current Psychiatry Reports · doi:10.1007/s11920-019-1092-2 · Cited by 35
A mixed methods study of autistic adults' mental health therapy experiences
Mazurek, M. O., Pappagianopoulos, J., Brunt, S., Sadikova, E., Nevill, R., Menezes, M., & Harkins, C. (2023) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2835 · Cited by 33
Ecological Momentary Interventions in Public Mental Health Provision
Schulte‐Strathaus, J. C. C., Rauschenberg, C., Baumeister, H., & Reininghaus, U. (2022) · Studies in neuroscience, psychology and behavioral economics · doi:10.1007/978-3-030-98546-2_25 · Cited by 33
Balaskas, A., Schueller, S. M., Cox, A. L., & Doherty, G. J. (2021) · JMIR mhealth and uhealth · doi:10.2196/26712 · Cited by 43
“Several studies have examined the effectiveness of delivering interventions using such apps [10,11].”
BackgroundToscos, T. R., Coupe, A., Flanagan, M. E., Drouin, M., Carpenter, M., Reining, L., Roebuck, A. E., & Mirro, M. (2018) · JMIR Mental Health · doi:10.2196/13230 · Cited by 31
Bell, I. H., Fielding-Smith, S. F., Hayward, M., Rossell, S. L., Lim, M. H., Farhall, J., & Thomas, N. (2018) · Trials · doi:10.1186/s13063-018-2607-6 · Cited by 28
Spohrer, K., Fallon, M., Hoehle, H., & Heinzl, A. (2021) · Journal of Management Information Systems · doi:10.1080/07421222.2021.1912936 · Cited by 30
“Second, the alleviation of harmful stress can be effectively supported by adequately designed personal health technology [14, 27], but few studies address the design and evaluation of mHealth stress applications rigorously [21].”
BackgroundStefanovics, E. A., & Potenza, M. N. (2022) · Psychiatric Clinics of North America · doi:10.1016/j.psc.2022.04.004 · Cited by 32
Zainal, N. H., & Newman, M. G. (2023) · European Psychiatry · doi:10.1192/j.eurpsy.2023.2 · Cited by 26
“Moreover, data pooled acrossmainly self-directed CBT and relaxation training-focused EMI RCTs for GAD and other anxiety disorders similarly showed small-tomoderate effects in reducing anxiety severity [58, 59].”
Kolar, D. R., Hammerle, F., Jenetzky, E., & Huß, M. (2017) · BMJ Open · doi:10.1136/bmjopen-2017-018049 · Cited by 28
“depression(8) 9 or anxiety.(10) 11 Regarding mhealth apps for eating disorders, two recent reviews identified existing apps in the most prominent app stores and assessed the quality and clinical utility of these apps.”
BackgroundThomas, N., Bless, J. J., Alderson‐Day, B., Bell, I., Cella, M., Craig, T., Delespaul, P., Hugdahl, K., Laloyaux, J., Larøi, F., et al. (2018) · Schizophrenia Bulletin · doi:10.1093/schbul/sby103 · Cited by 29
Ferreira, S., Pêgo, J. M., & Morgado, P. F. (2018) · Psychiatry Research · doi:10.1016/j.psychres.2018.12.096 · Cited by 24
“Indeed, devices incorporating mobile technology are starting to be applied to help patients with psychiatric disorders in everyday life (Adams et al., 2017; Bhugra et al., 2017; Loo Gee et al., 2016; Van Ameringen et al., 2017; Versluis et al., 2016).”
BackgroundDemers, M., & Winstein, C. J. (2020) · Topics in Stroke Rehabilitation · doi:10.1080/10749357.2020.1856557 · Cited by 26
Beute, F., de Kort, Y. A. W., & IJsselsteijn, W. A. (2016) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph13040420 · Cited by 29
“, [29–31]).”
Naccache, B., Mesquida, L., Raynaud, J., & Revet, A. (2021) · BMC Psychiatry · doi:10.1186/s12888-021-03478-7 · Cited by 28
Livingston, N. A., Shingleton, R. M., Heilman, M. E., & Brief, D. J. (2019) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-019-00099-6 · Cited by 20
Rohde, J., Marciniak, M. A., Henninger, M., Homan, S., Ries, A., Paersch, C., Friedman, O. B., Brown, A. D., & Kleim, B. (2024) · PLoS ONE · doi:10.1371/journal.pone.0305103 · Cited by 36
Marciniak, M. A., Shanahan, L., Myin‐Germeys, I., Veer, I. M., Yuen, K. S. L., Binder, H., Walter, H., Hermans, E. J., Kalisch, R., & Kleim, B. (2023) · Applied Psychology Health and Well-Being · doi:10.1111/aphw.12505 · Cited by 23
Rules of engagement in mobile health: what does mobile health bring to research and theory?
Şahin, Ç. Ç. (2018) · Contemporary Nurse · doi:10.1080/10376178.2018.1448290 · Cited by 16
Beltzer, M., Meyerhoff, J., Popowski, S. A., Mohr, D. C., & Kornfield, R. (2023) · JMIR Formative Research · doi:10.2196/48152 · Cited by 20
“Although some digital mental health interventions that include self-tracking simply serve as repositories for self-tracked data, others leverage self-tracking data to deliver personalized interventions or features [9].”
BackgroundZhu, Z., Aitken, J. A., Dalal, R. S., & Kaplan, S. A. (2023) · Organizational Research Methods · doi:10.1177/10944281231202740 · Cited by 22
“In another review, Loo Gee et al. (2016) conducted a meta-analysis on the effect of JITAIs on anxiety.”
Castilla, D., Haro, M. V. N., Suso‐Ribera, C., Díaz‐García, A., Zaragozá, I., & García‐Palacios, A. (2022) · BMC Psychiatry · doi:10.1186/s12888-022-03800-x · Cited by 20
“These interventions can be used as an adjunct to existing psychological therapies delivered by a therapist or they can be implemented as a stand-alone intervention [63].”
BackgroundKuburi, S., Ewing, L., Hamza, C. A., & Goldstein, A. L. (2024) · Journal of Youth and Adolescence · doi:10.1007/s10964-024-01946-3 · Cited by 18
“Emerging evidence suggests that EMI may be effective in reducing anxiety and stress (Loo Gee et al., 2016).”
Effectiveness of telemedicine on common mental disorders: An umbrella review and meta-meta-analysis
Chen, J., Li, C., An, K., Dong, X., Liu, J., & Wu, H. Y. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108325 · Cited by 22
Feneberg, A. C., & Nater, U. M. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.927705 · Cited by 17
Rabasco, A., McKay, D., Smits, J. A., Powers, M. B., Meuret, A. E., & McGrath, P. B. (2022) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2022.102528 · Cited by 14
Mobile Health to Support Ageing in Place: A Systematic Review of Reviews and Meta-Analyses
Rocha, N. P., Santos, M., Cerqueira, M., & Queirós, A. (2019) · International Journal of E-Health and Medical Communications · doi:10.4018/ijehmc.2019070101 · Cited by 15
Just-In-Time Adaptive Interventions to Promote Behavioral Health: Protocol for a Systematic Review
Henry, L. M., Blay-Tofey, M., Haeffner, C. E., Raymond, C. N., Tandilashvili, E., Terry, N. L., Kiderman, M., Metcalf, O., Brotman, M. A., & López-Guzmán, S. (2024) · JMIR Research Protocols · doi:10.2196/58917 · Cited by 16
Lapão, L. V., Correia, J. C., & Jevtić, M. (2023) · Sustainability · doi:10.3390/su15054269 · Cited by 16
Meyer, A. E., Silva, S. G., & Curry, J. F. (2023) · Behaviour Research and Therapy · doi:10.1016/j.brat.2023.104429 · Cited by 13
Binder, F., Koenig, J., Resch, F., & Kaess, M. (2024) · Psychotherapy and Psychosomatics · doi:10.1159/000537934 · Cited by 13
Marciniak, M. A., Shanahan, L., Yuen, K. S. L., Veer, I. M., Walter, H., Tuescher, O., Kobylińska, D., Kalisch, R., Hermans, E. J., Binder, H., et al. (2024) · Digital Health · doi:10.1177/20552076241249267 · Cited by 9
Mental health mobile app use to manage psychological difficulties: an umbrella review
Badesha, K., Wilde, S., & Dawson, D. L. (2022) · Mental Health Review Journal · doi:10.1108/mhrj-02-2021-0014 · Cited by 11
An Ecological Momentary Intervention for people with social anxiety: A descriptive case study
Gee, B. L., Batterham, P. J., Gulliver, A., Reynolds, J., & Griffiths, K. M. (2021) · Informatics for Health and Social Care · doi:10.1080/17538157.2021.1896525 · Cited by 6
Self-citationInterventions to prevent and mitigate workplace violence
Sanders, J. E., Thomas, L., Kerr, T., et al. (2023) · Nursing Management · doi:10.1097/nmg.0000000000000040 · Cited by 3
Liu, C., Lee, W. L., Teo, C. H., Zhang, J. H., & Chong, M. C. (2024) · Digital Health · doi:10.1177/20552076241263695 · Cited by 5
Patient and therapist experiences of using a smartphone application monitoring anxiety symptoms
Tarp, K., Holmberg, T. T., Moeller, A. M., & Lichtenstein, M. B. (2022) · International Journal of Qualitative Studies on Health and Well-Being · doi:10.1080/17482631.2022.2044981 · Cited by 3
Tong, Y. A., & Newman, M. G. (2022) · doi:10.31234/osf.io/t3egn · Cited by 3
Alhasani, M., Oyebode, O., & Orji, R. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-94959-3_11 · Cited by 2
Technological Interventions for Anxiety Disorders
Baños, R., Vara, M. D., Mira, A., García‐Palacios, A., & Botella, C. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-818697-8.00008-x · Cited by 2
Chan, M., Lau, C., Li, S., & Lam, M. (2022) · TMS Proceedings 2021 · doi:10.1037/tms0000007 · Cited by 2
Staab, P. A., Bhattacharya, A., & Slovák, P. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713859 · Cited by 1
“Digital EMIs can function as standalone treatments, but they are often integrated into stepped-care models as a complement to traditional face-to-face therapy [49, 175].”
Berkowitz, T. S., Toumbourou, J. W., Evans, S., Fuller‐Tyszkiewicz, M., & Westrupp, E. M. (2025) · PLoS ONE · doi:10.1371/journal.pone.0327179 · Cited by 3
Leverage points in evidence-based professional psychology training.
Warren, J. S., & Park, S. Y. (2018) · Training and Education in Professional Psychology · doi:10.1037/tep0000216 · Cited by 2
Ménard, F., Ouellet‐Morin, I., & Guay, S. (2021) · Santé mentale au Québec · doi:10.7202/1081518ar · Cited by 3
Marciniak, M. A., Shanahan, L., Yuen, K. S. L., Veer, I. M., Walter, H., Tüscher, O., Kobylińska, D., Kalisch, R., Hermans, E. J., Binder, H., et al. (2023) · doi:10.31234/osf.io/tyrp2 · Cited by 2
Rudnicki, K., Joris, G., Meyvis, F., Verschraegen, M., & Poels, K. (2026) · Behavioral Sciences · doi:10.3390/bs16050778 · Cited by 1
“…(EMA)—i.e., repetitive sampling of participants’ affect and stress in real-world environments—are scarce in this domain, with only a handful of investigations having used EMA designs to track the effects of breathing interventions in daily life (Loo Gee et al., 2016; Perreau et al., 2023).”
Gugel, J., Rauschenberg, C., Paetzold, I., Schick, A., Wierzba, E., Hirjak, D., Boehnke, J. R., Boecking, B., & Reininghaus, U. (2026) · Journal of Medical Internet Research · doi:10.2196/77150 · Cited by 3
“Even though there is great variability in content, design, and target populations of EMIs, the current state of research indicates their overall potential in improving mental health outcomes [9,63-67], including findings from the EMIcompass RCT [35].”
Amo, V., & Lieder, F. (2024) · JMIR Mental Health · doi:10.2196/57201 · Cited by 4
An Ecological Momentary Intervention Using Self-Compassionate Writing to Reduce Stress
Chishima, Y., Sugawara, D., & Mizuno, M. (2025) · Mindfulness · doi:10.1007/s12671-024-02503-6 · Cited by 1
“Literature on EMIs targeting not only problematic behaviors (e.g., smoking) but also mental health (e.g., depression) has been growing (Gee et al., 2016; Marciniak et al., 2020; Versluis et al., 2016).”
Stand-Alone KVT-basierte Interventionen via Smartphone zur Förderung der psychischen Gesundheit
Marciniak, M. A., Shanahan, L., Rohde, J., Ehrt‐Schäfer, Y., Schulz, A., Wackerhagen, C., Kobylińska, D., Tüscher, O., Binder, H., Walter, H., et al. (2021) · Nervenheilkunde · doi:10.1055/a-1488-4943 · Cited by 1
“PMID: 29434552 [10] Loo Gee B, Griffiths KM, Gulliver A.”
BackgroundColombo, D. (2020) · Tesis Doctorals en Xarxa (Consorci de Serveis Universitaris de Catalunya) · doi:10.6035/14109.2020.762821 · Cited by 1
Gugel, J., Paetzold, I., Rauschenberg, C., Schick, A., Hirjak, D., Boehnke, J. R., Boecking, B., & Reininghaus, U. (2025) · doi:10.2196/preprints.77150 · Cited by 1
Bell, I. (2019) · Minerva Access (University of Melbourne)
Marciniak, M. A., Shanahan, L., Rohde, J., Schulz, A., Wackerhagen, C., Kobylińska, D., Tüscher, O., Binder, H., Walter, H., Kalisch, R., et al. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/r4vwz
de Castro, R. A. S. (2021) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.22.2021.tde-22032022-160154 · Cited by 2
Mobile Health to Support Ageing in Place: A Systematic Review of Reviews and Meta-Analyses
Rocha, N. P., Santos, M., Cerqueira, M., & Queirós, A. (2022) · IGI Global eBooks · doi:10.4018/978-1-6684-5295-0.ch049
Strategies in Ecological Momentary Interventions for Mental Health Care in Adults: A Scoping Review
Ryu, G. W. (2024) · Journal of Digital Contents Society · doi:10.9728/dcs.2024.25.4.961
Henry, L. M., Blay-Tofey, M., Haeffner, C. E., Raymond, C. N., Tandilashvili, E., Terry, N. L., Kiderman, M., Brotman, M. A., & López-Guzmán, S. (2024) · doi:10.2196/preprints.58917
Song, H., Choi, Y., Park, J., Hwang, H., Kim, J., & Park, C. (2026) · JMIR mhealth and uhealth · doi:10.2196/preprints.88919 · Cited by 1
Petagna, K. D., Ecker, A., Reid, T. E., McMullen, K. M., Quigley, K. S., & Wormwood, J. B. (2026) · International Journal of Clinical and Health Psychology · doi:10.1016/j.ijchp.2025.100659 · Cited by 3
“Cells report standardized coefficient estimates with 95 % confidence intervals in the square brackets. symptom reporting through experience sampling as an intervention (for reviews see Loo Gee et al., 2016; Myin-Germeys et al., 2024; Walz et al., 2014).”
Fiß, F., Berndt, L., Anickova, S., Vaessen, T., & Kraiss, J. T. (2026) · Journal of Affective Disorders · doi:10.1016/j.jad.2026.121661 · Cited by 1
Alhasani, M., & Orji, R. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2659301
Ewald, S., Berkowitz, T. S., Hiskens-Ravest, S., Bufton, K., Bates, M. T., Eric, O., Fuller‐Tyszkiewicz, M., King, G., & Westrupp, E. M. (2026) · JMIR Pediatrics and Parenting · doi:10.2196/87917 · Cited by 1
Alhasani, M., & Orji, R. (2026) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-026-09447-7
“…to encourage behaviour change, including promoting participation in physical activity (Aldenaini et al. 2020), enhancing medication adherence (Allam et al. 2015), reducing stress and anxiety, as well as improving overall well-being (Loo Gee et al. 2016; Zafar et al. 2020; Loo 2016 amd zafar 2020).”
Li, S., Lo, L. L. H., Lau, C., Lam, M., & Chan, M. (2026) · JMIR mhealth and uhealth · doi:10.2196/72435
“However, RCTs of EMA and EMI in mental health promotion remained scarce [45]—and their application in workplace mental health services is even more limited.”
Rauschenberg, C., Schirmbeck, F. N., Fechtelpeter, J., Wierzba, E., Hiller, S., Kahr, K., Kessler, A. S., Hornbacher, L. L. F., Götzl, C., Schick, A., et al. (2026) · Translational Psychiatry · doi:10.1038/s41398-026-04475-8
“Recent randomized controlled trials suggest that EMIs can have bene fi cial effects on various mental health outcomes [5, 9 – 12].”
Metadata
- Authors
- Loo Gee, B., Griffiths, K. M., & Gulliver, A.
- Affiliations
- National Institute for Mental Health Research, Research School of Population Health, Australian National University
- Australian National University (AU)
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2015-05-21
- Volume
- 23
- Issue
- 1
- Pages
- 221-229
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC7814930
- OpenAlex
- W1537141504
- Cited by
- 92
- References
- 65
- Citations by year
- 2026: 10 · 2025: 5 · 2024: 11 · 2023: 11 · 2022: 14 · 2021: 13 · 2020: 7 · 2019: 6 · 2018: 5 · 2017: 7 · 2016: 2 · 2015: 1
- FWCI
- 0.70
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- ANU Open Research (Australian National University) (submittedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- ecological momentary intervention, mobile health, anxiety, stress, generalized anxiety disorder, panic disorder, social anxiety disorder, self-monitoring, multimedia intervention
- MeSH terms
- Adolescent, Adult, Anxiety, Anxiety Disorders, Humans, Psychotherapy, Brief, Stress, Psychological, Panic Disorder, Telemedicine, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-27, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-27 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.