Effectiveness of mobile technologies delivering Ecological Momentary Interventions for stress and anxiety: a systematic review
Open accessThe DOI matches its Crossref record; 56 of the 65 references it cites were found in a registry or an index; 16 of the 53 sources its claims cite were checked for support.
Abstract
Objectives Mobile technologies may be suitable for delivering Ecological Momentary Interventions (EMI) to treat anxiety in real-time. This review aims to synthesize evidence on the effectiveness of EMI for treating anxiety conditions. Materials and Methods Four databases and the reference lists of previous studies were searched. A total of 1949 abstracts were double screened for inclusion. Sufficient studies were available to undertake a quantitative meta-analysis on EMIs on generalized anxiety symptoms. Results The 15 randomized trials and randomized controlled trials examined anxiety (n=7), stress (n=3), anxiety and stress (n=2), panic disorder (n=2), and social phobia (n=1). Eight EMIs comprised self-monitoring integrated with therapy modules, seven comprised multimedia content, and three comprised self-monitoring only. The quality of studies presented high risk of biases. Meta-analysis (n=7) demonstrated that EMIs reduced generalized anxiety compared to control and/or comparison groups (Effect Size (ES)=0.32, 95% CI, 0.12-0.53). Most EMIs targeting stress were reported effective relative to control as were the two EMIs targeting panic disorders. The EMI targeting social phobia was not effective. Discussion EMIs have potential in treating both anxiety and stress. However, few high-quality trials have been conducted for specific anxiety disorders. Further trials are needed to assess the value of EMI technologies for anxiety in enhancing existing treatments. Conclusion This study found a small significant effect of EMI studies on reducing generalized anxiety. Studies on stress demonstrated EMI was effective compared to control, with the small number of studies on panic and social phobia demonstrating mixed results. © The Author 2015.
Overview
CoChat Summary
TL;DR
This systematic review and meta-analysis found that ecological momentary interventions (EMIs) delivered via mobile technologies produced a small significant reduction in generalized anxiety compared with control/comparison groups, and most stress EMIs were effective, while evidence for panic disorder and social phobia was mixed or negative. The authors conclude EMIs are promising for anxiety and stress but that more high-quality trials are needed.
Key findings
- Meta-analysis of 7 studies on generalized anxiety showed EMIs reduced symptoms versus control/comparison groups: pooled effect size 0.32 (95% CI, 0.12–0.53, P = .002), with low heterogeneity (I² = 8%); excluding the active-control study, pooled effect size was 0.31 (95% CI, 0.07–0.55).
- The 15 randomized trials/RCTs covered anxiety/generalized anxiety, stress, anxiety and stress, panic disorder, and social phobia; 8 EMIs comprised self-monitoring integrated with therapy modules, 7 comprised multimedia content, and 3 comprised self-monitoring only.
- Most EMIs targeting stress were reported effective relative to control, but one self-monitoring mobile phone EMI was not effective for stress (d = −0.08 at post-test).
- Panic disorder findings were mixed: one 6-week CBT-plus-EMI condition was effective versus waitlist (d = 2.00) but not superior to CBT alone (d = 0.43 vs 6 weeks; d = −0.23 vs 12 weeks); the single social phobia trial found 8 sessions of group CBT plus EMI did not significantly reduce symptoms versus waitlist, whereas 12 sessions of group CBT without EMI did.
Methods
- Systematic review following PRISMA; searched Cochrane Library, PubMed, OvidSP (MEDLINE and PsycInfo), and Science Direct in January 2014, plus reference lists. From 3145 records, 1949 unique abstracts were double screened, 51 full texts were screened, and 15 papers were included.
- Included randomized trials/RCTs evaluating EMIs for anxiety symptoms, anxiety disorders, or anxiety-related outcomes such as stress/tension, with at least one control or comparison group; excluded usability/adherence-only studies, non-anxiety outcomes, laboratory-only biofeedback, ecological momentary assessment monitoring only, and non-mobile/hand-held interventions.
- Data were extracted with a pre-formulated rating sheet; study quality was assessed using Cochrane Effective Practice and Organization of Care criteria. Descriptive statistics summarized study characteristics, and a random-effects meta-analysis (Comprehensive Meta-Analysis v2.2.064) was conducted on the generalized anxiety subgroup, using post-test standardized mean differences, I², funnel plots, and trim-and-fill.
Limitations
- Stated by the authors: the review included EMIs with varying levels of therapist support; the search concept “ecological momentary intervention” may not have captured all relevant studies; only studies measuring anxiety-related outcomes were included, excluding cost-efficiency and adherence outcomes; and broad/ambiguous EMI definitions limit meaningful comparison across interventions.
- Evident from the text: most studies had unclear or high risk of bias (e.g., 11/15 [73.3%] unclear/high for sequence generation and allocation concealment; 15/15 [100%] for blinding), sample sizes were small (range 13–720, median 33.5), and heterogeneity prevented an overall quantitative meta-analysis, so only the generalized anxiety subgroup was pooled.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
14 Valid · 2 Not valid · 42 Not checked · 54 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“In the present research, the study conducted by Reid et al.38 was the only study evaluating an interactive EMI using mobile phones which failed to yield significant effects in reducing stress relative to an attention control.”
What the sources say
- Supportedcites [38] Reid, 2011, A mobile phone application for the assessment and management of youth mental health problems in primary care: a randomised controlled trial, BMC Fam Pract. source
The Results (Outcome–Intention to Treat; page unavailable) report no significant group effect or group-by-time interaction for stress, despite a decrease across both groups. The Methods describe a mobile-phone monitoring intervention and an attention comparison group. The claim that this was the 'only study' is the citing authors’ comparison across studies, not a finding attributed to Reid et al. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“an EMI using self-monitoring on mobile phones 38 was not effective relative to an attention control in reducing stress ( d = −0.08 at post-test).”
What the sources say
- Partly supportedcites [38] Reid, 2011, A mobile phone application for the assessment and management of youth mental health problems in primary care: a randomised controlled trial, BMC Fam Pract. sourceExperimental — accuracy not yet measured
The Results (Outcome–Intention to Treat; page not specified) report no significant group-by-time effect for stress, supporting the claim that the intervention was not more effective than the attention comparison. But Table 3 gives a post-test between-group effect size of d = 0.14, not −0.08. (LLM, conf=0.87)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“However, the negative findings of this study may have been due to nature of the attention control, which closely resembled the intervention. 19”
What the sources say
- Supportedcites [19] Donker, 2013, Smartphones for smarter delivery of mental health programs: a systematic review, J Med Internet Res. source
The Discussion (page not specified) links the nonsignificant finding to the attention-placebo control receiving almost the same intervention as the experimental group. The Results likewise report no significant between-group differences and describe the control intervention as largely the same. (LLM, conf=0.94)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“The effect size appears lower than reported previously for Internet-delivered cognitive behavioral therapy for anxiety. 42”
What the sources say
- Supportedcites [42] Mewton, 2014, Current perspectives on Internet-delivered cognitive behavioral therapy for adults with anxiety and related disorders, Psychol Res Behav Manag. source
The Efficacy of iCBT for anxiety disorders section reports between-group effect-size ranges for Internet-delivered CBT in adults with anxiety disorders. The citation supplies the previously reported iCBT figures; the comparison with EMIs is the citing authors’ own assessment, not a finding attributed to this review. No page number is available in our copy. (LLM, conf=0.88)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“A study evaluating a transdiagnostic EMI comprising online CBT modules and SMS reminders for treating stress and anxiety 37 was associated with lower stress levels than a waitlist control ( d = 0.34 at post-test).”
What the sources say
- Partly supportedcites [37] Proudfoot, 2013, Impact of a mobile phone and web program on symptom and functional outcomes for people with mild-to-moderate depression, anxiety and stress: a randomised controlled trial, BMC Psychiatr. sourceExperimental — accuracy not yet measured
The Methods > Interventions section describes myCompass as offering online modules derived partly from CBT and optional SMS reminders. Results > Outcomes at post-intervention reports significantly greater improvement in stress than the waitlist group. However, Table 5 in Results > Effect size gives the post-test stress effect as d = .35 using observed means or .28 using estimated marginal means, not .34; no page numbers are provided in our copy. (LLM, conf=0.90)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
69 more claims · 3 with their cited sources checked
Create a free account to see all 112 claims and every source verdict.
- Probably not a substantial claim. 22
- It may state two separate claims as one. 17
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Previous work has demonstrated that EMIs can be effective at reducing symptoms of depression and anxiety as well as related outcomes of stress and at increasing positive psychological functioning.”
From Ecological momentary interventions for depression and anxiety (2017) · cites this paper as Gee et al., 2016
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Current evidence supports that EMIs can be beneficial to reduce depression and anxiety and associated aspects of mental health such as stress, acceptance, and quality of life (Gee et al., 2016;Versluis et al., 2016).”
From Ecological momentary interventions for depression and anxiety (2017) · cites this paper as Gee et al., 2016
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Potential strategies for enhancing generalization could include additional homework assignments (Kazantzis et al., 2000), in vivo practice in new settings (Abramowitz & Arch, 2014), or utilizing technology to provide out-ofsession prompts and supports in the daily environment (Loo Gee et al., 2016;Swan et al., 2016).”
From A mixed methods study of autistic adults' mental health therapy experiences (2023) · cites this paper as Loo Gee et al., 2016
In the citing paper
“publication bias was rarely assessed for the representative effect sizes.”
From Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials (2022) · cites this paper as [49]
In the citing paper
“Evidence for ecological momentary interventions and apps compared to non-specific controls was weak or non-significant, although of similar magnitude (ds = 0.30 to 0.43 [20, 49]).”
From Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials (2022) · cites this paper as [49]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ RESULTS
“remained statistically significant (adjusted effect size = 0.27; 95% CI, −0.04 to 0.46)”
§ RESULTS
“95% CI, −0.04 to 0.46”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ RESULTS
“Seven studies delivered interventions both on-site and distally, 25,31–34,36,38”
§ RESULTS
“and three involved on-site and combined on-site and distal delivery. 31,39,41”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ RESULTS
“two of these examined indicated interventions, 35,36 and one evaluated a universal intervention. 36”
§ RESULTS
“a further five studies involved universal interventions delivered regardless of risk status and symptom levels. 25,26,29,30,34”
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Kessler, R. C., Berglund, P., Demler, O., Jin, R., Merikangas, K. R., & Walters, E. E. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.593 · Cited by 20,391
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099 · cited 1×
“Publication bias was investigated using visual inspection of funnel plots and the Tweedie trim and fill procedure.(28)”
MethodKessler, R. C., Chiu, W. T., Demler, O., & Walters, E. E. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.617 · Cited by 12,052
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454
Cochrane Handbook for Systematic Reviews of Interventions
Higgins, J. P. T., Green, S., & Ben Van Den, A. (2020) · International Coaching Psychology Review · doi:10.53841/bpsicpr.2020.15.2.123 · Cited by 5,670
Reducing Risks for Mental Disorders: Frontiers for Preventive Intervention Research
(1994) · doi:10.17226/2139 · Cited by 2,073
The ESEMeD/MHEDEA 2000 Investigators, Alonso, J., Angermeyer, M. C., Bernert, S., Bruffaerts, R., Brugha, T. S., Bryson, H., de Girolamo, G., de Graaf, R., Demyttenaere, K., et al. (2004) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0047.2004.00327.x · Cited by 1,819
Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: A meta-analysis
SPEK, V., CUIJPERS, P., NYKLÍČEK, I., RIPER, H., KEYZER, J., & POP, V. (2007) · Psychological Medicine · doi:10.1017/s0033291706008944 · Cited by 1,586 · cited 1×
“Given many of the EMIs included in the meta-analysis were predominately SA and unguided by a therapist, it is possible EMIs with therapist support would have yielded larger effect sizes.(43,44) Further, the EMIs included in the meta-analysis were on average briefer and less intensive than Internet-delivered cognitive…”
ResultHeron, K. E., & Smyth, J. M. (2010) · British Journal of Health Psychology · doi:10.1348/135910709x466063 · Cited by 1,438
Smartphones for smarter delivery of mental health programs: A systematic review
Donker, T., Petrie, K., Proudfoot, J., Clarke, J., Birch, M.-R., & Christensen, H. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2791 · Cited by 1,136 · cited 3×
“There have been a small number of reviews of studies on the effectiveness of EMIs for mental health problems.(8,19,20) However, to our knowledge there have been no comprehensive systematic reviews of the effectiveness of EMIs for anxiety conditions.”
BackgroundResultReducing Risks for Mental Disorders: Frontiers for Preventive Intervention Research
Novins, D. K. (1995) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199503000-00028 · Cited by 1,076
Healthcare in the pocket: Mapping the space of mobile-phone health interventions
Klasnja, P., & Pratt, W. (2012) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2011.08.017 · Cited by 970
mHealth for mental health: Integrating smartphone technology in behavioral healthcare.
Luxton, D. D., McCann, R. A., Bush, N. E., Mishkind, M. C., & Reger, G. M. (2011) · Professional Psychology: Research and Practice · doi:10.1037/a0024485 · Cited by 809 · cited 1×
“However, many of the recent advances in smartphones have enabled the use of automated sensors and in-built cameras.(50) These features can be accessed through native operating system programming libraries, which can be used to develop smartphone applications (apps).”
BackgroundAlonso, J., Angermeyer, M. C., & Lépine, J. P. (2004) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0047.2004.00325.x · Cited by 758
Mapping mHealth research: a decade of evolution
Fiordelli, M., Diviani, N., & Schulz, P. J. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2430 · Cited by 570 · cited 2×
“These portable devices incorporate a specific operating system platform that enables greater computing power and extra network connectively to various electronic devices and the internet.(15,16) Furthermore, smartphone technologies can wirelessly connect to wearable sensors to detect changes in physiological factors (…”
BackgroundMartínez-Pérez, B., de la Torre-Díez, I., & López-Coronado, M. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2600 · Cited by 550
Non-communicable diseases must have greater priority, says WHO
Zarocostas, J. (2009) · BMJ · doi:10.1136/bmj.b2857 · Cited by 517
Newman, M. G., Szkodny, L. E., Llera, S. J., & Przeworski, A. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.09.008 · Cited by 480 · cited 5×
“There is also the potential for EMIs to improve outcomes when used as a stand-alone intervention, although a priori it might be anticipated that EMIs would be most effective when delivered as an adjunct to clinical care.(10) Carter et al.”
BackgroundInfluentialComputer‐Aided Psychotherapy for Anxiety Disorders: A Meta‐Analytic Review
Cuijpers, P., Marks, I. M., van Straten, A., Cavanagh, K., Gega, L., & Andersson, G. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070802694776 · Cited by 429
How to evaluate technologies for health behavior change in HCI research
Klasnja, P., Consolvo, S., & Pratt, W. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979396 · Cited by 414 · cited 1×
“For example, more research is needed to evaluate the effectiveness of specific Human-Computer Interaction mechanisms of smartphones and other portable devices in alleviating anxiety-related symptoms.(54) Overall, it is difficult to draw reliable conclusions on the effects of EMIs on reducing anxiety symptoms and stres…”
BackgroundThere’s an App for That: Content Analysis of Paid Health and Fitness Apps
West, J. H., Hall, P. C., Hanson, C. L., Barnes, M. D., Giraud-Carrier, C., & Barrett, J. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1977 · Cited by 314
Status and trends of mobile-health applications for iOS devices: A developer's perspective
Liu, C., Zhu, Q., Holroyd, K. A., & Seng, E. K. (2011) · Journal of Systems and Software · doi:10.1016/j.jss.2011.06.049 · Cited by 313
Wilhelm, F. H., & Grossman, P. (2010) · Biological Psychology · doi:10.1016/j.biopsycho.2010.01.017 · Cited by 307
Griffiths, K. M., Farrer, L., & Christensen, H. (2010) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2010.tb03685.x · Cited by 303
Self-citationPalmqvist, B., Carlbring, P., & Andersson, G. (2007) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1586/14737167.7.3.291 · Cited by 290 · cited 1×
“Given many of the EMIs included in the meta-analysis were predominately SA and unguided by a therapist, it is possible EMIs with therapist support would have yielded larger effect sizes.(43,44) Further, the EMIs included in the meta-analysis were on average briefer and less intensive than Internet-delivered cognitive…”
ResultProudfoot, J., Clarke, J., Birch, M.-R., Whitton, A. E., Parker, G., Manicavasagar, V., Harrison, V., Christensen, H., & Hadzi-Pavlovic, D. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-312 · Cited by 264 · cited 1×
“Proudfoot et al. (2013) 37 x x x - x ? x x x Lappalainen et al. (2013) 36 ?”
Reger, M. A., & Gahm, G. A. (2009) · Journal of Clinical Psychology · doi:10.1002/jclp.20536 · Cited by 234
Reid, S. C., Kauer, S. D., Hearps, S. J., Crooke, A. H., Khor, A. S., Sanci, L. A., & Patton, G. C. (2011) · BMC Family Practice · doi:10.1186/1471-2296-12-131 · Cited by 192 · cited 10×
“Seven studies examined adults (aged 18 and over), 33,36,37,39,40 and one study focused on adolescents to young adults (aged 14–24 years).(38) The remaining seven studies provided the average age of the sample but did not specify the age group targeted.”
BackgroundMethodInfluentialNewman, M. G., Kenardy, J., Herman, S., & Taylor, C. B. (1997) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.65.1.178 · Cited by 172
Kenardy, J. A., Dow, M. G. T., Johnston, D. W., Newman, M. G., Thomson, A., & Taylor, C. B. (2003) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.71.6.1068 · Cited by 157 · cited 14×
“The two panic disorder studies used the Mobility Inventory, the Agoraphobic Cognitions Questionnaire, the Fear Questionnaire, the Body Sensations Questionnaire, the Agoraphobia subscale, and the phobia subscales.(39,40) The social phobia trial used the Social Phobia Scale and Social Phobia and Anxiety Inventory.”
BackgroundMethodInfluentialSelf-help stress management training through mobile phones: An experience with oncology nurses
Villani, D., Grassi, A., Cognetta, C., Toniolo, D., Cipresso, P., & Riva, G. (2013) · Psychological Services · doi:10.1037/a0026459 · Cited by 129 · cited 1×
“? x - x - x x x Villani et al. (2013) 35 ?”
Technological adjuncts to increase adherence to therapy: A review
Clough, B. A., & Casey, L. M. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2011.03.006 · Cited by 125
Virtual Reality in the Treatment of Generalized Anxiety Disorders
Alessandra, G., Federica, P., Davide, A., Claudia, R., Andrea, G., & Giuseppe, R. (2010) · Studies in Health Technology and Informatics · doi:10.3233/978-1-60750-561-7-39 · Cited by 107
Mobile Heart Health: Project Highlight
Morris, M., & Guilak, F. (2009) · IEEE Pervasive Computing · doi:10.1109/mprv.2009.31 · Cited by 106
Effectiveness of cognitive behavioural therapy in primary health care: a review
Hoifodt, R. S., Strom, C., Kolstrup, N., Eisemann, M., & Waterloo, K. (2011) · Family Practice · doi:10.1093/fampra/cmr017 · Cited by 104
Computer-assisted cognitive behavioral group therapy for social phobia
Gruber, K., Moran, P. J., Roth, W. T., & Taylor, C. B. (2001) · Behavior Therapy · doi:10.1016/s0005-7894(01)80050-2 · Cited by 101
Online interventions for anxiety disorders
Christensen, H., Batterham, P., & Calear, A. (2014) · Current Opinion in Psychiatry · doi:10.1097/yco.0000000000000019 · Cited by 95
Lappalainen, P., Kaipainen, K., Lappalainen, R., Hoffrén, H., Myllymäki, T., Kinnunen, M.-L., Mattila, E., Happonen, A. P., Rusko, H., & Korhonen, I. (2013) · JMIR Research Protocols · doi:10.2196/resprot.2389 · Cited by 79
Newman, M. G., Przeworski, A., Consoli, A. J., & Taylor, C. B. (2014) · Psychotherapy · doi:10.1037/a0032519 · Cited by 71 · cited 8×
“There was little change in the pooled effect size after excluding data from the Newman et al.(31) study, which employed an active comparison group (pooled standardized effect size: 0.”
BackgroundMethodInfluentialExperience Sampling Methodology studies of depression: the state of the art
Telford, C., McCarthy-Jones, S., Corcoran, R., & Rowse, G. (2012) · Psychological Medicine · doi:10.1017/s0033291711002200 · Cited by 64
(2009) · BOA (University of Milano-Bicocca) · Cited by 59
(2011) · Europe PMC (PubMed Central) · Cited by 58
Mewton, L., Smith, J., Rossouw, P., & Andrews, G. (2014) · Psychology Research and Behavior Management · doi:10.2147/prbm.s40879 · Cited by 57
The Green Valley: The Use of Mobile Narratives for Reducing Stress in Commuters
Grassi, A., Gaggioli, A., & Riva, G. (2009) · CyberPsychology & Behavior · doi:10.1089/cpb.2008.0156 · Cited by 56
Ehrenreich, B., Righter, B., Rocke, D. A., Dixon, L., & Himelhoch, S. (2011) · Journal of Nervous & Mental Disease · doi:10.1097/nmd.0b013e3182349e90 · Cited by 53 · cited 7×
“40 No studies evaluated a universal or an indicated intervention nor used a simple EMI.”
BackgroundInfluentialAmbulatory assessment in panic disorder and specific phobia.
Alpers, G. W. (2009) · Psychological Assessment · doi:10.1037/a0017489 · Cited by 40 · cited 1×
“Regular ambulatory biofeedback devices have shown promise in the context of panic disorders, especially in directing an individual’s attention to physiological changes through continuous self-monitoring.(12) Additionally, hand-held computers such as PDAs and palmtop computers have enabled programmable capabilities for…”
BackgroundVirtual Reality on Mobile Phones to Reduce Anxiety in Outpatient Surgery
Mosso José, L., Alessandra, G., Gustavo, D. L. C., Tomas, O., Andrew, A., Dejanira, M., Nieto Jesus, J., & Giuseppe, R. (2009) · Studies in Health Technology and Informatics · doi:10.3233/978-1-58603-964-6-195 · Cited by 40
Harrison, A. M., & Goozee, R. (2014) · Journal of Mental Health · doi:10.3109/09638237.2013.869575 · Cited by 36
The clinical use of palmtop computers in the treatment of generalized anxiety disorder
Newman, M. G. (1999) · Cognitive and Behavioral Practice · doi:10.1016/s1077-7229(99)80080-7 · Cited by 29
Stress management using UMTS cellular phones: a controlled trial.
Riva, G., Preziosa, A., Grassi, A., & Villani, D. (2006) · PubMed · Cited by 27
Dumont, I. P., & Olson, A. L. (2012) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2012.03.110056 · Cited by 24
Managing exam stress using UMTS phones: the advantage of portable audio/video support.
Riva, G., Grassi, A., Villani, D., Gaggioli, A., & Preziosa, A. (2007) · PubMed · Cited by 24
Momentary Health Interventions: Where are We and Where are We Going?
Carter, B. L., Day, S. X., Cinciripini, & Wetter, D. W. (2007) · The Science of Real-Time Data Capture · doi:10.1093/oso/9780195178715.003.0015 · Cited by 13
Cited by
Philippe, T. J., Sikder, N., Jackson, A., Koblanski, M. E., Liow, E., Pilarinos, A., & Vasarhelyi, K. (2022) · JMIR Mental Health · doi:10.2196/35159 · Cited by 436
Van Ameringen, M., Turna, J., Khalesi, Z., Pullia, K., & Patterson, B. (2017) · Depression and Anxiety · doi:10.1002/da.22657 · Cited by 234
“These interventions aim to deliver interactive tools, when an immediate need (such as decreased mood or increased anxiety) is identified in real-time resultant of passive data collection (reviewed in Gee et al., 2016).”
BackgroundGoldberg, S. B., Lam, S. U., Simonsson, O., Torous, J., & Sun, S. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000002 · Cited by 237
“Gee (2016) [49] adults/ adolescents n/a ecological momentary interventions anxiety 6 Cochrane 8”
BackgroundEcological momentary interventions for mental health: A scoping review
Balaskas, A., Schueller, S. M., Cox, A. L., & Doherty, G. (2021) · PLOS ONE · doi:10.1371/journal.pone.0248152 · Cited by 235
“The selection of keywords for the search string related to mental health was informed by previous studies [5, 14, 15].”
MethodRauschenberg, C., Schick, A., Hirjak, D., Seidler, A., Paetzold, I., Apfelbacher, C., Riedel-Heller, S. G., & Reininghaus, U. (2021) · Journal of Medical Internet Research · doi:10.2196/23365 · Cited by 205
“While there is some initial evidence on the effectiveness of mHealth interventions to improve physical activity [90-95], stress appraisal [96,97], depression [26,96-100], anxiety [25,26,96,97], and alcohol and substance use [55,96,98,101-103], with small to medium effect sizes in all areas of…”
Background
Metadata
- Authors
- Loo Gee, B., Griffiths, K. M., & Gulliver, A.
- Affiliations
- National Institute for Mental Health Research, Research School of Population Health, Australian National University
- Australian National University (AU)
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2015-05-21
- Volume
- 23
- Issue
- 1
- Pages
- 221-229
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC7814930
- OpenAlex
- W1537141504
- Cited by
- 92
- References
- 65
- Citations by year
- 2026: 10 · 2025: 5 · 2024: 11 · 2023: 11 · 2022: 14 · 2021: 13 · 2020: 7 · 2019: 6 · 2018: 5 · 2017: 7 · 2016: 2 · 2015: 1
- FWCI
- 0.70
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- ANU Open Research (Australian National University) (submittedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- ecological momentary intervention, mobile health, anxiety, stress, generalized anxiety disorder, panic disorder, social anxiety disorder, self-monitoring, multimedia intervention
- MeSH terms
- Adolescent, Adult, Anxiety, Anxiety Disorders, Humans, Psychotherapy, Brief, Stress, Psychological, Panic Disorder, Telemedicine, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-27, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-27 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.