Current state and future directions of technology-based ecological momentary assessment and intervention for major depressive disorder: a systematic review
Open accessAbstract
Ecological momentary assessment (EMA) and ecological momentary intervention (EMI) are alternative approaches to retrospective self-reports and face-to-face treatments, and they make it possible to repeatedly assess patients in naturalistic settings and extend psychological support into real life. The increase in smartphone applications and the availability of low-cost wearable biosensors have further improved the potential of EMA and EMI, which, however, have not yet been applied in clinical practice. Here, we conducted a systematic review, using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, to explore the state of the art of technology-based EMA and EMI for major depressive disorder (MDD). A total of 33 articles were included (EMA = 26; EMI = 7). First, we provide a detailed analysis of the included studies from technical (sampling methods, duration, prompts), clinical (fields of application, adherence rates, dropouts, intervention effectiveness), and technological (adopted devices) perspectives. Then, we identify the advantages of using information and communications technologies (ICTs) to extend the potential of these approaches to the understanding, assessment, and intervention in depression. Furthermore, we point out the relevant issues that still need to be addressed within this field, and we discuss how EMA and EMI could benefit from the use of sensors and biosensors, along with recent advances in machine learning for affective modelling.
AI snapshot
Written from the paper’s full text.
TL;DR
This systematic review maps technology-based ecological momentary assessment (EMA) and ecological momentary intervention (EMI) for major depressive disorder (MDD), covering technical, clinical, and technological dimensions. It finds growing feasibility and preliminary efficacy, but limited clinical implementation, compliance challenges, and few EMI trials.
Key findings
- The review included 33 articles (EMA = 26; EMI = 7) per the abstract, though the Results section reports 32 EMA studies and 8 EMI studies.
- EMA compliance was generally encouraging: 16 studies reported >85% compliance, 5 reported 70–84%, and 4 reported 65%.
- Four EMIs were identified: Psymate, Mobylize, Help4Mood, and Medlink. Psymate was tested in 102 depressed patients in a three-arm RCT; Mobylize in 7 MDD patients; Help4Mood in 28 depressed patients randomized to Help4Mood or TAU; Medlink in 8 MDD patients.
- Psymate reduced depressive symptoms in the experimental group with maintenance at follow-up; Mobylize reduced depressive and anxiety symptoms but had low mood-prediction accuracy; Help4Mood showed reduced symptoms in both groups but greater clinical improvement in TAU; Medlink showed 84% medication adherence and significant depressive symptom decrease over 4 weeks.
Methods
- Systematic review following PRISMA guidelines, searching PubMed and Web of Science in March 2019 with a broad EMA/EMI/mHealth/depression string.
- Search produced 4,993 articles; after duplicate removal and title/abstract screening, 401 were retrieved, 40 papers selected, and 33 articles included.
- Inclusion required adults with primary current or past MDD using DSM/ICD criteria and hand-held technology-based EMA or EMI; paper-and-pencil diaries were excluded. EMA studies had no risk-of-bias assessment; EMI studies used the Downs and Black quality index.
Limitations
- The paper states that EMA/EMI are time-consuming, may be perceived as invasive, require repeated assessments over weeks, raise privacy concerns, and reduce experimental control because data are collected in naturalistic settings.
- The paper states there are no standard validated EMA item sets, compliance and dropout remain problematic, few EMIs exist, only two were tested in RCTs, and more high-quality trials are needed.
- Evident from the text: the abstract and Results report inconsistent included-study counts (33 vs. 32 EMA/8 EMI), and the search was limited to English-language publications in two databases as of March 2019.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 137 cited sources checked · 0 supported · 0 flagged
- Findingown data
Most selected EMA studies administered daily self-reports through a personal digital assistant or a smartphone.
“Most of the selected studies administered daily self-reports either through a personal digital assistant (PDA) or a smartphone.”
Quote in the paperNot a substantial claim - Findingcitation
When applying individual correction for lifestyle factors, the association of depression to cortisol and the ratio of α-amylase over cortisol was no longer significant.
“Similarly, when applying individual correction for lifestyle factors, the association of depression to cortisol and the ratio of α-amylase over cortisol was no longer significant, suggesting that generalization from groups does not always reflect the single individual.”
Quote in the paperNot a substantial claim - Findingcitation
A bidirectional association was found between positive and negative affect and daily cortisol levels.
“One study explored the impact of cortisol on affect, showing a bidirectional association between PA and NA and daily cortisol levels [45].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [45] Booij, S.H., Bos, E.H., de Jonge, P., and Oldehinkel, A.J. (2016). The temporal dynamics of cortisol and affective states in depressed and non-depressed individuals. Psychoneuroendocrinology. source
Not checked in the free run.
- Findingown data
None of the selected EMA studies adopted event-based sampling.
“Regarding our selected studies, none of them adopted event-based sampling.”
Quote in the paperNot a substantial claim - Findingcitation
Cortisol levels after awakening were different in depressed and healthy participants.
“Not only were cortisol levels after awakening different in depressed and healthy participants, but the impact of psychosocial variables on cortisol secretion was also dissimilar.”
Quote in the paperNot a substantial claim
- Findingown data
Some selected EMA studies collected self-reports for less than 3 days, especially in cortisol and sleep pattern research.
“Some studies collected self-reports for a brief time period (less than 3 days); this choice was especially observed in the field of cortisol and sleep pattern research.”
Quote in the paperNot a substantial claim - Findingown data
The duration of data collection in selected EMA studies showed great variability.
“The duration of the data collection showed great variability.”
Quote in the paperNot a substantial claim - Findingown data
The number of prompts in selected EMA studies varied from 1 to 20 prompts per day.
“The same high variability was observed in the number of prompts, which varied from 1 to 20 prompts per day.”
Quote in the paperNot a substantial claim - Findingcitation
High variability was observed among participants regarding the timing, direction, and sign of the association between affect and cortisol.
“Nevertheless, high variability was observed among participants regarding the timing, direction, and sign of this association.”
Quote in the paperNot a substantial claim - Findingown data
Only three selected studies adopted technological solutions that allowed collection of both self-reports and data from sensors and biosensors.
“Only three studies adopted different technological solutions that allowed them to collect both self-reports and data gathered from sensors and biosensors.”
Quote in the paperNot a substantial claim - Findingcitation
EMA assessments of depression, sleep quality, and anxiety were highly associated with the Hamilton Depression Rating Scale administered at baseline.
“EMA assessments of depression, sleep quality, and anxiety were highly associated with the Hamilton Depression Rating Scale (HAM-D), administered at baseline.”
Quote in the paperNot a substantial claim - Findingown data
Only three selected studies actually applied EMA to monitor clinically depressed patients.
“Unexpectedly, we could only retrieve three studies within this research field, i.e., studies that actually applied EMA to monitor clinically depressed patients.”
Quote in the paperSubstantial claim - Findingcitation
Symptoms were evaluated as more severe in daily EMA evaluations compared to retrospective PHQ-9 assessment.
“Symptoms were evaluated as more severe in daily EMA evaluations, compared to the retrospective PHQ-9 assessment.”
Quote in the paperSubstantial claim - Findingreasoning
The remaining five of the seven studies collecting physiological measures investigated associations of depressive symptoms with sleep/wake cycles and physical activity using actimetry sensors.
“The remaining five articles investigated the association of depressive symptoms with sleep/wake cycles [32,33,36] and physical activity [37,38] using actimetry sensors.”
Quote in the paperNot a substantial claim0 of 5 sources checked- cites [32] Kim, 2015, Covariation of Depressive Mood and Spontaneous Physical Activity in Major Depressive Disorder: Toward Continuous Monitoring of Depressive Mood, IEEE J. Biomed. Heal. Inform. source
Not checked in the free run.
- cites [33] Littlewood, D.L., Kyle, S.D., Carter, L.-A., Peters, S., Pratt, D., and Gooding, P. (2018). Short sleep duration and poor sleep quality predict next-day suicidal ideation: An ecological momentary assessment study. Psychol. Med. source
Not checked in the free run.
- cites [36] Booij, S.H., Bos, E.H., Bouwmans, M.E.J., Van Faassen, M., Kema, I.P., Oldehinkel, A.J., and De Jonge, P. (2015). Cortisol and α-amylase secretion patterns between and within depressed and non-depressed individuals. PLoS ONE. source
Not checked in the free run.
- cites [37] Stavrakakis, 2015, Temporal dynamics of physical activity and affect in depressed and nondepressed individuals, Health Psychol. source
Not checked in the free run.
- cites [38] Bouwmans, M.E.J., Oude Oosterik, N.A.M., Bos, E.H., de Groot, I.W., Oldehinkel, A.J., and de Jonge, P. (2018). The Temporal Order of Changes in Physical Activity and Subjective Sleep in Depressed Versus Nondepressed Individuals: Findings From the MOOVD Study. Behav. Sleep Med. source
Not checked in the free run.
- Findingcitation
Husky and colleagues found encouraging compliance and acceptance rates for a three-day computerized ambulatory monitoring among both MDD and BD patients.
“Husky and colleagues investigated the acceptability of a three-days computerized ambulatory monitoring on MDD and BD patients, showing encouraging compliance and acceptance rates among both samples.”
Quote in the paperNot a substantial claim - Findingcitation
Practice effects were observed in the Husky study, with faster response time over the course of the study.
“Practice effects were observed (faster response time over the course of the study), thus suggesting the importance of considering the potential effects of EMA duration on self-reports [39].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [39] Husky, M.M., Gindre, C., Mazure, C.M., Brebant, C., Nolen-Hoeksema, S., Sanacora, G., and Swendsen, J. (2010). Computerized ambulatory monitoring in mood disorders: Feasibility, compliance, and reactivity. Psychiatry Res. source
Not checked in the free run.
- Findingcitation
Two selected studies investigated recall bias by comparing EMA daily data to retrospective assessments.
“In the case of EMAs, two studies were carried out to investigate this bias, comparing EMA daily data to retrospective assessments.”
Quote in the paperNot a substantial claim - Findingcitation
A negative correlation between negative affect and heart rate variability was observed only in the control group.
“Interestingly, a negative correlation between NA and heart rate variability (HRV) was observed only in the control group, suggesting that constant NA may alter the normal interaction between affectivity and the autonomic nervous system [31].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [31] Conrad, A., Wilhelm, F.H., Roth, W.T., Spiegel, D., and Taylor, C.B. (2008). Circadian affective, cardiopulmonary, and cortisol variability in depressed and nondepressed individuals at risk for cardiovascular disease. J. Psychiatr. Res. source
Not checked in the free run.
- Findingown data
Six selected studies adopted EMA to explore sleep disturbances in depression.
“According to our search, six studies adopted an EMA to explore sleep disturbances in depression.”
Quote in the paperNot a substantial claim - Findingcitation
The impact of psychosocial variables on cortisol secretion was dissimilar between depressed and healthy participants.
“Not only were cortisol levels after awakening different in depressed and healthy participants, but the impact of psychosocial variables on cortisol secretion was also dissimilar.”
Quote in the paperNot a substantial claim - Findingcitation
Application use in the iHOPE study decreased significantly over the weeks, from 3.4 days per week to 0.4 days per week after 8 weeks.
“Nevertheless, application use decreased significantly over the weeks, from 3.4 days per week to 0.4 days per week after 8 weeks, highlighting the important issue of compliance in EMA assessments.”
Quote in the paperSubstantial claim - Findingown data
Among the selected EMA studies, only seven of 32 collected physiological measures in addition to self-reports.
“Among our selected studies, only seven of the 32 studies collected physiological measures in addition to self-reports.”
Quote in the paperSubstantial claim - Findingown data
Other selected EMA studies required longer assessment periods of one or two months, especially studies investigating physical activity and its association with depressive symptoms.
“Other studies required longer periods of assessment, where participants were involved for one or two months. This was especially true for studies investigating physical activity and its association with depressive symptoms.”
Quote in the paperNot a substantial claim - Findingcitation
When retrospectively recalled, both positive and negative affect were overestimated, regardless of diagnosis.
“When retrospectively recalled, both PA and NA were overestimated, regardless of the diagnosis.”
Quote in the paperNot a substantial claim - Findingown data
So far EMA has been applied to seven different fields in the study of MDD.
“As Table 4 shows, so far EMA has been applied to seven different fields.”
Quote in the paperNot a substantial claim - Findingown data
After applying inclusion criteria, 32 studies were retrieved that investigated and assessed MDD through a technology-based EMA.
“After applying the inclusion criteria, 32 studies were retrieved that investigated and assessed MDD through a technology-based EMA.”
Quote in the paperSubstantial claim - Findingreasoning
Fixed-time-point sampling was adopted especially by studies investigating the association between cortisol or melatonin and depression, when the assessed variable required greater temporal precision and accuracy.
“This latter approach was adopted especially by the studies that investigated the association between cortisol or melatonin and depression, i.e., when the assessed variable required greater temporal precision and accuracy.”
Quote in the paperNot a substantial claim - Findingown data
High subjective variability was revealed in the association between physical activity and mood in terms of strength, direction, and temporal aspects.
“However, the analysis also revealed high subjective variability in the association between physical activity and mood in terms of strength, direction, and temporal aspects.”
Quote in the paperNot a substantial claim - Findingcitation
The association between sleep quality and daily mood did not differ between depressed and healthy participants.
“This association did not differ between depressed and healthy participants.”
Quote in the paperNot a substantial claim - Findingnone given
In healthy participants, sleep disturbances only affected emotional reactivity to unpleasant events.
“However, in healthy participants, sleep disturbances only affected emotional reactivity to unpleasant events.”
Quote in the paperNot a substantial claim - Findingcitation
A statistical model with cross validity identified a significant association between higher intermittency of locomotor activity and worse mood ratings.
“Finally, Kim and colleagues developed a statistical model with cross validity that identified a significant association between higher intermittency of locomotor activity and worse mood ratings [32], suggesting the possibility of predicting patients’ moods through the analysis of momentary locomotor patterns.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [32] Kim, 2015, Covariation of Depressive Mood and Spontaneous Physical Activity in Major Depressive Disorder: Toward Continuous Monitoring of Depressive Mood, IEEE J. Biomed. Heal. Inform. source
Not checked in the free run.
- Findingreasoning
There was no evidence of a moderating role of depression in the association between sleep and affect.
“Surprisingly, there was no evidence of the moderating role of depression in the association between sleep and affect.”
Quote in the paperNot a substantial claim - Findingcitation
The increase in positive affect after physical exercise was greater in depressed patients.
“Notably, the increase in PA after physical exercise was greater in depressed patients, which is consistent with the ample evidence supporting behavioural activation in general, and physical activity in particular, for the treatment of depression.”
Quote in the paperNot a substantial claim - Findingcitation
Suicidal thoughts did not predict sleep patterns the following night.
“However, suicidal thoughts did not predict sleep patterns the following night.”
Quote in the paperNot a substantial claim - Findingcitation
Physical activity was associated with subsequent increased positive affect, regardless of diagnosis.
“Confirming these results, another study found that physical activity was associated with subsequent increased PA, regardless of the diagnosis [37].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [37] Stavrakakis, 2015, Temporal dynamics of physical activity and affect in depressed and nondepressed individuals, Health Psychol. source
Not checked in the free run.
- Findingcitation
Poor sleep quality, both subjective and objective, was associated with increased suicide ideations the following day.
“Poor sleep quality, both at subjective and objective levels, was associated with increased suicide ideations the following day.”
Quote in the paperNot a substantial claim - Findingnone given
No systematic review has explored technology-based EMA and EMI for MDD to date.
“Nevertheless, no systematic review has explored technology-based EMA and EMI for MDD to date.”
Quote in the paperNot a substantial claim - Findingcitation
Higher sleep quality was associated with higher positive affect in both healthy and depressed participants.
“As expected, higher sleep quality was associated with higher PA in both healthy and depressed participants.”
Quote in the paperNot a substantial claim - Findingown data
The selection process resulted in eight studies that administered an EMI to clinically depressed patients.
“The selection process resulted in eight studies that administered an EMI to clinically depressed patients.”
Quote in the paperSubstantial claim - Findingown data
Four different EMI interventions were identified: Psymate, Mobylize, Hel4Mood, and Medlink.
“In all, four different interventions were identified: Psymate, Mobylize, Hel4Mood, and Medlink.”
Quote in the paperNot a substantial claim - Findingreasoning
The gap between clinical practice and research is still quite wide, as revealed by the low number of studies that adopt EMA to assess and monitor patients for clinical purposes or implement EMA in clinical settings.
“the gap between clinical practice and research is still quite wide, as revealed by the low number of studies that adopt this approach to assess and monitor patients for clinical purposes or implement EMA in clinical settings”
Quote in the paperSubstantial claim - Findingown data
86% of Mobylize participants reported that the intervention was particularly helpful for identifying negative affect triggers and avoiding distressing and maladaptive behaviours.
“86% of the participants reported that the intervention was particularly helpful for identifying NA triggers and avoiding distressing and maladaptive behaviours”
Quote in the paperNot a substantial claim - Findingnone given
Widespread adoption of EMA for the investigation of depression has led to novel insights into emotion reactivity, cortisol patterns, or daily rumination.
“the widespread adoption of EMA for the investigation of depression has led to novel insights into different aspects of the disease, including emotion reactivity, cortisol patterns, or daily rumination”
Quote in the paperNot a substantial claim - Findingnone given
The signal-contingent design with prompt randomization or semi-randomization is the most widely adopted option for variables such as affect and symptom monitoring.
“the signal-contingent design with prompt randomization or semi-randomization is the most widely adopted option when dealing with variables, such as affect and symptom monitoring”
Quote in the paperNot a substantial claim - Findingown data
Our results highlight the existence of a small number of EMIs for depression.
“Our results also highlight the existence of a small number of EMIs for depression.”
Quote in the paperSubstantial claim - Interpretationreasoning
The HPA axis of depressed patients was no longer able to respond to the timing of the sleep-wake cycle, daily routines, and external social experiences.
“Consistently, the Hypothalamic–pituitary–adrenal (HPA) axis of depressed patients was no longer able to respond to the timing of the sleep-wake cycle, daily routines, and external social experiences.”
Quote in the paperNot a substantial claim - Premisecitation
Compared to healthy participants, clinically depressed patients showed higher negative affect instability.
“Compared to healthy participants, clinically depressed patients showed higher NA instability”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [50] Thompson, 2012, The everyday emotional experience of adults with major depressive disorder: Examining emotional instability, inertia, and reactivity, J. Abnorm. Psychol. source
Not checked in the free run.
- Premisecitation
In a smartphone diary study, only perseverative cognition was associated with health risk factors such as lower HRV, worse mood, and higher interference in daily functioning.
“only perseverative cognition was associated with health risk factors, such as lower HRV, worse mood, and higher”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [35] Ottaviani, C., Shahabi, L., Tarvainen, M., Cook, I., Abrams, M., and Shapiro, D. (2015). Cognitive, behavioral, and autonomic correlates of mind wandering and perseverative cognition in major depression. Front. Neurosci. source
Not checked in the free run.
- Premisecitation
Compared to the control group, clinically depressed individuals showed decreased positive affect and increased negative affect as a consequence of high rumination levels.
“Compared to the control group, clinically depressed individuals showed decreased PA and increased NA as a consequence of high rumination levels.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [53] Kircanski, 2018, The everyday dynamics of rumination and worry: Precipitant events and affective consequences, Cogn. Emot. source
Not checked in the free run.
- Premisecitation
In MDD and GAD, symptom severity and extensive comorbidity worsened rumination in response to stress.
“which were further worsened by symptom severity and extensive comorbidity”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [52] Ruscio, 2015, Rumination Predicts Heightened Responding to Stressful Life Events in Major Depressive Disorder and Generalized Anxiety Disorder, J. Abnorm. Psychol. source
Not checked in the free run.
- Premisecitation
Paper-and-pencil daily diaries were not very efficacious because of discomfort, low compliance, and low experimental control over backfilling.
“The first studies to use this approach adopted paper-and-pencil daily diaries, but the discomfort, low compliance, and low experimental control over backfilling made them not very efficacious [14].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [14] Stone, A.A., Shiffman, S., Atienza, A.A., and Nebeling, A. (2007). Historical roots and rationale of ecological momentary assessment (EMA). The Science of Real-Time Data Capture: Self-Reports in Health Research, Oxford University Press. source
Not checked in the free run.
- Premisecitation
Providing continuous feedback to patients has been shown to be a valuable therapeutic procedure.
“Because providing continuous feedback to patients has been shown to be a valuable therapeutic procedure [29], we also included studies that adopted EMA-based feedback as a therapeutic tool for clinically depressed patients.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [29] Delgadillo, J., de Jong, K., Lucock, M., Lutz, W., Rubel, J., Gilbody, S., Ali, S., Aguirre, E., Appleton, M., and Nevin, J. (2018). Feedback-informed treatment versus usual psychological treatment for depression and anxiety: A multisite, open-label, cluster randomised controlled trial. Lancet Psychiatry. source
Not checked in the free run.
- Premisecitation
Traditional clinical assessments based on retrospective self-reports are not able to capture MDD dynamics, such as symptom fluctuations or mood shifts over time.
“Nevertheless, increasing evidence shows that these tools are not able to capture MDD dynamics, such as symptom fluctuations or mood shifts over time [6,7].”
Quote in the paperSubstantial claim0 of 2 sources checked - Premisecitation
In clinically depressed individuals, rumination was associated with increased alpha signal in the bilateral prefrontal cortex, indicating decreased neural activation.
“Rumination was found to be associated with an increased alpha signal in the bilateral prefrontal cortex (i.e., decreased neural activation)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [51] Putnam, K.M., and McSweeney, L.B. (2008). Depressive symptoms and baseline prefrontal EEG alpha activity: A study utilizing Ecological Momentary Assessment. Biol. Psychol. source
Not checked in the free run.
- Premisecitation
In both MDD and GAD clinical samples, rumination levels were higher in response to stressful situations.
“Both clinical samples showed higher levels of rumination in response to stressful situations”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [52] Ruscio, 2015, Rumination Predicts Heightened Responding to Stressful Life Events in Major Depressive Disorder and Generalized Anxiety Disorder, J. Abnorm. Psychol. source
Not checked in the free run.
- Premisecitation
No differences in positive affect instability were observed between clinically depressed patients and healthy participants.
“whereas no differences in PA instability were observed”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [50] Thompson, 2012, The everyday emotional experience of adults with major depressive disorder: Examining emotional instability, inertia, and reactivity, J. Abnorm. Psychol. source
Not checked in the free run.
- Premisecitation
In daily life, rumination was significantly higher in response to significant events.
“rumination was significantly higher in response to these circumstances”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [53] Kircanski, 2018, The everyday dynamics of rumination and worry: Precipitant events and affective consequences, Cogn. Emot. source
Not checked in the free run.
- Premisecitation
In daily life, worry levels were not significantly associated with the occurrence of significant events.
“levels of worry were not significantly associated with the occurrence of significant events”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [53] Kircanski, 2018, The everyday dynamics of rumination and worry: Precipitant events and affective consequences, Cogn. Emot. source
Not checked in the free run.
- Premisecitation
Rumination significantly mediated the impact of stress on symptoms and affect in MDD and GAD.
“rumination significantly mediated the impact of stress on symptoms and affect”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [52] Ruscio, 2015, Rumination Predicts Heightened Responding to Stressful Life Events in Major Depressive Disorder and Generalized Anxiety Disorder, J. Abnorm. Psychol. source
Not checked in the free run.
- Premisecitation
Smartphone embedded sensors make it possible to indirectly collect data about patients' behaviours and habits, such as social media use, physical activity, or social interactions.
“Unobtrusive wearable biosensors can continuously monitor physiological parameters throughout the day with high precision [17], whereas smartphone embedded sensors make it possible to indirectly collect data about patients’ behaviours and habits, such as their social media use, physical activity, or social interactions [18,19].”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [18] Mohr, 2017, Personal Sensing: Understanding Mental Health Using Ubiquitous Sensors and Machine Learning, Annu. Rev. Clin. Psychol. source
Not checked in the free run.
- cites [19] Henriques, 2017, ULTEMAT: A mobile framework for smart ecological momentary assessments and interventions, Internet Interv. source
Not checked in the free run.
- Premisecitation
Unobtrusive wearable biosensors can continuously monitor physiological parameters throughout the day with high precision.
“Unobtrusive wearable biosensors can continuously monitor physiological parameters throughout the day with high precision [17], whereas smartphone embedded sensors make it possible to indirectly collect data about patients’ behaviours and habits, such as their social media use, physical activity, or social interactions [18,19].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [17] Marzano, 2015, The application of mHealth to mental health: Opportunities and challenges, Lancet Psychiatry source
Not checked in the free run.
- Premisecitation
Use of Psymate was associated with increased levels of perceived empowerment, regardless of the presence of weekly feedback.
“the use of Psymate was associated with increased levels of perceived empowerment, regardless of the presence of weekly feedback”
Quote in the paperNot a substantial claim0 of 4 sources checked- cites [62] Kramer, 2014, A therapeutic application of the experience sampling method in the treatment of depression: A randomized controlled trial, World Psychiatry source
Not checked in the free run.
- cites [63] Simons, C.J.P., Hartmann, J.A., Kramer, I., Menne-Lothmann, C., Höhn, P., van Bemmel, A.L., Myin-Germeys, I., Delespaul, P., van Os, J., and Wichers, M. (2015). Effects of momentary self-monitoring on empowerment in a randomized controlled trial in patients with depression. Eur. Psychiatry. source
Not checked in the free run.
- cites [64] Hartmann, J.A., Wichers, M., Menne-Lothmann, C., Kramer, I., Viechtbauer, W., Peeters, F., Schruers, K.R.J., Van Bemmel, A.L., Myin-Germeys, I., and Delespaul, P. (2015). Experience sampling-based personalized feedback and Positive affect: A randomized controlled trial in depressed patients. PLoS ONE, 10. source
Not checked in the free run.
- cites [67] Snippe, 2016, Change in daily life behaviors and depression: Within-person and between-person associations, Health Psychol. source
Not checked in the free run.
- Premisecitation
Another study confirmed a greater reduction in negative affect following positive events in depressed individuals.
“These results were confirmed by another study that showed a greater reduction in NA following positive events in depressed individuals”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [55] Bylsma, L.M., Taylor-Clift, A., and Rottenberg, J. (2011). Emotional reactivity to daily events in major and minor depression. J. Abnorm. Psychol. source
Not checked in the free run.
- Premisecitation
Higher levels of sadness and arousal were associated with higher rates of gambling desire in depressed individuals.
“Higher levels of sadness and arousal were associated with higher rates of gambling desire.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [59] Quilty, L.C., Watson, C., Toneatto, T., and Bagby, R.M. (2017). A Prospective Investigation of Affect, the Desire to Gamble, Gambling Motivations and Gambling Behavior in the Mood Disorders. J. Gambl. Stud. source
Not checked in the free run.
- Premisecitation
Decreased depressive symptoms were associated with increased positive daily behaviours.
“Decreased depressive symptoms were also associated with increased positive daily behaviours.”
Quote in the paperNot a substantial claim0 of 4 sources checked- cites [62] Kramer, 2014, A therapeutic application of the experience sampling method in the treatment of depression: A randomized controlled trial, World Psychiatry source
Not checked in the free run.
- cites [63] Simons, C.J.P., Hartmann, J.A., Kramer, I., Menne-Lothmann, C., Höhn, P., van Bemmel, A.L., Myin-Germeys, I., Delespaul, P., van Os, J., and Wichers, M. (2015). Effects of momentary self-monitoring on empowerment in a randomized controlled trial in patients with depression. Eur. Psychiatry. source
Not checked in the free run.
- cites [64] Hartmann, J.A., Wichers, M., Menne-Lothmann, C., Kramer, I., Viechtbauer, W., Peeters, F., Schruers, K.R.J., Van Bemmel, A.L., Myin-Germeys, I., and Delespaul, P. (2015). Experience sampling-based personalized feedback and Positive affect: A randomized controlled trial in depressed patients. PLoS ONE, 10. source
Not checked in the free run.
- cites [67] Snippe, 2016, Change in daily life behaviors and depression: Within-person and between-person associations, Health Psychol. source
Not checked in the free run.
- Premisecitation
Use of Psymate was associated with increased experienced positive affect throughout treatment.
“and with increased experienced PA throughout the treatment”
Quote in the paperNot a substantial claim0 of 4 sources checked- cites [62] Kramer, 2014, A therapeutic application of the experience sampling method in the treatment of depression: A randomized controlled trial, World Psychiatry source
Not checked in the free run.
- cites [63] Simons, C.J.P., Hartmann, J.A., Kramer, I., Menne-Lothmann, C., Höhn, P., van Bemmel, A.L., Myin-Germeys, I., Delespaul, P., van Os, J., and Wichers, M. (2015). Effects of momentary self-monitoring on empowerment in a randomized controlled trial in patients with depression. Eur. Psychiatry. source
Not checked in the free run.
- cites [64] Hartmann, J.A., Wichers, M., Menne-Lothmann, C., Kramer, I., Viechtbauer, W., Peeters, F., Schruers, K.R.J., Van Bemmel, A.L., Myin-Germeys, I., and Delespaul, P. (2015). Experience sampling-based personalized feedback and Positive affect: A randomized controlled trial in depressed patients. PLoS ONE, 10. source
Not checked in the free run.
- cites [67] Snippe, 2016, Change in daily life behaviors and depression: Within-person and between-person associations, Health Psychol. source
Not checked in the free run.
- Premisecitation
Depressed participants were likely to perform gambling behaviours to increase current positive affect levels.
“depressed participants were also likely to perform gambling behaviours to increase their current PA levels”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [59] Quilty, L.C., Watson, C., Toneatto, T., and Bagby, R.M. (2017). A Prospective Investigation of Affect, the Desire to Gamble, Gambling Motivations and Gambling Behavior in the Mood Disorders. J. Gambl. Stud. source
Not checked in the free run.
- Premisecitation
High levels of hostility predicted rejection and disagreements.
“High levels of hostility predicted rejection and disagreements”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [58] Hepp, J., Lane, S.P., Carpenter, R.W., Niedtfeld, I., Brown, W.C., and Trull, T.J. (2017). Interpersonal Problems and Negative Affect in Borderline Personality and Depressive Disorders in Daily Life. Clin. Psychol. Sci. source
Not checked in the free run.
- Premisecitation
Positive and negative mood were the most representative variables of patients' core symptoms in network models of depression and anxiety.
“Positive (positive, content, enthusiastic, energetic) and negative (down) mood were the most representative variables of patients’ core symptoms.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [60] Fisher, A.J., Reeves, J.W., Lawyer, G., Medaglia, J.D., and Rubel, J.A. (2017). Exploring the idiographic dynamics of mood and anxiety via network analysis. J. Abnorm. Psychol. source
Not checked in the free run.
- Premisecitation
No association between mental imagery and affective reactivity was observed.
“no association between mental imagery and affective reactivity was observed”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [57] Slofstra, 2018, Exploring the relation between visual mental imagery and affect in the daily life of previously depressed and never depressed individuals, Cogn. Emot. source
Not checked in the free run.
- Premisecitation
Imagery-based processing was associated with better mood, regardless of the valence of the mental representation.
“Imagery-based processing was associated with better mood, regardless of the valence of the mental representation.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [57] Slofstra, 2018, Exploring the relation between visual mental imagery and affect in the daily life of previously depressed and never depressed individuals, Cogn. Emot. source
Not checked in the free run.
- Premisecitation
The relationships between interpersonal events and affect were stronger in BPD patients than in depressed participants.
“The aforementioned relationships were stronger in BPD patients than in depressed participants.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [58] Hepp, J., Lane, S.P., Carpenter, R.W., Niedtfeld, I., Brown, W.C., and Trull, T.J. (2017). Interpersonal Problems and Negative Affect in Borderline Personality and Depressive Disorders in Daily Life. Clin. Psychol. Sci. source
Not checked in the free run.
- Study design and conductcitation
Psymate was tested in a sample of 102 clinically depressed patients in a three-arm randomized controlled trial.
“Psymate was tested in a sample of 102 clinically depressed patients in a three-arm randomized controlled trial”
Quote in the paperNot a substantial claim0 of 4 sources checked- cites [62] Kramer, 2014, A therapeutic application of the experience sampling method in the treatment of depression: A randomized controlled trial, World Psychiatry source
Not checked in the free run.
- cites [63] Simons, C.J.P., Hartmann, J.A., Kramer, I., Menne-Lothmann, C., Höhn, P., van Bemmel, A.L., Myin-Germeys, I., Delespaul, P., van Os, J., and Wichers, M. (2015). Effects of momentary self-monitoring on empowerment in a randomized controlled trial in patients with depression. Eur. Psychiatry. source
Not checked in the free run.
- cites [64] Hartmann, J.A., Wichers, M., Menne-Lothmann, C., Kramer, I., Viechtbauer, W., Peeters, F., Schruers, K.R.J., Van Bemmel, A.L., Myin-Germeys, I., and Delespaul, P. (2015). Experience sampling-based personalized feedback and Positive affect: A randomized controlled trial in depressed patients. PLoS ONE, 10. source
Not checked in the free run.
- cites [67] Snippe, 2016, Change in daily life behaviors and depression: Within-person and between-person associations, Health Psychol. source
Not checked in the free run.
- Interpretationreasoning
Psymate does not meet all criteria for an EMI because EMA-feedbacks are provided during weekly face-to-face sessions.
“Psymate does not meet all the criteria for an EMI, as EMA-feedbacks are provided during weekly face-to-face sessions.”
Quote in the paperSubstantial claim - Premisecitation
Momentary and daily negative interpersonal events triggered higher negative affect (fear, hostility, sadness) in both MDD and BPD patients.
“momentary and daily negative interpersonal events triggered higher NA (fear, hostility, and sadness) in both groups”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [58] Hepp, J., Lane, S.P., Carpenter, R.W., Niedtfeld, I., Brown, W.C., and Trull, T.J. (2017). Interpersonal Problems and Negative Affect in Borderline Personality and Depressive Disorders in Daily Life. Clin. Psychol. Sci. source
Not checked in the free run.
- Premisecitation
In contemporaneous and temporal network models, worried and down did not show temporal influence.
“While “worried” and “down” did not show temporal influence”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [60] Fisher, A.J., Reeves, J.W., Lawyer, G., Medaglia, J.D., and Rubel, J.A. (2017). Exploring the idiographic dynamics of mood and anxiety via network analysis. J. Abnorm. Psychol. source
Not checked in the free run.
- Premisecitation
Momentary affect did not predict actual gambling behaviours in depressed individuals.
“momentary affect did not predict actual gambling behaviours”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [59] Quilty, L.C., Watson, C., Toneatto, T., and Bagby, R.M. (2017). A Prospective Investigation of Affect, the Desire to Gamble, Gambling Motivations and Gambling Behavior in the Mood Disorders. J. Gambl. Stud. source
Not checked in the free run.
- Premisecitation
Both depressed and healthy samples reported increased negative affect after a negative event.
“Both samples reported increased NA after a negative event”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [50] Thompson, 2012, The everyday emotional experience of adults with major depressive disorder: Examining emotional instability, inertia, and reactivity, J. Abnorm. Psychol. source
Not checked in the free run.
- Premisecitation
Positive mood, hopelessness, anger, and irritability were the strongest drivers of moment-to-moment symptomatology.
““positive mood”, “hopelessness”, “anger”, and “irritability” were the strongest drivers of moment-to-moment symptomatology”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [60] Fisher, A.J., Reeves, J.W., Lawyer, G., Medaglia, J.D., and Rubel, J.A. (2017). Exploring the idiographic dynamics of mood and anxiety via network analysis. J. Abnorm. Psychol. source
Not checked in the free run.
- Premisecitation
The association between imagery-based processing and better mood was similar in healthy and depressed participants.
“This pattern was similar in healthy and depressed participants.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [57] Slofstra, 2018, Exploring the relation between visual mental imagery and affect in the daily life of previously depressed and never depressed individuals, Cogn. Emot. source
Not checked in the free run.
- Premisecitation
Depressive symptoms significantly decreased over 4 weeks in the Medlink study.
“depressive symptoms significantly decreased over the course of 4 weeks”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [65] Mohr, 2015, MedLink: A Mobile Intervention to Address Failure Points in the Treatment of Depression in General Medicine, Int. Conf. Pervasive Comput. Technol. Healthc.
Not checked in the free run.
- Study design and conductown data
Psymate participants answered 135.5 out of 180 prompts (75.3%).
“the number of answered prompts in both the experimental and pseudo-experimental groups was 135.5 out of 180 (75.3%)”
Quote in the paperNot a substantial claim - Interpretationreasoning
Unobtrusively monitoring behavioural, physiological, and cognitive/emotional factors in ecological settings through portable and wearable devices can provide new information about elusive psychological constructs.
“unobtrusively monitoring behavioural (i.e., sensors), physiological (i.e., biosensors), and cognitive/emotional (i.e., self-reports) factors in ecological settings collected through portable and wearable devices can provide new information about elusive psychological constructs”
Quote in the paperSubstantial claim - Interpretationcitation
Compared to paper and pencil daily diaries, electronic devices and especially smartphones could increase the six EMA advantages identified by Ebner-Premier.
“Compared to paper and pencil daily diaries, the use of electronic devices, and especially smartphones, could further increase the six EMA advantages identified by Ebner-Premier (Table 5) [16]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [16] Trull, 2009, Ecological momentary assessment of mood disorders and mood dysregulation, Psychol. Assess. source
Not checked in the free run.
- Premisecitation
Use of Mobylize! significantly reduced depressive symptoms on a self-rated PHQ-9 and a clinician-based QIDS-C.
“the use of Mobylize! significantly reduced depressive symptoms, both on a self-rated measure (PHQ-9) and a clinician-based evaluation (Quick Inventory of Depressive Symptomatology-Clinician Rating, QUIDS-C)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [61] Burns, M.N., Begale, M., Duffecy, J., Gergle, D., Karr, C.J., Giangrande, E., and Mohr, D.C. (2011). Harnessing context sensing to develop a mobile intervention for depression. J. Med. Internet Res., 13. source
Not checked in the free run.
- Interpretationnone given
Automation on mobile devices can provide greater control over backfilling and higher temporal precision in administration, planning, and randomization of prompts.
“The automation of the entire process directly on a mobile device, such as a smartphone, can provide greater control over backfilling and higher temporal precision in the administration, planning, and randomization of prompts”
Quote in the paperNot a substantial claim - Study design and conductcitation
A randomized controlled trial evaluated Help4Mood with 28 depressed patients randomized into Help4Mood and TAU.
“A randomized controlled trial was conducted to evaluate Help4Mood [66]. Twenty-eight depressed patients were recruited and randomized into two treatment groups: Help4Mood and TAU.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [66] Burton, 2016, Pilot randomised controlled trial of Help4Mood, an embodied virtual agent-based system to support treatment of depression, J. Telemed. Telecare source
Not checked in the free run.
- Premisecitation
Outcome measures BDI and QIDS-SR indicated reduced symptoms in both Help4Mood and TAU samples.
“Outcome measures, which included the Beck Depression Inventory (BDI) and Quick Inventory of Depressive Symptomatology—Self Report (QIDS-SR), indicated reduced symptoms in both samples.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [66] Burton, 2016, Pilot randomised controlled trial of Help4Mood, an embodied virtual agent-based system to support treatment of depression, J. Telemed. Telecare source
Not checked in the free run.
- Premisecitation
The accuracy of Mobylize!'s predictive model was low, especially for mood.
“the accuracy of the predictive model was low, especially for mood”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [61] Burns, M.N., Begale, M., Duffecy, J., Gergle, D., Karr, C.J., Giangrande, E., and Mohr, D.C. (2011). Harnessing context sensing to develop a mobile intervention for depression. J. Med. Internet Res., 13. source
Not checked in the free run.
- Premisecitation
At the end of Mobylize! treatment, participants were less likely to meet MDD diagnostic criteria.
“At the end of the treatment, participants were also less likely to meet MDD diagnostic criteria.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [61] Burns, M.N., Begale, M., Duffecy, J., Gergle, D., Karr, C.J., Giangrande, E., and Mohr, D.C. (2011). Harnessing context sensing to develop a mobile intervention for depression. J. Med. Internet Res., 13. source
Not checked in the free run.
- Study design and conductcitation
A preliminary study tested the efficacy of Medlink with 8 MDD patients.
“a preliminary study tested the efficacy of Medlink with 8 MDD patients”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [65] Mohr, 2015, MedLink: A Mobile Intervention to Address Failure Points in the Treatment of Depression in General Medicine, Int. Conf. Pervasive Comput. Technol. Healthc.
Not checked in the free run.
- Premisecitation
Regular Help4Mood users were more likely to obtain greater clinical improvement compared to users with low compliance.
“regular users were more likely to obtain greater clinical improvement compared to users with low compliance”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [66] Burton, 2016, Pilot randomised controlled trial of Help4Mood, an embodied virtual agent-based system to support treatment of depression, J. Telemed. Telecare source
Not checked in the free run.
- Premisecitation
People with serious mental and physical illnesses are interested in using applications for their health.
“and are interested in using applications for their health [26]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [26] Torous, J., Friedman, R., and Keshvan, M. (2014). Smartphone ownership and interest in mobile applications to monitor symptoms of mental health conditions. J. Med. Internet Res., 16. source
Not checked in the free run.
- Premisecitation
Ample evidence shows the dynamic nature of affective states and mood.
“ample evidence shows the dynamic nature of affective states and mood [75]”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [75] Kuppens, 2017, Emotion dynamics, Curr. Opin. Psychol. source
Not checked in the free run.
- Premisecitation
Mobylize! models predicting location, conversational state, and social interactions achieved higher accuracy between 60% and 90%.
“higher accuracy was achieved by models that predicted location, conversational state, and social interactions (accuracy between 60% and 90%)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [61] Burns, M.N., Begale, M., Duffecy, J., Gergle, D., Karr, C.J., Giangrande, E., and Mohr, D.C. (2011). Harnessing context sensing to develop a mobile intervention for depression. J. Med. Internet Res., 13. source
Not checked in the free run.
- Study design and conductown data
Mobylize answered prompts decreased from 15.3 in the first week to 4.8 in the last week due to technical difficulties and connectivity problems.
“The number of answered prompts drastically decreased throughout the treatment, from 15.3 in the first week to 4.8 in the last week, due to technical difficulties and connectivity problems.”
Quote in the paperNot a substantial claim - Premisecitation
Patients in the TAU group achieved greater clinical improvement compared to patients who used Help4Mood.
“patients in the TAU group achieved greater clinical improvement compared to patients who used the application”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [66] Burton, 2016, Pilot randomised controlled trial of Help4Mood, an embodied virtual agent-based system to support treatment of depression, J. Telemed. Telecare source
Not checked in the free run.
- Interpretationreasoning
Use of ICTs can offer additional possibilities for multimodal assessments with embedded sensors and wearable biosensors coordinated with self-reports.
“the use of ICTs can offer additional possibilities for multimodal assessments, with data supplied by embedded sensors and wearable unobstructed biosensors that can automatically be coordinated with the collection of self-reports”
Quote in the paperNot a substantial claim - Interpretationreasoning
By means of EMAs, a more accurate diagnostic process could be pursued.
“by means of EMAs, a more accurate diagnostic process could be pursued”
Quote in the paperSubstantial claim - Interpretationreasoning
Because EMA data are collected during everyday life in naturalistic environments, it is not possible to rule out the role of confounding variables.
“Because the data are collected during everyday life and in naturalistic environments, it becomes hard or even impossible to have complete control over the setting, and, therefore, it is not possible to rule out the role of confounding variables.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Physiological monitoring can be considered less obstructive to the patient's life because physiological data are recorded passively and do not require extra effort from the patient.
“It can be considered less obstructive to the patient’s life because physiological data are recorded passively and do not require extra effort from the patient.”
Quote in the paperNot a substantial claim - Premisecitation
Models can be automatically learned that continuously estimate the patient's affective state by extracting and analysing salient features of physiological signals.
“models can be automatically learned that continuously estimate the patient’s affective state by extracting and analysing salient features of physiological signals [86]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [86] Lisetti, 2004, Using noninvasive wearable computers to recognize human emotions from physiological signals, EURASIP J. Appl. Signal Process.
Not checked in the free run.
- Premisecitation
Patient-specific models can be automatically learned that continuously estimate the patient's affective state by extracting and analysing salient features of physiological signals.
“Consistently, patient-specific models can be automatically learned that continuously estimate the patient’s affective state by extracting and analysing salient features of physiological signals [86].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [86] Lisetti, 2004, Using noninvasive wearable computers to recognize human emotions from physiological signals, EURASIP J. Appl. Signal Process.
Not checked in the free run.
- Interpretationreasoning
It is now possible to infer and collect behavioural information without necessarily asking the person to report it.
“it is now possible to infer and collect behavioural information without necessarily asking the person to report it”
Quote in the paperSubstantial claim - Interpretationreasoning
This systematic review shows the emergence of ecological assessment and intervention as a promising avenue for clinical psychology.
“Overall, this systematic review clearly shows the emergence of ecological assessment and intervention as a promising avenue for clinical psychology.”
Quote in the paperSubstantial claim - Interpretationreasoning
Similar limitations and burning issues were evidenced for EMA and EMI applications, including the gap between the clinical and research field.
“However, similar limitations and burning issues were also evidenced, including the need for more high-quality trials, the gap between the clinical and research field, and the importance of making EMAs and EMIs as engaging and tailored as possible.”
Quote in the paperSubstantial claim
- May combine two claims. 70
- Classified as probably not a substantial claim. 45
- The quote only partly states this claim. 2
May combine two claims.
Findingnone givenPatient dropout in selected EMA studies was related to diagnosis change, subjective burden, technical problems, incomplete data, retrospective completion of the electronic diary, missed prompts, worsening of symptoms, or non-attendance at follow-up sessions.
“Patient dropout was related to diagnosis change, subjective burden, technical problems, incomplete data, retrospective completion of the electronic diary, missed prompts, worsening of symptoms, or non-attendance at follow-up sessions.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataMost selected EMA studies collected data using randomized or semi-randomized schemas, whereas nine studies prompted participants at fixed time points during the day.
“Most of the studies collected data using randomized or semi-randomized schemas, whereas nine studies prompted participants to note information at fixed time points during the day.”
Quote in the paperNot a substantial claimMay combine two claims.
FindingcitationDepression was associated with lower perceived sleep quality, which in turn affected negative emotional reactivity to both neutral and unpleasant events during the day.
“Through the daily administration of morning self-reports about sleep patterns, O’Leary et al. found that depression was associated with lower perceived sleep quality, which in turn affected negative emotional reactivity to both neutral and unpleasant events during the day [47].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [47] Small, 2017, Sleep quality in healthy and mood-disordered persons predicts daily life emotional reactivity, Cogn. Emot. source
Not checked in the free run.
May combine two claims.
FindingcitationA reduction in depressive symptoms was already observable one day after beginning pharmacological treatment, and symptoms on day 7 were predictive of treatment outcome.
“According to the results, a reduction in depressive symptoms was already observable one day after beginning the treatment, and symptoms on day 7 were predictive of treatment outcome.”
Quote in the paperNot a substantial claimMay combine two claims.
FindingcitationThe control group was more likely to exaggerate retrieval of positive affect rather than negative affect, but this trend was not observed in depressed patients.
“Interestingly, the control group was more likely to exaggerate the retrieval of PA rather than NA, but this trend was not observed in depressed patients.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataA few selected EMA studies did not report compliance information.
“A few studies did not report this information [35,40,41,42,51,57,60].”
Quote in the paperNot a substantial claim0 of 7 sources checked- cites [35] Ottaviani, C., Shahabi, L., Tarvainen, M., Cook, I., Abrams, M., and Shapiro, D. (2015). Cognitive, behavioral, and autonomic correlates of mind wandering and perseverative cognition in major depression. Front. Neurosci. source
Not checked in the free run.
- cites [40] Schaffer, A., Kreindler, D., Reis, C., and Levitt, A.J. (2013). Use of Mental Health Telemetry to Enhance Identification and Predictive Value of Early Changes During Augmentation Treatment of Major Depression. J. Clin. Psychopharmacol. source
Not checked in the free run.
- cites [41] Hung, 2016, Smartphone-based ecological momentary assessment for Chinese patients with depression: An exploratory study in Taiwan, Asian J. Psychiatr. source
Not checked in the free run.
- cites [42] Stetler, 2004, Uncoupling of social zeitgebers and diurnal cortisol secretion in clinical depression, Psychoneuroendocrinology source
Not checked in the free run.
- cites [51] Putnam, K.M., and McSweeney, L.B. (2008). Depressive symptoms and baseline prefrontal EEG alpha activity: A study utilizing Ecological Momentary Assessment. Biol. Psychol. source
Not checked in the free run.
- cites [57] Slofstra, 2018, Exploring the relation between visual mental imagery and affect in the daily life of previously depressed and never depressed individuals, Cogn. Emot. source
Not checked in the free run.
- cites [60] Fisher, A.J., Reeves, J.W., Lawyer, G., Medaglia, J.D., and Rubel, J.A. (2017). Exploring the idiographic dynamics of mood and anxiety via network analysis. J. Abnorm. Psychol. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
FindingcitationBooij et al. identified higher cortisol and α-amylase levels among depressed individuals.
“Booij et al. identified higher cortisol and α-amylase levels among depressed individuals [36].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [36] Booij, S.H., Bos, E.H., Bouwmans, M.E.J., Van Faassen, M., Kema, I.P., Oldehinkel, A.J., and De Jonge, P. (2015). Cortisol and α-amylase secretion patterns between and within depressed and non-depressed individuals. PLoS ONE. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenIn most selected EMA studies, participants could complete self-reports for a fixed time period after the prompt, ranging from a few minutes to a maximum of one hour.
“In most of the studies, participants could complete self-reports for a fixed time period after the prompt, ranging from a few minutes to a maximum of one hour.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenConrad and colleagues could not find cortisol differences between depressed and non-depressed participants.
“Nevertheless, Conrad and colleagues could not find cortisol differences between depressed and non-depressed participants.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataSixteen selected EMA studies reported compliance rates higher than 85%, five showed rates between 84% and 70%, and four collected 65% of the total possible answers.
“Sixteen studies reported compliance rates higher than 85%, five studies showed rates between 84% and 70%, and four studies collected 65% of the total possible answers.”
Quote in the paperNot a substantial claimMay combine two claims.
FindingcitationNegative affect was positively associated with cortisol 50% of the time, while the association between cortisol and positive affect was almost always negative.
“For instance, NA was positively associated with cortisol 50% of the time, while the association between cortisol and PA was almost always negative.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
FindingreasoningTwo selected EMA studies gave participants the possibility of postponing prompts to increase compliance.
“To increase compliance, two studies also gave participants the possibility of postponing prompts.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataA total of 33 articles were included in the systematic review, comprising 26 EMA studies and 7 EMI studies.
“A total of 33 articles were included (EMA = 26; EMI = 7).”
Quote in the paperNot a substantial claimMay combine two claims.
FindingcitationAmong remitted MDD patients, reduced cortisol levels throughout the day and a different interaction between affect and cortisol were observed despite remission.
“Finally, interesting outcomes were also observed among remitted MDD patients [44]. Despite remission, patients showed reduced cortisol levels throughout the day and a different interaction between affect and cortisol, thus suggesting a reduction in the HPA axis’ responsiveness as a potential marker of recurrent depression.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [44] Huffziger, 2013, Effects of mood and rumination on cortisol levels in daily life: An ambulatory assessment study in remitted depressed patients and healthy controls, Psychoneuroendocrinology source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
FindingcitationAccording to the model, a worsening of depressive mood was associated with increased intermittency of locomotor activity.
“According to their model, a worsening of depressive mood was associated with increased intermittency of locomotor activity.”
Quote in the paperNot a substantial claimMay combine two claims.
FindingcitationBoth healthy and depressed participants showed higher levels of positive affect following physical activity, but no decrease in negative affect.
“Both healthy and depressed participants showed higher levels of PA following physical activity, but no decrease in NA.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataAfter eliminating duplicates and first selection by titles and abstracts, 401 articles were retrieved.
“After eliminating duplicate papers, we made a first selection by reading titles and abstracts, and 401 articles were retrieved.”
Quote in the paperNot a substantial claimMay combine two claims.
FindingreasoningSleep quality affected daily mood, but not vice versa, because higher sleep quality was associated with increased positive affect and decreased negative affect the following day.
“Nevertheless, sleep quality affected daily mood, but not vice versa, because higher sleep quality was associated with increased PA and decreased NA the following day.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataThe search produced a total of 4993 articles.
“This search produced a total of 4993 articles.”
Quote in the paperNot a substantial claimMay combine two claims.
FindingcitationA bidirectional relationship was found between affect and fatigue, and melatonin: melatonin is associated with changes in affect and fatigue, and affect and fatigue are predictors of melatonin levels.
“A bidirectional relationship between affect and fatigue, and melatonin was pointed out: Melatonin is associated with changes in affect and fatigue; however, affect and fatigue are also predictors of melatonin levels.”
Quote in the paperNot a substantial claimMay combine two claims.
FindingcitationSleep duration affected next-day physical activity, but no difference between depressed and non-depressed individuals was observed.
“Similarly, sleep duration was found to affect next-day physical activity, but again, no difference between depressed and non-depressed individuals was observed [38].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [38] Bouwmans, M.E.J., Oude Oosterik, N.A.M., Bos, E.H., de Groot, I.W., Oldehinkel, A.J., and de Jonge, P. (2018). The Temporal Order of Changes in Physical Activity and Subjective Sleep in Depressed Versus Nondepressed Individuals: Findings From the MOOVD Study. Behav. Sleep Med. source
Not checked in the free run.
Classified as probably not a substantial claim.
Findingown dataAfter applying selection criteria, 40 papers were obtained.
“We finally selected publications by applying the selection criteria described in the following paragraph, obtaining 40 papers.”
Quote in the paperSubstantial claimMay combine two claims.
FindingcitationParticipants who did not show the association between affect/fatigue and melatonin were likely to report higher rates of depression, worse sleep quality, and lower energy expenditure.
“Participants that did not show this association were likely to report higher rates of depression, worse sleep quality, and lower energy expenditure.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataMedlink usability scores were encouraging for ease of use and learnability but low for perceived usefulness and satisfaction.
“participants reported encouraging scores for ease of use (mean = 5.7 ± 1.1) and learnability (mean = 6.1 ± 1.5), but low scores for perceived usefulness (mean = 4.6 ± 1.0) and satisfaction (mean = 4.8 ± 0.8)”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataHelp4Mood patients reported sometimes being bored by excessively long sessions and would have appreciated more psychoeducational material and a more tailored experience.
“patients reported sometimes being bored by excessively long sessions. They would have appreciated receiving more psychoeducational material and a more tailored experience”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataPsymate participants would have appreciated receiving more specific and practical advice related to EMA-based feedback.
“participants would have appreciated receiving more specific and practical advice related to the EMA-based feedback (3.2 ± 2.0)”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataPsymate EMA-derived feedback was highly appreciated and considered valuable.
“the feedback was highly appreciated (usefulness of feedback = 6.2 ± 0.7) and considered valuable (feedback to improve daily skills = 5.4 ± 1.1)”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataMedlink weekly psychoeducation lessons had encouraging ratings and were reported as the most interesting and useful parts of the application.
“encouraging ratings were observed for the weekly psychoeducation lessons (liking = 6.0 ± 1.1; ease of use = 6.6 ± 0.5; learnability = 6.6 ± 0.5; and usefulness = 5.8 ± 1.7), which were also reported to be the most interesting and useful parts of the application”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataMobylize satisfaction was rated 5.71 on a scale from 1 to 7.
“satisfaction with the application was rated as 5.71 on a scale from 1 to 7”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataPsymate participants did not find the number of daily prompts and the time needed to complete assessments stressful.
“The number of daily prompts and the time needed to complete assessments was not stressful (number of beeps per day = 3.1 ± 1.6; time to answer = 2.5 ± 1.5).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataCompliance and dropout rates showed encouraging results, with most studies reporting more than 70% adherence.
“We also reported compliance and dropout rates, which showed encouraging results, with most of the studies reporting more than 70% adherence.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataHelp4Mood participants were quite satisfied; most would use it in everyday life and suggest it to other patients.
“Participants involved in the Help4Mood study were quite satisfied with the application. Most of them would use it in everyday life and suggest it to other patients.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataPsymate participants found it very simple to use and provided clear instructions.
“participants found that Psymate was very simple to use and provided clear instructions (verbal instructions = 6.6 ± 0.7; written instructions = 6.5 ± 1.0; Psymate answers = 2.6 ± 1.5)”
Quote in the paperNot a substantial claimMay combine two claims.
Findingnone givenNo standard and validated sets of items have been developed for EMA protocols, raising the problem of context validity.
“To date, no standard and validated sets of items have been developed for EMA protocols, raising the problem of context validity.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataThe Help4Mood virtual agent was appreciated, but some participants perceived it as too cold, repetitive, and not sufficiently realistic.
“The idea of a virtual agent to guide participants in completing the assessments was appreciated; however, some participants perceived the agent as too cold, repetitive, and not sufficiently realistic.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataMedlink feedback interviews showed neutral comments regarding daily self-reports, perceived as not very useful, and contrasting opinions regarding feedback graphs.
“feedback interviews showed neutral comments regarding daily self-reports, that were perceived as not very useful; contrasting opinions were collected regarding feedback graphs”
Quote in the paperNot a substantial claimMay combine two claims.
Findingnone givenIn the current literature, only four ecological interventions have been developed, and only two of them were tested in a randomized-controlled trial.
“In the current literature, only four ecological interventions have been developed, and only two of them were tested in a randomized-controlled trial (RCT).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataOur review showed promising results in terms of patient satisfaction and clinical efficacy, further supporting the need for more efforts in this direction.
“Our review showed promising results in terms of patient satisfaction and clinical efficacy, further supporting the need for more efforts in this direction.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningThree EMI features were highly appreciated: visual feedback about daily assessments and self-monitoring of daily patterns; psychoeducational material on depression and its mechanisms; and continuous or periodic communication with a trained clinician.
“we were able to identify three EMI features that were highly appreciated: The possibility of receiving visual feedback about daily assessments and, therefore, self-monitoring of daily patterns; the availability of psychoeducational material on depression and its mechanisms; and the opportunity to have continuous or periodic communication with a trained clinician.”
Quote in the paperSubstantial claimMay combine two claims.
FindingcitationCompliance rates were sometimes not encouraging, and a major challenge is to encourage regular use of these technologies throughout the entire treatment process.
“compliance rates were sometimes not encouraging, and a major challenge is to encourage regular use of these technologies throughout the entire treatment process [79]”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [79] Saranummi, 2013, Moving the science of behavioral change into the 21st century: Part 2, IEEE Pulse source
Not checked in the free run.
May combine two claims.
Findingown dataMost EMAs were based only on self-reports, whereas more attempts to integrate information with data from sensors and biosensors were observed for EMIs.
“most of the EMAs were based only on self-reports, whereas more attempts to integrate this information with data gathered from sensors and biosensors were observed for EMIs”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationSeventy percent of people suffering from mental disorders do not receive adequate psychological treatment or reach complete clinical remission.
“According to statistics, 70% of people suffering from mental disorders do not receive adequate psychological treatment or reach complete clinical remission [20].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [20] Henderson, 2013, Mental illness stigma, help seeking, and public health programs, Am. J. Public Health source
Not checked in the free run.
May combine two claims.
PremisecitationSelf-reports are affected by recall bias, and depressed patients have been found to alter the content of past experiences when asked to retrieve them retrospectively.
“Likewise, self-reports are affected by recall bias. In other words, depressed patients have been found to alter the content of past experiences when asked to retrieve them retrospectively [8,9], judging symptoms as more severe [10] or increasing the elaboration of negative information [11].”
Quote in the paperSubstantial claim0 of 4 sources checked- cites [8] Ben-Zeev, D., Young, M.A., and Madsen, J.W. (2009). Retrospective recall of affect in clinically depressed individuals and controls. Cogn. Emot. source
Not checked in the free run.
- cites [9] Chamberlain, 2006, The neuropsychology of mood disorders, Curr. Psychiatry Rep. source
Not checked in the free run.
- cites [10] 1995, Self-rating procedures in the evaluation of antidepressants: Review of the literature and results of our studies, Psychopathology source
Not checked in the free run.
- cites [11] Gotlib, 2010, Cognition and Depression: Current Status and Future Directions, Annu. Rev. Clin. Psychol. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataRisk of bias of EMI studies was assessed by two independent reviewers.
“Differently, risk of bias of EMI studies was assessed by two independent reviewers (D.C and J.F.-Á.).”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationTwo prior reviews focused on EMAs for mood disorders, but most included studies were based on paper-and-pencil daily diaries, and the target population included adults and adolescents with bipolar disorder and borderline personality disorder.
“Although two reviews focused on EMAs for mood disorders [15,16], most of the included studies were based on paper-and-pencil daily diaries, and the target population included adults and adolescents with bipolar disorder (BD) and borderline personality disorder (BPD).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [15] Hogenelst, 2012, Mood disorders in everyday life: A systematic review of experience sampling and ecological momentary assessment studies, Clin. Psychol. Rev. source
Not checked in the free run.
- cites [16] Trull, 2009, Ecological momentary assessment of mood disorders and mood dysregulation, Psychol. Assess. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenStudies were independently selected by three different authors, who first analysed titles and abstracts and subsequently selected full papers meeting inclusion criteria, resolving disagreements through consensus.
“Studies were independently selected by three different authors (D.C., M.S., and J.F.-Á.), who first analysed titles and abstracts and subsequently selected the full papers that met the inclusion criteria, resolving disagreements through consensus.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningMobile technologies allow the shortcomings of traditional diaries to be overcome by eliminating manual data entry and increasing control on backfilling, thus obtaining more accurate data.
“On the one hand, mobile technologies allow the shortcomings of traditional diaries to be overcome by eliminating the need for manual data entry and by increasing control on backfilling, thus obtaining more accurate data.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationHigher rumination after a stressful event predicted greater negative affect and more maladaptive behaviours.
“higher rumination after a stressful event predicted greater NA and more maladaptive behaviours”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [52] Ruscio, 2015, Rumination Predicts Heightened Responding to Stressful Life Events in Major Depressive Disorder and Generalized Anxiety Disorder, J. Abnorm. Psychol. source
Not checked in the free run.
Classified as probably not a substantial claim.
Study design and conductreasoningNo risk of bias assessment was performed for the included EMA studies.
“No risk of bias assessment was therefore performed.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe hypothesis that mind wandering is not a maladaptive behaviour per se was confirmed.
“Confirming the hypothesis that mind wandering is not a maladaptive behaviour per se”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [35] Ottaviani, C., Shahabi, L., Tarvainen, M., Cook, I., Abrams, M., and Shapiro, D. (2015). Cognitive, behavioral, and autonomic correlates of mind wandering and perseverative cognition in major depression. Front. Neurosci. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationIn clinically depressed individuals, increased alpha signal in the right prefrontal cortex was positively correlated with higher self-esteem ratings.
“an increased alpha signal in the right prefrontal cortex was positively correlated with higher self-esteem ratings”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [51] Putnam, K.M., and McSweeney, L.B. (2008). Depressive symptoms and baseline prefrontal EEG alpha activity: A study utilizing Ecological Momentary Assessment. Biol. Psychol. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationPRISMA criteria were followed for the systematic review.
“Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) criteria [27] were followed.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [27] Moher, 2009, Preferred reporting items for systematic reviews and meta analyses: The Prisma Statement, PLoS Med. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningQuality assessment of EMI studies was assessed with the Downs and Black quality index.
“As both randomized and non-randomized controlled trials were included, quality assessment was assessed with the Downs and Black quality index [30].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [30] Downs, 1998, The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions, J. Epidemiol. Community Health source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationSadness was only a predictor of social rejection.
“sadness was only a predictor of social rejection”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [58] Hepp, J., Lane, S.P., Carpenter, R.W., Niedtfeld, I., Brown, W.C., and Trull, T.J. (2017). Interpersonal Problems and Negative Affect in Borderline Personality and Depressive Disorders in Daily Life. Clin. Psychol. Sci. source
Not checked in the free run.
The quote only partly states this claim.
Study design and conductcitationMobylize! was tested in a small pilot study with a sample of 7 MDD patients.
“Mobylize! was tested in a small pilot study with a sample of 7 MMD patients”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [61] Burns, M.N., Begale, M., Duffecy, J., Gergle, D., Karr, C.J., Giangrande, E., and Mohr, D.C. (2011). Harnessing context sensing to develop a mobile intervention for depression. J. Med. Internet Res., 13. source
Not checked in the free run.
May combine two claims.
PremisecitationParticipants in the pseudo-experimental condition reported decreased depressive symptoms in the first weeks of treatment, but this gain was not maintained across the weeks.
“Participants in the pseudo-experimental condition reported decreased depressive symptoms in the first weeks of the treatment, but this gain was not maintained across the weeks.”
Quote in the paperSubstantial claim0 of 4 sources checked- cites [62] Kramer, 2014, A therapeutic application of the experience sampling method in the treatment of depression: A randomized controlled trial, World Psychiatry source
Not checked in the free run.
- cites [63] Simons, C.J.P., Hartmann, J.A., Kramer, I., Menne-Lothmann, C., Höhn, P., van Bemmel, A.L., Myin-Germeys, I., Delespaul, P., van Os, J., and Wichers, M. (2015). Effects of momentary self-monitoring on empowerment in a randomized controlled trial in patients with depression. Eur. Psychiatry. source
Not checked in the free run.
- cites [64] Hartmann, J.A., Wichers, M., Menne-Lothmann, C., Kramer, I., Viechtbauer, W., Peeters, F., Schruers, K.R.J., Van Bemmel, A.L., Myin-Germeys, I., and Delespaul, P. (2015). Experience sampling-based personalized feedback and Positive affect: A randomized controlled trial in depressed patients. PLoS ONE, 10. source
Not checked in the free run.
- cites [67] Snippe, 2016, Change in daily life behaviors and depression: Within-person and between-person associations, Health Psychol. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationWomen and remitted patients evaluated daily events as more negative than men.
“women and remitted patients evaluated daily events as more negative than men”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [54] Husky, 2009, Past depression and gender interact to influence emotional reactivity to daily life stress, Cognit. Ther. Res. source
Not checked in the free run.
May combine two claims.
PremisecitationWith BPD comorbidity, depressed patients were less emotionally influenced by events and perceived themselves as less emotionally reactive.
“depressed patients were found to be less emotionally influenced by events, and to perceive themselves as less emotionally reactive”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [56] Kohling, 2015, Affective Instability and Reactivity in Depressed Patients With and Without Borderline Pathology, J. Personal. Disord.
Not checked in the free run.
May combine two claims.
PremisecitationPsymate produced a significant reduction in depressive symptoms in the experimental group that was maintained at follow-up.
“Results showed a significant reduction in depressive symptoms in the experimental group that was maintained in the follow-up assessment.”
Quote in the paperSubstantial claim0 of 4 sources checked- cites [62] Kramer, 2014, A therapeutic application of the experience sampling method in the treatment of depression: A randomized controlled trial, World Psychiatry source
Not checked in the free run.
- cites [63] Simons, C.J.P., Hartmann, J.A., Kramer, I., Menne-Lothmann, C., Höhn, P., van Bemmel, A.L., Myin-Germeys, I., Delespaul, P., van Os, J., and Wichers, M. (2015). Effects of momentary self-monitoring on empowerment in a randomized controlled trial in patients with depression. Eur. Psychiatry. source
Not checked in the free run.
- cites [64] Hartmann, J.A., Wichers, M., Menne-Lothmann, C., Kramer, I., Viechtbauer, W., Peeters, F., Schruers, K.R.J., Van Bemmel, A.L., Myin-Germeys, I., and Delespaul, P. (2015). Experience sampling-based personalized feedback and Positive affect: A randomized controlled trial in depressed patients. PLoS ONE, 10. source
Not checked in the free run.
- cites [67] Snippe, 2016, Change in daily life behaviors and depression: Within-person and between-person associations, Health Psychol. source
Not checked in the free run.
May combine two claims.
PremisecitationDepressed patients showed a greater decrease in negative affect and increase in positive affect after a positive event compared to healthy participants.
“depressed patients showed a greater decrease in NA and increase in PA after a positive event”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [50] Thompson, 2012, The everyday emotional experience of adults with major depressive disorder: Examining emotional instability, inertia, and reactivity, J. Abnorm. Psychol. source
Not checked in the free run.
May combine two claims.
PremisecitationWomen and remitted patients showed worse mood and higher emotional reactivity in response to daily stressors.
“they showed worse mood and higher emotional reactivity in response to daily stressors”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [54] Husky, 2009, Past depression and gender interact to influence emotional reactivity to daily life stress, Cognit. Ther. Res. source
Not checked in the free run.
May combine two claims.
PremisecitationAfter 6 weeks of self-monitoring, there was a significant improvement in negative emotions' differentiation and a close-to-significance improvement in positive emotions' differentiation, regardless of EMA-derived feedbacks.
“Widdershoven and colleagues observed a significant improvement in negative emotions’ differentiation and a close-to-significance improvement in positive emotions’ differentiation after 6-weeks of self-monitoring, regardless of EMA-derived feedbacks”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [68] Widdershoven, R.L.A., Wichers, M., Kuppens, P., Hartmann, J.A., Menne-Lothmann, C., Simons, C.J.P., and Bastiaansen, J.A. (2019). Effect of self-monitoring through experience sampling on emotion differentiation in depression. J. Affect. Disord. source
Not checked in the free run.
May combine two claims.
InterpretationreasoningUse of mobile devices reduces user effort in completing daily assessments and prevents errors by researchers and clinicians due to manual data entry.
“the use of mobile devices reduces the effort required of users in completing daily assessments and prevents errors by researchers and clinicians due to manual data entry”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataEleven out of 13 (84.6%) Help4Mood participants completed the protocol and were assessed at follow-up; one withdrew due to worsening mood.
“Eleven out of 13 (84.6%) participants completed the protocol and were assessed for the follow-up. One participant withdrew due to worsening mood.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationMedlink patients reported taking 84% of their medication, significantly higher than medication adherence rates reported in the literature.
“Patients reported taking 84% of their medication, which is significantly higher than medication adherence rates reported in the literature.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [65] Mohr, 2015, MedLink: A Mobile Intervention to Address Failure Points in the Treatment of Depression in General Medicine, Int. Conf. Pervasive Comput. Technol. Healthc.
Not checked in the free run.
May combine two claims.
InterpretationcitationContinuous monitoring of patients' symptoms would allow clinicians to monitor treatment efficacy over time, predict short-term mood changes, detect symptom worsening early, and create continuous communication between clinicians and patients.
“the continuous monitoring of patients’ symptoms would allow clinicians to monitor the efficacy of a treatment over time [76], predict short-term mood changes [77], detect symptoms’ worsening in an early stage [78], and create continuous communication between clinicians and patients”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [76] Boswell, J.F., Kraus, D.R., Miller, S.D., and Lambert, M.J. (2015). Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions. Psychother. Res. source
Not checked in the free run.
- cites [77] Mikus, 2018, Predicting short term mood developments among depressed patients using adherence and ecological momentary assessment data, Internet Interv. source
Not checked in the free run.
- cites [78] Nuij, C., van Ballegooijen, W., Ruwaard, J., de Beurs, D., Mokkenstorm, J., van Duijn, E., de Winter, R.F.P., O’Connor, R.C., Smit, J.H., and Riper, H. (2018). Smartphone-based safety planning and self-monitoring for suicidal patients: Rationale and study protocol of the CASPAR (Continuous Assessment for Suicide Prevention And Research) study. Internet Interv. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningSmartphones offer the possibility of providing real-time EMA-derived feedback as a therapeutic tool for self-monitoring and sending real-time alerts to clinicians.
“smartphones offer the possibility of providing real-time EMA-derived feedback that can be an important therapeutic tool for patients’ self-monitoring, in addition to the possibility of sending real-time alerts to clinicians in case of need”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningSmartphones have the potential of becoming global low-cost tools that can also be adopted in the clinical field.
“smartphones have the potential of becoming global low-cost tools that can also be adopted in the clinical field”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationCurrently, 2.32 billion people in the world use smartphones, and it has been estimated that by 2020, 70% of the world's population will own one.
“Currently, 2.32 billion people in the world use smartphones, and it has been estimated that, by 2020, 70% of the world’s population will own one [71].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [71] (2015). Ericsson Consumer Lab Eurupe Ericsson Mobility Report Appendix. Ericsson Mobil. Rep., 1–8.
Not checked in the free run.
May combine two claims.
PremisecitationIn a previous study, compliance was higher in EMA administered through a smartphone and when patients were prompted less than 8 times a day.
“In a previous study, we observed that compliance was higher in EMA administered through a smartphone and when patients were prompted less than 8 times a day [73].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [73] Colombo, D., Cipresso, P., Fernández Alvarez, J., Garcia Palacios, A., Riva, G., and Botella, C. (2018). An Overview of Factors Associated with Adherence and Dropout to Ecological Momentary Assessments in Depression. Annu. Rev. CyberTherapy Telemed., in press.
Not checked in the free run.
The quote only partly states this claim.
PremisecitationUse of Mobylize! significantly reduced anxiety symptoms measured with the GAD-7.
“as well as anxiety symptoms, measured with the Generalized Anxiety Disorder Scale (GAD-7)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [61] Burns, M.N., Begale, M., Duffecy, J., Gergle, D., Karr, C.J., Giangrande, E., and Mohr, D.C. (2011). Harnessing context sensing to develop a mobile intervention for depression. J. Med. Internet Res., 13. source
Not checked in the free run.
May combine two claims.
InterpretationcitationThe dynamics of affective states and mood greatly vary from person to person, so ideographic approaches may shed light upon the structure of individual symptom dynamics.
“these dynamics greatly vary from person to person, reasons for which ideographic approaches may shed light upon the structure of individual symptom dynamics [60]”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [60] Fisher, A.J., Reeves, J.W., Lawyer, G., Medaglia, J.D., and Rubel, J.A. (2017). Exploring the idiographic dynamics of mood and anxiety via network analysis. J. Abnorm. Psychol. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataNo dropouts were reported in Medlink.
“No dropouts were reported.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationPeople with serious mental and physical illnesses own and regularly use smartphones.
“people with serious mental and physical illnesses own and regularly use smartphones [72]”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [72] Davis, 2013, Mobile technologies among people with serious mental illness: Opportunities for future services, Adm. Policy Ment. Health source
Not checked in the free run.
May combine two claims.
Study design and conductown dataHelp4Mood use varied: two participants used the application for one or two days, three used it between 3 and 7 days, and the remaining six used it more than 10 times, approximately twice a week.
“Two participants used the application for one or two days, whereas three participants used it between 3 and 7 days. The remaining six participants used it more than 10 times, approximately twice a week.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataThroughout 8-week Mobylize treatment, mean log-ins to the mobile application was 7.9, approximately one per week.
“the mean number of log-ins to the mobile application was 7.9 (approximately one per week)”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataSeven out of eight Mobylize participants (87.5%) completed the intervention; the only dropout was caused by technical problems with the smartphone.
“Seven out of eight participants (87.5%) completed the intervention: The only dropout was caused by technical problems with the smartphone.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataMedlink participants entered the application approximately 17.4 times during the 4 weeks of data collection and answered 96% of the prompts.
“participants entered the Medlink application approximately 17.4 times during the 4 weeks of data collection and answered 96% of the prompts”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataMobylize completed lessons on the website was 4.8 out of 9 (53.3%).
“the number of completed lessons on the website was 4.8 out of 9 (53.3%)”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataMean Help4Mood use was 134 min.
“The mean use was 134 min.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataIn Psymate, 27 of 33 (81.9%) experimental and 32 of 36 (88.89%) pseudo-experimental participants completed the intervention.
“27 of the 33 participants (81.9%) allocated to the experimental group completed the intervention, whereas 32 out of 36 participants (88.89%) allocated to the pseudo-experimental group completed it.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataIn Medlink, seven out of nine users read psychoeducation lessons from the first and second week, whereas only half read the third and fourth lessons.
“Seven out of nine users read the psychoeducation lessons from the first and second week, whereas only half of them read the third and fourth lessons.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataPsymate participants completed 39.7 out of 50 pre-assessments (79.4%) and 23.7 out of 30 (79%) post-assessment observations.
“participants completed 39.7 out of 50 pre-assessments (79.4%) and 23.7 out of 30 (79%) post-assessment observations”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationThe scientific literature has mostly been based on studies conducted in laboratory settings, thus understudying the daily dynamics of psychopathology.
“the scientific literature has mostly been based on studies conducted in laboratory settings, thus understudying the daily dynamics of psychopathology [70]”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [70] Nilsen, 2013, Moving behavioral theories into the 21st century: Technological advancements for improving quality of life, IEEE Pulse source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenDepressed patients could be less likely to consistently complete daily assessments due to the intrinsic nature of the disease.
“Due to the intrinsic nature of the disease, depressed patients could be less likely to consistently complete daily assessments.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationThe hierarchical sensing model proposed by Mohr highlights the revolution that new sensors and biosensors can bring to mental health, making it possible to collect raw sensor data that can be converted into behavioural markers through machine learning and data mining.
“the hierarchical sensing model proposed by Mohr highlights the great revolution that new sensors and biosensors can bring to the field of mental health [85], making it possible to collect raw sensor data (i.e., the lower level of the hierarchy) that can be converted into “behavioural markers” through machine learning and data mining methods [18]”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [85] Miettunen, 2019, Mobile Phone and Wearable Sensor-Based mHealth Approaches for Psychiatric Disorders and Symptoms: Systematic Review, JMIR Ment. Health source
Not checked in the free run.
- cites [18] Mohr, 2017, Personal Sensing: Understanding Mental Health Using Ubiquitous Sensors and Machine Learning, Annu. Rev. Clin. Psychol. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenPeople might not be willing to share personal information in EMA/EMI.
“Moreover, people might not be willing to share personal information.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningIn terms of ecological validity, EMAs and EMIs may be advantageous for clinical purposes but disadvantageous for research aims, because they imply less experimental control.
“Finally, in terms of more ecological validity, they may be advantageous for clinical purposes, but disadvantageous for research aims, because they imply less experimental control.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationcitationThese physiological signals could provide an EMA and/or EMI platform with additional markers that more closely correlate to a person's affective state and can be used as input to analysis.
“These could provide an EMA and/or EMI platform with additional markers that more closely correlate to a person’s affective state, and that can be used as input to the analysis performed [61].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [61] Burns, M.N., Begale, M., Duffecy, J., Gergle, D., Karr, C.J., Giangrande, E., and Mohr, D.C. (2011). Harnessing context sensing to develop a mobile intervention for depression. J. Med. Internet Res., 13. source
Not checked in the free run.
Classified as probably not a substantial claim.
PremisecitationDue to the implementation of novel statistical procedures, a balance between research necessities and clinical utility could be achieved.
“Nevertheless, due to the implementation of novel statistical procedures, a balance between research necessities and clinical utility could be achieved [90].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [90] Lin, X., Mermelstein, R.J., and Hedeker, D. (2018). A 3-level Bayesian mixed effects location scale model with an application to ecological momentary assessment data. Stat. Med. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationRecent advances in sensor technologies have had an impact on applications for remote health, such as postoperative recovery, treatment for chronic patients, and monitoring of elderly individuals.
“Recent advances in sensor technologies have had an impact on applications for remote health [81], such as postoperative recovery [82], treatment for chronic patients [83], and monitoring of elderly individuals [84].”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [81] Majumder, S., Mondal, T., and Deen, M. (2017). Wearable Sensors for Remote Health Monitoring. Sensors, 17. source
Not checked in the free run.
- cites [82] Aziz, O., Atallah, L., Lo, B., ElHelw, M., Wang, L., Yang, G.Z., and Darzi, A. (2007). A pervasive body sensor network for measuring postoperative recovery at home. Surg. Innov. source
Not checked in the free run.
- cites [83] Patel, 2012, A review of wearable sensors and systems with application in rehabilitation, J. Neuroeng. Rehabil. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningSmartphone sensors increase potentially collectable information, allowing reconstruction of people's habits, sleep patterns, or social life using embedded sensors such as accelerometers, calls, SMS, social network data, or geolocation.
“Smartphone sensors further increase the potentially collectable information, allowing the reconstruction of people’s habits, sleep patterns, or social life by using embedded sensors, such as accelerometers, calls, short message service (SMS), social network data, or geolocation.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThe use of EMAs and EMIs is time-consuming and may be perceived as invasive by users.
“These approaches are time-consuming and may be perceived as invasive by users.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Premisenone givenWearable sensors and their associated sensors do not interfere with users' daily routines.
“and acoustic signals), and associated sensors do not interfere with users’ daily routines.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningPhysiological signals can now be recorded unobtrusively by means of smartwatches and chest bands.
“physiological signals can be nowadays recorded unobtrusively by means of, for example, smartwatches and chest bands”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Interpretationnone givenEMA protocols require patients to complete multiple assessments throughout a day and often last weeks.
“Patients are required to complete multiple assessments throughout a day, and protocols often last weeks.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Interpretationnone givenEDA and HRV do not involve recording sensitive information and associated sensors do not interfere with users' daily routines.
“They do not involve recording sensitive information (as opposed to, for example, cameras and acoustic signals), and associated sensors do not interfere with users’ daily routines.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationPredictive models that combine information from physiological and behavioural signals can automatically estimate the patient's future mood, stress level, and self-reported health one or a few days in advance.
“Alternatively, predictive models that combine information from physiological and behavioural signals to estimate the patient’s future mood, stress level, and self-reported health (one or a few days in advance) can be automatically inferred [89].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [89] Shen, 2015, Finding a Depression App: A Review and Content Analysis of the Depression App Marketplace, JMIR Mhealth Uhealth source
Not checked in the free run.
May combine two claims.
PremisecitationBehavioural signals are readily collectable with smartphone sensors, though they may lack the required specificity for mood recognition and prediction, as found by the Mobylize! study.
“several behavioural signals are readily collectable with the use of smartphone sensors, even though they may lack the required specificity for mood recognition and prediction, as found by the Mobylize! study [61]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [61] Burns, M.N., Begale, M., Duffecy, J., Gergle, D., Karr, C.J., Giangrande, E., and Mohr, D.C. (2011). Harnessing context sensing to develop a mobile intervention for depression. J. Med. Internet Res., 13. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningSeveral opportunities can be found in the integration of EMA and EMI platforms with behavioural and physiological signal processing, further mediated by machine learning algorithms.
“several opportunities can be found in the integration of EMA and EMI platforms with behavioural and physiological signal processing, further mediated by machine learning algorithms”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationThe relation between physiological signals and affective states is not trivial, and mixed results on it are discussed in the literature.
“Unfortunately, the relation between physiological signals and affective states is not trivial and mixed results are discussed in the literature [87].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [87] Choi, K.H., Kim, J., Kwon, O.S., Kim, M.J., Ryu, Y.H., and Park, J.E. (2017). Is heart rate variability (HRV) an adequate tool for evaluating human emotions? A focus on the use of the International Affective Picture System (IAPS). Psychiatry Res. source
Not checked in the free run.
May combine two claims.
PremisecitationPromising results have already been shown for the application of EMA and EMI to anxiety disorders and stress-related disorders, highlighting the potential of these tools to provide psychological support in daily life and to investigate symptom fluctuations across time.
“Still, promising results have been already shown also regarding the application of EMA and EMI to anxiety disorders [93,94] and stress-related disorders [95,96], highlighting the potential of these tools to provide psychological support in daily life and to investigate symptom fluctuations across time.”
Quote in the paperNot a substantial claim0 of 4 sources checked- cites [93] Walz, 2014, Experience sampling and ecological momentary assessment for studying the daily lives of patients with anxiety disorders: A systematic review, J. Anxiety Disord. source
Not checked in the free run.
- cites [94] Schueller, 2017, Ecological momentary interventions for depression and anxiety, Depress. Anxiety source
Not checked in the free run.
- cites [95] Yoshiuchi, 2008, Application of ecological momentary assessment in stress-related diseases, Biopsychosoc. Med. source
Not checked in the free run.
- cites [96] Gee, B.L., Griffiths, K.M., and Gulliver, A. (2016). Effectiveness of mobile technologies delivering Ecological Momentary Interventions for stress and anxiety: A systematic review. J. Am. Med. Inform. Assoc.
Not checked in the free run.
May combine two claims.
PremisecitationRecent studies obtained promising results for stress recognition via model personalisation and for mood prediction via deep learning, using a combination of behavioural and physiological markers in non-clinical populations.
“Building on recent advances of machine learning, recent studies obtained promising results by means of model personalisation for stress recognition [88] and deep learning for mood prediction [89] using a combination of behavioural and physiological markers in non-clinical populations.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [88] Kocielnik, R., Sidorova, N., Maggi, F.M., Ouwerkerk, M., and Westerink, J.H.D.M. (2013, January 20–22). Smart technologies for long-term stress monitoring at work. Proceedings of the CBMS 2013—26th IEEE International Symposium on Computer-Based Medical Systems, Porto, Portugal. source
Not checked in the free run.
- cites [89] Shen, 2015, Finding a Depression App: A Review and Content Analysis of the Depression App Marketplace, JMIR Mhealth Uhealth source
Not checked in the free run.
May combine two claims.
InterpretationreasoningThere is evidence showing the feasibility and preliminary efficacy of EMA and EMI approaches.
“Altogether, there is evidence showing the feasibility and preliminary efficacy of these approaches, but much more research should be conducted before drawing definite conclusions.”
Quote in the paperSubstantial claim
The paper relies on this without support.
Technology-based EMA and EMI have not yet been applied in clinical practice.
“The increase in smartphone applications and the availability of low-cost wearable biosensors have further improved the potential of EMA and EMI, which, however, have not yet been applied in clinical practice.”
The paper relies on this without support.
The findings from the included EMA and EMI studies are valid and comparable enough to support the review's conclusions about EMA and EMI for MDD.
“As pointed out in this review, the widespread adoption of EMA for the investigation of depression has led to novel insights into different aspects of the disease, including emotion reactivity, cortisol patterns, or daily rumination.”
The paper relies on this without support.
Electrodermal activity and heart rate variability are valid correlates of users' affective state.
“electrodermal activity (EDA) and heart rate variability (HRV) have been extensively investigated as correlates of users’ affective state, and they are considered non-invasive”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
EMA/EMI have shown good results in other psychological disorders, such as substance use, anxiety, and major depressive disorders.
“EMA/EMI have shown good results in other psychological disorders, such as substance use disorders (e.g., smoking cessation), anxiety disorders (e.g., social anxiety disorder, generalized anxiety disorder), and major depressive disorders (LaFreniere and Newman, 2016; Colombo et al., 2019; Linardon et al., 2019; Miralles et al., 2020).”
From Efficacy of an internet-based psychological intervention for problem gambling and gambling disorder: Study protocol for a randomized controlled trial (2021) · cites this paper as Colombo et al., 2019
The Discussion (page unavailable) reports promising results for EMA/EMI in major depressive disorder and says promising results have also been shown for anxiety disorders, while emphasizing that efficacy evidence is preliminary. This source does not report good EMA/EMI results for substance use disorders or smoking cessation, which are also included in the citing sentence. (LLM, conf=0.86)
Experimental — accuracy not yet measuredRecent reviews indicate that EMA is an acceptable and feasible data collection method in psychiatric samples.
“These reviews indicate that EMA is an acceptable and feasible data collection method in psychiatric samples as well”
From Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research (2022) · cites this paper as [11]
Adherence rates in this study are higher than in previous studies with a similar population, although those studies used different EMA methods (e.g., paper-and-pencil diaries, PDAs).
“Moreover, the adherence rates found in this study are even higher than in previous ones with a similar population, although these studies used different EMA methods (e.g., paper-and-pencil diaries, PDAs) [8,14,15].”
From Experienced burden of and adherence to smartphone-based ecological momentary assessment in persons with affective disorders (2020) · cites this paper as [15]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
EMA study count changes
MajorThe abstract reports 26 EMA articles, but the results report 32 EMA studies after applying the inclusion criteria.
“A total of 33 articles were included (EMA = 26; EMI = 7).”
“After applying the inclusion criteria, 32 studies were retrieved that investigated and assessed MDD through a technology-based EMA.”
Medlink participant count changes
MinorThe efficacy study is described as involving eight MDD patients, but the compliance section counts nine users.
“Finally, a preliminary study tested the efficacy of Medlink with 8 MDD patients [65].”
“Seven out of nine users read the psychoeducation lessons from the first and second week, whereas only half of them read the third and fourth lessons.”
EMI study count changes
MinorThe abstract reports seven EMI articles, but the results report eight EMI studies.
“A total of 33 articles were included (EMA = 26; EMI = 7).”
“The selection process resulted in eight studies that administered an EMI to clinically depressed patients.”
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823 · see citing works
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · see citing works
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859 · see citing works
Downs, S. H., & Black, N. (1998) · Journal of Epidemiology and Community Health · doi:10.1136/jech.52.6.377 · Cited by 8,252 · see citing works
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454 · see citing works
Validity and reliability of the Experience-Sampling Method
CSIKSZENTMIHALYI, M., & LARSON, R. (1987) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-198709000-00004 · Cited by 2,544 · see citing works
Cognition and Depression: Current Status and Future Directions
Gotlib, I. H., & Joormann, J. (2010) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.121208.131305 · Cited by 2,420 · see citing works
A review of wearable sensors and systems with application in rehabilitation
Patel, S., Park, H., Bonato, P., Chan, L., & Rodgers, M. (2012) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-9-21 · Cited by 2,396 · see citing works
Heron, K. E., & Smyth, J. M. (2010) · British Journal of Health Psychology · doi:10.1348/135910709x466063 · Cited by 1,438 · see citing works
Wearable Sensors for Remote Health Monitoring
Majumder, S., Mondal, T., & Deen, M. (2017) · Sensors · doi:10.3390/s17010130 · Cited by 1,375 · see citing works
Rebooting psychotherapy research and practice to reduce the burden of mental illness
Kazdin, A. E., & Blase, S. L. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393527 · Cited by 1,254 · see citing works
Smartphones for smarter delivery of mental health programs: A systematic review
Donker, T., Petrie, K., Proudfoot, J., Clarke, J., Birch, M.-R., & Christensen, H. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2791 · Cited by 1,136 · see citing works
Mental Illness Stigma, Help Seeking, and Public Health Programs
Henderson, C., Evans-Lacko, S., & Thornicroft, G. (2013) · American Journal of Public Health · doi:10.2105/ajph.2012.301056 · Cited by 959 · see citing works
Cuijpers, P., Donker, T., van Straten, A., Li, J., & Andersson, G. (2010) · Psychological Medicine · doi:10.1017/s0033291710000772 · Cited by 832 · see citing works
Personal Sensing: Understanding Mental Health Using Ubiquitous Sensors and Machine Learning
Mohr, D. C., Zhang, M., & Schueller, S. M. (2017) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032816-044949 · Cited by 802 · see citing works
Harnessing context sensing to develop a mobile intervention for depression
Burns, M. N., Begale, M., Duffecy, J., Gergle, D., Karr, C. J., Giangrande, E., & Mohr, D. C. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1838 · Cited by 646 · cited 5× · see citing works
“On the one hand, several behavioural signals are readily collectable with the use of smartphone sensors, even though they may lack the required specificity for mood recognition and prediction, as found by the Mobylize! study [61].”
BackgroundMethodInfluentialThe comorbidity of depression and substance use disorders
Swendsen, J. (2000) · Clinical Psychology Review · doi:10.1016/s0272-7358(99)00026-4 · Cited by 632 · see citing works
Ecological momentary assessment of mood disorders and mood dysregulation
Ebner-Priemer, U. W., & Trull, T. J. (2009) · Psychological Assessment · doi:10.1037/a0017075 · Cited by 530 · see citing works
Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions
Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2015) · Psychotherapy Research · doi:10.1080/10503307.2013.817696 · Cited by 494 · see citing works
The prevalence and impact of alcohol problems in major depression: A systematic review
Sullivan, L. E., Fiellin, D. A., & O’Connor, P. G. (2005) · The American Journal of Medicine · doi:10.1016/j.amjmed.2005.01.007 · Cited by 489 · see citing works
Impact of major depression on chronic medical illness
Katon, W., & Ciechanowski, P. (2002) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(02)00313-6 · Cited by 485 · see citing works
Mobile monitoring with wearable photoplethysmographic biosensors
Asada, H. H., Shaltis, P., Reisner, A., Rhee, S., & Hutchinson, R. C. (2003) · IEEE Engineering in Medicine and Biology Magazine · doi:10.1109/memb.2003.1213624 · Cited by 466 · see citing works
Using Noninvasive Wearable Computers to Recognize Human Emotions from Physiological Signals
Lisetti, C., & Nasoz, F. (2004) · EURASIP Journal on Advances in Signal Processing · doi:10.1155/s1110865704406192 · Cited by 432 · see citing works
Social and economic burden of mood disorders
Simon, G. E. (2003) · Biological Psychiatry · doi:10.1016/s0006-3223(03)00420-7 · Cited by 430 · see citing works
Karyotaki, E., Kleiboer, A., Smit, F., Turner, D. T., Pastor, A. M., Andersson, G., Berger, T., Botella, C., Breton, J. M., Carlbring, P., et al. (2015) · Psychological Medicine · doi:10.1017/s0033291715000665 · Cited by 408 · see citing works
Self-citationEmotional reactivity to daily events in major and minor depression.
Bylsma, L. M., Taylor-Clift, A., & Rottenberg, J. (2011) · Journal of Abnormal Psychology · doi:10.1037/a0021662 · Cited by 388 · see citing works
Exploring the idiographic dynamics of mood and anxiety via network analysis
Fisher, A. J., Reeves, J. W., Lawyer, G., Medaglia, J. D., & Rubel, J. A. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000311 · Cited by 385 · see citing works
Kuppens, P., & Verduyn, P. (2017) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2017.06.004 · Cited by 369 · see citing works
aan het Rot, M., Hogenelst, K., & Schoevers, R. A. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.05.007 · Cited by 325 · see citing works
Kramer, I., Simons, C. J. P., Hartmann, J. A., Menne-Lothmann, C., Viechtbauer, W., Peeters, F., Schruers, K., van Bemmel, A. L., Myin-Germeys, I., Delespaul, P., et al. (2014) · World Psychiatry · doi:10.1002/wps.20090 · Cited by 306 · see citing works
Diurnal mood variation in major depressive disorder
Peeters, F., Berkhof, J., Delespaul, P., Rottenberg, J., & Nicolson, N. A. (2006) · Emotion · doi:10.1037/1528-3542.6.3.383 · Cited by 306 · see citing works
Thompson, R. J., Mata, J., Jaeggi, S. M., Buschkuehl, M., Jonides, J., & Gotlib, I. H. (2012) · Journal of Abnormal Psychology · doi:10.1037/a0027978 · Cited by 292 · see citing works
Torous, J., Friedman, R., & Keshavan, M. (2014) · JMIR mHealth and uHealth · doi:10.2196/mhealth.2994 · Cited by 287 · see citing works
Finding a Depression App: A Review and Content Analysis of the Depression App Marketplace
Shen, N., Levitan, M.-J., Johnson, A., Bender, J. L., Hamilton-Page, M., Jadad, A. (. R., & Wiljer, D. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3713 · Cited by 282 · see citing works
Torous, J., Staples, P., Shanahan, M., Lin, C., Peck, P., Keshavan, M., & Onnela, J.-P. (2015) · JMIR Mental Health · doi:10.2196/mental.3889 · Cited by 258 · see citing works
Mobile technologies among people with serious mental illness: Opportunities for future services
Ben-Zeev, D., Davis, K. E., Kaiser, S., Krzsos, I., & Drake, R. E. (2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0424-x · Cited by 249 · see citing works
Ruscio, A. M., Gentes, E. L., Jones, J. D., Hallion, L. S., Coleman, E. S., & Swendsen, J. (2015) · Journal of Abnormal Psychology · doi:10.1037/abn0000025 · Cited by 228 · cited 2× · see citing works
“Ruscio and colleagues investigated the relationship between stressful events and rumination in MDD and GAD patients [52].”
BackgroundLittlewood, D. L., Kyle, S. D., Carter, L.-A., Peters, S., Pratt, D., & Gooding, P. (2019) · Psychological Medicine · doi:10.1017/s0033291718001009 · Cited by 209 · see citing works
Stetler, C., & Miller, G. E. (2005) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.114.4.697 · Cited by 200 · see citing works
The application of mHealth to mental health: opportunities and challenges
Marzano, L., Bardill, A., Fields, B., Herd, K., Veale, D., Grey, N., & Moran, P. (2015) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00268-0 · Cited by 200 · see citing works
Walz, L. C., Nauta, M. H., & aan het Rot, M. (2014) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2014.09.022 · Cited by 195 · cited 1× · see citing works
“Still, promising results have been already shown also regarding the application of EMA and EMI to anxiety disorders [93,94] and stress-related disorders [95,96], highlighting the potential of these tools to provide psychological support in daily life and to investigate symptom fluctuations across time.”
BackgroundBOWER, B., BYLSMA, L. M., MORRIS, B. H., & ROTTENBERG, J. (2010) · Journal of Sleep Research · doi:10.1111/j.1365-2869.2009.00816.x · Cited by 192 · see citing works
Gamification and Adherence to Web-Based Mental Health Interventions: A Systematic Review
Brown, M., O'Neill, N., van Woerden, H., Eslambolchilar, P., Jones, M., & John, A. (2016) · JMIR Mental Health · doi:10.2196/mental.5710 · Cited by 178 · see citing works
Ecological momentary interventions for depression and anxiety
Schueller, S. M., Aguilera, A., & Mohr, D. C. (2017) · Depression and Anxiety · doi:10.1002/da.22649 · Cited by 168 · see citing works
Choi, K.-H., Kim, J., Kwon, O. S., Kim, M. J., Ryu, Y. H., & Park, J.-E. (2017) · Psychiatry Research · doi:10.1016/j.psychres.2017.02.025 · Cited by 164 · see citing works
Retrospective recall of affect in clinically depressed individuals and controls
Ben-Zeev, D., Young, M. A., & Madsen, J. W. (2009) · Cognition & Emotion · doi:10.1080/02699930802607937 · Cited by 158 · see citing works
A Health Monitoring System for Elderly People Living Alone
Ohta, S., Nakamoto, H., Shinagawa, Y., & Tanikawa, T. (2002) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x0200800305 · Cited by 157 · see citing works
Smart technologies for long-term stress monitoring at work
Kocielnik, R., Sidorova, N., Maggi, F. M., Ouwerkerk, M., & Westerink, J. H. D. M. (2013) · Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems · doi:10.1109/cbms.2013.6627764 · Cited by 154 · see citing works
Delgadillo, J., de Jong, K., Lucock, M., Lutz, W., Rubel, J., Gilbody, S., Ali, S., Aguirre, E., Appleton, M., Nevin, J., et al. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30162-7 · Cited by 152 · cited 1× · see citing works
“Because providing continuous feedback to patients has been shown to be a valuable therapeutic procedure [29], we also included studies that adopted EMA-based feedback as a therapeutic tool for clinically depressed patients.”
MethodSeppälä, J., De Vita, I., Jämsä, T., Miettunen, J., Isohanni, M., Rubinstein, K., Feldman, Y., Grasa, E., Corripio, I., Berdun, J., et al. (2019) · JMIR Mental Health · doi:10.2196/mental.9819 · Cited by 148 · see citing works
Ottaviani, C., Shahabi, L., Tarvainen, M., Cook, I., Abrams, M., & Shapiro, D. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00433 · Cited by 140 · see citing works
The neuropsychology of mood disorders
Chamberlain, S. R., & Sahakian, B. J. (2006) · Current Psychiatry Reports · doi:10.1007/s11920-006-0051-x · Cited by 140 · see citing works
Burton, C., Szentagotai Tatar, A., McKinstry, B., Matheson, C., Matu, S., Moldovan, R., Macnab, M., Farrow, E., David, D., Pagliari, C., et al. (2016) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x15609793 · Cited by 125 · see citing works
Bouwmans, M. E. J., Bos, E. H., Hoenders, H. J. R., Oldehinkel, A. J., & de Jonge, P. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.09.046 · Cited by 105 · see citing works
Cortisol and α-Amylase Secretion Patterns between and within Depressed and Non-Depressed Individuals
Booij, S. H., Bos, E. H., Bouwmans, M. E. J., van Faassen, M., Kema, I. P., Oldehinkel, A. J., & de Jonge, P. (2015) · PLOS ONE · doi:10.1371/journal.pone.0131002 · Cited by 96 · cited 3× · see citing works
“identified higher cortisol and α-amylase levels among depressed individuals [36].”
BackgroundChange in daily life behaviors and depression: Within-person and between-person associations
Snippe, E., Simons, C. J. P., Hartmann, J. A., Menne-Lothmann, C., Kramer, I., Booij, S. H., Viechtbauer, W., Delespaul, P., Myin-Germeys, I., & Wichers, M. (2016) · Health Psychology · doi:10.1037/hea0000312 · Cited by 94 · cited 1× · see citing works
“[67] PsyMate MDD (n = 102): Experimental condition (n = 33), pseudo-experimental condition (n = 36), control condition (n = 33) Daily assessment of self-reports and weekly EMA-derived feedback through face-to-face sessions 3 days per week, for 6 weeks 10/day Semi-randomized No The use of EMA-derived feedback decreased…”
MethodLoo Gee, B., Griffiths, K. M., & Gulliver, A. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv043 · Cited by 92 · cited 1× · see citing works
“Still, promising results have been already shown also regarding the application of EMA and EMI to anxiety disorders [93,94] and stress-related disorders [95,96], highlighting the potential of these tools to provide psychological support in daily life and to investigate symptom fluctuations across time.”
BackgroundA Pervasive Body Sensor Network for Measuring Postoperative Recovery at Home
Aziz, O., Atallah, L., Lo, B., ElHelw, M., Wang, L., Yang, G. Z., & Darzi, A. (2007) · Surgical Innovation · doi:10.1177/1553350607302326 · Cited by 91 · see citing works
Uncoupling of social zeitgebers and diurnal cortisol secretion in clinical depression
Stetler, C., Dickerson, S. S., & Miller, G. E. (2004) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2004.03.003 · Cited by 88 · see citing works
Huffziger, S., Ebner-Priemer, U., Zamoscik, V., Reinhard, I., Kirsch, P., & Kuehner, C. (2013) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2013.04.014 · Cited by 79 · see citing works
Adams, Z. W., McClure, E. A., Gray, K. M., Danielson, C. K., Treiber, F. A., & Ruggiero, K. J. (2016) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2016.10.019 · Cited by 78 · see citing works
The everyday dynamics of rumination and worry: Precipitant events and affective consequences
Kircanski, K., Thompson, R. J., Sorenson, J., Sherdell, L., & Gotlib, I. H. (2018) · Cognition and Emotion · doi:10.1080/02699931.2017.1278679 · Cited by 76 · cited 2× · see citing works
“[53] MDD (n = 16), GAD (n = 15), MDD with GAD comorbidity (n = 20), and HCG (n = 19) Rumination; worry; PA and NA; significant events Palm Pilot Zire 22 6 to7 days 8 Semi-randomized 65% No Levels of rumination among all the clinical samples are higher in response to significant events.”
BackgroundPutnam, K. M., & McSweeney, L. B. (2008) · Biological Psychology · doi:10.1016/j.biopsycho.2007.10.010 · Cited by 74 · see citing works
Simons, C. J. P., Hartmann, J. A., Kramer, I., Menne-Lothmann, C., Höhn, P., van Bemmel, A. L., Myin-Germeys, I., Delespaul, P., van Os, J., & Wichers, M. (2015) · European Psychiatry · doi:10.1016/j.eurpsy.2015.09.004 · Cited by 73 · see citing works
Effect of self-monitoring through experience sampling on emotion differentiation in depression
Widdershoven, R. L. A., Wichers, M., Kuppens, P., Hartmann, J. A., Menne-Lothmann, C., Simons, C. J. P., & Bastiaansen, J. A. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.10.092 · Cited by 70 · see citing works
Sleep quality in healthy and mood-disordered persons predicts daily life emotional reactivity
O'Leary, K., Small, B. J., Panaite, V., Bylsma, L. M., & Rottenberg, J. (2017) · Cognition and Emotion · doi:10.1080/02699931.2015.1126554 · Cited by 65 · see citing works
Hepp, J., Lane, S. P., Carpenter, R. W., Niedtfeld, I., Brown, W. C., & Trull, T. J. (2017) · Clinical Psychological Science · doi:10.1177/2167702616677312 · Cited by 64 · see citing works
Hartmann, J. A., Wichers, M., Menne-Lothmann, C., Kramer, I., Viechtbauer, W., Peeters, F., Schruers, K. R. J., van Bemmel, A. L., Myin-Germeys, I., Delespaul, P., et al. (2015) · PLOS ONE · doi:10.1371/journal.pone.0128095 · Cited by 62 · see citing works
Past depression and gender interact to influence emotional reactivity to daily life stress
Husky, M. M., Mazure, C. M., Maciejewski, P. K., & Swendsen, J. D. (2009) · Cognitive Therapy and Research · doi:10.1007/s10608-008-9212-z · Cited by 62 · see citing works
Computerized ambulatory monitoring in mood disorders: Feasibility, compliance, and reactivity
Husky, M. M., Gindre, C., Mazure, C. M., Brebant, C., Nolen-Hoeksema, S., Sanacora, G., & Swendsen, J. (2010) · Psychiatry Research · doi:10.1016/j.psychres.2010.04.045 · Cited by 62 · see citing works
Nuij, C., van Ballegooijen, W., Ruwaard, J., Beurs, D. P. D., Mokkenstorm, J. K., van Duijn, E., de Winter, R. F. P., O’Connor, R. C., Smit, J. H., Riper, H. M., et al. (2018) · Internet Interventions · doi:10.1016/j.invent.2018.04.005 · Cited by 58 · see citing works
Application of ecological momentary assessment in stress-related diseases
Yoshiuchi, K., Yamamoto, Y., & Akabayashi, A. (2008) · BioPsychoSocial Medicine · doi:10.1186/1751-0759-2-13 · Cited by 51 · see citing works
Lin, X., Mermelstein, R. J., & Hedeker, D. (2018) · Statistics in Medicine · doi:10.1002/sim.7627 · Cited by 48 · see citing works
Temporal dynamics of physical activity and affect in depressed and nondepressed individuals
Stavrakakis, N., Booij, S. H., Roest, A. M., de Jonge, P., Oldehinkel, A. J., & Bos, E. H. (2015) · Health Psychology · doi:10.1037/hea0000303 · Cited by 47 · see citing works
Hung, S., Li, M.-S., Chen, Y.-L., Chiang, J.-H., Chen, Y.-Y., & Hung, G. C.-L. (2016) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2016.08.003 · Cited by 46 · see citing works
Kim, J., Nakamura, T., Kikuchi, H., Yoshiuchi, K., Sasaki, T., & Yamamoto, Y. (2015) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2015.2440764 · Cited by 45 · see citing works
The future of psychotherapy integration: Closing the gap between research and practice.
Goldfried, M. R. (2010) · Journal of Psychotherapy Integration · doi:10.1037/a0022036 · Cited by 44 · see citing works
Self-Rating Procedures in the Evaluation of Antidepressants
Möller, H.-J., & von Zerssen, D. (2010) · Psychopathology · doi:10.1159/000284941 · Cited by 44 · see citing works
Conrad, A., Wilhelm, F. H., Roth, W. T., Spiegel, D., & Taylor, C. B. (2008) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2007.08.003 · Cited by 41 · see citing works
Affective Instability and Reactivity in Depressed Patients With and Without Borderline Pathology
Köhling, J., Moessner, M., Ehrenthal, J. C., Bauer, S., Cierpka, M., Kämmerer, A., Schauenburg, H., & Dinger, U. (2015) · Journal of Personality Disorders · doi:10.1521/pedi_2015_29_230 · Cited by 39 · see citing works
Mohr, D. C., Montague, E. N. H., Stiles‐Shields, C., Kaiser, S. M., Brenner, C. J., Palac, H., Carty-Fickes, E., & Duffecy, J. (2015) · EAI Endorsed Transactions on Pervasive Health and Technology · doi:10.4108/icst.pervasivehealth.2015.259042 · Cited by 32 · see citing works
Mood variability and the intensity of depressive states
McConville, C., & Cooper, C. (1996) · Current Psychology · doi:10.1007/bf02686921 · Cited by 31 · see citing works
Mikus, A., Hoogendoorn, M., Rocha, A., Gama, J., Ruwaard, J., & Riper, H. (2018) · Internet Interventions · doi:10.1016/j.invent.2017.10.001 · Cited by 31 · see citing works
ULTEMAT: A mobile framework for smart ecological momentary assessments and interventions
van de Ven, P., O’Brien, H., Henriques, R., Klein, M., Msetfi, R., Nelson, J., Rocha, A., Ruwaard, J., O’Sullivan, D., & Riper, H. (2017) · Internet Interventions · doi:10.1016/j.invent.2017.07.001 · Cited by 26 · see citing works
Nilsen, W. J., & Pavel, M. (2013) · IEEE Pulse · doi:10.1109/mpul.2013.2271682 · Cited by 24 · see citing works
The temporal dynamics of cortisol and affective states in depressed and non-depressed individuals
Booij, S. H., Bos, E. H., de Jonge, P., & Oldehinkel, A. J. (2016) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2016.03.012 · Cited by 24 · see citing works
Schaffer, A., Kreindler, D., Reis, C., & Levitt, A. J. (2013) · Journal of Clinical Psychopharmacology · doi:10.1097/jcp.0b013e31829e8359 · Cited by 22 · see citing works
Colombo, D., García‐Palacios, A., Fernández‐Álvarez, J., Patanè, A., Semonella, M., Cipresso, P., Kwiatkowska, M., Riva, G., & Botella, C. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0899-y · Cited by 21 · see citing works
Self-citationQuilty, L. C., Watson, C., Toneatto, T., & Bagby, R. M. (2017) · Journal of Gambling Studies · doi:10.1007/s10899-016-9616-8 · Cited by 19 · see citing works
Colombo, D., Cipresso, P., Fernández‐Álvarez, J., Palacios, A. G., Riva, G., & Botella, C. (2018) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · doi:10.5281/zenodo.1400399 · Cited by 17 · see citing works
Self-citationOn the brink of the information society
Chernyĭ, A. I. (2010) · Automatic Documentation and Mathematical Linguistics · doi:10.3103/s0005105510050031 · Cited by 16 · see citing works
Slofstra, C., Nauta, M. H., Holmes, E. A., Bos, E. H., Wichers, M., Batalas, N., Klein, N. S., & Bockting, C. L. H. (2018) · Cognition and Emotion · doi:10.1080/02699931.2017.1365047 · Cited by 16 · see citing works
Bouwmans, M. E. J., Beltz, A. M., Bos, E. H., Oldehinkel, A. J., de Jonge, P., & Molenaar, P. C. M. (2017) · Personality and Individual Differences · doi:10.1016/j.paid.2017.11.022 · Cited by 15 · see citing works
Moving the science of behavioral change into the 21st century: Part 2
Saranummi, N., Spruijt-Metz, D., Intille, S. S., Korhonen, I., Nilsen, W. J., & Pavel, M. (2013) · IEEE Pulse · doi:10.1109/mpul.2013.2279619 · Cited by 10 · see citing works
Nuij, C., Van Ballegooijen, W., Ruwaard, J., de Beurs, D., O'Connor, R. C., Smit, J. H., Riper, H., & Kerkhof, A. (2017) · doi:10.20944/preprints201704.0103.v1 · Cited by 10 · see citing works
(2018) · REVISTA ARGENTINA DE CLINICA PSICOLOGICA · doi:10.24205/03276716.2018.1070 · Cited by 7 · see citing works
Bouwmans, M. E. J., Oude Oosterik, N. A. M., Bos, E. H., de Groot, I. W., Oldehinkel, A. J., & de Jonge, P. (2018) · Behavioral Sleep Medicine · doi:10.1080/15402002.2016.1180521 · Cited by 6 · see citing works
The temporal dynamics of cortisol and affect in depressed and non-depressed individuals
Booij, S. H., Bos, E. H., de Jonge, P., & Oldehinkel, A. J. (2016) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2016.07.146 · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Maj, M., Stein, D. J., Parker, G., Zimmerman, M., Fava, G. A., De Hert, M., Demyttenaere, K., McIntyre, R. S., Widiger, T., & Wittchen, H. (2020) · World Psychiatry · doi:10.1002/wps.20771 · Cited by 435 · see citing works
The prefrontal cortex, pathological anxiety, and anxiety disorders
Kenwood, M. M., Kalin, N. H., & Barbas, H. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-021-01109-z · Cited by 339 · see citing works
Ecological momentary interventions for mental health: A scoping review
Balaskas, A., Schueller, S. M., Cox, A. L., & Doherty, G. (2021) · PLOS ONE · doi:10.1371/journal.pone.0248152 · Cited by 235 · see citing works
Bickman, L. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01065-8 · Cited by 184 · see citing works
Affect Recall Bias: Being Resilient by Distorting Reality
Colombo, D., Suso‐Ribera, C., Fernández‐Álvarez, J., Cipresso, P., García‐Palacios, A., Riva, G., & Botella, C. (2020) · Cognitive Therapy and Research · doi:10.1007/s10608-020-10122-3 · Cited by 176 · see citing works
Self-citationDon't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research
Kivelä, L., van der Does, W. A. J., Riese, H., & Antypa, N. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.876595 · Cited by 163 · see citing works
Colombo, D., Fernández‐Álvarez, J., Suso‐Ribera, C., Cipresso, P., Valev, H., Leufkens, T., Sas, C., García‐Palacios, A., Riva, G., & Botella, C. (2020) · Emotion · doi:10.1037/emo0000671 · Cited by 154 · see citing works
Self-citationUse of Ecological Momentary Assessment to Study Suicidal Thoughts and Behavior: a Systematic Review
Sedano-Capdevila, A., Porras-Segovia, A., Bello, H. J., Baca-García, E., & Barrigon, M. L. (2021) · Current Psychiatry Reports · doi:10.1007/s11920-021-01255-7 · Cited by 148 · see citing works
Dao, K. P., Cocker, K. A. D., Tong, H. L., Kocaballi, A. B., Chow, C. K., & Laranjo, L. (2021) · JMIR mhealth and uhealth · doi:10.2196/22890 · Cited by 133 · see citing works
Virtual Reality for the Enhancement of Emotion Regulation
Colombo, D., Díaz‐García, A., Fernandez‐Álvarez, J., & Botella, C. (2021) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2618 · Cited by 120 · see citing works
Self-citationPerski, O., Keller, J., Kale, D., Asiamah-Asare, B. K. Y., Schneider, V., Powell, D., Naughton, F., ten Hoor, G. A., Verboon, P., & Kwaśnicka, D. (2022) · Health Psychology Review · doi:10.1080/17437199.2022.2112258 · Cited by 107 · see citing works
The utility of smartphone-based, ecological momentary assessment for depressive symptoms
Yim, S. J., Lui, L. M. W., Lee, Y. L., Rosenblat, J. D., Ragguett, R., Park, C., Subramaniapillai, M., Cao, B., Zhou, A. J., Rong, C., et al. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.05.116 · Cited by 82 · see citing works
Sensors Capabilities, Performance, and Use of Consumer Sleep Technology
de Zambotti, M., Cellini, N., Menghini, L., Sarlo, M., & Baker, F. C. (2020) · Sleep Medicine Clinics · doi:10.1016/j.jsmc.2019.11.003 · Cited by 88 · see citing works
Lim, D., Jeong, J., Song, Y. M., Cho, C., Yeom, J. W., Lee, T., Lee, J.-B., Lee, H., & Kim, J. K. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01333-z · Cited by 85 · see citing works
Zarate, D., Stavropoulos, V., Ball, M., Collier, G. D. S., & Jacobson, N. C. (2022) · BMC Psychiatry · doi:10.1186/s12888-022-04013-y · Cited by 79 · see citing works
van Genugten, C. R., Schuurmans, J., Lamers, F., Riese, H., Penninx, B. W. J. H., Schoevers, R. A., Riper, H. M., & Smit, J. H. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9020322 · Cited by 71 · see citing works
“Nevertheless, systematic reviews showed encouraging results regarding the burden experienced and adherence rates by persons with affective disorders [8,14,15].”
BackgroundInfluentialShin, D., Kim, H., Lee, S., Cho, Y., & Jung, W. (2024) · Journal of Medical Internet Research · doi:10.2196/54617 · Cited by 76 · see citing works
van Genugten, C., Thong, M. S. Y., van Ballegooijen, W., Kleiboer, A. M., Spruijt‐Metz, D., Smit, A. C., Sprangers, M. A. G., Terhorst, Y., & Riper, H. M. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1460167 · Cited by 59 · see citing works
Wearable Technology in Clinical Practice for Depressive Disorder
Fedor, S., Lewis, R., Pedrelli, P., Mischoulon, D., Curtiss, J. E., & Picard, R. W. (2023) · New England Journal of Medicine · doi:10.1056/nejmra2215898 · Cited by 57 · see citing works
Ali, M., Ali, S., Abbas, Q., Abbas, Z., & Lee, S. (2025) · Digital Health · doi:10.1177/20552076251395548 · Cited by 72 · see citing works
Wiebenga, J. X. M., Heering, H. D., Eikelenboom, M., van Hemert, A. M., van Oppen, P., & Penninx, B. W. J. H. (2022) · Brain, Behavior, and Immunity · doi:10.1016/j.bbi.2022.02.021 · Cited by 53 · see citing works
Digital phenotyping in depression diagnostics: Integrating psychiatric and engineering perspectives
Kamath, J., León-Barriera, R., Jain, N., Keisari, E. J., & Wang, B. (2022) · World Journal of Psychiatry · doi:10.5498/wjp.v12.i3.393 · Cited by 54 · see citing works
Cabinio, M., Rossetto, F., Isernia, S., Saibene, F. L., Cesare, M. D., Borgnis, F., Pazzi, S., Migliazza, T., Alberoni, M., Blasi, V., et al. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9051355 · Cited by 45 · see citing works
Folkersma, W., Veerman, V., Ornée, D. A., Oldehinkel, A. J., Alma, M. A., & Bastiaansen, J. A. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100436 · Cited by 38 · see citing works
Bastiaansen, J. A., Ornée, D. A., Meurs, M., & Oldehinkel, A. J. (2020) · Psychological Medicine · doi:10.1017/s0033291720004845 · Cited by 41 · see citing works
Patient and physician perspectives of a smartphone application for depression: a qualitative study
Patoz, M.-C., Hidalgo‐Mazzei, D., Blanc, O., Verdolini, N., Pacchiarotti, I., Murru, A., Zukerwar, L., Vieta, E., Llorca, P., & Samalin, L. (2021) · BMC Psychiatry · doi:10.1186/s12888-021-03064-x · Cited by 36 · see citing works
Biased Affective Forecasting: A Potential Mechanism That Enhances Resilience and Well-Being
Colombo, D., Fernández‐Álvarez, J., Suso‐Ribera, C., Cipresso, P., García‐Palacios, A., Riva, G., & Botella, C. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.01333 · Cited by 38 · see citing works
Self-citationSlow down and be critical before using early warning signals in psychopathology
Helmich, M. A., Schreuder, M. J., Bringmann, L. F., Riese, H., Snippe, E., & Smit, A. C. (2024) · Nature Reviews Psychology · doi:10.1038/s44159-024-00369-y · Cited by 39 · see citing works
Speech as a promising biosignal in precision psychiatry
Kappen, M., Vanderhasselt, M., & Slavich, G. M. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105121 · Cited by 35 · see citing works
Psychopathology and positive emotions in daily life
Heininga, V. E., & Kuppens, P. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.11.005 · Cited by 36 · see citing works
Jiménez-Muñoz, L., Peñuelas‐Calvo, I., Díaz-Oliván, I., Gutiérrez-Rojas, L., Baca‐García, E., & Porras-Segovia, A. (2022) · Harvard Review of Psychiatry · doi:10.1097/hrp.0000000000000331 · Cited by 36 · see citing works
Kolenik, T. (2022) · Internet of things · doi:10.1007/978-3-030-91181-2_7 · Cited by 34 · see citing works
Natural language processing for cognitive therapy: Extracting schemas from thought records
Burger, F., Neerincx, M. A., & Brinkman, W. (2021) · PLoS ONE · doi:10.1371/journal.pone.0257832 · Cited by 31 · see citing works
Ecological Momentary Interventions in Public Mental Health Provision
Schulte‐Strathaus, J. C. C., Rauschenberg, C., Baumeister, H., & Reininghaus, U. (2022) · Studies in neuroscience, psychology and behavioral economics · doi:10.1007/978-3-030-98546-2_25 · Cited by 29 · see citing works
Kopf‐Beck, J., Zimmermann, P., Egli, S., Rein, M., Kappelmann, N., Fietz, J., Tamm, J., Rek, K., Lucae, S., Brem, A., et al. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02880-x · Cited by 41 · see citing works
Peng, Y., Knotts, J. D., Young, K. S., Bookheimer, S. Y., Nusslock, R., Zinbarg, R. E., Kelley, N. J., Echiverri-Cohen, A. M., & Craske, M. G. (2022) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2021.12.013 · Cited by 28 · see citing works
Craske, M. G., Herzallah, M. M., Nusslock, R., & Patel, V. (2023) · Nature Mental Health · doi:10.1038/s44220-022-00012-w · Cited by 30 · see citing works
Jones, S. E., Moore, R. C., Pinkham, A. E., Depp, C. A., Granholm, E. L., & Harvey, P. D. (2021) · Personalized Medicine in Psychiatry · doi:10.1016/j.pmip.2021.100085 · Cited by 30 · see citing works
Mouchabac, S., Maatoug, R., Conejero, I., Adrien, V., Bonnot, O., Millet, B., Ferreri, F., & Bourla, A. (2021) · Brain Sciences · doi:10.3390/brainsci11111454 · Cited by 30 · see citing works
Horwitz, A. G., Kentopp, S. D., Cleary, J. L., Ross, K. E. T., Wu, Z., Sen, S., & Czyz, E. K. (2022) · Psychological Medicine · doi:10.1017/s0033291722003014 · Cited by 29 · see citing works
The Moderating Role of Emotion Regulation in the Recall of Negative Autobiographical Memories
Colombo, D., Serino, S., Suso‐Ribera, C., Fernández‐Álvarez, J., Cipresso, P., García‐Palacios, A., Riva, G., & Botella, C. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18137122 · Cited by 27 · see citing works
Self-citationQualitative Diary Methods in Mental Health Research
McCombie, C., Esponda, G., Schmidt, U., & Lawrence, V. (2024) · European Psychologist · doi:10.1027/1016-9040/a000511 · Cited by 28 · see citing works
Thong, M. S. Y., Chan, R. J., van den Hurk, C. J. G., Fessele, K. L., Tan, W. W., Poprawski, D. M., Fernández‐Ortega, P., Paterson, C. C., Fitch, M. I., & MASCC EMA working group (2020) · Supportive Care in Cancer · doi:10.1007/s00520-020-05648-x · Cited by 26 · see citing works
González‐Pérez, A., Matey-Sanz, M., Granell, C., Díaz-Sanahuja, L., Bretón-López, J. M., & Casteleyn, S. (2023) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2023.104359 · Cited by 30 · see citing works
Tanaka, M. (2024) · Advances in Clinical and Experimental Medicine · doi:10.17219/acem/197425 · Cited by 27 · see citing works
Demers, M., & Winstein, C. J. (2020) · Topics in Stroke Rehabilitation · doi:10.1080/10749357.2020.1856557 · Cited by 23 · see citing works
Girolamo, G., Barattieri di San Pietro, C., Bulgari, V., Dagani, J., Ferrari, C., Hotopf, M., Iannone, G., Macis, A., Matcham, F., Myin‐Germeys, I., et al. (2020) · Depression and Anxiety · doi:10.1002/da.23023 · Cited by 24 · see citing works
Zhang, Y., Li, D., Li, X., Zhou, X., & Newman, G. (2024) · Social Science & Medicine · doi:10.1016/j.socscimed.2024.117075 · Cited by 24 · see citing works
Tervo‐Clemmens, B., Schmitt, W. A., Wheeler, G. L., Cooke, M. E., Schuster, R. M., Hickey, S., Pachas, G. N., Evins, A. E., & Gilman, J. M. (2022) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2022.109760 · Cited by 24 · see citing works
Selecting an Ecological Momentary Assessment Platform: Tutorial for Researchers
Henry, L. M., Hansen, E., Chimoff, J., Pokstis, K., Kiderman, M., Naim, R., Kossowsky, J., Byrne, M. E., López-Guzmán, S., Kircanski, K., et al. (2023) · Journal of Medical Internet Research · doi:10.2196/51125 · Cited by 25 · see citing works
Moore, R. C., Parrish, E. M., Patten, R. V., Paolillo, E. W., Filip, T. F., Bomyea, J. A., Lomas, D., Twamley, E. W., Eyler, L. T., & Depp, C. A. (2022) · Journal of Medical Internet Research · doi:10.2196/36665 · Cited by 24 · see citing works
mHealth in affective disorders: hype or hope? A focused narrative review
Hidalgo‐Mazzei, D., Llach, C.-D., & Vieta, E. (2020) · International Clinical Psychopharmacology · doi:10.1097/yic.0000000000000302 · Cited by 22 · see citing works
Kingsbury, C., Buzzi, M., Chaix, B., Kanning, M. K., Khezri, S., Kiani, B., Kirchner, T., Maurel, A., Thierry, B., & Kestens, Y. (2024) · Archives of Public Health · doi:10.1186/s13690-024-01310-8 · Cited by 20 · see citing works
Acorda, D. E., Businelle, M. S., & Maria, D. S. (2021) · JMIR Formative Research · doi:10.2196/21638 · Cited by 20 · see citing works
Amin, R., Schreynemackers, S., Oppenheimer, H., Petrovic, M., Hegerl, U., & Reich, H. (2025) · Journal of Medical Internet Research · doi:10.2196/57418 · Cited by 24 · see citing works
Hong, S., Lee, S., Song, K., Kim, M.-J., Kim, Y., Kim, H., & Kim, H. (2022) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2022.104431 · Cited by 22 · see citing works
Gómez-Pérez, M. C., García-Palacios, A., Castilla, D., Zaragozá, I., & Suso-Ribera, C. (2020) · Pain Research and Management · doi:10.1155/2020/7897268 · Cited by 18 · see citing works
Self-citationvan Genugten, C., Schuurmans, J., Hoogendoorn, A. W., Araya, R., Andersson, G., Baños, R., Berger, T., Botella, C., Pashoja, A. C., Cieślak, R., et al. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.755809 · Cited by 18 · see citing works
Self-citationWiedermann, M., Rose, A. H., Maier, B. F., Kolb, J. J., Hinrichs, D., & Brockmann, D. (2023) · PNAS Nexus · doi:10.1093/pnasnexus/pgad223 · Cited by 19 · see citing works
Mueller, I., Pruessner, L., Holt, D. V., Zimmermann, V., Schulze, K., Strakosch, A.-M., & Barnow, S. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2023.12.037 · Cited by 18 · see citing works
Telepsychiatry: The future is already present
Gutiérrez-Rojas, L., Álvarez-Mon, M. Á., Andreu-Bernabeu, Á., Capitán, L., Cuevas, C. D. L., Gómez, J. C., Grande, I., Hidalgo‐Mazzei, D., Mateos, R., Moreno-Gea, P., et al. (2022) · Revista de Psiquiatría y Salud Mental · doi:10.1016/j.rpsm.2022.09.001 · Cited by 17 · see citing works
Ecological momentary interventions for smoking cessation: a systematic review and meta-analysis
Eghdami, S., Ahmadkhaniha, H., Baradaran, H. R., & Hirbod‐Mobarakeh, A. (2023) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-023-02503-2 · Cited by 17 · see citing works
Kolenik, T., Schiepek, G. K., & Gams, M. (2024) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s417695 · Cited by 17 · see citing works
Digital Clinical Trials for Substance Use Disorders in the Age of Covid-19
Brezing, C., Luo, S. X., Mariani, J. J., & LEVIN, F. R. (2020) · Journal of Addiction Medicine · doi:10.1097/adm.0000000000000733 · Cited by 17 · see citing works
Martínez‐Borba, V., Ripoll-Server, P., Yakobov, E., & Suso‐Ribera, C. (2021) · Clinical Journal of Pain · doi:10.1097/ajp.0000000000000913 · Cited by 16 · see citing works
Mood and Activity Measured Using Smartphones in Unipolar Depressive Disorder
Tønning, M. L., Faurholt-Jepsen, M., Frost, M., Bardram, J. E., & Kessing, L. V. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.701360 · Cited by 17 · see citing works
Faurholt‐Jepsen, M., Rohani, D. A., Busk, J., Tønning, M. L., Vinberg, M., Bardram, J. E., & Kessing, L. V. (2021) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.13391 · Cited by 17 · see citing works
Castilla, D., Navarro-Haro, M., Suso-Ribera, C., Díaz-García, A., Zaragozá, I., & García-Palacios, A. (2022) · BMC Psychiatry · doi:10.1186/s12888-022-03800-x · Cited by 15 · see citing works
Self-citationSeidman, A. J., George, C. J., & Kovács, M. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.05.015 · Cited by 16 · see citing works
Using mobile devices as scientific measurement instruments: Reliable android task scheduling
González‐Pérez, A., Matey-Sanz, M., Granell, C., & Casteleyn, S. (2022) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2022.101550 · Cited by 19 · see citing works
Brederoo, S., Nadema, F. G., Goedhart, F. G., Voppel, A., de Boer, J. N., Wouts, J., Koops, S., & Sommer, I. E. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2021.08.019 · Cited by 15 · see citing works
Colomer‐Carbonell, A., Sanabria‐Mazo, J. P., Hernández-Negrín, H., Borràs, X., Suso‐Ribera, C., García‐Palacios, A., Muchart, J., Munuera, J., D’Amico, F., Maes, M. H. J., et al. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-055351 · Cited by 15 · see citing works
Self-citationInnovative Technology Based Interventions for Psychological Treatment of Common Mental Disorders
Donker, T., & Kleiboer, A. M. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9103075 · Cited by 15 · see citing works
Dropping the E: The potential for integrating e-mental health in psychotherapy
Daele, T. V., Best, P., Bernaerts, S., Assche, E. V., & Witte, N. A. J. D. (2021) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2021.02.007 · Cited by 14 · see citing works
Mobile-based ecological momentary assessment and intervention: bibliometric analysis
Yin, H., Zhu, H., Gu, J., Qin, H., Ding, W., Guo, N., Fu, J., & Yang, Y. X. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1300739 · Cited by 14 · see citing works
van Genugten, C., Schuurmans, J., van Ballegooijen, W., Hoogendoorn, A. W., Smit, J. H., & Riper, H. M. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100437 · Cited by 14 · see citing works
A systematic review of ecological momentary assessment in autism research
Chen, Y., Xi, Z., Greene, T., & Mandy, W. (2024) · Autism · doi:10.1177/13623613241305722 · Cited by 13 · see citing works
Wayda‐Zalewska, M., Grzegorzewski, P., Kot, E., Skimina, E., Santangelo, P., & Kucharska, K. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph192013659 · Cited by 12 · see citing works
Adams, L. B., Watts, T., DeVinney, A., Haroz, E. E., Thrul, J., Brooks, J. R., Campbell, M. N., Antoine, D. G., Cook, B. L., Joe, S., et al. (2024) · JMIR Formative Research · doi:10.2196/48992 · Cited by 13 · see citing works
Using Multimodal Assessments to Reevaluate Depression Designations for Spine Surgery Candidates
Benedict, B. C., Frumkin, M. R., Botterbush, K. S., Javeed, S., Zhang, J. K., Yakdan, S. M., Neuman, B. J., Steinmetz, M. P., Ghogawala, Z., Kelly, M. P., et al. (2024) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.23.01195 · Cited by 12 · see citing works
Sosa‐Hernandez, L., Vogel, N., Frankiewicz, K., Reaume, C. L., Drew, A., Neufeld, S. M., & Thomassin, K. (2024) · Psychophysiology · doi:10.1111/psyp.14699 · Cited by 13 · see citing works
de Vries, H., Delahaij, R., van Zwieten, M. H. J., Verhoef, H., & Kamphuis, W. (2025) · JMIR mhealth and uhealth · doi:10.2196/60708 · Cited by 14 · see citing works
Deng, H., Kandt, J., Signorelli, V., & Shelton, N. J. (2025) · Landscape and Urban Planning · doi:10.1016/j.landurbplan.2025.105407 · Cited by 12 · see citing works
van Genugten, C. V., Schuurmans, J., Hoogendoorn, A., Araya, R., Andersson, G., Baños, R., Botella, C., Cerga-Pashoja, A., Cieślak, R., Ebert, D., et al. (2021) · JMIR Mental Health · doi:10.2196/32007 · Cited by 13 · see citing works
Self-citationCormack, F. K., McCue, M., Skirrow, C., Cashdollar, N. M., Taptiklis, N., van Schaik, T. A., Fehnert, B., King, J., Chrones, L., Sarkey, S., et al. (2023) · JMIR Mental Health · doi:10.2196/46895 · Cited by 14 · see citing works
Han, A., Malone, L. A., Lee, H. Y., Gong, J., Henry, R., Zhu, X., & Yuen, H. K. (2024) · Health Psychology Research · doi:10.52965/001c.93907 · Cited by 11 · see citing works
The Effect of Everyday-Life Social Contact on Pain
Weiss, M. H., Gründahl, M., Jachnik, A., Lampe, E. C., Malik, I., Rittner, H. L., Sommer, C., & Hein, G. (2024) · Journal of Medical Internet Research · doi:10.2196/53830 · Cited by 12 · see citing works
Differential effects of everyday-life social support on chronic pain
Weiss, M. H., Jachnik, A., Lampe, E. C., Gründahl, M., Harnik, M. A., Sommer, C., Rittner, H. L., & Hein, G. (2024) · BMC Neurology · doi:10.1186/s12883-024-03792-z · Cited by 11 · see citing works
Measuring loneliness in everyday life.
Halvorson, M. A., & Kuczynski, A. M. (2024) · Translational Issues in Psychological Science · doi:10.1037/tps0000438 · Cited by 11 · see citing works
Three Questions to Consider Before Applying Ecological Momentary Interventions (EMI) in Psychiatry
Gründahl, M., Deckert, J., & Hein, G. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00333 · Cited by 11 · see citing works
Biello, K. B., Salhaney, P., Valente, P. K., Childs, E., Olson, J., Earlywine, J. J., Marshall, B. D. L., & Bazzi, A. R. (2020) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2020.108167 · Cited by 11 · see citing works
Terhorst, Y., Meßner, E.-M., Asare, K. O., Montag, C., Kannen, C., & Baumeister, H. (2024) · Journal of Medical Internet Research · doi:10.2196/55308 · Cited by 9 · see citing works
Daniels, K., Quadflieg, K., Robijns, J., Vry, J. D., Alphen, H. V., Beers, R. V., Sourbron, B., Vanbuel, A., Meekers, S., Mattheeussen, M., et al. (2025) · Sensors · doi:10.3390/s25030858 · Cited by 10 · see citing works
Technology-Based Ecological Momentary Assessment in Clinical Psychology
Colombo, D., Suso‐Ribera, C., Fernández‐Álvarez, J., Cipresso, P., García‐Palacios, A., Riva, G., & Botella, C. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-818697-8.00003-0 · Cited by 9 · see citing works
Self-citationLüdtke, T., & Westermann, S. (2022) · Motivation and Emotion · doi:10.1007/s11031-022-09985-8 · Cited by 10 · see citing works
Bond, R., Moorhead, A., Mulvenna, M. D., O’Neill, S. M., Potts, C., & Murphy, N. (2019) · Behaviour and Information Technology · doi:10.1080/0144929x.2019.1648553 · Cited by 10 · see citing works
Diaz-Sanahuja, L., Campos, D., Mira, A., Castilla, D., García-Palacios, A., & Bretón-López, J. M. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100466 · Cited by 10 · see citing works
Self-citationPostma, M. R., Vrancken, S., Daemen, M., der Meulen, I. H.-V., Volbragt, N., Delespaul, P., de Haan, L., van der Pluijm, M., Breedvelt, J., van der Gaag, M., et al. (2024) · BMC Public Health · doi:10.1186/s12889-024-19143-z · Cited by 9 · see citing works
Ecological Momentary Assessment versus Weekly Questionnaire Assessment of Change in Depression
Tamm, J., Takano, K., Just, L., Ehring, T. W., Rosenkranz, T., & Kopf‐Beck, J. (2024) · Depression and Anxiety · doi:10.1155/2024/9191823 · Cited by 9 · see citing works
Hartnagel, L., Ebner‐Priemer, U., Foo, J. C., Streit, F., Witt, S. H., Frank, J., Limberger, M. F., Horn, A. B., Gilles, M., Rietschel, M., et al. (2024) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.13726 · Cited by 9 · see citing works
- Authors
- Colombo, D., Fernández-Álvarez, J., Patané, A., Semonella, M., Kwiatkowska, M., García-Palacios, A., Cipresso, P., Riva, G., & Botella, C.
- Affiliations
- Universitat Jaume I (ES)
- Department of Psychology, Università Cattolica del Sacro Cuore, Largo Gemelli, 1, 20100 Milan, Italy
- Department of Computer Science, University of Oxford, Wolfson Building, Parks Rd, Oxford OX1 3QD, UK
- IRCCS Istituto Auxologico Italiano (IT)
- University of Oxford (GB)
- Department of Basic Psychology, Clinic and Psychobiology, Universitat Jaume I, Av. Sos Baynat, s/n, 12071 Castellón, Spain
- Università Cattolica del Sacro Cuore (IT)
- Corresponding author
- Colombo, Desirée
- ORCID
- Venue
- Journal of Clinical Medicine
- Publisher
- MDPI AG
- Published
- 2019-04-05
- Volume
- 8
- Issue
- 4
- Pages
- 465
- ISSN
- 2077-0383 (ISSN-L)
- PMC
- PMC6518287
- OpenAlex
- W2905222826
- Cited by
- 194
- References
- 99
- Citations by year
- 2026: 19 · 2025: 28 · 2024: 42 · 2023: 22 · 2022: 33 · 2021: 23 · 2020: 26 · 2019: 1
- FWCI
- 2.94
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Journal of Clinical Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (publishedVersion, other-oa)
- Repositori UJI (Universitat Jaume I) (submittedVersion, cc-by-sa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- PubliCatt (Università Cattolica del Sacro Cuore) (submittedVersion, other-oa)
- Funders
- H2020 Marie Skłodowska-Curie Actions (722022)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
- Keywords
- ecological momentary assessment, ecological momentary intervention, major depressive disorder, mobile application, wearable biosensors, information and communication technologies, machine learning, naturalistic assessment, medication adherence, digital mental health
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review