The acceptability of real‐time health monitoring among community participants with depression: A systematic review and meta‐analysis of the literature
Open accessAbstract
Background The application of experience sampling method/ecological momentary assessment (ESM/EMA) methods to individuals with major depressive disorder (MDD) seems promising, but evidence about their acceptability is still unclear. The aim of this systematic review and meta-analysis (registration number CRD42017060438) was to investigate the acceptability of ESM/EMA techniques for health monitoring in patients with MDD, by examining the dropout rate and related-reasons, and to explore the effects of individual, methodological, and technical features on dropping out. Method According to PRISMA guidelines, after leading a systematic search on major electronic databases, a structured process for selecting and collecting data was followed. Results A total of 19 studies were included in the analyses. From results, it emerged a dropout rate of 3.6%. Our findings showed that the use of paper and pencil tools in combination with electronic devices, the time-based sampling method, and not providing monetary incentives significantly increase the dropout rate of patients with MDD during ESM/EMA monitoring. Age, gender, depression severity, duration of monitoring, number of assessments each day, and number of questions did not affect dropout rate. Conclusions The results of this systematic review may assist clinicians and researchers in planning, implementing, or evaluating the use of ESM/EMA to assess the health status of community-based individuals with MDD.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The study was designed with patient involvement from the outset.
“The study was designed with patient involvement from the outset (including systematic reviews [19, 20], focus groups [21] and a Patient Advisory Board) with the aim of developing a protocol which meets the needs of the target population.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369 · see citing works
Diagnostic and Statistical Manual of Mental Disorders
Williams, J. B. W., & First, M. B. (2013) · Oxford University Press eBooks · doi:10.1093/acrefore/9780199975839.013.104 · Cited by 109,841 · see citing works
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554 · see citing works
Conducting Meta-Analyses in <i>R</i> with the <b>metafor</b> Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464 · see citing works
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454 · see citing works
Symonds, P. M. (1954) · Journal of Educational Psychology · doi:10.1037/h0051901 · Cited by 4,902 · see citing works
Sekhon, M., Cartwright, M., & Francis, J. J. (2017) · BMC Health Services Research · doi:10.1186/s12913-017-2031-8 · Cited by 3,938 · see citing works
Ecological Momentary Assessment (Ema) in Behavioral Medicine
Stone, A. A., & Shiffman, S. (1994) · Annals of Behavioral Medicine · doi:10.1093/abm/16.3.199 · Cited by 1,931 · see citing works
Bias and Efficiency of Meta-Analytic Variance Estimators in the Random-Effects Model
Viechtbauer, W. (2005) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986030003261 · Cited by 1,699 · cited 1× · see citing works
“A meta‐analysis was performed through a random‐effects model to consider the variability (heterogeneity) of the studies included in the meta‐analysis (Viechtbauer, 2005).”
MethodExperience sampling research in psychopathology: opening the black box of daily life
Myin-Germeys, I., Oorschot, M., Collip, D., Lataster, J., Delespaul, P., & van Os, J. (2009) · Psychological Medicine · doi:10.1017/s0033291708004947 · Cited by 817 · see citing works
Self-citationPersonal Sensing: Understanding Mental Health Using Ubiquitous Sensors and Machine Learning
Mohr, D. C., Zhang, M., & Schueller, S. M. (2017) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032816-044949 · Cited by 802 · see citing works
Trull, T. J., & Ebner-Priemer, U. (2013) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185510 · Cited by 761 · see citing works
Experience sampling methodology in mental health research: new insights and technical developments.
Myin‐Germeys, I., Kasanova, Z., Vaessen, T., Vachon, H., Kirtley, O., Viechtbauer, W., & Reininghaus, U. (2018) · World Psychiatry · doi:10.1002/wps.20513 · Cited by 709 · see citing works
Self-citationValidity and Reliability of the Experience-Sampling Method
Csikszentmihalyi, M., & Larson, R. (2014) · Flow and the Foundations of Positive Psychology · doi:10.1007/978-94-017-9088-8_3 · Cited by 578 · see citing works
Trull, T. J., & Ebner-Priemer, U. W. (2009) · Psychological Assessment · doi:10.1037/a0017653 · Cited by 550 · see citing works
Torous, J., Lipschitz, J., Ng, M., & Firth, J. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.167 · Cited by 546 · see citing works
Ecological momentary assessment of mood disorders and mood dysregulation
Ebner-Priemer, U. W., & Trull, T. J. (2009) · Psychological Assessment · doi:10.1037/a0017075 · Cited by 530 · see citing works
aan het Rot, M., Hogenelst, K., & Schoevers, R. A. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.05.007 · Cited by 325 · see citing works
Diurnal mood variation in major depressive disorder
Peeters, F., Berkhof, J., Delespaul, P., Rottenberg, J., & Nicolson, N. A. (2006) · Emotion · doi:10.1037/1528-3542.6.3.383 · Cited by 306 · see citing works
Torous, J., Staples, P., Shanahan, M., Lin, C., Peck, P., Keshavan, M., & Onnela, J.-P. (2015) · JMIR Mental Health · doi:10.2196/mental.3889 · Cited by 258 · see citing works
Vachon, H., Viechtbauer, W., Rintala, A., & Myin-Germeys, I. (2019) · Journal of Medical Internet Research · doi:10.2196/14475 · Cited by 252 · see citing works
Self-citationPractical guide to the meta-analysis of rare events
Efthimiou, O. (2018) · Evidence Based Mental Health · doi:10.1136/eb-2018-102911 · Cited by 231 · see citing works
Ecological momentary interventions in psychiatry
Myin‐Germeys, I., Klippel, A., Steinhart, H., & Reininghaus, U. (2016) · Current Opinion in Psychiatry · doi:10.1097/yco.0000000000000255 · Cited by 223 · see citing works
Self-citationLittlewood, D. L., Kyle, S. D., Carter, L.-A., Peters, S., Pratt, D., & Gooding, P. (2019) · Psychological Medicine · doi:10.1017/s0033291718001009 · Cited by 209 · see citing works
Colombo, D., Fernández-Álvarez, J., Patané, A., Semonella, M., Kwiatkowska, M., García-Palacios, A., Cipresso, P., Riva, G., & Botella, C. (2019) · Journal of Clinical Medicine · doi:10.3390/jcm8040465 · Cited by 194 · see citing works
Response compliance and predictors thereof in studies using the experience sampling method.
Rintala, A., Wampers, M., Myin‐Germeys, I., & Viechtbauer, W. (2018) · Psychological Assessment · doi:10.1037/pas0000662 · Cited by 176 · see citing works
Self-citationRetrospective recall of affect in clinically depressed individuals and controls
Ben-Zeev, D., Young, M. A., & Madsen, J. W. (2009) · Cognition & Emotion · doi:10.1080/02699930802607937 · Cited by 158 · see citing works
Ottaviani, C., Shahabi, L., Tarvainen, M., Cook, I., Abrams, M., & Shapiro, D. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00433 · Cited by 140 · see citing works
Simblett, S., Matcham, F., Siddi, S., Bulgari, V., Barattieri di San Pietro, C., Hortas López, J., Ferrão, J., Polhemus, A., Haro, J. M., de Girolamo, G., et al. (2019) · JMIR mHealth and uHealth · doi:10.2196/11325 · Cited by 120 · see citing works
Self-citationGeschwind, N., Nicolson, N. A., Peeters, F., van Os, J., Barge-Schaapveld, D., & Wichers, M. (2011) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2010.11.004 · Cited by 119 · see citing works
Ecological momentary assessment (EMA) of depression-related phenomena
Armey, M. F., Schatten, H. T., Bailen, N. H., & Miller, I. W. (2015) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2015.01.002 · Cited by 108 · see citing works
Snippe, E., Viechtbauer, W., Geschwind, N., Klippel, A., de Jonge, P., & Wichers, M. (2017) · Scientific Reports · doi:10.1038/srep46523 · Cited by 89 · see citing works
Everyday emotional dynamics in major depression.
Nelson, J., Klumparendt, A., Doebler, P., & Ehring, T. W. (2018) · Emotion · doi:10.1037/emo0000541 · Cited by 88 · see citing works
Peeters, F., Berkhof, J., Rottenberg, J., & Nicolson, N. A. (2010) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.04.008 · Cited by 84 · see citing works
Changes in daily life experience associated with clinical improvement in depression
Barge-Schaapveld, D. (1995) · Journal of Affective Disorders · doi:10.1016/0165-0327(95)00012-c · Cited by 84 · see citing works
Putnam, K. M., & McSweeney, L. B. (2008) · Biological Psychology · doi:10.1016/j.biopsycho.2007.10.010 · Cited by 74 · see citing works
van Genugten, C. R., Schuurmans, J., Lamers, F., Riese, H., Penninx, B. W. J. H., Schoevers, R. A., Riper, H. M., & Smit, J. H. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9020322 · Cited by 71 · see citing works
Starr, L. R. (2015) · Journal of Social and Clinical Psychology · doi:10.1521/jscp.2015.34.5.436 · Cited by 70 · see citing works
Experience Sampling Methodology studies of depression: the state of the art
Telford, C., McCarthy-Jones, S., Corcoran, R., & Rowse, G. (2012) · Psychological Medicine · doi:10.1017/s0033291711002200 · Cited by 64 · see citing works
Computerized ambulatory monitoring in mood disorders: Feasibility, compliance, and reactivity
Husky, M. M., Gindre, C., Mazure, C. M., Brebant, C., Nolen-Hoeksema, S., Sanacora, G., & Swendsen, J. (2010) · Psychiatry Research · doi:10.1016/j.psychres.2010.04.045 · Cited by 62 · see citing works
Watson, L. A., Berntsen, D., Kuyken, W., & Watkins, E. R. (2012) · Consciousness and Cognition · doi:10.1016/j.concog.2012.06.016 · Cited by 58 · see citing works
Resting-state functional connectivity and inflexibility of daily emotions in major depression
Kirshenbaum, J. S., Ordaz, S. J., Kircanski, K., Ho, T. C., Davis, E., Camacho, M. C., & Gotlib, I. H. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.01.040 · Cited by 47 · see citing works
Kim, J., Nakamura, T., Kikuchi, H., Yoshiuchi, K., Sasaki, T., & Yamamoto, Y. (2015) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2015.2440764 · Cited by 45 · see citing works
Messiah, A., Grondin, O., & Encrenaz, G. (2010) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2010.09.016 · Cited by 42 · see citing works
Conrad, A., Wilhelm, F. H., Roth, W. T., Spiegel, D., & Taylor, C. B. (2008) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2007.08.003 · Cited by 41 · see citing works
Cohen, L. H., Gunthert, K. C., Butler, A. C., Parrish, B. P., Wenze, S. J., & Beck, J. S. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0014131 · Cited by 38 · see citing works
Vachon, H., Fortes-Bourbousson, M., Deschamps, T., Doron, J., Bulteau, S., Sauvaget, A., & Thomas-Ollivier, V. (2016) · Psychiatry Research · doi:10.1016/j.psychres.2016.08.034 · Cited by 27 · see citing works
Accompanying Depression with FINE - A Smartphone-Based Approach.
Dang, M., Mielke, C., Diehl, A., & Haux, R. (2016) · PubMed · Cited by 14 · see citing works
Flagged first, then by citations
1 of the 49 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- ICH Expert Working Group (1998). Statistical principles for clinical trials E9. Paper presented at the International conference on harmonisation of technical requirements for registration of pharmaceuticals for human use, London.
Cited by
Sorted by citations
Torous, J., Bucci, S., Bell, I. H., Kessing, L. V., Faurholt‐Jepsen, M., Whelan, P., Carvalho, A. F., Keshavan, M., Linardon, J., & Firth, J. (2021) · World Psychiatry · doi:10.1002/wps.20883 · Cited by 1,199 · see citing works
Matcham, F., Leightley, D., Siddi, S., Lamers, F., White, K. M., Annas, P., de Girolamo, G., Difrancesco, S., Haro, J. M., Horsfall, M., et al. (2022) · BMC Psychiatry · doi:10.1186/s12888-022-03753-1 · Cited by 110 · see citing works
Self-citationWhite, K. M., Williamson, C., Bergou, N., Oetzmann, C., de Angel, V., Matcham, F., Henderson, C., & Hotopf, M. H. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00624-7 · Cited by 30 · see citing works
Self-citationde Angel, V., Adeleye, F., Zhang, Y., Cummins, N., Munir, S., Lewis, S., Laporta, E., Matcham, F., Sun, S., Folarin, A., et al. (2022) · JMIR Mental Health · doi:10.2196/42866 · Cited by 25 · see citing works
Self-citationYip, S. W., Barch, D. M., Chase, H. W., Flagel, S. B., Huys, Q. J. M., Konova, A. B., Montague, P. R., & Paulus, M. P. (2022) · Biological Psychiatry Global Open Science · doi:10.1016/j.bpsgos.2022.03.011 · Cited by 24 · see citing works
de Angel, V., Lewis, S., White, K. M., Matcham, F., & Hotopf, M. H. (2022) · JMIR Mental Health · doi:10.2196/38934 · Cited by 15 · see citing works
Self-citationvan Genugten, C., Schuurmans, J., van Ballegooijen, W., Hoogendoorn, A. W., Smit, J. H., & Riper, H. M. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100437 · Cited by 14 · see citing works
Sankesara, H., Denyer, H., Sun, S.-X., Deng, Q., Ranjan, Y., Conde, P., Rashid, Z., Asherson, P., Bilbow, A., Groom, M. J., et al. (2023) · JMIR Formative Research · doi:10.2196/54531 · Cited by 10 · see citing works
Ergun, T. D., ten Klooster, P. M., Bohlmeijer, E. T., Westerhof, G. J., Franzen, M., & Lenferink, L. I. M. (2025) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2025.152597 · Cited by 11 · see citing works
Reliability and validity of the Brief Emotional Experience Scale (BEES) for mood monitoringPreprint
Rogers, S., Cruickshank, T. M., & Nosaka, K. K. (2021) · doi:10.31234/osf.io/p4j7t · Cited by 11 · see citing works
White, K. M., Matcham, F., Leightley, D., Carr, E., Conde, P., Dawe‐Lane, E., Ranjan, Y., Simblett, S. K., Henderson, C., & Hotopf, M. H. (2021) · JMIR Research Protocols · doi:10.2196/32653 · Cited by 7 · see citing works
Self-citationChaoyi, W. U., & Zhen, W. (2023) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2024.00364 · Cited by 5 · see citing works
Witkoś, J., Fusińska-Korpik, A., Hartman‐Petrycka, M., & Nowak, A. (2022) · PeerJ · doi:10.7717/peerj.13373 · Cited by 4 · see citing works
White, K. M., Williamson, C., Bergou, N., Oetzmann, C., de Angel, V., Matcham, F., Henderson, C., & Hotopf, M. H. (2022) · Research Square · doi:10.21203/rs.3.rs-1625589/v1 · Cited by 4 · see citing works
Self-citationThe potential of experience sampling methods in palliative care
Geeraerts, J., Pivodic, L., de Nooijer, K., Rosquin, L., Naert, E., Crombez, G., Ridder, M. D., & den Block, L. V. (2024) · Palliative Medicine · doi:10.1177/02692163241306242 · Cited by 3 · see citing works
Feasibility of digital monitoring in patients receiving ambulatory psychiatric care
Conejero, I., Villalba, M. Á., Matos, V., Jiménez, O., García, R. R., Albarracín-García, L., Porras‐Segovia, A., Barrigón, M. L., López‐Castromán, J., Artés-Rodrı́guez, A., et al. (2025) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2025.05.072 · Cited by 1 · see citing works
Ricerca in salute mentale: un decennio di progetti all'IRCSS Fatebenefratelli
de Girolamo, G., Candini, V., Iozzino, L., & Zarbo, C. (2020) · RIVISTA SPERIMENTALE DI FRENIATRIA · doi:10.3280/rsf2020-002006
Self-citationde Angel, V., Lewis, S., White, K. M., Matcham, F., & Hotopf, M. H. (2022) · doi:10.2196/preprints.38934
Self-citationde Angel, V., Adeleye, F., Zhang, Y., Cummins, N., Munir, S., Lewis, S., Laporta, E., Matcham, F., Sun, S., Dobson, R., et al. (2022) · doi:10.2196/preprints.42866
Self-citationmHealth for mental health during quarantine
(2023) · International Research Journal of Modernization in Engineering Technology and Science · doi:10.56726/irjmets43689
Dynamic prediction of depressive states using stress processes: A multilevel decision tree approach
Luo, X., Yueqin, H. U., & Liu, H. (2025) · Acta Psychologica Sinica · doi:10.3724/sp.j.1041.2025.1363
- Authors
- Girolamo, G., Barattieri di San Pietro, C., Bulgari, V., Dagani, J., Ferrari, C., Hotopf, M., Iannone, G., Macis, A., Matcham, F., Myin‐Germeys, I., Rintala, A., Simblett, S., Wykes, T., Zarbo, C., & the RADAR‐CNS Consortium
- Affiliations
- Centro San Giovanni di Dio Fatebenefratelli (IT)
- Department of Psychology University of Milano‐Bicocca Milan Italy
- King's College London (GB)
- KU Leuven (BE)
- Corresponding author
- Girolamo, Giovanni
- ORCID
- Venue
- Depression and Anxiety
- Publisher
- Wiley
- Published
- 2020-04-27
- Volume
- 37
- Issue
- 9
- Pages
- 885-897
- ISSN
- 1091-4269 (ISSN-L)
- 1520-6394
- OpenAlex
- W3020056820
- Cited by
- 24
- References
- 49
- Citations by year
- 2025: 3 · 2024: 2 · 2023: 2 · 2022: 12 · 2021: 4 · 2020: 1
- FWCI
- 0.69
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Depression and Anxiety (publishedVersion)
- BOA (University of Milano-Bicocca) (submittedVersion, other-oa)
- Institutional Research Information System (Università degli Studi di Brescia) (submittedVersion)
- Research Portal (King's College London) (submittedVersion)
- Lirias (submittedVersion, other-oa)
- Funders
- Innovative Medicines Initiative 2 Joint Undertaking (115902)
- European Union's Horizon 2020 research and innovation programme and EFPIA
- National Institute for Health Research
- Biomedical Research Centre at South London
- Maudsley NHS Foundation Trust and King's College London
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- ecological momentary assessment, major depressive disorder, real-time health monitoring, participant dropout, acceptability, financial incentives
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
