ULTEMAT: A mobile framework for smart ecological momentary assessments and interventions
Open accessAbstract
In this paper we introduce a new Android library, called ULTEMAT, for the delivery of ecological momentary assessments (EMAs) on mobile devices and we present its use in the MoodBuster app developed in the H2020 E-COMPARED project. We discuss context-aware, or event-based, triggers for the presentation of EMAs and discuss the potential they have to improve the effectiveness of mobile provision of mental health interventions as they allow for the delivery of assessments to the patients when and where these are most appropriate. Following this, we present the abilities of ULTEMAT to use such context-aware triggers to schedule EMAs and we discuss how a similar approach can be used for Ecological Momentary Interventions (EMIs).
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Smartphone embedded sensors make it possible to indirectly collect data about patients' behaviours and habits, such as social media use, physical activity, or social interactions.
“Unobtrusive wearable biosensors can continuously monitor physiological parameters throughout the day with high precision [17], whereas smartphone embedded sensors make it possible to indirectly collect data about patients’ behaviours and habits, such as their social media use, physical activity, or social interactions [18,19].”
From Current state and future directions of technology-based ecological momentary assessment and intervention for major depressive disorder: a systematic review (2019) · cites this paper as [19]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
(1932) · Medical Entomology and Zoology · Cited by 9,568 · see citing works
Validity and reliability of the Experience-Sampling Method
CSIKSZENTMIHALYI, M., & LARSON, R. (1987) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-198709000-00004 · Cited by 2,544 · see citing works
Heron, K. E., & Smyth, J. M. (2010) · British Journal of Health Psychology · doi:10.1348/135910709x466063 · Cited by 1,438 · see citing works
Harnessing context sensing to develop a mobile intervention for depression
Burns, M. N., Begale, M., Duffecy, J., Gergle, D., Karr, C. J., Giangrande, E., & Mohr, D. C. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1838 · Cited by 646 · cited 1× · see citing works
“Although smart EMEs will yet need to prove their worth, they hold a great promise for future connected health interventions as they allow for the scheduling of intervention content when and where this matters most.”
Feasibility, Acceptability, and Preliminary Efficacy of a Smartphone Intervention for Schizophrenia
Ben-Zeev, D., Brenner, C. J., Begale, M., Duffecy, J., Mohr, D. C., & Mueser, K. T. (2014) · Schizophrenia Bulletin · doi:10.1093/schbul/sbu033 · Cited by 493 · see citing works
Froehlich, J. E., Chen, M. Y., Consolvo, S., Harrison, B. L., & Landay, J. A. (2007) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/1247660.1247670 · Cited by 488 · see citing works
The Handbook of Behavioral Medicine
(2014) · Wiley eBooks · doi:10.1002/9781118453940 · Cited by 343 · see citing works
The science of real-time data capture: self-reports in health research
Domingo‐Salvany, A. (2008) · Journal of Epidemiology & Community Health · doi:10.1136/jech.2007.068551 · Cited by 241 · see citing works
Depp, C. A., Ceglowski, J., Wang, V. C., Yaghouti, F., Mausbach, B. T., Thompson, W. K., & Granholm, E. L. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.10.053 · Cited by 215 · see citing works
Use of ecological momentary assessment in mood disorders research
Wenze, S. J., & Miller, I. W. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.06.007 · Cited by 205 · see citing works
Walz, L. C., Nauta, M. H., & aan het Rot, M. (2014) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2014.09.022 · Cited by 195 · cited 1× · see citing works
“For example, Walz et al. (2014) performed a review of EMA use for anxiety disorder studies between 1997 and 2014 in studies using paper diaries, dedicated apps on personal digital assistants and phones (voice calls) for the collection of the EMAs.”
Asselbergs, J., Ruwaard, J., Ejdys, M., Schrader, N., Sijbrandij, M., & Riper, H. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5505 · Cited by 192 · see citing works
A context-aware experience sampling tool
Intille, S. S., Rondoni, J., Kukla, C., Ancona, I., & Bao, L. (2003) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/765891.766101 · Cited by 178 · see citing works
Wichers, M. C., Myin‐Germeys, I., Jacobs, N., Peeters, F., Kenis, G., Derom, C., Vlietinck, R., Delespaul, P., & Van Os, J. (2007) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2006.00924.x · Cited by 165 · see citing works
Ramanathan, N., Swendeman, D. T., Comulada, W. S., Estrin, D. L., & Rotheram‐Borus, M. J. (2012) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2012.05.009 · Cited by 153 · see citing works
Signaling does not adequately improve diary compliance
Broderick, J. E., Schwartz, J. E., Shiffman, S. S., Hufford, M. R., & Stone, A. A. (2003) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2602_06 · Cited by 151 · see citing works
Kleiboer, A., Smit, J., Bosmans, J., Ruwaard, J., Andersson, G., Topooco, N., Berger, T., Krieger, T., Botella, C., Baños, R., et al. (2016) · Trials · doi:10.1186/s13063-016-1511-1 · Cited by 133 · see citing works
Self-citationA Serious Game for Clinical Assessment of Cognitive Status: Validation Study
Tong, T., Chignell, M., Tierney, M. C., & Lee, J. (2016) · JMIR Serious Games · doi:10.2196/games.5006 · Cited by 132 · see citing works
Kooistra, L. C., Wiersma, J. E., Ruwaard, J., van Oppen, P., Smit, F., Lokkerbol, J., Cuijpers, P., & Riper, H. (2014) · BMC Psychiatry · doi:10.1186/s12888-014-0290-z · Cited by 82 · see citing works
Self-citationJuarascio, A. S., Goldstein, S. P., Manasse, S. M., Forman, E. M., & Butryn, M. L. (2015) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2015.06.004 · Cited by 81 · see citing works
Technological Innovations Enabling Automatic, Context-Sensitive Ecological Momentary Assessment
Intille, S. S. (2007) · The Science of Real-Time Data Capture · doi:10.1093/oso/9780195178715.003.0016 · Cited by 72 · see citing works
Random sampling of cognitions and behavior
Hurlburt, R. T. (1979) · Journal of Research in Personality · doi:10.1016/0092-6566(79)90045-x · Cited by 69 · see citing works
van Ballegooijen, W., Ruwaard, J., Karyotaki, E., Ebert, D. D., Smit, J. H., & Riper, H. M. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-1065-5 · Cited by 32 · see citing works
Self-citationMobile health monitoring to characterize depression symptom trajectories in primary care
Pfeiffer, P. N., Bohnert, K. M., Zivin, K., Yosef, M., Valenstein, M. M., Aikens, J. E., & Piette, J. D. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.11.040 · Cited by 17 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Colombo, D., Fernández-Álvarez, J., Patané, A., Semonella, M., Kwiatkowska, M., García-Palacios, A., Cipresso, P., Riva, G., & Botella, C. (2019) · Journal of Clinical Medicine · doi:10.3390/jcm8040465 · Cited by 194 · see citing works
Kemmeren, L. L., van Schaik, A., Smit, J. H., Ruwaard, J., Rocha, A., Henriques, M., Ebert, D. D., Titzler, I., Hazo, J.-B., Dorsey, M., et al. (2019) · JMIR Mental Health · doi:10.2196/12707 · Cited by 36 · see citing works
Self-citation
- Authors
- van de Ven, P., O’Brien, H., Henriques, R., Klein, M., Msetfi, R., Nelson, J., Rocha, A., Ruwaard, J., O’Sullivan, D., & Riper, H.
- Affiliations
- University of Limerick (IE)
- Vrije Universiteit Amsterdam (NL)
- INESC TEC (PT)
- Venue
- Internet Interventions
- Publisher
- Elsevier BV
- Published
- 2017-09
- Volume
- 9
- Pages
- 74-81
- ISSN
- 2214-7829 (ISSN-L)
- PMC
- PMC6096290
- OpenAlex
- W2730583541
- Cited by
- 26
- References
- 24
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 4 · 2023: 1 · 2022: 4 · 2021: 4 · 2020: 5 · 2019: 3 · 2018: 3
- FWCI
- 3.44
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Internet Interventions (publishedVersion, cc-by-nc-nd)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- VU Research Portal (publishedVersion, other-oa)
- University of Limerick Institutional Repository (University of Limerick) (acceptedVersion)
- Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) (submittedVersion, other-oa)
- Arrow@dit (Dublin Institute of Technology) (submittedVersion, cc-by-nc-sa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by-nc-sa)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Funders
- Seventh Framework Programme (603098-2)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- ecological momentary assessment, ecological momentary intervention, mobile health, Android library, mood tracking, mental health interventions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review