The DOI matches its Crossref record; 44 of the 45 references it cites were found in a registry or an index.
A Smartphone Ecological Momentary Assessment/Intervention “App” for Collecting Real-Time Data and Promoting Self-Awareness
Open accessAbstract
We have designed a flexible ecological momentary assessment/intervention smartphone (EMA/EMI) "app". We examine the utility of this app for collecting real-time data, and assessing intra-subject variability, by using it to assess how freshman undergraduates spend their time. We also explore whether its use can promote greater self-awareness. Participants were randomly divided into an experimental group, who used the app, and a control group, who did not. We used the app to collect both randomized in-the-moment data as well as end-of-day data to assess time use. Using a posttest survey we asked participants questions about how they spent time throughout the school semester. We also asked the experimental group about their experience with the app. Among other findings, 80.49% participants indicated that they became more aware of how they spent their time using the app. Corroborating this report, among the experimental group, end-of-semester self-assessment of time spent wasted, and time spent using electronics recreationally, predicted semester GPA at a strength comparable to high school GPA and ACT score (two of the best single predictors for first semester college GPA), but had no correlation among controls. We discuss the advantages and limitations of using apps, such as ours, for EMA and/or EMI.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Mobile apps provide a means to more accurately record symptoms (e.g., depressive mood, anxious mood or fatigue) through real-time assessments that can be administered outside of the clinic and accurate recall and time of recording [94,95].”
From Wearables and the Medical Revolution (2018) · cites this paper as [94]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Transtheoretical Model of Health Behavior Change.
Prochaska, J. O., & Velicer, W. F. (1997) · American Journal of Health Promotion · doi:10.4278/0890-1171-12.1.38 · Cited by 7,782
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454
Diary Methods: Capturing Life as it is Lived
Bolger, N., Davis, A., & Rafaeli, E. (2003) · Annual Review of Psychology · doi:10.1146/annurev.psych.54.101601.145030 · Cited by 3,843
Handbook of research methods for studying daily life
Mehl, M. R., Conner, T. S., & Csíkszentmihályi, M. (2012) · Choice Reviews Online · doi:10.5860/choice.50-1159 · Cited by 2,121
Representative design and probabilistic theory in a functional psychology.
Brunswik, E. (1955) · Psychological Review · doi:10.1037/h0047470 · Cited by 1,600
Experience sampling research in psychopathology: opening the black box of daily life
Myin-Germeys, I., Oorschot, M., Collip, D., Lataster, J., Delespaul, P., & van Os, J. (2009) · Psychological Medicine · doi:10.1017/s0033291708004947 · Cited by 817
Patient non-compliance with paper diaries
Stone, A. A., Shiffman, S., Schwartz, J. E., Broderick, J. E., & Hufford, M. R. (2002) · BMJ · doi:10.1136/bmj.324.7347.1193 · Cited by 810
Ecological momentary assessment (EMA) in studies of substance use.
Shiffman, S. S. (2009) · Psychological Assessment · doi:10.1037/a0017074 · Cited by 764
Trull, T. J., & Ebner-Priemer, U. (2013) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185510 · Cited by 761
The Smartphone Psychology Manifesto
Miller, G. F. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612441215 · Cited by 671
Flagged first, then by citations
1 of the 45 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Items 101–179 of 179
Well-being in amyotrophic lateral sclerosis: a pilot experience sampling study
Real, R. G. L., Dickhaus, T., Ludolph, A. C., Hautzinger, M., & Kübler, A. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00704 · Cited by 8
Koudela-Hamila, S., Grund, A., Santangelo, P., & Ebner‐Priemer, U. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.01430 · Cited by 7
Gharani, P., Karimi, H. A., Syzdykbayev, M., Burke, L. E., Rathbun, S. L., Davis, E. M., Gary‐Webb, T. L., & Méndez, D. D. (2021) · Informatics for Health and Social Care · doi:10.1080/17538157.2021.1877140 · Cited by 8
Borjalilu, S. (2023) · International Journal of Islamic Educational Psychology · doi:10.18196/ijiep.v4i1.16513 · Cited by 10
Kiepek, N. C., Beagan, B. L., & Harris, J. (2018) · Performance Enhancement & Health · doi:10.1016/j.peh.2018.02.003 · Cited by 8
Brophy‐Herb, H. E., Brincks, A. M., Cook, J. L., Stacks, A. M., Vallotton, C. D., Frosch, C. A., Carson, R. L., Wheeler, R., Perkins, H. A., & Jennings, P. A. (2022) · Early Education and Development · doi:10.1080/10409289.2022.2151399 · Cited by 11
Knowles, L. M., Skeath, P. R., Jia, M., Najafi, B., Thayer, J. F., & STERNBERG, E. M. (2015) · Gerontology · doi:10.1159/000441494 · Cited by 7
Methods of Studying Economic Decisions in Private Households
Kirchler, E. M., Winter, L., & Penz, E. (2016) · Revista crítica de ciências sociais/Revista crítica de ciências sociais · doi:10.4000/rccs.6467 · Cited by 7
Measuring the Psychobiological Correlates of Daily Experience in Adolescents
Dockray, S., O’Neill, S. B., & Jump, O. (2019) · Journal of Research on Adolescence · doi:10.1111/jora.12473 · Cited by 8
Axén, I., & Bodin, L. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0221-4 · Cited by 6
Vhaduri, S., Cho, J., & Meng, K. (2023) · Smart Health · doi:10.1016/j.smhl.2023.100398 · Cited by 6
Jonassaint, C. R., Kang, C., Abrams, D. M., Li, J. J., Mao, J. M., Jia, Y., Long, Q., Sanger, M., Jonassaint, J., Castro, L. M. D., et al. (2017) · British Journal of Haematology · doi:10.1111/bjh.14956 · Cited by 6
Schmiegelow, K., & Frandsen, T. L. (2018) · The Lancet Haematology · doi:10.1016/s2352-3026(18)30070-x · Cited by 6
Zeni, M., Bison, I., Reis, F., Gauckler, B., & Giunchiglia, F. (2021) · Journal of Official Statistics · doi:10.2478/jos-2021-0015 · Cited by 6
Yerima, S. Y., Loughlin, M., Sezer, S., Moriarty, J., McCann, M., McAneney, H., O’Hara, L., Tully, M. A., Ell, P. S., Miller, R., et al. (2018) · SoftwareX · doi:10.1016/j.softx.2018.04.006 · Cited by 6
Braun, B. J., Menger, M. M., Histing, T., Marmor, M. T., Grimm, B. P., Fischer, F. H., Harrison, C. J., Joeris, A., Lambert, S. M., Beeres, F. J. P., et al. (2025) · EFORT Open Reviews · doi:10.1530/eor-2024-0154 · Cited by 5
Brophy‐Herb, H. E., Stacks, A. M., Frosch, C. A., Brincks, A. M., Cook, J. L., Vallotton, C. D., Perkins, H. A., Kim, L., Carson, R. L., Muzik, M., et al. (2022) · Early Childhood Education Journal · doi:10.1007/s10643-022-01416-0 · Cited by 6
Poluha, R. L., Macário, H. S., Câmara‐Souza, M. B., Canales, G. D. L. T., Ernberg, M. M., & Stuginski‐Barbosa, J. (2024) · Journal of Oral Rehabilitation · doi:10.1111/joor.13667 · Cited by 6
Batalas, N., Khan, V.-J., Franzen, M., Markopoulos, P., & Rot, M. A. H. (2018) · Behavior Research Methods · doi:10.3758/s13428-018-1148-y · Cited by 5
Khatib, T., Alwaneh, H., Mabroukeh, W., Abu-Ghalion, Y., Abu-Gadi, F., Assali, A., Elmenreich, W., & Zarour, M. (2021) · Sustainability · doi:10.3390/su13010433 · Cited by 5
Badiyepeymaiejahromi, Z., Yektatalab, S., Momennasab, M., & Mehrabi, M. (2023) · Investigación y Educación en Enfermería · doi:10.17533/udea.iee.v41n1e15 · Cited by 5
Altweck, L., Schmidt, S., & Tomczyk, S. (2024) · JMIR Research Protocols · doi:10.2196/54728 · Cited by 4
Taylor, A., Hayes, R., Nwokolo, N. C., Whitlock, G. G., Dosekun, O., McCormack, S., Gafos, M., & Evangeli, M. (2023) · AIDS and Behavior · doi:10.1007/s10461-023-04151-8 · Cited by 4
Gütges, I. D., Xi, H., Gauggel, S., & Forster, S. D. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1576353 · Cited by 7
Skeen, S. J., Tokarz, S., Gasik, R. E., Solano, C. M., Smith, E. A., Sagoe, M. B., Hudson, L. V., Steele, K., Theall, K. P., & Clum, G. A. (2023) · JMIR Research Protocols · doi:10.2196/47151 · Cited by 7
Legewie, N. M., & Fasang, A. E. (2021) · Edward Elgar Publishing eBooks · doi:10.4337/9781788975544.00014 · Cited by 5
Duncan, D. T., Goedel, W. C., Williams, J. H., & Elbel, B. D. (2017) · BMC Research Notes · doi:10.1186/s13104-017-2850-z · Cited by 4
Skills for life: A review of life skills and their measurability, malleability, and meaningfulness
McGrath, R. E., & Adler, A. (2022) · doi:10.18235/0004414 · Cited by 8
Cross-Platform Ecological Momentary Assessment App (JTrack-EMA+): Development and Usability Study
Far, M. S., Fischer, J. M., Senge, S., Rathmakers, R., Meißner, T., Schneble, D., Narava, M., Eickhoff, S. B., & Dukart, J. (2024) · Journal of Medical Internet Research · doi:10.2196/51689 · Cited by 3
Dubord, M. G., Gagné, M., Dubreuil, P., & Forest, J. (2025) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2025.2566811 · Cited by 3
Altweck, L., & Tomczyk, S. (2025) · JMIR Formative Research · doi:10.2196/67451 · Cited by 3
Using Paradata to Evaluate Youth Participation in a Digital Diary Study
Tienda, M., & Koffman, D. (2020) · Social Science Computer Review · doi:10.1177/0894439320929272 · Cited by 3
A Mobile-Based Multimodal Framework for Pervasive Health Monitoring
Mastoras, R.-E., Triantafyllidis, A. K., Giakoumis, D., Kordonias, R.-K., Papaprodromou, A., Nalbadis, F., Segkouli, S., Lithoxoidou, E. E., Georgiadis, C., Paliokas, I., et al. (2021) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomworkshops51409.2021.9430967 · Cited by 3
Ajlouni, A. O., Wahba, F. A.-A., & Almahaireh, A. S. (2023) · International Journal of Online and Biomedical Engineering (iJOE) · doi:10.3991/ijoe.v19i06.38533 · Cited by 5
Core contents for digital healthcare services across the life span
Kim, J., Lee, J.-Y., Yang, S.-Y., & Kim, H. (2023) · 보건교육·건강증진학회지 · doi:10.14367/kjhep.2023.40.4.33 · Cited by 3
New Technology in the Assessment and Treatment of Obesity
Ramalho, S. M., Silva, C., Pinto‐Bastos, A., & Conceição, E. (2015) · Springer eBooks · doi:10.1007/978-3-319-19821-7_20 · Cited by 3
End-User Development in Social Psychology Research: Factors for Adoption
Rough, D. J., & Quigley, A. J. (2018) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2018.8506573 · Cited by 3
Stewart, M., Nezich, T., Lee, J. M., Hasson, R., & Colabianchi, N. (2021) · JMIR mHealth and uHealth · doi:10.2196/17581 · Cited by 3
Attitudes About COVID-19 and Health (ATTACH): Online Survey and Mixed Methods Study
Hood, A., Stotesbury, H., Murphy, J., Kölbel, M., Slee, A. E., Springall, C., Paradis, M., Corral-Frías, N. S., Reyes-Aguilar, A., Barboza, A. B. C., et al. (2021) · JMIR Mental Health · doi:10.2196/29963 · Cited by 2
Bouldin, E. D., Delgado, R. E., Peacock, K. S., Hale, W. J., Roghani, A., Trevino, A. Y., Viny, M., Wetter, D. W., & Pugh, M. J. (2021) · JMIR Research Protocols · doi:10.2196/30975 · Cited by 2
Mobile Health Solutions for Tinnitus
Mehdi, M., Hauck, F. J., Pryss, R., & Schlee, W. (2024) · Springer eBooks · doi:10.1007/978-3-031-35647-6_57 · Cited by 2
A Methodology and a Platform for High-quality Rich Personal Data Collection
Kayongo, I., Malcotti, L. J., Zhao, H., & Giunchiglia, F. (2025) · The European Journal on Artificial Intelligence · doi:10.1177/30504554251333615 · Cited by 2
Laure, T., Meija, C. V., Remmerswaal, D., Dulloo, D., der Hallen, R. V., Mayer, B., Littel, M., Dierckx, B., Legerstee, J. S., Engels, R. C. M. E., et al. (2025) · JMIR Formative Research · doi:10.2196/63325 · Cited by 2
Shrier, L. A., & Harris, S. K. (2022) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2022.09.002 · Cited by 4
Online Intervention for Muscle Tension Dysphonia
Nguyen‐Feng, V. N., Frazier, P. A., Liu, Y., Feddema, E., Wils, B., Nikcevich, E., Stockness, A., Lim, K. O., Hu, A. C., Butcher, L., et al. (2025) · JAMA Otolaryngology–Head & Neck Surgery · doi:10.1001/jamaoto.2024.5255 · Cited by 3
A platform for user empowerment through Self Ecological Momentary Assessment / Intervention
Álvarez, R., Murua, A., Artetxe, A., Epelde, G., & Beristain, A. (2015) · Wireless Mobile Communication and Healthcare · doi:10.4108/eai.14-10-2015.2261615 · Cited by 2
L’apport du numérique en santé mentale : beaucoup d’espoir, quelques inquiétudes
Gorwood, P. A. P. M. (2017) · Soins Psychiatrie · doi:10.1016/j.spsy.2017.04.006 · Cited by 2
Big Data y Psicología: ¿una oportunidad para el Internet de las Personas?
Armayones, M., Gómez‐Zúñiga, B., Encuentra, E. H., & Pousada, M. (2015) · Aloma: revista de psicologia, ciències de l'educació i de l'esport Blanquerna · doi:10.51698/aloma.2015.33.2.21-29 · Cited by 2
Ferguson, S. G., Jahnel, T., Elliston, K. G., & Shiffman, S. S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781316995808.029 · Cited by 2
Huff, E. S., & Kittredge, D. B. (2020) · Forests · doi:10.3390/f11090944 · Cited by 1
Asare, E. V., Ghunney, W. K., Ayete-Nyampong, J. B., Mensah, E. A., Swarray-Deen, A., Olayemi, E., Boafor, T., Jonassaint, J., Jonassaint, C. R., Rodeghier, M., et al. (2025) · Blood Advances · doi:10.1182/bloodadvances.2024015750 · Cited by 1
Caudroit, J., St‐Amour, S., Lapointe, J., Romain, A. J., Comtois, A. S., Chevance, G., & Bernard, P. (2025) · Clinical Psychology in Europe · doi:10.32872/cpe.14851 · Cited by 2
Intensive Longitudinal Designs
Wright, A. G. C., & Hallquist, M. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781316995808.028 · Cited by 1
Willoughby, J. F., Gibbons, S., & Hundley, S. L. (2022) · Journalism & Mass Communication Quarterly · doi:10.1177/10776990221112949 · Cited by 1
Libro de ponencias del VI Congreso de la FEDN (2014)
Baladía, E. (2014) · Revista Española de Nutrición Humana y Dietética · doi:10.14306/renhyd.18.0.129 · Cited by 1
Graham, K. M. (2017) · D-Scholarship@Pitt (University of Pittsburgh) · Cited by 1
Caudroit, J., St‐Amour, S., Lapointe, J., Romain, A. J., Comtois, & Bernard, P. (2024) · doi:10.31234/osf.io/bfmjc · Cited by 1
McKeon, A. B. (2016) · D-Scholarship@Pitt (University of Pittsburgh)
Ashurst, J. (2016) · Arizona State University Library Digital Repository (Arizona State University)
Reflections on ESM in the Wild
Roig-Maimó, M. F., Varona, J., & Manresa-Yee, C. (2018) · International Conference on Human Computer Interaction (Interacción) · doi:10.1145/3233824.3233825
Digital Health for the Opioid Crisis: A Historical Analysis of NIH Funding from 2013 to 2017
Lin, E.-J. D., Schroeder, M., Huang, Y., & Linwood, S. L. (2022) · Exon Publications eBooks · doi:10.36255/exon-publications-digital-health-opioid-crisis
Methodische Aspekte der Stressforschung
Kasten, N., & Fuchs, R. (2016) · Springer eBooks · doi:10.1007/978-3-662-49411-0_7-1
Digital Health for the Opioid Crisis: Funding the Future (Preprint)Preprint
Lin, E.-J. D., Schroeder, M., Huang, Y., & Lin, S. M. (2020) · doi:10.2196/preprints.20442
Kache, P. A., Bron, G. M., Zapata-Ramirez, S., Tsao, J. I., Bartholomay, L. C., Paskewitz, S. M., Diuk‐Wasser, M. A., & Fernández, M. D. P. (2022) · Research Square · doi:10.21203/rs.3.rs-2222034/v1
Measuring subjective experiences using wearable microinteractions
Ponnada, A. (2021) · Digital Repository Service (Northeastern University) · doi:10.17760/d20467309
(2025) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-83797-428-320251009
Puffer, K. A., & Brooks, R. (2025) · Religions · doi:10.3390/rel16040468
Comparative analysis of Mobile Crowdsensing and Ecological Momentary Assessment systems
Stach, M., Ramović, A., Reichert, M., & Pryss, R. C. (2025) · Ecological Informatics · doi:10.1016/j.ecoinf.2025.103315 · Cited by 1
Wong, V. W.-H., Shi, N.-K., Lee, L., Chan, S. W. Y., Ng, C. H., Sarris, J. J., & Ho, F. Y. (2025) · Scientific Reports · doi:10.1038/s41598-025-21688-x
The Cultural Psychology of Treat
Kevin, R. C. (2020) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-64802-258-620251017
Jenny, G. J., & Schreiber, M. (2020) · OSF Preprints (OSF Preprints)
Petagna, K. D., Ecker, A., Reid, T. E., McMullen, K. M., Quigley, K. S., & Wormwood, J. B. (2026) · International Journal of Clinical and Health Psychology · doi:10.1016/j.ijchp.2025.100659 · Cited by 3
Sui, M., & Hawkins, I. (2026) · Media Psychology · doi:10.1080/15213269.2026.2614630
Reyes, S. R., & Benuto, L. T. (2026) · Hispanic Journal of Behavioral Sciences · doi:10.1177/07399863261448704 · Cited by 1
Cognitive Load or Timely Answers? Cognitive Effort Markers in Context-Aware EMA Sampling
Li, X., & Zhao, H. (2026) · Data · doi:10.3390/data11090221
Efficacy of Technology-Augmented Behavioral Counseling for Risky Firearm Behaviors
Carter, P. M., Resnicow, K., Stallworth, P., Goldstick, J. E., Carrillo, A., Seewald, L., Cunningham, R. M., Massey, L., Battisti, K. A., Schoener, B., et al. (2026) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2026.3893
Home-Based Virtual Reality for Cognitive Monitoring in Breast Cancer
Matsangidou, M., Hadjipanayi, V., Solomou, T., Kazalaki, I., Panayiotou, G., Constantinidou, A., Karekla, M., Avraamides, M. N., Pattichis, C. S., & Kassianos, A. P. (2026) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/3821581.3833110
Metadata
- Authors
- Runyan, J. D., Steenbergh, T. A., Bainbridge, C., Daugherty, D. A., Oke, L., & Fry, B. N.
- Affiliations
- Indiana Wesleyan University (US)
- Corresponding author
- Runyan, Jason D.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-08-14
- Volume
- 8
- Issue
- 8
- Pages
- e71325
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3743745
- OpenAlex
- W2133044419
- Cited by
- 179
- References
- 45
- Citations by year
- 2026: 6 · 2025: 14 · 2024: 9 · 2023: 12 · 2022: 12 · 2021: 19 · 2020: 13 · 2019: 15 · 2018: 25 · 2017: 12 · 2016: 15 · 2015: 21 · 2014: 5 · 2013: 1
- FWCI
- 18.92
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Eli Lilly and Company
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- ecological momentary assessment, ecological momentary intervention, mobile application, self-awareness, time use, within-person variability, GPA prediction, time waste, mobile health
- MeSH terms
- Adolescent, Awareness, Data Collection, Female, Humans, Male, Surveys and Questionnaires, Self-Assessment, Space Perception, Task Performance and Analysis, Time Perception, Time Management, Cell Phone, Young Adult, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
