The DOI matches its Crossref record; 44 of the 45 references it cites were found in a registry or an index.
A Smartphone Ecological Momentary Assessment/Intervention “App” for Collecting Real-Time Data and Promoting Self-Awareness
Open accessAbstract
We have designed a flexible ecological momentary assessment/intervention smartphone (EMA/EMI) "app". We examine the utility of this app for collecting real-time data, and assessing intra-subject variability, by using it to assess how freshman undergraduates spend their time. We also explore whether its use can promote greater self-awareness. Participants were randomly divided into an experimental group, who used the app, and a control group, who did not. We used the app to collect both randomized in-the-moment data as well as end-of-day data to assess time use. Using a posttest survey we asked participants questions about how they spent time throughout the school semester. We also asked the experimental group about their experience with the app. Among other findings, 80.49% participants indicated that they became more aware of how they spent their time using the app. Corroborating this report, among the experimental group, end-of-semester self-assessment of time spent wasted, and time spent using electronics recreationally, predicted semester GPA at a strength comparable to high school GPA and ACT score (two of the best single predictors for first semester college GPA), but had no correlation among controls. We discuss the advantages and limitations of using apps, such as ours, for EMA and/or EMI.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Mobile apps provide a means to more accurately record symptoms (e.g., depressive mood, anxious mood or fatigue) through real-time assessments that can be administered outside of the clinic and accurate recall and time of recording [94,95].”
From Wearables and the Medical Revolution (2018) · cites this paper as [94]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Transtheoretical Model of Health Behavior Change.
Prochaska, J. O., & Velicer, W. F. (1997) · American Journal of Health Promotion · doi:10.4278/0890-1171-12.1.38 · Cited by 7,782
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454
Diary Methods: Capturing Life as it is Lived
Bolger, N., Davis, A., & Rafaeli, E. (2003) · Annual Review of Psychology · doi:10.1146/annurev.psych.54.101601.145030 · Cited by 3,843
Handbook of research methods for studying daily life
Mehl, M. R., Conner, T. S., & Csíkszentmihályi, M. (2012) · Choice Reviews Online · doi:10.5860/choice.50-1159 · Cited by 2,121
Representative design and probabilistic theory in a functional psychology.
Brunswik, E. (1955) · Psychological Review · doi:10.1037/h0047470 · Cited by 1,600
Experience sampling research in psychopathology: opening the black box of daily life
Myin-Germeys, I., Oorschot, M., Collip, D., Lataster, J., Delespaul, P., & van Os, J. (2009) · Psychological Medicine · doi:10.1017/s0033291708004947 · Cited by 817
Patient non-compliance with paper diaries
Stone, A. A., Shiffman, S., Schwartz, J. E., Broderick, J. E., & Hufford, M. R. (2002) · BMJ · doi:10.1136/bmj.324.7347.1193 · Cited by 810
Ecological momentary assessment (EMA) in studies of substance use.
Shiffman, S. S. (2009) · Psychological Assessment · doi:10.1037/a0017074 · Cited by 764
Trull, T. J., & Ebner-Priemer, U. (2013) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185510 · Cited by 761
The Smartphone Psychology Manifesto
Miller, G. F. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612441215 · Cited by 671
Nock, M. K., Prinstein, M. J., & Sterba, S. K. (2009) · Journal of Abnormal Psychology · doi:10.1037/a0016948 · Cited by 662
Why researchers should think "within-person": A paradigmatic rationale.
Hamaker, E. L. (2012) · Cited by 472
Retrospective and Concurrent Self-Reports: The Rationale for Real-Time Data Capture
Schwarz, N. (2007) · Oxford University Press eBooks · doi:10.1093/oso/9780195178715.003.0002 · Cited by 389
Emotional reactivity to daily events in major and minor depression.
Bylsma, L. M., Taylor-Clift, A., & Rottenberg, J. (2011) · Journal of Abnormal Psychology · doi:10.1037/a0021662 · Cited by 388
Wolfe, H. K., & Wundt, W. M. (1897) · The Philosophical Review · doi:10.2307/2175592 · Cited by 366
Robbins, S. B., Allen, J., Casillas, A., Peterson, C. H., & Le, H. (2006) · Journal of Educational Psychology · doi:10.1037/0022-0663.98.3.598 · Cited by 362
Ecological Momentary Assessment
Kirchner, T., & Shiffman, S. S. (2013) · Wiley eBooks · doi:10.1002/9781118384404.ch20 · Cited by 288
The Science of Real-Time Data Capture: Self-Reports in Health Research
Atienza, A. A. (2007) · Cited by 287
Rizvi, S. L., Dimeff, L. A., Skutch, J., Carroll, D., & Linehan, M. M. (2011) · Behavior Therapy · doi:10.1016/j.beth.2011.01.003 · Cited by 271 · cited 1×
“All of the EMA/EMI studies mentioned above–and all that we are aware of to date save one using a smartphone app designed specifically for Borderline Personality Disorders [26]–have relied on cell phone calls, text messages, or handheld computers, each of which come with inherent limitations that have constrained the u…”
BackgroundAn overview of self-monitoring research in assessment and treatment.
Korotitsch, W. J., & Nelson-Gray, R. O. (1999) · Psychological Assessment · doi:10.1037/1040-3590.11.4.415 · Cited by 241
Feeling blue or turquoise? Emotional differentiation in major depressive disorder
Demiralp, E., Thompson, R. J., Mata, J., Jaeggi, S. M., Buschkuehl, M., Barrett, L. F., Ellsworth, P. C., Demiralp, M., Hernandez-Garcia, L., Deldin, P. J., et al. (2012) · Psychological Science · doi:10.1177/0956797612444903 · Cited by 205
Cohn, A. M., Hunter‐Reel, D., Hagman, B. T., & Mitchell, J. N. (2011) · Alcoholism Clinical and Experimental Research · doi:10.1111/j.1530-0277.2011.01571.x · Cited by 194
Ambulatory Assessment: An Innovative and Promising Approach for Clinical Psychology
Ebner-Priemer, U. W., & Trull, T. J. (2009) · European Psychologist · doi:10.1027/1016-9040.14.2.109 · Cited by 173
Johansen, B., & Wedderkopp, N. (2010) · Chiropractic & Manual Therapies · doi:10.1186/1746-1340-18-10 · Cited by 139
The impact of momentary pain and fatigue on physical activity in women with osteoarthritis
Murphy, S. L., Smith, D. M., Clauw, D. J., & Alexander, N. B. (2008) · Arthritis Care & Research · doi:10.1002/art.23710 · Cited by 134
A real-time assessment of work stress in physicians and nurses.
Rutledge, T. R., Stucky, E. R., Dollarhide, A. W., Shively, M., Jain, S., Wolfson, T. J., Weinger, M. B., & Dresselhaus, T. R. (2009) · Health Psychology · doi:10.1037/a0013145 · Cited by 109
Measurement reactivity in diary research.
Barta, W. D., Tennen, H. A., & Litt, M. D. (2012) · Cited by 108
Using mobile phones to measure adolescent diabetes adherence.
Mulvaney, S. A., Rothman, R. L., Dietrich, M. S., Wallston, K. A., Grove, E., Elasy, T. A., & Johnson, K. B. (2011) · Health Psychology · doi:10.1037/a0025543 · Cited by 103
Noble, J. P., & Sawyer, R. (2002) · Cited by 92
Berkman, E. T., Dickenson, J. A., Falk, E. B., & Lieberman, M. D. (2011) · Health Psychology · doi:10.1037/a0022201 · Cited by 85
Coaching for Behavior Change in Physiatry
Frates, E. P., Moore, M. A., Lopez, C. N., & McMahon, G. T. (2011) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/phm.0b013e31822dea9a · Cited by 75
ohmage: An open Mobile System for Activity and Experience Sampling
Ramanathan, N., Alquaddoomi, F., Falaki, H., George, D., Hsieh, C.-K., Jenkins, J., Ketcham, C., Longstaff, B., Ooms, J. C. L., Selsky, J., et al. (2012) · International Conference on Pervasive Computing Technologies for Healthcare · doi:10.4108/icst.pervasivehealth.2012.248705 · Cited by 68
Ferguson, S. G., & Shiffman, S. S. (2010) · Substance Use & Misuse · doi:10.3109/10826084.2011.521399 · Cited by 61
Wichers, M., Hartmann, J. A., Kramer, I. M. A., Lothmann, C., Peeters, F., van Bemmel, L., Myin-Germeys, I., Delespaul, P., van Os, J., & Simons, C. J. P. (2011) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2011.01684.x · Cited by 56
Psychometric properties of a computerized mobile phone method for assessing mood in daily life
Courvoisier, D. S., Eid, M., Lischetzke, T., & Schreiber, W. H. (2010) · Emotion · doi:10.1037/a0017813 · Cited by 56
Badr, H., Laurenceau, J., Schart, L., Basen-Engquist, K. M., & Turk, D. C. (2010) · Pain · doi:10.1016/j.pain.2010.08.022 · Cited by 54
Situational Temptation for HIV Medication Adherence in High-Risk Youth
MacDonell, K. K., Naar‐King, S., Murphy, D. A., Parsons, J. T., & Huszti, H. C. (2010) · AIDS Patient Care and STDs · doi:10.1089/apc.2010.0172 · Cited by 33
Palm or Cell? Comparing Personal Digital Assistants and Cell Phones for Experience Sampling Research
Burgin, C. J., Silvia, P. J., Eddington, K. M., & Kwapil, T. R. (2012) · Social Science Computer Review · doi:10.1177/0894439312441577 · Cited by 31
Noble, J. P., & Sawyer, R. (2002) · PsycEXTRA Dataset · doi:10.1037/e427952008-001 · Cited by 29
Feasibility of a daily electronic survey to study prevention behavior with HIV‐infected individuals
Cook, P. F., McElwain, C. J., & Bradley‐Springer, L. A. (2010) · Research in Nursing & Health · doi:10.1002/nur.20381 · Cited by 27
Axén, I., Bodin, L., Kongsted, A., Wedderkopp, N., Jensen, I. B., & Bergström, G. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-105 · Cited by 23
Research In Brief: Using Mobile Phones to Collect Daily Experience Data From College Undergraduates
Ravert, R. D., Calix, S. I., & Sullivan, M. J. (2010) · Journal of college student development · doi:10.1353/csd.0.0134 · Cited by 20
The influence of communication situation on self-report in people who stutter
James, S., Brumfitt, S. M., & Cowell, P. E. (2009) · International Journal of Speech-Language Pathology · doi:10.1080/17549500802588179 · Cited by 12
Von Wilhelm Wundt, Grundriss der Psychologie
Stevenson, E. F. (1896) · Mind · doi:10.1093/mind/v.20.564 · Cited by 5
Cited by
Sorted by citations
Sung, Y.-T., Chang, K.-E., & Liu, T.-C. (2016) · Computers & Education · doi:10.1016/j.compedu.2015.11.008 · Cited by 1,574
Wearables and the Medical Revolution
Dunn, J., Runge, R., & Snyder, M. (2018) · Personalized Medicine · doi:10.2217/pme-2018-0044 · Cited by 654
Does monitoring goal progress promote goal attainment? A meta-analysis of the experimental evidence.
Harkin, B., Webb, T. L., Chang, B. P. I., Prestwich, A., Conner, M., Kellar, I., Benn, Y., & Sheeran, P. (2016) · Psychological Bulletin · doi:10.1037/bul0000025 · Cited by 564
Social media and depression symptoms: A network perspective.
Aalbers, G., McNally, R. J., Heeren, A., de Wit, S., & Fried, E. I. (2018) · Journal of Experimental Psychology General · doi:10.1037/xge0000528 · Cited by 330
Clinical Child and Family Psychology Review
(2013) · Clinical Child and Family Psychology Review · doi:10.1007/10567.1573-2827 · Cited by 268
Metadata
- Authors
- Runyan, J. D., Steenbergh, T. A., Bainbridge, C., Daugherty, D. A., Oke, L., & Fry, B. N.
- Affiliations
- Indiana Wesleyan University (US)
- Corresponding author
- Runyan, Jason D.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-08-14
- Volume
- 8
- Issue
- 8
- Pages
- e71325
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3743745
- OpenAlex
- W2133044419
- Cited by
- 179
- References
- 45
- Citations by year
- 2026: 6 · 2025: 14 · 2024: 9 · 2023: 12 · 2022: 12 · 2021: 19 · 2020: 13 · 2019: 15 · 2018: 25 · 2017: 12 · 2016: 15 · 2015: 21 · 2014: 5 · 2013: 1
- FWCI
- 18.92
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Eli Lilly and Company
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- ecological momentary assessment, ecological momentary intervention, mobile application, self-awareness, time use, within-person variability, GPA prediction, time waste, mobile health
- MeSH terms
- Adolescent, Awareness, Data Collection, Female, Humans, Male, Surveys and Questionnaires, Self-Assessment, Space Perception, Task Performance and Analysis, Time Perception, Time Management, Cell Phone, Young Adult, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review