Psychometric properties of a computerized mobile phone method for assessing mood in daily life
Open accessAbstract
Ecological momentary assessment is a method that is now largely used to study behavior and mood in the settings in which they naturally occur. It maximizes ecological validity and avoids the limitations of retrospective self-reports. Studies on the psychometric properties of scales administered via mobile phone ecological momentary assessment are lacking. Therefore, we collected data on a 4-item mood scale measuring well being on six occasions per day for 7 days (N = 307) and examined compliance rate across time, within day, and within week. Using specific latent state-trait structural equation models, we analyzed the degree to which interindividual mood differences on an occasion of measurement were because of (a) measurement error, (b) stable differences in mood level, and (c) occasion-specific differences. Results show good compliance (mean compliance: 74.9% of calls answered). Moreover, the scale showed good reliability (M = .82). Mood was mostly stable, especially the first 3 days of the week. It depended weakly albeit significantly on the previous assessment (autoregressive coefficient). In conclusion, computerized mobile phone assessment is an appropriate, easy-to-use, and promising method to measure mood.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Psychometric properties of mobile phone tools could differ from those of traditional questionnaires because they are not always used in the same context.
“These properties could potentially differ from those used for more traditional questionnaires, because they are not always used in the same context—e.g., users could fill out the questionnaire on their phone while they perform other tasks at home (123).”
From Mobile intervention for individuals with psychosis, dual disorders, and their common comorbidities: A literature review (2019) · cites this paper as [123]
Very few studies have examined the psychometric properties of tools used to collect information on mobile phones.
“Furthermore, very few studies have examined the psychometric properties of tools used to collect information on mobile phones.”
From Mobile intervention for individuals with psychosis, dual disorders, and their common comorbidities: A literature review (2019) · cites this paper as [123]
Cites
Well-being : the foundations of hedonic psychology
Kahneman, D. J., Diener, E. F., & Schwarz, N. (1999) · Cited by 7,472 · see citing works
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454 · see citing works
The nature of emotion: Fundamental questions.
Ekman, P., & Davidson, R. J. (1994) · Oxford University Press eBooks · Cited by 2,839 · see citing works
Ecological Momentary Assessment (Ema) in Behavioral Medicine
Stone, A. A., & Shiffman, S. (1994) · Annals of Behavioral Medicine · doi:10.1093/abm/16.3.199 · Cited by 1,931 · see citing works
Yuan, K.-H., & Bentler, P. (2000) · Sociological Methodology · doi:10.1111/0081-1750.00078 · Cited by 1,847 · see citing works
Belief and feeling: Evidence for an accessibility model of emotional self-report.
Robinson, M. D., & Clore, G. L. (2002) · Psychological Bulletin · doi:10.1037/0033-2909.128.6.934 · Cited by 1,806 · see citing works
Patient compliance with paper and electronic diaries
Stone, A. A., Shiffman, S., Schwartz, J. E., Broderick, J. E., & Hufford, M. R. (2003) · Controlled Clinical Trials · doi:10.1016/s0197-2456(02)00320-3 · Cited by 910 · see citing works
Refining the measurement of mood: The UWIST Mood Adjective Checklist
Matthews, G., Jones, D. M., & Chamberlain, A. G. (1990) · British Journal of Psychology · doi:10.1111/j.2044-8295.1990.tb02343.x · Cited by 862 · see citing works
Patient non-compliance with paper diaries
Stone, A. A., Shiffman, S., Schwartz, J. E., Broderick, J. E., & Hufford, M. R. (2002) · BMJ · doi:10.1136/bmj.324.7347.1193 · Cited by 810 · see citing works
Mood and the mundane: Relations between daily life events and self-reported mood.
Clark, L. A., & Watson, D. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.2.296 · Cited by 784 · see citing works
Global Judgments of Subjective Well-Being: Situational Variability and Long-Term Stability
Eid, M., & Diener, E. (2004) · Social Indicators Research · doi:10.1023/b:soci.0000003801.89195.bc · Cited by 714 · see citing works
Intraindividual variability in affect: Reliability, validity, and personality correlates.
Eid, M., & Diener, E. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.76.4.662 · Cited by 571 · see citing works
Parkinson, B. (1996) · British Journal of Psychology · doi:10.1111/j.2044-8295.1996.tb02615.x · Cited by 521 · see citing works
Handbook of multimethod measurement in psychology.
Eid, M., & Diener, E. (2006) · American Psychological Association eBooks · doi:10.1037/11383-000 · Cited by 492 · see citing works
Models for Intensive Longitudinal Data
(2006) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195173444.001.0001 · Cited by 367 · see citing works
Varieties of affect: Emotions and episodes, moods, and sentiments.
Frijda, N. H. (1994) · UvA-DARE (University of Amsterdam) · Cited by 324 · see citing works
Ambulatory Assessment - Monitoring Behavior in Daily Life Settings
Fahrenberg, J., Myrtek, M., Pawlik, K., & Perrez, M. (2007) · European Journal of Psychological Assessment · doi:10.1027/1015-5759.23.4.206 · Cited by 317 · see citing works
Cole, D. A., Martin, N. C., & Steiger, J. H. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.1.3 · Cited by 314 · see citing works
Stone, A. A., Broderick, J. E., Schwartz, J. E., Shiffman, S., Litcher-Kelly, L., & Calvanese, P. (2003) · Pain · doi:10.1016/s0304-3959(03)00040-x · Cited by 293 · see citing works
The Science of Real-Time Data Capture: Self-Reports in Health Research
Atienza, A. A. (2007) · Cited by 289 · see citing works
States and traits in psychological assessment.
Steyer, R., Ferring, D., & Schmitt, M. (1992) · Open Repository and Bibliography (University of Luxembourg) · Cited by 266 · see citing works
(2010) · Sociological Methodology · doi:10.1111/(issn)1467-9531 · Cited by 256 · see citing works
(1990) · Choice Reviews Online · doi:10.5860/choice.27-4813 · Cited by 248 · see citing works
Collins, R. L., Kashdan, T. B., & Gollnisch, G. (2003) · Experimental and Clinical Psychopharmacology · doi:10.1037//1064-1297.11.1.73 · Cited by 185 · see citing works
Cell phones for ecological momentary assessment with cocaine-addicted homeless patients in treatment
Freedman, M. J., Lester, K. M., McNamara, C. L., Milby, J. B., & Schumacher, J. E. (2006) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2005.10.005 · Cited by 168 · see citing works
Technology and Methods in Behavioral Medicine
Krantz, D. S., Baum, A. E., & Baum, A. S. (1998) · Psychology Press eBooks · doi:10.4324/9781410602770 · Cited by 157 · see citing works
Tidey, J. W., Monti, P. M., Rohsenow, D. J., Gwaltney, C. J., Miranda, R., McGeary, J. E., MacKillop, J. M., Swift, R. M., Abrams, D. B., Shiffman, S. M., et al. (2007) · Alcoholism Clinical and Experimental Research · doi:10.1111/j.1530-0277.2007.00545.x · Cited by 135 · see citing works
Meldrum, S. J. (2002) · Physiological Measurement · doi:10.1088/0967-3334/23/3/701 · Cited by 111 · see citing works
Mehl, M. R., & Holleran, S. E. (2007) · European Journal of Psychological Assessment · doi:10.1027/1015-5759.23.4.248 · Cited by 100 · see citing works
Why Extraverts Are Happier Than Introverts: The Role of Mood Regulation
Lischetzke, T., & Eid, M. (2006) · Journal of Personality · doi:10.1111/j.1467-6494.2006.00405.x · Cited by 92 · see citing works
Do you feel better or worse? The validity of perceived deviations of mood states from mood traits
Eid, M., Schneider, C., & Schwenkmezger, P. (1999) · European Journal of Personality · doi:10.1002/(sici)1099-0984(199907/08)13:4 · Cited by 89 · see citing works
Persons in situations: distinguishing new wine from old wine in new bottles
Johnson, J. A. (1999) · European Journal of Personality · doi:10.1002/(sici)1099-0984(199909/10)13:5 · Cited by 78 · see citing works
Ecological momentary assessment: A new tool for behavioral medicine research.
Shiffman, S. M., & Stone, A. A. (1998) · Cited by 75 · see citing works
Marco, C. A., Neale, J. M., Schwartz, J. E., Shiffman, S. M., & Stone, A. A. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.67.5.755 · Cited by 70 · see citing works
Mood state and gambling: Using mobile telephones to track emotions
Gee, P., Coventry, K. R., & Birkenhead, D. (2005) · British Journal of Psychology · doi:10.1348/000712604x15536 · Cited by 61 · see citing works
Ecological Momentary Assessment: Real-world, real-time measurement of patient experience.
Hufford, M. R., Shiffman, S. M., Paty, J. A., & Stone, A. A. (2001) · Cited by 53 · see citing works
Validating scales for the assessment of mood level and variability by latent state-trait analyses
Eid, M., Notz, P., Steyer, R., & Schwenkmezger, P. (1994) · Personality and Individual Differences · doi:10.1016/0191-8869(94)90111-2 · Cited by 47 · see citing works
Measuring Affective Clarity Indirectly: Individual Differences in Response Latencies of State.
Lischetzke, T., Cuccodoro, G., Gauger, A., Todeschini, L., & Eid, M. (2005) · Emotion · doi:10.1037/1528-3542.5.4.431 · Cited by 46 · see citing works
Mixture distribution latent state-trait analysis: Basic ideas and applications.
Courvoisier, D. S., Eid, M., & Nußbeck, F. W. (2007) · Psychological Methods · doi:10.1037/1082-989x.12.1.80 · Cited by 44 · see citing works
Momentary Capture of Real-World Data.
Stone, A. A., & Litcher‐Kelly, L. (2006) · American Psychological Association eBooks · doi:10.1037/11383-005 · Cited by 23 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Using experience sampling methodology in organizational behavior
Fisher, C. D., & To, M. L. (2012) · Journal of Organizational Behavior · doi:10.1002/job.1803 · Cited by 555 · see citing works
Hofmann, W., & Patel, P. V. (2014) · Social Science Computer Review · doi:10.1177/0894439314525117 · Cited by 255 · see citing works
Zulueta, J., Piscitello, A., Rasic, M., Easter, R., Babu, P., Langenecker, S. A., McInnis, M., Ajilore, O., Nelson, P. C., Ryan, K., et al. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9775 · Cited by 233 · see citing works
Knogler, M., Harackiewicz, J. M., Gegenfurtner, A., & Lewalter, D. (2015) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2015.08.004 · Cited by 219 · see citing works
Asselbergs, J., Ruwaard, J., Ejdys, M., Schrader, N., Sijbrandij, M., & Riper, H. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5505 · Cited by 192 · see citing works
Runyan, J. D., Steenbergh, T. A., Bainbridge, C., Daugherty, D. A., Oke, L., & Fry, B. N. (2013) · PLoS ONE · doi:10.1371/journal.pone.0071325 · Cited by 179 · see citing works
A comparison of four approaches to account for method effects in latent state–trait analyses.
Geiser, C., & Lockhart, G. (2012) · Psychological Methods · doi:10.1037/a0026977 · Cited by 168 · see citing works
Courvoisier, D. S., Eid, M., & Lischetzke, T. (2012) · Psychological Assessment · doi:10.1037/a0026733 · Cited by 153 · see citing works
Williams, M., Lewthwaite, H., Fraysse, F., Gajewska, A., Ignatavicius, J., & Ferrar, K. (2020) · Journal of Medical Internet Research · doi:10.2196/17023 · Cited by 141 · see citing works
Review of the Day Reconstruction Method (DRM)
Diener, E., & Tay, L. (2013) · Social Indicators Research · doi:10.1007/s11205-013-0279-x · Cited by 124 · see citing works
Bergin, D. A. (2016) · Educational Psychologist · doi:10.1080/00461520.2015.1133306 · Cited by 116 · see citing works
Getting started: Launching a study in daily life.
Conner, T. S., & Lehman, B. J. (2012) · Cited by 93 · see citing works
Kuntsche, E. N., & Labhart, F. (2012) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000137 · Cited by 88 · see citing works
Measuring time use in surveys – Concordance of survey and experience sampling measures
Sonnenberg, B., Riediger, M., Wrzus, C., & Wagner, G. G. (2012) · Social Science Research · doi:10.1016/j.ssresearch.2012.03.013 · Cited by 73 · see citing works
Diurnal variation in rumination.
Takano, K., & Tanno, Y. (2011) · Emotion · doi:10.1037/a0022757 · Cited by 73 · see citing works
Using Personal Cell Phones for Ecological Momentary Assessment
Kuntsche, E. N., & Labhart, F. (2013) · European Psychologist · doi:10.1027/1016-9040/a000127 · Cited by 65 · see citing works
Bless, J. J., Westerhausen, R., Arciuli, J., Kompus, K., Gudmundsen, M., & Hugdahl, K. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00042 · Cited by 63 · see citing works
The Metrics of Societal Happiness
Tay, L., Chan, D. W., & Diener, E. (2013) · Social Indicators Research · doi:10.1007/s11205-013-0356-1 · Cited by 55 · see citing works
Pain as an important predictor of psychosocial health in patients with rheumatoid arthritis
Courvoisier, D. S., Agoritsas, T., Glauser, J., Michaud, K. D., Wolfe, F., Cantoni, E., Perneger, T., Finckh, A., & Diseases, N. D. B. F. R. (2011) · Arthritis Care & Research · doi:10.1002/acr.20652 · Cited by 49 · see citing works
A Real‐Time Examination of Context Effects on Alcohol Cognitions
Monk, R. L., & Heim, D. (2014) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.12504 · Cited by 46 · see citing works
Seto, E., Hua, J., Wu, L., Shia, V., Eom, S., Wang, M. D., & Li, Y. (2016) · PLoS ONE · doi:10.1371/journal.pone.0153085 · Cited by 43 · see citing works
Using structural equation modeling to study traits and states in intensive longitudinal data.
Castro‐Alvarez, S., Tendeiro, J. N., Meijer, R. R., & Bringmann, L. F. (2021) · Psychological Methods · doi:10.1037/met0000393 · Cited by 35 · see citing works
Pennou, A., Lecomte, T., Potvin, S., & Khazaal, Y. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00302 · Cited by 34 · see citing works
“, users could fill out the questionnaire on their phone while they perform other tasks at home (123).”
MethodPalm or Cell? Comparing Personal Digital Assistants and Cell Phones for Experience Sampling Research
Burgin, C. J., Silvia, P. J., Eddington, K. M., & Kwapil, T. R. (2012) · Social Science Computer Review · doi:10.1177/0894439312441577 · Cited by 31 · see citing works
dpMood: Exploiting Local and Periodic Typing Dynamics for Personalized Mood Prediction
Huang, H., Cao, B., Yu, P. S., Wang, C., & Leow, A. (2018) · Proceedings · doi:10.1109/icdm.2018.00031 · Cited by 30 · see citing works
Lazarides, C., Moog, N. K., Verner, G., Voelkle, M. C., Henrich, W., Heim, C. C., Braun, T., Wadhwa, P. D., Buß, C., & Entringer, S. (2021) · Psychological Medicine · doi:10.1017/s0033291721002221 · Cited by 29 · see citing works
Chen, C., Lifset, E. T., Han, Y., Roy, A., Hogarth, M., Moore, A. A., Farcas, E., & Weibel, N. (2023) · The 25th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3597638.3608378 · Cited by 25 · see citing works
“Prior researchers have used interactive voice response systems to address the limitations of mobile and wearable devices [23].”
BackgroundSelf‐Report Assessment: The Status of the Field and Room for Improvement
Fernandez, K. C., Piccirillo, M. L., & Rodebaugh, T. L. (2014) · Wiley eBooks · doi:10.1002/9781118653920.ch14 · Cited by 24 · see citing works
Cullati, S., Courvoisier, D. S., & Burton‐Jeangros, C. (2014) · Sociology of Health & Illness · doi:10.1111/1467-9566.12156 · Cited by 23 · see citing works
Quilty, L. C., Watson, C., Toneatto, T., & Bagby, R. M. (2017) · Journal of Gambling Studies · doi:10.1007/s10899-016-9616-8 · Cited by 19 · see citing works
Smartphone-Based Platform for Affect Monitoring through Flexibly Managed Experience Sampling Methods
Bailón, C., Damas, M., Pomares, H., Sanabria, D., Perakakis, P., Goicoechea, C., & Baños, O. (2019) · Sensors · doi:10.3390/s19153430 · Cited by 17 · see citing works
de la Barrera, U., Arrigoni, F., Monserrat, C., Montoya-Castilla, I., & Gil-Gómez, J. (2024) · Psychiatry Research · doi:10.1016/j.psychres.2023.115710 · Cited by 16 · see citing works
Assessing Specific Discipline Techniques: A Mixed-Methods Approach
Passini, C. M., Pihet, S., & Favez, N. (2013) · Journal of Child and Family Studies · doi:10.1007/s10826-013-9796-0 · Cited by 13 · see citing works
TelEMA: a low-cost and user-friendly telephone assessment platform
Fernandez, K. C., Johnson, M. R., & Rodebaugh, T. (2012) · Behavior Research Methods · doi:10.3758/s13428-012-0287-9 · Cited by 11 · see citing works
Assessment of parental discipline in daily life.
Passini, C. M., Pihet, S., Favez, N., & Schoebi, D. (2013) · Journal of Family Psychology · doi:10.1037/a0031504 · Cited by 10 · see citing works
Horváth, Z., Kun, B., Király, O., Paksi, B., Griffiths, M. D., & Demetrovics, Z. (2024) · Journal of Behavioral Addictions · doi:10.1556/2006.2024.00055 · Cited by 8 · see citing works
Pasini, M., Brondino, M., Burro, R., Raccanello, D., & Gallo, S. (2016) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-40165-2_13 · Cited by 6 · see citing works
Grillo, E. U., Corej, B., & Wolfberg, J. (2021) · Journal of Voice · doi:10.1016/j.jvoice.2021.10.026 · Cited by 7 · see citing works
Giese, H., & König, L. M. (2024) · Journal of Trial and Error · doi:10.36850/28b4-4f59 · Cited by 5 · see citing works
La Adherencia al Entrenamiento en Meditación Mindfulness con Registro en Papel y en Aplicación Móvil
Horrillo-Álvarez, B., Marín‐Martín, C., & Abuín, M. R. (2019) · Clínica y Salud · doi:10.5093/clysa2019a15 · Cited by 5 · see citing works
Mobile Diary Methods in Studying Daily Family Life
Malinen, K., Rönkä, A. K., & Sevón, E. (2015) · IGI Global eBooks · doi:10.4018/978-1-4666-8239-9.ch032 · Cited by 5 · see citing works
Giese, H., & König, L. M. (2022) · doi:10.31219/osf.io/ruza6 · Cited by 5 · see citing works
Trends in Adolescent Development Impacting Practice: How Can We Catch Up?
Anthony, E. K., Williams, L. R., & LeCroy, C. W. (2014) · Journal of Human Behavior in the Social Environment · doi:10.1080/10911359.2013.849220 · Cited by 4 · see citing works
Norget, J., Weiß, A., & Mayer, A. (2025) · Multivariate Behavioral Research · doi:10.1080/00273171.2025.2454904 · Cited by 3 · see citing works
Allometric control of daily mood and anxiety fluctuations
Bornas, X., Balle, M., Morillas-Romero, A., & Aguayo-Siquier, B. (2015) · Motivation and Emotion · doi:10.1007/s11031-015-9471-4 · Cited by 3 · see citing works
Evaluations of human emotional state & affective computing to support job-seekers
Ikwunne, T. A. (2018) · African Human Computer Interaction Conference (AfriCHI) · doi:10.1145/3283458.3283531 · Cited by 3 · see citing works
Application of Asynchronous and Hybrid Voice Telepractice Methods
Grillo, E. U., & van Leer, E. (2025) · Perspectives of the ASHA Special Interest Groups · doi:10.1044/2025_persp-24-00285 · Cited by 2 · see citing works
mPeer: A Mobile Health Approach to Monitoring PTSD in Veterans
O'Brien, C. J. (2013) · e-Publications@Marquette (Marquette University) · Cited by 1 · see citing works
Wang, M. (2013) · Oxford University Press eBooks · doi:10.1093/obo/9780199846740-0028 · Cited by 2 · see citing works
The Influence of Spatial Position on Affect
Burrows, M. T. (2011) · doi:10.26686/wgtn.16999342
The Influence of Spatial Position on Affect
Burrows, M. T. (2011) · doi:10.26686/wgtn.16999342.v1
Chronicle of a Measurement Unforetold
Castro‐Alvarez, S. (2022) · doi:10.33612/diss.258185361
Chronicle of a Measurement UnforetoldPreprint
Castro‐Alvarez, S. (2022) · doi:10.31237/osf.io/6zfhm
Courvoisier, D. S. (2023) · Springer eBooks · doi:10.1007/978-3-031-17299-1_297
Fernandez, V. A. (2019) · theses.fr (ABES) · doi:10.70675/25b8c91azd0fcz4680z8a83zdfd3d067a92c
- Authors
- Courvoisier, D. S., Eid, M., Lischetzke, T., & Schreiber, W. H.
- Affiliations
- University of Geneva (CH)
- Freie Universität Berlin (DE)
- University of Koblenz and Landau (DE)
- Venue
- Emotion
- Published
- 2010-02
- Volume
- 10
- Issue
- 1
- Pages
- 115-124
- ISSN
- 1528-3542 (ISSN-L)
- 1931-1516
- OpenAlex
- W1977831800
- Cited by
- 56
- References
- 40
- Citations by year
- 2025: 2 · 2024: 4 · 2023: 2 · 2022: 3 · 2021: 3 · 2020: 1 · 2019: 4 · 2018: 3 · 2016: 5 · 2015: 3 · 2014: 5 · 2013: 9 · 2012: 8
- FWCI
- 8.74
- Type
- journal article
- Language
- en
- Open access
- Licence
- cc-by
- Locations
- Emotion (publishedVersion)
- PubMed (publishedVersion)
- Archive ouverte UNIGE (University of Geneva) (submittedVersion, cc-by)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- ecological momentary assessment, mood measurement, well-being, psychometric properties, scale reliability, compliance, latent state-trait models, measurement error, autoregressive effects
- MeSH terms
- Activities of Daily Living, Adolescent, Adult, Affect, Female, Humans, Male, Middle Aged, Models, Psychological, Patient Compliance, Psychometrics, Sex Factors, Software, Cell Phone, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
