Examining the Concurrent and Predictive Validity of Single Items in Ecological Momentary Assessments
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Although single items can save time and burden in psychology research, concerns about their reliability have made the use of multiple-item measures the default standard practice. Although single items cannot demonstrate internal reliability, their criterion validity can be compared with multiple-item measures. Using ecological momentary assessment data, we evaluated repeated measures correlations and constructed multilevel cross-lagged models to assess concurrent and predictive validity of single- and multiple-item measures. Correlations between the single- and multiple-item measures ranged from .24 to .61. In 27 of 29 unique single-item predictor models, single items demonstrated significant predictive validity, and in one of eight sets of comparisons, a single-item predictor exhibited a larger effect size than its multiple-item counterpart. Although multiple-item measures generally performed better than single items, the added benefit of multiple items was modest in most cases. The present data provide support for the use of single-item measures in intensive longitudinal designs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
lavaan : An R Package for Structural Equation Modeling
Rosseel, Y. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i02 · Cited by 27,955
A Paradigm for Developing Better Measures of Marketing Constructs
Churchill, G. A. (1979) · Journal of Marketing Research · doi:10.1177/002224377901600110 · Cited by 16,549
What is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810 · cited 2×
“First, the reliability argument is null for a singular and concrete target construct that can be captured by a single item (Rossiter, 2002), and Cronbach’s alpha should be examined only after a multiple-item measure has shown to constitute a unidimensional construct (Cortina, 1993).”
BackgroundBeck, A. T., Steer, R. A., & Brown, G. (2011) · PsycTESTS Dataset · doi:10.1037/t00742-000 · Cited by 7,535
The Predictive Validity of Multiple-Item versus Single-Item Measures of the Same Constructs
Bergkvist, L., & Rossiter, J. R. (2007) · Journal of Marketing Research · doi:10.1509/jmkr.44.2.175 · Cited by 3,107
Robins, R. W., Hendin, H. M., & Trzesniewski, K. H. (2001) · Personality and Social Psychology Bulletin · doi:10.1177/0146167201272002 · Cited by 3,041 · cited 2×
“Similarly, the use of single items to assess self-esteem (Robins et al., 2001) and social support (Slavin et al.”
BackgroundMethodAffect Grid: A single-item scale of pleasure and arousal.
Russell, J. A., Weiss, A., & Mendelsohn, G. A. (1989) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.57.3.493 · Cited by 2,068
Krosnick, J. A. (1999) · Annual Review of Psychology · doi:10.1146/annurev.psych.50.1.537 · Cited by 1,852
Lack of group-to-individual generalizability is a threat to human subjects research
Fisher, A. J., Medaglia, J. D., & Jeronimus, B. F. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1711978115 · Cited by 1,099
Self-citationDepression sum-scores don’t add up: why analyzing specific depression symptoms is essential
Fried, E. I., & Nesse, R. M. (2015) · BMC Medicine · doi:10.1186/s12916-015-0325-4 · Cited by 981 · cited 1×
“For example, depression is one of many highly heterogeneous conditions of which symptoms, such as sad mood, insomnia, concentration problems, and suicidal ideation, significantly differ from one another in their etiology and impact on impairment (Fried & Nesse, 2015).”
BackgroundMackinnon, A., Jorm, A. F., Christensen, H., Korten, A. E., Jacomb, P. A., & Rodgers, B. (1999) · Personality and Individual Differences · doi:10.1016/s0191-8869(98)00251-7 · Cited by 850
Ganna, A., & Ingelsson, E. (2015) · The Lancet · doi:10.1016/s0140-6736(15)60175-1 · Cited by 411 · cited 1×
“More broadly, another example of the use of a well-validated single-item measure is self-rated health in medicine, which has shown to predict mortality across numerous studies (e.g., Finch et al., 2002; Ganna & Ingelsson, 2015; Mossey & Shapiro, 1982).”
BackgroundOpen trial of a personalized modular treatment for mood and anxiety
Fisher, A. J., Bosley, H. G., Fernandez, K. C., Reeves, J. W., Soyster, P. D., Diamond, A. E., & Barkin, J. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.01.010 · Cited by 156 · cited 4×
“The field has been moving toward acknowledging substantial heterogeneity in mental health diagnoses both between and within subjects (Fisher et al., 2018, 2019; Wright & Simms, 2016).”
BackgroundMethodResultInfluentialSelf-citationEddy, C. L., Herman, K. C., & Reinke, W. M. (2019) · Journal of School Psychology · doi:10.1016/j.jsp.2019.05.001 · Cited by 120 · cited 1×
“Eddy et al. (2019) examined concurrent and predictive validity of single-item measures for teacher stress and coping.”
Background
Cited by
Assessing reliability and validity of food safety culture assessment tools
Nyarugwe, S. P., & Jespersen, L. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e32226 · Cited by 14
Melanou, C., & Beege, M. (2026) · Education Sciences · doi:10.3390/educsci16040651 · Cited by 12
Disentangling trait and state psychological inflexibility: A longitudinal multilevel approach
Klimczak, K. S., Schwartz, S. E., Donahue, M. L., Capel, L. K., Snow, J. L., & Levin, M. E. (2023) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2023.05.006 · Cited by 11
Robbins, K. A., Bartholomew, T. T., Joy, E. E., Keum, B. T., Pérez-Rojas, A. E., & Lockard, A. J. (2025) · Journal of American College Health · doi:10.1080/07448481.2024.2338426 · Cited by 6
Brem, M. J. (2025) · Journal of Family Violence · doi:10.1007/s10896-025-00893-2 · Cited by 3
Metadata
- Authors
- Song, J., Howe, E., Oltmanns, J. R., & Fisher, A. J.
- Venue
- Assessment
- Publisher
- SAGE Publications
- Published
- 2022-08-24
- Volume
- 30
- Issue
- 5
- Pages
- 1662-1671
- ISSN
- 1073-1911 (ISSN-L)
- 1552-3489
- OpenAlex
- W4293089772
- Cited by
- 159
- References
- 15
- FWCI
- 22.76
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.