Cognition in Context: Understanding the Everyday Predictors of Cognitive Performance in a New Era of Measurement
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
Background: Research suggests that variability in attention and working memory scores, as seen across time points, may be a sensitive indicator of impairment compared with a singular score at one point in time. Given that fluctuation in cognitive performance is a meaningful metric of real-world function and trajectory, it is valuable to understand the internal state-based and environmental factors that could be driving these fluctuations in performance. Objective: In this viewpoint, we argue for the use of repeated mobile assessment as a way to better understand how context shapes moment-to-moment cognitive performance. To elucidate potential factors that give rise to intraindividual variability, we highlight existing literature that has linked both internal and external modifying variables to a number of cognitive domains. We identify ways in which these variables could be measured using mobile assessment to capture them in ecologically meaningful settings (ie, in daily life). Finally, we describe a number of studies that have already begun to use mobile assessment to measure changes in real time cognitive performance in people’s daily environments and the ways in which this burgeoning methodology may continue to advance the field. Methods: This paper describes selected literature on contextual factors that examined how experimentally induced or self-reported contextual variables (ie, affect, motivation, time of day, environmental noise, physical activity, and social activity) related to tests of cognitive performance. We also selected papers that used mobile assessment of cognition; these papers were chosen for their use of high-frequency time-series measurement of cognition using a mobile device. Results: Upon review of the relevant literature, it is evident that contextual factors have the potential to meaningfully impact cognitive performance when measured in laboratory and daily life environments. Although this research has shed light on the question of what gives rise to real-life variability in cognitive function (eg, affect and activity), many of the studies were limited by traditional methods of data collection (eg, involving retrospective recall). Furthermore, cognition has often been measured in one domain or in one age group, which does not allow us to extrapolate results to other cognitive domains and across the life span. On the basis of the literature reviewed, mobile assessment of cognition shows high levels of feasibility and validity and could be a useful method for capturing individual cognitive variability in real-world contexts via passive and active measures. Conclusions: We propose that, through the use of mobile assessment, there is an opportunity to combine multiple sources of contextual and cognitive data. These data have the potential to provide individualized digital signatures that could improve diagnostic precision and lead to meaningful clinical outcomes in a wide range of psychiatric and neurological disorders.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454
Validity and reliability of the Experience-Sampling Method
CSIKSZENTMIHALYI, M., & LARSON, R. (1987) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-198709000-00004 · Cited by 2,544 · cited 4×
“Building off research using ESM and EMA [12,60], mobile devices have been increasingly used in mental health assessment.”
MethodInfluentialThe variable nature of cognitive control: a dual mechanisms framework
Braver, T. S. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.12.010 · Cited by 2,482 · cited 3×
“Although the function and mechanisms of this increase are not fully understood [11], it seems to occur in both normal aging and varying disease processes [28], resulting in decreased frontal-executive function [29] and an observed decrease in dopamine response within extrastriatal regions [30].”
BackgroundCompetition between functional brain networks mediates behavioral variability
Kelly, A. M. C., Uddin, L. Q., Biswal, B. B., Castellanos, F. X., & Milham, M. P. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.08.008 · Cited by 1,287 · cited 2×
“Broadly defined, variability in attention and inhibition of behavioral response is thought to be supported by the prefrontal cortex, which serves to differentially activate the strength of specific networks depending on factors of context, state, and task demands [23].”
BackgroundLack of group-to-individual generalizability is a threat to human subjects research
Fisher, A. J., Medaglia, J. D., & Jeronimus, B. F. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1711978115 · Cited by 1,099
Sonuga-Barke, E. J. S., & Castellanos, F. X. (2007) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2007.02.005 · Cited by 890 · cited 1×
“Research has found that these within-person changes in performance, commonly referred to as intraindividual cognitive variability [1,2], can serve as highly sensitive markers of cognitive dysfunction [3], such as in attention deficit hyperactivity disorder [4] and cognitive decline [5] or dementia [6,7].”
BackgroundMental Health Smartphone Apps: Review and Evidence-Based Recommendations for Future Developments
Bakker, D., Kazantzis, N., Rickwood, D., & Rickard, N. (2016) · JMIR Mental Health · doi:10.2196/mental.4984 · Cited by 886 · cited 2×
“There have been several calls to the field to address this concern by focusing on resources and investigating the psychometrics of mobile cognitive assessment [29,61,79] and centralizing the development of a toolbox of standardized mobile neuropsychological assessments that can be validated more efficiently through a…”
BackgroundA time to think: circadian rhythms in human cognition
Schmidt, C., Collette, F., Cajochen, C., & Peigneux, P. (2007) · Cognitive Neuropsychology · doi:10.1080/02643290701754158 · Cited by 778
Trull, T. J., & Ebner-Priemer, U. (2013) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185510 · Cited by 761
Torous, J., Kiang, M. V., Lorme, J., & Onnela, J.-P. (2016) · JMIR Mental Health · doi:10.2196/mental.5165 · Cited by 758 · cited 1×
“Mobile assessment data, in turn, produce a digital phenotype [16] (ie, a reflection of a person’s moment-to-moment cognitive and behavioral function in the context of everyday life).”
BackgroundSelf-citationHarnessing Smartphone-Based Digital Phenotyping to Enhance Behavioral and Mental Health
Onnela, J.-P., & Rauch, S. L. (2016) · Neuropsychopharmacology · doi:10.1038/npp.2016.7 · Cited by 726 · cited 1×
“The use of this method has become increasingly common in the fields of clinical psychology and psychiatry to understand the temporal patterns of symptoms [17,18] and how contextual factors, such as a person’s physical and social environment, influence important clinical features, such as mood dysregulation [19].”
MethodA systematic review and meta-analysis of exercise interventions in schizophrenia patients
Firth, J., Cotter, J., Elliott, R., French, P., & Yung, A. R. (2015) · Psychological Medicine · doi:10.1017/s0033291714003110 · Cited by 600 · cited 1×
“was associated with improved attention and working memory [59].”
BackgroundStaying on the job: The frontal lobes control individual performance variability
Stuss, D. T. (2003) · Brain · doi:10.1093/brain/awg237 · Cited by 554
Exploring the idiographic dynamics of mood and anxiety via network analysis
Fisher, A. J., Reeves, J. W., Lawyer, G., Medaglia, J. D., & Rubel, J. A. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000311 · Cited by 385 · cited 1×
“In addition to statistical analysis that uses aggregate measures, idiographic approaches [78] could be used to understand the temporal dynamics between context, state, and cognitive function of a unique individual, which may be reliably different from another individual.”
BackgroundUnsworth, N., & McMillan, B. D. (2013) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0029669 · Cited by 335
Intraindividual coupling of daily stress and cognition.
Sliwinski, M. J., Smyth, J. M., Hofer, S. M., & Stawski, R. S. (2006) · Psychology and Aging · doi:10.1037/0882-7974.21.3.545 · Cited by 306 · cited 5×
“ResultState or context variables Cognitive domain Daily frequency Length (weeks) Assessment toolSampleReference Cognitive performance improved folLocation, social setting, and recent activities or behaviors Semantic reasoning and memory 2 times/day1PDAa60 older adultsAllard et al [32] lowing intellectually stimulating…”
BackgroundResultInfluentialLipsmeier, F., Taylor, K. I., Kilchenmann, T., Wolf, D., Scotland, A., Schjodt‐Eriksen, J., Cheng, W., Fernandez‐Garcia, I., Siebourg‐Polster, J., Jin, L., et al. (2018) · Movement Disorders · doi:10.1002/mds.27376 · Cited by 266 · cited 2×
“Phone tests of motor speed correlated with Motor symptoms Motor speed 6 times/day 24 Smartphone 44 patients with Parkinson disease; 35 controls Lipmeister et al [73] questionnaire measures and differentiated patients from controls”
BackgroundEmotional mood states and memory: Elaborative encoding, semantics processing, and cognitive effort.
Ellis, H. C., Thomas, R. L., & Rodriguez, I. A. (1984) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.10.3.470 · Cited by 217 · cited 5×
“ResultLengthTest location and task domain SampleModifierReference Low arousal with negative affect associated with best performance 1 dayIn laboratory; visual attention 100 younger adultsMoodJefferies et al [37] Depressed mood reduced semantic processing, interaction between depressed mood and task difficulty 1 dayIn…”
BackgroundResultInfluentialMobile Technology for Cognitive Assessment of older adults: a scoping review
Koo, B. M., & Vizer, L. M. (2019) · Innovation in Aging · doi:10.1093/geroni/igy038 · Cited by 194
Digital neuropsychology: challenges and opportunities at the intersection of science and software
Germine, L., Reinecke, K., & Chaytor, N. S. (2019) · The Clinical Neuropsychologist · doi:10.1080/13854046.2018.1535662 · Cited by 171
Krawczyk, D. C., Gazzaley, A., & D'Esposito, M. (2007) · Brain Research · doi:10.1016/j.brainres.2007.01.052 · Cited by 156 · cited 2×
“This conceptual model was exemplified through a study by another group and showed how the modulation of reward potential (ie, money) on each trial was positively correlated with both behavioral response time and blood oxygen level–dependent response (ie, functional magnetic resonance imaging–measured neural activation…”
BackgroundMethodDetermining typical smartphone usage: What data do we need?
Wilcockson, T. D. W., Ellis, D. A., & Shaw, H. (2018) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2017.0652 · Cited by 138 · cited 1×
“One of the greatest benefits to using mobile devices, specifically smartphones, for ambulatory assessment is capitalizing on their ubiquity: owners carry them on-person most of the time and check them up to hundreds of times in a given day [62].”
BackgroundCormack, F., McCue, M., Taptiklis, N., Skirrow, C., Glazer, E., Panagopoulos, E., van Schaik, T. A., Fehnert, B., King, J., & Barnett, J. H. (2019) · JMIR Mental Health · doi:10.2196/12814 · Cited by 79
Gates, N. J., & Kochan, N. A. (2015) · Current Opinion in Psychiatry · doi:10.1097/yco.0000000000000141 · Cited by 56
Cited by
Torous, J., Bucci, S., Bell, I. H., Kessing, L. V., Faurholt‐Jepsen, M., Whelan, P., Carvalho, A. F., Keshavan, M., Linardon, J., & Firth, J. (2021) · World Psychiatry · doi:10.1002/wps.20883 · Cited by 1,199
Self-citationStein, D. J., Shoptaw, S. J., Vigo, D. V., Lund, C., Cuijpers, P., Bantjes, J., Sartorius, N., & Maj, M. (2022) · World Psychiatry · doi:10.1002/wps.20998 · Cited by 331
Leveraging technology to personalize cognitive enhancement methods in aging
Ziegler, D. A., Anguera, J. A., Gallen, C. L., Hsu, W.-Y., Wais, P. E., & Gazzaley, A. (2022) · Nature Aging · doi:10.1038/s43587-022-00237-5 · Cited by 50
Zainal, N. H., & Newman, M. G. (2022) · Current Psychiatry Reports · doi:10.1007/s11920-022-01390-9 · Cited by 40
“A more granular test of these theories and understanding their state-dependent nature requires adopting ecological momentary assessment (EMA) and passive sensing strategies [90].”
BackgroundMoran, E. K., Culbreth, A. J., & Barch, D. M. (2022) · Current Topics in Behavioral Neurosciences · doi:10.1007/7854_2022_321 · Cited by 30
“…have begun deploying experimental tasks, similar to those described in the aforementioned sections, onto mobile phones as a means to understand the temporal dynamics of task performance as well as how specific contexts may affect task performance (e.g., Moore et al. 2017; Weizenbaum et al. 2020).”
Method
Metadata
- Authors
- Weizenbaum, E., Torous, J., & Fulford, D.
- Venue
- JMIR mHealth and uHealth
- Publisher
- JMIR Publications Inc.
- Published
- 2020-07-23
- Volume
- 8
- Issue
- 7
- Pages
- e14328
- ISSN
- 2291-5222 (ISSN-L)
- OpenAlex
- W3013305777
- Cited by
- 81
- References
- 24
- FWCI
- 8.79
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.