The reliability and stability of visual working memory capacity
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Because of the central role of working memory capacity in cognition, many studies have used short measures of working memory capacity to examine its relationship to other domains. Here, we measured the reliability and stability of visual working memory capacity, measured using a single-probe change detection task. In Experiment 1, the participants (N = 135) completed a large number of trials of a change detection task (540 in total, 180 each of set sizes 4, 6, and 8). With large numbers of both trials and participants, reliability estimates were high (α > .9). We then used an iterative down-sampling procedure to create a look-up table for expected reliability in experiments with small sample sizes. In Experiment 2, the participants (N = 79) completed 31 sessions of single-probe change detection. The first 30 sessions took place over 30 consecutive days, and the last session took place 30 days later. This unprecedented number of sessions allowed us to examine the effects of practice on stability and internal reliability. Even after much practice, individual differences were stable over time (average between-session r = .76).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
The magical number 4 in short-term memory: A reconsideration of mental storage capacity
Cowan, N. (2001) · Behavioral and Brain Sciences · doi:10.1017/s0140525x01003922 · Cited by 6,779
Conducting behavioral research on Amazon’s Mechanical Turk
Mason, W., & Suri, S. (2012) · Behavior Research Methods · doi:10.3758/s13428-011-0124-6 · Cited by 3,172 · cited 1×
“Although remote data collection sacrifices some degree of experimental control, the use of at-home tests is becoming more common with the ease of remote data collection through resources like Amazon’s Mechanical Turk (Mason & Suri, 2012).”
Working memory, short-term memory, and general fluid intelligence: A latent-variable approach.
Engle, R. W., Tuholski, S. W., Laughlin, J. E., & Conway, A. R. A. (1999) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.128.3.309 · Cited by 3,078
Is working memory training effective? A meta-analytic review
Melby-Lervåg, M., & Hulme, C. (2013) · Developmental Psychology · doi:10.1037/a0028228 · Cited by 1,782
Working memory and fluid intelligence: Capacity, attention control, and secondary memory retrieval
Unsworth, N., Fukuda, K., Awh, E., & Vogel, E. K. (2014) · Cognitive Psychology · doi:10.1016/j.cogpsych.2014.01.003 · Cited by 528
Self-citationHow to measure working memory capacity in the change detection paradigm
Rouder, J. N., Morey, R. D., Morey, C. C., & Cowan, N. (2011) · Psychonomic Bulletin & Review · doi:10.3758/s13423-011-0055-3 · Cited by 334 · cited 1×
“For change detection tasks using wholedisplay probes, Pashler’s (1988) formula may be more appropriate (Rouder et al., 2011).”
Unreliability as a threat to understanding psychopathology: The cautionary tale of attentional bias.
Rodebaugh, T. L., Scullin, R. B., Langer, J. K., Dixon, D. J., Huppert, J. D., Bernstein, A., Zvielli, A., & Lenze, E. J. (2016) · Journal of Abnormal Psychology · doi:10.1037/abn0000184 · Cited by 312 · cited 2×
“The reliability of differences scores can be impacted both by (1) the internal reliability of each measure used to compute the difference and (2) the degree of correlation between the two measures (Rodebaugh et al., 2016).”
The concurrent validity and test?retest reliability of a visuospatial working memory task
HOCKEY, A., & GEFFEN, G. (2004) · Intelligence · doi:10.1016/j.intell.2004.07.009 · Cited by 115 · cited 1×
“This finding is consistent with previous studies showing that other measures ofWMcapacity are reliable and stable, including complex span measures (Beckmann, Holling, & Kuhn, 2007; Foster et al., 2015; Klein & Fiss, 1999; Waters & Caplan, 1996) and the visuospatial n-back (Hockey & Geffen, 2004).”
Cited by
The Border Between Seeing and Thinking
Block, N. (2023) · doi:10.1093/oso/9780197622223.001.0001 · Cited by 367
Can short-term memory be trained?
Norris, D. G., Hall, J., & Gathercole, S. E. (2019) · Memory & Cognition · doi:10.3758/s13421-019-00901-z · Cited by 31
The Neural Mechanism Underlying Visual Working Memory Training and Its Limited Transfer Effect
Cai, Y., Yang, C., Wang, S., & Xue, G. (2022) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01897 · Cited by 6
“…processes from memory storage ability (Norris et al., 2019; Pergher et al., 2018), a recent training study focused on the training effect of the memory storage process and found that the training for the color change detection task reliably increased memory capacity for colors (Xu et al., 2018).”
Background
Metadata
- Authors
- Xu, Z., Adam, K. C. S., Fang, X., & Vogel, E. K.
- Venue
- Behavior Research Methods
- Published
- 2017-04-07
- Volume
- 50
- Issue
- 2
- Pages
- 576-588
- ISSN
- 1554-351X (ISSN-L)
- 1554-3528
- OpenAlex
- W2604569479
- Cited by
- 106
- References
- 9
- FWCI
- 9.85
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The reliability and stability of visual working memory capacity. https://app.cochat.ai/papers/10.3758/s13428-017-0886-6
- The paper
- Xu, Z., Adam, K. C. S., Fang, X., & Vogel, E. K. (2018). The reliability and stability of visual working memory capacity. Behavior Research Methods. https://doi.org/10.3758/s13428-017-0886-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.