Combining Reaction Time and Accuracy: The Relationship Between Working Memory Capacity and Task Switching as a Case Example
The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
It is generally agreed upon that the mechanisms underlying task switching heavily depend on working memory, yet numerous studies have failed to show a strong relationship between working memory capacity (WMC) and task-switching ability. We argue that this relationship does indeed exist but that the dependent variable used to measure task switching is problematic. To support our claim, we reanalyzed data from two studies with a new scoring procedure that combines reaction time (RT) and accuracy into a single score. The reanalysis revealed a strong relationship between task switching and WMC that was not present when RT-based switch costs were used as the dependent variable. We discuss the theoretical implications of this finding along with the potential uses and limitations of the scoring procedure we used. More broadly, we emphasize the importance of using measures that incorporate speed and accuracy in other areas of research, particularly in comparisons of subjects differing in cognitive and developmental levels.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000) · Cognitive Psychology · doi:10.1006/cogp.1999.0734 · Cited by 15,798
Measuring individual differences in implicit cognition: the implicit association test
Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. K. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.74.6.1464 · Cited by 9,210
Effects of noise letters upon the identification of a target letter in a nonsearch task
Eriksen, B. A., & Eriksen, C. W. (1974) · Perception & Psychophysics · doi:10.3758/bf03203267 · Cited by 7,230
The magical number 4 in short-term memory: A reconsideration of mental storage capacity
Cowan, N. (2001) · Behavioral and Brain Sciences · doi:10.1017/s0140525x01003922 · Cited by 6,779
Individual differences in working memory and reading
Daneman, M., & Carpenter, P. A. (1980) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(80)90312-6 · Cited by 6,336 · cited 1×
“For example, a common way to measure WMC is with complex span tasks, the first of which were the reading span (Daneman & Carpenter, 1980), counting span (Case, Kurland, & Goldberg, 1982), and the operation span (Turner & Engle, 1989).”
MethodHalf a century of research on the Stroop effect: An integrative review.
MacLeod, C. M. (1991) · Psychological Bulletin · doi:10.1037/0033-2909.109.2.163 · Cited by 5,500
Baddeley, A. (1992) · Science · doi:10.1126/science.1736359 · Cited by 5,258
Tests for comparing elements of a correlation matrix
Steiger, J. H. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.87.2.245 · Cited by 4,621 · cited 1×
“In the test for differences between dependent correlations (Steiger, 1980), use of the binning procedure resulted in four out of the six correlations being significantly different from correlations found via use of latency switch costs.”
MethodTesting the efficiency and independence of attentional networks
Fan, J., McCandliss, B. D., Sommer, T., Raz, A., & Posner, M. I. (2002) · Journal of Cognitive Neuroscience · doi:10.1162/089892902317361886 · Cited by 3,717
Costs of a predictible switch between simple cognitive tasks.
Rogers, R. D., & Monsell, S. (1995) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.124.2.207 · Cited by 3,170
Working memory, short-term memory, and general fluid intelligence: A latent-variable approach.
Engle, R. W., Tuholski, S. W., Laughlin, J. E., & Conway, A. R. A. (1999) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.128.3.309 · Cited by 3,078
Self-citationMonsell, S. (2003) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(03)00028-7 · Cited by 2,984
Working memory span tasks: A methodological review and user’s guide
Conway, A. R. A., Kane, M. J., Bunting, M. F., Hambrick, D. Z., Wilhelm, O., & Engle, R. W. (2005) · Psychonomic Bulletin & Review · doi:10.3758/bf03196772 · Cited by 2,882 · cited 1×
“…WMC has been shown to share a substantial amount of variance with fluid intelligence (Gf), which is the ability to reason in novel situations (Ackerman, Beier, & Boyle, 2005; Engle, Tuholski, Laughlin, & Conway, 1999; Kane, Hambrick, & Conway, 2005; Oberauer, Schulze, Wilhelm, & Süß, 2005).”
BackgroundSelf-citationWorking Memory Capacity as Executive Attention
Engle, R. W. (2002) · Current Directions in Psychological Science · doi:10.1111/1467-8721.00160 · Cited by 2,507
Self-citationGrant, D. A., & Berg, E. (1948) · Journal of Experimental Psychology · doi:10.1037/h0059831 · Cited by 2,244
The phonological loop as a language learning device.
Baddeley, A., Gathercole, S., & Papagno, C. (1998) · Psychological Review · doi:10.1037/0033-295x.105.1.158 · Cited by 2,199 · cited 1×
“Therefore, it is typically measured in terms of capacity— estimated to be between three and five chunks of information in normal functioning individuals (Cowan, 2001).”
BackgroundReasoning ability is (little more than) working-memory capacity?!
Kyllonen, P. C., & Christal, R. E. (1990) · Intelligence · doi:10.1016/s0160-2896(05)80012-1 · Cited by 1,810
Kane, M. J., Hambrick, D. Z., Tuholski, S. W., Wilhelm, O., Payne, T. W., & Engle, R. W. (2004) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.133.2.189 · Cited by 1,679 · cited 1×
“Since then, spatial complex span tasks such as the rotation span (Shah & Miyake, 1996) and symmetry span (Kane et al., 2004) have also been introduced.”
BackgroundSelf-citationControl and interference in task switching—A review
Kiesel, A., Steinhauser, M., Wendt, M., Falkenstein, M., Jost, K., Philipp, A. M., & Koch, I. (2010) · Psychological Bulletin · doi:10.1037/a0019842 · Cited by 1,485 · cited 1×
“…costs arise from a task-set reconfiguration in which the cognitive system has to reconfigure itself to properly execute the switch (e.g., returning to the mental state of the phone conversation with your friend after you have let the dog out and turned on the television; Rogers & Monsell, 1995).”
BackgroundA controlled-attention view of working-memory capacity.
Kane, M. J., Bleckley, M. K., Conway, A. R. A., & Engle, R. W. (2001) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.130.2.169 · Cited by 1,414
Self-citationSpeed-accuracy tradeoff and information processing dynamics
Wickelgren, W. A. (1977) · Acta Psychologica · doi:10.1016/0001-6918(77)90012-9 · Cited by 1,304 · cited 2×
“It has been argued that studies taking speed-accuracy tradeoffs into consideration are vastly superior to traditional RT studies, such that conclusions made from RT studies can always be called into question (e.g., Luce, 1986; Wickelgren, 1977).”
BackgroundNot All Executive Functions Are Related to Intelligence
Friedman, N. P., Miyake, A., Corley, R. P., Young, S. E., DeFries, J. C., & Hewitt, J. K. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01681.x · Cited by 1,293
Reactions toward the source of stimulation
Simon, J. R. (1969) · Journal of Experimental Psychology · doi:10.1037/h0027448 · Cited by 1,229
Executive control of cognitive processes in task switching
Rubinstein, J. S., Meyer, D. E., & Evans, J. E. (2001) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037//0096-1523.27.4.763 · Cited by 1,207
Working Memory and Intelligence: The Same or Different Constructs?
Ackerman, P. L., Beier, M. E., & Boyle, M. O. (2005) · Psychological Bulletin · doi:10.1037/0033-2909.131.1.30 · Cited by 969
Kane, M. J., Hambrick, D. Z., & Conway, A. R. A. (2005) · Psychological Bulletin · doi:10.1037/0033-2909.131.1.66 · Cited by 545
Working memory and the control of action: Evidence from task switching
Baddeley, A., Chincotta, D., & Adlam, A. (2001) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.130.4.641 · Cited by 494
Measuring Working Memory Capacity With Automated Complex Span Tasks
Redick, T. S., Broadway, J. M., Meier, M. E., Kuriakose, P. S., Unsworth, N., Kane, M. J., & Engle, R. W. (2012) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000123 · Cited by 457
Self-citationOberauer, K., Schulze, R., Wilhelm, O., & Süß, H.-M. (2005) · Psychological Bulletin · doi:10.1037/0033-2909.131.1.61 · Cited by 410
STANDARDIZATION OF PROGRESSIVE MATRICES, 1938
RAVEN, J. C. (1941) · British Journal of Medical Psychology · doi:10.1111/j.2044-8341.1941.tb00316.x · Cited by 389
The role of inner speech in task switching: A dual-task investigation
Emerson, M. J., & Miyake, A. (2003) · Journal of Memory and Language · doi:10.1016/s0749-596x(02)00511-9 · Cited by 348 · cited 2×
“…executive is involved in task switching (Baddeley, Chincotta, & Adlam, 2001), that the phonological loop2 is involved in the retrieval of task sets (Emerson & Miyake, 2003; Liefooghe, Vandierendonck, Muyllaert, Verbruggen, & Vanneste, 2005), and that task switching exacts a cost on working memory…”
BackgroundResultWorking Memory Training May Increase Working Memory Capacity but Not Fluid Intelligence
Harrison, T. L., Shipstead, Z., Hicks, K. L., Hambrick, D. Z., Redick, T. S., & Engle, R. W. (2013) · Psychological Science · doi:10.1177/0956797613492984 · Cited by 305 · cited 1×
“Latency switch costs have been used to assess task switching since the introduction of Jersild’s (1927) multilist procedure, in which the total RT to complete a pure list of problems (i.”
MethodSelf-citationDoyle, A. E., Biederman, J., Seidman, L. J., Weber, W., & Faraone, S. V. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.68.3.477 · Cited by 209
Chevalier, N., Sheffield, T. D., Nelson, J. M., Clark, C. A. C., Wiebe, S. A., & Espy, K. A. (2012) · Developmental Neuropsychology · doi:10.1080/87565641.2011.632458 · Cited by 87 · cited 1×
“…involved in the actual execution of the task switch, whereas global switch costs are hypothesized to arise from the task ambiguity in mixed block conditions and reflect the retrieval and representation of the goals involved in task switching (e.g., Chevalier et al., 2012; Rubin & Meiran, 2005).”
Background
Cited by
The reliability paradox: Why robust cognitive tasks do not produce reliable individual differences
Hedge, C., Powell, G., & Sumner, P. (2018) · Behavior Research Methods · doi:10.3758/s13428-017-0935-1 · Cited by 1,457
Vandierendonck, A. (2017) · Behavior Research Methods · doi:10.3758/s13428-016-0721-5 · Cited by 385
Combining speed and accuracy to control for speed-accuracy trade-offs(?)
Liesefeld, H. R., & Janczyk, M. (2019) · Behavior Research Methods · doi:10.3758/s13428-018-1076-x · Cited by 369
Draheim, C., Mashburn, C. A., Martin, J. D., & Engle, R. W. (2019) · Psychological Bulletin · doi:10.1037/bul0000192 · Cited by 322
Self-citationWestbrook, J. I., Raban, M. Z., Walter, S. R., & Douglas, H. (2018) · BMJ Quality & Safety · doi:10.1136/bmjqs-2017-007333 · Cited by 317
Metadata
- Authors
- Draheim, C., Hicks, K. L., & Engle, R. W.
- Venue
- Perspectives on Psychological Science
- Publisher
- SAGE Publications
- Published
- 2016-01
- Volume
- 11
- Issue
- 1
- Pages
- 133-155
- ISSN
- 1745-6916 (ISSN-L)
- 1745-6924
- OpenAlex
- W2339300684
- Cited by
- 140
- References
- 34
- FWCI
- 6.27
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.