The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Fleeting reliability in the dot-probe task
Open accessAbstract
In a dot-probe task, two cues-one emotional and one neutral-are followed by a probe in one of their locations. Faster responses to probes co-located with the emotional stimulus are taken as evidence of attentional bias. Several studies indicate that such attentional bias measures have poor reliability, even though ERP studies show that people reliably attend to the emotional stimulus. This inconsistency might arise because the emotional stimulus captures attention briefly (as indicated by ERP), but cues appear for long enough that attention can be redistributed before the probe onset, causing RT measures of bias to vary across trials. We tested this hypothesis by manipulating SOA (stimulus onset asynchrony between onset of the cues and onset of the probe) in a dot-probe task using angry and neutral faces. Across three experiments, the internal reliability of behavioural biases was significantly greater than zero when probes followed faces by 100 ms, but not when the SOA was 300, 500, or 900 ms. Thus, the initial capture of attention shows some level of consistency, but this diminishes quickly. Even at the shortest SOA internal reliability estimates were poor, and not sufficient to justify the use of the task as an index of individual differences in attentional bias.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, it should be noted that concerns have been raised about the reliability of dot probe tasks (Chapman et al., 2019; Price et al., 2015; Schmukle, 2005).”
From Toward objective characterizations of suicide risk: A narrative review of laboratory-based cognitive and behavioral tasks (2023) · cites this paper as Chapman et al., 2019
Citations
Cites
(1991) · Cited by 15,554
Anxiety and cognitive performance: Attentional control theory
Eysenck, M. W., Derakshan, N., Santos, R., & Calvo, M. G. (2007) · Emotion · doi:10.1037/1528-3542.7.2.336 · Cited by 5,289
Threat-related attentional bias in anxious and nonanxious individuals: a meta-analytic study.
Bar-Haim, Y., Lamy, D., Pergamin, L., Bakermans-Kranenburg, M. J., & van IJzendoorn, M. H. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.1.1 · Cited by 3,721 · cited 2×
“, 2015), though such a link is predicted by theories of emotion and attention (Bar-Haim et al., 2007; Bishop, 2008; Eysenck, Derakshan, Santos, & Calvo, 2007; Eysenck & Derakshan, 2011; Okon-Singer et al., 2013).”
BackgroundThe NimStim set of facial expressions: Judgments from untrained research participants.
Tottenham, N., Tanaka, J. W., Leon, A. C., McCarry, T., Nurse, M., Hare, T. A., Marcus, D. J., Westerlund, A., Casey, B., & Nelson, C. (2009) · Psychiatry Research · doi:10.1016/j.psychres.2008.05.006 · Cited by 3,454
Attentional bias in emotional disorders
MacLeod, C., Mathews, A., & Tata, P. (1986) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.95.1.15 · Cited by 3,152
OpenSesame: An open-source, graphical experiment builder for the social sciences
Mathôt, S., Schreij, D., & Theeuwes, J. (2012) · Behavior Research Methods · doi:10.3758/s13428-011-0168-7 · Cited by 2,586
Methods for dealing with reaction time outliers.
Ratcliff, R. (1993) · Psychological Bulletin · doi:10.1037/0033-2909.114.3.510 · Cited by 2,123
Anxiety-related attentional biases and their regulation by attentional control.
Derryberry, D., & Reed, M. A. (2002) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.111.2.225 · Cited by 1,729
The Use of Psychological Testing for Treatment Planning and Outcome Assessment
Maruish, M. E., & Leahy, R. L. (2000) · Journal of Cognitive Psychotherapy · doi:10.1891/0889-8391.14.2.205 · Cited by 1,634
The reliability paradox: Why robust cognitive tasks do not produce reliable individual differences
Hedge, C., Powell, G., & Sumner, P. (2018) · Behavior Research Methods · doi:10.3758/s13428-017-0935-1 · Cited by 1,457
Cited by
Weissman, D. G., Bitran, D., Miller, A. B., Schaefer, J. D., Sheridan, M. A., & McLaughlin, K. A. (2019) · Development and Psychopathology · doi:10.1017/s0954579419000348 · Cited by 330
Pronk, T., Molenaar, D., Wiers, R. W., & Murre, J. (2022) · Psychonomic Bulletin & Review · doi:10.3758/s13423-021-01948-3 · Cited by 123
The Cambridge Handbook of Personality Psychology
(2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822 · Cited by 161
Attentional threat biases and their role in anxiety: A neurophysiological perspective
Wieser, M. J., & Keil, A. (2020) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2020.05.004 · Cited by 72
Jones, A., Christiansen, P., & Field, M. (2018) · Psychology of Addictive Behaviors · doi:10.1037/adb0000414 · Cited by 60
Metadata
- Authors
- Chapman, A., Devue, C., & Grimshaw, G. M.
- Affiliations
- Victoria University of Wellington (NZ)
- Corresponding author
- Grimshaw, Gina M.
- Venue
- Psychological Research
- Published
- 2017-11-20
- Volume
- 83
- Issue
- 2
- Pages
- 308-320
- ISSN
- 0033-3026 (ISSN-L)
- 0340-0727
- 1430-2772
- OpenAlex
- W2768274310
- Cited by
- 172
- References
- 61
- Citations by year
- 2026: 7 · 2025: 19 · 2024: 22 · 2023: 22 · 2022: 17 · 2021: 15 · 2020: 51 · 2019: 8 · 2018: 7 · 2017: 2
- FWCI
- 10.69
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Psychological Research (publishedVersion)
- PubMed (publishedVersion)
- ORBi (University of Liège) (submittedVersion, other-oa)
- Funders
- Royal Society of New Zealand (VUW1307)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- dot-probe task, attentional bias, emotional attention, stimulus onset asynchrony, internal consistency, attentional capture, angry faces, individual differences, reaction time variability, event-related potentials
- MeSH terms
- Behavior Rating Scale, Attentional Bias, Adolescent, Adult, Cues, Emotions, Female, Humans, Male, Psychomotor Performance, Time Factors, Reproducibility of Results, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Fleeting reliability in the dot-probe task. https://app.cochat.ai/papers/10.1007/s00426-017-0947-6
- The paper
- Chapman, A., Devue, C., & Grimshaw, G. M. (2019). Fleeting reliability in the dot-probe task. Psychological Research. https://doi.org/10.1007/s00426-017-0947-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.