Unreliability as a threat to understanding psychopathology: The cautionary tale of attentional bias.
Open accessAbstract
The use of unreliable measures constitutes a threat to our understanding of psychopathology, because advancement of science using both behavioral and biologically oriented measures can only be certain if such measurements are reliable. Two pillars of the National Institute of Mental Health's portfolio-the Research Domain Criteria (RDoC) initiative for psychopathology and the target engagement initiative in clinical trials-cannot succeed without measures that possess the high reliability necessary for tests involving mediation and selection based on individual differences. We focus on the historical lack of reliability of attentional bias measures as an illustration of how reliability can pose a threat to our understanding. Our own data replicate previous findings of poor reliability for traditionally used scores, which suggests a serious problem with the ability to test theories regarding attentional bias. This lack of reliability may also suggest problems with the assumption (in both theory and the formula for the scores) that attentional bias is consistent and stable across time. In contrast, measures accounting for attention as a dynamic process in time show good reliability in our data. The field is sorely in need of research reporting findings and reliability for attentional bias scores using multiple methods, including those focusing on dynamic processes over time. We urge researchers to test and report reliability of all measures, considering findings of low reliability not just as a nuisance but as an opportunity to modify and improve upon the underlying theory. Full assessment of reliability of measures will maximize the possibility that RDoC (and psychological science more generally) will succeed. (PsycINFO Database Record
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The dot-probe task has notoriously poor psychometric properties that may have impeded the ability to sensitively detect changes over time.
“Although in a separate study, ketamine failed to illustrate a similar impact on attentional bias towards negative cues 128 , the use of a reaction time measure (the dot-probe task) with notoriously poor psychometric properties 136-138 may have impeded the ability to sensitively detect changes over time.”
From Neuroplasticity in cognitive and psychological mechanisms of depression: an integrative model (2020) · cites this paper as [138]
The ability to identify individually relevant brain and behavioural changes depends on a high level of measurement accuracy combined with appropriate statistical modelling.
“Our ability to identify individually relevant brain and behavioural changes depends on a high level of measurement accuracy, combined with appropriate statistical modelling, neither of which is widely used in RCTs.38”
From Precision clinical trials: a framework for getting to precision medicine for neurobehavioural disorders (2021) · cites this paper as [38]
High measurement accuracy and appropriate statistical modelling are not widely used in RCTs.
“Our ability to identify individually relevant brain and behavioural changes depends on a high level of measurement accuracy, combined with appropriate statistical modelling, neither of which is widely used in RCTs.38”
From Precision clinical trials: a framework for getting to precision medicine for neurobehavioural disorders (2021) · cites this paper as [38]
AB indices derived from manual response times have limited reliability.
“One research challenge is the limited reliability of AB indices derived from manual response times, which may reflect measurement problems and the variability of anxiety-related ABs, as discussed earlier [19,56-58,98].”
From Anxiety and Threat-Related Attention: Cognitive-Motivational Framework and Treatment (2018) · cites this paper as [56]
The limited reliability of AB indices derived from manual response times may reflect measurement problems and the variability of anxiety-related ABs.
“One research challenge is the limited reliability of AB indices derived from manual response times, which may reflect measurement problems and the variability of anxiety-related ABs, as discussed earlier [19,56-58,98].”
From Anxiety and Threat-Related Attention: Cognitive-Motivational Framework and Treatment (2018) · cites this paper as [56]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Statistical power analyses using G∗Power 3.1: tests for correlation and regression analyses
Faul, F., Erdfelder, E., Buchner, A., & Lang, A.-G. (2009) · Behavior Research Methods · doi:10.3758/brm.41.4.1149 · Cited by 37,615 · see citing works
ggplot2: Elegant Graphics for Data Analysis
Wickham, H. (2009) · doi:10.1007/978-0-387-98141-3 · Cited by 14,447 · see citing works
Threat-related attentional bias in anxious and nonanxious individuals: a meta-analytic study.
Bar-Haim, Y., Lamy, D., Pergamin, L., Bakermans-Kranenburg, M. J., & van IJzendoorn, M. H. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.1.1 · Cited by 3,721 · see citing works
Cole, D. A., & Maxwell, S. E. (2003) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.112.4.558 · Cited by 3,605 · see citing works
How to improve R&D productivity: the pharmaceutical industry's grand challenge
Paul, S. M., Mytelka, D. S., Dunwiddie, C. T., Persinger, C. C., Munos, B. H., Lindborg, S. R., & Schacht, A. L. (2010) · Nature Reviews Drug Discovery · doi:10.1038/nrd3078 · Cited by 3,566 · see citing works
Structured clinical interview for DSM-IV axis I disorders : SCID-I : clinical version : scoresheet
First, M. B., Spitzer, R. L., Gibbon, M., & Williams, J. B. W. (1997) · American Psychiatric Press eBooks · Cited by 3,101 · see citing works
Balota, D. A., Yap, M. J.-M., Hutchison, K. A., Cortese, M. J., Kessler, B., Loftis, B., Neely, J. H., Nelson, D. L., Simpson, G. B., & Rebecca Treiman, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193014 · Cited by 2,758 · see citing works
Attentional bias in emotional disorders.
MacLeod, C., Mathews, A., & Tata, P. R. (1986) · Journal of Abnormal Psychology · doi:10.1037//0021-843x.95.1.15 · Cited by 2,553 · see citing works
Producing high-dimensional semantic spaces from lexical co-occurrence
Lund, K., & Burgess, C. (1996) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03204766 · Cited by 1,808 · see citing works
Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2004) · Psychological Review · doi:10.1037/0033-295x.111.4.1061 · Cited by 1,733 · see citing works
Cognitive Approaches to Emotion and Emotional Disorders
Mathews, A., & MacLeod, C. (1994) · Annual Review of Psychology · doi:10.1146/annurev.ps.45.020194.000325 · Cited by 1,023 · see citing works
Selective processing of threat cues in anxiety states
Mathews, A., & MacLeod, C. (1985) · Behaviour Research and Therapy · doi:10.1016/0005-7967(85)90104-4 · Cited by 1,001 · see citing works
(2004) · Cited by 964 · see citing works
Anxiety and the Allocation of Attention to Threat
MacLeod, C., & Mathews, A. (1988) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/14640748808402292 · Cited by 817 · see citing works
Wendland, J. R., Martin, B. J., Kruse, M. R., Lesch, K., & Murphy, D. L. (2006) · Molecular Psychiatry · doi:10.1038/sj.mp.4001789 · Cited by 561 · see citing works
The Attack of the Psychometricians
Borsboom, D. (2006) · Psychometrika · doi:10.1007/s11336-006-1447-6 · Cited by 551 · see citing works
Attention modification program in individuals with generalized anxiety disorder
Amir, N., Beard, C., Burns, M., & Bomyea, J. (2009) · Journal of Abnormal Psychology · doi:10.1037/a0012589 · Cited by 539 · see citing works
Unreliability of the dot probe task
Schmukle, S. C. (2005) · European Journal of Personality · doi:10.1002/per.554 · Cited by 538 · see citing works
A review of current evidence for the causal impact of attentional bias on fear and anxiety
Van Bockstaele, B., Verschuere, B., Tibboel, H., De Houwer, J., Crombez, G., & Koster, E. H. W. (2014) · Psychological Bulletin · doi:10.1037/a0034834 · Cited by 485 · see citing works
Borsboom, D. (2005) · Cambridge University Press eBooks · doi:10.1017/cbo9780511490026 · Cited by 481 · see citing works
Attention training in individuals with generalized social phobia: A randomized controlled trial.
Amir, N., Beard, C., Taylor, C. T., Klumpp, H., Elias, J. A., Burns, M. N., & Chen, X. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0016685 · Cited by 453 · see citing works
Biased processing of emotional information in girls at risk for depression
Joormann, J., Talbot, L., & Gotlib, I. H. (2007) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.116.1.135 · Cited by 420 · see citing works
Constructing constructs for psychopathology: The NIMH research domain criteria.
Cuthbert, B. N., & Kozak, M. J. (2013) · Journal of Abnormal Psychology · doi:10.1037/a0034028 · Cited by 364 · see citing works
Measuring attentional bias to threat: reliability of dot probe and eye movement indices
Waechter, S., Nelson, A. L., Wright, C., Hyatt, A., & Oakman, J. (2014) · Cognitive Therapy and Research · doi:10.1007/s10608-013-9588-2 · Cited by 324 · see citing works
The attentional bias modification approach to anxiety intervention
MacLeod, C., & Clarke, P. J. F. (2015) · Clinical Psychological Science · doi:10.1177/2167702614560749 · Cited by 315 · see citing works
Empirical recommendations for improving the stability of the dot-probe task in clinical research.
Price, R. B., Kuckertz, J. M., Siegle, G. J., Ladouceur, C. D., Silk, J. S., Ryan, N. D., Dahl, R. E., & Amir, N. (2015) · Psychological Assessment · doi:10.1037/pas0000036 · Cited by 312 · see citing works
Automaticity and the anxiety disorders.
Mcnally, R. J. (1995) · Behaviour Research and Therapy · doi:10.1016/0005-7967(95)00015-p · Cited by 281 · see citing works
Kappenman, E. S., Farrens, J. L., Luck, S. J., & Hajcak, G. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01368 · Cited by 267 · see citing works
Determining target engagement in living systems
Simon, G. M., Niphakis, M. J., & Cravatt, B. F. (2013) · Nature Chemical Biology · doi:10.1038/nchembio.1211 · Cited by 246 · see citing works
Test–retest and between‐site reliability in a multicenter fMRI study
Friedman, L., Stern, H. S., Brown, G. G., Mathalon, D. H., Turner, J. A., Glover, G. H., Gollub, R. L., Lauriello, J., Lim, K. O., Cannon, T. D., et al. (2007) · Human Brain Mapping · doi:10.1002/hbm.20440 · Cited by 245 · see citing works
Temporal dynamics of attentional bias
Zvielli, A., Bernstein, A., & Koster, E. H. W. (2015) · Clinical Psychological Science · doi:10.1177/2167702614551572 · Cited by 237 · see citing works
Self-citationLife-threatening danger and suppression of attention bias to threat
Bar-Haim, Y., Holoshitz, Y., Eldar, S., Frenkel, T. I., Muller, D., Charney, D. S., Pine, D. S., Fox, N. A., & Wald, I. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2009.09070956 · Cited by 193 · see citing works
Clarke, P. J., Notebaert, L., & MacLeod, C. (2014) · BMC Psychiatry · doi:10.1186/1471-244x-14-8 · Cited by 188 · see citing works
Reliability of two versions of the dot-probe task using photographic faces
Staugaard, S. R. (2009) · Cited by 187 · see citing works
Enock, P. M., Hofmann, S. G., & McNally, R. J. (2014) · Cognitive Therapy and Research · doi:10.1007/s10608-014-9606-z · Cited by 186 · see citing works
Pérez‐Edgar, K. E., Bar‐Haim, Y., McDermott, J. M., Gorodetsky, E. K., Hodgkinson, C. A., Goldman, D. A., Monique Ernst, D., Pine, D. S., & Fox, N. A. (2009) · Biological Psychology · doi:10.1016/j.biopsycho.2009.08.009 · Cited by 171 · see citing works
Attentional retraining: A randomized clinical trial for pathological worry
Hazen, R. A., Vasey, M. W., & Schmidt, N. B. (2008) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2008.07.004 · Cited by 140 · see citing works
Pergamin‐Hight, L., Bakermans‐Kranenburg, M. J., van IJzendoorn, M. H., & Bar‐Haim, Y. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.10.030 · Cited by 136 · see citing works
Britton, J. C., Bar-Haim, Y., Clementi, M. A., Sankin, L. S., Chen, G., Shechner, T., Norcross, M. A., Spiro, C. N., Lindstrom, K. M., & Pine, D. S. (2013) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2012.11.001 · Cited by 101 · see citing works
Waechter, S., & Stolz, J. A. (2015) · Cognitive Therapy and Research · doi:10.1007/s10608-015-9670-z · Cited by 87 · see citing works
Dear, B. F., Sharpe, L., Nicholas, M. K., & Refshauge, K. M. (2011) · Journal of Pain · doi:10.1016/j.jpain.2011.07.003 · Cited by 80 · see citing works
The effect of attention modification with explicit vs. minimal instructions on worry
Krebs, G., Hirsch, C. R., & Mathews, A. (2010) · Behaviour Research and Therapy · doi:10.1016/j.brat.2009.10.009 · Cited by 79 · see citing works
Hoyle, R. H., & Robinson, J. C. (2008) · Sage eBooks · doi:10.4135/9781412976190.n10 · Cited by 70 · see citing works
Barch, D. M., & Yarkoni, T. (2013) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-013-0201-7 · Cited by 67 · see citing works
Hirsch, C. R., MacLeod, C., Mathews, A., Sandher, O., Siyani, A., & Hayes, S. (2011) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2010.09.013 · Cited by 65 · see citing works
Emil Kraepelin: Icon and Reality
Engstrom, E. J., & Kendler, K. S. (2015) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2015.15050665 · Cited by 65 · see citing works
Moving From Clinical Trials to Precision Medicine
Pencina, M. J., & Peterson, E. D. (2016) · JAMA · doi:10.1001/jama.2016.4839 · Cited by 65 · see citing works
Schäfer, J., Bernstein, A., Zvielli, A., Höfler, M., Wïttchen, H., & Schönfeld, S. (2016) · Depression and Anxiety · doi:10.1002/da.22526 · Cited by 52 · see citing works
Self-citation(De)coupling of our eyes and our mind’s eye: A dynamic process perspective on attentional bias.
Amir, I., Zvielli, A., & Bernstein, A. (2016) · Emotion · doi:10.1037/emo0000172 · Cited by 51 · see citing works
Self-citationBarch, D. M., & Mathalon, D. H. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.01.004 · Cited by 41 · see citing works
Attentional Bias Dynamics and Posttraumatic Stress in Survivors of Violent Conflict and Atrocities
Yuval, K., Zvielli, A., & Bernstein, A. (2016) · Clinical Psychological Science · doi:10.1177/2167702616649349 · Cited by 32 · see citing works
Self-citationTo honor Kraepelin...: From symptoms to pathology in the diagnosis of mental illness.
Kihlstrom, J. F. (2004) · American Psychological Association eBooks · doi:10.1037/10456-011 · Cited by 30 · see citing works
Calamaras, M. R., Tone, E. B., & Anderson, P. L. (2012) · Journal of Clinical Psychology · doi:10.1002/jclp.21875 · Cited by 24 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- Harvey AG Watkins E Mansell W 2004 Cognitive behavioural processes across psychological disorders New York Oxford University Press
- Nunnally JD Bernstein IH 1994 Psychometric theory 3 New York McGraw-Hill
Cited by
Sorted by citations
Neuroplasticity in cognitive and psychological mechanisms of depression: an integrative model
Price, R. B., & Duman, R. (2020) · Molecular Psychiatry · doi:10.1038/s41380-019-0615-x · Cited by 721 · see citing works
Parsons, S. D., Kruijt, A., & Fox, E. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919879695 · Cited by 424 · see citing works
Attentional bias for threat: Crisis or opportunity?
McNally, R. J. (2018) · Clinical Psychology Review · doi:10.1016/j.cpr.2018.05.005 · Cited by 248 · see citing works
Anxiety and Threat-Related Attention: Cognitive-Motivational Framework and Treatment
Mogg, K., & Bradley, B. P. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.01.001 · Cited by 210 · see citing works
Fleeting reliability in the dot-probe task
Chapman, A., Devue, C., & Grimshaw, G. M. (2019) · Psychological Research · doi:10.1007/s00426-017-0947-6 · Cited by 172 · see citing works
Anxiety-Linked Attentional Bias: Is It Reliable?
MacLeod, C., Grafton, B., & Notebaert, L. (2019) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050718-095505 · Cited by 156 · see citing works
Association between negative cognitive bias and depression: A symptom-level approach.
Beevers, C. G., Mullarkey, M. C., Dainer‐Best, J., Stewart, R. A., Labrada, J., Allen, J. J. B., McGeary, J. E., & Shumake, J. (2019) · Journal of Abnormal Psychology · doi:10.1037/abn0000405 · Cited by 145 · see citing works
Computational Psychiatry Needs Time and Context
Hitchcock, P., Fried, E. I., & Frank, M. J. (2021) · Annual Review of Psychology · doi:10.1146/annurev-psych-021621-124910 · Cited by 135 · see citing works
A developmental neuroscience perspective on affect-biased attention
Morales, S., Fu, X., & Pérez‐Edgar, K. E. (2016) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2016.08.001 · Cited by 130 · see citing works
Lazarov, A., Suarez‐Jimenez, B., Tamman, A. J. F., Falzon, L., Zhu, X., Edmondson, D. E., & Neria, Y. (2018) · Psychological Medicine · doi:10.1017/s0033291718002313 · Cited by 111 · see citing works
The reliability and stability of visual working memory capacity
Xu, Z., Adam, K. C. S., Fang, X., & Vogel, E. K. (2017) · Behavior Research Methods · doi:10.3758/s13428-017-0886-6 · Cited by 107 · see citing works
Skinner, I., Hübscher, M., Moseley, G. L., Lee, H., Wand, B. M., Traeger, A. C., Gustin, S. M., & McAuley, J. H. (2017) · Behavior Research Methods · doi:10.3758/s13428-017-0946-y · Cited by 108 · see citing works
Individual differences in computational psychiatry: A review of current challenges
Karvelis, P., Paulus, M. P., & Diaconescu, A. O. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105137 · Cited by 113 · see citing works
Kruijt, A., Parsons, S. D., & Fox, E. (2019) · Journal of Abnormal Psychology · doi:10.1037/abn0000406 · Cited by 103 · see citing works
Hur, J., Stockbridge, M. D., Fox, A. S., & Shackman, A. J. (2019) · Progress in brain research · doi:10.1016/bs.pbr.2019.03.012 · Cited by 91 · see citing works
Brown, V. M., Chen, J.-Z., Gillan, C., & Price, R. (2020) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2019.12.019 · Cited by 90 · see citing works
Marin, M., Hammoud, M. Z., Klumpp, H., Simon, N. M., & Milad, M. R. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.4833 · Cited by 84 · see citing works
Price, R. B., Brown, V., & Siegle, G. J. (2019) · Biological Psychiatry · doi:10.1016/j.biopsych.2018.09.022 · Cited by 84 · see citing works
Fu, X., & Pérez‐Edgar, K. E. (2018) · Developmental Review · doi:10.1016/j.dr.2018.11.002 · Cited by 85 · see citing works
Hardman, C. A., Jones, A., Burton, S. P., Duckworth, J. J., McGale, L. S., Mead, B. R., Roberts, C. A., Field, M., & Werthmann, J. (2020) · Appetite · doi:10.1016/j.appet.2020.104986 · Cited by 80 · see citing works
Hagan, K. E., Alasmar, A., Exum, A., Chinn, B., & Forbush, K. T. (2020) · Appetite · doi:10.1016/j.appet.2020.104710 · Cited by 79 · see citing works
Attentional threat biases and their role in anxiety: A neurophysiological perspective
Wieser, M. J., & Keil, A. (2020) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2020.05.004 · Cited by 72 · see citing works
Waltmann, M., Schlagenhauf, F., & Deserno, L. (2022) · Behavior Research Methods · doi:10.3758/s13428-021-01739-7 · Cited by 69 · see citing works
Test-retest reliability of attention bias for food: Robust eye-tracking and reaction time indices
van Ens, W., Schmidt, U. H., Campbell, I. C., Roefs, A., & Werthmann, J. (2019) · Appetite · doi:10.1016/j.appet.2019.01.020 · Cited by 67 · see citing works
mHealth Assessment and Intervention of Depression and Anxiety in Older Adults
Grossman, J. T., Frumkin, M., Rodebaugh, T., & Lenze, E. (2020) · Harvard Review of Psychiatry · doi:10.1097/hrp.0000000000000255 · Cited by 45 · see citing works
Self-citationDainer‐Best, J., Lee, H. Y., Shumake, J., Yeager, D. S., & Beevers, C. G. (2018) · Psychological Assessment · doi:10.1037/pas0000602 · Cited by 59 · see citing works
Albery, I. P., Spada, M. M., & Nikčević, A. V. (2021) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2639 · Cited by 60 · see citing works
Klawohn, J., Bruchnak, A., Burani, K., Meyer, A. M., Lazarov, A., Bar‐Haim, Y., & Hajcak, G. (2020) · Behaviour Research and Therapy · doi:10.1016/j.brat.2020.103762 · Cited by 57 · see citing works
McNamara, M. E., Zisser, M., Beevers, C. G., & Shumake, J. (2022) · Behaviour Research and Therapy · doi:10.1016/j.brat.2022.104086 · Cited by 56 · see citing works
Jones, A., Christiansen, P., & Field, M. (2018) · Psychology of Addictive Behaviors · doi:10.1037/adb0000414 · Cited by 56 · see citing works
Optimizing assessments of post‐error slowing: A neurobehavioral investigation of a flanker task
Schroder, H. S., Nickels, S., Cárdenas, E. F., Breiger, M., Perlo, S., & Pizzagalli, D. A. (2019) · Psychophysiology · doi:10.1111/psyp.13473 · Cited by 55 · see citing works
Smith, K. E., Mason, T. B., Juarascio, A., Weinbach, N., Dvorak, R., Crosby, R. D., & Wonderlich, S. A. (2020) · International Journal of Eating Disorders · doi:10.1002/eat.23235 · Cited by 53 · see citing works
Taylor, C. T., Stein, M. B., Simmons, A. N., He, F., Oveis, C., Shakya, H. B., Sieber, W. J., Fowler, J. H., & Jain, S. (2024) · Biological Psychiatry · doi:10.1016/j.biopsych.2023.07.024 · Cited by 53 · see citing works
Attentional biases in human anxiety
Valadez, E. A., Pine, D. S., Fox, N. A., & Bar‐Haim, Y. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104917 · Cited by 55 · see citing works
The impact of negative affect on attention patterns to threat across the first 2 years of life.
Pérez‐Edgar, K. E., Morales, S., LoBue, V., Taber‐Thomas, B. C., Allen, E. K., Brown, K. M., & Buss, K. A. (2017) · Developmental Psychology · doi:10.1037/dev0000408 · Cited by 48 · see citing works
Heterogeneity of the Anxiety-Related Attention Bias: A Review and Working Model for Future Research
Dennis‐Tiwary, T. A., Roy, A. K., Denefrio, S., & Myruski, S. (2019) · Clinical Psychological Science · doi:10.1177/2167702619838474 · Cited by 49 · see citing works
Vago, D. R., Gupta, R. S., & Lazar, S. W. (2018) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2018.12.015 · Cited by 49 · see citing works
Macatee, R. J., Albanese, B. J., Schmidt, N. B., & Cougle, J. R. (2017) · Behaviour Research and Therapy · doi:10.1016/j.brat.2016.12.013 · Cited by 47 · see citing works
Machulska, A., Eiler, T. J., Kleinke, K., Grünewald, A., Brück, R., Jahn, K., Niehaves, B., & Klucken, T. (2021) · Behaviour Research and Therapy · doi:10.1016/j.brat.2021.103858 · Cited by 46 · see citing works
Attentional Bias in Children with Social Anxiety Disorder
Schmidtendorf, S., Wiedau, S., Asbrand, J., Tuschen‐Caffier, B., & Heinrichs, N. (2017) · Cognitive Therapy and Research · doi:10.1007/s10608-017-9880-7 · Cited by 45 · see citing works
Liu, P., Taber‐Thomas, B. C., Fu, X., & Pérez‐Edgar, K. E. (2017) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2017.11.016 · Cited by 45 · see citing works
Mapping Dynamic Interactions Among Cognitive Biases in Depression
Everaert, J., Bernstein, A., Joormann, J., & Koster, E. H. W. (2020) · Emotion Review · doi:10.1177/1754073919892069 · Cited by 44 · see citing works
Self-citationLazarov, A., Basel, D., Dolan, S. C., Dillon, D. G., Pizzagalli, D. A., & Schneier, F. R. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.04.063 · Cited by 45 · see citing works
Diane Swick, A., & Ashley, V. (2017) · Scientific Reports · doi:10.1038/s41598-017-15226-7 · Cited by 44 · see citing works
Lenze, E. J., Nicol, G. E., Barbour, D. L., Kannampallil, T., Wong, A. W. K., Piccirillo, J., Drysdale, A. T., Sylvester, C. M., Haddad, R., Miller, J. P., et al. (2021) · Journal of Psychiatry and Neuroscience · doi:10.1503/jpn.200042 · Cited by 43 · see citing works
Self-citationXu, I., Passell, E. J., Strong, R. W., Grinspoon, E. A., Wu, C. Y., Jung, L., Germine, L. T., & Germine, L. T. (2024) · Clinical Psychological Science · doi:10.1177/21677026241253826 · Cited by 46 · see citing works
Adam, K. C. S., Vogel, E. K., & Awh, E. (2020) · Psychophysiology · doi:10.1111/psyp.13691 · Cited by 40 · see citing works
Naim, R., Kivity, Y., Bar-Haim, Y., & Huppert, J. (2018) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2017.10.006 · Cited by 43 · see citing works
Self-citationBrown, V. M., Price, R. B., & Dombrovski, A. Y. (2023) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-023-01080-w · Cited by 40 · see citing works
Soleymani, A., Ivanov, Y., Mathôt, S., & de Jong, P. J. (2019) · Addictive Behaviors · doi:10.1016/j.addbeh.2019.106117 · Cited by 41 · see citing works
Intergenerational transmission of attentional bias and anxiety
Aktar, E., Bockstaele, B. V., Pérez‐Edgar, K. E., Wiers, R. W. H. J., & Bögels, S. M. (2018) · Developmental Science · doi:10.1111/desc.12772 · Cited by 37 · see citing works
Bockstaele, B. V., Lamens, L., Salemink, E., Wiers, R. W. H. J., Bögels, S. M., & Nikolaou, K. (2019) · Cognition & Emotion · doi:10.1080/02699931.2019.1609423 · Cited by 38 · see citing works
Everaert, J., & Koster, E. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-816660-4.00009-x · Cited by 30 · see citing works
Vulnerabilities in social anxiety: Integrating intra- and interpersonal perspectives
Ginat-Frolich, R., Gilboa-Schechtman, E., Huppert, J. D., Aderka, I. M., Alden, L. E., Bar-Haim, Y., Becker, E. S., Bernstein, A., Geva, R., Heimberg, R. G., et al. (2024) · Clinical Psychology Review · doi:10.1016/j.cpr.2024.102415 · Cited by 36 · see citing works
Self-citationApproach-avoidance modification as an add-on in smoking cessation: A randomized-controlled study
Wittekind, C. E., Reibert, E., Takano, K., Ehring, T. W., Pogarell, O. M., & Rüther, T. (2018) · Behaviour Research and Therapy · doi:10.1016/j.brat.2018.12.004 · Cited by 36 · see citing works
Kemps, E., Goossens, L., Petersen, J. M., Verbeken, S., Vervoort, L., & Braet, C. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101840 · Cited by 37 · see citing works
Grafton, B., Teng, S. S. W., & MacLeod, C. (2021) · Behaviour Research and Therapy · doi:10.1016/j.brat.2021.103805 · Cited by 36 · see citing works
Reliability of Decision-Making and Reinforcement Learning Computational Parameters
Mkrtchian, A., Valton, V., & Roiser, J. P. (2023) · Computational Psychiatry · doi:10.5334/cpsy.86 · Cited by 41 · see citing works
Physically active individuals look for more: An eye‐tracking study of attentional bias
Cheval, B., Miller, M. W., Orsholits, D., Berry, T. R., Sander, D., & Boisgontier, M. P. (2020) · Psychophysiology · doi:10.1111/psyp.13582 · Cited by 34 · see citing works
Toward dynamic phenotypes and the scalable measurement of human behavior
Germine, L. T., Strong, R. W., Singh, S. M., & Sliwinski, M. J. (2020) · Neuropsychopharmacology · doi:10.1038/s41386-020-0757-1 · Cited by 29 · see citing works
Klawohn, J., Hajcak, G., Amir, N., Kathmann, N., & Riesel, A. (2020) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2020.07.005 · Cited by 35 · see citing works
Fu, X., Nelson, E. E., Borge, M., Buss, K. A., & Pérez‐Edgar, K. E. (2019) · Development and Psychopathology · doi:10.1017/s0954579419000427 · Cited by 34 · see citing works
Shi, C., Taylor, S., Witthöft, M., Du, X., Zhang, T., Lu, S., & Ren, Z. (2022) · Psychological Medicine · doi:10.1017/s0033291721005432 · Cited by 32 · see citing works
Attention bias modification reduces neural correlates of response monitoring
Nelson, B. D., Jackson, F. L., Amir, N., & Hajcak, G. (2017) · Biological Psychology · doi:10.1016/j.biopsycho.2017.08.059 · Cited by 32 · see citing works
Parsons, S. D., Kruijt, A., & Fox, E. (2018) · doi:10.31234/osf.io/6ka9z · Cited by 32 · see citing works
Liu, P., & Pérez‐Edgar, K. E. (2018) · Adolescent Research Review · doi:10.1007/s40894-018-0092-5 · Cited by 30 · see citing works
Psychometrics and Psychological Assessment
Hunsley, J. D., & Allan, T. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108235433.002 · Cited by 33 · see citing works
Platt, B., Sfärlea, A., Buhl, C., Löchner, J., Neumüller, J., Thomsen, L. A., Starman‐Wöhrle, K., Salemink, E., & Schulte‐Körne, G. (2021) · Child Psychiatry & Human Development · doi:10.1007/s10578-020-01105-2 · Cited by 31 · see citing works
Hitchcock, P. F., Britton, W. B., Mehta, K. P., & Frank, M. J. (2022) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-022-01033-9 · Cited by 30 · see citing works
Attention allocation in posttraumatic stress disorder: an eye-tracking study
Lazarov, A., Suarez‐Jimenez, B., Zhu, X., Pine, D. S., Bar‐Haim, Y., & Neria, Y. (2021) · Psychological Medicine · doi:10.1017/s0033291721000581 · Cited by 29 · see citing works
Shamai‐Leshem, D., Linetzky, M., & Bar‐Haim, Y. (2022) · Cognitive Therapy and Research · doi:10.1007/s10608-022-10331-y · Cited by 31 · see citing works
A review of attentional bias modification trainings for depression
Guo, L., Cai, X., Yang, Q., Cui, Q., Huang, L., Jing, X., & Wang, Y. (2022) · CNS Neuroscience & Therapeutics · doi:10.1111/cns.14022 · Cited by 29 · see citing works
Caudek, C., Ceccarini, F., & Sica, C. (2017) · Behaviour Research and Therapy · doi:10.1016/j.brat.2017.05.003 · Cited by 29 · see citing works
Attentional avoidance of emotional information in emotional eating
Deroost, N., & Cserjési, R. (2018) · Psychiatry Research · doi:10.1016/j.psychres.2018.08.053 · Cited by 29 · see citing works
Thunberg, C., Wiker, T., Bundt, C., & Huster, R. J. (2024) · Cortex · doi:10.1016/j.cortex.2024.02.008 · Cited by 28 · see citing works
Huppert, J., Kivity, Y., Cohen, L., Strauss, A. Y., Elizur, Y., & Weiss, M. (2018) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2018.08.002 · Cited by 29 · see citing works
Self-citationThe Reliability and Validity of Response-Based Measures of Attention Bias
Meissel, E. E. E., Liu, H., Stevens, E. S., Evans, T. C., Britton, J. C., Letkiewicz, A. M., & Shankman, S. A. (2021) · Cognitive Therapy and Research · doi:10.1007/s10608-021-10212-w · Cited by 26 · see citing works
Attentional bias toward negative stimuli in PTSD: an eye-tracking study
Veerapa, É., Grandgenèvre, P., Vaïva, G., Duhem, S., Fayoumi, M. E., Vinnac, B., Szaffarczyk, S., Wathelet, M., Fovet, T., & D’Hondt, F. (2022) · Psychological Medicine · doi:10.1017/s0033291722003063 · Cited by 26 · see citing works
The effects of attentional bias modification on emotion regulation
Bockstaele, B. V., Notebaert, L., MacLeod, C., Salemink, E., Clarke, P., Verschuère, B., Bögels, S. M., & Wiers, R. W. H. J. (2018) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2018.08.010 · Cited by 26 · see citing works
Different attention bias patterns in anorexia nervosa restricting and binge/purge types
Mann, T. G., Hamdan, S., Bar‐Haim, Y., Lazarov, A., Enoch‐Levy, A., Dubnov‐Raz, G., Treasure, J. L., & Stein, D. J. (2018) · European Eating Disorders Review · doi:10.1002/erv.2593 · Cited by 25 · see citing works
Niles, A. N., Woolley, J. D., Tripp, P., Pesquita, A., Vinogradov, S., Neylan, T. C., & O’Donovan, A. (2020) · Clinical Psychological Science · doi:10.1177/2167702620902119 · Cited by 26 · see citing works
Hsu, K. J., McNamara, M. E., Shumake, J., Stewart, R. A., Labrada, J., Alario, A. A., Gonzalez, G. D. S., Schnyer, D. M., & Beevers, C. G. (2020) · Depression and Anxiety · doi:10.1002/da.23042 · Cited by 23 · see citing works
Rumination Derails Reinforcement Learning With Possible Implications for Ineffective Behavior
Hitchcock, P., Forman, E. M., Rothstein, N. J., Zhang, F., Kounios, J., Niv, Y., & Sims, C. R. (2021) · Clinical Psychological Science · doi:10.1177/21677026211051324 · Cited by 25 · see citing works
Armstrong, T., Engel, M., Press, T., Sonstroem, A., & Reed, J. (2019) · Motivation and Emotion · doi:10.1007/s11031-019-09770-0 · Cited by 23 · see citing works
Attentional biases in older adults with generalized anxiety disorder
Cabrera, I., Miranda, D. B., & Montorio, I. (2020) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2020.102207 · Cited by 22 · see citing works
Simulating thoughts to measure and study internal attention in mental health
Amir, I., Ruimi, L., & Bernstein, A. (2021) · Scientific Reports · doi:10.1038/s41598-021-81756-w · Cited by 22 · see citing works
Self-citationThe free-viewing matrix task: A reliable measure of attention allocation in psychopathology
Shamai‐Leshem, D., Abend, R., Arad, G., Azriel, O., Chong, L. J., de Jong, P. J., Dykan, C. D. G., Hajcak, G., Klawohn, J., Meyer, A. M., et al. (2023) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2023.102789 · Cited by 23 · see citing works
Attentional biases in depression: Relation to disorder severity, rumination, and anhedonia
Krings, A., Heeren, A., Fontaine, P., & Blairy, S. (2020) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2020.152173 · Cited by 23 · see citing works
Schäfer, J., Zvielli, A., Höfler, M., Wittchen, H.-U., & Bernstein, A. (2018) · Behaviour Research and Therapy · doi:10.1016/j.brat.2018.01.004 · Cited by 22 · see citing works
Self-citationAttention allocation in OCD: A systematic review and meta-analysis of eye-tracking-based research
Basel, D., Hallel, H., Dar, R., & Lazarov, A. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.12.141 · Cited by 22 · see citing works
Cludius, B., Wenzlaff, F., Briken, P., & Wittekind, C. E. (2017) · Journal of Obsessive-Compulsive and Related Disorders · doi:10.1016/j.jocrd.2017.12.007 · Cited by 22 · see citing works
Beevers, C. G., Hsu, K. J., Schnyer, D. M., Smits, J. A. J., & Shumake, J. (2021) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000683 · Cited by 20 · see citing works
Woody, M. L., Miskovic, V., Owens, M., James, K. M., Feurer, C., Sosoo, E. E., & Gibb, B. E. (2017) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2016.12.007 · Cited by 20 · see citing works
Karoly, H. C., Schacht, J. P., Jacobus, J., Meredith, L. R., Taylor, C. T., Tapert, S. F., Gray, K. M., & Squeglia, L. M. (2019) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2019.04.007 · Cited by 20 · see citing works
Is the Hebb repetition task a reliable measure of individual differences in sequence learning?
Bogaerts, L., Siegelman, N., Ben-Porat, T., & Frost, R. (2017) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2017.1307432 · Cited by 19 · see citing works
Cox, J. A., Christensen, B. K., & Goodhew, S. C. (2017) · Cognition & Emotion · doi:10.1080/02699931.2017.1386619 · Cited by 19 · see citing works
Auday, E. S., Taber‐Thomas, B. C., & Pérez‐Edgar, K. E. (2018) · NeuroImage Clinical · doi:10.1016/j.nicl.2018.04.003 · Cited by 19 · see citing works
Attentional Bias Modification in Virtual Reality – A VR-Based Dot-Probe Task With 2D and 3D Stimuli
Ma, L., Kruijt, A., Nöjd, S., Zetterlund, E., Andersson, G., & Carlbring, P. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02526 · Cited by 17 · see citing works
Meta-Awareness of Dysregulated Emotional Attention
Ruimi, L., Hadash, Y., Zvielli, A., Amir, I., Goldstein, P., & Bernstein, A. (2018) · Clinical Psychological Science · doi:10.1177/2167702618776948 · Cited by 17 · see citing works
Self-citationPrice, R. B., Beltz, A. M., Woody, M. L., Cummings, L. R., Gilchrist, D., & Siegle, G. J. (2020) · Clinical Psychological Science · doi:10.1177/2167702620906149 · Cited by 17 · see citing works
- Authors
- Rodebaugh, T. L., Scullin, R. B., Langer, J. K., Dixon, D. J., Huppert, J. D., Bernstein, A., Zvielli, A., & Lenze, E. J.
- Affiliations
- Hebrew University of Jerusalem (IL)
- University of Haifa (IL)
- ORCID
- Venue
- Journal of Abnormal Psychology
- Published
- 2016-08
- Volume
- 125
- Issue
- 6
- Pages
- 840-851
- ISSN
- 0021-843X (ISSN-L)
- 1939-1846
- PMC
- PMC4980228
- OpenAlex
- W2465300579
- Cited by
- 312
- References
- 53
- Citations by year
- 2026: 21 · 2025: 24 · 2024: 28 · 2023: 39 · 2022: 41 · 2021: 40 · 2020: 37 · 2019: 24 · 2018: 33 · 2017: 22 · 2016: 2
- FWCI
- 38.33
- Type
- journal article
- Language
- en
- Update notices
- correction (2016-09-01)
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of Abnormal Psychology (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health (UL1TR000448)
- National Institute of Mental Health (R21MH090308, R01MH070547)
- National Center for Research Resources (UL1RR024992)
- National Center for Advancing Translational Sciences
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- attentional bias, measurement reliability, psychopathology, Research Domain Criteria, target engagement, replication, individual differences, reliability reporting
- MeSH terms
- Attentional Bias, Mental Disorders, Humans, Individuality, Models, Psychological, National Institute of Mental Health (U.S.), Research Design, United States, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
