The DOI matches its Crossref record; 154 of the 154 references it cites were found in a registry or an index.
Attention in Psychology, Neuroscience, and Machine Learning
Open accessAbstract
Attention is the important ability to flexibly control limited computational resources. It has been studied in conjunction with many other topics in neuroscience and psychology including awareness, vigilance, saliency, executive control, and learning. It has also recently been applied in several domains in machine learning. The relationship between the study of biological attention and its use as a tool to enhance artificial neural networks is not always clear. This review starts by providing an overview of how attention is conceptualized in the neuroscience and psychology literature. It then covers several use cases of attention in machine learning, indicating their biological counterparts where they exist. Finally, the ways in which artificial attention can be further inspired by biology for the production of complex and integrative systems is explored.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Advances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,886
Effective Approaches to Attention-based Neural Machine Translation
Luong, T., Pham, H., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1166 · Cited by 8,382
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
Computational modelling of visual attention
Itti, L., & Koch, C. (2001) · Nature Reviews Neuroscience · doi:10.1038/35058500 · Cited by 4,733
Rubber hands ‘feel’ touch that eyes see
Botvinick, M., & Cohen, J. (1998) · Nature · doi:10.1038/35784 · Cited by 4,410
The distinct modes of vision offered by feedforward and recurrent processing
Lamme, V. A. F., & Roelfsema, P. R. (2000) · Trends in Neurosciences · doi:10.1016/s0166-2236(00)01657-x · Cited by 2,338
The expected value of control: an integrative theory of anterior cingulate cortex function
Shenhav, A., Botvinick, M. M., & Cohen, J. D. (2013) · Neuron · doi:10.1016/j.neuron.2013.07.007 · Cited by 2,321
Proceedings of IEEE International Conference on Computer Vision
(1995) · doi:10.1109/iccv.1995 · Cited by 2,280
Zagoruyko, S., & Komodakis, N. (2016) · arXiv · doi:10.48550/arxiv.1612.03928 · Cited by 2,027
Contextual Cueing: Implicit Learning and Memory of Visual Context Guides Spatial Attention
Chun, M. M., & Jiang, Y. (1998) · Cognitive Psychology · doi:10.1006/cogp.1998.0681 · Cited by 1,959
Normalization as a canonical neural computation
Carandini, M., & Heeger, D. J. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3136 · Cited by 1,906 · cited 1×
“Biologically speaking, this form of interaction is most similar to horizontal connections within a visual area, which are known to carry out computations such as divisive normalization (Carandini and Heeger, 2012).”
BackgroundState-of-the-Art in Visual Attention Modeling
Borji, A., & Itti, L. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.89 · Cited by 1,817
Rizzolatti, G., Riggio, L., Dascola, I., & Umiltá, C. (1987) · Neuropsychologia · doi:10.1016/0028-3932(87)90041-8 · Cited by 1,812
What attributes guide the deployment of visual attention and how do they do it?
Wolfe, J. M., & Horowitz, T. S. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1411 · Cited by 1,766 · cited 1×
“Because certain features can create a pop-out effect—for example, a single red shape amongst several black ones will immediately draw attention—visual search tasks also engage bottom-up attention which, depending on the task, may need to be suppressed (Wolfe and Horowitz, 2004).”
BackgroundNeural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex
Luck, S. J., Chelazzi, L., Hillyard, S. A., & Desimone, R. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.77.1.24 · Cited by 1,615
Parietal lobe contributions to episodic memory retrieval
Wagner, A. D., Shannon, B. J., Kahn, I., & Buckner, R. L. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.07.001 · Cited by 1,571
Hierarchical Bayesian inference in the visual cortex
Lee, T. S., & Mumford, D. (2003) · Journal of the Optical Society of America A · doi:10.1364/josaa.20.001434 · Cited by 1,473
A taxonomy of external and internal attention.
Chun, M. M., Golomb, J. D., & Turk-Browne, N. B. (2011) · Annual Review of Psychology · doi:10.1146/annurev.psych.093008.100427 · Cited by 1,472
Feature-based attention influences motion processing gain in macaque visual cortex
Treue, S., & Trujillo, J. C. M. (1999) · Nature · doi:10.1038/21176 · Cited by 1,465
The Normalization Model of Attention
Reynolds, J. H., & Heeger, D. J. (2009) · Neuron · doi:10.1016/j.neuron.2009.01.002 · Cited by 1,457
Eye movements in natural behavior
Hayhoe, M., & Ballard, D. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.02.009 · Cited by 1,326
Long Short-Term Memory-Networks for Machine Reading
Cheng, J., Dong, L., & Lapata, M. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1053 · Cited by 1,172
Graves, A., Wayne, G., & Danihelka, I. (2014) · arXiv · doi:10.48550/arxiv.1410.5401 · Cited by 1,058
The pulvinar regulates information transmission between cortical areas based on attention demands
Saalmann, Y. B., Pinsk, M. A., Wang, L., Li, X., & Kastner, S. (2012) · Science · doi:10.1126/science.1223082 · Cited by 1,016
Functional brain development in humans
Johnson, M. H. (2001) · Nature Reviews Neuroscience · doi:10.1038/35081509 · Cited by 980
Attention is not not Explanation
Wiegreffe, S., & Pinter, Y. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1002 · Cited by 966
Global workspace theory of consciousness: toward a cognitive neuroscience of human experience
Baars, B. J. (2005) · Progress in Brain Research · doi:10.1016/s0079-6123(05)50004-9 · Cited by 888
Vigilance, alertness, or sustained attention: physiological basis and measurement
Oken, B. S., Salinsky, M. C., & Elsas, S. M. (2006) · Clinical Neurophysiology · doi:10.1016/j.clinph.2006.01.017 · Cited by 887
Saliency, attention, and visual search: An information theoretic approach
Bruce, N. D. B., & Tsotsos, J. K. (2009) · Journal of Vision · doi:10.1167/9.3.5 · Cited by 855
fMRI evidence for objects as the units of attentional selection
O'Craven, K. M., Downing, P. E., & Kanwisher, N. (1999) · Nature · doi:10.1038/44134 · Cited by 846
Object-based attention in the primary visual cortex of the macaque monkey
Roelfsema, P. R., Lamme, V. A. F., & Spekreijse, H. (1998) · Nature · doi:10.1038/26475 · Cited by 814
Multiple Object Recognition with Visual Attention
Ba, J., Mnih, V., & Kavukcuoglu, K. (2014) · arXiv · doi:10.48550/arxiv.1412.7755 · Cited by 808
The Automaticity of Visual Statistical Learning.
Turk-Browne, N. B., Jungé, J. A., & Scholl, B. J. (2005) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.134.4.552 · Cited by 795
Crossmodal Space and Crossmodal Attention
(2004) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198524861.001.0001 · Cited by 791
Information-seeking, curiosity, and attention: computational and neural mechanisms
Gottlieb, J., Oudeyer, P.-Y., Lopes, M., & Baranes, A. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.09.001 · Cited by 784 · cited 1×
“An additional factor that drives biological attention but is perhaps underrepresented in artificial attention systems is curiosity (Gottlieb et al., 2013).”
Samuels, E., & Szabadi, E. (2008) · Current Neuropharmacology · doi:10.2174/157015908785777229 · Cited by 764
Attentional stimulus selection through selective synchronization between monkey visual areas
Bosman, C. A., Schoffelen, J.-M., Brunet, N., Oostenveld, R., Bastos, A. M., Womelsdorf, T., Rubehn, B., Stieglitz, T., De Weerd, P., & Fries, P. (2012) · Neuron · doi:10.1016/j.neuron.2012.06.037 · Cited by 720
Visual correlates of fixation selection: effects of scale and time
Tatler, B. W., Baddeley, R. J., & Gilchrist, I. D. (2005) · Vision Research · doi:10.1016/j.visres.2004.09.017 · Cited by 700
Visual attention mediated by biased competition in extrastriate visual cortex
Desimone, R. (1998) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1998.0280 · Cited by 696
Differential attention-dependent response modulation across cell classes in macaque visual area V4
Mitchell, J. F., Sundberg, K. A., & Reynolds, J. H. (2007) · Neuron · doi:10.1016/j.neuron.2007.06.018 · Cited by 665
Superior Colliculus and Visual Spatial Attention
Krauzlis, R. J., Lovejoy, L. P., & Zénon, A. (2013) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062012-170249 · Cited by 660
A selective review of selective attention research from the past century
Driver, J. (2001) · British Journal of Psychology · doi:10.1348/000712601162103 · Cited by 658
Shapiro, K. L., Raymond, J. E., & Arnell, K. M. (1997) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(97)01094-2 · Cited by 644
Visual attention: Insights from brain imaging
Kanwisher, N., & Wojciulik, E. (2000) · Nature Reviews Neuroscience · doi:10.1038/35039043 · Cited by 632
Learning multiple visual domains with residual adapters
Rebuffi, S.-A., Bilen, H., & Vedaldi, A. (2017) · arXiv · doi:10.48550/arxiv.1705.08045 · Cited by 605
The Neural Correlates of Motor Skill Automaticity
Poldrack, R. A., Sabb, F. W., Foerde, K., Tom, S. M., Asarnow, R. F., Bookheimer, S. Y., & Knowlton, B. J. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.3880-04.2005 · Cited by 600 · cited 1×
“…transformation are not entirely clear but insofar as they seem to rely on moving the burden of the task to different, possibly lower/more reflexive brain areas, it may benefit artificial systems to have multiple redundant pathways that can be engaged differently by attention (Poldrack et al., 2005).”
BackgroundGlobal effects of feature-based attention in human visual cortex
Saenz, M., Buracas, G. T., & Boynton, G. M. (2002) · Nature Neuroscience · doi:10.1038/nn876 · Cited by 598
No one knows what attention is
Hommel, B., Chapman, C. S., Cisek, P., Neyedli, H. F., Song, J.-H., & Welsh, T. N. (2019) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-019-01846-w · Cited by 594
The Nose Smells What the Eye Sees
Gottfried, J. A., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00392-1 · Cited by 567
Early, Involuntary Top-Down Guidance of Attention From Working Memory.
Soto, D., Heinke, D., Humphreys, G. W., & Blanco, M. J. (2005) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.31.2.248 · Cited by 565
Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanism
Firat, O., Cho, K., & Bengio, Y. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1101 · Cited by 562
Convolutional Neural Networks as a Model of the Visual System: Past, Present, and Future
Lindsay, G. W. (2021) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01544 · Cited by 557
Self-citationCiaramelli, E., Grady, C. L., & Moscovitch, M. (2008) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2008.03.022 · Cited by 534
Auditory attention — focusing the searchlight on sound
Fritz, J. B., Elhilali, M., David, S. V., & Shamma, S. A. (2007) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2007.07.011 · Cited by 520
Non-homogeneous Content-driven Video-retargeting
Wolf, L., Guttmann, M., & Cohen-Or, D. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4409010 · Cited by 503
The cocktail-party problem revisited: early processing and selection of multi-talker speech
Bronkhorst, A. W. (2015) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-015-0882-9 · Cited by 501
Automatic guidance of attention from working memory
Soto, D., Hodsoll, J., Rotshtein, P., & Humphreys, G. W. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.05.007 · Cited by 488
Jain, S., & Wallace, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.10186 · Cited by 467
Fries, P., Womelsdorf, T., Oostenveld, R., & Desimone, R. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4499-07.2008 · Cited by 458
Visuomotor Origins of Covert Spatial Attention
Moore, T., Armstrong, K. M., & Fallah, M. (2003) · Neuron · doi:10.1016/s0896-6273(03)00716-5 · Cited by 424
Attention and recollective experience in recognition memory
Gardiner, J. M., & Parkin, A. J. (1990) · Memory & Cognition · doi:10.3758/bf03197100 · Cited by 410
The brain circuitry of attention
Shipp, S. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.03.004 · Cited by 402
Pulvinar-Cortex Interactions in Vision and Attention
Zhou, H., Schafer, R. J., & Desimone, R. (2016) · Neuron · doi:10.1016/j.neuron.2015.11.034 · Cited by 386
Top-down control of visual attention
Noudoost, B., Chang, M. H., Steinmetz, N. A., & Moore, T. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.02.003 · Cited by 385
Extremely high conductivity observed in the triple point topological metal MoP
Kumar, N., Sun, Y., Nicklas, M., Watzman, S. J., Young, O., Leermakers, I., Hornung, J., Klotz, J., Gooth, J., Manna, K., et al. (2019) · RePEc: Research Papers in Economics · Cited by 374
Modulating early visual processing by language
de Vries, H., Strub, F., Mary, J., Larochelle, H., Pietquin, O., & Courville, A. C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.00683 · Cited by 369
Why Is There So Much More Research on Vision Than on Any Other Sensory Modality?
Hutmacher, F. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02246 · Cited by 368
Posner, M. I. (2008) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1417.011 · Cited by 345
Describing Multimedia Content Using Attention-Based Encoder-Decoder Networks
Cho, K., Courville, A., & Bengio, Y. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2477044 · Cited by 338
Neuronal Mechanisms of Visual Attention
Maunsell, J. H. R. (2015) · Annual Review of Vision Science · doi:10.1146/annurev-vision-082114-035431 · Cited by 331
A Neurodynamical cortical model of visual attention and invariant object recognition
Deco, G., & Rolls, E. T. (2004) · Vision Research · doi:10.1016/j.visres.2003.09.037 · Cited by 316
The Oxford handbook of attention
(2014) · Choice Reviews Online · doi:10.5860/choice.52-1132 · Cited by 300
Is subliminal learning really passive?
Seitz, A. R., & Watanabe, T. (2003) · Nature · doi:10.1038/422036a · Cited by 300
Competition Between Endogenous and Exogenous Orienting of Visual Attention.
Berger, A., Henik, A., & Rafal, R. (2005) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.134.2.207 · Cited by 294
Attentional enhancement of spatial resolution: linking behavioural and neurophysiological evidence
Anton-Erxleben, K., & Carrasco, M. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3443 · Cited by 289
Cortical Mechanisms of Feature-based Attentional Control
Liu, T. (2003) · Cerebral Cortex · doi:10.1093/cercor/bhg080 · Cited by 289
A source for feature-based attention in the prefrontal cortex
Bichot, N. P., Heard, M. T., DeGennaro, E. M., & Desimone, R. (2015) · Neuron · doi:10.1016/j.neuron.2015.10.001 · Cited by 283
SLAM: A connectionist model for attention in visual selection tasks
Phaf, R. H., Van der Heijden, A. H. C., & Hudson, P. T. W. (1990) · Cognitive Psychology · doi:10.1016/0010-0285(90)90006-p · Cited by 272
Psychostimulants and Cognition: A Continuum of Behavioral and Cognitive Activation
Wood, S., Sage, J. R., Shuman, T., & Anagnostaras, S. G. (2014) · Pharmacological Reviews · doi:10.1124/pr.112.007054 · Cited by 259
Buschman, T. J., & Miller, E. K. (2009) · Neuron · doi:10.1016/j.neuron.2009.06.020 · Cited by 255
ABC-CNN: An Attention Based Convolutional Neural Network for Visual Question Answering
Chen, K., Wang, J., Chen, L.-C., Gao, H., Xu, W., & Nevatia, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.05960 · Cited by 254
Automatic visual bias of perceived auditory location
Bertelson, P., & Aschersleben, G. (1998) · Psychonomic Bulletin & Review · doi:10.3758/bf03208826 · Cited by 252
Neurodynamics of Biased Competition and Cooperation for Attention: A Model With Spiking Neurons
Deco, G., & Rolls, E. T. (2005) · Journal of Neurophysiology · doi:10.1152/jn.01095.2004 · Cited by 238
Object-based attention: A tutorial review
Chen, Z. (2012) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-012-0322-z · Cited by 231
Feature-Based Attention in the Frontal Eye Field and Area V4 during Visual Search
Zhou, H., & Desimone, R. (2011) · Neuron · doi:10.1016/j.neuron.2011.04.032 · Cited by 227
The challenges of joint attention
Kaplan, F., & Hafner, V. V. (2006) · Interaction Studies. Social Behaviour and Communication in Biological and Artificial Systems · doi:10.1075/is.7.2.04kap · Cited by 225
CAT2000: A Large Scale Fixation Dataset for Boosting Saliency Research
Borji, A., & Itti, L. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.03581 · Cited by 212
What and where: A Bayesian inference theory of attention
Chikkerur, S., Serre, T., Tan, C., & Poggio, T. (2010) · Vision Research · doi:10.1016/j.visres.2010.05.013 · Cited by 197
The Development of Attention Systems and Working Memory in Infancy
Reynolds, G. D., & Romano, A. C. (2016) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2016.00015 · Cited by 197
Social attention and the brain
Klein, J. T., Shepherd, S. V., & Platt, M. L. (2009) · Current Biology · doi:10.1016/j.cub.2009.08.010 · Cited by 196
Paneri, S., & Gregoriou, G. G. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00545 · Cited by 189
Toneva, M., & Wehbe, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.11833 · Cited by 176
Neural mechanisms of attending to items in working memory
Manohar, S., Zokaei, N., Fallon, S. J., Vogels, T. P., & Husain, M. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.03.017 · Cited by 171
The negative priming paradigm: An update and implications for selective attention
Frings, C., Schneider, K. K., & Fox, E. (2015) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0841-4 · Cited by 164
Bayesian inference and attentional modulation in the visual cortex
Rao, R. P. N. (2005) · NeuroReport · doi:10.1097/01.wnr.0000183900.92901.fc · Cited by 161
Automaticity and Preattentive Processing
Treisman, A., Vieira, A., & Hayes, A. (1992) · The American Journal of Psychology · doi:10.2307/1423032 · Cited by 158
What is remembered? Role of attention on the encoding and retrieval of hippocampal representations
Muzzio, I. A., Kentros, C. G., & Kandel, E. R. (2009) · The Journal of Physiology · doi:10.1113/jphysiol.2009.172445 · Cited by 156
Bengio, Y. (2017) · arXiv · doi:10.48550/arxiv.1709.08568 · Cited by 155
Early recurrent feedback facilitates visual object recognition under challenging conditions
Wyatte, D., Jilk, D. J., & O’Reilly, R. C. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00674 · Cited by 152
Heinke, D. G., & Humphreys, G. W. (2003) · Psychological Review · doi:10.1037/0033-295x.110.1.29 · Cited by 151
How do attention and adaptation affect contrast sensitivity?
Pestilli, F., Viera, G., & Carrasco, M. (2007) · Journal of Vision · doi:10.1167/7.7.9 · Cited by 140
Explaining the Colavita visual dominance effect
Spence, C. J. (2009) · Progress in brain research · doi:10.1016/s0079-6123(09)17615-x · Cited by 136
Connectionist Models in Cognitive Psychology
Leek, E. C. (2004) · Psychology Press eBooks · doi:10.4324/9780203647110 · Cited by 128
Feature-specific effects of selective visual attention
Rossi, A. F., & Paradiso, M. A. (1995) · Vision Research · doi:10.1016/0042-6989(94)00156-g · Cited by 124
Awareness during drowsiness: Dynamics and electrophysiological correlates.
Makeig, S., Jung, T., & B, T. J. S. A. (2000) · Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale · doi:10.1037/h0087346 · Cited by 124
Using human brain activity to guide machine learning
Fong, R., Scheirer, W. J., & Cox, D. (2018) · Scientific Reports · doi:10.1038/s41598-018-23618-6 · Cited by 124
Attention and Olfactory Consciousness
Keller, A. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00380 · Cited by 122
Incremental grouping of image elements in vision
Roelfsema, P. R., & Houtkamp, R. (2011) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-011-0200-0 · Cited by 112
Holistic Reinforcement Learning: The Role of Structure and Attention
Radulescu, A., Niv, Y., & Ballard, I. C. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.01.010 · Cited by 112
Effects of Divided Attention on fMRI Correlates of Memory Encoding
Uncapher, M. R., & Rugg, M. D. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/089892905775008616 · Cited by 98
How Hippocampal Memory Shapes, and Is Shaped by, Attention
Aly, M., & Turk-Browne, N. B. (2017) · The Hippocampus from Cells to Systems · doi:10.1007/978-3-319-50406-3_12 · Cited by 97
Ahissar, M., & Hochstein, S. (2000) · Vision Research · doi:10.1016/s0042-6989(00)00002-x · Cited by 95
On the difference between working memory and attentional set
Olivers, C. N. L., & Martin Eimer, A. (2010) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2010.11.033 · Cited by 94
Attention control: explorations of the work of an executive controller
Gopher, D. (1996) · Cognitive Brain Research · doi:10.1016/s0926-6410(96)00038-9 · Cited by 94
The physiology and psychology of selective attention to touch
Johansen‐Berg, H. (2000) · Frontiers in bioscience · doi:10.2741/a558 · Cited by 85
How biological attention mechanisms improve task performance in a large-scale visual system model
Lindsay, G. W., & Miller, K. D. (2018) · eLife · doi:10.7554/elife.38105 · Cited by 84
Self-citationMany Task Learning With Task Routing
Strezoski, G., van Noord, N., & Worring, M. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00146 · Cited by 84
Introducing a Bayesian model of selective attention based on active inference
Mirza, M. B., Adams, R. A., Friston, K., & Parr, T. (2019) · Scientific Reports · doi:10.1038/s41598-019-50138-8 · Cited by 83
The effects of salience on saccadic target selection
van Zoest, W., & Donk, M. (2005) · Visual Cognition · doi:10.1080/13506280444000229 · Cited by 82
Weakly Supervised Part-of-speech Tagging Using Eye-tracking Data
Barrett, M., Bingel, J., Keller, F., & Søgaard, A. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-2094 · Cited by 80
Coenen, A. M. L. (1998) · Consciousness and Cognition · doi:10.1006/ccog.1997.0324 · Cited by 78
Combined effects of spatial and feature-based attention on responses of V4 neurons
Hayden, B. Y., & Gallant, J. L. (2008) · Vision Research · doi:10.1016/j.visres.2008.06.011 · Cited by 78
Tasks of a feather flock together: Similarity effects in task switching
Arrington, C. M., Altmann, E. M., & Carr, T. H. (2003) · Memory & Cognition · doi:10.3758/bf03196116 · Cited by 71
Learning to attend: Effects of practice on information selection
Kelley, T. A., & Yantis, S. (2009) · Journal of Vision · doi:10.1167/9.7.16 · Cited by 69
Lozito, J. P., & Mulligan, N. W. (2006) · Memory & Cognition · doi:10.3758/bf03193246 · Cited by 67
Diamond, D. M. (2005) · Nonlinearity in Biology Toxicology Medicine · doi:10.2201/nonlin.003.01.001 · Cited by 65
Attention and the Detectability of Weak Taste Stimuli
Marks, L. E., & Wheeler, M. E. (1998) · Chemical Senses · doi:10.1093/chemse/23.1.19 · Cited by 63
Visual novelty, curiosity, and intrinsic reward in machine learning and the brain
Jaegle, A., Mehrpour, V., & Rust, N. C. (2019) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2019.08.004 · Cited by 61
Shifting attention into and out of objects: Evaluating the processes underlying the object advantage
Brown, J. M., & Denney, H. I. (2007) · Perception & Psychophysics · doi:10.3758/bf03193918 · Cited by 59
Saliency-SVM: An automatic approach for image segmentation
Bai, X., & Wang, W. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.01.008 · Cited by 58
The costs of crossing paths and switching tasks between audition and vision
Murray, M. M., Santis, L. D., Thut, G., & Wylie, G. R. (2008) · Brain and Cognition · doi:10.1016/j.bandc.2008.05.004 · Cited by 47
Independent Effects of Adaptation and Attention on Perceived Speed
Anton-Erxleben, K., Herrmann, K., & Carrasco, M. (2012) · Psychological Science · doi:10.1177/0956797612449178 · Cited by 46
Attention, please! A critical review of neural attention models in natural language processingPreprint
Galassi, A., Lippi, M., & Torroni, P. (2019) · arXiv (Cornell University) · Cited by 42
Past rewards capture spatial attention and action choices
Càmara, E., Manohar, S., & Husain, M. (2013) · Experimental Brain Research · doi:10.1007/s00221-013-3654-6 · Cited by 40
Attention-dependent reductions in burstiness and action-potential height in macaque area V4
Anderson, E. B., Mitchell, J. F., & Reynolds, J. H. (2013) · Nature Neuroscience · doi:10.1038/nn.3463 · Cited by 38
A flexible readout mechanism of human sensory representations
Birman, D., & Gardner, J. L. (2019) · Nature Communications · doi:10.1038/s41467-019-11448-7 · Cited by 33
Myachykov, A., & Posner, M. I. (2005) · Elsevier eBooks · doi:10.1016/b978-012375731-9/50057-4 · Cited by 32
Neural Correlates of Learning to Attend
Kelley, T. A., & Yantis, S. (2010) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2010.00216 · Cited by 27
Cholinergic Modulation Promotes Attentional Modulation in Primary Visual Cortex- A Modeling Study
Sajedin, A., Menhaj, M. B., Vahabie, A., Panzeri, S., & Esteky, H. (2019) · Scientific Reports · doi:10.1038/s41598-019-56608-3 · Cited by 27
Ballesteros, S., & Mayas, J. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01567 · Cited by 25
Subcortical connectivity correlates selectively with attention’s effects on spatial choice bias
Sreenivasan, V., & Sridharan, D. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1902704116 · Cited by 25
The Costs and Benefits of Goal-Directed Attention in Deep Convolutional Neural Networks
Luo, X., Roads, B. D., & Love, B. C. (2021) · Computational Brain & Behavior · doi:10.1007/s42113-021-00098-y · Cited by 25
Predicting Goal-directed Attention Control Using Inverse-Reinforcement Learning
Zelinsky, G. J., Chen, Y., Ahn, S., Adeli, H., Yang, Z., Huang, L., Samaras, D., & Hoai, M. (2021) · Neurons Behavior Data analysis and Theory · doi:10.51628/001c.22322 · Cited by 19
Feature-based attentional modulation of orientation perception in somatosensation
Schweisfurth, M. A., Schweizer, R., & Treue, S. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00519 · Cited by 18
A unified circuit model of attention: Neural and behavioral effectsPreprint
Lindsay, G. W., Rubin, D. B., & Miller, K. D. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2019.12.13.875534 · Cited by 10
Self-citationConditional Computation for Continual LearningPreprint
Lin, M., Fu, J., & Bengio, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.06635 · Cited by 6
Cited by
No one knows what attention is
Hommel, B., Chapman, C. S., Cisek, P., Neyedli, H. F., Song, J.-H., & Welsh, T. N. (2019) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-019-01846-w · Cited by 594
Artificial Neural Networks for Neuroscientists: A Primer
Yang, G. R., & Wang, X.-J. (2020) · Neuron · doi:10.1016/j.neuron.2020.09.005 · Cited by 376
Why Is There So Much More Research on Vision Than on Any Other Sensory Modality?
Hutmacher, F. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02246 · Cited by 368
The Edge of Sentience: Risk and Precaution in Humans, Other Animals, and AI
Birch, J. (2024) · doi:10.1093/9780191966729.001.0001 · Cited by 236
Consciousness in Artificial Intelligence: Insights from the Science of Consciousness
Butlin, P., Long, R., Elmoznino, E., Bengio, Y., Birch, J., Constant, A., Deane, G., Fleming, S. M., Frith, C., Ji, X., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.08708 · Cited by 196
Self-citation
Metadata
- Authors
- Lindsay, G. W.
- Venue
- Frontiers in Computational Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2020-04-16
- Volume
- 14
- Pages
- 29-29
- ISSN
- 1662-5188 (ISSN-L)
- OpenAlex
- W3016489761
- Cited by
- 309
- References
- 154
- FWCI
- 14.41
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.