The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Realistic avatar eye and head animation using a neurobiological model of visual attention
Abstract
We describe a neurobiological model of visual attention and eye/head movements in primates, and its application to the automatic animation of a realistic virtual human head watching an unconstrained variety of visual inputs. The bottom-up (image-based) attention model is based on the known neurophysiology of visual processing along the occipito-parietal pathway of the primate brain, while the eye/head movement model is derived from recordings in freely behaving Rhesus monkeys. The system is successful at autonomously saccading towards and tracking salient targets in a variety of video clips, including synthetic stimuli, real outdoors scenes and gaming console outputs. The resulting virtual human eye/head animation yields realistic rendering of the simulation results, both suggesting applicability of this approach to avatar animation and reinforcing the plausibility of the neural model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex
Hubel, D. H., & Wiesel, T. N. (1962) · The Journal of Physiology · doi:10.1113/jphysiol.1962.sp006837 · Cited by 13,680
Control of goal-directed and stimulus-driven attention in the brain
Corbetta, M., & Shulman, G. L. (2002) · Nature Reviews Neuroscience · doi:10.1038/nrn755 · Cited by 12,881
A feature-integration theory of attention.
Treisman, A. M., & Gelade, G. (1980) · Cognitive Psychology · doi:10.1016/0010-0285(80)90005-5 · Cited by 12,366
A model of saliency-based visual attention for rapid scene analysis
Itti, L., Koch, C., & Niebur, E. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.730558 · Cited by 11,271
Self-citationThe Laplacian pyramid as a compact image code
Burt, P., & Adelson, E. (1983) · IEEE Transactions on Communications · doi:10.1109/tcom.1983.1095851 · Cited by 6,077
Computational modelling of visual attention
Itti, L., & Koch, C. (2001) · Nature Reviews Neuroscience · doi:10.1038/35058500 · Cited by 4,733
Self-citationUngerleider, L. G. (1982) · Medical Entomology and Zoology · Cited by 4,531
Shifts in Selective Visual Attention: Towards the Underlying Neural Circuitry
Koch, C., & Ullman, S. (1987) · Matters of Intelligence · doi:10.1007/978-94-009-3833-5_5 · Cited by 3,722
A saliency-based search mechanism for overt and covert shifts of visual attention
Itti, L., & Koch, C. (2000) · Vision Research · doi:10.1016/s0042-6989(99)00163-7 · Cited by 3,156
Self-citationSelective Attention Gates Visual Processing in the Extrastriate Cortex
Moran, J., & Desimone, R. (2003) · Essential Sources in the Scientific Study of Consciousness · doi:10.7551/mitpress/2834.003.0024 · Cited by 2,144
Distance transformations in digital images
Borgefors, G. (1986) · Computer Vision, Graphics, and Image Processing · doi:10.1016/s0734-189x(86)80047-0 · Cited by 1,898
Spatial frequency selectivity of cells in macaque visual cortex
De Valois, R. L., Albrecht, D. G., & Thorell, L. G. (1982) · Vision Research · doi:10.1016/0042-6989(82)90113-4 · Cited by 1,489
Feature-based attention influences motion processing gain in macaque visual cortex
Treue, S., & Trujillo, J. C. M. (1999) · Nature · doi:10.1038/21176 · Cited by 1,465
Modeling the role of salience in the allocation of overt visual attention
Parkhurst, D., Law, K., & Niebur, E. (2002) · Vision Research · doi:10.1016/s0042-6989(01)00250-4 · Cited by 1,388
Human neural systems for face recognition and social communication
Haxby, J. V., Hoffman, E. A., & Gobbini, M. I. (2002) · Biological Psychiatry · doi:10.1016/s0006-3223(01)01330-0 · Cited by 1,287
(1995) · Medical Entomology and Zoology · Cited by 1,212
Columnar specificity of intrinsic horizontal and corticocortical connections in cat visual cortex
Gilbert, C., & Wiesel, T. (1989) · The Journal of Neuroscience · doi:10.1523/jneurosci.09-07-02432.1989 · Cited by 1,162
Modeling visual attention via selective tuning
Tsotsos, J. K., Culhane, S. M., Kei Wai, W. Y., Lai, Y., Davis, N., & Nuflo, F. (1995) · Artificial Intelligence · doi:10.1016/0004-3702(95)00025-9 · Cited by 1,143
A model of saccade generation based on parallel processing and competitive inhibition
Findlay, J. M., & Walker, R. (1999) · Behavioral and Brain Sciences · doi:10.1017/s0140525x99002150 · Cited by 730
Synthesizing realistic facial expressions from photographs
Pighin, F., Hecker, J., Lischinski, D., Szeliski, R., & Salesin, D. H. (2006) · ACM SIGGRAPH 2006 Courses on - SIGGRAPH '06 · doi:10.1145/1185657.1185859 · Cited by 723
Self-citationThe brainstem control of saccadic eye movements
Sparks, D. L. (2002) · Nature Reviews Neuroscience · doi:10.1038/nrn986 · Cited by 717
Video Rewrite: driving visual speech with audio
Bregler, C., Covell, M., & Slaney, M. (1997) · Proceedings of the 24th annual conference on Computer graphics and interactive techniques - SIGGRAPH '97 · doi:10.1145/258734.258880 · Cited by 669
Visual cortical mechanisms detecting focal orientation discontinuities
Slllito, A. M., Grieve, K. L., Jones, H. E., Cudeiro, J., & Davls, J. (1995) · Nature · doi:10.1038/378492a0 · Cited by 649
Neural systems control of spatial orienting
Posner, M. I., Cohen, Y., & Rafal, R. D. (1982) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1982.0081 · Cited by 588
Visual Perception: The Neurophysiological Foundations
Spillmann, L., & Werner, J. S. (1989) · Cited by 564
Intrinsic laminar lattice connections in primate visual cortex
Rockland, K. S., & Lund, J. S. (1983) · Journal of Comparative Neurology · doi:10.1002/cne.902160307 · Cited by 545
Contrast dependence of contextual effects in primate visual cortex
Levitt, J. B., & Lund, J. S. (1997) · Nature · doi:10.1038/387073a0 · Cited by 509
The architecture of perceptual spatial interactions
Polat, U., & Sagi, D. (1994) · Vision Research · doi:10.1016/0042-6989(94)90258-5 · Cited by 471
Synthesizing realistic facial expressions from photographs
Pighin, F., Hecker, J., Lischinski, D., Szeliski, R., & Salesin, D. H. (1998) · Proceedings of the 25th annual conference on Computer graphics and interactive techniques - SIGGRAPH '98 · doi:10.1145/280814.280825 · Cited by 462
Self-citationBrand, M. (1999) · Proceedings of the 26th annual conference on Computer graphics and interactive techniques - SIGGRAPH '99 · doi:10.1145/311535.311537 · Cited by 411
Constraints on cortical and thalamic projections: the no-strong-loops hypothesis
Crick, F., & Koch, C. (1998) · Nature · doi:10.1038/34584 · Cited by 353 · cited 1×
“H = 0 if T < G < T with T = IEP 2 +20 0:56 (15)”
Dynamics of Automatic and Controlled Visual Attention
Weichselgartner, E., & Sperling, G. (1987) · Science · doi:10.1126/science.3672124 · Cited by 340
Vestibulo‐ocular function during co‐ordinated head and eye movements to acquire visual targets.
Barnes, G. R. (1979) · The Journal of Physiology · doi:10.1113/jphysiol.1979.sp012650 · Cited by 330
Evaluation of optical motion information by movement detectors
Reichardt, W. (1987) · Journal of Comparative Physiology A · doi:10.1007/bf00603660 · Cited by 306
Trainable videorealistic speech animation
Ezzat, T., Geiger, G., & Poggio, T. (2002) · Proceedings of the 29th annual conference on Computer graphics and interactive techniques · doi:10.1145/566570.566594 · Cited by 301
The coordination of eye and head movement during smooth pursuit
Lanman, J., Bizzi, E., & Allum, J. (1978) · Brain Research · doi:10.1016/0006-8993(78)91127-7 · Cited by 285
Neural Mechanisms of Saccadic Suppression
Thiele, A., Henning, P., Kubischik, M., & Hoffmann, K.-P. (2002) · Science · doi:10.1126/science.1068788 · Cited by 278
Two modes of active eye-head coordination in monkeys
Bizzi, E., Kalil, R. E., & Morasso, P. (1972) · Brain Research · doi:10.1016/0006-8993(72)90104-7 · Cited by 265
Lee, S. P., Badler, J. B., & Badler, N. I. (2002) · Proceedings of the 29th annual conference on Computer graphics and interactive techniques · doi:10.1145/566570.566629 · Cited by 257
The guidance of eye movements during active visual search
Motter, B. C., & Belky, E. J. (1998) · Vision Research · doi:10.1016/s0042-6989(97)00349-0 · Cited by 250
Cannon, M. W., & Fullenkamp, S. C. (1991) · Vision Research · doi:10.1016/0042-6989(91)90193-9 · Cited by 245
Overcomplete steerable pyramid filters and rotation invariance
Greenspan, Belongie, Goodman, Perona, Rakshit, & Anderson (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323833 · Cited by 228
Human eye-head coordination in two dimensions under different sensorimotor conditions
Goossens, H. H. L. M., & Opstal, A. J. V. (1997) · Experimental Brain Research · doi:10.1007/pl00005663 · Cited by 223
Weliky, M., Kandler, K., Fitzpatrick, D., & Katz, L. C. (1995) · Neuron · doi:10.1016/0896-6273(95)90143-4 · Cited by 213
Visual search in continuous, naturalistic stimuli
Wolfe, J. M. (1994) · Vision Research · doi:10.1016/0042-6989(94)90300-x · Cited by 213
Freedman, E. G., & Sparks, D. L. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.78.3.1669 · Cited by 199
A Cortico-Subcortical Model for Generation of Spatially Accurate Sequential Saccades
Dominey, P. F., & Arbib, M. A. (1992) · Cerebral Cortex · doi:10.1093/cercor/2.2.153 · Cited by 168
Eye blinks: new indices for the detection of deception
Fukuda, K. (2001) · International Journal of Psychophysiology · doi:10.1016/s0167-8760(00)00192-6 · Cited by 146
Animat vision: Active vision in artificial animals
Terzopoulos, D., & Rabie, T. F. (2002) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.1995.466856 · Cited by 113
A Goal Oriented Attention Guidance Model
Navalpakkam, V., & Itti, L. (2002) · Lecture notes in computer science · doi:10.1007/3-540-36181-2_45 · Cited by 92
Self-citationAttentive mechanisms for dynamic and static scene analysis
Milanese, R., Gil, S., & Pun, T. (1995) · Optical Engineering · doi:10.1117/12.205668 · Cited by 89
The coordination of eye-head movements.
Bizzi, E. (1974) · PubMed · Cited by 79
Estimating focus of attention based on gaze and sound
Stiefelhagen, R., Yang, J., & Waibel, A. (2001) · doi:10.1145/971478.971505 · Cited by 67
Video Rewrite: Driving Visual Speech with Audio
Bregler, C., Covell, M., & Slaney, M. (2023) · Seminal Graphics Papers: Pushing the Boundaries, Volume 2 · doi:10.1145/3596711.3596787 · Cited by 67
Where am I looking? The accuracy of video-mediated gaze awareness
Gale, C., & Monk, A. F. (2000) · Perception & Psychophysics · doi:10.3758/bf03212110 · Cited by 65
Blink rate, neurocognitive impairments, and symptoms in schizophrenia
Chen, E. Y. H., Lam, L. C. W., Chen, R. Y. L., & Nguyen, D. G. H. (1996) · Biological Psychiatry · doi:10.1016/0006-3223(95)00482-3 · Cited by 52
Gaze estimation using morphable models
Rikert, T. D., & Jones, M. (2002) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1998.670987 · Cited by 52
Pop-out of orientation but no pop-out of motion at isoluminance
Lüschow, A., & Nothdurft, H. (1993) · Vision Research · doi:10.1016/0042-6989(93)90062-2 · Cited by 29
Contextual Modulation of Target Saliency
Torralba, A. B. (2001) · Cited by 26
Cited by
State-of-the-Art in Visual Attention Modeling
Borji, A., & Itti, L. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.89 · Cited by 1,817
Self-citationAutomatic Foveation for Video Compression Using a Neurobiological Model of Visual Attention
Itti, L. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2004.834657 · Cited by 759
Self-citationQuantitative Analysis of Human-Model Agreement in Visual Saliency Modeling: A Comparative Study
Borji, A., Sihite, D. N., & Itti, L. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2210727 · Cited by 613
Self-citationSocial Eye Gaze in Human-Robot Interaction: A Review
Admoni, H., & Scassellati, B. (2017) · Journal of Human-Robot Interaction · doi:10.5898/jhri.6.1.admoni · Cited by 588
Cognitive Developmental Robotics: A Survey
Asada, M., Hosoda, K., Kuniyoshi, Y., Ishiguro, H., Inui, T., Yoshikawa, Y., Ogino, M., & Yoshida, C. (2009) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2009.2021702 · Cited by 554
Metadata
- Authors
- Itti, L., Dhavale, N., & Pighin, F.
- Venue
- SPIE Proceedings
- Publisher
- SPIE
- Published
- 2004-01-05
- Volume
- 5200
- Pages
- 64-64
- ISSN
- 0277-786X (ISSN-L)
- OpenAlex
- W2070645165
- Cited by
- 289
- References
- 59
- FWCI
- 9.01
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.