Learning and disrupting invariance in visual recognition with a temporal association rule
Open accessAbstract
Learning by temporal association rules such as Foldiak's trace rule is an attractive hypothesis that explains the development of invariance in visual recognition. Consistent with these rules, several recent experiments have shown that invariance can be broken at both the psychophysical and single cell levels. We show (1) that temporal association learning provides appropriate invariance in models of object recognition inspired by the visual cortex, (2) that we can replicate the "invariance disruption" experiments using these models with a temporal association learning rule to develop and maintain invariance, and (3) that despite dramatic single cell effects, a population of cells is very robust to these disruptions. We argue that these models account for the stability of perceptual invariance despite the underlying plasticity of the system, the variability of the visual world and expected noise in the biological mechanisms.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Imposing continuity within certain models gives rise to aspects of the visual system including complex cells, specific properties of visual invariance, and even other representational properties such as the existence of place cells.
“Imposing continuity within certain models gives rise to aspects of the visual system including complex cells (Körding et al., 2004), specific properties of visual invariance (Isik et al., 2012), and even other representational properties such as the existence of place cells (Wyss et al., 2006; Franzius et al., 2007).”
From Toward an integration of deep learning and neuroscience (2016) · cites this paper as Isik et al., 2012
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Two new Later Stone Age sites from the Final Pleistocene in the Falémé Valley, eastern Senegal
Ndiaye, M., Lespez, L., Tribolo, C., Rassé, M., Hadjas, I., Davidoux, S., Huysecom, É., & Douze, K. (2024) · Monash University Research Portal (Monash University) · doi:10.3929/ethz-b-000667478 · Cited by 24,015 · see citing works
Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex
Hubel, D. H., & Wiesel, T. N. (1962) · The Journal of Physiology · doi:10.1113/jphysiol.1962.sp006837 · Cited by 13,680 · see citing works
Fukushima, K. (1980) · Biological Cybernetics · doi:10.1007/bf00344251 · Cited by 5,759 · see citing works
Hierarchical models of object recognition in cortex
Riesenhuber, M., & Poggio, T. (1999) · Nature Neuroscience · doi:10.1038/14819 · Cited by 3,309 · see citing works
Self-citationRobust Object Recognition with Cortex-Like Mechanisms
Serre, T., Wolf, L., Bileschi, S., Riesenhuber, M., & Poggio, T. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.56 · Cited by 1,667 · see citing works
Self-citationSlow Feature Analysis: Unsupervised Learning of Invariances
Wiskott, L., & B, T. J. S. A. (2002) · Neural Computation · doi:10.1162/089976602317318938 · Cited by 1,351 · see citing works
Becoming a “Greeble” Expert: Exploring Mechanisms for Face Recognition
Gauthier, L., & Tarr, M. J. (1997) · Vision Research · doi:10.1016/s0042-6989(96)00286-6 · Cited by 1,017 · see citing works
Learning invariance from transformation sequences
Földiák, P. (1991) · Neural Computation · doi:10.1162/neco.1991.3.2.194 · Cited by 661 · see citing works
Unsupervised Learning of Visual Features through Spike Timing Dependent Plasticity
Masquelier, T., & Thorpe, S. J. (2007) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030031 · Cited by 549 · see citing works
INVARIANT FACE AND OBJECT RECOGNITION IN THE VISUAL SYSTEM
Wallis, G. M., & Rolls, E. T. (1997) · Progress in Neurobiology · doi:10.1016/s0301-0082(96)00054-8 · Cited by 539 · see citing works
Unsupervised Natural Experience Rapidly Alters Invariant Object Representation in Visual Cortex
Li, N., & DiCarlo, J. J. (2008) · Science · doi:10.1126/science.1160028 · Cited by 263 · see citing works
Slowness and Sparseness Lead to Place, Head-Direction, and Spatial-View Cells
Franzius, M., Sprekeler, H., & Wiskott, L. (2007) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030166 · Cited by 218 · see citing works
Effects of temporal association on recognition memory
Wallis, G. M., & Bülthoff, H. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.071028598 · Cited by 212 · see citing works
'Breaking' position-invariant object recognition
Cox, D., Meier, P. M., Oertelt, N., & DiCarlo, J. J. (2005) · Nature Neuroscience · doi:10.1038/nn1519 · Cited by 158 · see citing works
A model of the ventral visual system based on temporal stability and local memory
Wyss, R., König, P., & Verschure, P. F. M. J. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040120 · Cited by 145 · see citing works
Li, N., & DiCarlo, J. J. (2010) · Neuron · doi:10.1016/j.neuron.2010.08.029 · Cited by 130 · see citing works
View-based Models of 3D Object Recognition: Invariance to Imaging Transformations
Vetter, T., Hurlbert, A. C., & Poggio, T. (1995) · Cerebral Cortex · doi:10.1093/cercor/5.3.261 · Cited by 59 · see citing works
Self-citationWallis, G. M., Backus, B. T., Langer, M., Huebner, G. M., & Bülthoff, H. (2009) · Journal of Vision · doi:10.1167/9.7.6 · Cited by 52 · see citing works
Learning viewpoint invariant object representations using a temporal coherence principle
Einhäuser, W., Hipp, J. F., Eggert, J. P., Körner, E., & Peter König, B. (2005) · Biological Cybernetics · doi:10.1007/s00422-005-0585-8 · Cited by 47 · see citing works
Why The Brain Separates Face Recognition From Object Recognition
Leibo, J. Z., Mutch, J., & Poggio, T. (2011) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 35 · see citing works
Self-citationLearning viewpoint invariant perceptual representations from cluttered images
Spratling, M. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.105 · Cited by 34 · see citing works
Learning Generic Invariances in Object Recognition: Translation and Scale
Leibo, J. Z., Mutch, J., Rosasco, L., Ullman, S., & Poggio, T. (2010) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 17 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Toward an integration of deep learning and neuroscience
Marblestone, A. H., Wayne, G., & Kording, K. P. (2016) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2016.00094 · Cited by 119 · see citing works
Unsupervised Learning of Invariant Representations in Hierarchical ArchitecturesPreprint
Anselmi, F., Leibo, J. Z., Rosasco, L., Mutch, J., Tacchetti, A., & Poggio, T. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1311.4158 · Cited by 63 · see citing works
Self-citationThe development of newborn object recognition in fast and slow visual worlds
Wood, J. N., & Wood, S. M. W. (2016) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2016.0166 · Cited by 59 · see citing works
Leibo, J. Z., Liao, Q., Anselmi, F., Freiwald, W. A., & Poggio, T. (2016) · Current Biology · doi:10.1016/j.cub.2016.10.015 · Cited by 51 · see citing works
Self-citationToward a unified model of face and object recognition in the human visual system
Wallis, G. M. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00497 · Cited by 38 · see citing works
Invariant visual object recognition: biologically plausible approaches
Robinson, L., & Rolls, E. T. (2015) · Biological Cybernetics · doi:10.1007/s00422-015-0658-2 · Cited by 36 · see citing works
Farzmahdi, A., Rajaei, K., Ghodrati, M., Ebrahimpour, R., & Khaligh‐Razavi, S. (2016) · Scientific Reports · doi:10.1038/srep25025 · Cited by 33 · see citing works
The Invariance Hypothesis Implies Domain-Specific Regions in Visual Cortex
Leibo, J. Z., Liao, Q., Anselmi, F., & Poggio, T. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004390 · Cited by 29 · see citing works
Self-citationPoggio, T., Mutch, J., Leibo, J. Z., Rosasco, L., & Tacchetti, A. (2012) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 25 · see citing works
Self-citationRolls, E. T., & Webb, T. J. (2014) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2014.00085 · Cited by 25 · see citing works
Reading in the Brain Revised and Extended: Response to Comments
Dehaene, S. (2014) · Mind & Language · doi:10.1111/mila.12053 · Cited by 24 · see citing works
Jia, X., Hong, H., & DiCarlo, J. J. (2021) · eLife · doi:10.7554/elife.60830 · Cited by 15 · see citing works
Tian, M., & Kalanit Grill-spector, A. (2015) · Journal of Vision · doi:10.1167/15.6.7 · Cited by 18 · see citing works
Webb, T. J., & Rolls, E. T. (2014) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2014.00037 · Cited by 11 · see citing works
Invariant Recognition Predicts Tuning of Neurons in Sensory Cortex
Mutch, J., Anselmi, F., Tacchetti, A., Rosasco, L., Leibo, J. Z., & Poggio, T. (2016) · Cognitive science and technology · doi:10.1007/978-981-10-0213-7_5 · Cited by 10 · see citing works
Self-citationProperties of visual episodic memory following repeated encounters with objectsPreprint
Schurgin, M. W., & Flombaum, J. (2018) · Learning & Memory · doi:10.1101/lm.047167.117 · Cited by 9 · see citing works
Eguchi, A., Mender, B. M. W., Evans, B. D., Humphreys, G. W., & Stringer, S. M. (2015) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2015.00100 · Cited by 7 · see citing works
Remarks on Invariance in the Primary Visual Systems of Mammals
Bennequin, D. (2014) · Lecture notes in morphogenesis · doi:10.1007/978-3-642-34444-2_7 · Cited by 7 · see citing works
Invariant Recognition of Visual Objects: Some Emerging Computational Principles
Bart, E., & Hegdé, J. (2012) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2012.00060 · Cited by 7 · see citing works
How Lateral Connections and Spiking Dynamics May Separate Multiple Objects Moving Together
Evans, B. D., & Stringer, S. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0069952 · Cited by 7 · see citing works
Evans, B., & Stringer, S. M. (2013) · PLoS ONE · doi:10.1371/annotation/7f6b65d9-a88d-4bdf-a174-48b1bc99b192 · Cited by 7 · see citing works
Distorting Face Representations in Newborn Brains
Wood, S. M. W., & Wood, J. N. (2021) · Cognitive Science · doi:10.1111/cogs.13021 · Cited by 4 · see citing works
Unsupervised learning of clutter-resistant visual representations from natural videosPreprint
Liao, Q., Leibo, J. Z., & Poggio, T. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.3879 · Cited by 4 · see citing works
Self-citationMeel, C. V., & de Beeck, H. O. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.116881 · Cited by 3 · see citing works
The invariance hypothesis and the ventral stream
Leibo, J. Z. (2014) · Cited by 2 · see citing works
Self-citationJia, X., Hong, H., & DiCarlo, J. J. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.01.13.900837 · Cited by 2 · see citing works
How Shape Perception Works, in Two Dimensions and Three Dimensions
Nielsen, K. J., & Connor, C. E. (2024) · Annual Review of Vision Science · doi:10.1146/annurev-vision-112823-031607 · Cited by 1 · see citing works
Blauch, N. M., & Behrmann, M. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0630-6 · Cited by 1 · see citing works
Cortical Networks of Visual Recognition
Thériault, C., Thome, N., & Cord, M. (2015) · doi:10.1002/9783527680863.ch13 · Cited by 1 · see citing works
Farzmahdi, A., Rajaei, K., Ghodrati, M., Ebrahimpour, R., & Khaligh‐Razavi, S. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.01241 · Cited by 1 · see citing works
What happens next and when "next" happens: Mechanisms of spatial and temporal predictionPreprint
Wyatte, D. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1407.5328
Face Recognition Using Invariance with a Single Training Sample
Tian, Q. (2014) · TELKOMNIKA (Telecommunication Computing Electronics and Control) · doi:10.12928/telkomnika.v12i4.810
Exploiting temporal continuity of views to learn visual object invariance
Bart, E., & Hegdé, J. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00026
Muntasa, A. (2016) · International Journal on Electrical Engineering and Informatics · doi:10.15676/ijeei.2016.8.1.10
Biasing restricted Boltzmann machines using Gaussian filters to learn invariant visual features
Yogeswaran, A., & Payeur, P. (2016) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci.2016.7850122
Baker, C. I. (2014) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.718084051.793490187
(2014) · Society for Neuroscience eBooks · doi:10.1523/hon.008009
- Authors
- Isik, L., Leibo, J. Z., & Poggio, T.
- Affiliations
- McGovern Institute for Brain Research (US)
- Venue
- Frontiers in Computational Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2012
- Volume
- 6
- Pages
- 37-37
- ISSN
- 1662-5188 (ISSN-L)
- PMC
- PMC3385587
- OpenAlex
- W2006151816
- Cited by
- 38
- References
- 22
- Citations by year
- 2024: 1 · 2021: 2 · 2020: 2 · 2019: 1 · 2018: 1 · 2016: 8 · 2015: 6 · 2014: 10 · 2013: 5 · 2012: 2
- FWCI
- 3.77
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- Locations
- Frontiers in Computational Neuroscience (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Frontiers Research Foundation
- Funders
- National Science Foundation (0827427, 0645960, 0640097)
- Defense Advanced Research Projects Agency
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Keywords
- perceptual invariance, object recognition, visual cortex model, population coding, neuroplasticity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review