The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
HATS: Histograms of Averaged Time Surfaces for Robust Event-Based Object Classification
Open accessAbstract
Event-based cameras have recently drawn the attention of the Computer Vision community thanks to their advantages in terms of high temporal resolution, low power consumption and high dynamic range, compared to traditional frame-based cameras. These properties make event-based cameras an ideal choice for autonomous vehicles, robot navigation or UAV vision, among others. However, the accuracy of event-based object classification algorithms, which is of crucial importance for any reliable system working in real-world conditions, is still far behind their frame-based counterparts. Two main reasons for this performance gap are: 1. The lack of effective low-level representations and architectures for event-based object classification and 2. The absence of large real-world event-based datasets. In this paper we address both problems. First, we introduce a novel event-based feature representation together with a new machine learning architecture. Compared to previous approaches, we use local memory units to efficiently leverage past temporal information and build a robust event-based representation. Second, we release the first large real-world event-based dataset for object classification. We compare our method to the state-of-the-art with extensive experiments, showing better classification performance and real-time computation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
An introduction to ROC analysis
Fawcett, T. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.10.010 · Cited by 21,879
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Object recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Fully convolutional networks for semantic segmentation
Shelhamer, E., Long, J., & Darrell, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2572683 · Cited by 11,898
ORB: An efficient alternative to SIFT or SURF
Rublee, E., Rabaud, V., Konolige, K., & Bradski, G. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126544 · Cited by 11,037
Contour Detection and Hierarchical Image Segmentation
Arbeláez, P., Maire, M., Fowlkes, C., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.161 · Cited by 5,454
(1989) · neural information processing systems · Cited by 3,736
Pedestrian Detection: An Evaluation of the State of the Art
Dollar, P., Wojek, C., Schiele, B., & Perona, P. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.155 · Cited by 3,190
One-shot learning of object categories
Fei-Fei, L., Fergus, R., & Perona, P. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.79 · Cited by 3,029
Laptev, I. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-1838-7 · Cited by 2,629
A 128$\times$128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor
Lichtsteiner, P., Posch, C., & Delbruck, T. (2008) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2007.914337 · Cited by 2,485
Invariant Scattering Convolution Networks
Bruna, J., & Mallat, S. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.230 · Cited by 1,633
Multichannel texture analysis using localized spatial filters
Bovik, A. C., Clark, M., & Geisler, W. S. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.41384 · Cited by 1,382
Evaluation of local spatio-temporal features for action recognition
Wang, H., Ullah, M. M., Klaser, A., Laptev, I., & Schmid, C. (2009) · Procedings of the British Machine Vision Conference 2009 · doi:10.5244/c.23.124 · Cited by 1,296
Scale-space filtering: A new approach to multi-scale description
Witkin, A. (2005) · ICASSP '84. IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1984.1172729 · Cited by 1,086
Error-backpropagation in temporally encoded networks of spiking neurons
Bohte, S. M., Kok, J. N., & La Poutré, H. (2002) · Neurocomputing · doi:10.1016/s0925-2312(01)00658-0 · Cited by 1,021
Fast-classifying, high-accuracy spiking deep networks through weight and threshold balancing
Diehl, P. U., Neil, D., Binas, J., Cook, M., Liu, S.-C., & Pfeiffer, M. (2015) · 2015 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280696 · Cited by 991
Training Deep Spiking Neural Networks Using Backpropagation
Lee, J. H., Delbruck, T., & Pfeiffer, M. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00508 · Cited by 976
Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition
Cao, Y., Chen, Y., & Khosla, D. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0788-3 · Cited by 917
Converting Static Image Datasets to Spiking Neuromorphic Datasets Using Saccades
Orchard, G., Jayawant, A., Cohen, G. K., & Thakor, N. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00437 · Cited by 882
The tempotron: a neuron that learns spike timing–based decisions
Gütig, R., & Sompolinsky, H. (2006) · Nature Neuroscience · doi:10.1038/nn1643 · Cited by 815
Posch, C., Matolin, D., & Wohlgenannt, R. (2011) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2010.2085952 · Cited by 793
Holistically-nested edge detection
Xie, S., & Tu, Z. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-017-1004-z · Cited by 682
Point-to-point connectivity between neuromorphic chips using address events
Boahen, K. A. (2000) · IEEE Transactions on Circuits and Systems II: Analog and Digital Signal Processing · doi:10.1109/82.842110 · Cited by 654
Chaudhry, R., Ravichandran, A., Hager, G., & Vidal, R. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206821 · Cited by 621
HOTS: A Hierarchy of Event-Based Time-Surfaces for Pattern Recognition
Lagorce, X., Orchard, G., Galluppi, F., Shi, B. E., & Benosman, R. B. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2574707 · Cited by 612
Self-citationMueggler, E., Rebecq, H., Gallego, G., Delbruck, T., & Scaramuzza, D. (2017) · The International Journal of Robotics Research · doi:10.1177/0278364917691115 · Cited by 606
On Spike-Timing-Dependent-Plasticity, Memristive Devices, and Building a Self-Learning Visual Cortex
Zamarreño-Ramos, C., Camuñas-Mesa, L. A., Pérez-Carrasco, J. A., Masquelier, T., Serrano-Gotarredona, T., & Linares-Barranco, B. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00026 · Cited by 558
Unsupervised Learning of Visual Features through Spike Timing Dependent Plasticity
Masquelier, T., & Thorpe, S. J. (2007) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030031 · Cited by 548
CIFAR10-DVS: An Event-Stream Dataset for Object Classification
Li, H., Liu, H., Ji, X., Li, G., & Shi, L. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00309 · Cited by 538
Efficient Visual Search of Videos Cast as Text Retrieval
Sivic, J., & Zisserman, A. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.111 · Cited by 499
Retinomorphic Event-Based Vision Sensors: Bioinspired Cameras With Spiking Output
Posch, C., Serrano-Gotarredona, T., Linares-Barranco, B., & Delbruck, T. (2014) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2346153 · Cited by 471
Real-Time 3D Reconstruction and 6-DoF Tracking with an Event Camera
Kim, H., Leutenegger, S., & Davison, A. J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_21 · Cited by 438
EVO: A Geometric Approach to Event-Based 6-DOF Parallel Tracking and Mapping in Real Time
Rebecq, H., Horstschaefer, T., Gallego, G., & Scaramuzza, D. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2016.2645143 · Cited by 410
Real-time classification and sensor fusion with a spiking deep belief network
O'Connor, P., Neil, D., Liu, S.-C., Delbruck, T., & Pfeiffer, M. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00178 · Cited by 408
Kasabov, N., Dhoble, K., Nuntalid, N., & Indiveri, G. (2013) · Neural Networks · doi:10.1016/j.neunet.2012.11.014 · Cited by 384
Serrano-Gotarredona, T., & Linares-Barranco, B. (2013) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2012.2230553 · Cited by 334
Phased LSTM: Accelerating Recurrent Network Training for Long or Event-based Sequences
Neil, D., Pfeiffer, M., & Liu, S. (2016) · Zurich Open Repository and Archive (University of Zurich) · doi:10.48550/arxiv.1610.09513 · Cited by 319
HFirst: A Temporal Approach to Object Recognition
Orchard, G., Meyer, C., Etienne-Cummings, R., Posch, C., Thakor, N., & Benosman, R. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2392947 · Cited by 312
Self-citationActivity-driven, event-based vision sensors
Delbruck, T., Linares-Barranco, B., Culurciello, E., & Posch, C. (2010) · Proceedings of 2010 IEEE International Symposium on Circuits and Systems · doi:10.1109/iscas.2010.5537149 · Cited by 251
Zhao, B., Ding, R., Chen, S., Linares-Barranco, B., & Tang, H. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2362542 · Cited by 216
Fast event-based Harris corner detection exploiting the advantages of event-driven cameras
Vasco, V., Glover, A., & Bartolozzi, C. (2016) · 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759610 · Cited by 167
Poker-DVS and MNIST-DVS. Their History, How They Were Made, and Other Details
Serrano-Gotarredona, T., & Linares-Barranco, B. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00481 · Cited by 161
Bichler, O., Querlioz, D., Thorpe, S. J., Bourgoin, J.-P., & Gamrat, C. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.02.022 · Cited by 160
Theory and Tools for the Conversion of Analog to Spiking Convolutional Neural NetworksPreprint
Rueckauer, B., Lungu, I.-A., Hu, Y., & Pfeiffer, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.04052 · Cited by 149
DVS Benchmark Datasets for Object Tracking, Action Recognition, and Object Recognition
Hu, Y., Liu, H., Pfeiffer, M., & Delbrück, T. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00405 · Cited by 133
Stromatias, E., Soto, M., Serrano‐Gotarredona, T., & Linares-Barranco, B. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00350 · Cited by 124
Asynchronous event-based corner detection and matching
Clady, X., Ieng, S.-H., & Benosman, R. B. (2015) · Neural Networks · doi:10.1016/j.neunet.2015.02.013 · Cited by 119
Self-citationCombined frame- and event-based detection and tracking
Liu, H., Moeys, D. P., Das, G. P., Neil, D., Liu, S., & Delbrück, T. (2016) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2016.7539103 · Cited by 96
Neil, D., Pfeiffer, M., & Liu, S. (2016) · ACM Symposium on Applied Computing · doi:10.1145/2851613.2851724 · Cited by 80
A Motion-Based Feature for Event-Based Pattern Recognition
Clady, X., Maro, J.-M., Barré, S., & Benosman, R. B. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00594 · Cited by 70
Self-citationSpatiotemporal features for asynchronous event-based data
Lagorce, X., Ieng, S.-H., Clady, X., Pfeiffer, M., & Benosman, R. B. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00046 · Cited by 55
Self-citationBag of Events: An Efficient Probability-Based Feature Extraction Method for AER Image Sensors
Peng, X., Zhao, B., Yan, R., Tang, H., & Zhang, Y. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2536741 · Cited by 53
Optimization Methods for Spiking Neurons and Networks
Russell, A., Orchard, G., Dong, Y., Mihalaş, Ş., Niebur, E., Tapson, J. C., & Etienne‐Cummings, R. (2010) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2083685 · Cited by 49
Benchmarking neuromorphic vision: lessons learnt from computer vision
Tan, C., Lallée, S., & Orchard, G. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00374 · Cited by 41
Energy-Efficient Neuromorphic Classifiers
Marti, D. N., Rigotti, M., Seok, M., & Fusi, S. (2016) · Neural Computation · doi:10.1162/neco_a_00882 · Cited by 39
Histograms of Oriented Gradients for 3D Object Retrieval
Scherer, M., Walter, M., & Schreck, T. (2010) · Digital Library (University of West Bohemia) · Cited by 36
Spatio-temporal Spike Pattern Classification in Neuromorphic Systems
Sheik, S., Pfeiffer, M., Stefanini, F., & Indiveri, G. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39802-5_23 · Cited by 24
Classification of Spatiotemporal Events Based on Random Forest
Li, H., Li, G., & Shi, L. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-49685-6_13 · Cited by 15
Accelerated frame-free time-encoded multi-step imaging
Orchard, G., Matolin, D., Lagorce, X., Benosman, R. B., & Posch, C. (2014) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2014.6865716 · Cited by 11
Self-citation
Cited by
Gallego, G., Delbruck, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3008413 · Cited by 2,566
Deep Learning With Spiking Neurons: Opportunities and Challenges
Pfeiffer, M., & Pfeil, T. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00774 · Cited by 766
Direct Training for Spiking Neural Networks: Faster, Larger, Better
Wu, Y., Deng, L., Li, G., Zhu, J., Xie, Y., & Shi, L. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33011311 · Cited by 670
Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networks
Fang, W., Yu, Z., Chen, Y., Masquelier, T., Huang, T., & Tian, Y. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00266 · Cited by 605
Gallego, G., Delbrück, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2020) · Zurich Open Repository and Archive (University of Zurich) · doi:10.3929/ethz-b-000521357 · Cited by 591
Metadata
- Authors
- Sironi, A., Brambilla, M., Bourdis, N., Lagorce, X., & Benosman, R.
- Venue
- 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2018-06
- Pages
- 1731-1740
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2793704846
- Cited by
- 486
- References
- 67
- FWCI
- 12.23
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.