A QVGA 143 dB Dynamic Range Frame-Free PWM Image Sensor With Lossless Pixel-Level Video Compression and Time-Domain CDS
The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
The biomimetic CMOS dynamic vision and image sensor described in this paper is based on a QVGA (304×240) array of fully autonomous pixels containing event-based change detection and pulse-width-modulation (PWM) imaging circuitry. Exposure measurements are initiated and carried out locally by the individual pixel that has detected a change of brightness in its field-of-view. Pixels do not rely on external timing signals and independently and asynchronously request access to an (asynchronous arbitrated) output channel when they have new grayscale values to communicate. Pixels that are not stimulated visually do not produce output. The visual information acquired from the scene, temporal contrast and grayscale data, are communicated in the form of asynchronous address-events (AER), with the grayscale values being encoded in inter-event intervals. The pixel-autonomous and massively parallel operation ideally results in lossless video compression through complete temporal redundancy suppression at the pixel level. Compression factors depend on scene activity and peak at ~1000 for static scenes. Due to the time-based encoding of the illumination information, very high dynamic range - intra-scene DR of 143 dB static and 125 dB at 30 fps equivalent temporal resolution - is achieved. A novel time-domain correlated double sampling (TCDS) method yields array FPN of56 dB (9.3 bit) for >10 Lx illuminance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Analog VLSI and Neural Systems
Mead, C. (1989) · CaltechAUTHORS (California Institute of Technology) · Cited by 2,776
A 128$\times$128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor
Lichtsteiner, P., Posch, C., & Delbruck, T. (2008) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2007.914337 · Cited by 2,485
Self-citationNeuromorphic electronic systems
Mead, C. (1990) · Proceedings of the IEEE · doi:10.1109/5.58356 · Cited by 2,368
Point-to-point connectivity between neuromorphic chips using address events
Boahen, K. A. (2000) · IEEE Transactions on Circuits and Systems II: Analog and Digital Signal Processing · doi:10.1109/82.842110 · Cited by 654
van der Heijden, A. H. C. (2003) · Routledge eBooks · doi:10.4324/9780203359341 · Cited by 436
A 10000 frames/s CMOS digital pixel sensor
Kleinfelder, S., Lim, S., Liu, X., & El Gamal, A. (2001) · IEEE Journal of Solid-State Circuits · doi:10.1109/4.972156 · Cited by 347
Characterization of surface channel CCD image arrays at low light levels
White, M. H., Lampe, D. R., Blaha, F. C., & Mack, I. A. (1974) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.1974.1050448 · Cited by 317
Mahowald, M. A., & Mead, C. (1991) · Scientific American · doi:10.1038/scientificamerican0591-76 · Cited by 270
Adaptive photoreceptor with wide dynamic range
Delbruck, T., & Mead, C. A. (2002) · Proceedings of IEEE International Symposium on Circuits and Systems - ISCAS '94 · doi:10.1109/iscas.1994.409266 · Cited by 187
A Burst-Mode Word-Serial Address-Event Link—I: Transmitter Design
Boahen, K. A. (2004) · IEEE Transactions on Circuits and Systems I: Regular Papers · doi:10.1109/tcsi.2004.830703 · Cited by 170
Cited by
Gallego, G., Delbruck, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3008413 · Cited by 2,566
Going Deeper in Spiking Neural Networks: VGG and Residual Architectures
Sengupta, A., Ye, Y., Wang, R., Liu, C., & Roy, K. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.00095 · Cited by 1,211
A 240 × 180 130 dB 3 µs Latency Global Shutter Spatiotemporal Vision Sensor
Brandli, C., Berner, R., Yang, M., Liu, S.-C., & Delbruck, T. (2014) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2014.2342715 · Cited by 1,144
Memory and Information Processing in Neuromorphic Systems
Indiveri, G., & Liu, S.-C. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2444094 · Cited by 1,037
A Low Power, Fully Event-Based Gesture Recognition System
Amir, A., Taba, B., Berg, D., Melano, T., McKinstry, J., Di Nolfo, C., Nayak, T., Andreopoulos, A., Garreau, G., Mendoza, M., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.781 · Cited by 1,017
Converting Static Image Datasets to Spiking Neuromorphic Datasets Using Saccades
Orchard, G., Jayawant, A., Cohen, G. K., & Thakor, N. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00437 · Cited by 882
Partial recovery of visual function in a blind patient after optogenetic therapy
Sahel, J.-A., Boulanger-Scemama, E., Pagot, C., Arleo, A., Galluppi, F., Martel, J. N., Esposti, S. D., Delaux, A., de Saint Aubert, J.-B., de Montleau, C., et al. (2021) · Nature Medicine · doi:10.1038/s41591-021-01351-4 · Cited by 700
Embedded Devices for Neuromorphic Time-Series Assessment
Mazumder, A. N., Hosseini, M., & Mohsenin, T. (2022) · Research Explorer (The University of Manchester) · doi:10.13016/m2ksy0-wxr3 · Cited by 652
HOTS: A Hierarchy of Event-Based Time-Surfaces for Pattern Recognition
Lagorce, X., Orchard, G., Galluppi, F., Shi, B. E., & Benosman, R. B. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2574707 · Cited by 612
Gallego, G., Delbrück, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2020) · Zurich Open Repository and Archive (University of Zurich) · doi:10.3929/ethz-b-000521357 · Cited by 591
STDP and STDP variations with memristors for spiking neuromorphic learning systems
Serrano-Gotarredona, T., Masquelier, T., Prodromakis, T., Indiveri, G., & Linares-Barranco, B. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00002 · Cited by 533
HATS: Histograms of Averaged Time Surfaces for Robust Event-Based Object Classification
Sironi, A., Brambilla, M., Bourdis, N., Lagorce, X., & Benosman, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00186 · Cited by 486
Retinomorphic Event-Based Vision Sensors: Bioinspired Cameras With Spiking Output
Posch, C., Serrano-Gotarredona, T., Linares-Barranco, B., & Delbruck, T. (2014) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2346153 · Cited by 471
Self-citationSpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligence
Fang, W., Chen, Y., Ding, J., Yu, Z., Masquelier, T., Chen, D., Huang, L., Zhou, H., Li, G., & Tian, Y. (2023) · Science Advances · doi:10.1126/sciadv.adi1480 · Cited by 444
Real-Time 3D Reconstruction and 6-DoF Tracking with an Event Camera
Kim, H., Leutenegger, S., & Davison, A. J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_21 · Cited by 438
Benosman, R., Clercq, C., Lagorce, X., Ieng, S.-H., & Bartolozzi, C. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2273537 · Cited by 419
End-to-End Learning of Representations for Asynchronous Event-Based Data
Gehrig, D., Loquercio, A., Derpanis, K., & Scaramuzza, D. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00573 · Cited by 386
Serrano-Gotarredona, T., & Linares-Barranco, B. (2013) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2012.2230553 · Cited by 334
HFirst: A Temporal Approach to Object Recognition
Orchard, G., Meyer, C., Etienne-Cummings, R., Posch, C., Thakor, N., & Benosman, R. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2392947 · Cited by 312
Self-citationSimultaneous Optical Flow and Intensity Estimation from an Event Camera
Bardow, P., Davison, A. J., & Leutenegger, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.102 · Cited by 295
Large-Scale Neuromorphic Spiking Array Processors: A Quest to Mimic the Brain
Thakur, C. S., Molin, J. L., Cauwenberghs, G., Indiveri, G., Kumar, K., Qiao, N., Schemmel, J., Wang, R., Chicca, E., Olson Hasler, J., et al. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00891 · Cited by 288
Spiking Neural Networks Hardware Implementations and Challenges: A Survey
Bouvier, M., Valentian, A., Mesquida, T., Rummens, F., Reyboz, M., Vianello, E., & Beigne, E. (2019) · ACM Journal on Emerging Technologies in Computing Systems · doi:10.1145/3304103 · Cited by 267
A Comprehensive Realization of Robot Skin: Sensors, Sensing, Control, and Applications
Cheng, G., Dean-Leon, E., Bergner, F., Rogelio Guadarrama Olvera, J., Leboutet, Q., & Mittendorfer, P. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2933348 · Cited by 209
“Since transmitting only change events induces drift at the reconstruction of absolute values whenever events are lost, more recent event-driven sensors also encode absolute values into events using rate codes [22] or time codes [59].”
BackgroundEvent-based Action Recognition Using Motion Information and Spiking Neural Networks
Liu, Q., Xing, D., Tang, H., Ma, D., & Pan, G. (2021) · Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/240 · Cited by 105
Design of an RGBW color VGA rolling and global shutter dynamic and active-pixel vision sensor
Li, C., Brandli, C., Berner, R., Liu, H., Yang, M., Liu, S.-C., & Delbruck, T. (2015) · 2015 IEEE International Symposium on Circuits and Systems (ISCAS) · doi:10.1109/iscas.2015.7168734 · Cited by 57
Advances in ophthalmic optogenetics: approaches and applications
Prosseda, P. P., Tran, M., Kowal, T., Wang, B., & Sun, Y. (2022) · Biomolecules · doi:10.3390/biom12020269 · Cited by 41
High Speed and High Dynamic Range Video with an Event Camera
Rebecq, H., Ranftl, R., Koltun, V., & Scaramuzza, D. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2963386 · Cited by 50
“The N-CARS dataset [14] (recorded with an ATIS event camera [52]) proposes a binary classification task: deciding whether a car is visible or not using a 100ms sequence of events.”
MethodN-HAR: A Neuromorphic Event-Based Human Activity Recognition System using Memory Surfaces
Pradhan, B. R., Bethi, Y., Narayanan, S., Chakraborty, A., & Thakur, C. S. (2019) · 2019 IEEE International Symposium on Circuits and Systems (ISCAS) · doi:10.1109/iscas.2019.8702581 · Cited by 31
“There are two popular camera systems that are implemented on this model, namely, Asynchronous Time-based Image Sensor (ATIS) [8] and Dynamic Vision Sensor (DVS) [9].”
Method2022 roadmap on neuromorphic computing and engineering
Christensen, D. V., Dittmann, R., Linares-Barranco, B., Sebastian, A., Le Gallo, M., Redaelli, A., Slesazeck, S., Mikolajick, T., Spiga, S., Menzel, S., et al. (2022) · Neuromorphic Computing and Engineering · doi:10.1088/2634-4386/ac4a83
Self-citation
Metadata
- Authors
- Posch, C., Matolin, D., & Wohlgenannt, R.
- Venue
- IEEE Journal of Solid-State Circuits
- Published
- 2011-01
- Volume
- 46
- Issue
- 1
- Pages
- 259-275
- ISSN
- 0018-9200 (ISSN-L)
- 1558-173X
- OpenAlex
- W1980178290
- Cited by
- 793
- References
- 22
- FWCI
- 10.72
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.