Event Encryption for Neuromorphic Vision Sensors: Framework, Algorithm, and Evaluation
Open accessAbstract
Nowadays, our lives have benefited from various vision-based applications, such as video surveillance, human identification and aided driving. Unauthorized access to the vision-related data greatly threatens users’ privacy, and many encryption schemes have been proposed to secure images and videos in those conventional scenarios. Neuromorphic vision sensor (NVS) is a brand new kind of bio-inspired sensor that can generate a stream of impulse-like events rather than synchronized image frames, which reduces the sensor’s latency and broadens the applications in surveillance and identification. However, the privacy issue related to NVS remains a significant challenge. For example, some image reconstruction and human identification approaches may expose privacy-related information from NVS events. This work is the first to investigate the privacy of NVS. We firstly analyze the possible security attacks to NVS, including grayscale image reconstruction and privacy-related classification. We then propose a dedicated encryption framework for NVS, which incorporates a 2D chaotic mapping to scramble the positions of events and flip their polarities. In addition, an updating score has been designed for controlling the frequency of execution, which supports efficient encryption on different platforms. Finally, extensive experiments have demonstrated that the proposed encryption framework can effectively protect NVS events against grayscale image reconstruction and human identification, and meanwhile, achieve high efficiency on various platforms including resource-constrained devices.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The encryption framework of Du et al. [12] is incompatible with direct execution of downstream computer vision tasks; encrypted event streams require decryption before practical application.
“However, the limitation of this encryption approach is the incompatibility with the direct execution of downstream computer vision tasks. The encrypted event stream primarily prevents privacy attacks during transmission or storage, requiring decryption prior to any practical application.”
From Event Anonymization: Privacy-Preserving Person Re-Identification and Pose Estimation in Event-Based Vision (2024) · cites this paper as [12]
Section 5.1 reports that images reconstructed directly from encrypted events were nearly all dark, and Section 5.2 reports that identification accuracy on encrypted events fell to random-guess levels. Section 4.2 describes how to decrypt events, but the paper does not establish that every downstream computer-vision task is incompatible with encrypted streams or that decryption is required before any practical application. Page numbers are unavailable in our copy. (LLM, conf=0.86)
Experimental — accuracy not yet measuredDu et al. [12] introduced a manually designed encryption framework that uses spatial chaotic mapping to scramble event positions and invert their polarities.
“Du et al. [12] recently introduced a manually designed encryption framework to counteract privacy attacks on event data. This method uses spatial chaotic mapping to scramble event positions and invert their polarities.”
From Event Anonymization: Privacy-Preserving Person Re-Identification and Pose Estimation in Event-Based Vision (2024) · cites this paper as [12]
The proposed event anonymization method outperforms the event encryption technique.
“Our proposed event anonymization method outperforms the event encryption technique.”
From Event Anonymization: Privacy-Preserving Person Re-Identification and Pose Estimation in Event-Based Vision (2024) · cites this paper as [12]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Gallego, G., Delbruck, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3008413 · Cited by 2,566 · see citing works
Image encryption using chaotic logistic map
Pareek, N. K., Patidar, V., & Sud, K. K. (2006) · Image and Vision Computing · doi:10.1016/j.imavis.2006.02.021 · Cited by 1,261 · see citing works
Chaos-based image encryption algorithm
Guan, Z.-H., Huang, F., & Guan, W. (2005) · Physics Letters A · doi:10.1016/j.physleta.2005.08.006 · Cited by 726 · see citing works
Event-Based Vision Meets Deep Learning on Steering Prediction for Self-Driving Cars
Maqueda, A. I., Loquercio, A., Gallego, G., Garcia, N., & Scaramuzza, D. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00568 · Cited by 624 · see citing works
Mueggler, E., Rebecq, H., Gallego, G., Delbrück, T., & Scaramuzza, D. (2017) · The International Journal of Robotics Research · doi:10.1177/0278364917691115 · Cited by 612 · see citing works
Gallego, G., Delbrück, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2020) · Zurich Open Repository and Archive (University of Zurich) · doi:10.3929/ethz-b-000521357 · Cited by 590 · see citing works
Event-Based Vision Meets Deep Learning on Steering Prediction for Self-Driving Cars
Maqueda, A. I., Loquercio, A., Gallego, G., Garcia, N. N., & Scaramuzza, D. (2018) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-175994 · Cited by 493 · see citing works
A fast image encryption algorithm based on chaotic map
Liu, W., Sun, K., & Zhu, C. (2016) · Optics and Lasers in Engineering · doi:10.1016/j.optlaseng.2016.03.019 · Cited by 489 · see citing works
Events-To-Video: Bringing Modern Computer Vision to Event Cameras
Rebecq, H., Ranftl, R., Koltun, V., & Scaramuzza, D. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00398 · Cited by 437 · see citing works
Wang, L., Mostafavi, M., Ho, Y.-S., & Yoon, K.-J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01032 · Cited by 233 · see citing works
Chaotic characteristics of a one-dimensional iterative map with infinite collapses
He, D., He, C., Jiang, L., Zhu, H.-W., & Hu, G. (2001) · IEEE Transactions on Circuits and Systems I Fundamental Theory and Applications · doi:10.1109/81.933333 · Cited by 210 · see citing works
An empirical study of secure MPEG video transmissions
Agi, I., & Gong, L. (2002) · doi:10.1109/ndss.1996.492420 · Cited by 210 · see citing works
Image encryption algorithm using chaotic Chebyshev generator
Huang, X. (2012) · Nonlinear Dynamics · doi:10.1007/s11071-011-0155-7 · Cited by 188 · see citing works
Real-Time Intensity-Image Reconstruction for Event Cameras Using Manifold Regularisation
Munda, G., Reinbacher, C., & Pock, T. (2018) · International Journal of Computer Vision · doi:10.1007/s11263-018-1106-2 · Cited by 181 · see citing works
EV-Gait: Event-Based Robust Gait Recognition Using Dynamic Vision Sensors
Wang, Y., Du, B., Shen, Y., Wu, K., Zhao, G., Sun, J., & Wen, H. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00652 · Cited by 170 · see citing works
Self-citationParedes-Vallés, F., & de Croon, G. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00345 · Cited by 154 · see citing works
Direct face detection and video reconstruction from event cameras
Miyatani, Y., Barua, S., & Veeraraghavan, A. (2016) · 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2016.7477561 · Cited by 133 · see citing works
A new chaotic algorithm for video encryption
Chiaraluce, F., Giccarelli, L., Gambi, E., et al. (2003) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2003.1196410 · Cited by 129 · see citing works
Image Encryption With Multiorders of Fractional Fourier Transforms
Tao, R., Meng, X.-Y., & Wang, Y. (2010) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2010.2068289 · Cited by 125 · see citing works
Wang, L., Kim, T., & Yoon, K. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00834 · Cited by 119 · see citing works
Learning to Super Resolve Intensity Images From Events
Mostafavi, M., Choi, J., & Yoon, K. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00284 · Cited by 73 · see citing works
Secure scalable video streaming for wireless networks
Wee, S. J., & Apostolopoulos, J. G. (2005) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2001.940394 · Cited by 66 · see citing works
Event-Stream Representation for Human Gaits Identification Using Deep Neural Networks
Wang, Y., Zhang, X., Shen, Y., Du, B., Zhao, G., Lizhen, L. C. C., & Wen, H. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3054886 · Cited by 65 · see citing works
Self-citationDDD17: End-To-End DAVIS Driving DatasetPreprint
Binas, J., Neil, D., Liu, S., & Delbrück, T. (2017) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-149345 · Cited by 58 · see citing works
Shared key encryption of jpeg color images
Bob, & Sudharsanan, S. I. (2005) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2005.1561845 · Cited by 44 · see citing works
Zhou, N., Liu, X., Zhang, Y., et al. (2012) · Optics & Laser Technology · doi:10.1016/j.optlastec.2012.08.033 · Cited by 43 · see citing works
A 3D Object Encryption Scheme Which Maintains Dimensional and Spatial Stability
Jolfaei, A., Wu, X.-W., & Muthukkumarasamy, V. (2014) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2014.2378146 · Cited by 40 · see citing works
N-HAR: A Neuromorphic Event-Based Human Activity Recognition System using Memory Surfaces
Pradhan, B. R., Bethi, Y., Narayanan, S., Chakraborty, A., & Thakur, C. S. (2019) · 2019 IEEE International Symposium on Circuits and Systems (ISCAS) · doi:10.1109/iscas.2019.8702581 · Cited by 31 · see citing works
Chen, G., Liu, P., Liu, Z., et al. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.3023791 · Cited by 31 · see citing works
3D Point Cloud Encryption Through Chaotic Mapping
Jin, X., Zhaoxing, W., Song, C., et al. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-48890-5_12 · Cited by 26 · see citing works
Fast localization and tracking using event sensors
Yuan, W., & Ramalingam, S. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487657 · Cited by 20 · see citing works
Event-Based High Frame-Rate Video Reconstruction With A Novel Cycle-Event Network
Su, B., Lei, Y., & Yang, W. T. (2020) · Proceedings - International Conference on Image Processing · doi:10.1109/icip40778.2020.9191114 · Cited by 20 · see citing works
Boosted Kernelized Correlation Filters for Event-based Face Detection
Ramesh, B., & Yang, H. (2020) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw50321.2020.9096944 · Cited by 17 · see citing works
Encryption of 3D Point Cloud Using Chaotic Cat Mapping
Jia, C., Yang, T., Wang, C., Fan, B., & He, F. (2019) · 3D Research · doi:10.1007/s13319-018-0212-9 · Cited by 16 · see citing works
Human identification by gait from event-based camera
Sokolova, A., & Konushin, A. (2019) · Machine Vision Applications · doi:10.23919/mva.2019.8758019 · Cited by 15 · see citing works
Paredes-Vallés, F., & de Croon, G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.08283 · Cited by 14 · see citing works
Events-To-Video: Bringing Modern Computer Vision to Event Cameras
Rebecq, H., Ranftl, R., Koltun, V., & Scaramuzza, D. (2019) · Zurich Open Repository and Archive (University of Zurich) · doi:10.48550/arxiv.1904.08298 · Cited by 11 · see citing works
Wang, L., Kim, T., & Yoon, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.07640 · Cited by 9 · see citing works
Flagged first, then by citations
Research works printed but not linked: 3
- [8]Qiao L. Nahrstedt K. A new algorithm for MPEG video encryption Proceedings of the First International Conference on Imaging Science System and Technology Las Vegas, NV, USA 30 June 30–3 July 1997 21 29
- [10]Wu C.P. Kuo C.C.J. Efficient multimedia encryption via entropy codec design Proceedings of the Photonics West 2001—Electronic Imaging San Jose, CA, USA 20 January 2001 Volume 4314 128 138
- [16]Lenz G. Ieng S.H. Benosman R. Event-based face detection and tracking in the blink of an eye arXiv 2018 1803.10106 PMC7397845 32848527
Cited by
Sorted by citations
Event-driven Re-Id: A New Benchmark and Method Towards Privacy-Preserving Person Re-Identification
Ahmad, S., Scarpellini, G., Morerio, P., & Bue, A. D. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw54805.2022.00052 · Cited by 54 · see citing works
Person Re-Identification without Identification via Event Anonymization
Ahmad, S., Morerio, P., & Del Bue, A. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01022 · Cited by 39 · see citing works
Ahmad, S., Morerio, P., & Del Bue, A. (2024) · IEEE Access · doi:10.1109/access.2024.3399539 · Cited by 16 · see citing works
“Du et al. [12] explore the privacy aspects of event cameras, analyzing potential threats such as the reconstruction of gray-scale images and privacy-related classifications.”
BackgroundMethodInfluential
- Authors
- Du, B., Li, W., Wang, Z., Xu, M., Gao, T., Li, J., & Wen, H.
- Affiliations
- University of Warwick (GB)
- Tongji University (CN)
- Corresponding author
- Wen, Hongkai
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2021-06-24
- Volume
- 21
- Issue
- 13
- Pages
- 4320
- ISSN
- 1424-8220 (ISSN-L)
- PMC
- PMC8272045
- OpenAlex
- W3177306017
- Cited by
- 18
- References
- 38
- Citations by year
- 2026: 1 · 2025: 6 · 2024: 4 · 2023: 5 · 2022: 2
- FWCI
- 0.99
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Sensors (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Chaos-based Image/Signal Encryption
- Physical Sciences › Computer Science › Artificial Intelligence › Cryptography and Data Security
- Physical Sciences › Computer Science › Artificial Intelligence › Cryptographic Implementations and Security
- Keywords
- neuromorphic vision sensors, privacy preservation, resource-constrained devices, video surveillance security
- MeSH terms
- Algorithms, Humans, Computer Security, Privacy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review