Bridging the Gap Between Events and Frames Through Unsupervised Domain Adaptation
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Reliable perception during fast motion maneuvers or in high dynamic range environments is crucial for robotic systems. Since event cameras are robust to these challenging conditions, they have great potential to increase the reliability of robot vision. However, event-based vision has been held back by the shortage of labeled datasets due to the novelty of event cameras. To overcome this drawback, we propose a task transfer method to train models directly with labeled images and unlabeled event data. Compared to previous approaches, (i) our method transfers from single images to events instead of high frame rate videos, and (ii) does not rely on paired sensor data. To achieve this, we leverage the generative event model to split event features into content and motion features. This split enables efficient matching between latent spaces for events and images, which is crucial for successful task transfer. Thus, our approach unlocks the vast amount of existing image datasets for the training of event-based neural networks. Our task transfer method consistently outperforms methods targeting Unsupervised Domain Adaptation for object detection by 0.26 mAP (increase by 93%) and classification by 2.7% accuracy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
CyCADA: Cycle-Consistent Adversarial Domain Adaptation
Hoffman, J., Tzeng, E., Park, T., Zhu, J.-Y., Isola, P., Saenko, K., Efros, A. A., & Darrell, T. (2017) · arXiv · doi:10.48550/arxiv.1711.03213 · Cited by 2,656 · cited 1×
“As a common constraint in the UDA literature [33], [34], [35], [22], [25], [13], we perform domain translation to generate pseudo pairs, which are used to align the shared latent space on which the task is learned.”
MethodGallego, G., Delbruck, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3008413 · Cited by 2,566
Self-citationCross and learn: Cross-modal self-supervision
Sayed, N., Brattoli, B., & Ommer, B. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-12939-2_17 · Cited by 76
Cited by
A Systematic Review of Drone Based Road Traffic Monitoring System
Bisio, I., Garibotto, C., Haleem, H., Lavagetto, F., & Sciarrone, A. (2022) · IEEE Access · doi:10.1109/access.2022.3207282 · Cited by 139
Person Re-Identification without Identification via Event Anonymization
Ahmad, S., Morerio, P., & Del Bue, A. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01022 · Cited by 39
“…dynamic range enables them to work under challenging illumination conditions while, alike RGB cameras, event-cameras are able to solve various vision tasks, such as object recognition [26], human pose estimation [33], detection and tracking [27, 15, 21], and person re-identification (ReId) [1].”
BackgroundAhmad, S., Morerio, P., & Del Bue, A. (2024) · IEEE Access · doi:10.1109/access.2024.3399539 · Cited by 16
“These include object recognition [1], human pose estimation [2], [3], detection and tracking [4], [5], [6], and person re-identification (ReId) [7].”
Background
Metadata
- Authors
- Messikommer, N., Gehrig, D., Gehrig, M., & Scaramuzza, D.
- Venue
- IEEE Robotics and Automation Letters
- Published
- 2022-04
- Volume
- 7
- Issue
- 2
- Pages
- 3515-3522
- ISSN
- 2377-3766 (ISSN-L)
- 2377-3774
- OpenAlex
- W3196480172
- Cited by
- 54
- References
- 4
- FWCI
- 3.88
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Bridging the Gap Between Events and Frames Through Unsupervised Domain Adaptation. https://app.cochat.ai/papers/10.1109/lra.2022.3145053
- The paper
- Messikommer, N., Gehrig, D., Gehrig, M., & Scaramuzza, D. (2022). Bridging the Gap Between Events and Frames Through Unsupervised Domain Adaptation. IEEE Robotics and Automation Letters. https://doi.org/10.1109/lra.2022.3145053
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.