The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Bringing a Blurry Frame Alive at High Frame-Rate With an Event Camera
Open accessAbstract
Event-based cameras can measure intensity changes (called ‘events’) with microsecond accuracy under high-speed motion and challenging lighting conditions. With the active pixel sensor (APS), the event camera allows simultaneous output of the intensity frames. However, the output images are captured at a relatively low frame-rate and often suffer from motion blur. A blurry image can be regarded as the integral of a sequence of latent images, while the events indicate the changes between the latent images. Therefore, we are able to model the blur-generation process by associating event data to a latent image. In this paper, we propose a simple and effective approach, the Event-based Double Integral (EDI) model, to reconstruct a high frame-rate, sharp video from a single blurry frame and its event data. The video generation is based on solving a simple non-convex optimization problem in a single scalar variable. Experimental results on both synthetic and real images demonstrate the superiority of our EDI model and optimization method in comparison to the state-of-the-art.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nonlinear total variation based noise removal algorithms
Rudin, L. I., Osher, S., & Fatemi, E. (1992) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(92)90242-f · Cited by 15,704
The Levenberg-Marquardt algorithm: Implementation and theory
Moré, J. J. (1978) · Lecture Notes in Mathematics · doi:10.1007/bfb0067700 · Cited by 5,773
A 128$\times$128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor
Lichtsteiner, P., Posch, C., & Delbruck, T. (2008) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2007.914337 · Cited by 2,485
Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring
Nah, S., Kim, T. H., & Lee, K. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.35 · Cited by 2,275
Removing camera shake from a single photograph
Fergus, R., Singh, B., Hertzmann, A., Roweis, S. T., & Freeman, W. T. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141956 · Cited by 1,815
Scale-Recurrent Network for Deep Image Deblurring
Tao, X., Gao, H., Shen, X., Wang, J., & Jia, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00853 · Cited by 1,316
A 240 × 180 130 dB 3 µs Latency Global Shutter Spatiotemporal Vision Sensor
Brandli, C., Berner, R., Yang, M., Liu, S.-C., & Delbruck, T. (2014) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2014.2342715 · Cited by 1,144
Blind deconvolution using a normalized sparsity measure
Krishnan, D., Tay, T., & Fergus, R. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995521 · Cited by 1,119
Unnatural L0 Sparse Representation for Natural Image Deblurring
Xu, L., Zheng, S., & Jia, J. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.147 · Cited by 1,079
Learning a convolutional neural network for non-uniform motion blur removal
Sun, J., Cao, W., Xu, Z., & Ponce, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298677 · Cited by 906
Scatter Search and Local NLP Solvers: A Multistart Framework for Global Optimization
Ugray, Z., Lasdon, L., Plummer, J., Glover, F., Kelly, J., & Martí, R. (2007) · INFORMS Journal on Computing · doi:10.1287/ijoc.1060.0175 · Cited by 726
Mueggler, E., Rebecq, H., Gallego, G., Delbruck, T., & Scaramuzza, D. (2017) · The International Journal of Robotics Research · doi:10.1177/0278364917691115 · Cited by 606
EV-FlowNet: Self-Supervised Optical Flow Estimation for Event-based Cameras
Zhu, A., Yuan, L., Chaney, K., & Daniilidis, K. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.062 · Cited by 470
Edge-based blur kernel estimation using patch priors
Sun, L., Cho, S., Wang, J., & Hays, J. (2013) · IEEE International Conference on Computational Photography (ICCP) · doi:10.1109/iccphot.2013.6528301 · Cited by 440
From Motion Blur to Motion Flow: A Deep Learning Solution for Removing Heterogeneous Motion Blur
Gong, D., Yang, J., Liu, L., Zhang, Y., Reid, I., Shen, C., Van Den Hengel, A., & Shi, Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.405 · Cited by 439
Real-Time 3D Reconstruction and 6-DoF Tracking with an Event Camera
Kim, H., Leutenegger, S., & Davison, A. J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_21 · Cited by 438
EVO: A Geometric Approach to Event-Based 6-DOF Parallel Tracking and Mapping in Real Time
Rebecq, H., Horstschaefer, T., Gallego, G., & Scaramuzza, D. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2016.2645143 · Cited by 410
Dynamic Scene Deblurring Using Spatially Variant Recurrent Neural Networks
Zhang, J., Pan, J., Ren, J., Song, Y., Bao, L., Lau, R. W. H., & Yang, M.-H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00267 · Cited by 384
Image Deblurring via Extreme Channels Prior
Yan, Y., Ren, W., Guo, Y., Wang, R., & Cao, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.738 · Cited by 365
Simultaneous Optical Flow and Intensity Estimation from an Event Camera
Bardow, P., Davison, A. J., & Leutenegger, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.102 · Cited by 295
Deblurring Images via Dark Channel Prior
Pan, J., Sun, D., Pfister, H., & Yang, M.-H. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2753804 · Cited by 285
Event-Based Visual Inertial Odometry
Zhu, A. Z., Atanasov, N., & Daniilidis, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.616 · Cited by 249
The Golden Ratio and Fibonacci Numbers
Dunlap, R. A. (1997) · WORLD SCIENTIFIC eBooks · doi:10.1142/3595 · Cited by 248
Simultaneous Mosaicing and Tracking with an Event Camera
Kim, H., Handa, A., Benosman, R., Ieng, S.-H., & Davison, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.26 · Cited by 247
Continuous-Time Intensity Estimation Using Event Cameras
Scheerlinck, C., Barnes, N., & Mahony, R. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-20873-8_20 · Cited by 217
Self-citationLow-latency visual odometry using event-based feature tracks
Kueng, B., Mueggler, E., Gallego, G., & Scaramuzza, D. (2016) · 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7758089 · Cited by 196
Generalized video deblurring for dynamic scenes
Kim, T. H., & Lee, K. M. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299181 · Cited by 165
Video deblurring for hand-held cameras using patch-based synthesis
Cho, S., Wang, J., & Lee, S. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185560 · Cited by 161
Asynchronous, Photometric Feature Tracking Using Events and Frames
Gehrig, D., Rebecq, H., Gallego, G., & Scaramuzza, D. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01258-8_46 · Cited by 157
Semi-dense 3D Reconstruction with a Stereo Event Camera
Zhou, Y., Gallego, G., Rebecq, H., Kneip, L., Li, H., & Scaramuzza, D. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01246-5_15 · Cited by 145
Direct face detection and video reconstruction from event cameras
Miyatani, Y., Barua, S., & Veeraraghavan, A. (2016) · 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2016.7477561 · Cited by 133 · cited 2×
“The existing methods can be in general categorized as 1) Event data only solutions [1, 27, 2], where the results tend to lack the texture and consistency of natural videos, as they fail to use the complementary information contained in the low frame-rate intensity image; 2) Low framerate intensity-image-only solutions…”
MethodLearning to Extract a Video Sequence from a Single Motion-Blurred Image
Jin, M., Meishvili, G., & Favaro, P. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00663 · Cited by 125
Real-time, high-speed video decompression using a frame- and event-based DAVIS sensor
Brändli, C., Müller, L. K., & Delbrück, T. (2014) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2014.6865228 · Cited by 121
Blur kernel estimation using normalized color-line priors
Lai, W., Ding, J., Lin, Y., & Chuang, Y. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298601 · Cited by 94
Bringing Alive Blurred Moments
Purohit, K., Shah, A., & Rajagopalan, A. N. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00699 · Cited by 67
Asynchronous Spatial Image Convolutions for Event Cameras
Scheerlinck, C., Barnes, N. M., & Mahony, R. E. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2893427 · Cited by 66
Self-citationReal-Time Intensity-Image Reconstruction for Event Cameras Using Manifold Regularisation
Reinbacher, C., Graber, G., & Pock, T. (2016) · British Machine Vision Conference (BMVC) · doi:10.5244/c.30.9 · Cited by 65
Semi-dense 3D Reconstruction with a Stereo Event Camera
Zhou, Y. B., Gallego, G., Rebecq, H., Kneip, L., Li, H., & Scaramuzza, D. (2018) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-176054 · Cited by 58
Simultaneous Stereo Video Deblurring and Scene Flow Estimation
Pan, L., Dai, Y., Liu, M., & Porikli, F. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.739 · Cited by 57
Self-citationEfficient Patch-Wise Non-Uniform Deblurring for a Single Image
Yu, X., Xu, F., Zhang, S., & Zhang, L. (2014) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2014.2321734 · Cited by 51
Self-citationSellent, A., Rother, C., & Roth, S. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46475-6_35 · Cited by 51
High-speed video generation with an event camera
Liu, H., Zhang, F., Marshall, D., Shi, L., & Hu, S. (2017) · The Visual Computer · doi:10.1007/s00371-017-1372-y · Cited by 24
Depth Map Completion by Jointly Exploiting Blurry Color Images and Sparse Depth Maps
Pan, L., Dai, Y., Liu, M., & Porikli, F. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00155 · Cited by 16
Self-citation
Cited by
Gallego, G., Delbruck, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3008413 · Cited by 2,566
Gallego, G., Delbrück, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2020) · Zurich Open Repository and Archive (University of Zurich) · doi:10.3929/ethz-b-000521357 · Cited by 591
DSEC: A Stereo Event Camera Dataset for Driving Scenarios
Gehrig, M., Aarents, W., Gehrig, D., & Scaramuzza, D. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3068942 · Cited by 428
Metadata
- Authors
- Pan, L., Scheerlinck, C., Yu, X., Hartley, R., Liu, M., & Dai, Y.
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 6813-6822
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2970672284
- Cited by
- 308
- References
- 43
- FWCI
- 8.69
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.