The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyond
Open accessAbstract
Video super-resolution (VSR) approaches tend to have more components than the image counterparts as they need to exploit the additional temporal dimension. Complex designs are not uncommon. In this study, we wish to untangle the knots and reconsider some most essential components for VSR guided by four basic functionalities, i.e., Propagation, Alignment, Aggregation, and Upsampling. By reusing some existing components added with minimal redesigns, we show a succinct pipeline, BasicVSR, that achieves appealing improvements in terms of speed and restoration quality in comparison to many state-of-the-art algorithms. We conduct systematic analysis to explain how such gain can be obtained and discuss the pitfalls. We further show the extensibility of BasicVSR by presenting an information-refill mechanism and a coupled propagation scheme to facilitate information aggregation. The BasicVSR and its extension, IconVSR, can serve as strong baselines for future VSR approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
Self-citationShi, W., Caballero, J., Huszar, F., Totz, J., Aitken, A. P., Bishop, R., Rueckert, D., & Wang, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.207 · Cited by 7,570
Deformable Convolutional Networks
Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., & Wei, Y. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.89 · Cited by 7,513 · cited 1×
“There is an urge to revisit various components macroscopically and uncover a generic baseline that inher-its the strengths of existing approaches.”
BackgroundLearning a Deep Convolutional Network for Image Super-Resolution
Dong, C., Loy, C. C., He, K., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_13 · Cited by 5,494
Self-citationSGDR: Stochastic Gradient Descent with Warm Restarts
Loshchilov, I., & Hutter, F. (2016) · arXiv · doi:10.48550/arxiv.1608.03983 · Cited by 5,309
Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolution
Lai, W.-S., Huang, J.-B., Ahuja, N., & Yang, M.-H. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.618 · Cited by 2,976
Deformable ConvNets V2: More Deformable, Better Results
Zhu, X., Hu, H., Lin, S., & Dai, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00953 · Cited by 2,943
Video Enhancement with Task-Oriented Flow
Xue, T., Chen, B., Wu, J., Wei, D., & Freeman, W. T. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-018-01144-2 · Cited by 1,393
Optical Flow Estimation Using a Spatial Pyramid Network
Ranjan, A., & Black, M. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.291 · Cited by 1,344
Edvr: video restoration with enhanced deformable convolutional networks
Wang, X., Chan, K. C. K., Yu, K., Dong, C., & Loy, C. C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00247 · Cited by 1,272 · cited 9×
“9458 EDVR-M [32] 3.”
MethodInfluentialSelf-citationVideo Enhancement with Task-Oriented FlowPreprint
Xue, T., Chen, B., Wu, J., Wei, D., & Freeman, W. T. (2019) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 1,190
Two deterministic half-quadratic regularization algorithms for computed imaging
Charbonnier, P., Blanc-Feraud, L., Aubert, G., & Barlaud, M. (2002) · Proceedings of 1st International Conference on Image Processing · doi:10.1109/icip.1994.413553 · Cited by 879
Real-Time Video Super-Resolution with Spatio-Temporal Networks and Motion Compensation
Caballero, J., Ledig, C., Aitken, A., Acosta, A., Totz, J., Wang, Z., & Shi, W. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.304 · Cited by 763
Flow-Guided Feature Aggregation for Video Object Detection
Zhu, X., Wang, Y., Dai, J., Yuan, L., & Wei, Y. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.52 · Cited by 729 · cited 1×
“In this work, we conduct extensive analysis and present a simple, strong and versatile baseline, BasicVSR, which can serve as a back-bone with abundant flexibilities in design.”
MethodDeep Feature Flow for Video Recognition
Zhu, X., Xiong, Y., Dai, J., Yuan, L., & Wei, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.441 · Cited by 653
TDAN: Temporally-Deformable Alignment Network for Video Super-Resolution
Tian, Y., Zhang, Y., Fu, Y., & Xu, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00342 · Cited by 634
Jo, Y., Oh, S. W., Kang, J., & Kim, S. J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00340 · Cited by 590
Frame-Recurrent Video Super-Resolution
Sajjadi, M. S. M., Vemulapalli, R., & Brown, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00693 · Cited by 568
Detail-Revealing Deep Video Super-Resolution
Tao, X., Gao, H., Liao, R., Wang, J., & Jia, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.479 · Cited by 556
Recurrent Back-Projection Network for Video Super-Resolution
Haris, M., Shakhnarovich, G., & Ukita, N. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00402 · Cited by 554
NTIRE 2019 Challenge on Video Deblurring and Super-Resolution: Dataset and Study
Nah, S., Baik, S., Hong, S., Moon, G., Son, S., Timofte, R., & Lee, K. M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00251 · Cited by 543
On Bayesian Adaptive Video Super Resolution
Liu, C., & Sun, D. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.127 · Cited by 526
Super-Resolution Without Explicit Subpixel Motion Estimation
Takeda, H., Milanfar, P., Protter, M., & Elad, M. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2023703 · Cited by 302
Yi, P., Wang, Z., Jiang, K., Jiang, J., & Ma, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00320 · Cited by 291
Video Super-Resolution with Recurrent Structure-Detail Network
Isobe, T., Jia, X., Gu, S., Li, S., Wang, S., & Tian, Q. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58610-2_38 · Cited by 240
MuCAN: Multi-correspondence Aggregation Network for Video Super-Resolution
Li, W., Tao, X., Guo, T., Qi, L., Lu, J., & Jia, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58607-2_20 · Cited by 225
Video Super-Resolution via Bidirectional Recurrent Convolutional Networks
Huang, Y., Wang, W., & Wang, L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2701380 · Cited by 209
Video Super-Resolution With Temporal Group Attention
Isobe, T., Li, S., Jia, X., Yuan, S., Slabaugh, G., Xu, C., Li, Y.-L., Wang, S., & Tian, Q. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00803 · Cited by 199
Clockwork Convnets for Video Semantic Segmentation
Shelhamer, E., Rakelly, K., Hoffman, J., & Darrell, T. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49409-8_69 · Cited by 197
Accel: A Corrective Fusion Network for Efficient Semantic Segmentation on Video
Jain, S., Wang, X., & Gonzalez, J. E. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00907 · Cited by 184
Self-citationEfficient Video Super-Resolution through Recurrent Latent Space Propagation
Fuoli, D., Gu, S., & Timofte, R. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00431 · Cited by 163
Understanding deformable alignment in video super-resolution
Chan, K. C. K., Wang, X., Yu, K., Dong, C., & Loy, C. C. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i2.16181 · Cited by 162
Self-citationSpatio-Temporal Transformer Network for Video Restoration
Kim, T. H., Sajjadi, M. S. M., Hirsch, M., & Schölkopf, B. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01219-9_7 · Cited by 158
Optimizing Video Object Detection via a Scale-Time Lattice
Chen, K., Wang, J., Yang, S., Zhang, X., Xiong, Y., Loy, C. C., & Lin, D. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00815 · Cited by 139
Self-citationDeformable Non-Local Network for Video Super-Resolution
Wang, H., Su, D., Liu, C., Jin, L., Sun, X., & Peng, X. (2019) · IEEE Access · doi:10.1109/access.2019.2958030 · Cited by 94
Revisiting Temporal Modeling for Video Super-resolution
Isobe, T., Zhu, F., & Wang, S. (2020) · British Machine Vision Conference (BMVC) · doi:10.5244/c.34.8 · Cited by 45
FAST: A Framework to Accelerate Super-Resolution Processing on Compressed Videos
Zhang, Z., & Sze, V. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.138 · Cited by 44
Towards High Performance Video Object Detection for MobilesPreprint
Zhu, X., Dai, J., Zhu, X., Wei, Y., & Yuan, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.05830 · Cited by 39
Understanding Deformable Alignment in Video Super-ResolutionPreprint
Chan, K. C. K., Wang, X., Yu, K., Dong, C., & Loy, C. C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.07265 · Cited by 29
Self-citation
Cited by
Low-Light Image and Video Enhancement Using Deep Learning: A Survey
Li, C., Guo, C., Han, L., Jiang, J., Cheng, M.-M., Gu, J., & Loy, C. C. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3126387 · Cited by 657
Self-citationBasicvsr++: improving video super-resolution with enhanced propagation and alignment
Chan, K. C. K., Zhou, S., Xu, X., & Loy, C. C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00588 · Cited by 604
“In particular, IconVSR (the more powerful variant of BasicVSR) [3] consists of a coupled propagation scheme with sequentially-connected branches to facilitate information exchange.”
BackgroundMethodResultInfluentialSelf-citationFlowFormer: A Transformer Architecture for Optical Flow
Huang, Z., Shi, X., Zhang, C., Wang, Q., Cheung, K. C., Qin, H., Dai, J., & Li, H. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19790-1_40 · Cited by 335
Image super-resolution: A comprehensive review, recent trends, challenges and applications
Lepcha, D. C., Goyal, B., Dogra, A., & Goyal, V. (2023) · Information Fusion · doi:10.1016/j.inffus.2022.10.007 · Cited by 305
VRT: A Video Restoration Transformer
Liang, J., Cao, J., Fan, Y., Zhang, K., Ranjan, R., Li, Y., Timofte, R., & Van Gool, L. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3372454 · Cited by 302
Metadata
- Authors
- Chan, K. C. K., Wang, X., Yu, K., Dong, C., & Loy, C. C.
- Venue
- 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2021-06
- Pages
- 4945-4954
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3107955907
- Cited by
- 604
- References
- 40
- FWCI
- 35.09
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.