The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
MFQE 2.0: A New Approach for Multi-Frame Quality Enhancement on Compressed Video
Open accessAbstract
The past few years have witnessed great success in applying deep learning to enhance the quality of compressed image/video. The existing approaches mainly focus on enhancing the quality of a single frame, not considering the similarity between consecutive frames. Since heavy fluctuation exists across compressed video frames as investigated in this paper, frame similarity can be utilized for quality enhancement of low-quality frames given their neighboring high-quality frames. This task is Multi-Frame Quality Enhancement (MFQE). Accordingly, this paper proposes an MFQE approach for compressed video, as the first attempt in this direction. In our approach, we first develop a Bidirectional Long Short-Term Memory (BiLSTM) based detector to locate Peak Quality Frames (PQFs) in compressed video. Then, a novel Multi-Frame Convolutional Neural Network (MF-CNN) is designed to enhance the quality of compressed video, in which the non-PQF and its nearest two PQFs are the input. In MF-CNN, motion between the non-PQF and PQFs is compensated by a motion compensation subnet. Subsequently, a quality enhancement subnet fuses the non-PQF and compensated PQFs, and then reduces the compression artifacts of the non-PQF. Also, PQF quality is enhanced in the same way. Finally, experiments validate the effectiveness and generalization ability of our MFQE approach in advancing the state-of-the-art quality enhancement of compressed video.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
Zhang, K., Zuo, W., Chen, Y., Meng, D., & Zhang, L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2662206 · Cited by 8,983
Overview of the High Efficiency Video Coding (HEVC) Standard
Sullivan, G. J., Ohm, J.-R., Han, W.-J., & Wiegand, T. (2012) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2012.2221191 · Cited by 8,263
Overview of the H.264/AVC video coding standard
Wiegand, T., Sullivan, G. J., Bjontegaard, G., & Luthra, A. (2003) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2003.815165 · Cited by 8,184
Shi, W., Caballero, J., Huszar, F., Totz, J., Aitken, A. P., Bishop, R., Rueckert, D., & Wang, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.207 · Cited by 7,570
Self-citationFlownet: Learning optical flow with convolutional networks
Dosovitskiy, A., Fischer, P., Ilg, E., Hausser, P., Hazirbas, C., Golkov, V., Smagt, P. V. D., Cremers, D., & Brox, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.316 · Cited by 4,313
FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks
Ilg, E., Mayer, N., Saikia, T., Keuper, M., Dosovitskiy, A., & Brox, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.179 · Cited by 3,152
MemNet: A Persistent Memory Network for Image Restoration
Tai, Y., Yang, J., Liu, X., & Xu, C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.486 · Cited by 1,883
Common test conditions and software reference configurations
Bossen, F. (2010) · Medical Entomology and Zoology · Cited by 1,731
Convolutional neural networks at constrained time cost
He, K., & Sun, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299173 · Cited by 1,558
Ohm, J.-R., Sullivan, G. J., Schwarz, H., Tan, T. K., & Wiegand, T. (2012) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2012.2221192 · Cited by 1,279
Study of Subjective and Objective Quality Assessment of Video
Seshadrinathan, K., Soundararajan, R., Bovik, A. C., & Cormack, L. K. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2042111 · Cited by 1,160
Compression Artifacts Reduction by a Deep Convolutional Network
Dong, C., Deng, Y., Loy, C. C., & Tang, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.73 · Cited by 883
Real-Time Video Super-Resolution with Spatio-Temporal Networks and Motion Compensation
Caballero, J., Ledig, C., Aitken, A., Acosta, A., Totz, J., Wang, Z., & Shi, W. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.304 · Cited by 763
Self-citationPointwise Shape-Adaptive DCT for High-Quality Denoising and Deblocking of Grayscale and Color Images
Foi, A., Katkovnik, V., & Egiazarian, K. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.891788 · Cited by 725
Video Super-Resolution With Convolutional Neural Networks
Kappeler, A., Yoo, S., Dai, Q., & Katsaggelos, A. K. (2016) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2016.2532323 · Cited by 647
The MPEG-4 video standard verification model
Sikora, T. (1997) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/76.554415 · Cited by 571
Detail-Revealing Deep Video Super-Resolution
Tao, X., Gao, H., Liao, R., Wang, J., & Jia, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.479 · Cited by 556
A Convolutional Neural Network Approach for Post-Processing in HEVC Intra Coding
Dai, Y., Liu, D., & Wu, F. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-51811-4_3 · Cited by 332
Simultaneous super-resolution and feature extraction for recognition of low-resolution faces
Hennings-Yeomans, P. H., Baker, S., & Kumar, B. V. K. V. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587810 · Cited by 230
Multi-frame Quality Enhancement for Compressed Video
Yang, R., Xu, M., Wang, Z., & Li, T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00697 · Cited by 220
Self-citationD3: Deep Dual-Domain Based Fast Restoration of JPEG-Compressed Images
Wang, Z., Liu, D., Chang, S., Ling, Q., Yang, Y., & Huang, T. S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.302 · Cited by 215
Self-citationEnhancing Quality for HEVC Compressed Videos
Yang, R., Xu, M., Liu, T., Wang, Z., & Guan, Z. (2019) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2867568 · Cited by 214
Self-citationVideo Super-Resolution via Bidirectional Recurrent Convolutional Networks
Huang, Y., Wang, W., & Wang, L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2701380 · Cited by 209
Building Dual-Domain Representations for Compression Artifacts Reduction
Guo, J., & Chao, H. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_38 · Cited by 194
Video Quality Evaluation Methodology and Verification Testing of HEVC Compression Performance
Tan, T. K., Weerakkody, R., Mrak, M., Ramzan, N., Baroncini, V., Ohm, J.-R., & Sullivan, G. J. (2016) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2015.2477916 · Cited by 192
Study of Temporal Effects on Subjective Video Quality of Experience
Bampis, C. G., Li, Z., Moorthy, A. K., Katsavounidis, I., Aaron, A., & Bovik, A. C. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2729891 · Cited by 188
Reducing Artifacts in JPEG Decompression Via a Learned Dictionary
Chang, H., Ng, M. K., & Zeng, T. (2014) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2013.2290508 · Cited by 182
A Novel Deep Learning-Based Method of Improving Coding Efficiency from the Decoder-End for HEVC
Wang, T., Chen, M., & Chao, H. (2017) · 2017 Data Compression Conference (DCC) · doi:10.1109/dcc.2017.42 · Cited by 177
Close the loop: Joint blind image restoration and recognition with sparse representation prior
Zhang, H., Yang, J., Zhang, Y., Nasrabadi, N. M., & Huang, T. S. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126315 · Cited by 170
CAS-CNN: A deep convolutional neural network for image compression artifact suppression
Cavigelli, L., Hager, P., & Benini, L. (2017) · 2017 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7965927 · Cited by 169
Blocking Artifacts Suppression in Block-Coded Images Using Overcomplete Wavelet Representation
Liew, A. W.-C., & Yan, H. (2004) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2004.825555 · Cited by 164
Decoder-side HEVC quality enhancement with scalable convolutional neural network
Yang, R., Xu, M., & Wang, Z. (2017) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2017.8019299 · Cited by 135
Self-citationLoss-Specific Training of Non-Parametric Image Restoration Models: A New State of the Art
Jancsary, J., Nowozin, S., & Rother, C. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33786-4_9 · Cited by 125
Digital video coding standards and their role in video communications
Schafer, R., & Sikora, T. (1995) · Proceedings of the IEEE · doi:10.1109/5.387092 · Cited by 121
Image deblocking via sparse representation
Jung, C., Jiao, L., Qi, H., & Sun, T. (2012) · Signal Processing Image Communication · doi:10.1016/j.image.2012.03.002 · Cited by 119
CAS-CNN: A deep convolutional neural network for image compression artifact suppression
Cavigelli, L., Hager, P. A., & Luca Benini, C. (2017) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000198586 · Cited by 112
Video Superresolution via Motion Compensation and Deep Residual Learning
Li, D., & Wang, Z. (2017) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2017.2671360 · Cited by 101
Self-citationAn efficient deep convolutional neural networks model for compressed image deblocking
Li, K., Bare, B., & Yan, B. (2017) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2017.8019416 · Cited by 69
Adaptive non-local means filter for image deblocking
Wang, C., Zhou, J. W., & Liu, S. (2013) · Signal Processing Image Communication · doi:10.1016/j.image.2013.01.006 · Cited by 67
End-to-End Learning of Video Super-Resolution with Motion Compensation
Makansi, O., Ilg, E., & Brox, T. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66709-6_17 · Cited by 59
Weight-based R-λ rate control for perceptual HEVC coding on conversational videos
Li, S., Xu, M., Deng, X., & Wang, Z. (2015) · Signal Processing Image Communication · doi:10.1016/j.image.2015.04.011 · Cited by 55
Self-citationA Discrete Probabilistic Memory Model for Discovering Dependencies in Time
Hochreiter, S., & Mozer, M. C. (2001) · Lecture notes in computer science · doi:10.1007/3-540-44668-0_92 · Cited by 13
Cited by
Hu, J., Chen, H., Heidari, A. A., Wang, M., Zhang, X., Chen, Y., & Pan, Z. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106684 · Cited by 289
Metadata
- Authors
- Guan, Z., Xing, Q., Xu, M., Yang, R., Liu, T., & Wang, Z.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2021-03-01
- Volume
- 43
- Issue
- 3
- Pages
- 949-963
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2915260409
- Cited by
- 259
- References
- 47
- FWCI
- 12.29
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.