Enhanced Bi-Prediction With Convolutional Neural Network for High-Efficiency Video Coding
The DOI matches its Crossref record; 47 of the 48 references it cites were found in a registry or an index.
Abstract
In this paper, we propose an enhanced bi-prediction scheme based on the convolutional neural network (CNN) to improve the rate-distortion performance in video compression. In contrast to the traditional bi-prediction strategy which computes the linear superposition as the predictive signals with pixel-to-pixel correspondence, the proposed scheme employs CNN to directly infer the predictive signals in a data-driven manner. As such, the predicted blocks are fused in a nonlinear fashion to improve the coding performance. Moreover, the patch-to-patch inference strategy with CNN also improves the prediction accuracy since the patch-level information for the prediction of each individual pixel can be exploited. The proposed enhanced bi-prediction scheme is further incorporated into the high-efficiency video coding standard, and the experimental results exhibit a significant performance improvement under different coding configurations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 2×
“Moreover, the skip connection [19] is introduced into our network to avoid the long-term memory [20] of the input features.”
BackgroundSelf-citationAdam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · cited 1×
“The Adam algorithm [44] is used to update the coefficients W (i) and b(i) in the network with the minimization of the loss function.”
MethodDelving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741 · cited 1×
“Unit (ReLU) [13] and Parametric ReLU (PReLU) [14], which was also analyzed in [15] and [16].”
BackgroundSelf-citation(2010) · Cited by 14,134
(2010) · International Conference on Machine Learning · Cited by 13,995
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
Overview of the High Efficiency Video Coding (HEVC) Standard
Sullivan, G. J., Ohm, J.-R., Han, W.-J., & Wiegand, T. (2012) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2012.2221191 · Cited by 8,263 · cited 9×
“264/AVC [1] and HEVC [2], performs motion-compensation from two reference frame lists.”
MethodInfluentialOverview of the H.264/AVC video coding standard
Wiegand, T., Sullivan, G. J., Bjontegaard, G., & Luthra, A. (2003) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2003.815165 · Cited by 8,184 · cited 1×
“B I-PREDICTION, which serves as an indispensable module in the state-of-the-art video coding standards such as H.264/AVC [1] and HEVC [2], performs motion-compensation from two reference frame lists.”
BackgroundAccurate Image Super-Resolution Using Very Deep Convolutional Networks
Kim, J., Lee, J. K., & Lee, K. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.182 · Cited by 7,870 · cited 4×
“[20], [27] deepened the network architecture to enhance the non-linear representation ability, which achieves better performance in SR problem.”
BackgroundInfluentialLearning a Deep Convolutional Network for Image Super-Resolution
Dong, C., Loy, C. C., He, K., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_13 · Cited by 5,494 · cited 1×
“[26] first introduced the deep learning into super-resolution problem.”
Background
Research works printed but not linked: 2
- 2018, Trained Models in the Caffe Platform
- bossen, 2011, Common Test Conditions and Software Reference Configurations
Cited by
Artificial intelligence in the creative industries: a review
Anantrasirichai, N., & Bull, D. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10039-7 · Cited by 793
“They have been applied to optimise a range of coding tools including intra prediction [219, 222], motion estimation [297], transforms [221], quantization [298], entropy coding [220] and loop filtering [299].”
MethodImage and Video Compression With Neural Networks: A Review
Ma, S., Zhang, X., Jia, C., Zhao, Z., Wang, S., & Wang, S. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2910119 · Cited by 459
“In addition, considering the limitation of the traditional bidirectional prediction using simple average of two prediction hypothesises, we further improve its efficiency by utilizing a six-layer CNN with 13×13 receptive field size to infer the inter prediction block in a nonlinear fashion [91], [92], which achieves 2.”
MethodSelf-citationBVI-DVC: A Training Database for Deep Video Compression
Ma, D., Zhang, F., & Bull, D. R. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3108943 · Cited by 163
“Image and video compression based on deep neural networks has become a popular research topic offering evident enhancements over conventional coding tools for: intra prediction [22, 23], motion estimation [24, 25], transforms [26, 27], quantisation [28], entropy coding [29, 30], post-processing [31, 32] and loop filte…”
BackgroundDeep Learning-Based Video Coding: A Review and a Case Study
Liu, D., Li, Y., Lin, J., Li, H., & Wu, F. (2021) · ACM Computing Surveys · doi:10.1145/3368405 · Cited by 192
“[148] propose a method to enhance the prediction quality.”
MethodMachine learning based video coding optimizations: A survey
Zhang, Y., Kwong, S., & Wang, S. (2019) · Information Sciences · doi:10.1016/j.ins.2019.07.096 · Cited by 88
Self-citation
Metadata
- Authors
- Zhao, Z., Wang, S., Wang, S., Zhang, X., Ma, S., & Yang, J.
- Affiliations
- Peking University (CN)
- City University of Hong Kong (HK)
- University of Southern California (US)
- Venue
- IEEE Transactions on Circuits and Systems for Video Technology
- Published
- 2019-11
- Volume
- 29
- Issue
- 11
- Pages
- 3291-3301
- ISSN
- 1051-8215 (ISSN-L)
- 1558-2205
- OpenAlex
- W2896406755
- Cited by
- 75
- References
- 48
- Citations by year
- 2025: 9 · 2024: 9 · 2023: 10 · 2022: 7 · 2021: 17 · 2020: 14 · 2019: 9
- FWCI
- 7.16
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Circuits and Systems for Video Technology (publishedVersion)
- Funders
- National Natural Science Foundation of China (61632001, 61421062, 61520106004, 61571017)
- National Basic Research Program of China (2015CB351800)
- Hong Kong RGC Early Career Scheme (9048122 (CityU 21211018))
- City University of Hong Kong (7200539/CS)
- Peking University
- Microsoft
- Topics
- Physical Sciences › Computer Science › Signal Processing › Video Coding and Compression Technologies
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Data Compression Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Keywords
- HEVC, convolutional neural networks, video compression, rate-distortion performance, motion prediction, data-driven prediction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Enhanced Bi-Prediction With Convolutional Neural Network for High-Efficiency Video Coding. https://app.cochat.ai/papers/10.1109/tcsvt.2018.2876399
- The paper
- Zhao, Z., Wang, S., Wang, S., Zhang, X., Ma, S., & Yang, J. (2019). Enhanced Bi-Prediction With Convolutional Neural Network for High-Efficiency Video Coding. IEEE Transactions on Circuits and Systems for Video Technology. https://doi.org/10.1109/tcsvt.2018.2876399
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.