The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Reducing Complexity of HEVC: A Deep Learning Approach
Open accessAbstract
High Efficiency Video Coding (HEVC) significantly reduces bit-rates over the preceding H.264 standard but at the expense of extremely high encoding complexity. In HEVC, the quad-tree partition of coding unit (CU) consumes a large proportion of the HEVC encoding complexity, due to the brute-force search for rate-distortion optimization (RDO). Therefore, this paper proposes a deep learning approach to predict the CU partition for reducing the HEVC complexity at both intra-and inter-modes, which is based on convolutional neural network (CNN) and long-and short-term memory (LSTM) network. First, we establish a large-scale database including substantial CU partition data for HEVC intra-and inter-modes. This enables deep learning on the CU partition. Second, we represent the CU partition of an entire coding tree unit (CTU) in the form of a hierarchical CU partition map (HCPM). Then, we propose an early-terminated hierarchical CNN (ETH-CNN) for learning to predict the HCPM. Consequently, the encoding complexity of intra-mode HEVC can be drastically reduced by replacing the brute-force search with ETH-CNN to decide the CU partition. Third, an early-terminated hierarchical LSTM (ETH-LSTM) is proposed to learn the temporal correlation of the CU partition. Then, we combine ETH-LSTM and ETH-CNN to predict the CU partition for reducing the HEVC complexity at inter-mode. Finally, experimental results show that our approach outperforms other state-of-the-art approaches in reducing the HEVC complexity at both intra-and inter-modes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Overview of the High Efficiency Video Coding (HEVC) Standard
Sullivan, G. J., Ohm, J.-R., Han, W.-J., & Wiegand, T. (2012) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2012.2221191 · Cited by 8,263
(2011) · Cited by 6,993
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382
Calcuation of average PSNR differences between RD-curves
Bjøntegaard, G. (2001) · Medical Entomology and Zoology · Cited by 4,573
Common test conditions and software reference configurations
Bossen, F. (2010) · Medical Entomology and Zoology · Cited by 1,731
Ohm, J.-R., Sullivan, G. J., Schwarz, H., Tan, T. K., & Wiegand, T. (2012) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2012.2221192 · Cited by 1,279
RAISE: a raw images dataset for digital image forensics
Dang-Nguyen, D.-T., Pasquini, C., Conotter, V., & Boato, G. (2015) · Proceedings of the 6th ACM Multimedia Systems Conference · doi:10.1145/2713168.2713194 · Cited by 508
Fast CU Splitting and Pruning for Suboptimal CU Partitioning in HEVC Intra Coding
Cho, S., & Kim, M. (2013) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2013.2249017 · Cited by 312
Effective CU Size Decision for HEVC Intracoding
Shen, L., Zhang, Z., & Liu, Z. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2341927 · Cited by 242
Fast Intra Mode Decision for High Efficiency Video Coding (HEVC)
Zhang, H., & Ma, Z. (2014) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2013.2290578 · Cited by 234
A Fast HEVC Inter CU Selection Method Based on Pyramid Motion Divergence
Xiong, J., Li, H., Wu, Q., & Meng, F. (2014) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2013.2291958 · Cited by 216
Performance and Computational Complexity Assessment of High-Efficiency Video Encoders
Correa, G., Assuncao, P., Agostini, L., & da Silva Cruz, L. A. (2012) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2012.2223411 · Cited by 203
Zhang, Y., Kwong, S., Wang, X., Yuan, H., Pan, Z., & Xu, L. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2417498 · Cited by 193
Fast HEVC Encoding Decisions Using Data Mining
Correa, G., Assuncao, P. A., Agostini, L. V., & da Silva Cruz, L. A. (2015) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2014.2363753 · Cited by 190
CU Partition Mode Decision for HEVC Hardwired Intra Encoder Using Convolution Neural Network
Liu, Z., Yu, X., Gao, Y., Chen, S., Ji, X., & Wang, D. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2601264 · Cited by 183
Fast coding unit size selection for HEVC based on Bayesian decision rule
Shen, X., Yu, L., & Chen, J. (2012) · 2012 Picture Coding Symposium · doi:10.1109/pcs.2012.6213252 · Cited by 174
Efficient Mode Decision Schemes for HEVC Inter Prediction
Vanne, J., Viitanen, M., & Hämäläinen, T. D. (2014) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2014.2308453 · Cited by 133
Region-of-Interest Based Conversational HEVC Coding with Hierarchical Perception Model of Face
Xu, M., Deng, X., Li, S., & Wang, Z. (2014) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2014.2314864 · Cited by 96
Self-citationAn adaptive complexity reduction scheme with fast prediction unit decision for HEVC intra encoding
Khan, M. U. K., Shafique, M., & Henkel, J. (2013) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2013.6738325 · Cited by 87
Early TU decision method for fast video encoding in high efficiency video coding
Choi, K., & Jang, E. S. (2012) · Electronics Letters · doi:10.1049/el.2012.0277 · Cited by 64
Deep learning-based intra prediction mode decision for HEVC
Laude, T., & Östermann, J. (2016) · Picture Coding Symposium · doi:10.1109/pcs.2016.7906399 · Cited by 55
Adaptive keypoint-based CU depth decision for HEVC intra coding
Kim, N.-U., Jeon, S., Shim, H. J., et al. (2016) · IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB) · doi:10.1109/bmsb.2016.7521923 · Cited by 35
Fast CU Size Decisions for HEVC Intra Frame Coding Based on Support Vector Machines
Liu, D., Liu, X., & Li, Y. (2016) · IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech) · doi:10.1109/dasc-picom-datacom-cyberscitec.2016.168 · Cited by 32
Cited by
Nano Biosensors: Properties, applications and electrochemical techniques
Huang, X., Zhu, Y., & Kianfar, E. (2021) · Journal of Materials Research and Technology · doi:10.1016/j.jmrt.2021.03.048 · Cited by 489
Image and Video Compression With Neural Networks: A Review
Ma, S., Zhang, X., Jia, C., Zhao, Z., Wang, S., & Wang, S. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2910119 · Cited by 459
Hu, J., Chen, H., Heidari, A. A., Wang, M., Zhang, X., Chen, Y., & Pan, Z. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106684 · Cited by 289
Deep Learning-Based Video Coding: A Review and a Case Study
Liu, D., Li, Y., Lin, J., Li, H., & Wu, F. (2021) · ACM Computing Surveys · doi:10.1145/3368405 · Cited by 192
Modeling of CO2 capture ability of [Bmim][BF4] ionic liquid using connectionist smart paradigms
Daryayehsalameh, B., Nabavi, M., & Vaferi, B. (2021) · Environmental Technology & Innovation · doi:10.1016/j.eti.2021.101484 · Cited by 111
Metadata
- Authors
- Xu, M., Li, T., Wang, Z., Deng, X., Yang, R., & Guan, Z.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2018-10
- Volume
- 27
- Issue
- 10
- Pages
- 5044-5059
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2761287863
- Cited by
- 325
- References
- 23
- FWCI
- 34.11
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.