Deep Learning-Based Video Coding: A Review and a Case Study

Liu, Dong, Li, Yue, Lin, Jianping, Li, Houqiang, Wu, Feng·2021·ACM Computing Surveys
DOI 10.1145/3368405

Cited by (192)

Items 101–192 of 192

  1. Special issue on Open Media Compression: Overview, Design Criteria, and Outlook on Emerging Standards
    Christian Timmerer, Mathias Wien, Lu Yu, Amy R. Reibman · 2021 · Proceedings of the IEEE
  2. Exploring Efficient Hardware Accelerator for Learning-Based Image Compression
    Chen Chen, Haoyang Zhang, Kaicheng Guo, Xingzi Yu, Weidong Qiu, Zhengwei Qi, Haibing Guan · 2024 · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
  3. SCSC: The Super Compressed Semantic Communication Transmission Method for Images and Video Frames
    Jia Guo, Bowen Sun, Jinqi Zhu, Weijia Feng, Shuqing He, Wanli Xue · 2025 · IEEE Internet of Things Journal
  4. Graph Based Cross-Channel Transform for Color Image Compression
    Lilong Wang, Yunhui Shi, Jin Wang, Shujun Chen, Baocai Yin, Nam Ling · 2023 · ACM Transactions on Multimedia Computing Communications and Applications
  5. Efficient Progressive Image Compression with Variance-Aware Masking
    Alberto Presta, Enzo Tartaglione, Attilio Fiandrotti, Marco Grangetto, Pamela C. Cosman · 2025 · IEEE Winter Conference on Applications of Computer Vision
  6. NNCD-IQA: A new neural networks based compressed database for image quality assessment
    Zohaib Amjad Khan, Tassnim Dardouri, Mounir Kaaniche, Gabriel Dauphin · 2022 · Multimedia Tools and Applications
  7. Lossless Coding of Multimodal Image Pairs Based on Image-To-Image Translation
    Joao O. Parracho, Lucas A. Thomaz, Luis M. N. Tavora, Pedro Assunção, Sérgio M. M. de Faria · 2022 · European Workshop on Visual Information Processing
  8. Learning-based Visual Compression
    Ruolei Ji, Lina J. Karam · 2023 · Foundations and Trends® in Computer Graphics and Vision
  9. Determining the invariant of inter-frame processing for constructing the image similarity metric
    Elena Gorda, Anatolii Serdiuk, Іван Назаренко · 2023 · Eastern-European Journal of Enterprise Technologies
  10. One-Click Upgrade from 2D to 3D: Sandwiched RGB-D Video Compression for Stereoscopic Teleconferencing
    Yueyu Hu, Onur G. Guleryuz, Philip A. Chou, Danhang Tang, Jonathan Taylor, Rus Maxham, Yao Wang · 2024 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
  11. Compression Artifact Removal with Ensemble Learning of Neural Networks
    Yueyu Hu, Haichuan Ma, Dong Liu, Jiaying Liu · 2020 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
  12. Efficient Low Bit-Rate Intra-Frame Coding using Common Information for 360-degree Video
    Fariha Afsana, Manoranjan Paul, Manzur Murshed, David Taubman · 2020 · IEEE International Workshop on Multimedia Signal Processing (MMSP)
  13. Towards Transparent Application of Machine Learning in Video Processing
    Luka Murn, Marc Górriz Blanch, Santamaria, Maria, Fiona M. Rivera, Marta Mrak · 2021 · arXiv (Cornell University)
  14. Human-inspired Perspectives: A Survey on AI Long-term Memory
    He, Zihong, Lin, Weizhe, Zheng, Hao, Zhang, Fan, Jones, Matt W., Aitchison, Laurence, Xu, Xuhai, Liu, Miao, Kristensson, Per Ola, Shen, Junxiao · 2024 · arXiv
  15. FRVC: frame relevance based video compression for surveillance videos using deep learning methods
    Prateek Agrawal, Nikita Mohod, Vishu Madaan, Wou Onn Choo, Khang Wen Goh · 2025 · PeerJ Computer Science
  16. FCA$^{\bf 2}$: Frame Compression-Aware Autoencoder for Modular and Fast Compressed Video Super-Resolution
    Zhaoyang Wang, Jie Li, Wen Bing Lu, Lihuo He, Maoguo Gong, Xinbo Gao · 2026 · IEEE Transactions on Multimedia
  17. A Motion-Based Compression and Tracking System for Video Camera Trap-Based Insect Behaviour Studies
    Malika Nisal Ratnayake, Lex Gallon, Adel N. Toosi, Alan Dorin · 2026 · International Journal of Computer Vision
  18. Current Frame Priors Assisted Neural Network for Intra Prediction
    Han Zhang, Li Song, Yan Huang, Rong Xie · 2021 · IEEE Access
  19. Faster Inter Prediction by NR-Frame in VVC
    Ka‐Hou Chan, Sio‐Kei Im · 2023 · International Conference on Graphics and Signal Processing (ICGSP)
  20. Reconstructing voice identity from noninvasive auditory cortex recordings
    Charly Lamothe, Etienne Thoret, Régis Trapeau, Bruno Lucio Giordano, Julien Sein, Sylvain Takerkart, Stéphane Ayache, Thierry Artières, Pascal Belin · 2026 · eLife
  21. iHELP: a model for instant learning of video coding in VR/AR real-time applications
    Yousef O. Sharrab, Mohammad A. Alsmirat, Mohammad Ali H. Eljinini, Nabil J. Sarhan · 2024 · Multimedia Tools and Applications
  22. Enhancing Versatile Video Coding Efficiency via Post-Processing of Decoded Frames Using Residual Network Integration in Deep Convolutional Neural Networks
    Murooj Khalid Ibraheem Ibraheem, Alexander Dvorkovich · 2024 · International Conference on Digital Signal Processing and its Applications (DSPA)
  23. CU Split Method Based on Adaptive CNN and Gradient Matrix for VVC 3D Video Depth Map
    Lina Si, Aohui Yan, Qiuwen Zhang · 2024 · IEEE Access
  24. Reduction of JPEG2000 Compression Artifacts using Very Deep Super Resolution Approach for Multitemporal Multispectral Images
    Ozan Kara, İbrahim Uçurmak, Ali Can Karaca, M. Kemal Güllü · 2020 · Signal Processing and Communications Applications Conference (SIU)
  25. Interpreting Super-Resolution CNNs for Sub-Pixel Motion Compensation in Video Coding
    Luka Murn, Alan F. Smeaton, Marta Mrak · 2021 · ACM International Conference on Multimedia (ACM MM)
  26. MultiTempGAN: Multitemporal multispectral image compression framework using generative adversarial networks
    Ali Can Karaca, Ozan Kara, M. Kemal Güllü · 2021 · Journal of Visual Communication and Image Representation
  27. Learning-based End-to-End Video Compression Using Predictive Coding
    Matheus C. de Oliveira, Luiz Gustavo R. Martins, Henrique Costa Jung, Nilson Donizete Guerin, Renam Castro da Silva, Eduardo Peixoto, Bruno Macchiavello, Edson M. Hung, Vanessa Testoni, Pedro Garcia Freitas · 2021 · SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI)
  28. Stabilizing the Convolution Operations for Neural Network-Based Image and Video Codecs for Machines
    Honglei Zhang, Nam Le, Francesco Cricri, Jukka Ahonen, Hamed R. Tavakoli · 2023 · IEEE International Conference on Multimedia and Expo workshops
  29. Deep Video Codec Control for Vision Models
    Christoph Reich, Biplob K. Debnath, Deep Patel, Tim Prangemeier, Daniel Cremers, Srimat Chakradhar · 2024 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
  30. Sparse MP4
    Daniel A. Wang, Charles M. S. Strauss, Jacob M. Springer, Austin Thresher, Howard Pritchard, Garrett T. Kenyon · 2020 · IEEE Southwest Symposium on Image Analysis and Interpretation (SSIAI)
  31. Judgment of Alzheemer’s Desease Based on Multi-feature Mixed Model
    Haoran Li, Zeng Wei, Dai Yunqiang, Chuan Chen, Liqi Hu, Jinping Yin · 2022 · International Conference on Pattern Recognition and Artificial Intelligence (PRAI)
  32. Standard Compliant Video Coding Using Low Complexity, Switchable Neural Wrappers
    Yueyu Hu, Chenhao Zhang, Onur G. Guleryuz, Debargha Mukherjee, Yao Wang · 2024 · Proceedings - International Conference on Image Processing
  33. CCLOP: Cross-Component Enhanced LOP Filter for Video Coding
    Yue Li, Junru Li, Chaoyi Lin, Kai Zhang, Li Zhang · 2025 · DCC
  34. Deep Learning-Based Pertinent Video Frame Detection to Compressed Surveillance Video
    Nikita Mohod, Prateek Agrawal, Vishu Madaan, Dimple Nagpal · 2025 · SN Computer Science
  35. Deep Network-Based Adaptive Quantization for Practical Video Coding
    Shuai Huo, Hewei Liu, Jiawen Gu, Dengchao Jin, Lei Meng, Bo Huang, Chao Zhou · 2025 · IEEE Transactions on Circuits and Systems for Video Technology
  36. SMD-Net: Multimodal change detection for content-adaptive semantic video transmission
    Jiaqing Xiong, Xiaohui Li, Feixiang Liu, Guanchong Niu · 2025 · Journal of Information and Intelligence
  37. HANeRV: Hierarchically Adaptive Neural Representation for Video Compression
    Lv Tang, J ZHU, Xinfeng Zhang, Li Zhang, Siwei Ma, Qingming Huang · 2026 · IEEE Transactions on Image Processing
  38. A Lightweight Model for Deep Frame Prediction in Video Coding
    Hyomin Choi, Ivan V. Bajić · 2020 · Asilomar Conference on Signals, Systems and Computers (ACSSC)
  39. Learning Source Coding for General Alphabets and Finite State Machines
    Mohammad Zaeri-Amirani, Anders Høst-Madsen · 2023 · Allerton Conference on Communication, Control, and Computing
  40. On the Robustness of Neural-Enhanced Video Streaming against Adversarial Attacks
    Qihua Zhou, Jingcai Guo, Song Guo, Ruibin Li, Jie Zhang, Bingjie Wang, Zhenda Xu · 2024 · Proceedings of the AAAI Conference on Artificial Intelligence
  41. Video Codec Using Machine Learning Image Compression Techniques
    Mikhail V. Gashnikov · 2024 · Lecture notes in networks and systems
  42. GAN-based multi-view video coding with spatio-temporal EPI reconstruction
    Chengdong Lan, Hao Yan, Cheng Xin Luo, Tiesong Zhao · 2024 · Signal Processing Image Communication
  43. Healthcare Data Encryption Based on Secure AI Model with Computational Analysis Using Machine Learning Algorithms
    K Nattar Kannan, Ramesh Sundar, M. Rammorthy, Sulaima Lebbe Abdul Haleem, R. Manikandan · 2024 · Studies in systems, decision and control
  44. Real-Time Semantic Video Communication with Temporally Consistent And Controllable Diffusion Models
    Cem Eteke, Alexander Griessel, Wolfgang Kellerer, Eckehard G. Steinbach · 2025 · Proceedings - International Conference on Image Processing
  45. Deep Video Compression using Compressed P-Frame Resampling
    Abhishek Kumar Sinha, Deepak Mishra · 2021 · National Conference on Communications
  46. An End-to-End Mutual Enhancement Network Toward Image Compression and Semantic Segmentation
    Junru Chen, Chao Yao, Meiqin Liu, Yao Zhao · 2021 · Lecture notes in computer science
  47. Video perception enhancement using effective encoding optimization in future generation wireless network
    Aruna Kumar Bananaik Thulajanaik, Naganaik Manjanaik · 2023 · Indonesian Journal of Electrical Engineering and Computer Science
  48. Improvements of Motion Estimation and Coding using Neural Networks
    Raz Birman, Yoram Segal, Ofer Hadar, Jenny Benois‐Pineau · 2020 · arXiv (Cornell University)
  49. 3D Medical Image Lossless Compressor Using Deep Learning Approaches
    Omniah H. Nagoor · 2022
  50. Reconstructing voice identity from noninvasive auditory cortex recordings
    Charly Lamothe, Etienne Thoret, Régis Trapeau, Bruno Lucio Giordano, Julien Sein, Sylvain Takerkart, Stéphane Ayache, Thierry Artières, Pascal Belin · 2024 · eLife
  51. HEVC improved performance with end-to-end super resolution
    Mohamed Abdelazim, Ahmed M. Hamza, Abdelrahman Emad Abdelazim, Djamel Ait-Boudaoud · 2021 · Digital Optical Technologies
  52. Neural Weight Step Video Compression
    Mikolaj Czerkawski, Javier Cardona, Robert C. Atkinson, Craig Michie, Ivan Andonović, Carmine Clemente, Christos Tachtatzis · 2021 · arXiv (Cornell University)
  53. Content-based coding tree unit level rate-quantization model for intra-coding in high efficiency video coding standard using convolutional neural network
    Yaser Rahimi, Mehdi Rezaei, Pouria Jafari · 2022 · Journal of Electronic Imaging
  54. Towards Neural Video Compression: A Rate Distortion Modeling Perspective
    Chuanmin Jia, Weimin Zhang, Kai Lin, Siwei Ma · 2022 · Communications in computer and information science
  55. Overview of Grand Challenge on Neural Network-based Video Coding in ISCAS 2022
    Yue Li, Li Zhang, Jizheng Xu, Kai Zhang · 2022 · Picture Coding Symposium
  56. Pre-Service Teachers’ Perceptions of Video-Based Case to Increase Higher Order Thinking Skills
    Syafril Syafril, Azrul Azrul · 2023 · Pegem Journal of Education and Instruction
  57. Adaptive Video Coding Framework with Spatial-Temporal Fusion for Optimized Streaming in Next-Generation Networks
    Pranob Kumar Charles, Habibulla Khan, K S Rao · 2023 · International Journal of Electrical and Electronics Research
  58. An investigation of machine learning-based video compression techniques
    Ye Zhu · 2024 · Applied and Computational Engineering
  59. A Fast Inter Mode Decision Approach Based on Machine Learning for Video Compressor
    Yi Xie, Zheyuan Zhang, Bin Wang, Jie Tian, Wenhuan Huang, Changliang Wang, Gang Shen, Ming Chen · 2024 · IEEE Advanced Information Technology, Electronic and Automation Control Conference (IAEAC)
  60. Author response: Reconstructing Voice Identity from Noninvasive Auditory Cortex Recordings
    Charly Lamothe, Etienne Thoret, Régis Trapeau, Bruno Lucio Giordano, Julien Sein, Sylvain Takerkart, Stéphane Ayache, Thierry Artières, Pascal Belin · 2024 · eLife
  61. Reviewer #3 (Public Review): Reconstructing Voice Identity from Noninvasive Auditory Cortex Recordings
    2024 · eLife
  62. Reviewer #2 (Public Review): Reconstructing Voice Identity from Noninvasive Auditory Cortex Recordings
    2024 · eLife
  63. Reviewer #1 (Public Review): Reconstructing Voice Identity from Noninvasive Auditory Cortex Recordings
    2024 · eLife
  64. eLife Assessment: Reconstructing Voice Identity from Noninvasive Auditory Cortex Recordings
    Andrea E. Martin · 2024 · eLife
  65. Reconstructing Voice Identity from Noninvasive Auditory Cortex Recordings
    Charly Lamothe, Etienne Thoret, Régis Trapeau, Bruno Lucio Giordano, Julien Sein, Sylvain Takerkart, Stéphane Ayache, Thierry Artières, Pascal Belin · 2024 · eLife
  66. Interpreting Contrastive Embeddings in Specific Domains with Fuzzy Rules
    Javier Fumanal-Idocin, Mohammadreza Jamalifard, Javier Andreu-Pérez · 2024 · IEEE International Conference on Fuzzy Systems (FUZZ-IEEE)
  67. Machine Learning-Driven Pre-Broadcast Video Codec Validation: Ensuring Seamless Television Transmission
    Khalid El Fayq, Said Tkatek, Lahcen Idouglid · 2024 · Indonesian Journal of Electrical Engineering and Informatics (IJEEI)
  68. A Perceptual-based Neural Video Preprocessing Hardware Solution for Video Encoding Applications
    Pierre-Alain Afro, Loïc Strus · 2025 · Mile-High Video Conference (MHV)
  69. Enhancing Energy Efficiency in GAN-based HEVC Video Compression Using Knowledge Distillation
    Hajar Hardi, Imade Fahd Eddine Fatani · 2025 · International journal of electrical and computer engineering systems
  70. A survey of learning-based end-to-end video compression
    Huanjie He, Yunhui Shi, Jin Wang, You Zuo, Nam Ling, Baocai Yin · 2025 · Research Square
  71. Intelligent Generative Design: A New Mechanical Design Concept
    Fangwei Ning, Yixuan Wang, Heran Li, Yan Shi, Jiaxing Lu · 2025 · SSRN Electronic Journal
  72. SD-VPU: Software Defined Video Processing Unit for Video Cloud
    Zongyuan Deng, Cheng Chen, Enfang Cui · 2025 · IEEE/CIC International Conference on Communications in China (ICCC)
  73. An intuitive IPT-IPA based deep learning approach for video compression techniques
    Mudhavath Ramesh Naik, Jayendra Kumar, Arvind R. Yadav · 2025 · Multimedia Tools and Applications
  74. Softmax-based Intra Luminance Prediction for H.266/VVC
    Tuo Li, Chaofei Li, Wenrui Lv, Shiqi Jiang, Hui Yuan · 2025 · International Symposium on Machine Learning and Media Computing (MLMC)
  75. GenStream: Semantic Streaming Framework for Generative Reconstruction of Human-centric Media
    Emanuele Artioli, Daniele Lorenzi, Shivi Vats, Farzad Tashtarian, Christian Timmerer · 2025 · ACM International Conference on Multimedia (ACM MM)
  76. Reconstructing Voice Identity from Noninvasive Auditory Cortex Recordings
    Charly Lamothe, Etienne Thoret, Régis Trapeau, Bruno Lucio Giordano, Julien Sein, Sylvain Takerkart, Stéphane Ayache, Thierry Artières, Pascal Belin · 2025 · eLife
  77. Recent Advances in Complexity Reduction Methods for VVC Inter Coding: A Review
    Komeil ShahHosseini, Abbas Javadtalab, M. Ghanbari, Ahmad Kalhor, Farhad Pakdaman, Moncef Gabbouj · 2025 · IEEE Access
  78. Consistent Video Compression using H.266/VVC based on Spatio-Temporal Color Gradients
    Kôtaro Oikawa, Zhe Sun, Takashi Michikawa, Shin YOSHIZAWA, Shigeho Noda, Ruggero Micheletto, Hideo Yokota · 2025 · International Symposium on Computing and Networking Workshops (CANDARW)
  79. High-Fidelity Semantic Video Communication with Controllable Image-To-Video Diffusion Models
    Cem Eteke, Alexander Griessel, Wolfgang Kellerer, Eckehard G. Steinbach · 2025 · International Symposium on Multimedia
  80. Low-rank Content Adaptation for Neural Network-based Video Coding beyond VVC
    Zhuowei Xu, Jacek Konieczny, Alexey Filippov, Christopher Hollmann, Vasily Rufitskiy, Tianyu Dong · 2025 · Picture Coding Symposium
  81. Improving video codec quality with AI-based super-resolution and directional-mode enhancement
    Alessandro Artusi, Mattia Angelini, Gabriele Spadaro, Attilio Fiandrotti, Giovanni Ballocca, Alessandra Mosca, Roberto Iacoviello, Leonardo Chiariglione · 2026 · Multimedia Tools and Applications
  82. Efficiency and Redundancy in Deep Learning Models : Theoretical Considerations and Practical Applications
    Pierre Stock · 2021
  83. Adaptive streaming using Peer-to-Peer and HTTP
    Hiba Yousef · 2021
  84. Machine learning based optimization for VVC low bitrate coding
    Fatemeh Nasiri · 2022
  85. Du signal vocal à la réponse neuronale : Modélisation computationnelle et perspective évolutive sur le traitement de la voix dans le cortex auditif
    Charly Lamothe · 2023
  86. Fusion of Transformer and CNN Attention Networks for Learned Image Compression
    Jianhua Hu, Jianding Guo, Xiaoyu Zhang, K L Eddie Law · 2026 · IEEE International Conference on Acoustics Speech and Signal Processing
  87. N-JSCC: A neighborhood-based joint source channel coding scheme for wireless image transmission
    Tao Tian, Yihao Chen, Qian Cao, Zhou Fang, Liangfen Wei · 2026 · Physical Communication
  88. RTINet: A learned in-loop filter in VVC using interaction of ResNet and Transformer
    Cheolkon Jung, Penghao Fu, Jiang Han, Lu Liu · 2026 · Signal Processing Image Communication
  89. DAM-SC: Text-Driven Semantic Communication for Ultra-Low Bitrate Video Transmission Using Dynamic Attribute Models
    Longfei Zhou, Xiaohui Li, Feixiang Liu, Guanchong Niu · 2026 · IEEE Wireless Communications and Networking Conference
  90. Blind Quality Enhancement of Compressed Video via Fine-Grained Degradation-Guided Sequential Inference
    Li Yu, Yuanzhang Zhao, Shiyu Wu, Siyue Yu, Moncef Gabbouj, Qingshan Liu · 2026 · IEEE Transactions on Circuits and Systems for Video Technology
  91. Relevancy-Guided Adaptive Decoupling for Multi-Module Joint Optimization in Perceptual Video Coding
    Yushen Shi, Haibing Yin, Yiyan Xie, Xia Wang, Hongkui Wang, Xiaofeng Huang · 2026 · IEEE Transactions on Broadcasting
  92. Adaptive Deep Video Frame Interpolation for Robust Laparoscopic Visualization: A Comparative Evaluation
    Shujaat Ali Zaidi, Ali Turab, Chailert Phongnarisorn · 2026 · International Journal of Imaging Systems and Technology