The DOI matches its Crossref record; 145 of the 145 references it cites were found in a registry or an index.
Video Coding for Machines: A Paradigm of Collaborative Compression and Intelligent Analytics
Open accessAbstract
Video coding, which targets to compress and reconstruct the whole frame, and feature compression, which only preserves and transmits the most critical information, stand at two ends of the scale. That is, one is with compactness and efficiency to serve for machine vision, and the other is with full fidelity, bowing to human perception. The recent endeavors in imminent trends of video compression, e.g. deep learning based coding tools and end-to-end image/video coding, and MPEG-7 compact feature descriptor standards, i.e. Compact Descriptors for Visual Search and Compact Descriptors for Video Analysis, promote the sustainable and fast development in their own directions, respectively. In this paper, thanks to booming AI technology, e.g. prediction and generation models, we carry out exploration in the new area, Video Coding for Machines (VCM), arising from the emerging MPEG standardization efforts1. Towards collaborative compression and intelligent analytics, VCM attempts to bridge the gap between feature coding for machine vision and video coding for human vision. Aligning with the rising Analyze then Compress instance Digital Retina, the definition, formulation, and paradigm of VCM are given first. Meanwhile, we systematically review state-of-the-art techniques in video compression and feature compression from the unique perspective of MPEG standardization, which provides the academic and industrial evidence to realize the collaborative compression of video and feature streams in a broad range of AI applications. Finally, we come up with potential VCM solutions, and the preliminary results have demonstrated the performance and efficiency gains. Further direction is discussed as well.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Flagged first, then by citations
Research works printed but not linked: 3
- xu, 2017, Review of development of visual neural computing, Comput Eng Appl, 1, 1
- pavlov, 2020, Lempel Ziv Markov chain algorithm
- 10.24963/ijcai.2019/871 · DOI · Paper page
Cited by
Sorted by citations
Items 201–260 of 260
Layered and scalable image coding with semantic features for human and machine
Jiao, W., An, P., Wang, S., Huang, K., Yang, C., & Huang, X. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110982 · Cited by 1
AdaJSCC: Instance-Adaptive Joint Source-Channel Coding for Wireless Image Transmission
Dang, T., Yao, S., Wang, S., Niu, K., Liu, Z., & Dai, J. (2024) · IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/gcwkshp64532.2024.11100771 · Cited by 1
An End-to-End Mutual Enhancement Network Toward Image Compression and Semantic Segmentation
Chen, J., Yao, C., Liu, M., & Zhao, Y. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-88007-1_51 · Cited by 1
Latent-Space Inpainting for Packet Loss Concealment in Collaborative Object DetectionPreprint
Bajić, I. V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.00142 · Cited by 1
Analysis of Latent-Space Motion for Collaborative IntelligencePreprint
Ulhaq, M., & Bajić, I. V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.04018 · Cited by 1
2020 Index IEEE Transactions on Image Processing Vol. 29
(2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3046056
Revisit Visual Representation in Analytics Taxonomy: A Compression PerspectivePreprint
Hu, Y., Yang, W., Huang, H., & Liu, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.08512
Self-citationHuman-Machine Collaborative Video Coding Through Cuboidal PartitioningPreprint
Ahmmed, A., Paul, M., Murshed, M., & Taubman, D. (2021) · doi:10.31224/osf.io/v7y2r
Learned image compression via multiscale prior for machine recognition
Shi, Y., Shen, L., & Wang, Q. (2023) · Journal of Electronic Imaging · doi:10.1117/1.jei.32.1.013003
Small Object-Aware Video Coding for Machines via Feature-Motion Synergy
Xu, Q., Xi, B., Xu, H., Huang, Y., Li, Y., & Chanussot, J. (2023) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2023.3345666 · Cited by 1
End to End Scalable Image Coding for Machines
Wu, Z., Wang, H., Wang, H., & Zhang, Y. (2023) · International Conference on Intelligent Communications and Computing (ICICC) · doi:10.1109/icc59986.2023.10421674
Side Information Design in Zero-Error Coding for Computing
Charpenay, N., Treust, M. L., & Roumy, A. (2024) · Entropy · doi:10.3390/e26040338
Compact Visual Data Representation for Multimedia Search and Analytics
Wang, S., & Zhang, X. (2024) · International Conference on Multimedia Retrieval · doi:10.1145/3652583.3658597
End-to-End Image Compression Through Machine Semantics
Liu, J., Chang, Z., & Ji, W. (2024) · Communications in computer and information science · doi:10.1007/978-981-97-3626-3_12
Self-citationPrivacy-preserving with Flexible Autoencoder for Video Coding for Machines
Gou, A., Sun, H., Zeng, X., & Fan, Y. (2024) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas58744.2024.10558330
Decoder-ROI based Versatile Video Coding for Multi-Object Tracking Vision Task
Bui, H. T., Minh, D. N., & Hoang, X. V. (2024) · REV Journal on Electronics and Communications · doi:10.21553/rev-jec.371
IN-Loop Filter for Object Mask Coding in Versatile Video Coding
Schwarz, S., Hannuksela, M. M., & Sansli, D. B. (2024) · Proceedings - International Conference on Image Processing · doi:10.1109/icip51287.2024.10647608
Balancing the encoder and decoder complexity in image compression for classification
Duan, Z., Hossain, M. A. F., He, J., & Zhu, F. M. (2024) · EURASIP Journal on Image and Video Processing · doi:10.1186/s13640-024-00652-1 · Cited by 1
Compact Visual Data Representation for Green Multimedia–A Human Visual System Perspective
Chen, P., Fang, X., Wang, M., Wang, S., & Ma, S. (2024) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2024.3524260
Frequency-Aware Hierarchical Image Compression for Humans and Machines
Luo, Y., Zhang, Z., Kuang, J., & Yu, L. C. (2024) · IEEE International Conference on Visual Communications and Image Processing (VCIP) · doi:10.1109/vcip63160.2024.10849897
Parashar, J., Upreti, K., Fatima, I., Gangwar, D., Saini, A. K., & Vats, P. (2025) · Smart innovation, systems and technologies · doi:10.1007/978-981-97-5200-3_23
Design of a Bitstream Structure for streaming of Video Coding for Machines
Park, K., Lee, J., Jeong, S., & Kim, K. (2025) · Journal of Broadcast Engineering · doi:10.5909/jbe.2025.30.3.320
Zhao, J., Ye, M., & Li, D. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3578964
He, K., Fu, C. M., Gao, G., & Zhou, J. (2025) · Proceedings - International Conference on Image Processing · doi:10.1109/icip55913.2025.11084584
Low-Rank Adaptation of Pre-Trained Vision Backbones for Energy-Efficient Image Coding For Machines
Zhang, Y., Duan, Z., Huang, Y., & Zhu, F. M. (2025) · Proceedings - International Conference on Image Processing · doi:10.1109/icip55913.2025.11084353
Human and Machine Perception Oriented Image and Video Coding
Gao, W. (2025) · Springer eBooks · doi:10.1007/978-981-96-7714-6_7
Self-citationDual-Region Preprocessing for Machine-Friendly JPEG Compression
Li, B., & Rhee, C. E. (2025) · International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC) · doi:10.1109/itc-cscc66376.2025.11137672
Tracking-Based Adaptive Temporal Resampling for Video Coding for Machines
An, E., Kim, M., Seo, K., Kwak, S., Kim, A., Jung, S., & Choo, H. (2025) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss65446.2025.11149979
Economic implications of air quality monitoring: a video analysis approach
Hang, Z., Yao, S., & Sun, X. (2025) · Frontiers in Environmental Science · doi:10.3389/fenvs.2025.1587566
Deep Learning-Driven Animation: Enhancing Real-Time Character Motion Synthesis
Li, Q., Sun, T., & Zhang, M. (2025) · IEEE Access · doi:10.1109/access.2025.3623285 · Cited by 1
Representation Disentanglement for Semantic Coding
Liu, J., Geng, J., Lv, L., Zeng, W., & Jin, X. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11209144
Self-citationGelSight dual-modal tactile data compression for machines
Zeng, Y., Lan, C., & Xu, Y. (2025) · Digital Signal Processing · doi:10.1016/j.dsp.2025.105696
Learned Pre-filter and Post-filter Network for VCM
Kwak, S., Jeong, S., Ko, J. H., Jung, S.-H., & Choo, H. (2025) · Journal of Broadcast Engineering · doi:10.5909/jbe.2025.30.6.942
Spatiotemporal video of blood-brain barrier disruption in neuroinflammatory disorders
Xu, Y., Zhang, Z., & Feng, K. (2026) · Frontiers in Physiology · doi:10.3389/fphys.2025.1633126
Text-guided diffusion-based restoration of extremely compressed backgrounds for VCM
Dao, L. T. H., Yang, N., Lee, J., Jeong, S., & Lee, C. (2026) · ICT Express · doi:10.1016/j.icte.2026.01.011
Lightweight Techniques for Multi-Source and Multi-Modal Video Fusion
Wang, X., & Wu, Z. (2025) · International Conference on Computer, Vision and Intelligent Technology (ICCVIT) · doi:10.1109/iccvit67848.2025.11391447
Enhancing Rail Transit Safety: Edge Computing‐Based Driver State Monitoring System
Liu, Y., Cheng, G., Yuan, B., Sun, H., Stewart, E. J. C., Fu, Z., Ma, Z., & Zhao, N. B. (2026) · IET Intelligent Transport Systems · doi:10.1049/itr2.70174
Towards Generalized Image Coding for Machine Through Meta Adversarial Adaptation
Xuelin, S., Yin, K., & Yang, W. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-026-02730-5
Self-citationStereo Image Coding for Machines With Joint Visual Feature Compression
Jin, D., Lei, J., Peng, B., Pan, Z., Zhao, B., Ling, N., & Huang, Q. (2026) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2026.3671761
Machine Inference Aware Video Compression with Adaptive Resolution ControlPreprint
Kim, A., An, E., Jung, S., Choo, H., Kim, M., & Seo, K.-D. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6418889
ProGVC: Progressive-Based Generative Video Compression via Auto-Regressive Context Modeling
Li, D., Dong, R., Li, K., Chen, Y., Ding, D., & Li, L. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-36846-1_20 · Cited by 5
Not All Split Points Are Created Equal
Merlos, J., Perera, A., Adzic, V., & Kalva, H. (2026) · International Conference on Consumer Electronics · doi:10.1109/icce67443.2026.11449818
Exploration of Lossy Image Coding Trade-off between Rate, Machine Perception and Quality
Marie, A. (2023) · theses.fr (ABES) · doi:10.70675/1303cd1eze77az4057zadb2z2b818272ba1a
Abdulridha, R. A., Siddeq, M. M., & Ahmed, M. A. (2026) · International Conference on Computing and Emerging Sciences · doi:10.1145/3797491.3797526
Rate-Distortion Optimization in Video Coding for Machines: A License Plate Recognition Perspective
Ai, D., Liu, T., Han, C., & Wang, D. (2026) · IEEE Signal Processing Letters · doi:10.1109/lsp.2026.3687796
Halder, S., Sarkar, S., & Goel, K. (2026) · Research Square · doi:10.21203/rs.3.rs-9552341/v1
YOLO-based semantic adaptive steganography driven by a locally active memristor hyperchaotic system
Huang, L., & Li, J. (2026) · Chaos Solitons & Fractals · doi:10.1016/j.chaos.2026.118663
Zhang, W., Shang, X., Wang, M. Y., Zhao, X., & Wang, G. (2026) · Research Square · doi:10.21203/rs.3.rs-9671400/v1
Dual-contextual scalable video coding for human–machine collaborative intelligence
Cui, T., Wang, Y., Fang, Z., & Fang, Y. (2026) · Displays · doi:10.1016/j.displa.2026.103638
Multimodal prompt-based image quality assessment for object detection
Chen, Y., Song, Y., Bai, X., & Guo, J. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.134622
Token-Wise Attention-Guided Semantic Quality Assessment for Compressed Visual Features
柯施恩, Gao, C., Amirpour, H., Wang, Z., & Sun, X. (2026) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex69967.2026.11618326
UVG-VCM: Benchmarking Dataset for Machine-Oriented Visual Data Compression
Partanen, T., Anttila, M., Kortelahti, R., Gautier, G., Mercat, A., & Vanne, J. (2026) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex69967.2026.11618360
Task-oriented quality assessment for machine perception: A review and perspectives
Tan, S., Zhu, L., Li, R., Chen, P., Wang, S., Ma, S., & Ma, H. (2026) · Displays · doi:10.1016/j.displa.2026.103645
3D Semantic Gaussian Compression for Occupancy Prediction
Chiu, Y.-C., & Chiang, J. (2026) · Proceedings - International Conference on Image Processing · doi:10.1109/icip61757.2026.11630091
Nami, S., Pakdaman, F., & Gabbouj, M. (2026) · Proceedings - International Conference on Image Processing · doi:10.1109/icip61757.2026.11630143
Park, U., Jeong, S., Kim, S., Lee, J., Park, G.-M., & Ko, J. H. (2026) · Electronics · doi:10.3390/electronics15173807
StreamDuet: Bandwidth Efficient Multi-Drone Video Analytics with Iterative Streaming
Zhang, H., Wang, W., Dai, H., Zhou, R., Mi, L., Zhou, M., & Chen, G. (2026) · International Workshop on Quality of Service · doi:10.1109/iwqos70441.2026.11661160
PART: Priority-Aware Resource-Constrained Patch Transmission for Task-Oriented Communication
Kim, S., & Park, H. (2026) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-3-032-38477-5_2
A Zero-Copy VPU-assisted Edge–Cloud Computing Framework for bandwidth-efficient video analytics
da Gao, Dai, G., Wang, L., & Zheng, C. (2026) · Future Generation Computer Systems · doi:10.1016/j.future.2026.108891
Metadata
- Authors
- Duan, L., Liu, J., Yang, W., Huang, T., & Gao, W.
- Affiliations
- Peking University (CN)
- Venue
- IEEE Transactions on Image Processing
- Published
- 2020
- Volume
- 29
- Pages
- 8680-8695
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W3082548248
- Cited by
- 260
- References
- 144
- Citations by year
- 2026: 25 · 2025: 43 · 2024: 59 · 2023: 51 · 2022: 38 · 2021: 37 · 2020: 7
- FWCI
- 18.00
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Image Processing (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Signal Processing › Video Coding and Compression Technologies
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Data Compression Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Analysis and Summarization
- Keywords
- video coding for machines, feature compression, MPEG standardization, video compression, intelligent analytics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
