The DOI matches its Crossref record; 52 of the 55 references it cites were found in a registry or an index.
Visual saliency guided perceptual adaptive quantization based on HEVC intra-coding for planetary images
Open accessAbstract
Due to the limited storage space of spacecraft and downlink bandwidth in the data delivery during planetary exploration, an efficient way for image compression onboard is essential to reduce the volume of acquired data. Applicable for planetary images, this study proposes a perceptual adaptive quantization technique based on Convolutional Neural Network (CNN) and High Efficiency Video Coding (HEVC). This technique is used for bitrate reduction while maintaining the subjective visual quality. The proposed algorithm adaptively determines the Coding Tree Unit (CTU) level Quantization Parameter (QP) values in HEVC intra-coding using the high-level features extracted by CNN. A modified model based on the residual network is exploited to extract the saliency map for a given image automatically. Furthermore, based on the saliency map, a CTU level QP adjustment technique combining global saliency contrast and local saliency perception is exploited to realize a flexible and adaptive bit allocation. Several quantitative performance metrics that efficiently correlate with human perception are used for evaluating image quality. The experimental results reveal that the proposed algorithm achieves better visual quality along with a maximum of 7.17% reduction in the bitrate as compared to the standard HEVC coding.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Objects on the surface of Mars exhibit unstructured characteristics with rich textures, ambiguous boundaries and diverse sizes, such as rocks and gravel [21].”
From SegMarsViT: Lightweight Mars Terrain Segmentation Network for Autonomous Driving in Planetary Exploration (2022) · cites this paper as [21]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
Aggregated Residual Transformations for Deep Neural Networks
Xie, S., Girshick, R., Dollar, P., Tu, Z., & He, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.634 · Cited by 12,465
Learning Deep Features for Discriminative Localization
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.319 · Cited by 11,428
A model of saliency-based visual attention for rapid scene analysis
Itti, L., Christof Koch, A., & Niebur, E. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.730558 · Cited by 11,289
Howard, A., Sandler, M., Chen, B., Wang, W., Chen, L.-C., Tan, M., Chu, G., Vasudevan, V., Zhu, Y., Pang, R., et al. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00140 · Cited by 9,708
Neural Mechanisms of Selective Visual Attention
Desimone, R., & Duncan, J. (1995) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.18.030195.001205 · Cited by 8,388
ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design
Ma, N., Zhang, X., Zheng, H.-T., & Sun, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01264-9_8 · Cited by 7,356 · cited 1×
“Furthermore, considering that typical onboard remote sensing systems have limited storage and compute capacity, we compare the proposed model with another 4 state-of-the-art lightweight CNN architectures including ShuffleNet_v2 [48], MobileNet_v3 [49], EfficientNet_b0 [50] and GhostNet [51].”
MethodMultiscale structural similarity for image quality assessment
Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2004) · The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003 · doi:10.1109/acssc.2003.1292216 · Cited by 6,253 · cited 4×
“The evaluation is performed by keeping the same values of initial QP for all the images and calculating the mean PSNR, PSNR-HVS, PSNR-HVS-M, SSIM, MS-SSIM, and VIFP.”
MethodInfluentialGhostNet: More Features From Cheap Operations
Han, K., Wang, Y., Tian, Q., Guo, J., Xu, C., & Xu, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00165 · Cited by 5,222
Frequency-tuned salient region detection
Achanta, R., Hemami, S. S., Estrada, F., & Susstrunk, S. E. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206596 · Cited by 4,437
Image information and visual quality
Sheikh, H. R., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859378 · Cited by 4,104
Harel, J., Koch, C., & Perona, P. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0073 · Cited by 3,517
Res2Net: A New Multi-Scale Backbone Architecture
Gao, S., Cheng, M., Zhao, K., Zhang, X., Yang, M., & Torr, P. H. S. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2938758 · Cited by 3,483
Li, X., Wang, W., Hu, X., & Yang, J. J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00060 · Cited by 3,472
Saliency Detection: A Spectral Residual Approach
Hou, X., & Zhang, L. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383267 · Cited by 3,453
Book Review: JPEG2000: Image Compression Fundamentals, Standards and Practice
Rabbani, M. (2002) · Journal of Electronic Imaging · doi:10.1117/1.1469618 · Cited by 3,159
Global contrast based salient region detection
Cheng, M., Zhang, G., Mitra, N. J., Huang, X., & Hu, S. (2011) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2011.5995344 · Cited by 3,084
The JPEG still picture compression standard
Wallace, G. K. (1992) · IEEE Transactions on Consumer Electronics · doi:10.1109/30.125072 · Cited by 2,875
Global Contrast Based Salient Region Detection
Cheng, M., Mitra, N. J., Huang, X., Torr, P. H. S., & Hu, S. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2345401 · Cited by 2,492
ResNeSt: Split-Attention Networks
Zhang, H., Wu, C., Zhang, Z., Zhu, Y., Lin, H., Zhang, Z., Sun, Y., He, T., Mueller, J. W., Manmatha, R., et al. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00309 · Cited by 2,119
Structure-Measure: A New Way to Evaluate Foreground Maps
Fan, D.-P., Cheng, M.-M., Liu, Y., Li, T., & Borji, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.487 · Cited by 2,092
Enhanced-alignment Measure for Binary Foreground Map Evaluation
Fan, D.-P., Gong, C., Cao, Y. H., Ren, B., Cheng, M., & Borji, A. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/97 · Cited by 1,690
The LOCO-I lossless image compression algorithm: principles and standardization into JPEG-LS
Weinberger, M. J., Seroussi, G., & Sapiro, G. (2000) · IEEE Transactions on Image Processing · doi:10.1109/83.855427 · Cited by 1,637
Context-Aware Saliency Detection
Goferman, S., Zelnik‐Manor, L., & Tal, A. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.272 · Cited by 1,631
Visual attention detection in video sequences using spatiotemporal cues
Zhai, Y., & Shah, M. A. (2006) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1180639.1180824 · Cited by 973
Salient Region Detection and Segmentation
Achanta, R., Estrada, F., Wils, P., & Susstrunk, S. E. (2008) · Springer eBooks · doi:10.1007/978-3-540-79547-6_7 · Cited by 879
Handbook of Image and Video Processing
Wells, P. N. T. (2001) · Physiological Measurement · doi:10.1088/0967-3334/22/1/702 · Cited by 835
Context-aware saliency detection
Goferman, S., Zelnik‐Manor, L., & Tal, A. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5539929 · Cited by 753
ON BETWEEN-COEFFICIENT CONTRAST MASKING OF DCT BASIS FUNCTIONS
Ponomarenko, N. N., Silvestri, F., Egiazarian, K., Carli, M., Astola, J. T., & Лукин, В. В. (2007) · Cited by 364
Salient Objects in Clutter: Bringing Salient Object Detection to the Foreground
Fan, D.-P., Cheng, M., Liu, J., Gao, S., Hou, Q., & Borji, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01267-0_12 · Cited by 351
Ji, Y., Zhang, H., Zhang, Z., & Liu, M. (2020) · Information Sciences · doi:10.1016/j.ins.2020.09.003 · Cited by 268
A NEW FULL-REFERENCE QUALITY METRICS BASED ON HVS
Egiazarian, K., Astola, J. T., Ponomarenko, N. N., Лукин, Battisti, F., & Carli, M. (2006) · Cited by 253
Salient Region Detection via Integrating Diffusion-Based Compactness and Local Contrast
Zhou, L. J., Yang, Z., Yuan, Q., Zhou, Z., & Hu, D. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2438546 · Cited by 129
Self-citationAdvances in Video Compression System Using Deep Neural Network: A Review and Case Studies
Ding, D., Ma, Z., Chen, D., Chen, Q., Liu, Z. S.-J., & Zhu, F. M. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3059994 · Cited by 104
A brief survey of visual saliency detection
Ullah, I., Jian, M., Hussain, S., Guo, J., Yu, H. L., Wang, X., & Yin, Y. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-08849-y · Cited by 101
Reduced-Complexity End-to-End Variational Autoencoder for on Board Satellite Image Compression
de Oliveira, V. A., Chabert, M., Oberlin, T., Poulliat, C., Bruno, M., Latry, C., Carlavan, M., Henrot, S., Falzon, F., & Camarero, R. (2021) · Remote Sensing · doi:10.3390/rs13030447 · Cited by 62
Spatiotemporal visual saliency guided perceptual high efficiency video coding with neural network
Zhu, S., & Xu, Z. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.08.054 · Cited by 49
Academic Press Library in Signal Processing
(2014) · Academic press library in signal processing · doi:10.1016/b978-0-12-420149-1.00015-6 · Cited by 46
Lemmetti, A., Viitanen, M., Mercat, A., & Vanne, J. (2020) · ACM Multimedia Systems Conference (MMSys) · doi:10.1145/3339825.3394927 · Cited by 39
CNN Based Detectors on Planetary Environments: A Performance Evaluation
Furlán, F., Rubio-Espino, E., Sossa, H., & Ponce-Ponce, V. H. (2020) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2020.590371 · Cited by 36
Content-aware rate control scheme for HEVC based on static and dynamic saliency detection
Sun, X., Yang, X., Wang, S., & Liu, M. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.06.003 · Cited by 30
Li, L., Zhou, G., Fiethe, B., Michalik, H., & Osterloh, B. (2013) · Journal of Applied Remote Sensing · doi:10.1117/1.jrs.7.074595 · Cited by 14
Performance Comparison of Saliency Detection
Li, N., Bi, H., Zhang, Z., Kong, X., & Lu, D. (2018) · Advances in Multimedia · doi:10.1155/2018/9497083 · Cited by 14
Kerner, H., Bell, J. F., III, & Amor, H. B. (2018) · Computers & Geosciences · doi:10.1016/j.cageo.2018.06.001 · Cited by 12
Bit Allocation based on Visual Saliency in HEVC
Ku, C., Xiang, G., Feng, Q., Yan, W., Li, Y., & Xie, X. (2019) · IEEE International Conference on Visual Communications and Image Processing (VCIP) · doi:10.1109/vcip47243.2019.8965753 · Cited by 12
Image compression using adaptive sparse representations over trained dictionaries
Akbari, A., Trocan, M., & Granado, B. (2016) · IEEE International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp.2016.7813346 · Cited by 11
Improving Video Compression with Deep Visual-attention Models
Lyudvichenko, V., Ерофеев, М., Ploshkin, A., & Vatolin, D. S. (2019) · International Conference on Intelligent Medicine and Image Processing (IMIP) · doi:10.1145/3332340.3332358 · Cited by 10
Saliency-driven rate-distortion optimization for 360-degree image coding
Chiang, J., Yang, C., Dedhia, B., & Char, Y.-F. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-10050-0 · Cited by 6
Semantic Learning for Image Compression (SLIC)
Mahalingaiah, K., Sharma, H. V., Kaplish, P., & Cheng, I. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-54407-2_5 · Cited by 3
Design of Image Compression Storage System and Key Algorithm for Mars Rover
Yong, X., Yang, J. X., Guo, J., Zhao, L., Jianbing, Z., Wang, C., Fan, Y., & Tong, L. (2020) · 深空探测学报(中英文） · doi:10.15982/j.issn.2096-9287.2020.20200035 · Cited by 1
Research works printed but not linked: 3
- N. Moayeri, 1998, A low-complexity, fixed-rate compression scheme for color images and documents, The Hewlett-Packard Journal, 50, 46
- M. Rabbani, 2002, JPEG2000: Image compression fundamentals, standards and practice, JEI, 11, 286
- Tan M, Le Q. Efficientnet: Rethinking model scaling for convolutional neural networks. International Conference on Machine Learning: PMLR; 2019. p. 6105–14.
Cited by
Sorted by citations
Dai, Y., Zheng, T., Xue, C., & Zhou, L. (2022) · Remote Sensing · doi:10.3390/rs14246297 · Cited by 35
Self-citationDSFNet: Video Salient Object Detection Using a Novel Lightweight Deformable Separable Fusion Network
Singh, H., Verma, M., & Cheruku, R. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3470045 · Cited by 13
DMFNet: geometric multi-scale pixel-level contrastive learning for video salient object detection
Singh, H., Verma, M., & Cheruku, R. (2025) · International Journal of Multimedia Information Retrieval · doi:10.1007/s13735-025-00361-z · Cited by 8
Energy-Efficient Saliency-Guided Video Coding Framework for Real-Time Applications
Partanen, T., Hoang, M., Mercat, A., Sainio, J., & Vanne, J. (2025) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2024.3525339 · Cited by 6
Moroto, Y., Maeda, K., Ogawa, T., & Haseyama, M. (2022) · Proceedings - International Conference on Image Processing · doi:10.1109/icip46576.2022.9897473 · Cited by 1
Metadata
- Authors
- Dai, Y., Xue, C., & Zhou, L.
- Affiliations
- Chinese Academy of Sciences (CN)
- Corresponding author
- Dai, Yuqi
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2022-02-09
- Volume
- 17
- Issue
- 2
- Pages
- e0263729
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC8827453
- OpenAlex
- W4210855954
- Cited by
- 6
- References
- 55
- Citations by year
- 2025: 2 · 2024: 2 · 2022: 2
- FWCI
- 0.49
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Data Compression Techniques
- Physical Sciences › Computer Science › Signal Processing › Video Coding and Compression Technologies
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Keywords
- visual saliency, planetary images, onboard image compression, quantization parameter adjustment, coding tree unit, saliency maps, ResNet, adaptive bit allocation, bit rate reduction, subjective image quality, spacecraft data storage
- MeSH terms
- Algorithms, Humans, Video Recording, Visual Perception, Planets, Neural Networks, Computer, Spacecraft, Data Compression, Limit of Detection, Satellite Imagery
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
