Cited by 6Advanced Data Compression TechniquesVideo Coding and Compression TechnologiesImage and Video Quality Assessment

The DOI matches its Crossref record; 52 of the 55 references it cites were found in a registry or an index.

Visual saliency guided perceptual adaptive quantization based on HEVC intra-coding for planetary images

Open access
Dai, Yuqi, Xue, Changbin, Zhou, Li·2022·PLOS ONE

Abstract

Due to the limited storage space of spacecraft and downlink bandwidth in the data delivery during planetary exploration, an efficient way for image compression onboard is essential to reduce the volume of acquired data. Applicable for planetary images, this study proposes a perceptual adaptive quantization technique based on Convolutional Neural Network (CNN) and High Efficiency Video Coding (HEVC). This technique is used for bitrate reduction while maintaining the subjective visual quality. The proposed algorithm adaptively determines the Coding Tree Unit (CTU) level Quantization Parameter (QP) values in HEVC intra-coding using the high-level features extracted by CNN. A modified model based on the residual network is exploited to extract the saliency map for a given image automatically. Furthermore, based on the saliency map, a CTU level QP adjustment technique combining global saliency contrast and local saliency perception is exploited to realize a flexible and adaptive bit allocation. Several quantitative performance metrics that efficiently correlate with human perception are used for evaluating image quality. The experimental results reveal that the proposed algorithm achieves better visual quality along with a maximum of 7.17% reduction in the bitrate as compared to the standard HEVC coding.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pone.0263729

Cites

52 of 53 references verified1 citation errors · 0 not checkable

Statistics

Figures

Fig 1 Flowchart of the proposed system. Onboard image compression comprises three stages: saliency detection by CNN generating a pixel-wise saliency map, CTU-level adaptive QP adjustment, and HEVC intra-coding.
Fig 1 Flowchart of the proposed system. Onboard image compression comprises three stages: saliency detection by CNN generating a pixel-wise saliency map, CTU-level adaptive QP adjustment, and HEVC intra-coding.CC BY · PubMed Central
Fig 2 Rate-distortion performance of HEVC, JPEG, JPEG2000, WebP, VP9, and AVC codec over Kodak dataset. Kodak datasets consist of 25 lossless, true color (24 bits per pixel) PNG images of 768 × 512 pixels.
Fig 2 Rate-distortion performance of HEVC, JPEG, JPEG2000, WebP, VP9, and AVC codec over Kodak dataset. Kodak datasets consist of 25 lossless, true color (24 bits per pixel) PNG images of 768 × 512 pixels.CC BY · PubMed Central
Fig 3 Two types of building blocks in ResNet50: (a) convolutional block; (b) identity block.
Fig 3 Two types of building blocks in ResNet50: (a) convolutional block; (b) identity block.CC BY · PubMed Central
Fig 4 The architecture of deep convolutional layers in ResNet50.
Fig 4 The architecture of deep convolutional layers in ResNet50.CC BY · PubMed Central
Fig 5 Architecture of proposed neural network for salient region detection.
Fig 5 Architecture of proposed neural network for salient region detection.CC BY · PubMed Central
Fig 6 QP distribution map.
Fig 6 QP distribution map.CC BY · PubMed Central
Fig 7 Examples of saliency maps over the test images: Original images and corresponding saliency map masks.
Fig 7 Examples of saliency maps over the test images: Original images and corresponding saliency map masks.CC BY · PubMed Central
Fig 8 Performance comparison with eight classic bottom-up saliency methods.
Fig 8 Performance comparison with eight classic bottom-up saliency methods.CC BY · PubMed Central
Fig 9 Performance comparison of the proposed method with the latest state-of-the-art methods. (left to right: original image, Ground Truth, ResNet, SKNet, ResNeXt, Res2Net, ResNeSt, ShuffleNet_v2, MobileNet_v3, EfficientNet_b0, and GhostNet).
Fig 9 Performance comparison of the proposed method with the latest state-of-the-art methods. (left to right: original image, Ground Truth, ResNet, SKNet, ResNeXt, Res2Net, ResNeSt, ShuffleNet_v2, MobileNet_v3, EfficientNet_b0, and GhostNet).CC BY · PubMed Central
Fig 10 RD curves for the proposed algorithm and the standard HEVC codec for 50 images of the planet Mars under different initial QPs: (a)PSNR (b)PSNR-HVS (c)PSNR-HVS-M (d)SSIM (e)MS-SSIM (f)VIFP.
Fig 10 RD curves for the proposed algorithm and the standard HEVC codec for 50 images of the planet Mars under different initial QPs: (a)PSNR (b)PSNR-HVS (c)PSNR-HVS-M (d)SSIM (e)MS-SSIM (f)VIFP.CC BY · PubMed Central
Fig 11 Subjective quality comparison between the standard HEVC codec and the proposed adaptive quantization algorithm at different QP setting. Details are magnified by bilinear interpolation for comparison.
Fig 11 Subjective quality comparison between the standard HEVC codec and the proposed adaptive quantization algorithm at different QP setting. Details are magnified by bilinear interpolation for comparison.CC BY · PubMed Central
Fig 12 The figure displays qualitative results comparison at three groups of images when QP is set to 41. For ease of comparison, details are magnified by bilinear interpolation.
Fig 12 The figure displays qualitative results comparison at three groups of images when QP is set to 41. For ease of comparison, details are magnified by bilinear interpolation.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 55 references

Research works printed but not linked: 3

  1. N. Moayeri, 1998, A low-complexity, fixed-rate compression scheme for color images and documents, The Hewlett-Packard Journal, 50, 46
  2. M. Rabbani, 2002, JPEG2000: Image compression fundamentals, standards and practice, JEI, 11, 286
  3. Tan M, Le Q. Efficientnet: Rethinking model scaling for convolutional neural networks. International Conference on Machine Learning: PMLR; 2019. p. 6105–14.

Cited by

Sorted by citations

Metadata

Authors
Dai, Y., Xue, C., & Zhou, L.
Affiliations
Chinese Academy of Sciences (CN)
Corresponding author
Dai, Yuqi
Venue
PLOS ONE
Published
2022-02-09
Volume
17
Issue
2
Pages
e0263729
ISSN
1932-6203 (ISSN-L)
OpenAlex
W4210855954
Cited by
6
References
55
Citations by year
2025: 2 · 2024: 2 · 2022: 2
FWCI
0.49
Type
journal article
Language
en
Open access
Locations
  • PLoS ONE (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Data Compression Techniques
  • Physical Sciences › Computer Science › Signal Processing › Video Coding and Compression Technologies
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
Keywords
visual saliency, planetary images, onboard image compression, quantization parameter adjustment, coding tree unit, saliency maps, ResNet, adaptive bit allocation, bit rate reduction, subjective image quality, spacecraft data storage
MeSH terms
Algorithms, Humans, Video Recording, Visual Perception, Planets, Neural Networks, Computer, Spacecraft, Data Compression, Limit of Detection, Satellite Imagery

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review