The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Saliency-Aware Video Compression
Abstract
In region-of-interest (ROI)-based video coding, ROI parts of the frame are encoded with higher quality than non-ROI parts. At low bit rates, such encoding may produce attention-grabbing coding artifacts, which may draw viewer's attention away from ROI, thereby degrading visual quality. In this paper, we present a saliency-aware video compression method for ROI-based video coding. The proposed method aims at reducing salient coding artifacts in non-ROI parts of the frame in order to keep user's attention on ROI. Further, the method allows saliency to increase in high quality parts of the frame, and allows saliency to reduce in non-ROI parts. Experimental results indicate that the proposed method is able to improve visual quality of encoded video relative to conventional rate distortion optimized video coding, as well as two state-of-the art perceptual video coding methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
A model of saliency-based visual attention for rapid scene analysis
Itti, L., Koch, C., & Niebur, E. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.730558 · Cited by 11,271
Fundamentals of digital image processing
Jain, A. K. (1988) · Cited by 7,111
Handbook of Parametric and Nonparametric Statistical Procedures
(2004) · Technometrics · doi:10.1198/tech.2004.s209 · Cited by 4,661
Calcuation of average PSNR differences between RD-curves
Bjøntegaard, G. (2001) · Medical Entomology and Zoology · Cited by 4,573
Frequency-tuned salient region detection
Achanta, R., Hemami, S., Estrada, F., & Susstrunk, S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206596 · Cited by 4,167
Most apparent distortion: full-reference image quality assessment and the role of strategy
Larson, E. C., & Chandler, D. M. (2010) · Journal of Electronic Imaging · doi:10.1117/1.3267105 · Cited by 1,953
Rate-distortion optimization for video compression
Sullivan, G. J., & Wiegand, T. (1998) · IEEE Signal Processing Magazine · doi:10.1109/79.733497 · Cited by 1,727
A new standardized method for objectively measuring video quality
Pinson, M. H., & Wolf, S. (2004) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2004.834028 · Cited by 1,182
PEST: Efficient Estimates on Probability Functions
Taylor, M. M., & Creelman, C. D. (1967) · The Journal of the Acoustical Society of America · doi:10.1121/1.1910407 · Cited by 1,173
Statistics of natural image categories
Torralba, A. B., & Oliva, A. (2003) · Network Computation in Neural Systems · doi:10.1088/0954-898x/14/3/302 · Cited by 847
Automatic Foveation for Video Compression Using a Neurobiological Model of Visual Attention
Itti, L. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2004.834657 · Cited by 759
The H.264 Advanced Video Compression Standard
Richardson, I. E. (2010) · Wiley eBooks · doi:10.1002/9780470989418 · Cited by 693
Digital images and human vision
(1994) · Choice Reviews Online · doi:10.5860/choice.31-5492 · Cited by 656
Objective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison
Chikkerur, S., Sundaram, V., Reisslein, M., & Karam, L. J. (2011) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2011.2104671 · Cited by 613
Handbook of Parametric and Nonparametric Statistical Procedures
Nash, M. S. (2001) · Technometrics · doi:10.1198/tech.2001.s629 · Cited by 570
Quantifying the contribution of low-level saliency to human eye movements in dynamic scenes
Itti, L. (2005) · Visual Cognition · doi:10.1080/13506280444000661 · Cited by 331
Saliency Detection in the Compressed Domain for Adaptive Image Retargeting
Fang, Y., Chen, Z., Lin, W., & Lin, C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2199126 · Cited by 317
Predicting visual fixations on video based on low-level visual features
Le Meur, O., Le Callet, P., & Barba, D. (2007) · Vision Research · doi:10.1016/j.visres.2007.06.015 · Cited by 305
Lagrange multiplier selection in hybrid video coder control
Wiegand, T., & Girod, B. (2002) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2001.958171 · Cited by 294
Visual attention guided bit allocation in video compression
Li, Z., Qin, S., & Itti, L. (2011) · Image and Vision Computing · doi:10.1016/j.imavis.2010.07.001 · Cited by 235
SSIM-Motivated Rate-Distortion Optimization for Video Coding
Wang, S., Rehman, A., Wang, Z., Ma, S., & Gao, W. (2012) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2011.2168269 · Cited by 225
Video quality assessment using a statistical model of human visual speed perception
Wang, Z., & Li, Q. (2007) · Journal of the Optical Society of America A · doi:10.1364/josaa.24.000b61 · Cited by 210
Perceptually-Friendly H.264/AVC Video Coding Based on Foveated Just-Noticeable-Distortion Model
Chen, Z., & Guillemot, C. (2010) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2010.2045912 · Cited by 207
Motion-compensated residue preprocessing in video coding based on just-noticeable-distortion profile
Yang, X., Lin, W., Lu, Z., Ong, E., & Yao, S. (2005) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2005.848313 · Cited by 193
Region-of-Interest Based Resource Allocation for Conversational Video Communication of H.264/AVC
Liu, Y., Li, Z. G., & Soh, Y. C. (2008) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2007.913754 · Cited by 175
Perceptual Video Coding Based on SSIM-Inspired Divisive Normalization
Wang, S., Rehman, A., Wang, Z., Ma, S., & Gao, W. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2231090 · Cited by 138
DCT quantization noise in compressed images
Robertson, M. A., & Stevenson, R. L. (2005) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2004.839995 · Cited by 121
Perceptual Rate-Distortion Optimization Using Structural Similarity Index as Quality Metric
Huang, Y., Ou, T.-S., Su, P.-Y., & Chen, H. H. (2010) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2010.2087472 · Cited by 118
DCT quantization noise in compressed images
Robertson, M. A., & Stevenson, R. L. (2005) · doi:10.1109/tcsvt.2004.839995(410 · Cited by 110
SSIM-Based Perceptual Rate Control for Video Coding
Ou, T.-S., Huang, Y.-H., & Chen, H. H. (2011) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2011.2129890 · Cited by 102
Rate control for videophone using local perceptual cues
Yang, X., Lin, W., Lu, Z., Lin, X., Rahardja, S., Ong, E. P., & Yao, S. (2005) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2005.844458 · Cited by 71
Perceptual video coding: Challenges and approaches
Chen, Z., Lin, W., & Ngan, K. N. (2010) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2010.5582549 · Cited by 68
Low-Complexity Video Quality Assessment Using Temporal Quality Variations
Narwaria, M., Lin, W., & Liu, A. (2012) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2012.2190589 · Cited by 66
An SSIM-optimal H.264/AVC inter frame encoder
Yang, C., Leung, R.-K., Po, L.-M., & Mai, Z.-Y. (2009) · IEEE International Conference on Intelligent Computing and Intelligent Systems (ICIS) · doi:10.1109/icicisys.2009.5357689 · Cited by 40
Quality Evaluation of Motion-Compensated Edge Artifacts in Compressed Video
Leontaris, A., Cosman, P. C., & Reibman, A. R. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.891778 · Cited by 39
Improved Inter Prediction based on Structural Similarity in H.264
Yang, C., Wang, H.-X., & Po, L.-M. (2007) · doi:10.1109/icspc.2007.4728325 · Cited by 30
Video Error Concealment Using a Computation-Efficient Low Saliency Prior
Hadizadeh, H., Bajić, I. V., & Cheung, G. (2013) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2013.2281024 · Cited by 18
Self-citationSaliency-preserving video compression
Hadizadeh, H., & Bajić, I. V. (2011) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2011.6012194 · Cited by 14
Self-citationVisual perception based Lagrangian rate distortion optimization for video coding
Wang, X., Su, L., Huang, Q., et al. (2011) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2011.6115770 · Cited by 13
On rate distortion optimization using SSIM
Yeo, C., Tan, H. L., & Tan, Y. H. (2012) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2012.6288013 · Cited by 13
Visual Saliency in Video Compression and Transmission
Hadizadeh, H. (2013) · Summit (Simon Fraser University) · Cited by 12
Self-citationMachine learning based modeling of spatial and temporal factors for video quality assessment
Narwaria, M., & Lin, W. (2011) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2011.6116173 · Cited by 10
Cited by
Shifting More Attention to Video Salient Object Detection
Fan, D.-P., Wang, W., Cheng, M.-M., & Shen, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00875 · Cited by 510
DeepFix: A Fully Convolutional Neural Network for Predicting Human Eye Fixations
Kruthiventi, S. S. S., Ayush, K., & Babu, R. V. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2710620 · Cited by 478
Predicting Human Eye Fixations via an LSTM-Based Saliency Attentive Model
Cornia, M., Baraldi, L., Serra, G., & Cucchiara, R. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2851672 · Cited by 474
Saliency in VR: How Do People Explore Virtual Environments?
Sitzmann, V., Serrano, A., Pavel, A., Agrawala, M., Gutierrez, D., Masia, B., & Wetzstein, G. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2793599 · Cited by 459
State-of-the-Art in 360° Video/Image Processing: Perception, Assessment and Compression
Xu, M., Li, C., Zhang, S., & Callet, P. L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2966864 · Cited by 281
Metadata
- Authors
- Hadizadeh, H., & Bajic, I. V.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2014-01
- Volume
- 23
- Issue
- 1
- Pages
- 19-33
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W1978479866
- Cited by
- 326
- References
- 43
- FWCI
- 31.66
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.