Full-Reference Image Quality Assessment with Linear Combination of Genetically Selected Quality Measures
Open accessThe DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
Information carried by an image can be distorted due to different image processing steps introduced by different electronic means of storage and communication. Therefore, development of algorithms which can automatically assess a quality of the image in a way that is consistent with human evaluation is important. In this paper, an approach to image quality assessment (IQA) is proposed in which the quality of a given image is evaluated jointly by several IQA approaches. At first, in order to obtain such joint models, an optimisation problem of IQA measures aggregation is defined, where a weighted sum of their outputs, i.e., objective scores, is used as the aggregation operator. Then, the weight of each measure is considered as a decision variable in a problem of minimisation of root mean square error between obtained objective scores and subjective scores. Subjective scores reflect ground-truth and involve evaluation of images by human observers. The optimisation problem is solved using a genetic algorithm, which also selects suitable measures used in aggregation. Obtained multimeasures are evaluated on four largest widely used image benchmarks and compared against state-of-the-art full-reference IQA approaches. Results of comparison reveal that the proposed approach outperforms other competing measures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892 · cited 3×
“Further extension of UQI, structural similarity (SSIM), was proposed by Wang et al. [3].”
MethodGenetic algorithms in search, optimization, and machine learning
(1989) · Choice Reviews Online · doi:10.5860/choice.27-0936 · Cited by 49,010 · cited 2×
“The optimisation problem was solved using a genetic algorithm (GA) [28, 33], since the number of possible solutions grows exponentially with the number of used IQA metrics.”
MethodGenetic Algorithms in Search, Optimization and Machine Learning
Goldberg, D. E., & Robson, D. (1988) · Cited by 18,391
Multiscale structural similarity for image quality assessment
Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2004) · The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003 · doi:10.1109/acssc.2003.1292216 · Cited by 6,253
A universal image quality index
Wang, Z., & Bovik, A. C. (2002) · IEEE Signal Processing Letters · doi:10.1109/97.995823 · Cited by 5,757 · cited 1×
“Wang et al. [2] introduced universal image quality index (UQI).”
BackgroundKittler, J., Hatef, M., Duin, R. P. W., & Matas, J. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.667881 · Cited by 5,290
FSIM: A Feature Similarity Index for Image Quality Assessment
Zhang, L., Zhang, L., Mou, X., & Zhang, D. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2109730 · Cited by 5,203 · cited 4×
“In the literature, sometimes more images were utilised in order to tune parameters of developed methods, e.g., 30% [9, 11], 80% [13], or parameters were generated for each image dataset separately [13, 21 – 23].”
BackgroundMethodInfluentialImage information and visual quality
Sheikh, H. R., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859378 · Cited by 4,104 · cited 2×
“The following techniques were used: VSI [11], FSIM [9], FSIMc [9], GSM [12], IFC [7], IW-SSIM [5], MAD [17], MSSIM [4], NQM [1], PSNR [29], RFSIM [8], SR-SIM [10], SSIM [3], VIF [6], IFS [31], and SFF [32].”
MethodA Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms
Sheikh, H. R., Sabir, M. F., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881959 · Cited by 2,966 · cited 6×
“The following techniques were used: VSI [11], FSIM [9], FSIMc [9], GSM [12], IFC [7], IW-SSIM [5], MAD [17], MSSIM [4], NQM [1], PSNR [29], RFSIM [8], SR-SIM [10], SSIM [3], VIF [6], IFS [31], and SFF [32].”
BackgroundMethodInfluentialMost apparent distortion: full-reference image quality assessment and the role of strategy
Larson, E. C., & Chandler, D. M. (2010) · Journal of Electronic Imaging · doi:10.1117/1.3267105 · Cited by 1,953
An information fidelity criterion for image quality assessment using natural scene statistics
Sheikh, H. R., Bovik, A. C., & de Veciana, G. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859389 · Cited by 1,399 · cited 2×
“The following techniques were used: VSI [11], FSIM [9], FSIMc [9], GSM [12], IFC [7], IW-SSIM [5], MAD [17], MSSIM [4], NQM [1], PSNR [29], RFSIM [8], SR-SIM [10], SSIM [3], VIF [6], IFS [31], and SFF [32].”
MethodInformation content weighting for perceptual image quality assessment
Wang, Z., & Li, Q. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2092435 · Cited by 1,304 · cited 2×
“Wang and Li in [5] proposed information content weighted SSIM (IW-SSIM) approach as an extension of MSSIM.”
MethodImage database TID2013: Peculiarities, results and perspectives
Ponomarenko, N., Jin, L., Ieremeiev, O., Lukin, V., Egiazarian, K., Astola, J., Vozel, B., Chehdi, K., Carli, M., Battisti, F., et al. (2015) · Signal Processing: Image Communication · doi:10.1016/j.image.2014.10.009 · Cited by 1,241
(2017) · Encyclopedia of Machine Learning and Data Mining · doi:10.1007/978-1-4899-7687-1_100318 · Cited by 1,037
VSI: A Visual Saliency-Induced Index for Perceptual Image Quality Assessment
Zhang, L., Shen, Y., & Li, H. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2346028 · Cited by 1,029 · cited 3×
“A visual saliency to calculate a local quality map of the distorted image is used in visual saliency-induced index (VSI) [11].”
MethodTID2008 – A database for evaluation of full-reference visual quality assessment metrics
Ponomarenko, N. N., Лукин, В. В., & Zelensky, A. A. (2004) · Iris (Roma Tre University) · Cited by 992
Multiscale structural similarity for image quality assessment
Wang, Z. (2025) · doi:10.57702/c0fj14hf · Cited by 867
Image quality assessment based on a degradation model
Damera-Venkata, N., Kite, T. D., Geisler, W. S., Evans, B. L., & Bovik, A. C. (2000) · IEEE Transactions on Image Processing · doi:10.1109/83.841940 · Cited by 806 · cited 2×
“In [1], Damera-Venkata et al. presented noise quality measure (NQM) in which a distorted image is modelled using a linear frequency distortion and an additive noise injection.”
MethodImage Quality Assessment Based on Gradient Similarity
Liu, A., Lin, W., & Narwaria, M. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2175935 · Cited by 701 · cited 2×
“The following techniques were used: VSI [11], FSIM [9], FSIMc [9], GSM [12], IFC [7], IW-SSIM [5], MAD [17], MSSIM [4], NQM [1], PSNR [29], RFSIM [8], SR-SIM [10], SSIM [3], VIF [6], IFS [31], and SFF [32].”
BackgroundMethod(2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-13208-7 · Cited by 427
Seven Challenges in Image Quality Assessment: Past, Present, and Future Research
Chandler, D. M. (2013) · ISRN Signal Processing · doi:10.1155/2013/905685 · Cited by 427
Perceptual Quality Metric With Internal Generative Mechanism
Wu, J., Lin, W., Shi, G., & Liu, A. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2214048 · Cited by 258
SR-SIM: A fast and high performance IQA index based on spectral residual
Zhang, L., & Li, H. (2012) · 2012 19th IEEE International Conference on Image Processing · doi:10.1109/icip.2012.6467149 · Cited by 256
Image Quality Assessment by Separately Evaluating Detail Losses and Additive Impairments
Li, S., Zhang, F., Ma, L., & Ngan, K. N. (2011) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2011.2152382 · Cited by 250
Designing classifier fusion systems by genetic algorithms
Jain, L. C., & Kuncheva, L. I. (2000) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.887233 · Cited by 241 · cited 2×
“The optimisation problem was solved using a genetic algorithm (GA) [28, 33], since the number of possible solutions grows exponentially with the number of used IQA metrics.”
BackgroundMethodRFSIM: A feature based image quality assessment metric using Riesz transforms
Zhang, L., Zhang, L., & Mou, X. (2010) · 2010 IEEE International Conference on Image Processing · doi:10.1109/icip.2010.5649275 · Cited by 218 · cited 2×
“In [8], Riesz-transform based feature similarity (RFSIM) was proposed.”
MethodImage Quality Assessment Using Multi-Method Fusion
Liu, T.-J., Lin, W., & Kuo, C.-C. J. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2236343 · Cited by 195 · cited 1×
“Furthermore, in order to provide fair comparison, overall results exclude works in which authors obtained a separate IQA measure for each benchmark without providing cross-database evaluation, e.g., [18, 19, 21 – 23], or [37].”
ResultSparse Feature Fidelity for Perceptual Image Quality Assessment
Chang, H.-W., Yang, H., Gan, Y., & Wang, M.-H. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2266579 · Cited by 158 · cited 1×
“The following techniques were used: VSI [11], FSIM [9], FSIMc [9], GSM [12], IFC [7], IW-SSIM [5], MAD [17], MSSIM [4], NQM [1], PSNR [29], RFSIM [8], SR-SIM [10], SSIM [3], VIF [6], IFS [31], and SFF [32].”
MethodImage Quality Assessment Using Human Visual DOG Model Fused With Random Forest
Pei, S.-C., & Chen, L.-H. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2440172 · Cited by 132
Multiclassifier Systems: Back to the Future
Ghosh, J. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45428-4_1 · Cited by 122
Perceptual image quality assessment by independent feature detector
Chang, H.-W., Zhang, Q., Wu, Q., & Gan, Y. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.04.081 · Cited by 72 · cited 5×
“The following techniques were used: VSI [11], FSIM [9], FSIMc [9], GSM [12], IFC [7], IW-SSIM [5], MAD [17], MSSIM [4], NQM [1], PSNR [29], RFSIM [8], SR-SIM [10], SSIM [3], VIF [6], IFS [31], and SFF [32].”
MethodInfluentialCombined Full-Reference Image Quality Metric Linearly Correlated with Subjective Assessment
Okarma, K. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-13208-7_67 · Cited by 70 · cited 2×
“Furthermore, in order to provide fair comparison, overall results exclude works in which authors obtained a separate IQA measure for each benchmark without providing cross-database evaluation, e.g., [18, 19, 21 – 23], or [37].”
MethodResultImage Quality Assessment with Degradation on Spatial Structure
Wu, J.-J., Lin, W., & Shi, G.-M. (2014) · IEEE Signal Processing Letters · doi:10.1109/lsp.2014.2304714 · Cited by 50 · cited 2×
“In [13], image structural degradation was considered and determined using local binary patterns.”
MethodFull-reference image quality assessment by combining global and local distortion measures
Saha, A., & Wu, Q. M. J. (2014) · Signal Processing · doi:10.1016/j.sigpro.2016.03.026 · Cited by 47 · cited 1×
“In [ 24], a combination of local and global distortion measures was considered using saliency maps, gradient and contrast information.”
MethodRoli, F., & Kittler, J. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45428-4 · Cited by 42
Decision Fusion for Image Quality Assessment using an Optimization Approach
Oszust, M. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2015.2500819 · Cited by 37
Self-citationSelecting Low-level Features for Image Quality Assessment by Statistical Methods
Lahouhou, A., Viennet, E., & Beghdadi, A. (2010) · Journal of Computing and Information Technology · doi:10.2498/cit.1001822 · Cited by 33 · cited 1×
“In [21], up to seven IQA models were combined using a regularised regression.”
MethodPerceptual image quality assessment using block-based multi-metric fusion (BMMF)
Jin, L., Egiazarian, K., & Kuo, C. ‐. J. (2012) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2012.6288089 · Cited by 28
A Locally Adaptive System for the Fusion of Objective Quality Measures
Barri, A., Dooms, A., Jansen, B., & Schelkens, P. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2316379 · Cited by 25
Image Quality Assessment Based on Inter-Patch and Intra-Patch Similarity
Zhou, F., Lu, Z., Wang, C., Sun, W., Xia, S.-T., & Liao, Q.-M. (2015) · PLoS ONE · doi:10.1371/journal.pone.0116312 · Cited by 23 · cited 2×
“An IQA measure that evaluates images taking into account inter-patch and intra-patch similarities was described in [15].”
MethodOkarma, K. (2013) · Elektronika ir Elektrotechnika · doi:10.5755/j01.eee.19.10.5908 · Cited by 21
A New Image Quality Approach Based on Decision Fusion
Liu, M., & Yang, X. (2008) · International Conference on Fuzzy Systems and Knowledge Discovery (FSKD) · doi:10.1109/fskd.2008.469 · Cited by 16 · cited 1×
“For example, Liu and Yang [16] combined SNR, SSIM, VIF, and VSNR using canonical correlation analysis.”
MethodAn Object-Distortion Based Image Quality Similarity
Wang, F., Sun, X., Guo, Z., Huang, Y., & Fu, K. (2015) · IEEE Signal Processing Letters · doi:10.1109/lsp.2015.2413891 · Cited by 10 · cited 1×
“In SURF-SIM [14], multiscale differences between features detected and described by Speed Up Robust Features (SURF) approach are combined with a pooling strategy.”
MethodA Mixture of Experts Approach to Multi-strategy Image Quality Assessment
Peng, P., & Li, Z.-N. (2012) · International Conference on Image Analysis and Recognition · doi:10.1007/978-3-642-31295-3_15 · Cited by 9
Regularization of the structural similarity index based on preservation of edge direction
Peng, P., & Li, Z.-N. (2012) · IEEE International Conference on Systems, Man and Cybernetics · doi:10.1109/icsmc.2012.6378054 · Cited by 9 · cited 3×
“Furthermore, in order to provide fair comparison, overall results exclude works in which authors obtained a separate IQA measure for each benchmark without providing cross-database evaluation, e.g., [18, 19, 21 – 23], or [37].”
BackgroundMethodResultFull-reference image quality assessment by combining global and local distortion measuresPreprint
Saha, A., & Wu, Q. M. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.5488 · Cited by 2 · cited 1×
“In [ 24], a combination of local and global distortion measures was considered using saliency maps, gradient and contrast information.”
Method
Cited by
Image Quality Assessment through FSIM, SSIM, MSE and PSNR—A Comparative Study
Sara, U., Akter, M., & Uddin, M. S. (2019) · Journal of Computer and Communications · doi:10.4236/jcc.2019.73002 · Cited by 1,689
“That’s why the quality should be evaluated by the human view perceptron [2].”
BackgroundState‐of‐art analysis of image denoising methods using convolutional neural networks
Thakur, R. S., Yadav, R. N., & Gupta, L. (2019) · IET Image Processing · doi:10.1049/iet-ipr.2019.0157 · Cited by 87
“…image is evaluated jointly by several image quality assessment approaches in which joint models are optimised and the image indices are given by Spearman Rank order Correlation Coefficient (SRCC), Kendall Rank order Correlation Coefficient (KRCC), Pearson linear Correlation Coefficient (PCC) [29].”
MethodA shallow convolutional neural network for blind image sharpness assessment
Yu, S., Wu, S., Wang, L., Jiang, F., Xie, Y., & Li, L. (2017) · PLoS ONE · doi:10.1371/journal.pone.0176632 · Cited by 59
Current Trends and Advances in Image Quality Assessment
Okarma, K. (2019) · Elektronika ir Elektrotechnika · doi:10.5755/j01.eie.25.3.23681 · Cited by 26
A Review on Application of Fourier Transform in Image Restoration
John, A. M., Khanna, K., Prasad, R. R., & Pillai, L. G. (2020) · International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC) · doi:10.1109/i-smac49090.2020.9243510 · Cited by 26
Metadata
- Authors
- Oszust, M.
- Affiliations
- Rzeszów University of Technology (PL)
- Corresponding author
- Oszust, Mariusz
- ORCID
- Oszust, Mariusz
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-06-24
- Volume
- 11
- Issue
- 6
- Pages
- e0158333
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4920377
- OpenAlex
- W2466828342
- Semantic Scholar
- 41e778b8d4f40a448eaa3582737e68f5279cdce4
- Cited by
- 39
- References
- 45
- Citations by year
- 2026: 1 · 2024: 2 · 2023: 4 · 2022: 3 · 2021: 3 · 2020: 6 · 2019: 8 · 2018: 6 · 2017: 5 · 2016: 1
- FWCI
- 4.53
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Keywords
- full-reference image quality assessment, genetic algorithm, subjective quality scores, image distortion
- MeSH terms
- Algorithms, Humans, Image Processing, Computer-Assisted, Models, Theoretical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.