Comparative Analysis of Image Quality Assessment Metrics: MSE, PSNR, SSIM and FSIM
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index; 1 of the 4 sources its claims cite were checked for support.
Abstract
Evaluating the quality of an image proves to be a multifaceted and intricate endeavor, given the nuanced nature of human perception influenced by an array of physical and psychological factors. Despite numerous proposed techniques aimed at measuring image quality, none emerge as flawless or universally applicable. In the realm of image processing, where precision is paramount, extensive research has explored diverse methodologies including point difference analysis, image correlation, edge detection, neural networks (NN), region of interest (ROI) analysis, and consideration of the human visual system (HVS). The essence of an effective image quality measure lies in its ability to furnish accurate and consistent predictions. This study concentrates on the full -reference image quality, which involves utilizing a reference image for comparison purposes. Additionally, the study directs its focus toward contrasting a range of comparison tools, each leveraging different metrics. Among the comparison tools scrutinized are those reliant on point -based measurements such as the mean square error (MSE) and the peak signal -to -noise ratio (PSNR). Conversely, others focus on the compositional aspects of images, exemplified by metrics like the Feature Index Matrix (FSIM) and the Structured Similarity Index Matrix (SSIM).
Overview
CoChat Summary
TL;DR
This paper compares full-reference image quality metrics MSE, PSNR, SSIM, and FSIM on distorted images, reporting that FSIM values are closer to 1 than SSIM values. It concludes that subjective image quality assessment still outperforms objective metrics, and objective IQM remains an open area.
Key findings
- In Table 1, FSIM is closer to 1 than SSIM across the listed images; for example, Boat has SSIM 0.90 vs. FSIM 0.95, Building has SSIM 0.77 vs. FSIM 0.95, and Lighthouse has SSIM 0.83 vs. FSIM 0.99.
- MSE and PSNR vary by image and distortion; examples include Boat MSE 58.36 and PSNR 30.47, Building MSE 351.95 and PSNR 22.67, and Parrots MSE 37.02 and PSNR 32.45.
- The paper states that different image quality metrics differ in value according to distortion type, and that it is hard to get the same quality value even if the same distortion is implemented on different images.
- The conclusion states that subjective IQM, despite being time-consuming and expensive, still does better than objective IQM, and that objective IQM needs more work to cooperate with subjective IQM.
Methods
- The study evaluates full-reference objective image quality metrics: MSE, PSNR, SSIM, and FSIM.
- It uses thirteen original and distorted images listed as building, cycle, girl, door, hats, house, parrots, window, plane, boat, statue, lighthouse, and woman, obtained from the “Lossless True Color Image Suite” provided by the LIVE Image Quality Assessment Database; the results text also refers to “nine images.”
- Images were converted to grayscale using PIL’s convert('L'), blurred with OpenCV GaussianBlur using kernel size ((5, 5), 0), and then assessed with the four metrics in Python; results are summarized in Table 1.
Limitations
- The paper states that subjective IQM is time-consuming and expensive but still performs better than objective IQM, and that objective IQM is still open and needs work to cooperate with subjective IQM.
- Evident from the text: the results discussion says nine images while the methodology and Table 1 list thirteen; the distortion is described as contrast enhancement, but the table column is labeled “Gaussian Variance.”
- Evident from the text: formulas are not decoded in the provided version, and no statistical significance testing or confidence intervals are reported; the comparison is descriptive.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
1 Valid · 0 Not valid · 5 Not checked · 4 Own results and interpretations
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is noticed that the result given by FSIM is closer to 1 than SSIM since it uses more features and involves better computations.”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“While SSIM and FSIM are used for image quality assessment, FSIM offers a more advanced evaluation by considering additional features beyond luminance, contrast, and structure.”
states a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“MSE provides a numerical measure of discrepancy between original and degraded images, but it does not always correlate with human perception of image quality.”
What the sources say
- Not matchedcites [3] [3] Mean Squared Error. wikipedia The Free Encyclopedia. [Online] [Cited: 29 2 2024. ] https: //en. wikipedia. org/wiki/Mean\_squared\_error. -
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“There are many different types of image quality metrics implemented for getting the quality of an image, but there are still limitations.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
In the paper
“However, FSIM may also involve higher computational complexity compared to SSIM [11].”
What the sources say
- Not checked — no full text of the sourcecites [11] [11] Yusra Al Najjar, Effect of Contrast Measures on the Performance of No -Reference Image Quality Assessment Algorithm for Contrast - Distorted Images, Jordan Journal of Electrical Engineering, 2021, Vol.7, No.4, 390 - 404, https: //orcid. org/0000 - 0002 - 3369 - 4999 Volume 13 Issue 3, March 2024 Fully Refereed | Open Access | Double Blind Peer Reviewed Journal www.ijsr.net source
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Probably not a substantial claim. 2
- It may state two separate claims as one. 4
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 4. Results and Discussion
“Measuring image quality for the nine images gave the results included in Table 1.”
§ Volume 13 Issue 3, March 2024
“The comparison involved thirteen original and distorted images: building, cycle, girl, door, hats, house, parrots, window, plane, boat, statue, lighthouse, and woman, see Fig.1.”
Citations
Cites
A universal image quality index
Wang, Z., & Bovik, A. C. (2002) · IEEE Signal Processing Letters · doi:10.1109/97.995823 · Cited by 5,757
Wikipedia: The Free Encyclopedia
(2002) · Reference Reviews · doi:10.1108/rr.2002.16.6.5.273 · Cited by 2,342
Image Quality Assessment through FSIM, SSIM, MSE and PSNR—A Comparative Study
Sara, U., Akter, M., & Uddin, M. S. (2019) · Journal of Computer and Communications · doi:10.4236/jcc.2019.73002 · Cited by 1,689
Indonesian Journal of Electrical Engineering and Computer Science
(2025) · doi:10.11591/ijeecs · Cited by 317
Prospects of Structural Similarity Index for Medical Image Analysis
Mudeng, V., Kim, M., & Choe, S.-W. (2022) · Applied Sciences · doi:10.3390/app12083754 · Cited by 101 · cited 1×
“So, it considers both luminance and structural similarities, regarding reference [8].”
Image quality assessment and human visual system
Gao, X., Lu, W. B., Tao, D., & Li, X. (2010) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.862431 · Cited by 80
Applicability of Existing Objective Metrics of Perceptual Quality for Adaptive Video Streaming
Søgaard, J., Krasula, L., Shahid, M., Temel, D., Brunnström, K., & Razaak, M. (2016) · Electronic Imaging · doi:10.2352/issn.2470-1173.2016.13.iqsp-206 · Cited by 43 · cited 1×
“Equation (4) displays the formula for SSIM, regarding reference [9]. equation (4) While both UIQI and SSIM are used to assess image quality, SSIM is more widely adopted due to its comprehensive evaluation of structural similarity.”
(2022) · doi:10.3390/electronics11040559 · Cited by 19
A Combined Full-Reference Image Quality Assessment Method Based on Convolutional Activation Maps
Varga, D. (2020) · Algorithms · doi:10.3390/a13120313 · Cited by 11
Najjar, Y. (2021) · Jordan Journal of Electrical Engineering · doi:10.5455/jjee.204-1614971790 · Cited by 2
Wang, L. (2021) · arXiv · doi:10.48550/arxiv.2109.00347 · Cited by 1
Cited by
Threat assessment for non-cooperative spacecraft integrating orbital dynamics and image quality
Yu, Y., Luo, J., Hui, M., et al. (2025) · Acta Astronautica · doi:10.1016/j.actaastro.2025.08.056 · Cited by 2
Digital image super-resolution reconstruction method based on stochastic gradient descent algorithm
Yu, Y., Peng, X., & Ye, X. (2025) · Egyptian Informatics Journal · doi:10.1016/j.eij.2025.100778 · Cited by 2
Raj, A. A. E., Ahmad, N. B., Durai, S. A., & Rajaram, R. (2024) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.23210 · Cited by 2
“In this article, we discuss four such measures: PSNR (Peak Signal to Noise Ratio), Absolute Mean Brightness Error (AMBE), SSIM (Structural Similarity Index Method), and DSSIM (Structural Dissimilarity) [40–42].”
A robust framework for rician noise reduction in MRI brain scans with SGO-PPF optimization
Shuriya, B., Varatharajan, N., Subashini, S., et al. (2025) · Journal of the Chinese Institute of Engineers · doi:10.1080/02533839.2025.2574449 · Cited by 1
Chen, D., Chen, M., Lang, B., Wang, X., Xu, Q., Shen, J., Liang, L., & Luo, Q. (2025) · Sensors · doi:10.3390/s25175219 · Cited by 2
Metadata
- Authors
- Al Najjar, Y.
- Venue
- International Journal of Science and Research (IJSR)
- Published
- 2024-03-05
- Volume
- 13
- Issue
- 3
- Pages
- 110-114
- ISSN
- 2319-7064 (ISSN-L)
- OpenAlex
- W4396863072
- Cited by
- 37
- References
- 10
- Citations by year
- 2026: 21 · 2025: 15 · 2024: 1
- FWCI
- 5.15
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- other-oa
- Locations
- International Journal of Science and Research (IJSR) (publishedVersion, other-oa)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Keywords
- image quality assessment, full-reference quality metrics, mean squared error, PSNR, structural similarity index, human visual system, image quality prediction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-06, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-06 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.