Analyzing the role of visual structure in the recognition of natural image content with multi-scale SSIM
The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Natural images are meaningful to humans - the physical world exhibits statistical regularities that permit the human visual system (HVS) to infer useful interpretations. These regularities communicate the visual structure of the physical world and govern the statistics of images (image structure). A signal processing framework is sought to analyze image characteristics for a relationship with human interpretation. This work investigates the first step toward an objective visual information evaluation: predicting the recognition threshold of different image representations. Given a image sequence, whose images begin as unrecognizable and are gradually refined to include more information according to some measure, the recognition threshold corresponds to first the image in the sequence in which an observer accurately identifies the content. Sequences are produced using two types of image representations: signal-based and visual structure preserving. Signal-based representations add information as dictated by conventional mathematical characterizations of images based on models of low-level HVS processing and use basis functions as the basic image components. Visual structure preserving representations add information to images attributed to visual structure and attempt to mimic higher-level HVS processing by considering the scene's objects as the basic image components. An experiment is conducted to identify the recognition threshold image. Several full-reference perceptual quality assessment algorithms are evaluated in terms of their ability to predict the recognition threshold of different image representations. The cross-correlation component of a modified version of the multi-scale structural similarity (MS-SSIM) metric, denoted MS-SSIM*, exhibits a better overall correlation with the signal-based and visual structure preserving representations' average recognition thresholds than the standard MS-SSIM cross-correlation component. These findings underscore the significance of visual structure in recognition and advocate a multi-scale image structure analysis for a rudimentary evaluation of visual information.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Image information and visual quality
Sheikh, H. R., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859378 · Cited by 4,104
Forest before trees: The precedence of global features in visual perception
Navon, D. (1977) · Cognitive Psychology · doi:10.1016/0010-0285(77)90012-3 · Cited by 4,005
Sparse coding with an overcomplete basis set: A strategy employed by V1?
Olshausen, B. A., & Field, D. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00169-7 · Cited by 3,642
Natural Image Statistics and Neural Representation
Simoncelli, E. P., & Olshausen, B. A. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.1193 · Cited by 2,460 · cited 2×
“Eq. ( 3 ) normalizes the standard deviation of the luminance values E +µX according to the mean luminance of X. This normalization accounts for Weber’s Law, which asserts that distortions of equal energy are more difficult to detect in brighter regions of an image than in darker image regions.”
BackgroundAn information fidelity criterion for image quality assessment using natural scene statistics
Sheikh, H. R., Bovik, A. C., & de Veciana, G. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859389 · Cited by 1,399
VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images
Chandler, D. M., & Hemami, S. S. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.901820 · Cited by 1,147
Self-citationFrom Blobs to Boundary Edges: Evidence for Time- and Spatial-Scale-Dependent Scene Recognition
Schyns, P. G., & Oliva, A. (1994) · Psychological Science · doi:10.1111/j.1467-9280.1994.tb00500.x · Cited by 715 · cited 1×
“Results from psychological studies emphasize the value of higher spatial frequency content of visual information in recognition tasks [10, 11, 12].”
Background
Cited by
Image Quality Assessment Based on Gradient Similarity
Liu, A., Lin, W., & Narwaria, M. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2175935 · Cited by 701
Self-assembled three dimensional network designs for soft electronics
Jang, K.-I., Li, K., Chung, H. U., Xu, S., Jung, H. N., Yang, Y., Kwak, J. W., Jung, H. H., Song, J., Yang, C., et al. (2017) · Nature Communications · doi:10.1038/ncomms15894 · Cited by 445
Brain Imaging Generation with Latent Diffusion Models
Pinaya, W. H. L., Tudosiu, P.-D., Dafflon, J., Da Costa, P. F., Fernandez, V., Nachev, P., Ourselin, S., & Cardoso, M. J. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-18576-2_12 · Cited by 395
A comprehensive assessment of the structural similarity index
Dosselmann, R., & Yang, X. D. (2011) · Signal, Image and Video Processing · doi:10.1007/s11760-009-0144-1 · Cited by 275
“It has been employed in image restoration [3], video quality monitoring [4,6,35,36], image enhancement [5], video compression [15,25], visual cognition [ 18 ], and imaging coding [34].”
MethodProspects of Structural Similarity Index for Medical Image Analysis
Mudeng, V., Kim, M., & Choe, S.-W. (2022) · Applied Sciences · doi:10.3390/app12083754 · Cited by 101
“(15) The genuine MS-SSIM sets 𝐾 = 5 with 𝛽 (cid:2869) = 0.0448 , 𝛽 (cid:2870) = 0.2856 , 𝛽 (cid:2871) = 0.3001 , 𝛽 (cid:2872) = 0.2363 , and 𝛽 (cid:2873) = 0.1333 [20,22].”
Influential
Metadata
- Authors
- Rouse, D. M., & Hemami, S. S.
- Venue
- SPIE Proceedings
- Publisher
- SPIE
- Published
- 2008-02-14
- Volume
- 6806
- Pages
- 680615
- ISSN
- 0277-786X (ISSN-L)
- OpenAlex
- W2155861247
- Cited by
- 88
- References
- 8
- FWCI
- 6.14
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Analyzing the role of visual structure in the recognition of natural image content with multi-scale SSIM. https://app.cochat.ai/papers/10.1117/12.768060
- The paper
- Rouse, D. M., & Hemami, S. S. (2008). Analyzing the role of visual structure in the recognition of natural image content with multi-scale SSIM. SPIE Proceedings. https://doi.org/10.1117/12.768060
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.