The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Specular reflections and the perception of shape
Open accessAbstract
Many materials, including leaves, water, plastic, and chrome exhibit specular reflections. It seems reasonable that the visual system can somehow exploit specular reflections to recover three-dimensional (3D) shape. Previous studies (e.g., J. T. Todd & E. Mingolla, 1983; J. F. Norman, J. T. Todd, & G. A. Orban, 2004) have shown that specular reflections aid shape estimation, but the relevant image information has not yet been isolated. Here we explain how specular reflections can provide reliable and accurate constraints on 3D shape. We argue that the visual system can treat specularities somewhat like textures, by using the systematic patterns of distortion across the image of a specular surface to recover 3D shape. However, there is a crucial difference between textures and specularities: In the case of textures, the image compressions depend on the first derivative of the surface depth (i.e., surface orientation), whereas in the case of specularities, the image compressions depend on the second derivative (i.e., surfaces curvatures). We suggest that this difference provides a cue that can help the visual system distinguish between textures and specularities, even when present simultaneously. More importantly, we show that the dependency of specular distortions on the second derivative of the surface leads to distinctive fields of image orientation as the reflected world is warped across the surface. We find that these "orientation fields" are (i) diagnostic of 3D shape, (ii) remain surprisingly stable when the world reflected in the surface is changed, and (iii) can be extracted from the image by populations of simple oriented filters. Thus the use of specular reflections for 3D shape perception is both easier and more reliable than previous computational work would suggest.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Ecological Approach to Visual Perception
Bornstein, M. H., & Gibson, J. J. (1980) · The Journal of Aesthetics and Art Criticism · doi:10.2307/429816 · Cited by 22,935
Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex
Hubel, D. H., & Wiesel, T. N. (1962) · The Journal of Physiology · doi:10.1113/jphysiol.1962.sp006837 · Cited by 13,680
Receptive fields and functional architecture of monkey striate cortex
Hubel, D. H., & Wiesel, T. N. (1968) · The Journal of Physiology · doi:10.1113/jphysiol.1968.sp008455 · Cited by 6,568
Receptive fields of single neurones in the cat's striate cortex
Hubel, D. H., & Wiesel, T. N. (1959) · The Journal of Physiology · doi:10.1113/jphysiol.1959.sp006308 · Cited by 4,653
Principles Of Gestalt Psychology
Koffka, K. (2013) · Routledge eBooks · doi:10.4324/9781315009292 · Cited by 4,263
Perception of the Visual World
(1952) · Archives of Ophthalmology · doi:10.1001/archopht.1952.01700030123016 · Cited by 3,732
Relations between the statistics of natural images and the response properties of cortical cells
Field, D. J. (1987) · Journal of the Optical Society of America A · doi:10.1364/josaa.4.002379 · Cited by 3,241
Computational vision and regularization theory
Poggio, T., Torre, V., & Koch, C. (1985) · Nature · doi:10.1038/317314a0 · Cited by 1,412
The steerable pyramid: a flexible architecture for multi-scale derivative computation
Simoncelli, E. P., & Freeman, W. T. (2002) · Proceedings., International Conference on Image Processing · doi:10.1109/icip.1995.537667 · Cited by 1,070
Chalupa, L. M., Werner, J. S., & Barnstable, C. J. (2004) · Cited by 1,029
Acquiring the reflectance field of a human face
Debevec, P., Hawkins, T., Tchou, C., Duiker, H.-P., Sarokin, W., & Sagar, M. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.344855 · Cited by 1,018
The RADIANCE lighting simulation and rendering system
Ward, G. J. (1994) · Proceedings of the 21st annual conference on Computer graphics and interactive techniques - SIGGRAPH '94 · doi:10.1145/192161.192286 · Cited by 1,006
Debevec, P. (2008) · ACM SIGGRAPH 2008 classes · doi:10.1145/1401132.1401175 · Cited by 969
The orientation and direction selectivity of cells in macaque visual cortex
De Valois, R. L., William Yund, E., & Hepler, N. (1982) · Vision Research · doi:10.1016/0042-6989(82)90112-2 · Cited by 772
Helmholtz's treatise on physiological optics
(1924) · Journal of the Franklin Institute · doi:10.1016/s0016-0032(24)90484-4 · Cited by 696
Perception of shape from shading
Ramachandran, V. S. (1988) · Nature · doi:10.1038/331163a0 · Cited by 674
The Perception of Visual Surfaces
Gibson, J. J. (1950) · The American Journal of Psychology · doi:10.2307/1418003 · Cited by 591
Recovering surface shape and orientation from texture
Witkin, A. P. (1981) · Artificial Intelligence · doi:10.1016/0004-3702(81)90019-9 · Cited by 505
The new cognitive neurosciences, 2nd ed.
Gazzaniga, M. S. (2000) · Cited by 470
What Does the Occluding Contour Tell Us about Solid Shape?
Koenderink, J. J. (1984) · Perception · doi:10.1068/p130321 · Cited by 468
Real-world illumination and the perception of surface reflectance properties
Fleming, R. W., Dror, R. O., & Adelson, E. H. (2003) · Journal of Vision · doi:10.1167/3.5.3 · Cited by 444
Self-citationThe measurement of highlights in color images
Klinker, G., Shafer, S. A., & Takeo Kanade, A. (1988) · International Journal of Computer Vision · doi:10.1007/bf00836279 · Cited by 373
Ramachandran, V. S. (1988) · Scientific American · doi:10.1038/scientificamerican0888-76 · Cited by 321
Schiller, P. H., Finlay, B. L., & Volman, S. F. (1976) · Journal of Neurophysiology · doi:10.1152/jn.1976.39.6.1320 · Cited by 291
Anderson, B. L. (1997) · Perception · doi:10.1068/p260419 · Cited by 286
Photometric Invariants Related to Solid Shape
Koenderink, J. J., & van Doorn, A. J. (1980) · Optica Acta: International Journal of Optics · doi:10.1080/713820338 · Cited by 262
Surface perception in pictures
Koenderink, J. J., van Doorn, A. J., & Kappers, A. M. L. (1992) · Perception & Psychophysics · doi:10.3758/bf03206710 · Cited by 251
Computing Local Surface Orientation and Shape from Texture for Curved Surfaces
Malik, J., & Rosenholtz, R. E. (1997) · International Journal of Computer Vision · doi:10.1023/a:1007958829620 · Cited by 214
Three gradients and the perception of flat and curved surfaces.
Cutting, J. E., & Millard, R. T. (1984) · Journal of Experimental Psychology: General · doi:10.1037//0096-3445.113.2.198 · Cited by 199
Observer biases in the 3D interpretation of line drawings
Mamassian, P., & Landy, M. S. (1998) · Vision Research · doi:10.1016/s0042-6989(97)00438-0 · Cited by 194
Does the brain know the physics of specular reflection?
Blake, A., & Bülthoff, H. (1990) · Nature · doi:10.1038/343165a0 · Cited by 192
Toward a perceptual theory of transparency.
Singh, M., & Anderson, B. L. (2002) · Psychological Review · doi:10.1037//0033-295x.109.3.492 · Cited by 176
Perception of solid shape from shading
Mingolla, E., & Todd, J. T. (1986) · Biological Cybernetics · doi:10.1007/bf00342882 · Cited by 166
Illuminant cues in surface color perception: tests of three candidate cues
Yang, J. N., & Maloney, L. T. (2001) · Vision Research · doi:10.1016/s0042-6989(01)00143-2 · Cited by 158
Shape from texture using local spectral moments
Super, B. J., & Bovik, A. C. (1995) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.385983 · Cited by 137
A Prior for Global Convexity in Local Shape-from-Shading
Langer, M., & Bülthoff, H. (2001) · Perception · doi:10.1068/p3178 · Cited by 137
Norman, J. F., Todd, J. T., & Orban, G. A. (2004) · Psychological Science · doi:10.1111/j.0956-7976.2004.00720.x · Cited by 136
The information content of texture gradients
Stevens, K. A. (1981) · Biological Cybernetics · doi:10.1007/bf00336727 · Cited by 132
Perception of three-dimensional form from patterns of optical texture.
Todd, J. T., & Akerstrom, R. A. (1987) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.13.2.242 · Cited by 129
Slant-tilt: The visual encoding of surface orientation
Stevens, K. A. (1983) · Biological Cybernetics · doi:10.1007/bf00336800 · Cited by 123
Blake, A., & Marinos, C. (1990) · Artificial Intelligence · doi:10.1016/0004-3702(90)90011-n · Cited by 122
Independent Effects of Lighting, Orientation, and Stereopsis on the Hollow-Face Illusion
Hill, H. C. H., & Bruce, V. (1993) · Perception · doi:10.1068/p220887 · Cited by 101
Interaction of stereo, texture and outline cues in the shape perception of three-dimensional ridges
Buckley, D., & Frisby, J. P. (1993) · Vision Research · doi:10.1016/0042-6989(93)90075-8 · Cited by 100
Shape from specularities: computation and psychophysics
Blake, A., & Bülthoff, H. (1991) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.1991.0012 · Cited by 95
Effects of different texture cues on curved surfaces viewed stereoscopically
Gumming, B. G., Johnston, E. B., & Parker, A. J. (1993) · Vision Research · doi:10.1016/0042-6989(93)90201-7 · Cited by 91
On visual detection of light sources
Ullman, S. (1976) · Biological Cybernetics · doi:10.1007/bf00344165 · Cited by 77
Surface orientation from texture: Isotropy or homogeneity (or both)?
Rosenholtz, R. E., & Malik, J. (1997) · Vision Research · doi:10.1016/s0042-6989(96)00121-6 · Cited by 76
Effects of Texture, Illumination, and Surface Reflectance on Stereoscopic Shape Perception
Todd, J. T., Norman, J. F., Koenderink, J. J., & Kappers, A. M. L. (1997) · Perception · doi:10.1068/p260807 · Cited by 71
A Comparison between the Hollow-Face and ‘Hollow-Potato’ Illusions
Hill, H. C. H., & Bruce, V. (1994) · Perception · doi:10.1068/p231335 · Cited by 68
Statistics of real-world illumination
Dror, R. O., Leung, T. K., Adelson, E. H., & Willsky, A. S. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2001.990948 · Cited by 55
Self-citationLocal analysis for 3D reconstruction of specular surfaces
Savarese, S., & Perona, P. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2001.991038 · Cited by 51
Limitations on shape information provided by texture cues
Zaidi, Q., & Li, A. (2002) · Vision Research · doi:10.1016/s0042-6989(01)00233-4 · Cited by 31
Shiftable multi-scale transforms [or "What's wrong with orthonormal wavelets"]
Simoncelli, E. P. (1992) · Medical Entomology and Zoology · Cited by 23
Occluding Edges in Apparent Reversal of Convexity and Concavity
Howard, I. P. (1983) · Perception · doi:10.1068/p120085 · Cited by 15
Orientation tuning of shapefrom shading
Symons, L. A., Cuddy, F., & Humphrey, K. (2000) · Perception & Psychophysics · doi:10.3758/bf03212107 · Cited by 12
Cited by
Visual perception of materials and their properties
Fleming, R. W. (2014) · Vision Research · doi:10.1016/j.visres.2013.11.004 · Cited by 331
Self-citationBell (2013) · doi:10.1145/2461912.2462002 · Cited by 200
Metadata
- Authors
- Fleming, R. W., Torralba, A., & Adelson, E. H.
- Venue
- Journal of Vision
- Published
- 2004-09-23
- Volume
- 4
- Issue
- 9
- Pages
- 10
- ISSN
- 1534-7362 (ISSN-L)
- OpenAlex
- W2054322877
- Cited by
- 301
- References
- 55
- FWCI
- 4.96
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.