The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
Visual perception of materials and their properties
Open accessAbstract
Misidentifying materials-such as mistaking soap for pâté, or vice versa-could lead to some pretty messy mishaps. Fortunately, we rarely suffer such indignities, thanks largely to our outstanding ability to recognize materials-and identify their properties-by sight. In everyday life, we encounter an enormous variety of materials, which we usually distinguish effortlessly and without error. However, despite its subjective ease, material perception poses the visual system with some unique and significant challenges, because a given material can take on many different appearances depending on the lighting, viewpoint and shape. Here, I use observations from recent research on material perception to outline a general theory of material perception, in which I suggest that the visual system does not actually estimate physical parameters of materials and objects. Instead-I argue-the brain is remarkably adept at building 'statistical generative models' that capture the natural degrees of variation in appearance between samples. For example, when determining perceived glossiness, the brain does not estimate parameters of the BRDF. Instead, it uses a constellation of low- and mid-level image measurements to characterize the extent to which the surface manifests specular reflections. I argue that these 'statistical appearance models' are both more expressive and easier to compute than physical parameters, and therefore represent a powerful middle way between a 'bag of tricks' and 'inverse optics'.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nonlinear Dimensionality Reduction by Locally Linear Embedding
Roweis, S. T., & Saul, L. K. (2000) · Science · doi:10.1126/science.290.5500.2323 · Cited by 14,965
A Global Geometric Framework for Nonlinear Dimensionality Reduction
Tenenbaum, J. B., Silva, V. D., & Langford, J. C. (2000) · Science · doi:10.1126/science.290.5500.2319 · Cited by 13,585
Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope
Oliva, A., & Torralba, A. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011139631724 · Cited by 6,319
Land, E. H., & McCann, J. J. (1971) · Journal of the Optical Society of America · doi:10.1364/josa.61.000001 · Cited by 4,095
Distilling Free-Form Natural Laws from Experimental Data
Schmidt, M., & Lipson, H. (2009) · Science · doi:10.1126/science.1165893 · Cited by 2,890
Gazzaniga, M. S., & Bizzi, E. (2000) · Cited by 2,549
Internal models in the cerebellum
Wolpert, D. M., Miall, R. C., & Kawato, M. (1998) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(98)01221-2 · Cited by 2,469
80 Million Tiny Images: A Large Data Set for Nonparametric Object and Scene Recognition
Torralba, A., Fergus, R., & Freeman, W. T. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.128 · Cited by 1,921
Theory for Off-Specular Reflection From Roughened Surfaces*
Torrance, K. E., & Sparrow, E. M. (1967) · Journal of the Optical Society of America · doi:10.1364/josa.57.001105 · Cited by 1,855
How to grow a mind: Statistics, structure, and abstraction
Tenenbaum, J. B., Kemp, C., Griffiths, T. L., & Goodman, N. D. (2011) · Science · doi:10.1126/science.1192788 · Cited by 1,815
Geometrical considerations and nomenclature for reflectance
Nicodemus, F. E., Richmond, J. C., Hsia, J. J., Ginsberg, I. W., & Limperis, T. (1977) · doi:10.6028/nbs.mono.160 · Cited by 1,478
Chapter 2 Building the gist of a scene: the role of global image features in recognition
Oliva, A., & Torralba, A. (2006) · Progress in Brain Research · doi:10.1016/s0079-6123(06)55002-2 · Cited by 1,434
Computational vision and regularization theory
Poggio, T., Torre, V., & Koch, C. (1985) · Nature · doi:10.1038/317314a0 · Cited by 1,412
(1995) · Medical Entomology and Zoology · Cited by 1,212
Debevec, P. (2008) · ACM SIGGRAPH 2008 classes · doi:10.1145/1401132.1401175 · Cited by 969
Measuring and modeling anisotropic reflection
Ward, G. J. (1992) · Proceedings of the 19th annual conference on Computer graphics and interactive techniques · doi:10.1145/133994.134078 · Cited by 948
Color constancy: a method for recovering surface spectral reflectance
Maloney, L. T., & Wandell, B. A. (1986) · Journal of the Optical Society of America A · doi:10.1364/josaa.3.000029 · Cited by 853
Statistics of natural image categories
Torralba, A. B., & Oliva, A. (2003) · Network Computation in Neural Systems · doi:10.1088/0954-898x/14/3/302 · Cited by 847
b'Geometrical Considerations and Nomenclature for Reflectance'
b'Nicodemus, F. E. '., b'Richmond, J. C. '., b'Hsia, J. J. '., b'Ginsberg, I. W. '., & b'Limperis, T. '. (1977) · Cited by 773
Chiang, A.-S., Lin, C.-Y., Chuang, C.-C., Chang, H.-M., Hsieh, C.-H., Yeh, C.-W., Shih, C.-T., Wu, J.-J., Wang, G.-T., Chen, Y.-C., et al. (2011) · Current Biology · doi:10.1016/j.cub.2010.11.056 · Cited by 767
Directional Reflectance and Emissivity of an Opaque Surface
Nicodemus, F. E. (1965) · Applied Optics · doi:10.1364/ao.4.000767 · Cited by 724
Helmholtz's treatise on physiological optics
(1924) · Journal of the Franklin Institute · doi:10.1016/s0016-0032(24)90484-4 · Cited by 696
Scene completion using millions of photographs
Hays, J., & Efros, A. A. (2007) · ACM SIGGRAPH 2007 papers · doi:10.1145/1275808.1276382 · Cited by 687
The discovery of structural form
Kemp, C., & Tenenbaum, J. B. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0802631105 · Cited by 650
An anchoring theory of lightness perception.
Gilchrist, A., Kossyfidis, C., Bonato, F. C., Agostini, T., Cataliotti, J., Li, X., Špehar, B., Annan, V., & Economou, E. (1999) · Psychological Review · doi:10.1037//0033-295x.106.4.795 · Cited by 629
A data-driven reflectance model
Matusik, W., Pfister, H., Brand, M., & McMillan, L. (2003) · ACM SIGGRAPH 2003 Papers · doi:10.1145/1201775.882343 · Cited by 597
Image statistics and the perception of surface qualities
Motoyoshi, I., Nishida, S., Sharan, L., & Adelson, E. H. (2007) · Nature · doi:10.1038/nature05724 · Cited by 588
Foster, D. H. (2011) · Vision Research · doi:10.1016/j.visres.2010.09.006 · Cited by 505
Arend, L., & Reeves, A. (1986) · Journal of the Optical Society of America A · doi:10.1364/josaa.3.001743 · Cited by 483
Ebner, M. (2007) · Cited by 482
The new cognitive neurosciences, 2nd ed.
Gazzaniga, M. S. (2000) · Cited by 470
GREENE, M., & OLIVA, A. (2009) · Cognitive Psychology · doi:10.1016/j.cogpsych.2008.06.001 · Cited by 467
Example-guided physically based modal sound synthesis
Ren, Z., Yeh, H., & Lin, M. C. (2013) · ACM Transactions on Graphics · doi:10.1145/2421636.2421637 · Cited by 453
Real-world illumination and the perception of surface reflectance properties
Fleming, R. W., Dror, R. O., & Adelson, E. H. (2003) · Journal of Vision · doi:10.1167/3.5.3 · Cited by 444
Self-citationThe contingent negative variation (CNV) event-related potential (ERP) predicts the attentional blink
Shapiro, K., Martin, E., Arend, I., Johnston, S., & Klein, C. (2008) · Journal of Vision · doi:10.1167/8.6.1 · Cited by 368
Mirmehdi, M., Xie, X., & Suri, J. S. (2008) · IMPERIAL COLLEGE PRESS eBooks · doi:10.1142/p547 · Cited by 309
On seeing stuff: the perception of materials by humans and machines:
Adelson, E. H. (2001) · SPIE Proceedings · doi:10.1117/12.429489 · Cited by 308
Long-lasting modulation of feature integrationby transcranial magnetic stimulation
Scharnowski, F., Ruter, J., Jolij, J., Hermens, F., Kammer, T., & Herzog, M. H. (2009) · Journal of Vision · doi:10.1167/9.6.1 · Cited by 305
Material perception: What can you see in a brief glance?
Sharan, L., Rosenholtz, R., & Adelson, E. (2010) · Journal of Vision · doi:10.1167/9.8.784 · Cited by 303
Specular reflections and the perception of shape
Fleming, R. W., Torralba, A., & Adelson, E. H. (2004) · Journal of Vision · doi:10.1167/4.9.10 · Cited by 301
Self-citationAnderson, B. L. (1997) · Perception · doi:10.1068/p260419 · Cited by 286
Photometric Invariants Related to Solid Shape
Koenderink, J. J., & van Doorn, A. J. (1980) · Optica Acta: International Journal of Optics · doi:10.1080/713820338 · Cited by 262
Exploring features in a Bayesian framework for material recognition
Liu, C., Sharan, L., Adelson, E. H., & Rosenholtz, R. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540207 · Cited by 240
The Perception and Misperception of Specular Surface Reflectance
Marlow, P. J., Kim, J., & Anderson, B. L. (2012) · Current Biology · doi:10.1016/j.cub.2012.08.009 · Cited by 217
Perception viewed as an inverse problem
Pizlo, Z. (2001) · Vision Research · doi:10.1016/s0042-6989(01)00173-0 · Cited by 195
Does the brain know the physics of specular reflection?
Blake, A., & Bülthoff, H. (1990) · Nature · doi:10.1038/343165a0 · Cited by 192
Low-Level Image Cues in the Perception of Translucent Materials
Fleming, R. W., & Bülthoff, H. (2005) · ACM Transactions on Applied Perception · doi:10.1145/1077399.1077409 · Cited by 189
Self-citationHigh temporal resolution decoding of object position and category
Carlson, T. A., Hogendoorn, H., Kanai, R., Mesik, J., & Turret, J. (2011) · Journal of Vision · doi:10.1167/11.10.9 · Cited by 185
III-Posed problems early vision: from computational theory to analogue networks
Poggio, T., & Koch, C. (1985) · Proceedings of the Royal Society of London. Series B. Biological Sciences · doi:10.1098/rspb.1985.0097 · Cited by 180
Toward a perceptual theory of transparency.
Singh, M., & Anderson, B. L. (2002) · Psychological Review · doi:10.1037//0033-295x.109.3.492 · Cited by 176
Perceptual qualities and material classes
Fleming, R. W., Wiebel, C., & Gegenfurtner, K. (2013) · Journal of Vision · doi:10.1167/13.8.9 · Cited by 164
Self-citationSimultaneous color constancy: how surface color perception varies with the illuminant
Bäuml, K. T. (1999) · Vision Research · doi:10.1016/s0042-6989(98)00192-8 · Cited by 157
Colour PerceptionMind and the physical world
Mausfeld, R. J., & Heyer, D. (2003) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198505006.001.0001 · Cited by 149
Folding and crumpling adaptive sheets
Narain, R., Pfaff, T., & O’Brien, J. F. (2013) · ACM Transactions on Graphics · doi:10.1145/2461912.2462010 · Cited by 131
The Neurobiology of Perception
Ramachandran, V. S. (1985) · Perception · doi:10.1068/p140097 · Cited by 121
Romeiro, F., & Zickler, T. E. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15549-9_4 · Cited by 102
How direction of illumination affects visually perceived surface roughness
Ho, Y.-X., Landy, M. S., & Maloney, L. T. (2006) · Journal of Vision · doi:10.1167/6.5.8 · Cited by 101
Perception of Lightness and Illumination in a World of One Reflectance
Gilchrist, A., & Jacobsen, A. R. (1984) · Perception · doi:10.1068/p130005 · Cited by 88
Helmholtz's Treatise on Physiological Optics
S. (1925) · Science · doi:10.1126/science.61.1574.235-a · Cited by 86
Motoyoshi, I., & Matoba, H. (2011) · Vision Research · doi:10.1016/j.visres.2011.11.010 · Cited by 81
D’Zmura, M., Colantoni, P., Knoblauch, K., & Laget, B. (1997) · Perception · doi:10.1068/p260471 · Cited by 81
Adaptation-induced blindness to sluggish stimuli
Motoyoshi, I., & Hayakawa, S. (2010) · Journal of Vision · doi:10.1167/10.2.16 · Cited by 73
Scene completion using millions of photographs
Hays, J. H., & Efros, A. A. (2007) · ACM Transactions on Graphics · doi:10.1145/1239451.1239455 · Cited by 68
Ambiguity and invariance: two fundamental challenges for visual processing
Rust, N. C., & Stocker, A. A. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.04.013 · Cited by 62
Remote Effects of Highlights on Gloss Perception
Berzhanskaya, J., Gurumurthy, S., Beck, J., & Mingolla, E. (2005) · Perception · doi:10.1068/p5401 · Cited by 52
Perceived roughness of 1/fβ noise surfaces
Padilla, S., Drbohlav, O., Green, P. R., Spence, A. D., & Chantler, M. J. (2008) · Vision Research · doi:10.1016/j.visres.2008.05.015 · Cited by 42
Perceptual Assignment of Opacity to Translucent Surfaces: The Role of Image Blur
Singh, M., & Anderson, B. L. (2002) · Perception · doi:10.1068/p3363 · Cited by 40
Specular reflections and the estimation of shape from binocular disparity
Muryy, A., Welchman, A. E., Blake, A., & Fleming, R. W. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212417110 · Cited by 39
Self-citationVisual inferences of material changes: color as clue and distraction
Zaidi, Q. (2011) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.148 · Cited by 31
Simultaneous contrast and gamut relativity in achromatic color perception
Vladusich, T. (2012) · Vision Research · doi:10.1016/j.visres.2012.07.022 · Cited by 14
Metadata
- Authors
- Fleming, R. W.
- Venue
- Vision Research
- Publisher
- Elsevier BV
- Published
- 2014-01
- Volume
- 94
- Pages
- 62-75
- ISSN
- 0042-6989 (ISSN-L)
- OpenAlex
- W2166150182
- Cited by
- 331
- References
- 70
- FWCI
- 8.25
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.