The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Towards foveated rendering for gaze-tracked virtual reality
Abstract
Foveated rendering synthesizes images with progressively less detail outside the eye fixation region, potentially unlocking significant speedups for wide field-of-view displays, such as head mounted displays, where target framerate and resolution is increasing faster than the performance of traditional real-time renderers. To study and improve potential gains, we designed a foveated rendering user study to evaluate the perceptual abilities of human peripheral vision when viewing today's displays. We determined that filtering peripheral regions reduces contrast, inducing a sense of tunnel vision. When applying a postprocess contrast enhancement, subjects tolerated up to 2× larger blur radius before detecting differences from a non-foveated ground truth. After verifying these insights on both desktop and head mounted displays augmented with high-speed gaze-tracking, we designed a perceptual target image to strive for when engineering a production foveated renderer. Given our perceptual target, we designed a practical foveated rendering system that reduces number of shades by up to 70% and allows coarsened shading up to 30° closer to the fovea than Guenter et al. [2012] without introducing perceivable aliasing or blur. We filter both pre- and post-shading to address aliasing from undersampling in the periphery, introduce a novel multiresolution- and saccade-aware temporal antialising algorithm, and use contrast enhancement to help recover peripheral details that are resolvable by our eye but degraded by filtering. We validate our system by performing another user study. Frequency analysis shows our system closely matches our perceptual target. Measurements of temporal stability show we obtain quality similar to temporally filtered non-foveated renderings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Transformed Up-Down Methods in Psychoacoustics
Levitt, H. (1971) · The Journal of the Acoustical Society of America · doi:10.1121/1.1912375 · Cited by 5,477
Human photoreceptor topography
Curcio, C. A., Sloan, K. R., Kalina, R. E., & Hendrickson, A. E. (1990) · Journal of Comparative Neurology · doi:10.1002/cne.902920402 · Cited by 3,167
The psychometric function: I. Fitting, sampling, and goodness of fit
Wichmann, F. A., & Hill, N. J. (2001) · Perception & Psychophysics · doi:10.3758/bf03194544 · Cited by 2,358
Topography of ganglion cells in human retina
Curcio, C. A., & Allen, K. A. (1990) · Journal of Comparative Neurology · doi:10.1002/cne.903000103 · Cited by 1,844
(1995) · Medical Entomology and Zoology · Cited by 1,212
Peripheral vision and pattern recognition: A review
Strasburger, H., Rentschler, I., & Jüttner, M. (2011) · Journal of Vision · doi:10.1167/11.5.13 · Cited by 943
The psychometric function: II. Bootstrap-based confidence intervals and sampling
Wichmann, F. A., & Hill, N. J. (2001) · Perception & Psychophysics · doi:10.3758/bf03194545 · Cited by 810
An estimation and application of the human cortical magnification factor
Rovamo, J., & Virsu, V. (1979) · Experimental Brain Research · doi:10.1007/bf00236819 · Cited by 790
Williams, L. (1983) · Proceedings of the 10th annual conference on Computer graphics and interactive techniques · doi:10.1145/800059.801126 · Cited by 715
Vernier acuity, crowding and cortical magnification
Levi, D. M., Klein, S. A., & Aitsebaomo, A. P. (1985) · Vision Research · doi:10.1016/0042-6989(85)90207-x · Cited by 650
Human cortical magnification factor and its relation to visual acuity
Cowey, A., & Rolls, E. T. (1974) · Experimental Brain Research · doi:10.1007/bf00237163 · Cited by 403
Schütt, H. H., Harmeling, S., Macke, J. H., & Wichmann, F. A. (2016) · Vision Research · doi:10.1016/j.visres.2016.02.002 · Cited by 402
Guenter, B., Finch, M., Drucker, S., Tan, D., & Snyder, J. (2012) · ACM Transactions on Graphics · doi:10.1145/2366145.2366183 · Cited by 378
The detection of motion in the peripheral visual field
Mckee, S. P., & Nakayama, K. (1984) · Vision Research · doi:10.1016/0042-6989(84)90140-8 · Cited by 375
Williams, L. (1983) · ACM SIGGRAPH Computer Graphics · doi:10.1145/964967.801126 · Cited by 308
Retinal limits to the detection and resolution of gratings
Thibos, L. N., Cheney, F. E., & Walsh, D. J. (1987) · Journal of the Optical Society of America A · doi:10.1364/josaa.4.001524 · Cited by 255
Color perception in the intermediate periphery of the visual field
Hansen, T., Pracejus, L., & Gegenfurtner, K. R. (2009) · Journal of Vision · doi:10.1167/9.4.26 · Cited by 251
Modulation transfer of the human eye as a function of retinal eccentricity
Navarro, R., Williams, D. R., & Artal, P. (1993) · Journal of the Optical Society of America A · doi:10.1364/josaa.10.000201 · Cited by 218
Peripheral spatial vision: limits imposed by optics, photoreceptors, and receptor pooling
Banks, M. S., Sekuler, A. B., & Anderson, S. J. (1991) · Journal of the Optical Society of America A · doi:10.1364/josaa.8.001775 · Cited by 211
Resolution of gratings oriented along and across meridians in peripheral vision.
Rovamo, J. M., Virsu, V., Laurinen, P. I., & Hyvärinen, L. (1982) · PubMed · Cited by 173
Characterization of spatial aliasing and contrast sensitivity in peripheral vision
Thibos, L. N., Still, D. L., & Bradley, A. (1996) · Vision Research · doi:10.1016/0042-6989(95)00109-d · Cited by 172
Why Is Spatial Stereoresolution So Low?
Banks, M. S., Gepshtein, S., & Landy, M. S. (2004) · Journal of Neuroscience · doi:10.1523/jneurosci.3852-02.2004 · Cited by 155
Retinal inhomogeneity I Spatiotemporal contrast sensitivity
Kelly, D. H. (1984) · Journal of the Optical Society of America A · doi:10.1364/josaa.1.000107 · Cited by 149
Off-axis optical quality and retinal sampling in the human eye
Williams, D. R., Artal, P., Navarro, R., McMahon, M. J., & Brainard, D. H. (1996) · Vision Research · doi:10.1016/0042-6989(95)00182-4 · Cited by 147
Sensitivity to spatiotemporal colour contrast in the peripheral visual field
Noorlander, C., Koenderink, J. J., Olden, R. J. D., & Edens, B. W. (1983) · Vision Research · doi:10.1016/0042-6989(83)90035-4 · Cited by 146
Vision beyond the resolution limit: Aliasing in the periphery
Thibos, L. N., Walsh, D. J., & Cheney, F. E. (1987) · Vision Research · doi:10.1016/0042-6989(87)90134-9 · Cited by 138
Perceptually-based foveated virtual reality
Patney, A., Kim, J., Salvi, M., Kaplanyan, A., Wyman, C., Benty, N., Lefohn, A. E., & Luebke, D. P. (2016) · ACM SIGGRAPH Emerging Technologies · doi:10.1145/2929464.2929472 · Cited by 112
Self-citationChromatic Organization of Ganglion Cell Receptive Fields in the Peripheral Retina
Solomon, S. G., Lee, B. B., White, A. J. R., Rüttiger, L., & Martin, P. R. (2005) · Journal of Neuroscience · doi:10.1523/jneurosci.3921-04.2005 · Cited by 106
User, metric, and computational evaluation of foveated rendering methods
Swafford, N. T., Iglesias-Guitián, J. A., Koniaris, B., Moon, B., Cosker, D. P., & Mitchell, K. (2016) · ACM Symposium on Applied Perception · doi:10.1145/2931002.2931011 · Cited by 90
Identification of facial images in peripheral vision
Mäkelä, P., Näsänen, R., Rovamo, J. M., & Melmoth, D. R. (2001) · Vision Research · doi:10.1016/s0042-6989(00)00259-5 · Cited by 80
A study of sine-wave contrast sensitivity by two psychophysical methods
Kelly, D. H., & Savoie, R. E. (1973) · Perception & Psychophysics · doi:10.3758/bf03212397 · Cited by 79
Cortical Magnification Theory Fails to Predict Visual Recognition
Strasburger, H., Rentschler, I., & Harvey, L. O. (1994) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.1994.tb00548.x · Cited by 79
Perceptually based downscaling of images
Öztireli, C., & Groß, M. H. (2015) · ACM Transactions on Graphics · doi:10.1145/2766891 · Cited by 76
Cross Dissolve Without Cross Fade: Preserving Contrast, Color and Salience in Image Compositing
Grundland, M., Vohra, R., WILLIAMS, G. P., & Dodgson, N. A. (2006) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2006.00977.x · Cited by 52
Vaidyanathan, K., Salvi, M., Toth, R., et al. (2014) · Lund University Publications (Lund University) · doi:10.2312/hpg.20141089 · Cited by 50
Self-citationClarberg, P., Toth, R., Hasselgren, J., et al. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601214 · Cited by 30
Wang, Y., Thibos, L. N., & Bradley, A. (1996) · Vision Research · doi:10.1016/0042-6989(95)00249-9 · Cited by 26
Aliased Frequencies Enable the Discrimination of Compound Gratings in Peripheral Vision
Wang, Y., Bradley, A., & Thibos, L. N. (1997) · Vision Research · doi:10.1016/s0042-6989(96)00160-5 · Cited by 20
Peripheral Vision : Adaptive Optics and Psychophysics
Rosén, R. (2013) · KTH Publication Database DiVA (KTH Royal Institute of Technology) · Cited by 2
Cited by
Saliency in VR: How Do People Explore Virtual Environments?
Sitzmann, V., Serrano, A., Pavel, A., Agrawala, M., Gutierrez, D., Masia, B., & Wetzstein, G. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2793599 · Cited by 459
Eye tracking in virtual reality
Clay, V., König, P., & König, S. U. (2019) · Journal of Eye Movement Research · doi:10.16910/jemr.12.1.3 · Cited by 412
Eye Tracking in Virtual Reality: a Broad Review of Applications and Challenges
Adhanom, I. B., MacNeilage, P., & Folmer, E. (2023) · Virtual Reality · doi:10.1007/s10055-022-00738-z · Cited by 325
Exploring Eye Gaze Visualization Techniques for Identifying Distracted Students in Educational VR
Rahman, Y., Asish, S. M., Fisher, N. P., Bruce, E. C., Kulshreshth, A. K., & Borst, C. W. (2020) · 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr46266.2020.00009 · Cited by 45
Impact of Foveated Rendering on Procedural Task Training
Radkowski, R., & Raul, S. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-21607-8_20 · Cited by 5
Metadata
- Authors
- Patney, A., Salvi, M., Kim, J., Kaplanyan, A., Wyman, C., Benty, N., Luebke, D., & Lefohn, A.
- Venue
- ACM Transactions on Graphics
- Published
- 2016-11-11
- Volume
- 35
- Issue
- 6
- Pages
- 1-12
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2551546500
- Cited by
- 491
- References
- 39
- FWCI
- 107.19
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.