The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Performance relighting and reflectance transformation with time-multiplexed illumination
Abstract
We present a technique for capturing an actor's live-action performance in such a way that the lighting and reflectance of the actor can be designed and modified in postproduction. Our approach is to illuminate the subject with a sequence of time-multiplexed basis lighting conditions, and to record these conditions with a high-speed video camera so that many conditions are recorded in the span of the desired output frame interval. We investigate several lighting bases for representing the sphere of incident illumination using a set of discrete LED light sources, and we estimate and compensate for subject motion using optical flow and image warping based on a set of tracking frames inserted into the lighting basis. To composite the illuminated performance into a new background, we include a time-multiplexed matte within the basis. We also show that the acquired data enables time-varying surface normals, albedo, and ambient occlusion to be estimated, which can be used to transform the actor's reflectance to produce both subtle and stylistic effects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
2011 International Conference on Computer Vision
(2011) · doi:10.1109/iccv17851.2011 · Cited by 2,860
Photometric Method For Determining Surface Orientation From Multiple Images
Woodham, R. J. (1980) · Optical Engineering · doi:10.1117/12.7972479 · Cited by 2,003
Porter, T., & Duff, T. (1984) · Proceedings of the 11th annual conference on Computer graphics and interactive techniques · doi:10.1145/800031.808606 · Cited by 1,164
Acquiring the reflectance field of a human face
Debevec, P., Hawkins, T., Tchou, C., Duiker, H.-P., Sarokin, W., & Sagar, M. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.344855 · Cited by 1,018
Self-citationDebevec, P. (2008) · ACM SIGGRAPH 2008 classes · doi:10.1145/1401132.1401175 · Cited by 969
Self-citationRaskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L., & Fuchs, H. (1998) · Proceedings of the 25th annual conference on Computer graphics and interactive techniques - SIGGRAPH '98 · doi:10.1145/280814.280861 · Cited by 833
Sloan, P., Kautz, J., & Snyder, J. (2002) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/566570.566612 · Cited by 796
Porter, T., & Duff, T. (1984) · ACM SIGGRAPH Computer Graphics · doi:10.1145/964965.808606 · Cited by 727
Malzbender, T., Gelb, D., & Wolters, H. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383320 · Cited by 648
Conference on Computer Vision and Pattern Recognition (CVPR) 2022
(2021) · The Photogrammetric Record · doi:10.1111/phor.9_12391 · Cited by 608
Real-time 3D model acquisition
Rusinkiewicz, S., Hall-Holt, O., & Levoy, M. (2002) · Proceedings of the 29th annual conference on Computer graphics and interactive techniques · doi:10.1145/566570.566600 · Cited by 576
Design galleries: a general approach to setting parameters for computer graphics and animation
Marks, J., Ruml, W., Ryall, K., Seims, J., Shieber, S., Andalman, B., Beardsley, P. A., Freeman, W., Gibson, S., Hodgins, J., et al. (1997) · Proceedings of the 24th annual conference on Computer graphics and interactive techniques - SIGGRAPH '97 · doi:10.1145/258734.258887 · Cited by 551
Spacetime faces: high resolution capture for modeling and animation
Zhang, L., Snavely, N., Curless, B., & Seitz, S. M. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015759 · Cited by 493
Sloan, P., Kautz, J., & Snyder, J. (2002) · ACM Transactions on Graphics · doi:10.1145/566654.566612 · Cited by 462
A framework for the robust estimation of optical flow
Black, M. J., & Anandan, P. (2002) · 1993 (4th) International Conference on Computer Vision · doi:10.1109/iccv.1993.378214 · Cited by 454
Smith, A. R., & Blinn, J. F. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237263 · Cited by 404
Kang, S. B., Uyttendaele, M., Winder, S., & Szeliski, R. (2003) · ACM SIGGRAPH 2003 Papers · doi:10.1145/1201775.882270 · Cited by 395
Guenter, B., Grimm, C., Wood, D., Malvar, H., & Pighin, F. (2006) · ACM SIGGRAPH 2006 Courses on - SIGGRAPH '06 · doi:10.1145/1185657.1185858 · Cited by 387
Kang, S. B., Uyttendaele, M., Winder, S., & Szeliski, R. (2003) · ACM Transactions on Graphics · doi:10.1145/882262.882270 · Cited by 387
Real-time 3D model acquisition
Rusinkiewicz, S., Hall-Holt, O., & Levoy, M. (2002) · ACM Transactions on Graphics · doi:10.1145/566654.566600 · Cited by 319
All-frequency shadows using non-linear wavelet lighting approximation
Ng, R., Ramamoorthi, R., & Hanrahan, P. (2003) · ACM SIGGRAPH Conference Papers (SIGGRAPH) · doi:10.1145/1201775.882280 · Cited by 317
All-frequency shadows using non-linear wavelet lighting approximation
Ng, R., Ramamoorthi, R., & Hanrahan, P. (2003) · ACM Transactions on Graphics · doi:10.1145/882262.882280 · Cited by 260
Guenter, B., Grimm, C., Wood, D., Malvar, H., & Pighin, F. (1998) · Proceedings of the 25th annual conference on Computer graphics and interactive techniques - SIGGRAPH '98 · doi:10.1145/280814.280822 · Cited by 258
Real-time tracking of image regions with changes in geometry and illumination
Hager, G. D., & Belhumeur, P. N. (1996) · Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1996.517104 · Cited by 222
Non-photorealistic camera: depth edge detection and stylized rendering using multi-flash imaging
Raskar, R., Tan, K.-H., Feris, R., Jingyi Yu, A., & Turk, M. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015779 · Cited by 214
Production-Ready Global Illumination
Landis, H. (2004) · Cited by 187
Efficient Re-rendering of Naturally Illuminated Environments
Nimeroff, J. S., Simoncelli, E. P., & Dorsey, J. O. (1995) · Springer eBooks · doi:10.1007/978-3-642-87825-1_27 · Cited by 148
Nishino, K., & Nayar, S. K. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015783 · Cited by 137
Face relighting with radiance environment maps
Wen, Z., Liu, Z., & Huang, T. S. (2003) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2003.1211466 · Cited by 115
Modeling and Rendering for Realistic Facial Animation
Marschner, S. R., Guenter, B. K., & Raghupathy, S. (2000) · Eurographics · doi:10.1007/978-3-7091-6303-0_21 · Cited by 114
Animatable Facial Reflectance Fields
Hawkins, T., Wenger, A., Tchou, C., Gardner, A., Göransson, F., & Debevec, P. E. (2004) · Eurographics Symposium on Rendering Techniques · doi:10.2312/egwr/egsr04/309-319 · Cited by 65
Self-citationA fast relighting engine for interactive cinematic lighting design
Gershbein, R., & Hanrahan, P. (2000) · ACM SIGGRAPH Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH) · doi:10.1145/344779.344938 · Cited by 41
Cited by
Analysis of human faces using a measurement-based skin reflectance model
Weyrich, T., Matusik, W., Pfister, H., Bickel, B., Donner, C., Tu, C., McAndless, J., Lee, J., Ngan, A., Jensen, H. W., et al. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141987 · Cited by 291
Programmable aperture photography: multiplexed light field acquisition
Liang, C.-K., Lin, T.-H., Wong, B.-Y., Liu, C., & Chen, H. H. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360654 · Cited by 261
Reconstruction of Personalized 3D Face Rigs from Monocular Video
Garrido, P., Zollhöfer, M., Casas, D., Valgaerts, L., Varanasi, K., Pérez, P., & Theobalt, C. (2016) · ACM Transactions on Graphics · doi:10.1145/2890493 · Cited by 260
Single image portrait relighting
Sun, T., Barron, J. T., Tsai, Y.-T., Xu, Z., Yu, X., Fyffe, G., Rhemann, C., Busch, J., Debevec, P., & Ramamoorthi, R. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3323008 · Cited by 259
Self-citationSelf-supervised 3D Representation Learning of Dressed Humans from Social Media Videos
Jafarian, Y., & Park, H. S. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3231558 · Cited by 12
Metadata
- Authors
- Wenger, A., Gardner, A., Tchou, C., Unger, J., Hawkins, T., & Debevec, P.
- Venue
- ACM Transactions on Graphics
- Published
- 2005-07
- Volume
- 24
- Issue
- 3
- Pages
- 756-764
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2009196333
- Cited by
- 255
- References
- 32
- FWCI
- 34.13
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.