NeRF: representing scenes as neural radiance fields for view synthesis
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
We present a method that achieves state-of-the-art results for synthesizing novel views of complex scenes by optimizing an underlying continuous volumetric scene function using a sparse set of input views. Our algorithm represents a scene using a fully connected (nonconvolutional) deep network, whose input is a single continuous 5D coordinate (spatial location ( x , y , z ) and viewing direction ( θ, ϕ )) and whose output is the volume density and view-dependent emitted radiance at that spatial location. We synthesize views by querying 5D coordinates along camera rays and use classic volume rendering techniques to project the output colors and densities into an image. Because volume rendering is naturally differentiable, the only input required to optimize our representation is a set of images with known camera poses. We describe how to effectively optimize neural radiance fields to render photorealistic novel views of scenes with complicated geometry and appearance, and demonstrate results that outperform prior work on neural rendering and view synthesis.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Recently, Large Language Models (LLMs) were shown to be useful in generating 3D scene layouts [10, 29].”
From Holodeck: Language Guided Generation of 3D Embodied AI Environments (2024) · cites this paper as [29]
Citations
Cites
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric
Zhang, R., Isola, P., Efros, A. A., Shechtman, E., & Wang, O. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00068 · Cited by 14,623
Structure-from-Motion Revisited
Schonberger, J. L., & Frahm, J.-M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.445 · Cited by 6,433
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
Mildenhall, B., Srinivasan, P. P., Tancik, M., Barron, J. T., Ramamoorthi, R., & Ng, R. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_24 · Cited by 5,351
Self-citationDeepSDF: Learning Continuous Signed Distance Functions for Shape Representation
Park, J. J., Florence, P., Straub, J., Newcombe, R., & Lovegrove, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00025 · Cited by 3,422
A volumetric method for building complex models from range images
Curless, B., & Levoy, M. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237269 · Cited by 3,124
Occupancy Networks: Learning 3D Reconstruction in Function Space
Mescheder, L., Oechsle, M., Niemeyer, M., Nowozin, S., & Geiger, A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00459 · Cited by 2,708
ShapeNet: An Information-Rich 3D Model Repository
Chang, A. X., Funkhouser, T., Guibas, L., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al. (2015) · arXiv · doi:10.48550/arxiv.1512.03012 · Cited by 2,330
Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach
Debevec, P. E., Taylor, C. J., & Malik, J. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237191 · Cited by 1,905
Optical models for direct volume rendering
Max, N. (1995) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/2945.468400 · Cited by 1,059
Unstructured lumigraph rendering
Buehler, C., Bosse, M., McMillan, L., Gortler, S., & Cohen, M. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383309 · Cited by 881
Research works printed but not linked: 11
- Kingma , D.P. , Ba , J. Adam: A method for stochastic optimization . In ICLR ( 2015 ). Kingma, D.P., Ba, J. Adam: A method for stochastic optimization. In ICLR (2015).
- Li , T.-M. , Aittala , M. , Durand , F. , Lehtinen , J. Differentiable monte carlo ray tracing through edge sampling. ACM Trans. Graph. (SIGGRAPH Asia) ( 2018 ). Li, T.-M., Aittala, M., Durand, F., Lehtinen, J. Differentiable monte carlo ray tracing through edge sampling. ACM Trans. Graph. (SIGGRAPH Asia) (2018).
- Lombardi , S. , Simon , T. , Saragih , J. , Schwartz , G. , Lehrmann , A. , Sheikh , Y. Neural volumes: Learning dynamic renderable volumes from images. ACM Trans. Graph. (SIGGRAPH) ( 2019 ). Lombardi, S., Simon, T., Saragih, J., Schwartz, G., Lehrmann, A., Sheikh, Y. Neural volumes: Learning dynamic renderable volumes from images. ACM Trans. Graph. (SIGGRAPH) (2019).
- Mildenhall , B. , Srinivasan , P.P. , Ortiz-Cayon , R. , Kalantari , N.K. , Ramamoorthi , R. , Ng , R. , Kar , A. Local light field fusion: Practical view synthesis with prescriptive sampling guidelines. ACM Trans. Graph. (SIGGRAPH) ( 2019 ). Mildenhall, B., Srinivasan, P.P., Ortiz-Cayon, R., Kalantari, N.K., Ramamoorthi, R., Ng, R., Kar, A. Local light field fusion: Practical view synthesis with prescriptive sampling guidelines. ACM Trans. Graph. (SIGGRAPH) (2019).
- Niemeyer , M. , Mescheder , L. , Oechsle , M. , Geiger , A. Differentiable volumetric rendering: Learning implicit 3D representations without 3D supervision . In CVPR ( 2019 ). Niemeyer, M., Mescheder, L., Oechsle, M., Geiger, A. Differentiable volumetric rendering: Learning implicit 3D representations without 3D supervision. In CVPR (2019).
- Porter , T. , Duff , T. Compositing digital images. Comput. Graph. (SIGGRAPH) ( 1984 ). Porter, T., Duff, T. Compositing digital images. Comput. Graph. (SIGGRAPH) (1984).
- Rahaman , N. , Baratin , A. , Arpit , D. , Dräxler , F. , Lin , M. , Hamprecht , F.A. , Bengio , Y. , Courville , A.C. On the spectral bias of neural networks . In ICML ( 2018 ). Rahaman, N., Baratin, A., Arpit, D., Dräxler, F., Lin, M., Hamprecht, F.A., Bengio, Y., Courville, A.C. On the spectral bias of neural networks. In ICML (2018).
- Seitz , S.M. , Dyer , C.R. Photorealistic scene reconstruction by voxel coloring. Int. J. Comput. Vision ( 1999 ). Seitz, S.M., Dyer, C.R. Photorealistic scene reconstruction by voxel coloring. Int. J. Comput. Vision (1999).
- Sitzmann , V. , Zollhoefer , M. , Wetzstein , G. Scene representation networks: Continuous 3D-structure-aware neural scene representations . In NeurIPS ( 2019 ). Sitzmann, V., Zollhoefer, M., Wetzstein, G. Scene representation networks: Continuous 3D-structure-aware neural scene representations. In NeurIPS (2019).
- Tancik , M. , Srinivasan , P.P. , Mildenhall , B. , Fridovich-Keil , S. , Raghavan , N. , Singhal , U. , Ramamoorthi , R. , Barron , J.T. , Ng , R. Fourier features let networks learn high frequency functions in low dimensional domains . In NeurIPS ( 2020 ). Tancik, M., Srinivasan, P.P., Mildenhall, B., Fridovich-Keil, S., Raghavan, N., Singhal, U., Ramamoorthi, R., Barron, J.T., Ng, R. Fourier features let networks learn high frequency functions in low dimensional domains. In NeurIPS (2020).
- Zhou , T. , Tucker , R. , Flynn , J. , Fyffe , G. , Snavely , N. Stereo magnification: Learning view synthesis using multiplane images. ACM Trans. Graph. (SIGGRAPH) ( 2018 ). Zhou, T., Tucker, R., Flynn, J., Fyffe, G., Snavely, N. Stereo magnification: Learning view synthesis using multiplane images. ACM Trans. Graph. (SIGGRAPH) (2018).
Cited by
Items 101–200 of 1,011
Deep learning for accelerated and robust MRI reconstruction
Heckel, R., Jacob, M., Chaudhari, A. S., Perlman, O., & Shimron, E. (2024) · Magnetic Resonance Materials in Physics Biology and Medicine · doi:10.1007/s10334-024-01173-8 · Cited by 222
Global Structure-from-Motion Revisited
Pan, L., Baráth, D., Pollefeys, M., & Schönberger, J. L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73661-2_4 · Cited by 162
HumanNeRF: Efficiently Generated Human Radiance Field from Sparse Inputs
Zhao, F., Yang, W. H., Zhang, J., Lin, P., Zhang, Y., Yu, J., & Xu, L. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00759 · Cited by 208
SGS-SLAM: Semantic Gaussian Splatting for Neural Dense SLAM
Li, M., Liu, S., Zhou, H., Zhu, G., Cheng, N., Deng, T., & Wang, H. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72751-1_10 · Cited by 236
Multi-Scale 3D Gaussian Splatting for Anti-Aliased Rendering
Yan, Z., Low, W. F., Chen, Y., & Lee, G. H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01977 · Cited by 118
CoIL: Coordinate-Based Internal Learning for Tomographic Imaging
Sun, Y., Liu, J., Xie, M., Wohlberg, B. E., & Kamilov, U. S. (2021) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2021.3125564 · Cited by 194
High-quality Surface Reconstruction using Gaussian Surfels
Dai, P., Xu, J., Xie, W., Liu, X., Wang, H., & Xu, W. (2024) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3641519.3657441 · Cited by 282
Generative artificial intelligence: a historical perspective
He, R., Cao, J., & Tan, T. N. (2025) · National Science Review · doi:10.1093/nsr/nwaf050 · Cited by 211
SUDS: Scalable Urban Dynamic Scenes
Turki, H., Zhang, J. Y., Ferroni, F., & Ramanan, D. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01191 · Cited by 132
A Critical Analysis of NeRF-Based 3D Reconstruction
Fabio Remondino, A., Karami, A. R., Yan, Z., Mazzacca, G., Rigon, S., & Qin, R. (2023) · Remote Sensing · doi:10.3390/rs15143585 · Cited by 130
HAC: Hash-Grid Assisted Context for 3D Gaussian Splatting Compression
Chen, Y., Wu, Q., Lin, W., Harandi, M. T., & Cai, J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72667-5_24 · Cited by 355
Gaussian Head Avatar: Ultra High-Fidelity Head Avatar via Dynamic Gaussians
Xu, Y., Chen, B., Li, Z., Zhang, H., Wang, L., Zheng, Z., & Liu, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00189 · Cited by 142
MVImgNet: A Large-scale Dataset of Multi-view Images
Yu, X., Xu, M., Zhang, Y., Liu, H., Ye, C., Wu, Y., Yan, Z., Zhu, C., Xiong, Z., Liang, T., et al. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00883 · Cited by 324
Industrial Metaverse for Smart Manufacturing: Model, Architecture, and Applications
Ren, L., Dong, J., Li, Z., Laili, Y., Wang, X., Qi, Y., Li, B. H., Wang, L., Yang, L. T., & Deen, M. J. (2024) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2024.3372591 · Cited by 131
DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesis
Tang, J., Nie, Y., Markhasin, L., Dai, A., Thies, J., & Nießner, M. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01938 · Cited by 106
Visual SLAM Integration With Semantic Segmentation and Deep Learning: A Review
Pu, H., Luo, J., Wang, G., Huang, T., Liu, H., & Luo, J. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3306371 · Cited by 132
BAD-NeRF: Bundle Adjusted Deblur Neural Radiance Fields
Wang, P., Zhao, L., Ma, R., & Liu, P. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00406 · Cited by 171
Accelerated Coordinate Encoding: Learning to Relocalize in Minutes Using RGB and Poses
Brachmann, E., Cavallari, T., & Prisacariu, V. A. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00488 · Cited by 202
Advances of machine learning in materials science: Ideas and techniques
Chong, S. S., Ng, Y. S., Wang, H., & Zheng, J. (2023) · Frontiers of Physics · doi:10.1007/s11467-023-1325-z · Cited by 125
Relightable Gaussian Codec Avatars
Saito, S., Schwartz, G., Simon, T., Li, J., & Nam, G. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00021 · Cited by 150
TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Composition
Lu, S., Liu, Y., & Kong, A. W. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00218 · Cited by 258
Face Generation and Editing With StyleGAN: A Survey
Melnik, A., Miasayedzenkau, M., Makaravets, D., Pirshtuk, D., Akbulut, E., Holzmann, D., Renusch, T., Reichert, G., & Ritter, H. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3350004 · Cited by 105
StyleRF: Zero-Shot 3D Style Transfer of Neural Radiance Fields
Liu, K., Zhan, F., Chen, Y., Zhang, J., Yu, Y., Saddik, A. E., Lu, S., & Xing, E. P. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00806 · Cited by 162
DreamEditor: Text-Driven 3D Scene Editing with Neural Fields
Zhuang, J., Wang, C., Lin, L., Liu, L., & Li, G. (2023) · SIGGRAPH Asia Conference Papers · doi:10.1145/3610548.3618190 · Cited by 221
Alpha-CLIP: A CLIP Model Focusing on Wherever you Want
Sun, Z., Fang, Y., Wu, T., Zhang, P., Zang, Y., Kong, S., Xiong, Y., Lin, D., & Wang, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01237 · Cited by 263
Label-Free Liver Tumor Segmentation
Hu, Q., Chen, Y., Xiao, J., Sun, S.-W., Chen, J., Yuille, A., & Zhou, Z. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00717 · Cited by 157
Conditional neural field latent diffusion model for generating spatiotemporal turbulence
Du, P., Parikh, M. H., Fan, X., Liu, X., & Wang, J. (2024) · Nature Communications · doi:10.1038/s41467-024-54712-1 · Cited by 225
NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstruction
Zhang, X., Bi, S., Sunkavalli, K., Su, H., & Xu, Z. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00537 · Cited by 153
Identity-Preserving Talking Face Generation with Landmark and Appearance Priors
Zhong, W., Fang, C., Cai, Y., Wei, P., Zhao, G., Lin, L., & Li, G. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00938 · Cited by 102
Mixed Neural Voxels for Fast Multi-view Video Synthesis
Wang, F., Tan, S., Li, X., Tian, Z., Song, Y., & Liu, H. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01805 · Cited by 180
Artificial Intelligence for Digital Heritage Innovation: Setting up a R&D Agenda for Europe
Münster, S., Maiwald, F., di Lenardo, I., Henriksson, J., Isaac, A., Graf, M., Beck, C., & Oomen, J. (2024) · Heritage · doi:10.3390/heritage7020038 · Cited by 170
Cao, J., Wang, Q., Xian, Y., Li, Y., Ni, B., Pi, Z., Zhang, K., Zhang, Y., Timofte, R., & Gool, L. V. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00179 · Cited by 172
Synthetic Datasets for Autonomous Driving: A Survey
Song, Z., He, Z., Li, X., Ma, Q., Ming, R., Mao, Z., Pei, H., Peng, L., Hu, J., Yao, D., et al. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3331024 · Cited by 163
Yu, S., Liu, X., Tan, Q., Wang, Z., & Zhang, B. (2024) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2024.109229 · Cited by 124
Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatars
Sun, J., Wang, X., Wang, L., Li, X., Zhang, Y., Zhang, H., & Liu, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02011 · Cited by 176
NeuralFeels with neural fields: Visuotactile perception for in-hand manipulation
Suresh, S., Qi, H., Wu, T., Fan, T., Pineda, L., Lambeta, M., Malik, J., Kalakrishnan, M., Calandra, R., Kaess, M., et al. (2024) · Science Robotics · doi:10.1126/scirobotics.adl0628 · Cited by 214
Continuous 3D Perception Model with Persistent State
Wang, Q., Zhang, Y., Holynski, A., Efros, A. A., & Kanazawa, A. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00983 · Cited by 680
EventNeRF: Neural Radiance Fields from a Single Colour Event Camera
Rudnev, V., Elgharib, M. A., Theobalt, C., & Golyanik, V. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00483 · Cited by 139
SNI-SLAM: Semantic Neural Implicit SLAM
Zhu, S., Wang, G., Blum, H., Liu, J., Song, L., Pollefeys, M., & Wang, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02000 · Cited by 173
AbsGS: Recovering Fine Details in 3D Gaussian Splatting
Ye, Z., Li, W., Liu, S., Qiao, P., & Dou, Y. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681361 · Cited by 102
Holodeck: Language Guided Generation of 3D Embodied AI Environments
Yang, Y., Sun, F.-Y., Weihs, L., Vanderbilt, E., Herrasti, A., Han, W., Wu, J., Haber, N., Krishna, R., Liu, L., et al. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01536 · Cited by 101
High-fidelity 3D reconstruction of plants using Neural Radiance Fields
Hu, K., Wei, Y. J., Pan, Y., Kang, H., & Chen, C. (2024) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2024.108848 · Cited by 106
3D-aware Image Synthesis via Learning Structural and Textural Representations
Xu, Y., Peng, S., Yang, C., Shen, Y., & Zhou, B. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01788 · Cited by 134
VGGSfM: Visual Geometry Grounded Deep Structure from Motion
Wang, J., Karaev, N., Rupprecht, C., & Novotný, D. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02049 · Cited by 340
CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Model
Wang, Z., Wang, Y., Chen, Y., Xiang, C., Chen, S., Yu, D., Li, C., Su, H., & Zhu, J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72751-1_4 · Cited by 193
WHU-Urban3D: An urban scene LiDAR point cloud dataset for semantic instance segmentation
Han, X., Liu, C., Zhou, Y., Tan, K., Dong, Z., & Yang, B. (2024) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2024.02.007 · Cited by 115
Text2NeRF: Text-Driven 3D Scene Generation With Neural Radiance Fields
Zhang, J., Li, X., Wan, Z., Wang, C., & Liao, J. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3361502 · Cited by 94
Infinite Photorealistic Worlds Using Procedural Generation
Raistrick, A., Lipson, L., Ma, Z., Mei, L., Wang, M., Zuo, Y., Kayan, K., Wen, H., Han, B., Wang, Y., et al. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01215 · Cited by 250
MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatar
Chen, Y., Wang, L., Li, Q., Xiao, H., Zhang, S., Yao, H., & Liu, Y. (2024) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3641519.3657499 · Cited by 167
Recent Advances in Deep Learning for Protein-Protein Interaction Analysis: A Comprehensive Review
Lee, M. (2023) · Molecules · doi:10.3390/molecules28135169 · Cited by 112
NeuralLift-360: Lifting an in-the-Wild 2D Photo to A 3D Object with 360° Views
Xu, D., Jiang, Y., Wang, P., Fan, Z., Wang, Y., & Wang, Z. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00435 · Cited by 88
VectorFusion: Text-to-SVG by Abstracting Pixel-Based Diffusion Models
Jain, A., Xie, A., & Abbeel, P. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00190 · Cited by 206
X-Avatar: Expressive Human Avatars
Shen, K., Guo, C., Kaufmann, M., Zarate, J., Valentin, J., Song, J., & Hilliges, O. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01622 · Cited by 149
Overview Frequency Principle/Spectral Bias in Deep Learning
Xu, Z. J., Zhang, Y., & Luo, T. (2024) · Communications on Applied Mathematics and Computation · doi:10.1007/s42967-024-00398-7 · Cited by 216
Progressively Optimized Local Radiance Fields for Robust View Synthesis
Meuleman, A., Liu, Y.-L., Gao, C., Huang, J., Kim, C., Kim, M. H., & Kopf, J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01587 · Cited by 144
Rebain, D., Matthews, M. A., Yi, K. M., Lagun, D., & Tagliasacchi, A. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00161 · Cited by 113
Large-Scale 3D Reconstruction from Multi-View Imagery: A Comprehensive Review
Luo, H., Zhang, J., Liu, X., Zhang, L., & Liu, J. (2024) · Remote Sensing · doi:10.3390/rs16050773 · Cited by 107
SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Field
Bao, C. G., Zhang, Y., Yang, B., Fan, T., Yang, Z., Bao, H., Zhang, G., & Cui, Z. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02004 · Cited by 147
NerfAcc: Efficient Sampling Accelerates NeRFs
Li, R., Gao, H., Tancik, M., & Kanazawa, A. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01699 · Cited by 83
Self-citationHOLODIFFUSION: Training a 3D Diffusion Model Using 2D Images
Karnewar, A., Vedaldi, A., Novotný, D., & Mitra, N. J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01767 · Cited by 155
RobustNeRF: Ignoring Distractors with Robust Losses
Sabour, S., Vora, S., Duckworth, D., Krasin, I., Fleet, D. J., & Tagliasacchi, A. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01976 · Cited by 94
SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis
Peng, Z., Hu, W., Shi, Y., Zhu, X., Zhang, X., Zhao, H., He, J., Liu, H., & Fan, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00070 · Cited by 179
Pix2NeRF: Unsupervised Conditional $\pi$-GAN for Single Image to Neural Radiance Fields Translation
Cai, S., Obukhov, A., Dai, D., & Gool, L. V. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00395 · Cited by 107
Shao, R., Zhang, H., Zhang, H., Chen, M., Cao, Y., Yu, T., & Liu, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01541 · Cited by 107
PLGSLAM: Progressive Neural Scene Represenation with Local to Global Bundle Adjustment
Deng, T., Shen, G., Qin, T., Wang, J., Zhao, W., Wang, J., Wang, D., & Chen, W. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01859 · Cited by 94
DN-SLAM: A Visual SLAM With ORB Features and NeRF Mapping in Dynamic Environments
Ruan, C., Zang, Q., Zhang, K., & Huang, K. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3345877 · Cited by 85
Reconstructing Surfaces for Sparse Point Clouds with On-Surface Priors
Ma, B., Liu, Y.-S., & Han, Z. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00621 · Cited by 119
Surface Reconstruction from Point Clouds by Learning Predictive Context Priors
Ma, B., Liu, Y.-S., Zwicker, M., & Han, Z. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00622 · Cited by 112
Towards accurate image stitching for drone-based wind turbine blade inspection
Yang, C., Liu, X., Zhou, H., Ke, Y., & See, J. (2022) · Renewable Energy · doi:10.1016/j.renene.2022.12.063 · Cited by 78
NeuRBF: A Neural Fields Representation with Adaptive Radial Basis Functions
Chen, Z., Li, Z., Song, L., Chen, L., Yu, J., Yuan, J., & Xu, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00386 · Cited by 128
Ha, S., Yeon, J., & Yu, H. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72764-1_11 · Cited by 165
Editable Scene Simulation for Autonomous Driving via Collaborative LLM-Agents
Wei, Y., Wang, Z., Lu, Y., Xu, C., Liu, C., Zhao, H., Chen, S., & Wang, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01428 · Cited by 189
Learning Neural Volumetric Representations of Dynamic Humans in Minutes
Chen, G., Peng, S., Xu, Z., Bao, H., & Zhou, X. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00846 · Cited by 121
Consistent View Synthesis with Pose-Guided Diffusion Models
Tseng, H.-Y., Li, Q., Kim, C., Alsisan, S., Huang, J., & Kopf, J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01609 · Cited by 165
Learning quadrotor dynamics for precise, safe, and agile flight control
Saviolo, A., & Loianno, G. (2023) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2023.03.009 · Cited by 98
An Introduction to Neural Data Compression
Yang, Y., Mandt, S., & Theis, L. (2023) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000107 · Cited by 162
A Survey of 6DoF Object Pose Estimation Methods for Different Application Scenarios
Guan, J., Hao, Y., Wu, Q., Li, S., & Fang, Y. (2024) · Sensors · doi:10.3390/s24041076 · Cited by 111
Multi-stage neural networks: Function approximator of machine precision
Wang, Y., & Lai, C. (2024) · Journal of Computational Physics · doi:10.1016/j.jcp.2024.112865 · Cited by 150
RenderOcc: Vision-Centric 3D Occupancy Prediction with 2D Rendering Supervision
Pan, M., Liu, J., Zhang, R., Huang, P., Li, X., Xie, H., Wang, B., Liu, L., & Zhang, S. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611537 · Cited by 191
Artificial intelligence for science in quantum, atomistic, and continuum systems
Zhang, X., Wang, L., Helwig, J., Luo, Y., Fu, C., Xie, Y., Liu, M., Lin, Y., Zhao, X., Yan, K., et al. (2025) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000115 · Cited by 256
A multifaceted vision of the human-AI collaboration: a comprehensive review
Puerta-Beldarrain, M., Gómez-Carmona, O., Sánchez-Corcuera, R., Casado-Mansilla, D., López-de-Ipiña, D., & Chen, L. (2025) · IEEE Access · doi:10.1109/access.2025.3536095 · Cited by 73
Multi-Realism Image Compression with a Conditional Generator
Agustsson, E., Minnen, D. C., Toderici, G. D., & Mentzer, F. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02138 · Cited by 142
PermutoSDF: Fast Multi-View Reconstruction with Implicit Surfaces Using Permutohedral Lattices
Roşu, R. A., & Behnke, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00818 · Cited by 118
Compressing Volumetric Radiance Fields to 1 MB
Li, L., Shen, Z., Wang, Z., Shen, L., & Bo, L. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00411 · Cited by 121
Evaluating Neural Radiance Fields for 3D Plant Geometry Reconstruction in Field Conditions
Arshad, M., Jubery, T. Z., Afful, J., Jignasu, A., Balu, A., Ganapathysubramanian, B., Sarkar, S., & Krishnamurthy, A. (2024) · Plant Phenomics · doi:10.34133/plantphenomics.0235 · Cited by 89
DynaMight: estimating molecular motions with improved reconstruction from cryo-EM images
Schwab, J., Kimanius, D., Burt, A., Dendooven, T., & Scheres, S. H. W. (2024) · Nature Methods · doi:10.1038/s41592-024-02377-5 · Cited by 90
4K4D: Real-Time 4D View Synthesis at 4K Resolution
Xu, Z., Peng, S., Lin, H., He, G., Sun, J., Shen, Y., Bao, H., & Zhou, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01893 · Cited by 98
Human-Computer Interaction System: A Survey of Talking-Head Generation
Zhen, R., Song, W., He, Q., Cao, J., Shi, L., & Luo, J. (2023) · Electronics · doi:10.3390/electronics12010218 · Cited by 106
$\text{NPBG++}$: Accelerating Neural Point-Based Graphics
Rakhimov, R., Ardelean, A.-T., Lempitsky, V., & Burnaev, E. V. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01550 · Cited by 79
LIV-GaussMap: LiDAR-Inertial-Visual Fusion for Real-Time 3D Radiance Field Map Rendering
Hong, S., He, J., Zheng, X., & Zheng, C. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3400149 · Cited by 105
CoR-GS: Sparse-View 3D Gaussian Splatting via Co-regularization
Zhang, J., Li, J., Yu, X., Huang, L., Gu, L., Zheng, J. J., & Bai, X. P. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73232-4_19 · Cited by 213
ObjectFolder 2.0: A Multisensory Object Dataset for Sim2Real Transfer
Gao, R., Si, Z., Chang, Y.-Y., Clarke, S., Bohg, J., Fei-Fei, L., Yuan, W., & Wu, J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01034 · Cited by 68
CAPRI-Net: Learning Compact CAD Shapes with Adaptive Primitive Assembly
Yu, F., Chen, Z., Li, M., Sanghi, A., Shayani, H., Amiri, A. M., & Zhang, H. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01147 · Cited by 127
DreamFace: Progressive Generation of Animatable 3D Faces under Text Guidance
Zhang, L., Qiu, Q., Lin, H., Zhang, Q., Cheng, S., Yang, W., Shi, Y., Yang, S., Xu, L., & Yu, J. (2023) · ACM Transactions on Graphics · doi:10.1145/3592094 · Cited by 126
Temporal Interpolation is all You Need for Dynamic Neural Radiance Fields
Park, S., Son, M., Jang, S.-H., Ahn, Y. C., Kim, J., & Kang, N. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00410 · Cited by 107
Implicit Anatomical Rendering for Medical Image Segmentation with Stochastic Experts
You, C., Dai, W., Min, Y., Staib, L. H., & Duncan, J. S. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43898-1_54 · Cited by 73
Gaussian Splatting: 3D Reconstruction and Novel View Synthesis: A Review
Dalal, A., Hagen, D., Robbersmyr, K. G., & Knausgård, K. M. (2024) · IEEE Access · doi:10.1109/access.2024.3408318 · Cited by 115
SelfOcc: Self-Supervised Vision-Based 3D Occupancy Prediction
Huang, Y., Zheng, W., Zhang, B., Zhou, J. N., & Lu, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01885 · Cited by 178
Learning Radio Environments by Differentiable Ray Tracing
Hoydis, J., Aoudia, F. A., Cammerer, S., Euchner, F., Nimier-David, M., ten Brink, S., & Keller, A. (2024) · IEEE Transactions on Machine Learning in Communications and Networking · doi:10.1109/tmlcn.2024.3474639 · Cited by 89
Hybrid Neural Fusion for Full-frame Video Stabilization
Liu, Y.-L., Lai, W., Yang, M., Chuang, Y., & Huang, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00230 · Cited by 75
Metadata
- Authors
- Mildenhall, B., Srinivasan, P. P., Tancik, M., Barron, J. T., Ramamoorthi, R., & Ng, R.
- Affiliations
- University of California, Berkeley (US)
- Google (United States) (US)
- University of California San Diego (US)
- Venue
- Communications of the ACM
- Published
- 2021-12-17
- Volume
- 65
- Issue
- 1
- Pages
- 99-106
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W4200150166
- Cited by
- 6,852
- References
- 13
- Citations by year
- 2026: 1802 · 2025: 2474 · 2024: 1675 · 2023: 756 · 2022: 134 · 2021: 11
- FWCI
- 365.48
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Communications of the ACM (publishedVersion, cc-by)
- Funders
- Office of Naval Research (N000141712687, N000141912293, N000142012529)
- National Science Foundation (1730158)
- Topics
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › 3D Shape Modeling and Analysis
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Computer Graphics and Visualization Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Keywords
- neural radiance fields, view synthesis, novel view synthesis, neural rendering, volume rendering, differentiable rendering, photorealistic rendering, scene representation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.