The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Structured 3D Latents for Scalable and Versatile 3D Generation
Open accessAbstract
We introduce a novel 3D generation method for versatile and high-quality 3D asset creation. The cornerstone is a unified Structured LATent (SLat) representation which allows decoding to different output formats, such as Radiance Fields, 3D Gaussians, and meshes. This is achieved by integrating a sparsely-populated 3D grid with dense multiview visual features extracted from a powerful vision foundation model, comprehensively capturing both structural (geometry) and textural (appearance) information while maintaining flexibility during decoding.We employ rectified flow transformers tailored for SLat as our 3D generation models and train models with up to 2 billion parameters on a large 3D asset dataset of 500K diverse objects. Our model generates high-quality results with text or image conditions, significantly surpassing existing methods, including recent ones at similar scales. We showcase flexible output format selection and local 3D editing capabilities which were not offered by previous models. Project Page: trellis3d.github.io.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric
Zhang, R., Isola, P., Efros, A. A., Shechtman, E., & Wang, O. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00068 · Cited by 14,623
Decoupled Weight Decay Regularization
Loshchilov, I., & Hutter, F. (2017) · arXiv · doi:10.48550/arxiv.1711.05101 · Cited by 12,522
NeRF: representing scenes as neural radiance fields for view synthesis
Mildenhall, B., Srinivasan, P. P., Tancik, M., Barron, J. T., Ramamoorthi, R., & Ng, R. (2022) · Communications of the ACM · doi:10.1145/3503250 · Cited by 6,852
3D Gaussian Splatting for Real-Time Radiance Field Rendering
Kerbl, B., Kopanas, G., Leimkuehler, T., & Drettakis, G. (2023) · ACM Transactions on Graphics · doi:10.1145/3592433 · Cited by 6,025
DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation
Park, J. J., Florence, P., Straub, J., Newcombe, R., & Lovegrove, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00025 · Cited by 3,422
Occupancy Networks: Learning 3D Reconstruction in Function Space
Mescheder, L., Oechsle, M., Niemeyer, M., Nowozin, S., & Geiger, A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00459 · Cited by 2,708
Scalable Diffusion Models with Transformers
Peebles, W., & Xie, S. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00387 · Cited by 2,284
Scalable Diffusion Models with Transformers
Peebles, W., & Xie, S. (2022) · arXiv · doi:10.48550/arxiv.2212.09748 · Cited by 2,284
RePaint: Inpainting using Denoising Diffusion Probabilistic Models
Lugmayr, A., Danelljan, M., Romero, A., Yu, F., Timofte, R., & Van Gool, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01117 · Cited by 1,778
Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling
Wu, J., Zhang, C., Xue, T., Freeman, W. T., & Tenenbaum, J. B. (2016) · arXiv · doi:10.48550/arxiv.1610.07584 · Cited by 1,393
Efficient Geometry-aware 3D Generative Adversarial Networks
Chan, E. R., Lin, C. Z., Chan, M. A., Nagano, K., Pan, B., de Mello, S., Gallo, O., Guibas, L., Tremblay, J., Khamis, S., et al. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01565 · Cited by 1,093
O-CNN: octree-based convolutional neural networks for 3D shape analysis
Wang, P.-S., Liu, Y., Guo, Y.-X., Sun, C.-Y., & Tong, X. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073608 · Cited by 884
Self-citationMagic3D: High-Resolution Text-to-3D Content Creation
Lin, C.-H., Gao, J., Tang, L., Takikawa, T., Zeng, X., Huang, X., Kreis, K., Fidler, S., Liu, M.-Y., & Lin, T.-Y. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00037 · Cited by 857
Zero-1-to-3: Zero-shot One Image to 3D Object
Liu, R., Wu, R., Van Hoorick, B., Tokmakov, P., Zakharov, S., & Vondrick, C. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00853 · Cited by 841
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2021) · arXiv · doi:10.48550/arxiv.2112.10752 · Cited by 737
Diffusion Probabilistic Models for 3D Point Cloud Generation
Luo, S., & Hu, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00286 · Cited by 628
Scaffold-GS: Structured 3D Gaussians for View-Adaptive Rendering
Lu, T., Yu, M., Xu, L., Xiangli, Y., Wang, L., Lin, D., & Dai, B. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01952 · Cited by 491
GS-LRM: Large Reconstruction Model for 3D Gaussian Splatting
Zhang, K., Bi, S., Tan, H., Xiangli, Y., Zhao, N., Sunkavalli, K., & Xu, Z. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72670-5_1 · Cited by 407
Wonder3D: Single Image to 3D Using Cross-Domain Diffusion
Long, X., Guo, Y.-C., Lin, C., Liu, Y., Dou, Z., Liu, L., Ma, Y., Zhang, S.-H., Habermann, M., Theobalt, C., et al. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.00951 · Cited by 377
One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion
Liu, M., Shi, R., Chen, L., Zhang, Z., Xu, C., Wei, X., Chen, H., Zeng, C., Gu, J., & Su, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00960 · Cited by 281
Swin3D: A Pretrained Transformer Backbone for 3D Indoor Scene Understanding
Yang, Y., Guo, Y., Xiong, J.-Y., Liu, Y., Pan, H., Wang, P., Tong, X., & Guo, B. (2025) · Computational Visual Media · doi:10.26599/cvm.2025.9450383 · Cited by 278
Self-citationDiffRF: Rendering-Guided 3D Radiance Field Diffusion
Muller, N. E., Siddiqui, Y., Porzi, L., Bulò, S. R., Kontschieder, P., & Nießner, M. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00421 · Cited by 263
Root Mean Square Layer Normalization
Zhang, B., & Sennrich, R. (2019) · arXiv · doi:10.48550/arxiv.1910.07467 · Cited by 262
Self-citationXCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchies
Ren, X.-C., Huang, J.-H., Zeng, X., Museth, K., Fidler, S., & Williams, F. (2023) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52733.2024.00403 · Cited by 256
Zou, Z., Yu, Z., Guo, Y., Li, Y., Ding, L., Cao, Y., & Zhang, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00983 · Cited by 245
LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matching
Liang, Y., Yang, X., Lin, J., Li, H., Xu, X., & Chen, Y.-C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00623 · Cited by 244
Flexible Isosurface Extraction for Gradient-Based Mesh Optimization
Shen, T., Munkberg, J., Hasselgren, J., Yin, K., Wang, Z., Chen, W., Gojčič, Ž., Fidler, S., Sharp, N., & Gao, J. (2023) · ACM Transactions on Graphics · doi:10.1145/3592430 · Cited by 238
LGM: Large Multi-view Gaussian Model for High-Resolution 3D Content Creation
Tang, J., Chen, Z., Chen, X., Wang, T., Zeng, G., & Liu, Z. (2025) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-73235-5_1 · Cited by 226
Locally Attentional SDF Diffusion for Controllable 3D Shape Generation
Zheng, X., Pan, H., Wang, P., Tong, X., Liu, Y., & Shum, H. (2023) · ACM Transactions on Graphics · doi:10.1145/3592103 · Cited by 219
Self-citationRODIN: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion
Wang, T., Zhang, B., Zhang, T., Gu, S., Bao, J., Baltrusaitis, T., Shen, J., Chen, D., Wen, F., Chen, Q., et al. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00443 · Cited by 209
Self-citationGRAM: Generative Radiance Manifolds for 3D-Aware Image Generation
Deng, Y., Yang, J., Xiang, J., & Tong, X. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01041 · Cited by 206
Self-citationMake-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior
Tang, J., Wang, T., Zhang, B., Zhang, T., Yi, R., Ma, L., & Chen, D. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02086 · Cited by 206
Self-citationSDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generation
Cheng, Y.-C., Lee, H.-Y., Tulyakov, S., Schwing, A., & Gui, L. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00433 · Cited by 204
3D-FUTURE: 3D Furniture Shape with TextURE
Fu, H., Jia, R., Gao, L., Gong, M., Zhao, B., Maybank, S., & Tao, D. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01534-z · Cited by 198
3DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Models
Zhang, B., Tang, J., Nießner, M., & Wonka, P. (2023) · ACM Transactions on Graphics · doi:10.1145/3592442 · Cited by 178
Self-citationNeural Wavelet-domain Diffusion for 3D Shape Generation
Hui, K.-H., Li, R., Hu, J., & Fu, C. (2022) · SIGGRAPH Asia Conference Papers · doi:10.1145/3550469.3555394 · Cited by 173
3D Neural Field Generation Using Triplane Diffusion
Shue, J. R., Chan, E. R., Po, R., Ankner, Z., Wu, J., & Wetzstein, G. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.02000 · Cited by 169
Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstruction
Chen, H., Gu, J., Chen, A., Tian, W., Tu, Z., Liu, L., & Su, H. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00229 · Cited by 160
CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assets
Zhang, L., Wang, Z., Zhang, Q., Qiu, Q., Pang, A., Jiang, H., Yang, W., Xu, L., & Yu, J. (2024) · ACM Transactions on Graphics · doi:10.1145/3658146 · Cited by 160
ABO: Dataset and Benchmarks for Real-World 3D Object Understanding
Collins, J., Goel, S., Deng, K., Luthra, A., Xu, L., Gundogdu, E., Zhang, X., Vicente, T. F. Y., Dideriksen, T., Arora, H., et al. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.02045 · Cited by 158
Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Bias
Stojanov, S., Thai, A., & Rehg, J. M. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00184 · Cited by 143
SDF‐StyleGAN: Implicit SDF‐Based StyleGAN for 3D Shape Generation
Zheng, X., Liu, Y., Wang, P., & Tong, X. (2022) · Computer Graphics Forum · doi:10.1111/cgf.14602 · Cited by 132
Self-citationLN3Diff: Scalable Latent Neural Fields Diffusion for Speedy 3D Generation
Lan, Y., Hong, F., Yang, S., Zhou, S., Meng, X., Dai, B., Pan, X., & Loy, C. C. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73235-5_7 · Cited by 107
3D-aware Image Generation using 2D Diffusion Models
Xiang, J., Yang, J., Huang, B., & Tong, X. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00226 · Cited by 92
Self-citationGVGEN: Text-to-3D Generation with Volumetric Representation
He, X., Chen, J., Peng, S., Huang, D., Li, Y., Huang, X., Yuan, C. Y., Ouyang, W., & He, T. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73242-3_26 · Cited by 75
Khanna, M., Mao, Y., Jiang, H., Haresh, S., Shacklett, B., Batra, D., Clegg, A., Undersander, E., Chang, A. X., & Savva, M. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01550 · Cited by 63
Generalized Deep 3D Shape Prior via Part-Discretized Diffusion Process
Li, Y., Dou, Y., Chen, X., Ni, B., Sun, Y., Liu, Y., & Wang, F. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01610 · Cited by 54
Probing the 3D Awareness of Visual Foundation Models
Banani, M. E., Raj, A., Maninis, K.-K., Kar, A., Li, Y., Rubinstein, M., Sun, D., Guibas, L., Johnson, J., & Jampani, V. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.02059 · Cited by 52
RodinHD: High-Fidelity 3D Avatar Generation with Diffusion Models
Zhang, B., Cheng, Y., Wang, C., Zhang, T., Yang, J., Tang, Y., Zhao, F., Chen, D., & Guo, B. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72630-9_27 · Cited by 47
Self-citationVolumeDiffusion: Feed-forward text-to-3D generation with efficient volumetric encoder
Tang, Z., Gu, S., Wang, C., Zhang, T., Bao, J., Chen, D., & Guo, B. (2025) · Graphical Models · doi:10.1016/j.gmod.2025.101274 · Cited by 45
Self-citationStrivec: Sparse Tri-Vector Radiance Fields
Gao, Q., Xu, Q., Su, H., Neumann, U., & Xu, Z. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01611 · Cited by 24
Cited by
ArtiLatent: Realistic Articulated 3D Object Generation via Structured Latents
Chen, H., Lan, Y., Chen, Y., & Pan, X. (2025) · Proceedings of the SIGGRAPH Asia 2025 Conference Papers · doi:10.1145/3757377.3763922 · Cited by 4
Skin Tokens: A Learned Compact Representation for Unified Autoregressive Rigging
Zhang, J.-P., Pu, C.-F., Guo, M.-H., Cao, Y.-P., & Hu, S.-M. (2026) · arXiv · doi:10.48550/arxiv.2602.04805
“The rapid advancement of generative models has enabled the creation of 3D assets at an unprecedented scale [Jiang 2024; Li et al. 2025; Xiang et al. 2024; Zhang et al. 2024].”
Rigel3D: Rig-aware Latents for Animation-Ready 3D Asset Generation
Chatzis, N., Loizou, M., & Kalogerakis, E. (2026) · arXiv · doi:10.48550/arxiv.2605.13129
AniGen: Unified S 3 Fields for Animatable 3D Asset Generation
Huang, Y.-H., Zou, Z.-X., He, Y., Chang, C., Pu, C.-F., Yang, Z., Guo, Y.-C., Cao, Y.-P., & Qi, X. (2026) · ACM Transactions on Graphics · doi:10.1145/3811297
Metadata
- Authors
- Xiang, J., Lv, Z., Xu, S., Deng, Y., Wang, R., Zhang, B., Chen, D., Tong, X., & Yang, J.
- Venue
- 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2025-06-10
- Pages
- 21469-21480
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W4413146851
- Cited by
- 278
- References
- 54
- FWCI
- 276.33
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.