The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Text2Mesh: Text-Driven Neural Stylization for Meshes
Open accessAbstract
In this work, we develop intuitive controls for editing the style of 3D objects. Our framework, Text2Mesh, stylizes a 3D mesh by predicting color and local geometric details which conform to a target text prompt. We consider a disentangled representation of a 3D object using a fixed mesh input (content) coupled with a learned neural network, which we term a neural style field network (NSF). In order to modify style, we obtain a similarity score between a text prompt (describing style) and a stylized mesh by harnessing the representational power of CLIP. Text2Mesh requires neither a pre-trained generative model nor a specialized 3D mesh dataset. It can handle low-quality meshes (non-manifold, boundaries, etc.) with arbitrary genus, and does not require UV parameterization. We demonstrate the ability of our technique to synthesize a myriad of styles over a wide variety of 3D meshes. Our code and results are available in our project webpage: https://threedle.github.io/text2meshl.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
A Style-Based Generator Architecture for Generative Adversarial Networks
Karras, T., Laine, S., & Aila, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00453 · Cited by 11,714
NeRF: representing scenes as neural radiance fields for view synthesis
Mildenhall, B., Srinivasan, P. P., Tancik, M., Barron, J. T., Ramamoorthi, R., & Ng, R. (2022) · Communications of the ACM · doi:10.1145/3503250 · Cited by 6,852
Analyzing and Improving the Image Quality of StyleGAN
Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00813 · Cited by 6,332
Image Style Transfer Using Convolutional Neural Networks
Gatys, L. A., Ecker, A. S., & Bethge, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.265 · Cited by 6,025
Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization
Huang, X., & Belongie, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.167 · Cited by 5,076
Taming Transformers for High-Resolution Image Synthesis
Esser, P., Rombach, R., & Ommer, B. (2020) · arXiv · doi:10.48550/arxiv.2012.09841 · Cited by 2,514
pixelNeRF: Neural Radiance Fields from One or Few Images
Yu, A., Ye, V., Tancik, M., & Kanazawa, A. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00455 · Cited by 1,560
Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., & Salesin, D. H. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383295 · Cited by 1,518
Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains
Tancik, M., Srinivasan, P. P., Mildenhall, B., Fridovich-Keil, S., Raghavan, N., Singhal, U., Ramamoorthi, R., Barron, J. T., & Ng, R. (2020) · arXiv · doi:10.48550/arxiv.2006.10739 · Cited by 1,459
Kato, H., Ushiku, Y., & Harada, T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00411 · Cited by 954
Akenine-Möller, T., Haines, E., Hoffman, N., Pesce, A., Iwanicki, M., & Hillaire, S. (2018) · A K Peters/CRC Press eBooks · doi:10.1201/b22086 · Cited by 866
MeshCNN: a network with an edge
Hanocka, R., Hertz, A., Fish, N., Giryes, R., Fleishman, S., & Cohen-Or, D. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3322959 · Cited by 742
Self-citationUlyanov, D., Vedaldi, A., & Lempitsky, V. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01303-4 · Cited by 719
Style Transfer by Relaxed Optimal Transport and Self-Similarity
Kolkin, N., Salavon, J., & Shakhnarovich, G. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01029 · Cited by 281
DeepSim: deep learning code functional similarity
Zhao, G., & Huang, J. (2018) · Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3236024.3236068 · Cited by 261
Texture Fields: Learning Texture Representations in Function Space
Oechsle, M., Mescheder, L., Niemeyer, M., Strauss, T., & Geiger, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00463 · Cited by 252
Point2Mesh: a self-prior for deformable meshes
Hanocka, R., Metzer, G., Giryes, R., & Cohen-Or, D. (2020) · ACM Transactions on Graphics · doi:10.1145/3386569.3392415 · Cited by 242
Self-citationRecent Advances in Mesh Morphing
Alexa, M. (2002) · Computer Graphics Forum · doi:10.1111/1467-8659.00575 · Cited by 235
Unsupervised co-segmentation of a set of shapes via descriptor-space spectral clustering
Sidi, O., van Kaick, O., Kleiman, Y., Zhang, H., & Cohen-Or, D. (2011) · Proceedings of the 2011 SIGGRAPH Asia Conference · doi:10.1145/2024156.2024160 · Cited by 211
InGAN: Capturing and Retargeting the “DNA” of a Natural Image
Shocher, A., Bagon, S., Isola, P., & Irani, M. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00459 · Cited by 159
Semantic shape editing using deformation handles
Yümer, M. E., Chaudhuri, S., Hodgins, J. K., & Kara, L. B. (2015) · ACM Transactions on Graphics · doi:10.1145/2766908 · Cited by 150
ALIGNet: Partial-Shape Agnostic Alignment via Unsupervised Learning
Hanocka, R., Fish, N., Wang, Z., Giryes, R., Fleishman, S., & Cohen‐Or, D. (2018) · ACM Transactions on Graphics · doi:10.1145/3267347 · Cited by 136
Self-citationLun, Z., Kalogerakis, E., & Sheffer, A. (2015) · ACM Transactions on Graphics · doi:10.1145/2766929 · Cited by 88
Deep geometric texture synthesis
Hertz, A., Hanocka, R., Giryes, R., & Cohen‐Or, D. (2020) · ACM Transactions on Graphics · doi:10.1145/3386569.3392471 · Cited by 75
Self-citationLiu, H. D., Kim, V. G., Chaudhuri, S., Aigerman, N., & Jacobson, A. (2020) · ACM Transactions on Graphics · doi:10.1145/3386569.3392418 · Cited by 75
3DStyleNet: Creating 3D Shapes with Geometric and Texture Style Variations
Yin, K., Gao, J., Shugrina, M., Khamis, S., & Fidler, S. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01223 · Cited by 71
Li, M., Kaufman, D. M., Kim, V. G., Solomon, J., & Sheffer, A. (2018) · ACM Transactions on Graphics · doi:10.1145/3272127.3275042 · Cited by 69
Liu, H. D., Tao, M. W., & Jacobson, A. (2018) · ACM Transactions on Graphics · doi:10.1145/3272127.3275047 · Cited by 61
PSNet: A Style Transfer Network for Point Cloud Stylization on Geometry and Color
Cao, X., Wang, W., Nagao, K., & Nakamura, R. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093513 · Cited by 47
LOGAN: unpaired shape transform in latent overcomplete space
Yin, K., Chen, Z., Huang, H., Cohen‐Or, D., & Zhang, H. (2019) · ACM Transactions on Graphics · doi:10.1145/3355089.3356494 · Cited by 46
Functionality preserving shape style transfer
Lun, Z., Kalogerakis, E., Wang, R., & Sheffer, A. (2016) · ACM Transactions on Graphics · doi:10.1145/2980179.2980237 · Cited by 41
Curve Style Analysis in a Set of Shapes
Li, H., Zhang, H., Wang, Y., Cao, J., Shamir, A., & Cohen‐Or, D. (2013) · Computer Graphics Forum · doi:10.1111/cgf.12015 · Cited by 37
Co-Locating Style-Defining Elements on 3D Shapes
Hu, R., Li, W., van Kaick, O. M., Huang, H. F., Averkiou, M., Cohen‐Or, D., & Zhang, H. (2017) · ACM Transactions on Graphics · doi:10.1145/3092817 · Cited by 32
Self-Sampling for Neural Point Cloud Consolidation
Metzer, G., Hanocka, R., Giryes, R., & Cohen‐Or, D. (2021) · ACM Transactions on Graphics · doi:10.1145/3470645 · Cited by 28
Self-citationSemi-Supervised Co-Analysis of 3D Shape Styles from Projected Lines
Yu, F., Zhang, Y., Xu, K., Amiri, A. M., & Zhang, H. (2018) · ACM Transactions on Graphics · doi:10.1145/3182158 · Cited by 9
Cited by
Objaverse: A Universe of Annotated 3D Objects
Deitke, M., Schwenk, D., Salvador, J., Weihs, L., Michel, O., VanderBilt, E., Schmidt, L., Ehsanit, K., Kembhavi, A., & Farhadi, A. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01263 · Cited by 725
Self-citationFantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation
Chen, R., Chen, Y., Jiao, N., & Jia, K. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02033 · Cited by 369
Latent-NeRF for Shape-Guided Generation of 3D Shapes and Textures
Metzer, G., Richardson, E., Patashnik, O., Giryes, R., & Cohen-Or, D. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01218 · Cited by 336
MotionCLIP: Exposing Human Motion Generation to CLIP Space
Tevet, G., Gordon, B., Hertz, A., Bermano, A. H., & Cohen-Or, D. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20047-2_21 · Cited by 317
Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions
Haque, A., Tancik, M., Efros, A. A., Holynski, A., & Kanazawa, A. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01808 · Cited by 314
Metadata
- Authors
- Michel, O., Bar-On, R., Liu, R., Benaim, S., & Hanocka, R.
- Venue
- 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2022-06
- Pages
- 13482-13492
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W4226127683
- Cited by
- 289
- References
- 37
- FWCI
- 50.16
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.