3D Tooth Segmentation and Labeling Using Deep Convolutional Neural Networks
The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
In this paper, we present a novel approach for 3D dental model segmentation via deep Convolutional Neural Networks (CNNs). Traditional geometry-based methods tend to receive undesirable results due to the complex appearance of human teeth (e.g., missing/rotten teeth, feature-less regions, crowding teeth, extra medical attachments, etc.). Furthermore, labeling of individual tooth is hardly enabled in traditional tooth segmentation methods. To address these issues, we propose to learn a generic and robust segmentation model by exploiting deep Neural Networks, namely NNs. The segmentation task is achieved by labeling each mesh face. We extract a set of geometry features as face feature representations. In the training step, the network is fed with those features, and produces a probability vector, of which each element indicates the probability a face belonging to the corresponding model part. To this end, we extensively experiment with various network structures, and eventually arrive at a 2-level hierarchical CNNs structure for tooth segmentation: one for teeth-gingiva labeling and the other for inter-teeth labeling. Further, we propose a novel boundary-aware tooth simplification method to significantly improve efficiency in the stage of feature extraction. After CNNs prediction, we do graph-based label optimization and further refine the boundary with an improved version of fuzzy clustering. The accuracy of our mesh labeling method exceeds that of the state-of-art geometry-based methods, reaching 99.06 percent measured by area which is directly applicable in orthodontic CAD systems. It is also robust to any possible foreign matters on model surface, e.g., air bubbles, dental accessories, and many more.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Fully convolutional networks for semantic segmentation
Shelhamer, E., Long, J., & Darrell, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2572683 · Cited by 11,898
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Fast approximate energy minimization via graph cuts
Boykov, Y., Veksler, O., & Zabih, R. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.969114 · Cited by 6,988
Shape matching and object recognition using shape contexts
Belongie, S., Malik, J., & Puzicha, J. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.993558 · Cited by 6,306
Real-time human pose recognition in parts from single depth images
Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., & Blake, A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995316 · Cited by 3,491
A Practical Guide to Training Restricted Boltzmann Machines
Hinton, G. E. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_32 · Cited by 2,852
Hoppe, H. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237216 · Cited by 2,817
Learning Hierarchical Features for Scene Labeling
Farabet, C., Couprie, C., Najman, L., & LeCun, Y. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.231 · Cited by 2,620
Using spin images for efficient object recognition in cluttered 3D scenes
Johnson, A. E., & Hebert, M. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.765655 · Cited by 2,599
Shilane, P., Min, P., Kazhdan, M., & Funkhouser, T. (2004) · Proceedings Shape Modeling Applications, 2004. · doi:10.1109/smi.2004.1314504 · Cited by 1,419
A survey of content based 3D shape retrieval methods
Tangelder, J. W. H., & Veltkamp, R. C. (2008) · Multimedia Tools and Applications · doi:10.1007/s11042-007-0181-0 · Cited by 900
O-CNN: octree-based convolutional neural networks for 3D shape analysis
Wang, P.-S., Liu, Y., Guo, Y.-X., Sun, C.-Y., & Tong, X. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073608 · Cited by 884
Functional maps: a flexible representation of maps between shapes
Ovsjanikov, M., Ben-Chen, M., Solomon, J., Butscher, A., & Guibas, L. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185526 · Cited by 735
Partitioning 3D surface meshes using watershed segmentation
Mangan, A. P., & Whitaker, R. (1999) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/2945.817348 · Cited by 631
A Survey on Shape Correspondence
van Kaick, O., Zhang, H., Hamarneh, G., & Cohen‐Or, D. (2011) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2011.01884.x · Cited by 606
A survey on Mesh Segmentation Techniques
Shamir, A. (2008) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2007.01103.x · Cited by 593
Consistent mesh partitioning and skeletonisation using the shape diameter function
Shapira, L., Shamir, A., & Cohen-Or, D. (2008) · The Visual Computer · doi:10.1007/s00371-007-0197-5 · Cited by 542
Salient geometric features for partial shape matching and similarity
Gal, R., & Cohen-Or, D. (2006) · ACM Transactions on Graphics · doi:10.1145/1122501.1122507 · Cited by 497
Hierarchical mesh decomposition using fuzzy clustering and cuts
Katz, S., & Tal, A. (2003) · ACM Transactions on Graphics · doi:10.1145/882262.882369 · Cited by 477
Learning 3D mesh segmentation and labeling
Kalogerakis, E., Hertzmann, A., & Singh, K. (2010) · ACM Transactions on Graphics · doi:10.1145/1778765.1778839 · Cited by 469
Hierarchical mesh segmentation based on fitting primitives
Attene, M., Falcidieno, B., & Spagnuolo, M. (2006) · The Visual Computer · doi:10.1007/s00371-006-0375-x · Cited by 462
Mesh segmentation using feature point and core extraction
Katz, S., Leifman, G., & Tal, A. (2005) · The Visual Computer · doi:10.1007/s00371-005-0344-9 · Cited by 375
Displaced dynamic expression regression for real-time facial tracking and animation
Cao, C., Hou, Q., & Zhou, K. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601204 · Cited by 356
Mesh Segmentation - A Comparative Study
Attene, M., Katz, S. M., Mortara, M., Patanè, G., Spagnuolo, M., & Tal, A. (2006) · IEEE International Conference on Shape Modeling and Applications · doi:10.1109/smi.2006.24 · Cited by 298
Active co-analysis of a set of shapes
Wang, Y., Asafi, S., van Kaick, O., Zhang, H., Cohen-Or, D., & Chen, B. (2012) · ACM Transactions on Graphics · doi:10.1145/2366145.2366184 · Cited by 258
Convolutional neural networks on surfaces via seamless toric covers
Maron, H., Galun, M., Aigerman, N., Trope, M., Dym, N., Yumer, E., Kim, V. G., & Lipman, Y. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073616 · Cited by 231
Learning part-based templates from large collections of 3D shapes
Kim, V. G., Li, W., Mitra, N. J., Chaudhuri, S., DiVerdi, S., & Funkhouser, T. (2013) · ACM Transactions on Graphics · doi:10.1145/2461912.2461933 · Cited by 230
3D Mesh Labeling via Deep Convolutional Neural Networks
Guo, K., Zou, D., & Chen, X. (2015) · ACM Transactions on Graphics · doi:10.1145/2835487 · Cited by 217
Unsupervised co-segmentation of a set of shapes via descriptor-space spectral clustering
Sidi, O., van Kaick, O., Kleiman, Y., Zhang, H., & Cohen-Or, D. (2011) · Proceedings of the 2011 SIGGRAPH Asia Conference · doi:10.1145/2024156.2024160 · Cited by 211
A new CAD mesh segmentation method, based on curvature tensor analysis
Lavoué, G., Dupont, F., & Baskurt, A. (2005) · Computer-Aided Design · doi:10.1016/j.cad.2004.09.001 · Cited by 210
Contextual Part Analogies in 3D Objects
Shapira, L., Shalom, S., Shamir, A., Cohen-Or, D., & Zhang, H. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0279-0 · Cited by 172
Functional map networks for analyzing and exploring large shape collections
Huang, Q., Wang, F., & Guibas, L. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601111 · Cited by 171
Co‐Segmentation of 3D Shapes via Subspace Clustering
Hu, R., Fan, L., & Liu, L. (2012) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2012.03175.x · Cited by 171
Structure recovery by part assembly
Shen, C.-H., Fu, H., Chen, K., & Hu, S.-M. (2012) · ACM Transactions on Graphics · doi:10.1145/2366145.2366199 · Cited by 161
Fast mesh segmentation using random walks
Lai, Y., Hu, S., Martin, R. R., & Rosin, P. L. (2008) · ACM Symposium on Solid and Physical Modeling (SPM) · doi:10.1145/1364901.1364927 · Cited by 154
A benchmark for 3D mesh segmentation
Chen, X., Golovinskiy, A., & Funkhouser, T. (2009) · ACM SIGGRAPH 2009 papers · doi:10.1145/1576246.1531379 · Cited by 135
Attribit: content creation with semantic attributes
Chaudhuri, S., Kalogerakis, E., Giguere, S., & Funkhouser, T. (2013) · Proceedings of the 26th annual ACM symposium on User interface software and technology · doi:10.1145/2501988.2502008 · Cited by 123
Data-driven shape analysis and processing
Xu, K., Kim, V. G., Huang, Q., Mitra, N. J., & Kalogerakis, E. (2016) · SIGGRAPH Asia Courses · doi:10.1145/2988458.2988473 · Cited by 114
3D Shape Segmentation and Labeling via Extreme Learning Machine
Xie, Z., Xu, K., Liu, L., & Xiong, Y. (2014) · Computer Graphics Forum · doi:10.1111/cgf.12434 · Cited by 103
Ji, Z., Liu, L., Chen, Z., & Wang, G. (2006) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2006.00947.x · Cited by 101
Supervised learning of bag‐of‐features shape descriptors using sparse coding
Litman, R., Bronstein, A. M., Bronstein, M. M., & Castellani, U. (2014) · Computer Graphics Forum · doi:10.1111/cgf.12438 · Cited by 100
Intelligent mesh scissoring using 3D snakes
Lee, Y., Lee, S., & Shamir, A. (2004) · Pacific Conference on Computer Graphics and Applications · doi:10.1109/pccga.2004.1348358 · Cited by 79
Sketch‐to‐Design: Context‐Based Part Assembly
Xie, X., Xu, K., Mitra, N. J., Cohen‐Or, D., Gong, W., Su, Q., & Chen, B. (2013) · Computer Graphics Forum · doi:10.1111/cgf.12200 · Cited by 78
Projective analysis for 3D shape segmentation
Wang, Y., Gong, M., Wang, T., Cohen‐Or, D., Zhang, H., & Chen, B. (2013) · ACM Transactions on Graphics · doi:10.1145/2508363.2508393 · Cited by 77
Single‐Tooth Modeling for 3D Dental Model
Yuan, T., Liao, W., Dai, N., Cheng, X., & Yu, Q. L. (2010) · International Journal of Biomedical Imaging · doi:10.1155/2010/535329 · Cited by 74
Snake-Based Segmentation of Teeth from Virtual Dental Casts
Kronfeld, T., Brunner, D., & Brunnett, G. (2010) · Computer-Aided Design and Applications · doi:10.3722/cadaps.2010.221-233 · Cited by 69
Data‐Driven Shape Analysis and Processing
Xu, K., Kim, V. G., Huang, Q., & Kalogerakis, E. (2016) · Computer Graphics Forum · doi:10.1111/cgf.12790 · Cited by 57
Fan, L., Lic, L., & Liu, K. (2011) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2011.01895.x · Cited by 49
Randomized cuts for 3D mesh analysis
Golovinskiy, A., & Funkhouser, T. A. (2008) · ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia) · doi:10.1145/1457515.1409098 · Cited by 48
Computer aided orthodontics treatment by virtual segmentation and adjustment
Yaqi, M., & Li, Z. (2010) · International Conference on Image Analysis and Signal Processing · doi:10.1109/iasp.2010.5476100 · Cited by 46
A Graph Regularized Deep Neural Network for Unsupervised Image Representation Learning
Yang, S., Li, L., Wang, S., Zhang, W., & Huang, Q. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.746 · Cited by 35
Creature grammar for creative modeling of 3D monsters
Guo, X., Lin, J., Xu, K., & Jin, X. (2014) · Graphical Models · doi:10.1016/j.gmod.2014.03.019 · Cited by 30
A comparative evaluation of foreground/background sketch-based mesh segmentation algorithms
Meng, M., Fan, L., & Liu, L. (2011) · Computers & Graphics · doi:10.1016/j.cag.2011.03.038 · Cited by 15
Cited by
An overview of deep learning in the field of dentistry
Hwang, J.-J., Jung, Y.-H., Cho, B.-H., & Heo, M.-S. (2019) · Imaging Science in Dentistry · doi:10.5624/isd.2019.49.1.1 · Cited by 296
Metadata
- Authors
- Xu, X., Liu, C., & Zheng, Y.
- Venue
- IEEE Transactions on Visualization and Computer Graphics
- Published
- 2019-07-01
- Volume
- 25
- Issue
- 7
- Pages
- 2336-2348
- ISSN
- 1077-2626 (ISSN-L)
- 1941-0506
- 2160-9306
- OpenAlex
- W2804967795
- Cited by
- 227
- References
- 56
- FWCI
- 11.05
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.