The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Measuring and Establishing the Accuracy and Reproducibility of 3D Printed Medical Models
Open accessAbstract
Despite the rapid growth of three-dimensional (3D) printing applications in medicine, the accuracy and reproducibility of 3D printed medical models have not been thoroughly investigated. Although current technologies enable 3D models to be created with accuracy within the limits of clinical imaging spatial resolutions, this is not always achieved in practice. Inaccuracies are due to errors that occur during the imaging, segmentation, postprocessing, and 3D printing steps. Radiologists’ understanding of the factors that influence 3D printed model accuracy and the metrics used to measure this accuracy is key in directing appropriate practices and establishing reference standards and validation procedures. The authors review the various factors in each step of the 3D model printing process that contribute to model inaccuracy, including the intrinsic limitations of each printing technology. In addition, common sources of model inaccuracy are illustrated. Metrics involving comparisons of model dimensions and morphology that have been developed to quantify differences between 3D models also are described and illustrated. These metrics can be used to define the accuracy of a model, as compared with the reference standard, and to measure the variability of models created by different observers or using different workflows. The accuracies reported for specific indications of 3D printing are summarized, and potential guidelines for quality assurance and workflow assessment are discussed. Online supplemental material is available for this article. ©RSNA, 2017
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Advantages and disadvantages of 3-dimensional printing in surgery: A systematic review
Martelli, N., Serrano, C., van den Brink, H., Pineau, J., Prognon, P., Borget, I., & El Batti, S. (2016) · Surgery · doi:10.1016/j.surg.2015.12.017 · Cited by 681
Medical 3D Printing for the Radiologist
Mitsouras, D., Liacouras, P., Imanzadeh, A., Giannopoulos, A. A., Cai, T., Kumamaru, K. K., George, E., Wake, N., Caterson, E. J., Pomahac, B., et al. (2015) · RadioGraphics · doi:10.1148/rg.2015140320 · Cited by 619
Self-citationMorrison, R. J., Hollister, S. J., Niedner, M. F., Mahani, M. G., Park, A. H., Mehta, D. K., Ohye, R. G., & Green, G. E. (2015) · Science Translational Medicine · doi:10.1126/scitranslmed.3010825 · Cited by 498
3D modeling, custom implants and its future perspectives in craniofacial surgery
Parthasarathy, J. (2014) · Annals of Maxillofacial Surgery · doi:10.4103/2231-0746.133065 · Cited by 377
Accuracy of medical models made by additive manufacturing (rapid manufacturing)
Salmi, M., Paloheimo, K.-S., Tuomi, J., Wolff, J., & Mäkitie, A. (2013) · Journal of Cranio-Maxillofacial Surgery · doi:10.1016/j.jcms.2012.11.041 · Cited by 330
Additively manufactured medical products – the FDA perspective
Di Prima, M., Coburn, J., Hwang, D., Kelly, J., Khairuzzaman, A., & Ricles, L. (2016) · 3D Printing in Medicine · doi:10.1186/s41205-016-0005-9 · Cited by 328
Ibrahim, D., Broilo, T. L., Heitz, C., de Oliveira, M. G., de Oliveira, H. W., Nobre, S. M. W., dos Santos Filho, J. H. G., & Silva, D. N. (2009) · Journal of Cranio-Maxillofacial Surgery · doi:10.1016/j.jcms.2008.10.008 · Cited by 285
Silva, D. N., Gerhardt de Oliveira, M., Meurer, E., Meurer, M. I., Lopes da Silva, J. V., & Santa-Bárbara, A. (2008) · Journal of Cranio-Maxillofacial Surgery · doi:10.1016/j.jcms.2008.04.003 · Cited by 246
Ripley, B., Kelil, T., Cheezum, M. K., Goncalves, A., Di Carli, M. F., Rybicki, F. J., Steigner, M., Mitsouras, D., & Blankstein, R. (2016) · Journal of Cardiovascular Computed Tomography · doi:10.1016/j.jcct.2015.12.004 · Cited by 205
Self-citationHuotilainen, E., Jaanimets, R., Valášek, J., Marcián, P., Salmi, M., Tuomi, J., Mäkitie, A., & Wolff, J. (2014) · Journal of Cranio-Maxillofacial Surgery · doi:10.1016/j.jcms.2013.10.001 · Cited by 203
Olivieri, L. J., Krieger, A., Loke, Y.-H., Nath, D. S., Kim, P. C. W., & Sable, C. A. (2015) · Journal of the American Society of Echocardiography · doi:10.1016/j.echo.2014.12.016 · Cited by 182
Ionita, C. N., Mokin, M., Varble, N., Bednarek, D. R., Xiang, J., Snyder, K. V., Siddiqui, A. H., Levy, E. I., Meng, H., & Rudin, S. (2014) · SPIE Proceedings · doi:10.1117/12.2042266 · Cited by 176
Three-dimensional Physical Modeling: Applications and Experience at Mayo Clinic
Matsumoto, J. S., Morris, J. M., Foley, T. A., Williamson, E. E., Leng, S., McGee, K. P., Kuhlmann, J. L., Nesberg, L. E., & Vrtiska, T. J. (2015) · RadioGraphics · doi:10.1148/rg.2015140260 · Cited by 166
Cardiothoracic Applications of 3-dimensional Printing
Giannopoulos, A. A., Steigner, M. L., George, E., Barile, M., Hunsaker, A. R., Rybicki, F. J., & Mitsouras, D. (2016) · Journal of Thoracic Imaging · doi:10.1097/rti.0000000000000217 · Cited by 164
Self-citationReplicating Patient-Specific Severe Aortic Valve Stenosis With Functional 3D Modeling
Maragiannis, D., Jackson, M. S., Igo, S. R., Schutt, R. C., Connell, P., Grande-Allen, J., Barker, C. M., Chang, S. M., Reardon, M. J., Zoghbi, W. A., et al. (2015) · Circulation: Cardiovascular Imaging · doi:10.1161/circimaging.115.003626 · Cited by 163
Rapid prototyping compliant arterial phantoms for in-vitro studies and device testing
Biglino, G., Verschueren, P., Zegels, R., Taylor, A. M., & Schievano, S. (2013) · Journal of Cardiovascular Magnetic Resonance · doi:10.1186/1532-429x-15-2 · Cited by 162
Three-dimensional Printing and 3D Slicer
Cheng, G. Z., Estépar, R. S. J., Folch, E. E., Onieva, J. O., Gangadharan, S. P., & Majid, A. (2016) · CHEST Journal · doi:10.1016/j.chest.2016.03.001 · Cited by 134
Engelke, K., Libanati, C. R., Liu, Y., Wang, H., Austin, M., Fuerst, T. P., Stampa, B., Timm, W., & Genant, H. K. (2009) · Bone · doi:10.1016/j.bone.2009.03.669 · Cited by 131
Tridimensional titanium-printed custom-made prosthesis for sternocostal reconstruction
Aranda, J. L., Jiménez, M. F., Rodríguez, M., & Varela, G. (2015) · European Journal of Cardio-Thoracic Surgery · doi:10.1093/ejcts/ezv265 · Cited by 124
Error analysis of FDM fabricated medical replicas
El‐Katatny, I., Masood, S. H., & Morsi, Y. (2010) · Rapid Prototyping Journal · doi:10.1108/13552541011011695 · Cited by 123
Accuracy assessment of CT-based outer surface femur meshes
Gelaude, F., Sloten, J. V., & Lauwers, B. (2008) · Computer Aided Surgery · doi:10.3109/10929080802195783 · Cited by 112
Wu, X., Wang, J., Zhao, C., Sun, X., Shi, Y., Zhang, Z.-A., Li, Y.-N., & Wang, M. (2015) · Chinese Medical Journal · doi:10.4103/0366-6999.151088 · Cited by 102
Dimensional accuracy of dental casting patterns created by 3D printers
Ishida, Y., & Miyasaka, T. (2016) · Dental Materials Journal · doi:10.4012/dmj.2015-278 · Cited by 91
Three‐dimensional printing of MRI‐visible phantoms and MR image‐guided therapy simulation
Mitsouras, D., Lee, T. C., Liacouras, P. C., Ionita, C. N., Pietila, T., Maier, S. E., & Mulkern, R. V. (2016) · Magnetic Resonance in Medicine · doi:10.1002/mrm.26136 · Cited by 75
Self-citationFactors Affecting Dimensional Accuracy of 3-D Printed Anatomical Structures Derived from CT Data
Ogden, K. M., Aslan, C., Ordway, N. R., et al. (2015) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-015-9803-7 · Cited by 72
Frölich, A. M., Spallek, J., Brehmer, L., Buhk, J., Krause, D., Fiehler, J., & Kemmling, A. (2015) · American Journal of Neuroradiology · doi:10.3174/ajnr.a4486 · Cited by 70
Accuracy of medical models made by consumer-grade fused deposition modelling printers
Petropolis, C. J., Kozan, D., & Sigurdson, L. J. (2015) · Plastic Surgery · doi:10.1177/229255031502300201 · Cited by 54
Accuracy of Craniofacial Measurements
Fruehwald‐Pallamar, J., Schicho, K., Figl, M., Benesch, T., Watzinger, F., & Kainberger, F. M. (2008) · Journal of Craniofacial Surgery · doi:10.1097/scs.0b013e318052ff1a · Cited by 44
Patient specific biomodel of the whole aorta - the importance of calcified plaque removal
Håkansson, Rantatalo, Hansen, & Wanhainen (2011) · VASA · doi:10.1024/0301-1526/a000148 · Cited by 43
Anatomical Reproducibility of a Head Model Molded by a Three-dimensional Printer
Kondo, K., Nemoto, M., Masuda, H., Okonogi, S., Nomoto, J., Harada, N., Sugo, N., & Miyazaki, C. (2015) · Neurologia medico-chirurgica · doi:10.2176/nmc.oa.2014-0436 · Cited by 38
Individualizing Management of Complex Esophageal Pathology Using Three-Dimensional Printed Models
Dickinson, K. J., Matsumoto, J. M. S., Cassivi, S. D., Reinersman, J. M., Fletcher, J. G., Morris, J., Song, L. M. W. K., & Blackmon, S. H. (2015) · The Annals of Thoracic Surgery · doi:10.1016/j.athoracsur.2015.03.115 · Cited by 38
A critical inventory of preoperative skull replicas
Fasel, J., Beinemann, J., Schaller, K., & Gailloud, P. (2013) · Annals of The Royal College of Surgeons of England · doi:10.1308/003588413x13629960046994 · Cited by 19
Cited by
Polymer 3D Printing Review: Materials, Process, and Design Strategies for Medical Applications
Arefin, A. M. E., Khatri, N. R., Kulkarni, N., & Egan, P. F. (2021) · Polymers · doi:10.3390/polym13091499 · Cited by 361
Ballard, D. H., Mills, P., Duszak, R., Weisman, J. A., Rybicki, F. J., & Woodard, P. K. (2020) · Academic Radiology · doi:10.1016/j.acra.2019.08.011 · Cited by 294
Self-citationRSNA Special Interest Group for 3D Printing, Chepelev, L., Wake, N., Ryan, J., Althobaity, W., Gupta, A., Arribas, E., Santiago, L., Ballard, D. H., Wang, K. C., et al. (2018) · 3D Printing in Medicine · doi:10.1186/s41205-018-0030-y · Cited by 272
Self-citationDimensional Accuracy in 3D Printed Medical Models: A Follow-Up Study on SLA and SLS Technology
Msallem, B., Vavrina, J. J., Beyer, M., Halbeisen, F. S., Lauer, G., Dragu, A., & Thieringer, F. M. (2024) · Journal of Clinical Medicine · doi:10.3390/jcm13195848 · Cited by 40
Metadata
- Authors
- George, E., Liacouras, P., Rybicki, F. J., & Mitsouras, D.
- Venue
- RadioGraphics
- Published
- 2017-09
- Volume
- 37
- Issue
- 5
- Pages
- 1424-1450
- ISSN
- 0271-5333 (ISSN-L)
- 1527-1323
- OpenAlex
- W2742750442
- Cited by
- 283
- References
- 32
- FWCI
- 8.96
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.