The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Automatic Instrument Segmentation in Robot-Assisted Surgery using Deep Learning
Open accessAbstract
Abstract Semantic segmentation of robotic instruments is an important problem for the robot-assisted surgery. One of the main challenges is to correctly detect an instrument’s position for the tracking and pose estimation in the vicinity of surgical scenes. Accurate pixel-wise instrument segmentation is needed to address this challenge. In this paper we describe our deep learning-based approach for robotic instrument segmentation. Our approach demonstrates an improvement over the state-of-the-art results using several novel deep neural network architectures. It addressed the binary segmentation problem, where every pixel in an image is labeled as an instrument or background from the surgery video feed. In addition, we solve a multi-class segmentation problem, in which we distinguish between different instruments or different parts of an instrument from the background. In this setting, our approach outperforms other methods for automatic instrument segmentation thereby providing state-of-the-art results for these problems. The source code for our solution is made publicly available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Albumentations: fast and flexible image augmentations
Buslaev, A., Iglovikov, V. I., Khvedchenya, E., Parinov, A., Druzhinin, M., & Kalinin, A. A. (2020) · Information · doi:10.3390/info11020125 · Cited by 2,714
Self-citationOpportunities and obstacles for deep learning in biology and medicine
Ching, T., Himmelstein, D. S., Beaulieu-Jones, B. K., Kalinin, A. A., Do, B. T., Way, G. P., Ferrero, E., Agapow, P.-M., Zietz, M., Hoffman, M. M., et al. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0387 · Cited by 2,310
Self-citationContinuum Robots for Medical Applications: A Survey
Burgner-Kahrs, J., Rucker, D. C., & Choset, H. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2489500 · Cited by 1,557
LinkNet: Exploiting encoder representations for efficient semantic segmentation
Chaurasia, A., & Culurciello, E. (2017) · 2017 IEEE Visual Communications and Image Processing (VCIP) · doi:10.1109/vcip.2017.8305148 · Cited by 1,507
TernausNet: U-Net with VGG11 Encoder Pre-Trained on ImageNet for Image Segmentation
Iglovikov, V., & Shvets, A. A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.05746 · Cited by 552
Self-citationDeep Convolutional Neural Networks for Breast Cancer Histology Image Analysis
Rakhlin, A., Shvets, A., Iglovikov, V., & Kalinin, A. A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-93000-8_83 · Cited by 219
Self-citationPaediatric Bone Age Assessment Using Deep Convolutional Neural Networks
Iglovikov, V., Rakhlin, A., Kalinin, A. A., & Shvets, A. A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00889-5_34 · Cited by 211
Self-citationDeep learning in pharmacogenomics: from gene regulation to patient stratification
Kalinin, A. A., Higgins, G. A., Reamaroon, N., Soroushmehr, S., Allyn-Feuer, A., Dinov, I. D., Najarian, K., & Athey, B. D. (2018) · Pharmacogenomics · doi:10.2217/pgs-2018-0008 · Cited by 207
Satellite Imagery Feature Detection using Deep Convolutional Neural Network: A Kaggle CompetitionPreprint
Iglovikov, V., Mushinskiy, S., & Osin, V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.06169 · Cited by 198
Self-citationTernausNetV2: Fully Convolutional Network for Instance Segmentation
Iglovikov, V., Seferbekov, S., Buslaev, A. P., & Shvets, A. A. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00042 · Cited by 147
Self-citationContent-based processing and analysis of endoscopic images and videos: A survey
Münzer, B., Schoeffmann, K., & Böszörményi, L. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-016-4219-z · Cited by 143
ToolNet: Holistically-nested real-time segmentation of robotic surgical tools
Garcia-Peraza-Herrera, L. C., Li, W., Fidon, L., Gruijthuijsen, C., Devreker, A., Attilakos, G., Deprest, J., Poorten, E. V., Stoyanov, D., Vercauteren, T., et al. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206462 · Cited by 137
Deep Residual Learning for Instrument Segmentation in Robotic Surgery
Pakhomov, D., Premachandran, V., Allan, M., Azizian, M., & Navab, N. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32692-0_65 · Cited by 135
Detecting Surgical Tools by Modelling Local Appearance and Global Shape
Bouget, D., Benenson, R., Omran, M., Riffaud, L., Schiele, B., & Jannin, P. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2450831 · Cited by 128
ToolNet: Holistically-Nested Real-Time Segmentation of Robotic Surgical ToolsPreprint
García-Peraza-Herrera, L. C., Li, W., Fidon, L., Gruijthuijsen, C., Devreker, A., Attilakos, G., Deprest, J. A., Poorten, E., Stoyanov, D. V., Vercauteren, T. K., et al. (2017) · UCL Discovery (University College London) · Cited by 128
Deep Convolutional Neural Networks for Breast Cancer Histology Image AnalysisPreprint
Rakhlin, A., Shvets, A. A., Iglovikov, V., & Kalinin, A. A. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/259911 · Cited by 117
Self-citationSurgical tool segmentation using a hybrid deep CNN-RNN auto encoder-decoder
Attia, M., Hossny, M., Nahavandi, S., & Asadi, H. (2017) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2017.8123151 · Cited by 92
Angiodysplasia Detection and Localization Using Deep Convolutional Neural Networks
Shvets, A. A., Iglovikov, V., Rakhlin, A., & Kalinin, A. A. (2018) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2018.00098 · Cited by 83
Self-citationPediatric Bone Age Assessment Using Deep Convolutional Neural NetworksPreprint
Iglovikov, V., Rakhlin, A., Kalinin, A. A., & Shvets, A. A. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/234120 · Cited by 74
Self-citationTracking of Instruments in Minimally Invasive Surgery for Surgical Skill Analysis
Speidel, S., Delles, M., Gutt, C. N., & Dillmann, R. (2006) · Lecture notes in computer science · doi:10.1007/11812715_19 · Cited by 65
FPGA Implementation of Convolutional Neural Networks with Fixed-Point Calculations.Preprint
Solovyev, R. A., Kalinin, A. A., Kustov, A. G., Telpukhov, D. V., & Сергеевич, Р. В. (2018) · arXiv (Cornell University) · Cited by 37
Self-citation
Cited by
A guide to deep learning in healthcare
Esteva, A., Robicquet, A., Ramsundar, B., Kuleshov, V., DePristo, M., Chou, K., Cui, C., Corrado, G., Thrun, S., & Dean, J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0316-z · Cited by 5,312
Albumentations: fast and flexible image augmentations
Buslaev, A., Iglovikov, V. I., Khvedchenya, E., Parinov, A., Druzhinin, M., & Kalinin, A. A. (2020) · Information · doi:10.3390/info11020125 · Cited by 2,714
Self-citationCHAOS Challenge - combined (CT-MR) healthy abdominal organ segmentation
Kavur, A. E., Gezer, N. S., Barış, M., Aslan, S., Conze, P.-H., Groza, V., Pham, D. D., Chatterjee, S., Ernst, P., Özkan, S., et al. (2021) · Medical Image Analysis · doi:10.1016/j.media.2020.101950 · Cited by 815
PIDNet: A Real-time Semantic Segmentation Network Inspired by PID Controllers
Xu, J., Xiong, Z., & Bhattacharyya, S. P. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01871 · Cited by 817
Unsupervised Intra-Domain Adaptation for Semantic Segmentation Through Self-Supervision
Pan, F., Shin, I., Rameau, F., Lee, S., & Kweon, I. S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00382 · Cited by 379
Metadata
- Authors
- Shvets, A. A., Rakhlin, A., Kalinin, A. A., & Iglovikov, V. I.
- Venue
- 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA)
- Publisher
- IEEE
- Published
- 2018-12
- Pages
- 624-628
- OpenAlex
- W2792767783
- Cited by
- 379
- References
- 24
- FWCI
- 14.62
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.