Visual SLAM for Handheld Monocular Endoscope
The DOI matches its Crossref record; 34 of the 37 references it cites were found in a registry or an index.
Abstract
Simultaneous localization and mapping (SLAM) methods provide real-time estimation of 3-D models from the sole input of a handheld camera, routinely in mobile robotics scenarios. Medical endoscopic sequences mimic a robotic scenario in which a handheld camera (monocular endoscope) moves along an unknown trajectory while observing an unknown cavity. However, the feasibility and accuracy of SLAM methods have not been extensively validated with human in vivo image sequences. In this work, we propose a monocular visual SLAM algorithm tailored to deal with medical image sequences in order to provide an up-to-scale 3-D map of the observed cavity and the endoscope trajectory at frame rate. The algorithm is validated over synthetic data and human in vivo sequences corresponding to 15 laparoscopic hernioplasties where accurate ground-truth distances are available. It can be concluded that the proposed procedure is: 1) noninvasive, because only a standard monocular endoscope and a surgical tool are used; 2) convenient, because only a hand-controlled exploratory motion is needed; 3) fast, because the algorithm provides the 3-D map and the trajectory in real time; 4) accurate, because it has been validated with respect to ground-truth; and 5) robust to inter-patient variability, because it has performed successfully over the validation sequences.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Recent results in non-rigid SfM such as [91, 96] are less restrictive but only work in small scenarios.”
From Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age (2016) · cites this paper as [96]
Citations
Cites
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893
Parallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346
Flexible camera calibration by viewing a plane from unknown orientations
Zhang, Z. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.791289 · Cited by 2,610
Real-time simultaneous localisation and mapping with a single camera
Davison (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238654 · Cited by 1,733
Fusing points and lines for high performance tracking
Rosten, E., & Drummond, T. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.104 · Cited by 1,119
Introduction to modern photogrammetry
Mikhail, E. M., Bethel, J., & McGlone, J. C. (2001) · Cited by 1,019
Inverse Depth Parametrization for Monocular SLAM
Civera, J., Davison, A. J., & Montiel, J. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2003276 · Cited by 779
Self-citationData association in stochastic mapping using the joint compatibility test
Neira, J., & Tardos, J. D. (2001) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.976019 · Cited by 772
Augmented reality in laparoscopic surgical oncology
Nicolau, S., Soler, L., Mutter, D., & Marescaux, J. (2011) · Surgical Oncology · doi:10.1016/j.suronc.2011.07.002 · Cited by 367
Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery
Maier-Hein, L., Mountney, P., Bartoli, A., Elhawary, H., Elson, D., Groch, A., Kolb, A., Rodrigues, M., Sorger, J., Speidel, S., et al. (2013) · Medical Image Analysis · doi:10.1016/j.media.2013.04.003 · Cited by 280
Civera, J., Grasa, O. G., Davison, A. J., & Montiel, J. M. M. (2010) · Journal of Field Robotics · doi:10.1002/rob.20345 · Cited by 261
Self-citationWilliams, B., Klein, G., & Reid, I. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4409115 · Cited by 224
Scale-invariant registration of monocular endoscopic images to CT-scans for sinus surgery
Burschka, D., Li, M., Ishii, M., Taylor, R. H., & Hager, G. D. (2005) · Medical Image Analysis · doi:10.1016/j.media.2005.05.005 · Cited by 121
An endoscopic 3D scanner based on structured light
Schmalz, C., Forster, F., Schick, A., & Angelopoulou, E. (2012) · Medical Image Analysis · doi:10.1016/j.media.2012.04.001 · Cited by 112
Simultaneous Stereoscope Localization and Soft-Tissue Mapping for Minimal Invasive Surgery
Mountney, P., Stoyanov, D. V., Davison, A. J., & Yang, G. (2006) · Lecture notes in computer science · doi:10.1007/11866565_43 · Cited by 107
Motion Compensated SLAM for Image Guided Surgery
Mountney, P., & Yang, G. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15745-5_61 · Cited by 99
A practical approach towards accurate dense 3D depth recovery for robotic laparoscopic surgery
Stoyanov, D. V., Darzi, A. W., & Yang, G. (2005) · Computer Aided Surgery · doi:10.3109/10929080500230379 · Cited by 94
EKF monocular SLAM with relocalization for laparoscopic sequences
Grasa, Ó. G., Civera, J., & Montiel, J. M. M. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5980059 · Cited by 90
Self-citationA System for Video-Based Navigation for Endoscopic Endonasal Skull Base Surgery
Mirota, D. J., Wang, H., Taylor, R. H., Ishii, M., Gallia, G. L., & Hager, G. D. (2012) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2011.2176500 · Cited by 64
Hu, M., Penney, G., Figl, M., Edwards, P., Bello, F., Casula, R., Rueckert, D., & Hawkes, D. J. (2010) · Medical Image Analysis · doi:10.1016/j.media.2010.11.002 · Cited by 63
3D reconstruction of the operating field for image overlay in 3D-endoscopic surgery
Mourgues, F., Devemay, F., & Coste-Manière, È. (2002) · doi:10.1109/isar.2001.970537 · Cited by 63
3D Reconstruction in Laparoscopy with Close-Range Photometric Stereo
Collins, T., & Bartoli, A. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33418-4_78 · Cited by 59
Three-Dimensional Modeling From Endoscopic Video Using Geometric Constraints Via Feature Positioning
Wu, C.-H., Sun, Y.-N., & Chang, C.-C. (2007) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2006.889767 · Cited by 50
Towards Live Monocular 3D Laparoscopy Using Shading and Specularity Information
Collins, T., & Bartoli, A. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-30618-1_2 · Cited by 46
Dense Surface Reconstruction for Enhanced Navigation in MIS
Totz, J., Mountney, P., Stoyanov, D. V., & Yang, G. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23623-5_12 · Cited by 43
Wang, H., Mirota, D. J., Ishii, M., & Hager, G. D. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587687 · Cited by 41
Toward automated model building from video in computer-assisted diagnoses in colonoscopy
Koppel, D., Chen, C.-I., Wang, Y.-F., Lee, H., Gu, J., Poirson, A. B., & Wolters, R. (2007) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.709595 · Cited by 40
Template-Based Conformal Shape-from-Motion-and-Shading for Laparoscopy
Malti, A., Bartoli, A., & Collins, T. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-30618-1_1 · Cited by 39
Finite Element based sequential Bayesian Non-Rigid Structure from Motion
Agudo, A., Calvo, B., & Montiel, J. M. M. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247829 · Cited by 36
Self-citationMaurice, X., Albitar, C., Doignon, C., & de Mathelin, M. (2012) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2012.6347305 · Cited by 33
MR in OR: First analysis of AR/VR visualization in 100 intra-operative Freehand SPECT acquisitions
Okur, A., Ahmadi, S., Bigdelou, A., Wendler, T., & Navab, N. (2011) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar.2011.6092388 · Cited by 22
Template-Based Conformal Shape-from-Motion from Registered Laparoscopic Images.
Malti, A., Bartoli, A., & Collins, T. (2011) · Cited by 22
3D Reconstruction of Non-Rigid Surfaces in Real-Time Using Wedge Elements
Agudo, A., Calvo, B., & Montiel, J. M. M. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33863-2_12 · Cited by 21
Self-citationToF/RGB Sensor Fusion for 3-D Endoscopy
Haase, S., Forman, C., Kilgus, T., Bammer, R., Maier‐Hein, L., & Joachim Hornegger, A. (2013) · Current Medical Imaging Formerly Current Medical Imaging Reviews · doi:10.2174/1573405611309020006 · Cited by 11
Research works printed but not linked: 2
- gil, 2011, Augmented reality and 3-D measurement for monocular laparoscopic abdominal wall hernia repair, 46th Cong Eur Soc Surg Res, 98, 1
- grasa, 2009, EKF monocular SLAM 3-D modeling, measuring and augmented reality from endoscope image sequences, Proc 5th Workshop AMI-ARCS 12th Int Conf MICCAI, 102
Cited by
Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I., & Leonard, J. J. (2016) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2624754 · Cited by 3,596
“Recent results in nonrigid SfM such as [92], [97] are less restrictive but only work in small scenarios.”
Past, present, and future of simultaneous localization and mapping: Toward the robust-perception age
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I. D., & Leonard, J. J. (2016) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-138892 · Cited by 3,048
The status of augmented reality in laparoscopic surgery as of 2016
Bernhardt, S., Nicolau, S. A., Soler, L., & Doignon, C. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.01.007 · Cited by 314
Ozyoruk, K. B., Gokceler, G. I., Bobrow, T. L., Coskun, G., Incetan, K., Almalioglu, Y., Mahmood, F., Curto, E., Perdigoto, L., Oliveira, M., et al. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102058 · Cited by 270
Unsupervised Reverse Domain Adaptation for Synthetic Medical Images via Adversarial Training
Mahmood, F., Chen, R., & Durr, N. J. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2842767 · Cited by 257
“in robotic and laparoscopic surgery [42]–[45].”
Metadata
- Authors
- Grasa, O. G., Bernal, E., Casado, S., Gil, I., & Montiel, J. M. M.
- Affiliations
- Hospital Clínico Universitario Lozano Blesa (ES)
- Universidad de Zaragoza (ES)
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2014-01
- Volume
- 33
- Issue
- 1
- Pages
- 135-146
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W1967329161
- Cited by
- 155
- References
- 37
- Citations by year
- 2026: 11 · 2025: 15 · 2024: 10 · 2023: 17 · 2022: 9 · 2021: 20 · 2020: 17 · 2019: 12 · 2018: 9 · 2017: 17 · 2016: 7 · 2015: 4 · 2014: 6
- FWCI
- 9.11
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Medical Imaging (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Physical Sciences › Earth and Planetary Sciences › Geology › 3D Surveying and Cultural Heritage
- Keywords
- visual SLAM, handheld camera, 3D reconstruction, laparoscopic hernia repair, real-time mapping, interpatient variability
- MeSH terms
- Algorithms, Endoscopy, Hernia, Humans, Image Enhancement, Image Interpretation, Computer-Assisted, Miniaturization, Pattern Recognition, Automated, Sensitivity and Specificity, User-Computer Interface, Video Recording, Reproducibility of Results, Imaging, Three-Dimensional, Surgery, Computer-Assisted, Herniorrhaphy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.