On Lunar On-Orbit Vision-Based Navigation: Terrain Mapping, Feature Tracking Driven EKF
Abstract
This paper presents an approach to vision guided, feature-based navigation that integrates absolute navigation concepts involving image feature extraction and matching to a database, with relative navigation including feature flow and tracking. The approach uses an extended Kalman filter (EKF) for vehicle navigation to integrate the two methodologies and thus capture the advantages of both techniques. This methodology was specifically developed for navigation in lunar orbiting or landing applications. Crater fiducial markers from the lunar surface are identified in an image and associated to a database; these are tracked across the image plane as the lunar lander moves in its orbit. In addition to the vision sensor, an altimeter is used to supply altitude measurements above the surface of the moon. The EKF presented here estimates the inertial vehicle position and velocity states by tracking the fiducials, whose inertial coordinates are now known, across the image plane. The accuracy improvements of this approach are substantial compared to either the absolute navigation pose estimation methods or the relative navigation optical flow methods when used alone in the same scenarios. The dominant computational overhead in any of these methods is in acquiring and processing the images for the features. Therefore, there is little additional processing load associated with this method that either of the other vision-based techniques do not require. Images used in this research to develop and analyze the algorithms were obtained from NASA’s Clementine lunar mapping mission.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Craters database matching is typically exploited to retrieve the absolute pseudo-measurement.
“In particular, literature demonstrates that craters database matching is typically exploited to retrieve the absolute pseudo-measurement [10,11].”
From Optical navigation for Lunar landing based on Convolutional Neural Network crater detector (2022) · cites this paper as [10]
In prior work, database matching is performed via a nearest neighbor approach, linking the output from the object detector to the navigation filter.
“In these papers, the database matching is performed via nearest neighbor approach, linking the output from the object detector to the navigation filter.”
From Optical navigation for Lunar landing based on Convolutional Neural Network crater detector (2022) · cites this paper as [10]
The achieved inference time makes the ODN a promising, and fast, alternative to the iterative, and slower, processes of template matching and thresholding required in classical techniques.
“the achieved inference time makes the ODN a promising, and fast, alternative to the iterative, and slower, processes of template matching and thresholding required in classical techniques [10].”
From Optical navigation for Lunar landing based on Convolutional Neural Network crater detector (2022) · cites this paper as [10]
[12] incorporated random sample consensus (RANSAC) to check whether the translation vectors between detected craters and known craters were consistent in images where multiple craters were detected; if a crater match produced a translation vector that was an outlier, then that match was rejected.
“This approach incorporated random sample consensus (RANSAC) [13] to check whether the translation vectors between detected craters and known craters were consistent in images where multiple craters were detected.If a crater match produced a translation vector that was an outlier from the other crater matches, then that match was rejected.”
From Lunar Terrain Relative Navigation Using a Convolutional Neural Network for Visual Crater Detection (2020) · cites this paper as [12]
Cites
GELB, A. (1974) · CERN Document Server (European Organization for Nuclear Research) · Cited by 6,367 · see citing works
Brinkmann, K.-D. (1991) · Springer eBooks · doi:10.1007/978-3-642-74176-0_23 · Cited by 2,399 · see citing works
Haddad, A. H. (1976) · Proceedings of the IEEE · doi:10.1109/proc.1976.10175 · Cited by 804 · see citing works
Linear pose estimation from points or lines
Ansar, A. I., & Daniilidis, K. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1195992 · Cited by 438 · see citing works
2008 IEEE Aerospace Conference
(2008) · doi:10.1109/aero12908.2008 · Cited by 330 · see citing works
Efficient linear solution of exterior orientation
Fiore, P. D. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.908965 · Cited by 191 · see citing works
A Sharper View of Impact Craters from Clementine Data
Pieters, C. M., Staid, M. I., Fischer, E. M., Tompkins, S., & He, G. (1994) · Science · doi:10.1126/science.266.5192.1844 · Cited by 158 · see citing works
Pose estimation using 3D view-based eigenspaces
Morency, L.-P., Sundberg, P., & Darrell, T. J. (2004) · Proceedings - IEEE International SOI Conference/Proceedings · doi:10.1109/amfg.2003.1240823 · Cited by 67 · see citing works
Linear Pose Estimation from Points or Lines
Ansar, A. I., & Daniilidis, K. (2002) · Lecture notes in computer science · doi:10.1007/3-540-47979-1_19 · Cited by 48 · see citing works
Vision-Aided Navigation for Small UAVs in GPS-Challenged Environments
Madison, R. W., Andrews, G., DeBitetto, P. A., Rasmussen, S., & Bottkol, M. (2007) · AIAA Infotech@Aerospace 2007 Conference and Exhibit · doi:10.2514/6.2007-2986 · Cited by 43 · see citing works
Target Geolocation from a Small Unmanned Aircraft System
Madison, R. W., DeBitetto, P. A., Olean, A. R., & Peebles, M. (2008) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero.2008.4526560 · Cited by 25 · see citing works
An efficient iterative pose estimation algorithm
Or, S.-H., Luk, W. S., Wong, K. H., & King, I. (1997) · Lecture notes in computer science · doi:10.1007/3-540-63931-4_262 · Cited by 6 · see citing works
Feng, X., & Liu, W. (1997) · CaltechAUTHORS (California Institute of Technology) · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Deep learning-based spacecraft relative navigation methods: A survey
Song, J., Rondao, D., & Aouf, N. (2022) · Acta Astronautica · doi:10.1016/j.actaastro.2021.10.025 · Cited by 106 · see citing works
“Compared to an image processing-based crater detection method [84], the LunaNet + EKF combination produces considerable improvements on the accuracy of the TRN, with reliable performance in variable lighting conditions.”
MethodOptical navigation for Lunar landing based on Convolutional Neural Network crater detector
Silvestrini, S., Piccinin, M., Zanotti, G., Brandonisio, A., Bloise, I., Feruglio, L., Lunghi, P., Lavagna, M., & Varile, M. (2022) · Aerospace Science and Technology · doi:10.1016/j.ast.2022.107503 · Cited by 65 · see citing works
Crater Navigation System for Autonomous Precision Landing on the Moon
Maass, B., Woicke, S., Oliveira, W. M., Razgus, B., & Krüger, H. (2020) · Journal of Guidance Control and Dynamics · doi:10.2514/1.g004850 · Cited by 63 · see citing works
Deep Learning Crater Detection for Lunar Terrain Relative Navigation
Downes, L., Steiner, T. J., & How, J. P. (2020) · AIAA Scitech 2020 Forum · doi:10.2514/6.2020-1838 · Cited by 57 · see citing works
Lunar Terrain Relative Navigation Using a Convolutional Neural Network for Visual Crater Detection
Downes, L. M., Steiner, T. J., & How, J. P. (2020) · 2020 American Control Conference (ACC) · doi:10.23919/acc45564.2020.9147595 · Cited by 35 · see citing works
Image-Based Lunar Terrain Relative Navigation Without a Map: Measurements
Christian, J. A., Hong, L., McKee, P., Christensen, R., & Crain, T. P. (2021) · Journal of Spacecraft and Rockets · doi:10.2514/1.a34875 · Cited by 31 · see citing works
Latorre, F., Spiller, D., Sasidharan, S. T., Basheer, S., & Curti, F. (2023) · Icarus · doi:10.1016/j.icarus.2023.115434 · Cited by 27 · see citing works
Visual–inertial navigation for pinpoint planetary landing using scale-based landmark matching
Delaune, J. H., Besnerais, G. L., Voirin, T., Farges, J.-L., & Bourdarias, C. (2016) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2016.01.007 · Cited by 27 · see citing works
Terrain-Relative and Beacon-Relative Navigation for Lunar Powered Descent and Landing
Christensen, D. P., & Geller, D. K. (2011) · The Journal of the Astronautical Sciences · doi:10.1007/bf03321162 · Cited by 19 · see citing works
Edge information based crater detection and matching for lunar exploration
He, J., Cui, H., & Junhua, F. (2010) · International Conference on Intelligent Control and Information Processing · doi:10.1109/icicip.2010.5565284 · Cited by 18 · see citing works
Robust deep learning LiDAR-based pose estimation for autonomous space landers
Chekakta, Z., Zenati, A., Aouf, N., & Dubois-Matra, O. (2022) · Acta Astronautica · doi:10.1016/j.actaastro.2022.08.049 · Cited by 17 · see citing works
Graph-based terrain relative navigation with optimal landmark database selection
Steiner, T. J., Brady, T. M., & Hoffman, J. A. (2015) · 2015 IEEE Aerospace Conference · doi:10.1109/aero.2015.7119053 · Cited by 16 · see citing works
Crater Detection and Recognition Method for Pose Estimation
Chen, Z., & Jiang, J. (2021) · Remote Sensing · doi:10.3390/rs13173467 · Cited by 16 · see citing works
Prete, R. D., & Renga, A. (2022) · Aerotecnica Missili & Spazio · doi:10.1007/s42496-022-00139-0 · Cited by 16 · see citing works
Crater Edge-based Flexible Autonomous Navigation for Planetary Landing
Tian, Y., Yu, M., Yao, M., & Huang, X. (2018) · Journal of Navigation · doi:10.1017/s0373463318000966 · Cited by 11 · see citing works
Ground-Assisted Position Navigation and Timing (PNT) for Moon and Mars
Cheung, K., Jun, W. W., Bhamidipati, S., & Carter, P. (2024) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero58975.2024.10520998 · Cited by 10 · see citing works
Maass, B. (2016) · CEAS Space Journal · doi:10.1007/s12567-016-0129-1 · Cited by 10 · see citing works
Deep Space Autonomous Navigation Options for Future Missions
Steffes, S. R., & Barton, G. H. (2017) · AIAA SPACE and Astronautics Forum and Exposition · doi:10.2514/6.2017-5369 · Cited by 10 · see citing works
Near-Real-Time Detection of Craters: A YOLO v5 Based Approach
Chatterjee, S., Chakraborty, S., Nath, A., Chowdhury, P. R., & Deshmukh, B. (2023) · International Conference on Machine Intelligence for GeoAnalytics and Remote Sensing (MIGARS) · doi:10.1109/migars57353.2023.10064529 · Cited by 9 · see citing works
Optical Terrain Relative Navigation Approaches to Lunar Orbit, Descent and Landing
Steffes, S. R., Monterroza, F., Benhacine, L., & Mario, C. (2019) · AIAA SciTech Forum · doi:10.2514/6.2019-1178 · Cited by 8 · see citing works
Vision-based navigation and hazard detection for terrestrial rocket approach and landing
Steiner, T. J., & Brady, T. M. (2014) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero.2014.6836216 · Cited by 7 · see citing works
Vision-Based Terrain Relative Navigation on High Altitude Balloon and Sub-Orbital Rocket
Maggio, D. R., Mario, C., Streetman, B. J., Steiner, T. J., & Carlone, L. (2023) · AIAA SciTech Forum · doi:10.2514/6.2023-0875 · Cited by 5 · see citing works
A Robust Crater Matching Algorithm for Autonomous Vision-Based Spacecraft Navigation
Prete, R. D., & Renga, A. (2021) · IEEE International Workshop on Metrology for AeroSpace (MetroAeroSpace) · doi:10.1109/metroaerospace51421.2021.9511670 · Cited by 5 · see citing works
Crater identification by perspective cone alignment
Chng, C.-K., McLeod, S. J. A., Rodda, M., & Chin, T.-J. (2024) · Acta Astronautica · doi:10.1016/j.actaastro.2024.07.053 · Cited by 3 · see citing works
Mario, C., Miller, C., Norman, C., Olds, R., Palmer, E. E., Weirich, J. R., Lorenz, D. A., Barnouin, O. S., Bos, B. J., Rizk, B., et al. (2022) · AIAA SciTech Forum · doi:10.2514/6.2022-0357 · Cited by 3 · see citing works
Toward Faster and Accurate Detection of Craters
Chatterjee, S., Chakraborty, S., Chowdhury, P. R., Deshmukh, B., & Nath, A. (2025) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2025.3557756 · Cited by 2 · see citing works
A Review of Deep Space Image-Based Navigation Methods
Lin, X., Li, T., Hua, B., Li, L., & Zhao, C. (2025) · Aerospace · doi:10.3390/aerospace12090789 · Cited by 2 · see citing works
Liheng, 许. X., Jie, 江. J., & Yan, 马. M. (2023) · Laser & Optoelectronics Progress · doi:10.3788/lop223406 · Cited by 2 · see citing works
Survey on AI‐Enabled Computer Vision Technologies and Applications for Space Robotic Missions
Quoos, M., Kay, S., Wajoras, J., Field, R., Ntagiou, E., Mohammad, F., & Gao, Y. (2026) · Journal of Field Robotics · doi:10.1002/rob.70150 · Cited by 1 · see citing works
Performance of a Crater Navigation Method for Lunar South Pole Landing
Woicke, S., & Krüger, H. (2023) · AIAA SciTech Forum · doi:10.2514/6.2023-0690 · Cited by 1 · see citing works
Signature method for determination of the lunar lander position by video image
Bobkov, A. V., & Yang, X. L. (2023) · Engineering Journal Science and Innovation · doi:10.18698/2308-6033-2023-5-2278 · Cited by 1 · see citing works
Vision Based Lunar Landing Using RC64 Rad Hard DSP/ML Manycore Processor
Ginosar, R., Aviely, P., Shor, Y., Leiter, N., Mor, R., Mintz, S., & Kouperman, V. (2023) · European Data Handling & Data Processing Conference (EDHPC) · doi:10.23919/edhpc59100.2023.10396521 · Cited by 1 · see citing works
Extent-Informed Tracking for Feature-Based Navigation
Brouk, J. D., & DeMars, K. J. (2024) · AIAA SciTech Forum · doi:10.2514/6.2024-1581 · Cited by 1 · see citing works
Utility-based map reduction for ground and flight vehicle navigation
Steiner, T. J. (2015) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 1 · see citing works
Overview of Guidance, Navigation and Control System of the TeamIndus lunar landerPreprint
Vatsal, V., Barath, C., Yogeshwaran, J., Gandhi, D., Sahu, C., Balasubramanian, K., Mohan, S., Menon, M. S., Natarajan, P., & Raghavan, V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.10955 · Cited by 1 · see citing works
CubeSat-Based Lunar Map Refinement Utilizing Surface Beacons and a Monocular Camera
Gardner, T., Hansen, M., Wisniewski, N., & Christensen, R. (2020) · IEEE/ION Position Location and Navigation Symposium · doi:10.1109/plans46316.2020.9109980
Hardware-in-the loop testing of crater navigation system for lunar landing
Woicke, S., & Krüger, H. (2024) · AIAA SciTech Forum · doi:10.2514/6.2024-0312
- Authors
- Singh, L., & Lim, S.
- Affiliations
- Draper Laboratory (US)
- ORCID
- Singh, Leena
- Venue
- AIAA Guidance, Navigation and Control Conference and Exhibit
- Published
- 2008-06-15
- OpenAlex
- W2320879449
- Cited by
- 37
- References
- 13
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 4 · 2023: 7 · 2022: 4 · 2021: 3 · 2020: 5 · 2019: 2 · 2018: 1 · 2017: 1 · 2016: 2 · 2015: 2 · 2014: 1
- FWCI
- 1.30
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- AIAA Guidance, Navigation, and Control Conference and Exhibit (publishedVersion)
- Funders
- Else Kröner-Fresenius-Stiftung
- Topics
- Physical Sciences › Engineering › Aerospace Engineering › Spacecraft Dynamics and Control
- Physical Sciences › Engineering › Aerospace Engineering › Inertial Sensor and Navigation
- Physical Sciences › Engineering › Aerospace Engineering › Robotics and Sensor-Based Localization
- Keywords
- visual navigation, feature tracking, extended Kalman filter, relative navigation, optical flow, lunar lander, altimeter, Clementine mission
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review