CNN-Based Pose Estimation System for Close-Proximity Operations Around Uncooperative Spacecraft
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
This paper introduces a novel framework which combines a Convolutional Neural Network (CNN) for feature detection with a Covariant Efficient Procrustes Perspective-n-Points (CEPPnP) solver and an Extended Kalman Filter (EKF) to enable robust monocular pose estimation for close-proximity operations around an uncooperative spacecraft. The relative pose estimation of an inactive spacecraft by an active servicer spacecraft is a critical task in the design of current and planned space missions, due to its relevance for close-proximity operations, such as In-Orbit Servicing and Active Debris Removal. The main contribution of this work stands in deriving statistical information from the Image Processing step, by associating a covariance matrix to the heatmaps returned by the CNN for each detected feature. This information is included in the CEPPnP to improve the accuracy of the pose estimation step during filter initialization. The derived measurement covariance matrix is used in a tightly-coupled EKF to allow an enhanced representation of the measurements error from the feature detection step. This increases the filter robustness in case of inaccurate CNN detections. The proposed method is capable of returning reliable estimates of the relative pose as well as of the relative translational and rotational velocities, under adverse illumination conditions and partial occultation of the target. Synthetic 2D images of the European Space Agency's Envisat spacecraft are used to generate datasets for training, validation and testing of the CNN. Likewise, the images are used to recreate representative close-proximity scenarios for the validation of the proposed method.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
EPnP: An Accurate O(n) Solution to the PnP Problem
Lepetit, V., Moreno-Noguer, F., & Fua, P. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-008-0152-6 · Cited by 3,298
Pose estimation for non-cooperative spacecraft rendezvous using convolutional neural networks
Sharma, S., Beierle, C., & D'Amico, S. (2018) · 2018 IEEE Aerospace Conference · doi:10.1109/aero.2018.8396425 · Cited by 207
Satellite Pose Estimation with Deep Landmark Regression and Nonlinear Pose Refinement
Chen, B., Cao, J., Parra, A., & Chin, T.-J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00343 · Cited by 203
Pasqualetto Cassinis, L., Fonod, R., & Gill, E. (2019) · Progress in Aerospace Sciences · doi:10.1016/j.paerosci.2019.05.008 · Cited by 156
Self-citationPose estimation of an uncooperative spacecraft from actual space imagery
D', S., Amico, N. A., Benn, M., & Jørgensen, J. L. (2014) · International Journal of Space Science and Engineering · doi:10.1504/ijspacese.2014.060600 · Cited by 132 · cited 1×
“Additionally, due to the fact that the trainable features can be selected offline prior to the training, the matching of the extracted feature points with the features of the wireframe model can be performed without the need of a large search space for the image-model correspondences, which usually characterizes most…”
BackgroundRobust Model-Based Monocular Pose Initialization for Noncooperative Spacecraft Rendezvous
Sharma, S., Ventura, J., & D’Amico, S. (2018) · Journal of Spacecraft and Rockets · doi:10.2514/1.a34124 · Cited by 128
Robust Features Extraction for On-board Monocular-based Spacecraft Pose Acquisition
Capuano, V., Alimo, S. R., Ho, A. Q., & Chung, S.-J. (2019) · AIAA Scitech 2019 Forum · doi:10.2514/6.2019-2005 · Cited by 39
Multi-View Monocular Pose Estimation for Spacecraft Relative Navigation
Rondao, D., & Aouf, N. (2018) · 2018 AIAA Guidance, Navigation, and Control Conference · doi:10.2514/6.2018-2100 · Cited by 25 · cited 1×
“One of the main advantages of CNNs over standard feature-based algorithms for relative pose estimation [3, 13, 14] is an increase in the robustness under adverse illumination condition, as well as a reduction in the computational complexity.”
Background
Research works printed but not linked: 15
- Tatsch A., 2006, Proceedings of the 2006 Performance Metrics for Intelligent Systems Workshop, 21
- Wieser M., 2015, ASTRA 2015-13th Symposium on Advanced Space Technologies in Robotics and Automation
- 10.1109/CVPR.2014.71 · DOI · Paper page
- Ostrowsky A., 1966, Solution of Equations and Systems of Equations
- 10.5244/C.28.83 · DOI
- 10.1109/JPHOT.2019.2901811 · DOI
- Sharma S., 2019, 29th AAS/AIAA Space Flight Mechanics Meeting
- 10.2514/6.2018-1604 · DOI
- 10.1109/ICRA.2017.7989233 · DOI · Paper page
- 10.1007/978-3-319-46484-8_29 · DOI · Paper page
- Park T., 2019, AAS/AIAA Astrodynamics Specialist Conference
- Curtis H., 2005, Orbital Mechanics for Engineering Students
- Pasqualetto Cassinis L., 2019, International Workshop on Satellite Constellations & Formation Flying
- Sharma S., 2017, Advances in the Astronautical Sciences Guidance, Navigation and Control, 159
- 10.1007/978-3-642-24834-4 · doi:10.1007/978-3-642-24834-4
Cited by
SPEED+: Next-Generation Dataset for Spacecraft Pose Estimation across Domain Gap
Park, T. H., Martens, M., Lecuyer, G., Izzo, D., & D'Amico, S. (2022) · 2022 IEEE Aerospace Conference (AERO) · doi:10.1109/aero53065.2022.9843439 · Cited by 170
Deep learning-based spacecraft relative navigation methods: A survey
Song, J., Rondao, D., & Aouf, N. (2022) · Acta Astronautica · doi:10.1016/j.actaastro.2021.10.025 · Cited by 106
“[46] YOLO, MobileNet 7 Keypoint regressor Synthetic (NST1), SPEED PnP [20] HRNet + Faster R-CNN 7 Keypoint regressor SPEED PnP [53] tiny-YOLOv3 COCO Keypoint regressor SPEED PnP [27] Hourglass network 7 Keypoint regressor Synthetic (Cinema 4D, Envisat S/C) PnP + EKF [21] 2-layer CNN 7 Keypoint regressor Synthetic, rea…”
BackgroundMethodInfluentialSatellite Pose Estimation Competition 2021: Results and Analyses
Park, T. H., Märtens, M., Jawaid, M., Wang, Z., Chen, B., Chin, T.-J., Izzo, D., & D’Amico, S. (2023) · Acta Astronautica · doi:10.1016/j.actaastro.2023.01.002 · Cited by 91
Park, T. H., & D’Amico, S. (2023) · Journal of Guidance, Control, and Dynamics · doi:10.2514/1.g007387 · Cited by 63
“[5] integrate a CNN into an Extended Kalman Filter (EKF), but it is only tested on a trajectory of synthetic images.”
BackgroundMethodHuo, Y., Li, Z., & Zhang, F. (2020) · IEEE Access · doi:10.1109/access.2020.3041415 · Cited by 44
“In [57], a simplified stacked hourglass architecture [15] is constructed for feature detection.”
Method
Metadata
- Authors
- Pasqualetto Cassinis, L., Fonod, R., Gill, E., Ahrns, I., & Gil Fernandez, J.
- Venue
- AIAA Scitech 2020 Forum
- Published
- 2020-01-05
- OpenAlex
- W2997189294
- Cited by
- 36
- References
- 9
- FWCI
- 8.75
- Type
- conference paper
- Language
- en
- Update notices
- correction (2020-01-28)
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: CNN-Based Pose Estimation System for Close-Proximity Operations Around Uncooperative Spacecraft. https://app.cochat.ai/papers/10.2514/6.2020-1457
- The paper
- Pasqualetto Cassinis, L., Fonod, R., Gill, E., Ahrns, I., & Gil Fernandez, J. (2020). CNN-Based Pose Estimation System for Close-Proximity Operations Around Uncooperative Spacecraft. AIAA Scitech 2020 Forum. https://doi.org/10.2514/6.2020-1457
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.