ChiNet: Deep Recurrent Convolutional Learning for Multimodal Spacecraft Pose Estimation
Open accessThe DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
Abstract
This paper presents an innovative deep learning pipeline which estimates the relative pose of a spacecraft by incorporating the temporal information from a rendezvous sequence. It leverages the performance of long short-term memory (LSTM) units in modelling sequences of data for the processing of features extracted by a convolutional neural network (CNN) backbone. Three distinct training strategies, which follow a coarse-to-fine funnelled approach, are combined to facilitate feature learning and improve end-to-end pose estimation by regression. The capability of CNNs to autonomously ascertain feature representations from images is exploited to fuse thermal infrared data with electro-optical red-green-blue (RGB) inputs, thus mitigating the effects of artifacts from imaging space objects in the visible wavelength. Each contribution of the proposed framework, dubbed ChiNet, is demonstrated on a synthetic dataset, and the complete pipeline is validated on experimental data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“In this direction, recently proposed ChiNet [188] have used Long Short-Term Memory (LSTM) [194] units in modelling sequences of data for estimating the spacecraft pose.”
From A survey on deep learning-based monocular spacecraft pose estimation: Current state, limitations and prospects (2023) · cites this paper as [188]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 2×
“ChiNet’s recurrent feature postprocessing module is based on the LSTM architecture [41].”
MethodAdam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · cited 1×
“A subset of 1000 object categories of ImageNet [53] is the typical go-to choice for pre-trained networks.”
BackgroundDistinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589 · cited 2×
“, SIFT [19], SURF [20], or the more modern ORB [21]) to obtain the matches.”
BackgroundRethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893 · cited 4×
“As the target is generally known beforehand, the followed strategies often choose to solve the model-to-image registration problem, under which the pose is retrieved via methods in [4] and [5] from correspondences between 2-D image features and 3-D model points.”
MethodInfluentialYOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892 · cited 1×
“To mitigate this, ChiNet adopts the Darknet-19 architecture (backbone of the YOLO object detector [45]), with some modifications (see Fig.”
MethodYOLOv3: An Incremental Improvement
Redmon, J., & Farhadi, A. (2018) · arXiv · doi:10.48550/arxiv.1804.02767 · Cited by 17,141 · cited 1×
“Second the network is modernised (bringing it closer to Darknet-53 [47]) by replacing all max pooling layers with a stride of 2 in the preceding convolution.”
MethodSURF: Speeded Up Robust Features
Bay, H., Tuytelaars, T., & Van Gool, L. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_32 · Cited by 14,955 · cited 1×
“An alternative approach constructs a database by discretising the 3D object into 2D keyframes representing multiple viewpoints [18], and then using local keypoint detectors and descriptors (e.g. SIFT [19], SURF [20], or the more modern ORB [21]) to obtain the matches.”
Method
Research works printed but not linked: 1
- Gansmann, 2017, 3D model-based relative pose estimation for rendezvous and docking using edge features
Cited by
Pauly, L., Rharbaoui, W., Shneider, C., Rathinam, A., Gaudillière, V., & Aouada, D. (2023) · Acta Astronautica · doi:10.1016/j.actaastro.2023.08.001 · Cited by 121
“In this direction, recently proposed ChiNet [137] have used Long Short-Term Memory (LSTM) [50] units in modelling sequences of data for estimating the spacecraft pose.”
BackgroundMethodGolroudbari, A. A., & Sabour, M. H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.11089 · Cited by 34
“[151] Supervised YOLO Synthetic Fault Detection [152] Supervised YOLO + MobileNet SPEED Pose Estimation [153] Supervised Faster R-CNN + HRNet SPEED Pose Estimation [154] Reinforcement Learning Deep Reinforcement Learning ✗ Landing [146] Reinforcement Learning Deep Reinforcement Learning ✗ Decision Making [155] Reinfor…”
MethodRTM-UAVDet: A Real-Time Multimodal UAV Detector
Wang, G., Jiang, Q., Jin, X., Woźniak, M., Yao, P. W. S., & Yao, S. (2024) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2024.3446460 · Cited by 32
TransFusionOdom: Transformer-Based LiDAR-Inertial Fusion Odometry Estimation
Sun, L., Ding, G., Qiu, Y., Yoshiyasu, Y., & Kanehiro, F. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3302401 · Cited by 30
Golroudbari, A. A., & Sabour, M. H. (2023) · doi:10.22541/au.168664884.43899660/v1 · Cited by 25
Metadata
- Authors
- Rondao, D., Aouf, N., & Richardson, M. A.
- Affiliations
- City, University of London (GB)
- University of London (GB)
- Cranfield University (GB)
- Venue
- IEEE Transactions on Aerospace and Electronic Systems
- Published
- 2022
- Pages
- 1-13
- ISSN
- 0018-9251 (ISSN-L)
- 1557-9603
- 2371-9877
- OpenAlex
- W3195488172
- Cited by
- 24
- References
- 62
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 8 · 2023: 7 · 2022: 1
- FWCI
- 2.34
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Aerospace and Electronic Systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- City Research Online (City University London) (submittedVersion)
- CERES (Cranfield University) (submittedVersion, cc-by-nc)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Engineering › Aerospace Engineering › Space Satellite Systems and Control
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Aerospace Engineering › Spacecraft Dynamics and Control
- Keywords
- spacecraft pose estimation, relative pose estimation, long short-term memory, convolutional neural networks, multimodal fusion, thermal infrared imaging, RGB imaging, coarse-to-fine training, representation learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: ChiNet: Deep Recurrent Convolutional Learning for Multimodal Spacecraft Pose Estimation. https://app.cochat.ai/papers/10.1109/taes.2022.3193085
- The paper
- Rondao, D., Aouf, N., & Richardson, M. A. (2022). ChiNet: Deep Recurrent Convolutional Learning for Multimodal Spacecraft Pose Estimation. IEEE Transactions on Aerospace and Electronic Systems. https://doi.org/10.1109/taes.2022.3193085
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.