CoChat

SPEED+: Next-Generation Dataset for Spacecraft Pose Estimation across Domain Gap

Open access
Park, Tae Ha, Martens, Marcus, Lecuyer, Gurvan, Izzo, Dario, D'Amico, Simone · 2022 · 2022 IEEE Aerospace Conference (AERO)

The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index; 16 of the 32 sources its claims cite were checked for support.

Abstract

This paper describes the Stanford/ESA Spacecraft PosE Estimation Dataset Plus (SPEED+) dataset for next-generation spacecraft pose estimation across the synthetic-to-real domain gap, comprising synthetic images of the Tango spacecraft.

Overview

CoChat Summary

TL;DR

SPEED+ is a next-generation spacecraft pose estimation dataset built to study the synthetic-to-real domain gap, combining large-scale labeled synthetic imagery with unlabeled hardware-in-the-loop images from the TRON robotic testbed. Baseline CNNs trained only on synthetic images degrade sharply on the HIL domains, though oracle and PRISMA comparisons suggest the HIL images retain learnable features and can serve as surrogates for flight imagery.

Key findings

  • SPEED+ contains 59,960 synthetic images split 80:20 for train/validation, plus 9,531 HIL images from TRON: 6,740 lightbox and 2,791 sunlamp test images. The abstract describes “60,000 synthetic images for training” and “9,531 hardware-in-the-loop images.”
  • Synthetic-only baselines show a large domain gap. For KRN, errors rise from 0.14 m / 3.69° on synthetic to 2.25 m / 44.53° on lightbox and 14.64 m / 80.95° on sunlamp. HigherHRNet degrades less: 0.97 m / 34.71° on lightbox and 0.85 m / 47.75° on sunlamp.
  • Domain-bridging helps but does not close the gap. For KRN on lightbox, synthetic-only gives 2.25 m / 44.53° / pose 1.12; style augmentation gives 1.06 m / 36.14° / 0.81; DANN gives 0.95 m / 33.62° / 0.74; oracle is 0.24 ± 0.04 m / 6.15 ± 0.61° / 0.15 ± 0.01. On sunlamp, synthetic-only gives 14.64 m / 80.95° / 3.73; style augmentation gives 1.32 m / 62.85° / 1.32; DANN gives 2.04 m / 65.37° / 1.47; oracle is 0.19 ± 0.02 m / 5.33 ± 0.36° / 0.13 ± 0.01.
  • The paper reports that SPEED+ HIL images retain learnable features, as shown by oracle performance, and that KRN SPEED-score distributions on PRISMA flight images “more or less overlap” with those on SPEED+ HIL images, supporting HIL images as surrogates for flight images in robustness analysis.

Methods

  • Dataset construction: synthetic images were rendered with the OpenGL-based Optical Stimulator of SLAB’s multi-Satellite Software Simulator. HIL images were captured in the TRON facility using two KUKA robot arms, Vicon tracking, 10 Earth-albedo lightboxes, and a sun lamp, with a half-scale Tango spacecraft mockup. A total of 10,000 pose labels were generated, divided into 10 illumination configurations, post-processed, and manually filtered to leave 6,740 lightbox and 2,791 sunlamp images.
  • Baseline experiments: three pose estimation CNNs—SPN, KRN, and HigherHRNet with EPnP—were trained on synthetic images and tested on HIL domains. DANN and style augmentation were applied to KRN as domain-bridging benchmarks. Oracle performance was approximated by 5-fold cross-validation on each HIL domain, and KRN was also evaluated on the 25-image prisma25 flight dataset.
  • Metrics: position error, orientation error, and pose error/SPEED score. SPEC2021 uses a modified pose error with thresholds θ_q = 0.169° for orientation and θ_t = 2.173 mm/m for normalized translation.

Limitations

  • The paper states that SPEED+ currently contains images of a single known target; future sequels will include more targets, and the KUKA robot arms will undergo a pending update to enable more accurate pose labeling with less human intervention for sample rejection.
  • The paper states that in real missions the servicer typically does not have target images until rendezvous, but SPEC2021 makes unlabeled lightbox and sunlamp images public to encourage participation; these operational constraints are not enforced.
  • The paper states that the baseline studies are intended to characterize the dataset rather than identify the best architecture or algorithm, with more comprehensive analysis planned after the competition. Evident from the text: HIL test images are unlabeled, manual sample rejection was required, retained artifacts include infrared markers, mounting holes, and unnatural surface glow, and calibration may allow up to centimeter-level position error beyond close range.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1109/aero53065.2022.9843439

Cites

54 of 54 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Example images from different domains of SPEED+.
Figure 1 Example images from different domains of SPEED+.From the PDF
Figure 2 (a) The visualization of the TRON facility simulation room layout. Ten light boxes (L1 ∼ L10) and three positions of the sun lamp (S1 ∼ S3) are marked and noted. (b) The half-scale Tango spacecraft mockup model is illuminated by two light boxes (L1, L2). (c) The same model is illuminated by the sun lamp placed at S1.
Figure 2 (a) The visualization of the TRON facility simulation room layout. Ten light boxes (L1 ∼ L10) and three positions of the sun lamp (S1 ∼ S3) are marked and noted. (b) The half-scale Tango spacecraft mockup model is illuminated by two light boxes (L1, L2). (c) The same model is illuminated by the sun lamp placed at S1.From the PDF
Figure 3 ( Left ) Position ( top ) and orientation ( bottom ) label distributions for lightbox , and sunlamp datasets. The position label is represented in the camera frame ( C ) whose z -axis is along the camera boresight, and the xy -axes form the image plane. The relative orientation distribution is paremetrized as ZYX Euler angles. ( Right ) The distribution of incident sunlamp direction as spherical coordinates in the target body reference frame ( T ). Samples are color-coded for different illumination configurations for sunlamp domain.
Figure 3 ( Left ) Position ( top ) and orientation ( bottom ) label distributions for lightbox , and sunlamp datasets. The position label is represented in the camera frame ( C ) whose z -axis is along the camera boresight, and the xy -axes form the image plane. The relative orientation distribution is paremetrized as ZYX Euler angles. ( Right ) The distribution of incident sunlamp direction as spherical coordinates in the target body reference frame ( T ). Samples are color-coded for different illumination configurations for sunlamp domain.From the PDF
Figure 4 Camera poses for 305 real images of SPEED in the Tango model's body frame ( B ) from two views. The simplified wireframe model of the satellite is plotted in green; camera poses are plotted in red and black for test and training samples, respectively. Directly taken from Kisantal et al. [5].
Figure 4 Camera poses for 305 real images of SPEED in the Tango model's body frame ( B ) from two views. The simplified wireframe model of the satellite is plotted in green; camera poses are plotted in red and black for test and training samples, respectively. Directly taken from Kisantal et al. [5].From the PDF
Image 5
From the PDF
Figure 6 Pipeline for post-processing the sunlamp images.
Figure 6 Pipeline for post-processing the sunlamp images.From the PDF
Figure 7 Cumulative distributions of KRN's SPEED score when tested on SPEED+ HIL and PRISMA flight images after 5 training sessions with different random seeds.
Figure 7 Cumulative distributions of KRN's SPEED score when tested on SPEED+ HIL and PRISMA flight images after 5 training sessions with different random seeds.From the PDF
Figure 8 Visualization of the retained artifacts, such as the infrared markers ( top , blue), mounting holes ( top , red), and the unnatural shape of the surface glow ( bottom ).
Figure 8 Visualization of the retained artifacts, such as the infrared markers ( top , blue), mounting holes ( top , red), and the unnatural shape of the surface glow ( bottom ).From the PDF
Image 9
From the PDF
Figure 9 Example samples rejected from sunlamp domain due to extreme surface glow and camera overexposure ( left ) and failed post-processing ( right ).
Figure 9 Example samples rejected from sunlamp domain due to extreme surface glow and camera overexposure ( left ) and failed post-processing ( right ).From the PDF
Figure 10 Example lightbox images with the wireframe model of the Tango spacecraft projected based on associated labels and the provided camera properties.
Figure 10 Example lightbox images with the wireframe model of the Tango spacecraft projected based on associated labels and the provided camera properties.From the PDF
Figure 11 Example sunlamp images with the wireframe model of the Tango spacecraft projected based on associated labels and the provided camera properties.
Figure 11 Example sunlamp images with the wireframe model of the Tango spacecraft projected based on associated labels and the provided camera properties.From the PDF
Image 13
From the PDF
Image 14
From the PDF
Image 15
From the PDF
Image 16
From the PDF
Image 17
From the PDF

Verification

Claims the paper makes

10 Valid · 7 Not valid · 5 Not checked · 37 Own results and interpretations

14 more claims · 1 with their cited sources checked

Create a free account to see all 59 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 30
  • It may state two separate claims as one. 19
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

1 more claim about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Show all 54 references

Research works printed but not linked: 3

  1. 0, Vero Compact super wide camera by vicon
  2. 2016, Verification of light-box devices for earth albedo simulation, Technical Note Stanford Space Rendezvous Lab (SLAB)
  3. tsiotras, 2014, Astros: A 5dof experimental facility for research in space proximity operations, Advances in the Astronautical Sciences, 151, 717

Cited by

See all 170

Metadata

Authors
Park, T. H., Martens, M., Lecuyer, G., Izzo, D., & D'Amico, S.
Affiliations
  • Stanford University (US)
  • Advanced Concepts Team European Space Agency,Noordwijk,AZ,The Netherlands,2201
  • European Space Agency (FR)
  • Stanford University,Department of Aeronautics & Astronautics,Stanford,CA,94305
Venue
2022 IEEE Aerospace Conference (AERO)
Publisher
IEEE
Published
2022-03-05
Pages
1-15
ISSN
1095-323X (ISSN-L)
OpenAlex
W3202897977
Cited by
170
References
46
Citations by year
2026: 32 · 2025: 64 · 2024: 40 · 2023: 31 · 2022: 3
FWCI
60.27
Type
conference paper
Language
en
Open access
Locations
  • IEEE Aerospace Conference (AERO) (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Engineering › Aerospace Engineering › Space Satellite Systems and Control
  • Physical Sciences › Engineering › Aerospace Engineering › Spacecraft Dynamics and Control
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Keywords
spacecraft pose estimation, spacecraft navigation, domain gap, synthetic images, illumination variation, on-orbit servicing, space logistics, visual navigation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (prompt extract-v3).

A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: SPEED+: Next-Generation Dataset for Spacecraft Pose Estimation across Domain Gap. https://app.cochat.ai/papers/10.1109/aero53065.2022.9843439
The paper
Park, T. H., Martens, M., Lecuyer, G., Izzo, D., & D'Amico, S. (2022). SPEED+: Next-Generation Dataset for Spacecraft Pose Estimation across Domain Gap. 2022 IEEE Aerospace Conference (AERO). https://doi.org/10.1109/aero53065.2022.9843439

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.