CoChat
Sign Up
PreprintCited by 292Autonomous Vehicle Technology and SafetyTraffic Prediction and Management TechniquesTraffic and Road Safety

One Thousand and One Hours: Self-driving Motion Prediction Dataset

Open access
Houston, John, Zuidhof, Guido, Bergamini, Luca, Ye, Yawei, Chen, Long, Jain, Ashesh, Omari, Sammy, Iglovikov, Vladimir +1 more·2020·arXiv
DOI 10.48550/arxiv.2006.14480arXiv 2006.14480
Open this paper in CoChat — free accountOpen PDF

Abstract

Motivated by the impact of large-scale datasets on ML systems we present the largest self-driving dataset for motion prediction to date, containing over 1,000 hours of data. This was collected by a fleet of 20 autonomous vehicles along a fixed route in Palo Alto, California, over a four-month period. It consists of 170,000 scenes, where each scene is 25 seconds long and captures the perception output of the self-driving system, which encodes the precise positions and motions of nearby vehicles, cyclists, and pedestrians over time. On top of this, the dataset contains a high-definition semantic map with 15,242 labelled elements and a high-definition aerial view over the area. We show that using a dataset of this size dramatically improves performance for key self-driving problems. Combined with the provided software kit, this collection forms the largest and most detailed dataset to date for the development of self-driving machine learning tasks, such as motion forecasting, motion planning and simulation. The full dataset is available at http://level5.lyft.com/.

Integrity signals

Registry

DataCite · 10.48550/arxiv.2006.14480

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Only the Lyft, Shifts and nuPlan datasets provide more than 1000h of driving data, and nuPlan was the first such dataset that provides lidar and camera sensor data (128h), although Waymo later also released compressed lidar data.

    “Only the Lyft [19], Shifts [15] and nuPlan datasets provide more than 1000h of driving data and nuPlan was the first such dataset that provides lidar and camera sensor data (128h), although Waymo [17] later also released compressed lidar data.”

    From Towards learning-based planning: The nuPlan benchmark for real-world autonomous driving (2024) · cites this paper as [19]

  • The offline perception system used for auto-labeling is not constrained by latency and causality, so the fidelity of generated tracks is drastically higher than online perception systems, enabling evaluation of planning under very limited perception noise.

    “Compared with the online perception systems used in many other datasets [19], [13], the offline version is not constrained by latency and causality.Therefore, the fidelity of the generated tracks is drastically higher, enabling us to evaluate planning performance under very limited perception noise.”

    From Towards learning-based planning: The nuPlan benchmark for real-world autonomous driving (2024) · cites this paper as [19]

  • Traffic light statuses are crucial for realistic traffic simulation, but only Waymo and Lyft contain these and only from an online perception system, rather than developing offline traffic light status inference as in nuPlan.

    “Likewise, the availability of traffic light statuses is crucial for realistic traffic simulation, but only Waymo [17] and Lyft [19] contain these and only from an online perception system, rather than developing offline traffic light status inference as in nuPlan.”

    From Towards learning-based planning: The nuPlan benchmark for real-world autonomous driving (2024) · cites this paper as [19]

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Houston, J., Zuidhof, G., Bergamini, L., Ye, Y., Chen, L., Jain, A., Omari, S., Iglovikov, V., & Ondruska, P.
ORCID
Venue
arXiv
Publisher
arXiv
Published
2020
Pages
409-418
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2006.14480
arXiv
2006.14480
OpenAlex
W3037058446
Cited by
292
References
6
Citations by year
2025: 35 · 2024: 76 · 2023: 83 · 2022: 60 · 2021: 33 · 2020: 5
Type
posted content
Language
en
Open access
Licence
creativecommons.org/licenses/by/4.0/legalcode
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
  • Physical Sciences › Engineering › Building and Construction › Traffic Prediction and Management Techniques
  • Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Traffic and Road Safety
Keywords
autonomous driving, motion prediction, autonomous vehicle fleets, semantic maps, aerial imagery, motion planning, driving simulation, Level 5

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review