The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
V2X-Sim: Multi-Agent Collaborative Perception Dataset and Benchmark for Autonomous Driving
Open accessAbstract
Vehicle-to-everything (V2X) communication techniques enable the collaboration between vehicles and many other entities in the neighboring environment, which could fundamentally improve the perception system for autonomous driving. However, the lack of a public dataset significantly restricts the research progress of collaborative perception. To fill this gap, we present V2X-Sim, a comprehensive simulated multi-agent perception dataset for V2X-aided autonomous driving. V2X-Sim provides: (1) multi-agent sensor recordings from the road-side unit (RSU) and multiple vehicles that enable collaborative perception, (2) multi-modality sensor streams that facilitate multi-modality perception, and (3) diverse ground truths that support various perception tasks. Meanwhile, we build an open-source testbed and provide a benchmark for the state-of-the-art collaborative perception algorithms on three tasks, including detection, tracking and segmentation. V2X-Sim seeks to stimulate collaborative perception research for autonomous driving before realistic datasets become widely available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
The Cityscapes Dataset for Semantic Urban Scene Understanding
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.350 · Cited by 12,433
nuScenes: A Multimodal Dataset for Autonomous Driving
Caesar, H., Bankiti, V., Lang, A. H., Vora, S., Liong, V. E., Xu, Q., Krishnan, A., Pan, Y., Baldan, G., & Beijbom, O. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01164 · Cited by 7,152
Simple online and realtime tracking
Bewley, A., Ge, Z., Ott, L., Ramos, F., & Upcroft, B. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7533003 · Cited by 4,433
Image segmentation using deep learning: A survey
Minaee, S., Boykov, Y. Y., Porikli, F., Plaza, A. J., Kehtarnavaz, N., & Terzopoulos, D. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3059968 · Cited by 3,796
CARLA: An open urban driving simulator
Dosovitskiy, A., Ros, G., Codevilla, F., Lopez, A., & Koltun, V. (2017) · arXiv · doi:10.48550/arxiv.1711.03938 · Cited by 3,718
Scalability in Perception for Autonomous Driving: Waymo Open Dataset
Sun, P., Kretzschmar, H., Dotiwalla, X., Chouard, A., Patnaik, V., Tsui, P., Guo, J., Zhou, Y., Chai, Y., Caine, B., et al. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00252 · Cited by 3,437
Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics
Bernardin, K., & Stiefelhagen, R. (2008) · EURASIP Journal on Image and Video Processing · doi:10.1155/2008/246309 · Cited by 2,918
Ros, G., Sellart, L., Materzynska, J., Vazquez, D., & Lopez, A. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.352 · Cited by 2,338
SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR Sequences
Behley, J., Garbade, M., Milioto, A., Quenzel, J., Behnke, S., Stachniss, C., & Gall, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00939 · Cited by 2,294
(2012) · elib (German Aerospace Center) · Cited by 1,994
Argoverse: 3D Tracking and Forecasting With Rich Maps
Chang, M.-F., Lambert, J., Sangkloy, P., Singh, J., Bak, S., Hartnett, A., Wang, D., Carr, P., Lucey, S., Ramanan, D., et al. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00895 · Cited by 1,474
The Mapillary Vistas Dataset for Semantic Understanding of Street Scenes
Neuhold, G., Ollmann, T., Bulo, S. R., & Kontschieder, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.534 · Cited by 1,434
HOTA: A Higher Order Metric for Evaluating Multi-object Tracking
Luiten, J., Os̆ep, A., Dendorfer, P., Torr, P., Geiger, A., Leal-Taixé, L., & Leibe, B. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-020-01375-2 · Cited by 1,171
HOTA: A Higher Order Metric for Evaluating Multi-object Tracking
Luiten, J. T., Os̆ep, A., Dendorfer, P., Torr, P., Geiger, A., Leal-Taixé, L., & Leibe, B. (2020) · RWTH Publications (RWTH Aachen) · Cited by 740
A Survey on 3D Object Detection Methods for Autonomous Driving Applications
Arnold, E., Al-Jarrah, O. Y., Dianati, M., Fallah, S., Oxtoby, D., & Mouzakitis, A. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2892405 · Cited by 713
The ApolloScape Dataset for Autonomous Driving
Huang, X., Cheng, X., Geng, Q., Cao, B., Zhou, D., Wang, P., Lin, Y., & Yang, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00141 · Cited by 679
Luo, W., Yang, B., & Urtasun, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00376 · Cited by 644
Xu, R., Xiang, H., Xia, X., Han, X., Li, J., & Ma, J. (2022) · 2022 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra46639.2022.9812038 · Cited by 586
Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Dataset
Ettinger, S., Cheng, S., Caine, B., Liu, C., Zhao, H., Pradhan, S., Chai, Y., Sapp, B., Qi, C., Zhou, Y., et al. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00957 · Cited by 584
DAIR-V2X: A Large-Scale Dataset for Vehicle-Infrastructure Cooperative 3D Object Detection
Yu, H., Luo, Y., Shu, M., Huo, Y., Yang, Z., Shi, Y., Guo, Z., Li, H., Hu, X., Yuan, J., et al. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.02067 · Cited by 577
V2VNet: Vehicle-to-Vehicle Communication for Joint Perception and Prediction
Wang, T.-H., Manivasagam, S., Liang, M., Yang, B., Zeng, W., & Urtasun, R. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58536-5_36 · Cited by 534
Cooper: Cooperative Perception for Connected Autonomous Vehicles Based on 3D Point Clouds
Chen, Q., Tang, S., Yang, Q., & Fu, S. (2019) · 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2019.00058 · Cited by 432
V2X Access Technologies: Regulation, Research, and Remaining Challenges
MacHardy, Z., Khan, A., Obana, K., & Iwashina, S. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2808444 · Cited by 407
Deep Learning for Visual Tracking: A Comprehensive Survey
Marvasti-Zadeh, S. M., Cheng, L., Ghanei-Yakhdan, H., & Kasaei, S. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3046478 · Cited by 405
WoodScape: A Multi-Task, Multi-Camera Fisheye Dataset for Autonomous Driving
Yogamani, S., Hughes, C., Horgan, J., Sistu, G., Chennupati, S., Uricar, M., Milz, S., Simon, M., Amende, K., Witt, C., et al. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00940 · Cited by 334
Cooperative Perception for 3D Object Detection in Driving Scenarios Using Infrastructure Sensors
Arnold, E., Dianati, M., de Temple, R., & Fallah, S. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3028424 · Cited by 333
Canadian adverse driving conditions dataset
Pitropov, M., Garcia, D. E., Rebello, J., Smart, M., Wang, C., Czarnecki, K., & Waslander, S. (2021) · The International Journal of Robotics Research · doi:10.1177/0278364920979368 · Cited by 286
When2com: Multi-Agent Perception via Communication Graph Grouping
Liu, Y.-C., Tian, J., Glaser, N., & Kira, Z. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00416 · Cited by 276
Securing Vehicle-to-Everything (V2X) Communication Platforms
Hasan, M., Mohan, S., Shimizu, T., & Lu, H. (2020) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2020.2987430 · Cited by 275
The H3D Dataset for Full-Surround 3D Multi-Object Detection and Tracking in Crowded Urban Scenes
Patil, A., Malla, S., Gang, H., & Chen, Y.-T. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8793925 · Cited by 263
OpenCDA: An Open Cooperative Driving Automation Framework Integrated with Co-Simulation
Xu, R., Guo, Y., Han, X., Xia, X., Xiang, H., & Ma, J. (2021) · 2021 IEEE International Intelligent Transportation Systems Conference (ITSC) · doi:10.1109/itsc48978.2021.9564825 · Cited by 260
Multivehicle Cooperative Driving Using Cooperative Perception: Design and Experimental Validation
Kim, S.-W., Qin, B., Chong, Z. J., Shen, X., Liu, W., Ang, M. H., Frazzoli, E., & Rus, D. (2015) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2014.2337316 · Cited by 236
LiDARsim: Realistic LiDAR Simulation by Leveraging the Real World
Manivasagam, S., Wang, S., Wong, K., Zeng, W., Sazanovich, M., Tan, S., Yang, B., Ma, W.-C., & Urtasun, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01118 · Cited by 233
Towards Semantic Segmentation of Urban-Scale 3D Point Clouds: A Dataset, Benchmarks and Challenges
Hu, Q., Yang, B., Khalid, S., Xiao, W., Trigoni, N., & Markham, A. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00494 · Cited by 225
Enhanced cooperative car-following traffic model with the combination of V2V and V2I communication
Jia, D., & Ngoduy, D. (2016) · Transportation Research Part B: Methodological · doi:10.1016/j.trb.2016.03.008 · Cited by 219
TrafficSim: Learning to Simulate Realistic Multi-Agent Behaviors
Suo, S., Regalado, S., Casas, S., & Urtasun, R. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01026 · Cited by 197
Wu, P., Chen, S., & Metaxas, D. N. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01140 · Cited by 188
Self-citationWho2com: Collaborative Perception via Learnable Handshake Communication
Liu, Y.-C., Tian, J., Ma, C.-Y., Glaser, N., Kuo, C.-W., & Kira, Z. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9197364 · Cited by 187
Survey on existing authentication issues for cellular-assisted V2X communication
Muhammad, M., & Safdar, G. A. (2018) · Vehicular Communications · doi:10.1016/j.vehcom.2018.01.008 · Cited by 186
A*3D Dataset: Towards Autonomous Driving in Challenging Environments
Pham, Q.-H., Sevestre, P., Pahwa, R. S., Zhan, H., Pang, C. H., Chen, Y., Mustafa, A., Chandrasekhar, V., & Lin, J. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9197385 · Cited by 170
A Comparison of the V2X Communication Systems: ITS-G5 and C-V2X
Mannoni, V., Berg, V., Sesia, S., & Perraud, E. (2019) · IEEE Vehicular Technology Conference · doi:10.1109/vtcspring.2019.8746562 · Cited by 158
Keypoints-Based Deep Feature Fusion for Cooperative Vehicle Detection of Autonomous Driving
Yuan, Y., Cheng, H., & Sester, M. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3143299 · Cited by 142
Rawashdeh, Z. Y., & Wang, Z. (2018) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569832 · Cited by 107
Self-citationSceneGen: Learning to Generate Realistic Traffic Scenes
Tan, S., Wong, K., Wang, S., Manivasagam, S., Ren, M., & Urtasun, R. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00095 · Cited by 104
Fast and Robust Registration of Partially Overlapping Point Clouds
Arnold, E. H., Mozaffari, S., & Dianati, M. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3137888 · Cited by 85
Multimedia Fusion at Semantic Level in Vehicle Cooperactive Perception
Xiao, Z., Mo, Z., Jiang, K., & Yang, D. (2018) · IEEE International Conference on Multimedia & Expo Workshops (ICMEW) · doi:10.1109/icmew.2018.8551565 · Cited by 32
COMAP: A SYNTHETIC DATASET FOR COLLECTIVE MULTI-AGENT PERCEPTION OF AUTONOMOUS DRIVING
Yuan, Y., & Sester, M. (2021) · The international archives of the photogrammetry, remote sensing and spatial information sciences/International archives of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-archives-xliii-b2-2021-255-2021 · Cited by 26
VANETs Meet Autonomous Vehicles: A Multimodal 3D Environment Learning Approach
Maalej, Y., Sorour, S., Abdel-Rahim, A., & Guizani, M. (2017) · Globecom · doi:10.1109/glocom.2017.8254480 · Cited by 20
Research works printed but not linked: 3
- Li, 2021, Learning distilled collaboration graph for multi-agent perception, 29541
- Howe, 2021, Weakly supervised training of monocular 3D object detectors using wide baseline multi-view traffic camera data, 394
- 10.1109/IVS.2015.7225903 · doi:10.1109/ivs.2015.7225903
Cited by
Yu, H., Yang, W., Ruan, H., Yang, Z., Tang, Y., Gao, X., Hao, X., Shi, Y., Pan, Y., Sun, N., et al. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00531 · Cited by 182
Latency-Aware Collaborative Perception
Lei, Z., Ren, S., Hu, Y., Zhang, W., & Chen, S. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19824-3_19 · Cited by 147
Self-citationVehicle-to-Everything Communication in Intelligent Connected Vehicles: A Survey and Taxonomy
Zhang, X., Li, J., Zhou, J., Zhang, S., Wang, J., Yuan, Y., Liu, J., & Li, J. (2025) · Automotive Innovation · doi:10.1007/s42154-024-00310-2 · Cited by 103
Interruption-Aware Cooperative Perception for V2X Communication-Aided Autonomous Driving
Ren, S., Lei, Z., Wang, Z., Dianati, M., Wang, Y., Chen, S., & Zhang, W. (2024) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2024.3371974 · Cited by 75
Self-citationSong, R., Lyu, L., Jiang, W., Festag, A., & Knoll, A. (2023) · arXiv · doi:10.48550/arxiv.2305.11654 · Cited by 11
Metadata
- Authors
- Li, Y., Ma, D., An, Z., Wang, Z., Zhong, Y., Chen, S., & Feng, C.
- Venue
- IEEE Robotics and Automation Letters
- Published
- 2022-10
- Volume
- 7
- Issue
- 4
- Pages
- 10914-10921
- ISSN
- 2377-3766 (ISSN-L)
- 2377-3774
- OpenAlex
- W4286544732
- Cited by
- 321
- References
- 50
- FWCI
- 17.52
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- NSF (CMMI-1932187, CNS-2121391)
- National Natural Science Foundation of China (62171276)
- Science and Technology Commission of Shanghai Municipal (21511100900)
- Committee for the Advancement of Learning and Teaching (2021-01)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.