The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Are They Going to Cross? A Benchmark Dataset and Baseline for Pedestrian Crosswalk Behavior
Abstract
Designing autonomous vehicles suitable for urban environments remains an unresolved problem. One of the major dilemmas faced by autonomous cars is how to understand the intention of other road users and communicate with them. The existing datasets do not provide the necessary means for such higher level analysis of traffic scenes. With this in mind, we introduce a novel dataset which in addition to providing the bounding box information for pedestrian detection, also includes the behavioral and contextual annotations for the scenes. This allows combining visual and semantic information for better understanding of pedestrians' intentions in various traffic scenarios. We establish baseline approaches for analyzing the data and show that combining visual and contextual information can improve prediction of pedestrian intention at the point of crossing by at least 20%.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971
Vision meets robotics: The KITTI dataset
Geiger, A., Lenz, P., Stiller, C., & Urtasun, R. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913491297 · Cited by 9,913
DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019 · cited 1×
“To get corresponding visual features for gait and attention we convert fc6, fc7 and fc8 layers of AlexNet to fully-convolutional layers and use the output of fc8 as the compact representation of the scene and pedestrian action (such features proved useful for generic recognition tasks [9]).”
MethodFriard, O., & Gamba, M. (2016) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12584 · Cited by 3,437
Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.222 · Cited by 3,150 · cited 2×
“For this purpose we use pre-trained AlexNet on two large image datasets, ImageNet [5] and places, and both datasets combined [44].”
MethodSpatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_23 · Cited by 3,034
ImageNet: A large-scale hierarchical image database
Deng, J. H., Dong, W. F., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206848 · Cited by 2,714
(2014) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 2,534
You'll never walk alone: Modeling social behavior for multi-target tracking
Pellegrini, S., Ess, A., Schindler, K., & van Gool, L. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459260 · Cited by 1,683 · cited 1×
“The common approach to remedy the problem of predicting road users behavior is to employ dynamic factors, such as trajectory [3] or velocity [30], or the expected final goal of pedestrians [18, 31].”
BackgroundPedestrian detection: A benchmark
Dollar, P., Wojek, C., Schiele, B., & Perona, P. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206631 · Cited by 1,313
Multispectral pedestrian detection: Benchmark dataset and baseline
Hwang, S., Park, J., Kim, N., Choi, Y., & Kweon, I. S. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298706 · Cited by 1,249
Monocular Pedestrian Detection: Survey and Experiments
Enzweiler, M., & Gavrila, D. M. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.260 · Cited by 1,213
Weakly-and Semi-Supervised Learning of a Deep Convolutional Network for Semantic Image Segmentation
Papandreou, G., Chen, L.-C., Murphy, K. P., & Yuille, A. L. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.203 · Cited by 1,005
Object Detectors Emerge in Deep Scene CNNs
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2014) · arXiv · doi:10.48550/arxiv.1412.6856 · Cited by 971
Is Faster R-CNN Doing Well for Pedestrian Detection?
Zhang, L., Lin, L., Liang, X., & He, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_28 · Cited by 852
A Hierarchical Deep Temporal Model for Group Activity Recognition
Ibrahim, M. S., Muralidharan, S., Deng, Z., Vahdat, A., & Mori, G. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.217 · Cited by 523
Object Detectors Emerge in Deep Scene CNNsPreprint
Zhou, B., Khosla, A., Lapedriza, À., Oliva, A., & Torralba, A. B. (2015) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 523
Spatio-temporal Depth Cuboid Similarity Feature for Activity Recognition Using Depth Camera
Xia, L., & Aggarwal, J. K. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.365 · Cited by 433
Context-Based Pedestrian Path Prediction
Kooij, J. F. P., Schneider, N., Flohr, F., & Gavrila, D. M. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_40 · Cited by 286
Going Deeper into First-Person Activity Recognition
Ma, M., Fan, H., & Kitani, K. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.209 · Cited by 274
Deng, Z., Vahdat, A., Hu, H., & Mori, G. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.516 · Cited by 253
Pedestrian Path Prediction with Recursive Bayesian Filters: A Comparative Study
Schneider, N., & Gavrila, D. M. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40602-7_18 · Cited by 249
Tom, A., & Granié, M.-A. (2011) · Accident Analysis & Prevention · doi:10.1016/j.aap.2011.04.012 · Cited by 222
Social roles in hierarchical models for human activity recognition
Lan, T., Sigal, L., & Mori, G. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247821 · Cited by 218
Matrix Completion for Weakly-Supervised Multi-Label Image Classification
Cabral, R., De la Torre, F., Costeira, J. P., & Bernardino, A. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2343234 · Cited by 173
A pedestrian’s stare and drivers’ stopping behavior: A field experiment at the pedestrian crossing
Guéguen, N., Meineri, S., & Eyssartier, C. (2015) · Safety Science · doi:10.1016/j.ssci.2015.01.018 · Cited by 163
Understanding Collective Activitiesof People from Videos
Choi, W., & Savarese, S. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.220 · Cited by 162
StixelNet: A Deep Convolutional Network for Obstacle Detection and Road Segmentation
Levi, D., Garnett, N., & Fetaya, E. (2015) · British Machine Vision Conference (BMVC) · doi:10.5244/c.29.109 · Cited by 161
Intent-aware long-term prediction of pedestrian motion
Karasev, V. I., Ayvacı, A., Heisele, B., & Soatto, S. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487409 · Cited by 161
Goal-Directed Pedestrian Prediction
Rehder, E., & Kloeden, H. (2015) · doi:10.1109/iccvw.2015.28 · Cited by 117
Generating Facial Expressions with Deep Belief Nets
Joshua, M., Geoffrey, E., Javier, R. A. V., & Adam, K. (2008) · doi:10.5772/6167 · Cited by 95
Stationary Detection of the Pedestrian?s Intention at Intersections
Koehler, S., Goldhammer, M., Bauer, S., Zecha, S., Doll, K., Brunsmann, U., & Dietmayer, K. (2013) · IEEE Intelligent Transportation Systems Magazine · doi:10.1109/mits.2013.2276939 · Cited by 94
Pedestrian intention recognition using Latent-dynamic Conditional Random Fields
Schulz, A., & Stiefelhagen, R. (2015) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2015.7225754 · Cited by 82
Weakly supervised object recognition with convolutional neural networks
Oquab, M., Bottou, L., Laptev, I., & Šivic, J. (2014) · Cited by 69
The Interaction Between Humans and Autonomous Agents
Wolf, I. (2016) · Springer eBooks · doi:10.1007/978-3-662-48847-8_6 · Cited by 68
A Probabilistic Framework for Joint Pedestrian Head and Body Orientation Estimation
Flohr, F. B., Dumitru-Guzu, M., Kooij, J. F. P., & Gavrila, D. M. (2015) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2014.2379441 · Cited by 65
DEEP-CARVING: Discovering visual attributes by carving deep neural nets
Shankar, S., Garg, V., & Cipolla, R. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298962 · Cited by 56
Learning And-Or Model to Represent Context and Occlusion for Car Detection and Viewpoint Estimation
Wu, T., Li, B. H., & Zhu, S. C. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2497699 · Cited by 49
(2015) · Cited by 42
Cited by
Autonomous Vehicles That Interact With Pedestrians: A Survey of Theory and Practice
Rasouli, A., & Tsotsos, J. K. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2901817 · Cited by 855
Self-citationPIE: A Large-Scale Dataset and Models for Pedestrian Intention Estimation and Trajectory Prediction
Rasouli, A., Kotseruba, I., Kunic, T., & Tsotsos, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00636 · Cited by 460
Self-citationToward Driving Scene Understanding: A Dataset for Learning Driver Behavior and Causal Reasoning
Ramanishka, V., Chen, Y.-T., Misu, T., & Saenko, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00803 · Cited by 314
Mez: An Adaptive Messaging System for Latency-Sensitive Multi-Camera Machine Vision at the IoT Edge
George, A., Ravindran, A., Mendieta, M., & Tabkhi, H. (2021) · IEEE Access · doi:10.1109/access.2021.3055775 · Cited by 73
“We use two publicly available video datasets - JAAD [19] and DukeMTMC [20] for latency characterization.”
MethodDetecting 32 Pedestrian Attributes for Autonomous Vehicles
Mordan, T., Cord, M., Perez, P., & Alahi, A. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3107587 · Cited by 36
Metadata
- Authors
- Rasouli, A., Kotseruba, I., & Tsotsos, J. K.
- Venue
- 2017 IEEE International Conference on Computer Vision Workshops (ICCVW)
- Publisher
- IEEE
- Published
- 2017-10
- Pages
- 206-213
- ISSN
- 2473-9936 (ISSN-L)
- OpenAlex
- W2771583656
- Cited by
- 425
- References
- 42
- FWCI
- 19.55
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.