The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Prediction
Open accessAbstract
Better machine understanding of pedestrian behaviors enables faster progress in modeling interactions between agents such as autonomous vehicles and humans. Pedestrian trajectories are not only influenced by the pedestrian itself but also by interaction with surrounding objects. Previous methods modeled these interactions by using a variety of aggregation methods that integrate different learned pedestrians states. We propose the Social Spatio-Temporal Graph Convolutional Neural Network (Social-STGCNN), which substitutes the need of aggregation methods by modeling the interactions as a graph. Our results show an improvement over the state of art by 20% on the Final Displacement Error (FDE) and an improvement on the Average Displacement Error (ADE) with 8.5 times less parameters and up to 48 times faster inference speed than previously reported methods. In addition, our model is data efficient, and exceeds previous state of the art on the ADE metric with only 20% of the training data. We propose a kernel function to embed the social interactions between pedestrians within the adjacency matrix. Through qualitative analysis, we show that our model inherited social behaviors that can be expected between pedestrians trajectories. Code is available at https://github.com/abduallahmohamed/Social-STGCNN.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Semi-supervised classification with graph convolutional networks
Kipf, T. N., & Welling, M. (2016) · arXiv · doi:10.48550/arxiv.1609.02907 · Cited by 24,853
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Deformable Convolutional Networks
Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., & Wei, Y. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.89 · Cited by 7,513
Modeling Relational Data with Graph Convolutional Networks
Schlichtkrull, M., Kipf, T. N., Bloem, P., van den Berg, R., Titov, I., & Welling, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-93417-4_38 · Cited by 5,570
Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition
Yan, S., Xiong, Y., & Lin, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12328 · Cited by 5,410 · cited 3×
“One of the development related to our work is the ST-GCNN [27].”
BackgroundAn Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
Bai, S., Kolter, J. Z., & Koltun, V. (2018) · arXiv · doi:10.48550/arxiv.1803.01271 · Cited by 4,655
Social LSTM: Human Trajectory Prediction in Crowded Spaces
Alahi, A., Goel, K., Ramanathan, V., Robicquet, A., Fei-Fei, L., & Savarese, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.110 · Cited by 3,483
Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks
Gupta, A., Johnson, J., Fei-Fei, L., Savarese, S., & Alahi, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00240 · Cited by 2,466
You'll never walk alone: Modeling social behavior for multi-target tracking
Pellegrini, S., Ess, A., Schindler, K., & van Gool, L. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459260 · Cited by 1,683 · cited 3×
“The model is trained on two human trajectory prediction datasets: ETH [21] and UCY [11].”
MethodDeepGCNs: Can GCNs Go As Deep As CNNs?
Li, G., Muller, M., Thabet, A., & Ghanem, B. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00936 · Cited by 1,400
Lerner, A., Chrysanthou, Y., & Lischinski, D. (2007) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2007.01089.x · Cited by 1,171
The Walking Behaviour of Pedestrian Social Groups and Its Impact on Crowd Dynamics
Moussaïd, M., Perozo, N., Garnier, S., Helbing, D., & Theraulaz, G. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010047 · Cited by 1,120
SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraints
Sadeghian, A., Kosaraju, V., Sadeghian, A., Hirose, N., Rezatofighi, H., & Savarese, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00144 · Cited by 1,065
Graph Convolutional Matrix Completion
van den Berg, R., Kipf, T., & Welling, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.02263 · Cited by 1,023
Variational Graph Auto-Encoders
Kipf, T., & Welling, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.07308 · Cited by 772
SR-LSTM: State Refinement for LSTM Towards Pedestrian Trajectory Prediction
Zhang, P., Ouyang, W., Zhang, P., Xue, J., & Zheng, N. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01236 · Cited by 540
Vert, J.-P., Tsuda, K., & Schölkopf, B. (2004) · Kernel Methods in Computational Biology · doi:10.7551/mitpress/4057.003.0004 · Cited by 365
Intention-aware online POMDP planning for autonomous driving in a crowd
Bai, H., Cai, S., Ye, N., Hsu, D., & Lee, W. S. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7139219 · Cited by 321
People tracking with human motion predictions from social forces
Luber, M., Stork, J. A., Tipaldi, G. D., & Arras, K. O. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509779 · Cited by 317
Peeking Into the Future: Predicting Future Person Activities and Locations in Videos
Liang, J., Jiang, L., Niebles, J. C., Hauptmann, A. G., & Fei-Fei, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00587 · Cited by 248
Peeking Into the Future: Predicting Future Person Activities and Locations in Videos
Liang, J., Jiang, L., Niebles, J. C., Hauptmann, A., & Fei-Fei, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00358 · Cited by 236
PORCA: Modeling and Planning for Autonomous Driving Among Many Pedestrians
Luo, Y., Cai, P., Bera, A., Hsu, D., Lee, W. S., & Manocha, D. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2852793 · Cited by 204
Conditional Generative Neural System for Probabilistic Trajectory Prediction
Li, J., Ma, H., & Tomizuka, M. (2019) · 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967822 · Cited by 187
Wavelet Pooling for Convolutional Neural Networks
Williams, T., & Li, R. (2018) · International Conference on Learning Representations · Cited by 182
Scene-LSTM: A Model for Human Trajectory PredictionPreprint
Manh, H. T., & Alaghband, G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.04018 · Cited by 165
Raksincharoensak, P., Hasegawa, T., & NAGAI, M. (2016) · International Journal of Automotive Engineering · doi:10.20485/jsaeijae.7.avec14_53 · Cited by 96
Pedestrian Detection and Tracking in Far Infrared Images
Yasuno, M., Yasuda, N., & Aoki, M. (2005) · IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvpr.2004.417 · Cited by 62
Identifying and Tracking Pedestrians Based on Sensor Fusion and Motion Stability Predictions
Musleh, B., García, F., Otamendi, F. J., Armingol, J. M., & de la Escalera, A. (2010) · Sensors · doi:10.3390/s100908028 · Cited by 54
Cited by
Human Action Recognition and Prediction: A Survey
Kong, Y., & Fu, Y. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01594-9 · Cited by 780
A Survey on Trajectory-Prediction Methods for Autonomous Driving
Huang, Y., Du, J., Yang, Z., Zhou, Z., Zhang, L., & Chen, H. (2022) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3167103 · Cited by 677
Spatio-Temporal Graph Neural Networks for Predictive Learning in Urban Computing: A Survey
Jin, G., Liang, Y., Fang, Y., Shao, Z., Huang, J., Zhang, J., & Zheng, Y. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3333824 · Cited by 568
HiVT: Hierarchical Vector Transformer for Multi-Agent Motion Prediction
Zhou, Z., Ye, L., Wang, J., Wu, K., & Lu, K. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00862 · Cited by 460
Autonomous driving system: A comprehensive survey
Zhao, J., Zhao, W., Deng, B., Wang, Z., Zhang, F., Zheng, W., Cao, W., Nan, J., Lian, Y., & Burke, A. F. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122836 · Cited by 361
Metadata
- Authors
- Mohamed, A., Qian, K., Elhoseiny, M., & Claudel, C.
- Venue
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 14412-14420
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3006895970
- Cited by
- 989
- References
- 28
- FWCI
- 102.06
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.