The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Encoding Crowd Interaction with Deep Neural Network for Pedestrian Trajectory Prediction
Abstract
Pedestrian trajectory prediction is a challenging task because of the complex nature of humans. In this paper, we tackle the problem within a deep learning framework by considering motion information of each pedestrian and its interaction with the crowd. Specifically, motivated by the residual learning in deep learning, we propose to predict displacement between neighboring frames for each pedestrian sequentially. To predict such displacement, we design a crowd interaction deep neural network (CIDNN) which considers the different importance of different pedestrians for the displacement prediction of a target pedestrian. Specifically, we use an LSTM to model motion information for all pedestrians and use a multi-layer perceptron to map the location of each pedestrian to a high dimensional feature space where the inner product between features is used as a measurement for the spatial affinity between two pedestrians. Then we weight the motion features of all pedestrians based on their spatial affinity to the target pedestrian for location displacement prediction. Extensive experiments on publicly available datasets validate the effectiveness of our method for trajectory prediction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741
Identity Mappings in Deep Residual Networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · arXiv · doi:10.48550/arxiv.1603.05027 · Cited by 10,665
Social force model for pedestrian dynamics
Helbing, D., & Molnár, P. (1995) · Physical Review E · doi:10.1103/physreve.51.4282 · Cited by 6,845
Agent-based modeling: Methods and techniques for simulating human systems
Bonabeau, E. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.082080899 · Cited by 4,500
Social LSTM: Human Trajectory Prediction in Crowded Spaces
Alahi, A., Goel, K., Ramanathan, V., Robicquet, A., Fei-Fei, L., & Savarese, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.110 · Cited by 3,483
You'll never walk alone: Modeling social behavior for multi-target tracking
Pellegrini, S., Ess, A., Schindler, K., & van Gool, L. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459260 · Cited by 1,683 · cited 5×
“As shown in [18], these datasets also cover very challenging group behaviors such as couples walking together, groups crossing each other and groups forming and dispersing in some scenes.”
BackgroundMethodInfluentialAbnormal crowd behavior detection using social force model
Mehran, R., Oyama, A., & Shah, M. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206641 · Cited by 1,672
Trajectory clustering: a partition-and-group framework
Lee, J.-G., Han, J., & Whang, K.-Y. (2007) · Proceedings of the 2007 ACM SIGMOD international conference on Management of data · doi:10.1145/1247480.1247546 · Cited by 1,363
Lerner, A., Chrysanthou, Y., & Lischinski, D. (2007) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2007.01089.x · Cited by 1,171
Cross-scene crowd counting via deep convolutional neural networks
Zhang, C., Li, H., Wang, X., & Yang, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298684 · Cited by 1,121
DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agents
Lee, N., Choi, W., Vernaza, P., Choy, C. B., Torr, P. H. S., & Chandraker, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.233 · Cited by 1,067
Human Pose Estimation with Iterative Error Feedback
Carreira, J., Agrawal, P., Fragkiadaki, K., & Malik, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.512 · Cited by 805
Discrete choice models of pedestrian walking behavior
Antonini, G., Bierlaire, M., & Weber, M. (2006) · Transportation Research Part B: Methodological · doi:10.1016/j.trb.2005.09.006 · Cited by 596
Wang, X., Ma, X., & Grimson, W. E. L. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.87 · Cited by 534
Who are you with and where are you going?
Yamaguchi, K., Berg, A. C., Ortiz, L. E., & Berg, T. L. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995468 · Cited by 484
Coarse-to-Fine Auto-Encoder Networks (CFAN) for Real-Time Face Alignment
Zhang, J., Shan, S., Kan, M., & Chen, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_1 · Cited by 468
Unsupervised Activity Perception by Hierarchical Bayesian Models
Wang, X., Ma, X., & Grimson, E. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383072 · Cited by 359
Understanding collective crowd behaviors: Learning a Mixture model of Dynamic pedestrian-Agents
Zhou, B., Wang, X., & Tang, X. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248013 · Cited by 313
Scene-Independent Group Profiling in Crowd
Shao, J., Loy, C. C., & Wang, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.285 · Cited by 254
Understanding pedestrian behaviors from stationary crowd groups
Yi, S., Li, H., & Wang, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298971 · Cited by 239
Learning trajectory patterns by clustering: Experimental studies and comparative evaluation
Morris, B., & Trivedi, M. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206559 · Cited by 228
Pedestrian Behavior Understanding and Prediction with Deep Neural Networks
Yi, S., Li, H., & Wang, X. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46448-0_16 · Cited by 199
Random field topic model for semantic region analysis in crowded scenes from tracklets
Zhou, B., Wang, X., & Tang, X. (2011) · doi:10.1109/cvpr.2011.5995459 · Cited by 151
Learning Collective Crowd Behaviors with Dynamic Pedestrian-Agents
Zhou, B., Tang, X., & Wang, X. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-014-0735-3 · Cited by 127
Identifying Rare and Subtle Behaviors: A Weakly Supervised Joint Topic Model
Hospedales, T. M., Li, J., Gong, S., & Xiang, T. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.81 · Cited by 100
Forecast the Plausible Paths in Crowd Scenes
Su, H., Zhu, J., Dong, Y., & Zhang, B. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/386 · Cited by 72
$L_0$ Regularized Stationary-Time Estimation for Crowd Analysis
Yi, S., Wang, X., Lu, C., Jia, J., & Li, H. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2560807 · Cited by 21
Unsupervised Trajectory Modelling Using Temporal Information via Minimal Paths
Cancela, B., Iglesias, A., Ortega, M., et al. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.327 · Cited by 19
Cited by
STGAT: Modeling Spatial-Temporal Interactions for Human Trajectory Prediction
Huang, Y., Bi, H., Li, Z., Mao, T., & Wang, Z. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00637 · Cited by 658
Human motion trajectory prediction: a survey
Rudenko, A., Palmieri, L., Herman, M., Kitani, K. M., Gavrila, D. M., & Arras, K. O. (2020) · The International Journal of Robotics Research · doi:10.1177/0278364920917446 · Cited by 658
Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Prediction
Yu, C., Ma, X., Ren, J., Zhao, H., & Yi, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58610-2_30 · Cited by 565
SR-LSTM: State Refinement for LSTM Towards Pedestrian Trajectory Prediction
Zhang, P., Ouyang, W., Zhang, P., Xue, J., & Zheng, N. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01236 · Cited by 540
Social Ways: Learning Multi-Modal Distributions of Pedestrian Trajectories With GANs
Amirian, J., Hayet, J.-B., & Pettre, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00359 · Cited by 323
Metadata
- Authors
- Xu, Y., Piao, Z., & Gao, S.
- Venue
- 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2018-06
- Pages
- 5275-5284
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2799059904
- Cited by
- 276
- References
- 31
- FWCI
- 67.76
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.