The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
SR-LSTM: State Refinement for LSTM Towards Pedestrian Trajectory Prediction
Open accessAbstract
In crowd scenarios, reliable trajectory prediction of pedestrians requires insightful understanding of their social behaviors. These behaviors have been well investigated by plenty of studies, while it is hard to be fully expressed by hand-craft rules. Recent studies based on LSTM networks have shown great ability to learn social behaviors. However, many of these methods rely on previous neighboring hidden states but ignore the important current intention of the neighbors. In order to address this issue, we propose a data-driven state refinement module for LSTM network (SR-LSTM), which activates the utilization of the current intention of neighbors, and jointly and iteratively refines the current states of all participants in the crowd through a message passing mechanism. To effectively extract the social effect of neighbors, we further introduce a social-aware information selection mechanism consisting of an element-wise motion gate and a pedestrian-wise attention to select useful message from neighboring pedestrians. Experimental results on two public datasets, i.e. ETH and UCY, demonstrate the effectiveness of our proposed SR-LSTM and we achieve state-of-the-art results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Semi-supervised classification with graph convolutional networks
Kipf, T. N., & Welling, M. (2016) · arXiv · doi:10.48550/arxiv.1609.02907 · Cited by 24,853
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
Social force model for pedestrian dynamics
Helbing, D., & Molnár, P. (1995) · Physical Review E · doi:10.1103/physreve.51.4282 · Cited by 6,845
Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition
Yan, S., Xiong, Y., & Lin, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12328 · Cited by 5,410
Spectral Networks and Locally Connected Networks on Graphs
Bruna, J., Zaremba, W., Szlam, A., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6203 · Cited by 3,983
Social LSTM: Human Trajectory Prediction in Crowded Spaces
Alahi, A., Goel, K., Ramanathan, V., Robicquet, A., Fei-Fei, L., & Savarese, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.110 · Cited by 3,483
Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks
Gupta, A., Johnson, J., Fei-Fei, L., Savarese, S., & Alahi, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00240 · Cited by 2,466
You'll never walk alone: Modeling social behavior for multi-target tracking
Pellegrini, S., Ess, A., Schindler, K., & van Gool, L. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459260 · Cited by 1,683 · cited 3×
“There are two types of metrics for evaluating the performance of trajectory prediction, including the Mean Average Displacement (MAD) error and Final Average Displacement (FAD) error [31] in meters.”
MethodAbnormal crowd behavior detection using social force model
Mehran, R., Oyama, A., & Shah, M. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206641 · Cited by 1,672
Relation Networks for Object Detection
Hu, H., Gu, J., Zhang, Z., Dai, J., & Wei, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00378 · Cited by 1,524
Self-Organized Pedestrian Crowd Dynamics: Experiments, Simulations, and Design Solutions
Helbing, D., Buzna, L., Johansson, A., & Werner, T. (2005) · Transportation Science · doi:10.1287/trsc.1040.0108 · Cited by 1,471
Scene Graph Generation by Iterative Message Passing
Xu, D., Zhu, Y., Choy, C. B., & Fei-Fei, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.330 · Cited by 1,271
Lerner, A., Chrysanthou, Y., & Lischinski, D. (2007) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2007.01089.x · Cited by 1,171
The Walking Behaviour of Pedestrian Social Groups and Its Impact on Crowd Dynamics
Moussaïd, M., Perozo, N., Garnier, S., Helbing, D., & Theraulaz, G. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010047 · Cited by 1,120
DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agents
Lee, N., Choi, W., Vernaza, P., Choy, C. B., Torr, P. H. S., & Chandraker, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.233 · Cited by 1,067
SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraints
Sadeghian, A., Kosaraju, V., Sadeghian, A., Hirose, N., Rezatofighi, H., & Savarese, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00144 · Cited by 1,065
Graph R-CNN for Scene Graph Generation
Yang, J., Lu, J., Lee, S., Batra, D., & Parikh, D. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01246-5_41 · Cited by 851
Videos as Space-Time Region Graphs
Wang, X., & Gupta, A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01228-1_25 · Cited by 765
Social Attention: Modeling Attention in Human Crowds
Vemula, A., Muelling, K., & Oh, J. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460504 · Cited by 675
Scene Graph Generation from Objects, Phrases and Region Captions
Li, Y., Ouyang, W., Zhou, B., Wang, K., & Wang, X. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.142 · Cited by 500
Self-citationWho are you with and where are you going?
Yamaguchi, K., Berg, A. C., Ortiz, L. E., & Berg, T. L. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995468 · Cited by 484
Fernando, T., Denman, S., Sridharan, S., & Fookes, C. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.09.002 · Cited by 371
Semantic Object Parsing with Graph LSTM
Liang, X., Shen, X., Feng, J., Lin, L., & Yan, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_8 · Cited by 352
Simulation of pedestrian flows by optimal control and differential games
Hoogendoorn, S., & H.L. Bovy, P. (2003) · Optimal Control Applications and Methods · doi:10.1002/oca.727 · Cited by 294
Encoding Crowd Interaction with Deep Neural Network for Pedestrian Trajectory Prediction
Xu, Y., Piao, Z., & Gao, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00553 · Cited by 276
Attentive Contexts for Object Detection
Li, J., Wei, Y., Liang, X., Dong, J., Xu, T., Feng, J., & Yan, S. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2642789 · Cited by 249
Understanding pedestrian behaviors from stationary crowd groups
Yi, S., Li, H., & Wang, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298971 · Cited by 239
ViP-CNN: Visual Phrase Guided Convolutional Neural Network
Li, Y., Ouyang, W., Wang, X., & Tang, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.766 · Cited by 229
Self-citationFerrer, G., Garrell, A., & Sanfeliu, A. (2013) · 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2013.6696576 · Cited by 227
Forecasting Interactive Dynamics of Pedestrians with Fictitious Play
Ma, W.-C., Huang, D.-A., Lee, N., & Kitani, K. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.493 · Cited by 153
MX-LSTM: Mixing Tracklets and Vislets to Jointly Forecast Trajectories and Head Poses
Hasan, I., Setti, F., Tsesmelis, T., Bue, A. D., Galasso, F., & Cristani, M. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00635 · Cited by 146
Interpretable Structure-Evolving LSTM
Liang, X., Lin, L., Shen, X., Feng, J., Yan, S., & Xing, E. P. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.234 · Cited by 103
Game theory in models of pedestrian room evacuation
Bouzat, S., & Kuperman, M. N. (2014) · Physical Review E · doi:10.1103/physreve.89.032806 · Cited by 100
Human Trajectory Prediction using Spatially aware Deep Attention ModelsPreprint
Varshneya, D., & Srinivasaraghavan, G. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.09436 · Cited by 98
Temporal Dynamic Graph LSTM for Action-Driven Video Object Detection
Yuan, Y., Liang, X., Wang, X., Yeung, D., & Gupta, A. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.200 · Cited by 92
Hierarchical Attention Network for Action Recognition in VideosPreprint
Wang, Y., Wang, S., Tang, J., O’Hare, N., Chang, Y., & Li, B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.06416 · Cited by 82
Forecast the Plausible Paths in Crowd Scenes
Su, H., Zhu, J., Dong, Y., & Zhang, B. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/386 · Cited by 72
RED: A Simple but Effective Baseline Predictor for the TrajNet Benchmark
Becker, S., Hug, R., Hübner, W., & Arens, M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11015-4_13 · Cited by 70
Abnormal crowd behavior detection based on social attribute-aware force model
Zhang, Y., Qin, L., Yao, H., et al. (2012) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2012.6467453 · Cited by 60
Age and Group-driven Pedestrian Behaviour: from Observations to Simulations
Gorrini, A., Vizzari, G., & Bandini, S. (2016) · Collective Dynamics · doi:10.17815/cd.2016.3 · Cited by 56
Ratsamee, P., Mae, Y., Ohara, K., et al. (2013) · International Journal of Humanoid Robotics · doi:10.1142/s0219843613500084 · Cited by 52
Particle-based Pedestrian Path Prediction using LSTM-MDL Models
Hug, R., Becker, S., Hübner, W., & Arens, M. (2018) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569478 · Cited by 43
Crowd scene understanding with coherent recurrent neural networks
Su, H., Dong, Y., Zhu, J., Ling, H., & Zhang, B. (2016) · International Joint Conference on Artificial Intelligence · Cited by 41
Empirical Investigation on Pedestrian Crowd Dynamics and Grouping
Gorrini, A., Bandini, S., & Vizzari, G. (2014) · Springer eBooks · doi:10.1007/978-3-319-10629-8_10 · Cited by 36
Adaptive Spectral Graph Convolutional Networks for Skeleton-Based Action RecognitionPreprint
Shi, L., Zhang, Y., Cheng, J., & Lu, H. (2018) · arXiv (Cornell University) · Cited by 23
Profiling stationary crowd groups
Yi, S., & Wang, X. (2014) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2014.6890138 · Cited by 17
Game Theoretical Interactions of Moving Agents
Yu, W., & Helbing, D. (2010) · Understanding complex systems · doi:10.1007/978-3-642-12203-3_10 · Cited by 10
Game Theoretical Interactions of Moving AgentsPreprint
Yu, W., & Helbing, D. (2012) · Cited by 10
Chen, T., Wang, Z., Li, L., Li, D., Li, Z., Chang, X., Bian, P., Liang, G., Wang, Q., & Xie, T. (2025) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.ecoop.2025.6
Cited by
A review on the long short-term memory model
Van Houdt, G., Mosquera, C., & Nápoles, G. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09838-1 · Cited by 1,991
Mohamed, A., Qian, K., Elhoseiny, M., & Claudel, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01443 · Cited by 989
Human motion trajectory prediction: a survey
Rudenko, A., Palmieri, L., Herman, M., Kitani, K. M., Gavrila, D. M., & Arras, K. O. (2020) · The International Journal of Robotics Research · doi:10.1177/0278364920917446 · Cited by 658
AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecasting
Yuan, Y., Weng, X., Ou, Y., & Kitani, K. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00967 · Cited by 631
Transformer Networks for Trajectory Forecasting
Giuliari, F., Hasan, I., Cristani, M., & Galasso, F. (2021) · 2020 25th International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr48806.2021.9412190 · Cited by 572
Metadata
- Authors
- Zhang, P., Ouyang, W., Zhang, P., Xue, J., & Zheng, N.
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 12077-12086
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2963353290
- Cited by
- 540
- References
- 53
- FWCI
- 141.71
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.