The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
What the Constant Velocity Model Can Teach Us About Pedestrian Motion Prediction
Open accessAbstract
Pedestrian motion prediction is a fundamental task for autonomous robots and vehicles to operate safely. In recent years many complex approaches based on neural networks have been proposed to address this problem. In this work we show that - surprisingly - a simple Constant Velocity Model can outperform even state-of-the-art neural models. This indicates that either neural networks are not able to make use of the additional information they are provided with, or that this information is not as relevant as commonly believed. Therefore, we analyze how neural networks process their input and how it impacts their predictions. Our analysis reveals pitfalls in training neural networks for pedestrian motion prediction and clarifies false assumptions about the problem itself. In particular, neural networks implicitly learn environmental priors that negatively impact their generalization capability, the motion history of pedestrians is irrelevant and interactions are too complex to predict. Our work shows how neural networks for pedestrian motion prediction can be thoroughly evaluated and our results indicate which research directions for neural motion prediction are promising in future.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Social force model for pedestrian dynamics
Helbing, D., & Molnár, P. (1995) · Physical Review E · doi:10.1103/physreve.51.4282 · Cited by 6,845
A Learning Algorithm for Continually Running Fully Recurrent Neural Networks
Williams, R. J., & Zipser, D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.2.270 · Cited by 4,369 · cited 1×
“We trained the LSTM with Teacher Forcing [33].”
MethodSocial LSTM: Human Trajectory Prediction in Crowded Spaces
Alahi, A., Goel, K., Ramanathan, V., Robicquet, A., Fei-Fei, L., & Savarese, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.110 · Cited by 3,483
Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks
Gupta, A., Johnson, J., Fei-Fei, L., Savarese, S., & Alahi, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00240 · Cited by 2,466
You'll never walk alone: Modeling social behavior for multi-target tracking
Pellegrini, S., Ess, A., Schindler, K., & van Gool, L. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459260 · Cited by 1,683 · cited 2×
“prediction, the ETH dataset [6] and the UCY dataset [31].”
MethodLerner, A., Chrysanthou, Y., & Lischinski, D. (2007) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2007.01089.x · Cited by 1,171
InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets
Chen, X., Duan, Y., Houthooft, R., Schulman, J., Sutskever, I., & Abbeel, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.03657 · Cited by 1,156
DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agents
Lee, N., Choi, W., Vernaza, P., Choy, C. B., Torr, P. H. S., & Chandraker, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.233 · Cited by 1,067
SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraints
Sadeghian, A., Kosaraju, V., Sadeghian, A., Hirose, N., Rezatofighi, H., & Savarese, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00144 · Cited by 1,065
Social Attention: Modeling Attention in Human Crowds
Vemula, A., Muelling, K., & Oh, J. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460504 · Cited by 675
SR-LSTM: State Refinement for LSTM Towards Pedestrian Trajectory Prediction
Zhang, P., Ouyang, W., Zhang, P., Xue, J., & Zheng, N. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01236 · Cited by 540
Who are you with and where are you going?
Yamaguchi, K., Berg, A. C., Ortiz, L. E., & Berg, T. L. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995468 · Cited by 484
Planning-based prediction for pedestrians
Ziebart, B. D., Ratliff, N., Gallagher, G., Mertz, C., Peterson, K., Bagnell, J. A., Hebert, M., Dey, A. K., & Srinivasa, S. (2009) · 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2009.5354147 · Cited by 456
TrafficPredict: Trajectory Prediction for Heterogeneous Traffic-Agents
Ma, Y., Zhu, X., Zhang, S., Yang, R., Wang, W., & Manocha, D. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016120 · Cited by 446
Social Ways: Learning Multi-Modal Distributions of Pedestrian Trajectories With GANs
Amirian, J., Hayet, J.-B., & Pettre, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00359 · Cited by 323
People tracking with human motion predictions from social forces
Luber, M., Stork, J. A., Tipaldi, G. D., & Arras, K. O. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509779 · Cited by 317
Encoding Crowd Interaction with Deep Neural Network for Pedestrian Trajectory Prediction
Xu, Y., Piao, Z., & Gao, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00553 · Cited by 276
Lipton, Z. C., & Steinhardt, J. (2019) · Queue · doi:10.1145/3317287.3328534 · Cited by 231
Leal-Taixe, L., Pons-Moll, G., & Rosenhahn, B. (2011) · 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops) · doi:10.1109/iccvw.2011.6130233 · Cited by 211
Person tracking and following with 2D laser scanners
Leigh, A., Pineau, J., Olmedo, N., & Zhang, H. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7139259 · Cited by 195
Object Detection and Tracking for Autonomous Navigation in Dynamic Environments
Ess, A., Schindler, K., Leibe, B., & Van Gool, L. (2010) · The International Journal of Robotics Research · doi:10.1177/0278364910365417 · Cited by 191
Context-Aware Trajectory Prediction
Bartoli, F., Lisanti, G., Ballan, L., & Del Bimbo, A. (2018) · 2018 24th International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr.2018.8545447 · Cited by 180
Exploring Nearest Neighbor Approaches for Image CaptioningPreprint
Devlin, J., Gupta, S., Girshick, R., Mitchell, M., & Zitnick, C. L. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.04467 · Cited by 175
Context-Based Path Prediction for Targets with Switching Dynamics
Kooij, J. F. P., Flohr, F. B., Pool, E. A. I., & Gavrila, D. M. (2018) · International Journal of Computer Vision · doi:10.1007/s11263-018-1104-4 · Cited by 161
Pfeiffer, M., Paolo, G., Sommer, H., Nieto, J. I., Siegwart, R., & Cadena, C. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8461157 · Cited by 134
Knowledge Transfer for Scene-Specific Motion Prediction
Ballan, L., Castaldo, F., Alahi, A., Palmieri, F., & Savarese, S. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46448-0_42 · Cited by 116
RED: A Simple but Effective Baseline Predictor for the TrajNet Benchmark
Becker, S., Hug, R., Hübner, W., & Arens, M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11015-4_13 · Cited by 70
Set-Based Prediction of Pedestrians in Urban Environments Considering Formalized Traffic Rules
Koschi, M., Pek, C., Beikirch, M., & Althoff, M. (2018) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569434 · Cited by 56
An Adaptive Motion Model for Person Tracking with Instantaneous Head-Pose Features
Baxter, R. H., Leach, M., Mukherjee, S. S., et al. (2014) · IEEE Signal Processing Letters · doi:10.1109/lsp.2014.2364458 · Cited by 39
Context-Aware Pedestrian Motion Prediction In Urban IntersectionsPreprint
Habibi, G., Jaipuria, N., & How, J. P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.09453 · Cited by 28
Predicting Pedestrian Trajectories
Pellegrini, S., Ess, A., & Gool, L. V. (2011) · Springer eBooks · doi:10.1007/978-0-85729-997-0_24 · Cited by 16
Cited by
Trajectron++: Dynamically-Feasible Trajectory Forecasting with Heterogeneous Data
Salzmann, T., Ivanovic, B., Chakravarty, P., & Pavone, M. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58523-5_40 · Cited by 1,076
Transformer Networks for Trajectory Forecasting
Giuliari, F., Hasan, I., Cristani, M., & Galasso, F. (2021) · 2020 25th International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr48806.2021.9412190 · Cited by 572
Human Trajectory Forecasting in Crowds: A Deep Learning Perspective
Kothari, P., Kreiss, S., & Alahi, A. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3069362 · Cited by 267
Crowd Density Forecasting by Modeling Patch-Based Dynamics
Minoura, H., Yonetani, R., Nishimura, M., & Ushiku, Y. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3043169 · Cited by 16
Metadata
- Authors
- Scholler, C., Aravantinos, V., Lay, F., & Knoll, A.
- Venue
- IEEE Robotics and Automation Letters
- Published
- 2020-04
- Volume
- 5
- Issue
- 2
- Pages
- 1696-1703
- ISSN
- 2377-3766 (ISSN-L)
- 2377-3774
- OpenAlex
- W2974402281
- Cited by
- 279
- References
- 35
- FWCI
- 13.95
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.