Social Interactions for Autonomous Driving: A Review and Perspectives
Open accessThe DOI matches its Crossref record; 276 of the 276 references it cites were found in a registry or an index.
Abstract
No human drives a car in a vacuum; she/he must negotiate with other road users to achieve their goals in social traffic scenes. A rational human driver can interact with other road users in a socially-compatible way through implicit communications to complete their driving tasks smoothly in interaction-intensive, safety-critical environments. This monograph aims to review the existing approaches and theories to help understand and rethink the interactions among human drivers toward social autonomous driving. We take this survey to seek the answers to a series of fundamental questions: 1) What is social interaction in road traffic scenes? 2) How to measure and evaluate social interaction? 3) How to model and reveal the process of social interaction? 4) How do human drivers reach an implicit agreement and negotiate smoothly in social interaction? This monograph reviews various approaches to modeling and learning the social interactions between human drivers, ranging from optimization theory, deep learning, and graphical models to social force theory and behavioral and cognitive science. We also highlight some new directions, critical challenges, and opening questions for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–276 of 276
Kolekar, S., Petermeijer, B., Boer, E. R., de Winter, J., & Abbink, D. A. (2021) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2021.103428 · Cited by 55
Lane-Attention: Predicting Vehicles’ Moving Trajectories by Learning Their Attention Over Lanes
Pan, J., Sun, H., Xu, K., Jiang, Y., Xiao, X., Hu, J., & Miao, J. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341233 · Cited by 55
Kauffmann, N., Winkler, F., Naujoks, F., & Vollrath, M. (2018) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2018.07.019 · Cited by 54
GAMMA: A General Agent Motion Model for Autonomous Driving
Luo, Y., Cai, P., Lee, Y., & Hsu, D. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3144501 · Cited by 53
Zhang, Y., Hang, P., Huang, C., & Lv, C. (2022) · Advanced Intelligent Systems · doi:10.1002/aisy.202100211 · Cited by 52
Deep Predictive Autonomous Driving Using Multi-Agent Joint Trajectory Prediction and Traffic Rules
Cho, K., Ha, T., Lee, G., & Oh, S. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967708 · Cited by 52
Deep Interactive Motion Prediction and Planning: Playing Games with Motion Prediction ModelsPreprint
Vazquez, J. L., Liniger, A., Schwarting, W., Rus, D. L., & Gool, L. V. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.02392 · Cited by 52
Sharing is Caring: Socially-Compliant Autonomous Intersection Negotiation
Buckman, N., Pierson, A. N., Schwarting, W., Karaman, S., & Rus, D. L. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967997 · Cited by 52
Heterogeneous-Agent Trajectory Forecasting Incorporating Class Uncertainty
Ivanovic, B., Lee, K.-H., Tokmakov, P., Wulfe, B., Mcllister, R., Gaidon, A., & Pavone, M. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9982283 · Cited by 51
Albaba, B. M., & Yıldız, Y. (2019) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2019.10.002 · Cited by 50
Sequence Prediction of Driving Behavior Using Double Articulation Analyzer
Taniguchi, T., Nagasaka, S., Hitomi, K., Chandrasiri, N. P., Bando, T., & Takenaka, K. (2015) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2015.2465933 · Cited by 49
CMetric: A Driving Behavior Measure using Centrality Functions
Chandra, R., Bhattacharya, U., Mittal, T., Bera, A., & Manocha, D. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341720 · Cited by 49
Navigating Congested Environments with Risk Level Sets
Pierson, A. N., Schwarting, W., Karaman, S., & Rus, D. L. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460697 · Cited by 49
New Multiple-Target Tracking Strategy Using Domain Knowledge and Optimization
Ding, R., Yu, M., Oh, H., & Chen, W. (2016) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2016.2615188 · Cited by 48
Modeling and Prediction of Driving Behaviors Using a Nonparametric Bayesian Method With AR Models
Hamada, R., Kubo, T., Ikeda, K., Zhang, Z., Shibata, T., Bando, T., Hitomi, K., & Egawa, M. (2016) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2016.2586307 · Cited by 46
Deng, C., Wu, C., Cao, S. C., & Lyu, N. (2018) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2017.12.017 · Cited by 44
Driving Behavior Prediction Considering Cognitive Prior and Driving Context
Zhou, D. H., Liu, H., Ma, H., Wang, X., Zhang, X., & Dong, Y. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2973751 · Cited by 42
IDE-Net: Interactive Driving Event and Pattern Extraction From Human Data
Jia, X., Sun, L., Tomizuka, M., & Zhan, W. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3062309 · Cited by 42
Self-citationWhen norms turn perverse: Contextual irrationality vs. rational traffic violations
Havârneanu, G., & Havârneanu, C. E. (2012) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2011.12.003 · Cited by 40
Generic Probabilistic Interactive Situation Recognition and Prediction: From Virtual to Real
Li, J., Ma, H., Zhan, W., & Tomizuka, M. (2018) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569780 · Cited by 40
Interaction-Based Trajectory Prediction Over a Hybrid Traffic Graph
Kumar, S., Gu, Y., Hoang, J., Haynes, G. C., & Marchetti-Bowick, M. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636143 · Cited by 38
Ma, H., Sun, Y., Li, J., & Tomizuka, M. (2021) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc48978.2021.9564510 · Cited by 38
Transferable and Adaptable Driving Behavior PredictionPreprint
Wang, L., Hu, Y., Sun, L., Zhan, W., Tomizuka, M., & Liu, C. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.05140 · Cited by 38
Self-citationYield or Rush? Social-Preference-Aware Driving Interaction Modeling Using Game-Theoretic Framework
Zhao, X., Tian, Y., & Sun, J. (2021) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc48978.2021.9564702 · Cited by 38
Using Graph-Theoretic Machine Learning to Predict Human Driver Behavior
Chandra, R., Bera, A., & Manocha, D. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3130218 · Cited by 37
Inferring Objectives in Continuous Dynamic Games from Noise-Corrupted Partial State Observations
Peters, L., Fridovich-Keil, D., Rubies-Royo, V., Tomlin, C. J., & Stachniss, C. (2021) · Robotics: Science and Systems · doi:10.15607/rss.2021.xvii.030 · Cited by 36
People as Sensors: Imputing Maps from Human Actions
Afolabi, O., Driggs-Campbell, K., Dong, R., Kochenderfer, M. J., & Sastry, S. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594511 · Cited by 33
Game-Theoretic Cooperative Lane Changing Using Data-Driven Models
Ding, G., Aghli, S., Heckman, C., & Chen, L. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593725 · Cited by 32
Human-centric Autonomous Driving in an AV-Pedestrian Interactive Environment Using SVO
Crosato, L., Wei, C., Ho, E. S. L., & Shum, H. P. H. (2021) · IEEE International Conference on Human-Machine Systems (ICHMS) · doi:10.1109/ichms53169.2021.9582640 · Cited by 31
Aware of Scene Vehicles—Probabilistic Modeling of Car-Following Behaviors in Real-World Traffic
Xu, D., Zhao, H., Guillemard, F., Géronimi, S., & Aioun, F. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2018.2863939 · Cited by 31
Langdon, A., Song, M., & Niv, Y. (2019) · Behavioural Processes · doi:10.1016/j.beproc.2019.103891 · Cited by 30
Deep Social ForcePreprint
Kreiss, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.12081 · Cited by 30
Control-Aware Prediction Objectives for Autonomous Driving
McAllister, R., Wulfe, B., Mercat, J., Ellis, L., Levine, S., & Gaidon, A. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811884 · Cited by 29
Understanding V2V Driving Scenarios Through Traffic Primitives
Wang, W., Zhang, W., Zhu, J., & Zhao, D. X. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3014612 · Cited by 29
Self-citationNajafi, M., Rossa, C., Adams, K. D., & Tavakoli, M. (2020) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2020.2981625 · Cited by 29
Zhang, H., Wang, Y., Liu, J., Li, C., Ma, T., Liu, X., & Yin, C. (2021) · SAE technical papers on CD-ROM/SAE technical paper series · doi:10.4271/2020-01-5113 · Cited by 28
Modeling Driver Behavior from Demonstrations in Dynamic Environments Using Spatiotemporal Lattices
González, D., Erkent, Ö., Romero-Cano, V., Dibangoye, J., & Laugier, C. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460208 · Cited by 27
UST: Unifying Spatio-Temporal Context for Trajectory Prediction in Autonomous Driving
He, H., Dai, H., & Wang, N. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9340943 · Cited by 26
Multi-Vehicle Tracking Using an Environment Interaction Potential Force Model
Tian, Z. H., Li, Y., Cen, M., & Zhu, H. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2020.2999095 · Cited by 26
Roh, J., Mavrogiannis, C., Madan, R., Fox, D., & Srinivasa, S. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.03894 · Cited by 25
Cooperation-Aware Decision Making for Autonomous Vehicles in Merge Scenarios
Liu, K., Li, N., Tseng, H. E., Kolmanovsky, I. V., Girard, A., & Filev, D. (2021) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc45484.2021.9682915 · Cited by 23
Immediate and delayed social interaction in road user behaviour
Wilde, G. J. S. (1980) · Applied Psychology · doi:10.1111/j.1464-0597.1980.tb01105.x · Cited by 23
Hierarchical Adaptable and Transferable Networks (HATN) for Driving Behavior PredictionPreprint
Wang, L., Hu, Y., Sun, L., Zhan, W., Tomizuka, M., & Liu, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.00788 · Cited by 23
Self-citationDynamic potential-model-based feature for lane change prediction
Woo, H., Ji, Y., Kono, H., Tamura, Y., Kuroda, Y., Sugano, T., Yamamoto, Y., Yamashita, A., & Asama, H. (2016) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2016.7844344 · Cited by 22
Uncertainty estimation for Cross-dataset performance in Trajectory predictionPreprint
Gilles, T., Sabatini, S., Tsishkou, D., Stanciulescu, B., & Moutarde, F. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2205.07310 · Cited by 22
Wang, H., Wang, W., Yuan, S., & Li, X. (2021) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2021.3103179 · Cited by 21
Self-citationCarmichael, J. T. (2012) · Oxford University Press eBooks · doi:10.1093/obo/9780199756384-0048 · Cited by 21
Guo, C., Kidono, K., Terashima, R., & Kojima, Y. (2018) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2017.2788194 · Cited by 21
Mervis, J. D. (2017) · Science · doi:10.1126/science.358.6369.1370 · Cited by 21
Interaction-aware driver maneuver inference in highways using realistic driver models
González, D., Romero-Cano, V., Dibangoye, J., & Laugier, C. (2017) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2017.8317709 · Cited by 21
Krüger, M., Stockem, A., Nattermann, T., & Bertram, T. (2020) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv47402.2020.9304846 · Cited by 20
Posetal Games: Efficiency, Existence, and Refinement of Equilibria in Games With Prioritized Metrics
Zanardi, A., Zardini, G., Srinivasan, S., Bolognani, S., Censi, A., Dörfler, F., & Frazzoli, E. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3135030 · Cited by 19
Socially Compatible Control Design of Automated Vehicle in Mixed Traffic
Ozkan, M. F., & Ma, Y. (2021) · IEEE Control Systems Letters · doi:10.1109/lcsys.2021.3133175 · Cited by 18
SFMGNet: A Physics-based Neural Network To Predict Pedestrian TrajectoriesPreprint
Hossain, S., Johora, F. T., Müller, J. P., Hartmann, S., & Reinhardt, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.02791 · Cited by 18
Tian, R., Tomizuka, M., & Sun, L. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636653 · Cited by 16
Self-citationMarkkula, G. M., & Doğar, M. R. (2022) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2022.3182892 · Cited by 16
Multiple Contextual Cues Integrated Trajectory Prediction for Autonomous Driving
Wang, L., Wu, T., Fu, H., Xiao, L., Wang, Z., & Dai, B. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3094564 · Cited by 16
Self-citationInterventional Behavior Prediction: Avoiding Overly Confident Anticipation in Interactive Prediction
Tang, C., Zhan, W., & Tomizuka, M. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981524 · Cited by 15
Should I stay or should I go? Evidence accumulation drives decision making in human driversPreprint
Zgonnikov, A., Abbink, D., & Markkula, G. (2020) · doi:10.31234/osf.io/p8dxn · Cited by 15
Potential Field: Interpretable and Unified Representation for Trajectory PredictionPreprint
Su, S., Peng, C., Shi, J., & Choi, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.07414 · Cited by 14
Analyzing Multiagent Interactions in Traffic Scenes via Topological Braids
Mavrogiannis, C., DeCastro, J., & Srinivasa, S. S. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9812118 · Cited by 13
Mavrogiannis, C., DeCastro, J., & Srinivasa, S. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.05205 · Cited by 11
Rosbach, S., James, V., Grosjohann, S., Homoceanu, S., Li, X., & Roth, S. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196778 · Cited by 11
Chen, X., & Chaudhari, P. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561148 · Cited by 11
Social Cohesion in Autonomous Driving
Landolfi, N. C., & Dragan, A. D. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593682 · Cited by 10
Sub-Goal Social Force Model for Collective Pedestrian Motion Under Vehicle InfluencePreprint
Yang, D., Johora, F. T., Redmill, K., Özgüner, Ü., & Müller, J. P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.03554 · Cited by 10
Chen, Y., Zhang, L., Merry, T., Amatya, S., Zhang, W., & Ren, Y. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561079 · Cited by 9
Spatial Attention for Autonomous Decision-making in Highway Scene
Zhang, S., Wu, Y., & Ogai, H. (2020) · Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE) · doi:10.23919/sice48898.2020.9240387 · Cited by 8
Swarm-Inspired Modeling of a Highway System With Stability Analysis
Fredette, D., & Özgüner, Ü. (2016) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2016.2619266 · Cited by 6
Prediction by Anticipation: An Action-Conditional Prediction Method based on Interaction Learning
Banijamali, E., Rohani, M., Amirloo, E., Luo, J., & Poupart, P. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01533 · Cited by 6
Moving efficiently through a crowd: A nature-inspired traffic rule
Danny Raj, M., & Kumaran, V. (2021) · Physical review. E · doi:10.1103/physreve.104.054609 · Cited by 5
Low Latency Trajectory Predictions for Interaction Aware Highway Driving
Anderson, C., Vasudevan, R., & Johnson‐Roberson, M. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3009068 · Cited by 5
Fluid-inspired field representation for risk assessment in road scenes
Li, X., Zhu, L., Xue, Q., Wang, D., & Zhang, Y. J. (2020) · Computational Visual Media · doi:10.1007/s41095-020-0190-8 · Cited by 4
A Field-Based Representation of Surrounding Vehicle Motion from a Monocular Camera
Zhu, L., Li, X., Lu, W., & Zhang, Y. J. (2018) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2018.8500491 · Cited by 2
Chen, T., Wang, Z., Li, L., Li, D., Li, Z., Chang, X., Bian, P., Liang, G., Wang, Q., & Xie, T. (2025) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.ecoop.2025.6
Metadata
- Authors
- Wang, W., Wang, L., Zhang, C., Liu, C., & Sun, L.
- Venue
- Foundations and Trends® in Robotics
- Publisher
- Emerald
- Published
- 2022-11-24
- Volume
- 10
- Issue
- 3-4
- Pages
- 198-377
- ISSN
- 1935-8253 (ISSN-L)
- 1935-8261
- OpenAlex
- W4308044468
- Cited by
- 165
- References
- 276
- FWCI
- 9.84
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.