The DOI matches its Crossref record; 82 of the 82 references it cites were found in a registry or an index.
Autonomous Vehicles That Interact With Pedestrians: A Survey of Theory and Practice
Open accessAbstract
One of the major challenges that autonomous cars are facing today is driving in urban environments. To make it a reality, autonomous vehicles require the ability to communicate with other road users and understand their intentions. Such interactions are essential between vehicles and pedestrians, the most vulnerable road users. Understanding pedestrian behavior, however, is not intuitive and depends on various factors, such as demographics of the pedestrians, traffic dynamics, environmental conditions, and so on. In this paper, we identify these factors by surveying pedestrian behavior studies, both the classical works on pedestrian-driver interaction and the modern ones that involve autonomous vehicles. To this end, we will discuss various methods of studying pedestrian behavior and analyze how the factors identified in the literature are interrelated. We will also review the practical applications aimed at solving the interaction problem, including design approaches for autonomous vehicles that communicate with pedestrians and visual perception and reasoning algorithms tailored to understanding pedestrian intention. Based on our findings, we will discuss the open problems and propose future research directions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vision meets robotics: The KITTI dataset
Geiger, A., Lenz, P., Stiller, C., & Urtasun, R. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913491297 · Cited by 9,913
You'll never walk alone: Modeling social behavior for multi-target tracking
Pellegrini, S., Ess, A., Schindler, K., & van Gool, L. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459260 · Cited by 1,683 · cited 2×
“treated as a dynamic navigation problem in which pedestrians choose the path that minimizes the likelihood of colliding with others [143].”
BackgroundPedestrian detection: A benchmark
Dollar, P., Wojek, C., Schiele, B., & Perona, P. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206631 · Cited by 1,313
Perceptions of autonomous vehicles: Relationships with road users, risk, gender and age
Hulse, L. M., Xie, H., & Galea, E. R. (2018) · Safety Science · doi:10.1016/j.ssci.2017.10.001 · Cited by 698
Visual attention while driving: sequences of eye fixations made by experienced and novice drivers
Underwood, G., Chapman, P., Brocklehurst, N., Underwood, J., & Crundall, D. (2003) · Ergonomics · doi:10.1080/0014013031000090116 · Cited by 517
Did you see the unicycling clown? Inattentional blindness while walking and talking on a cell phone
Hyman, I. E., Boss, S. M., Wise, B. M., McKenzie, K. E., & Caggiano, J. M. (2010) · Applied Cognitive Psychology · doi:10.1002/acp.1638 · Cited by 438
Are They Going to Cross? A Benchmark Dataset and Baseline for Pedestrian Crosswalk Behavior
Rasouli, A., Kotseruba, I., & Tsotsos, J. K. (2017) · 2017 IEEE International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw.2017.33 · Cited by 425
Self-citationSisiopiku, V. P., & Akın, D. (2003) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2003.06.001 · Cited by 380
Visual attention and the transition from novice to advanced driver
Underwood, G. (2007) · Ergonomics · doi:10.1080/00140130701318707 · Cited by 373
Communicating Awareness and Intent in Autonomous Vehicle-Pedestrian Interaction
Mahadevan, K., Somanath, S., & Sharlin, E. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174003 · Cited by 366
Holland, C., & Hill, R. (2007) · Accident Analysis & Prevention · doi:10.1016/j.aap.2006.07.003 · Cited by 360
Enhancements of V2X communication in support of cooperative autonomous driving
Hobert, L., Festag, A., Llatser, I., Altomare, L., Visintainer, F., & Kovacs, A. (2015) · IEEE Communications Magazine · doi:10.1109/mcom.2015.7355568 · Cited by 338
Intention-aware online POMDP planning for autonomous driving in a crowd
Bai, H., Cai, S., Ye, N., Hsu, D., & Lee, W. S. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7139219 · Cited by 321
Pedestrians, Autonomous Vehicles, and Cities
Millard-Ball, A. (2018) · Journal of Planning Education and Research · doi:10.1177/0739456x16675674 · Cited by 320
Pedestrian-driver communication and decision strategies at marked crossings
Sucha, M., Dostal, D., & Risser, R. (2017) · Accident Analysis & Prevention · doi:10.1016/j.aap.2017.02.018 · Cited by 305
Rothenbucher, D., Li, J., Sirkin, D., Mok, B., & Ju, W. (2016) · 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) · doi:10.1109/roman.2016.7745210 · Cited by 303
Walker, I. (2007) · Accident Analysis & Prevention · doi:10.1016/j.aap.2006.08.010 · Cited by 302
Communicating Intent of Automated Vehicles to Pedestrians
Habibovic, A., Lundgren, V. M., Andersson, J., Klingegård, M., Lagström, T., Sirkka, A., Fagerlönn, J., Edgren, C., Fredriksson, R., Krupenia, S., et al. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.01336 · Cited by 298
Probabilistic Analysis of Dynamic Scenes and Collision Risks Assessment to Improve Driving Safety
Laugier, C., Paromtchik, I. E., Perrollaz, M., Yong, M. Y., Yoder, J., Tay, C., Mekhnacha, K., & Negre, A. (2011) · IEEE Intelligent Transportation Systems Magazine · doi:10.1109/mits.2011.942779 · Cited by 295
Context-Based Pedestrian Path Prediction
Kooij, J. F. P., Schneider, N., Flohr, F., & Gavrila, D. M. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_40 · Cited by 286
Understanding Pedestrian Behavior in Complex Traffic Scenes
Rasouli, A., Kotseruba, I., & Tsotsos, J. K. (2018) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2017.2788193 · Cited by 274
Self-citationDeb, S., Strawderman, L., Carruth, D. W., DuBien, J., Smith, B., & Garrison, T. M. (2017) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2017.08.029 · Cited by 259
Pedestrian Path Prediction with Recursive Bayesian Filters: A Comparative Study
Schneider, N., & Gavrila, D. M. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40602-7_18 · Cited by 249
Status factors in pedestrian violation of traffic signals.
Lefkowitz, M., Blake, R. R., & Mouton, J. S. (1955) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0042000 · Cited by 244
Multi-sensor system for driver's hand-gesture recognition
Molchanov, P., Gupta, S., Kim, K., & Pulli, K. (2015) · 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2015.7163132 · Cited by 238
Pedestrian Interaction with Vehicles: Roles of Explicit and Implicit Communication
Dey, D., & Terken, J. (2017) · Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications · doi:10.1145/3122986.3123009 · Cited by 235
Agreeing to cross: How drivers and pedestrians communicate
Rasouli, A., Kotseruba, I., & Tsotsos, J. K. (2017) · 2017 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2017.7995730 · Cited by 232
Self-citationPedestrians at the kerb – Recognising the action intentions of humans
Schmidt, S., & Färber, B. (2009) · Transportation Research Part F: Traffic Psychology and Behaviour · doi:10.1016/j.trf.2009.02.003 · Cited by 229
Eyes on a Car: an Interface Design for Communication between an Autonomous Car and a Pedestrian
Chang, C.-M., Toda, K., Sakamoto, D., & Igarashi, T. (2017) · Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications · doi:10.1145/3122986.3122989 · Cited by 226
Tom, A., & Granié, M.-A. (2011) · Accident Analysis & Prevention · doi:10.1016/j.aap.2011.04.012 · Cited by 222
Looking at Humans in the Age of Self-Driving and Highly Automated Vehicles
Ohn-Bar, E., & Trivedi, M. M. (2016) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2016.2571067 · Cited by 218
Yagil, D. (2000) · Transportation Research Part F: Traffic Psychology and Behaviour · doi:10.1016/s1369-8478(00)00004-8 · Cited by 206
The Perception of Arrival Time for Different Oncoming Vehicles at an Intersection
Caird, J. K., & Hancock, P. A. (1994) · Ecological Psychology · doi:10.1207/s15326969eco0602_1 · Cited by 205
Willis, A., Gjersoe, N., Havard, C., Kerridge, J., & Kukla, R. (2004) · Environment and Planning B: Planning and Design · doi:10.1068/b3060 · Cited by 202
Evans, D., & Norman, P. (1998) · Health Education Research · doi:10.1093/her/13.4.481-a · Cited by 195
Is the Pedestrian going to Cross? Answering by 2D Pose Estimation
Fang, Z., & López, A. M. (2018) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2018.8500413 · Cited by 184
A Combined Model- and Learning-Based Framework for Interaction-Aware Maneuver Prediction
Bahram, M., Hubmann, C., Lawitzky, A., Aeberhard, M., & Wollherr, D. (2016) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2015.2506642 · Cited by 175
Communication and Communication Problems Between Autonomous Vehicles and Human Drivers
Färber, B. (2016) · Springer eBooks · doi:10.1007/978-3-662-48847-8_7 · Cited by 174
Behavioural Issues in Pedestrian Speed Choice and Street Crossing Behaviour: A Review
Ishaque, M. M., & Noland, R. B. (2008) · Transport Reviews · doi:10.1080/01441640701365239 · Cited by 165
A pedestrian’s stare and drivers’ stopping behavior: A field experiment at the pedestrian crossing
Guéguen, N., Meineri, S., & Eyssartier, C. (2015) · Safety Science · doi:10.1016/j.ssci.2015.01.018 · Cited by 163
Head, Eye, and Hand Patterns for Driver Activity Recognition
Ohn-Bar, E., Martin, S., Tawari, A., & Trivedi, M. M. (2014) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2014.124 · Cited by 162
Human-Vehicle Interfaces: The Power of Vehicle Movement Gestures in Human Road User Coordination
Risto, M., Emmenegger, C., Vinkhuyzen, E., Cefkin, M., & Hollan, J. (2017) · International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design (Driving Assessment Conference) · doi:10.17077/drivingassessment.1633 · Cited by 148
Rosenbloom, T., Nemrodov, D., & Barkan, H. (2004) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2004.10.004 · Cited by 143
Intent Communication between Autonomous Vehicles and PedestriansPreprint
Matthews, M., Chowdhary, G. V., & Kieson, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.07123 · Cited by 140
Walk or wait? An empirical analysis of street crossing decisions
Das, S., Manski, C. F., & Manuszak, M. D. (2005) · Journal of Applied Econometrics · doi:10.1002/jae.791 · Cited by 138
Joint Attention in Autonomous Driving (JAAD)Preprint
Kotseruba, I., Rasouli, A., & Tsotsos, J. K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.04741 · Cited by 138
Self-citationP2V and V2P communication for Pedestrian warning on the basis of Autonomous Vehicles
Hussein, A., García, F., Armingol, J. M., & Olaverri-Monreal, C. (2016) · 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2016.7795885 · Cited by 130
Schneemann, F., & Heinemann, P. (2016) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759351 · Cited by 121
A data-driven approach for pedestrian intention estimation
Völz, B., Behrendt, K., Mielenz, H., Gilitschenski, I., Siegwart, R., & Nieto, J. I. (2016) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2016.7795975 · Cited by 108
On the problem of making autonomous vehicles conform to traffic law
Prakken, H. (2017) · Artificial Intelligence and Law · doi:10.1007/s10506-017-9210-0 · Cited by 97
Gaze Behavior while Crossing Complex Intersections
Geruschat, D. R., Hassan, S. E., & Turano, K. A. (2003) · Optometry and Vision Science · doi:10.1002/j.1538-9235.2003.tb01687.x · Cited by 91
To Cross or Not to Cross: The Effect of Locomotion on Street-Crossing Behavior
Oudejans, R. R. D., Michaels, C. F., van Dort, B., & Frissen, E. J. P. (1996) · Ecological Psychology · doi:10.1207/s15326969eco0803_4 · Cited by 87
Møgelmose, A., Trivedi, M. M., & Moeslund, T. B. (2015) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2015.7225707 · Cited by 83
The social behavior of autonomous vehicles
Müller, L., Risto, M., & Emmenegger, C. (2016) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2968219.2968561 · Cited by 81
Intention-Aware Pedestrian Avoidance
Bandyopadhyay, T., Jie, C. Z., Hsu, D., Ang, M. H., Rus, D. L., & Frazzoli, E. (2013) · Springer tracts in advanced robotics · doi:10.1007/978-3-319-00065-7_64 · Cited by 77
First Step into Visceral Interaction with Autonomous Vehicles
Zimmermann, R., & Wettach, R. (2017) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3122986.3122988 · Cited by 74
Narla, S. R. (2013) · ITE journal · Cited by 72
Schulz, A., & Stiefelhagen, R. (2015) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2015.37 · Cited by 70
The Interaction Between Humans and Autonomous Agents
Wolf, I. (2016) · Springer eBooks · doi:10.1007/978-3-662-48847-8_6 · Cited by 68
Deb, S., Rahman, M. M., Strawderman, L. J., & Garrison, T. M. (2018) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2018.2799523 · Cited by 64
Pedestrian Notification Methods in Autonomous Vehicles for Multi-Class Mobility-on-Demand Service
Florentine, E., Ang, M. A., Pendleton, S., Andersen, H., & Ang, M. H. (2016) · International Conference on Human-Agent Interaction (HAI) · doi:10.1145/2974804.2974833 · Cited by 63
Stereo-Vision-Based Pedestrian's Intention Detection in a Moving Vehicle
Köhler, S., Goldhammer, M., Zindler, K., Doll, K., & Dietmeyer, K. (2015) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2015.374 · Cited by 61
Jayaraman, S. K., Creech, C., Robert, L., Tilbury, D. M., Yang, X. J., Pradhan, A. K., & Tsui, K. M. (2018) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3173386.3177073 · Cited by 61
Three Strategies for Autonomous Car-to-Pedestrian Communication: A Survival Guide
Mirnig, N., Perterer, N., Stollnberger, G., & Tscheligi, M. (2017) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3029798.3038402 · Cited by 50
Pedestrian Choice and Judgment
Moore, R. L. (1953) · Journal of the Operational Research Society · doi:10.1057/jors.1953.2 · Cited by 48
Analysis of pedestrian dynamics from a vehicle perspective
Kooij, J. F. P., Schneider, N., & Gavrila, D. M. (2014) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2014.6856505 · Cited by 45
(2015) · Cited by 42
Autonomous evasive maneuvers triggered by infrastructure-based detection of pedestrian intentions
Köhler, S., Schreiner, B., Ronalter, S., et al. (2013) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2013.6629520 · Cited by 32
Rangesh, A., & Trivedi, M. M. (2018) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2018.2804170 · Cited by 31
HI Robot: Human intention-aware robot planning for safe and efficient navigation in crowds
Park, C., Ondřej, J., Gilbert, M., Freeman, K., & O’Sullivan, C. (2016) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759511 · Cited by 29
Conventionalized gestures for the interaction of people in traffic with autonomous vehicles
Gupta, S., Vasardani, M., & Winter, S. (2016) · ACM SIGSPATIAL International Workshop on Computational Transportation Science (IWCTS) · doi:10.1145/3003965.3003967 · Cited by 26
AN EXPERIMENTAL METHODOLOGY FOR ANALYSIS OF CHILD PEDESTRIAN BEHAVIOR
Heimstra, N. W., Nichols, J. L., & Martin, G. L. (1969) · PEDIATRICS · doi:10.1542/peds.44.5.832 · Cited by 22
Analysis on termination of pedestrians' gait at urban intersections
Goldhammer, M., Hubert, A., Koehler, S., Zindler, K., Brunsmann, U., Doll, K., & Sick, B. (2014) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2014.6957947 · Cited by 21
Pilot study on pedestrian step frequency in naturalistic driving environment
Tian, R., Du, E. Y., Yang, K., et al. (2013) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2013.6629632 · Cited by 21
From V2X to Control2Trust: Why Trust and Control Are Major Attributes in Vehicle2X Technologies
Schmidt, T., Philipsen, R., & Ziefle, M. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-20376-8_51 · Cited by 18
Immediate and delayed social interaction in road user behaviour
Wilde, G. J. S. (1980) · Applied Psychology · doi:10.1111/j.1464-0597.1980.tb01105.x · Cited by 14
Recognizing Car Fluents from Video
Li, B., Wu, T., Xiong, C., & Zhu, S. C. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.413 · Cited by 12
Intention-Aware Multiple Pedestrian Tracking
Madrigal, F., Hayet, J.-B., & Lerasle, F. (2014) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2014.706 · Cited by 11
Estimation of collision risk for improving driver's safety
Hariyono, J., Shahbaz, A., Kurnianggoro, L., & Jo, K.-H. (2016) · Annual Conference of the IEEE Industrial Electronics Society (IECON) · doi:10.1109/iecon.2016.7793743 · Cited by 10
Learning with proxy supervision for end-to-end visual learning
Čermák, J., & Angelova, A. (2017) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2017.7995690 · Cited by 5
Estimating Driver Unawareness of Pedestrian Based On Visual Behaviors and Driving BehaviorsPreprint
Phan, M. T., Thouvenin, I., Frémont, V., & Cherfaoui, V. B. (2013) · HAL · Cited by 3
Act like a Human: Teach an Autonomous Vehicle to Deal with Traffic Encounters
Wang, J., Lu, J., You, F., & Wang, Y. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-73888-8_84 · Cited by 3
Cited by
A Review on YOLOv8 and Its Advancements
Sohan, M., Sai Ram, T., & Rami Reddy, C. V. (2024) · Algorithms for Intelligent Systems · doi:10.1007/978-981-99-7962-2_39 · Cited by 898
Deep Learning for Safe Autonomous Driving: Current Challenges and Future Directions
Muhammad, K., Ullah, A., Lloret, J., Ser, J. D., & de Albuquerque, V. H. C. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3032227 · Cited by 659
Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveys
Chen, L., Li, Y., Huang, C., Li, B., Xing, Y., Tian, D., Li, L., Hu, Z., Na, X., Li, Z., et al. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3223131 · Cited by 511
Explanations in Autonomous Driving: A Survey
Omeiza, D., Webb, H., Jirotka, M., & Kunze, L. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3122865 · Cited by 355
Human Trajectory Forecasting in Crowds: A Deep Learning Perspective
Kothari, P., Kreiss, S., & Alahi, A. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3069362 · Cited by 267
Metadata
- Authors
- Rasouli, A., & Tsotsos, J. K.
- Venue
- IEEE Transactions on Intelligent Transportation Systems
- Published
- 2020-03
- Volume
- 21
- Issue
- 3
- Pages
- 900-918
- ISSN
- 1524-9050 (ISSN-L)
- 1558-0016
- OpenAlex
- W2805439952
- Cited by
- 855
- References
- 82
- FWCI
- 43.15
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.