Anticipatory robot control for efficient human-robot collaboration
Abstract
Efficient collaboration requires collaborators to monitor the behaviors of their partners, make inferences about their task intent, and plan their own actions accordingly. To work seamlessly and efficiently with their human counterparts, robots must similarly rely on predictions of their users' intent in planning their actions. In this paper, we present an anticipatory control method that enables robots to proactively perform task actions based on anticipated actions of their human partners. We implemented this method into a robot system that monitored its user's gaze, predicted his or her task intent based on observed gaze patterns, and performed anticipatory task actions according to its predictions. Results from a human-robot interaction experiment showed that anticipatory control enabled the robot to respond to user requests and complete the task faster-2.5 seconds on average and up to 3.4 seconds-compared to a robot using a reactive control method that did not anticipate user intent. Our findings highlight the promise of performing anticipatory actions for achieving efficient human-robot teamwork.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Prior research in human-robot collaboration has demonstrated how a robot can anticipate its human collaborator's task needs based on the observation of the collaborator's eye gaze and provide anticipatory robot assistance [29].
“Prior research in the domain of human-robot collaboration has demonstrated how a robot can anticipate its human collaborator's task needs based on the observation of the collaborator's eye gaze and provide anticipatory robot assistance [29].”
From Understanding User Reliance on AI in Assisted Decision-Making (2022) · cites this paper as [29]
Cites
RRT-connect: An efficient approach to single-query path planning
Kuffner, J. J., & LaValle, S. M. (2000) · Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065) · doi:10.1109/robot.2000.844730 · Cited by 3,555 · see citing works
Mirror neurons and the simulation theory of mind-reading
Gallese, V (1998) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(98)01262-5 · Cited by 3,201 · see citing works
Joint action: bodies and minds moving together
SEBANZ, N., BEKKERING, H., & KNOBLICH, G. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.12.009 · Cited by 1,950 · see citing works
Tomasello, M. (2009) · doi:10.7551/mitpress/8470.001.0001 · Cited by 1,896 · see citing works
The Roles of Vision and Eye Movements in the Control of Activities of Daily Living
Land, M. F., Mennie, N. R., & Rusted, J. M. (1999) · Perception · doi:10.1068/p2935 · Cited by 1,096 · see citing works
Joint attention as social cognition.
Tomasello, M. (1995) · Medical Entomology and Zoology · Cited by 1,004 · see citing works
Eye–Hand Coordination in Object Manipulation
Johansson, R. S., Westling, G., Bäckström, A., & Flanagan, J. R. (2001) · Journal of Neuroscience · doi:10.1523/jneurosci.21-17-06917.2001 · Cited by 873 · see citing works
(2013) · doi:10.1109/hri.2013.6483603 · Cited by 595 · see citing works
Prediction in Joint Action: What, When, and Where
Sebanz, N., & Knoblich, G. (2009) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2009.01024.x · Cited by 571 · see citing works
Perception of Another Person's Looking Behavior
Gibson, J. J., & Pick, A. D. (1963) · The American Journal of Psychology · doi:10.2307/1419779 · Cited by 400 · see citing works
Coordinating cognition: The costs and benefits of shared gaze during collaborative search
Brennan, S. E., Chen, X., Dickinson, C. A., Neider, M. B., & Zelinsky, G. J. (2007) · Cognition · doi:10.1016/j.cognition.2007.05.012 · Cited by 351 · see citing works
How we predict what other people are going to do
Frith, C., & Uta Frith, A. (2006) · Brain Research · doi:10.1016/j.brainres.2005.12.126 · Cited by 347 · see citing works
Satake, S., Kanda, T., Glas, D. F., Imai, M., Ishiguro, H., & Hagita, N. (2009) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/1514095.1514117 · Cited by 302 · see citing works
Human-robot collaborative manipulation planning using early prediction of human motion
Mainprice, J., & Berenson, D. (2013) · 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2013.6696368 · Cited by 301 · see citing works
On the Roles of Eye Gaze and Head Dynamics in Predicting Driver's Intent to Change Lanes
Doshi, A., & Trivedi, M. M. (2009) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2009.2026675 · Cited by 299 · see citing works
The ontogeny and phylogeny of joint visual attention.
Butterworth, G. E. (1991) · Cited by 204 · see citing works
"Like Me" as a Building Block for Understanding Other Minds: Bodily Acts, Attention, and Intention
Meltzoff, A. N., & Brooks, R. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/3838.003.0013 · Cited by 204 · see citing works
Mutlu, B., Yamaoka, F., Kanda, T., Ishiguro, H., & Hagita, N. (2009) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/1514095.1514110 · Cited by 184 · see citing works
Self-citationEffects of anticipatory action on human-robot teamwork efficiency, fluency, and perception of team
Hoffman, G., & Breazeal, C. (2007) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/1228716.1228718 · Cited by 169 · see citing works
Using gaze patterns to predict task intent in collaboration
Huang, C., Andrist, S., Sauppé, A., & Mutlu, B. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01049 · Cited by 168 · see citing works
Self-citationBoucher, J.-D., Pattacini, U., Lelong, A., Bailly, G., Elisei, F., Fagel, S., Dominey, P. F., & Ventre‐Dominey, J. (2012) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2012.00003 · Cited by 151 · see citing works
Pérez-D’Arpino, C., & Shah, J. (2015) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2015.7140066 · Cited by 149 · see citing works
Joint Action: Neurocognitive Mechanisms Supporting Human Interaction
Harold Bekkering, A., de Bruijn, E. R. A., Cuijpers, R. H., Newman‐Norlund, R., van Schie, H. T., & Meulenbroek, R. G. J. (2009) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2009.01023.x · Cited by 135 · see citing works
Anticipating Human Activities using Object Affordances for Reactive Robotic Response
Koppula, H., & Saxena, A. (2013) · Robotics: Science and Systems IX · doi:10.15607/rss.2013.ix.006 · Cited by 130 · see citing works
Anticipating human actions for collaboration in the presence of task and sensor uncertainty
Hawkins, K. P., Bansal, S., Vo, N., & Bobick, A. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907165 · Cited by 79 · see citing works
Robot mediated round table: Analysis of the effect of robot's gaze
Imai, M., Kanda, T., Ono, T., Ishiguro, H., & Mase, K. (2003) · IEEE RO-MAN · doi:10.1109/roman.2002.1045657 · Cited by 62 · see citing works
Action parsing and goal inference using self as simulator
Gray, J., Breazeal, C., Berlin, M., Brooks, A., & Lieberman, J. (2006) · IEEE RO-MAN · doi:10.1109/roman.2005.1513780 · Cited by 59 · see citing works
RECOGNIZING BEHAVIOR IN HAND-EYE COORDINATION PATTERNS
Yi, W., & Ballard, D. H. (2009) · International Journal of Humanoid Robotics · doi:10.1142/s0219843609001863 · Cited by 49 · see citing works
Towards active event recognition
Ognibene, D., & Demiris, Y. (2013) · Spiral (Imperial College London) · Cited by 29 · see citing works
Proactive Action Preparation: Seeing Action Preparation as a Continuous and Proactive Process
Pezzulo, G., & Ognibene, D. (2012) · Motor Control · doi:10.1123/mcj.16.3.386 · Cited by 27 · see citing works
Experimental Design in the Behavioral and Social Sciences
Schneider, S. (2013) · SAGE Publications Ltd eBooks · doi:10.4135/9781446286326 · Cited by 8 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Social eye gaze in human-robot interaction
Admoni, H., & Scassellati, B. (2017) · J. Hum. Robot Interact. · doi:10.5898/jhri.6.1.admoni · Cited by 587 · see citing works
Artificial Intelligence in Advanced Manufacturing: Current Status and Future Outlook
Arinez, J. F., Chang, Q., Gao, R. X., Xu, C., & Zhang, J. (2020) · Journal of Manufacturing Science and Engineering · doi:10.1115/1.4047855 · Cited by 584 · see citing works
Cobot programming for collaborative industrial tasks: An overview
Zaatari, S. E., Marei, M., Li, W., & Usman, Z. (2019) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2019.03.003 · Cited by 470 · see citing works
Hentout, A., Mustapha, A., Maoudj, A., & Akli, I. (2019) · Advanced Robotics · doi:10.1080/01691864.2019.1636714 · Cited by 463 · see citing works
Embodiment in Socially Interactive Robots
Deng, E., Mutlu, B., & Matarić, M. J. (2019) · Foundations and Trends in Robotics · doi:10.1561/2300000056 · Cited by 238 · see citing works
Self-citationAppearance-Based Gaze Estimation Using Dilated-Convolutions
Chen, Z., & Shi, B. E. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-20876-9_20 · Cited by 181 · see citing works
Gombolay, M., Bair, A., Huang, C., & Shah, J. (2017) · The International Journal of Robotics Research · doi:10.1177/0278364916688255 · Cited by 160 · see citing works
Self-citationLiu, H., & Wang, L. (2019) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2019.11.001 · Cited by 149 · see citing works
A Review of Human–Machine Cooperation in the Robotics Domain
Yang, C., Zhu, Y., & Chen, Y. (2021) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2021.3131684 · Cited by 134 · see citing works
Probabilistic Human Intent Recognition for Shared Autonomy in Assistive Robotics
Jain, S., & Argall, B. (2019) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3359614 · Cited by 125 · see citing works
Optimal Scheduling of Human–Robot Collaborative Assembly Operations With Time Petri Nets
Casalino, A., Zanchettin, A. M., Piroddi, L., & Rocco, P. (2019) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2019.2932150 · Cited by 118 · see citing works
Controlling Object Hand-Over in Human–Robot Collaboration Via Natural Wearable Sensing
Wang, W., Li, R., Diekel, Z. M., Chen, Y., Zhang, Z., & Jia, Y. (2018) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2018.2883176 · Cited by 106 · see citing works
Chadalavada, R. T., Andreasson, H., Schindler, M., Palm, R., & Lilienthal, A. J. (2019) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2019.101830 · Cited by 99 · see citing works
Human-Centered Collaborative Robots With Deep Reinforcement Learning
Ghadirzadeh, A., Chen, X., Yin, W.-J., Yi, Z., Björkman, M., & Kragic, D. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3047730 · Cited by 88 · see citing works
Andrist, S., Gleicher, M. L., & Mutlu, B. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3026033 · Cited by 87 · see citing works
Self-citationSaleh, K., Hossny, M., & Nahavandi, S. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793991 · Cited by 85 · see citing works
Telepresence Social Robotics towards Co-Presence: A Review
Almeida, L., Menezes, P. J., & Dias, J. M. M. (2022) · Applied Sciences · doi:10.3390/app12115557 · Cited by 78 · see citing works
Schydlo, P., Raković, M., Jamone, L., & Santos-Victor, J. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460924 · Cited by 71 · see citing works
Robot-Assisted Disassembly Sequence Planning With Real-Time Human Motion Prediction
Lee, M.-L., Liu, W., Behdad, S., Liang, X. P., & Zheng, M. (2022) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2022.3185889 · Cited by 69 · see citing works
Understanding User Reliance on AI in Assisted Decision-Making
Cao, S., & Huang, C.-M. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555572 · Cited by 71 · see citing works
Self-citationDesigning Human-Agent Collaborations: Commitment, responsiveness, and support
Cila, N. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517500 · Cited by 65 · see citing works
Human Gaze Following for Human-Robot Interaction
Saran, A., Majumdar, S., Short, E. S., Thomaz, A. L., & Niekum, S. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593580 · Cited by 64 · see citing works
Gaze-Based Intention Estimation: Principles, Methodologies, and Applications in HRI
Belardinelli, A. (2024) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3656376 · Cited by 63 · see citing works
Literature Review on Recent Trends and Perspectives of Collaborative Robotics in Work 4.0
Weidemann, C., Mandischer, N., van Kerkom, F., Corves, B. J., Hüsing, M., Kraus, T., & Garus, C. (2023) · Robotics · doi:10.3390/robotics12030084 · Cited by 64 · see citing works
User-Adaptive Interaction in Social Robots: A Survey Focusing on Non-physical Interaction
Martins, G. S., Santos, L., & Dias, J. M. M. (2018) · International Journal of Social Robotics · doi:10.1007/s12369-018-0485-4 · Cited by 61 · see citing works
Combining gaze and AI planning for online human intention recognition
Singh, R., Miller, T., Newn, J., Velloso, E., Vetere, F., & Sonenberg, L. (2020) · Artificial Intelligence · doi:10.1016/j.artint.2020.103275 · Cited by 60 · see citing works
Deep learning-based human action recognition to leverage context awareness in collaborative assembly
Moutinho, D., Rocha, L. F., Costa, C. M., Teixeira, L. F., & Veiga, G. M. (2022) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2022.102449 · Cited by 59 · see citing works
Recursive Bayesian Human Intent Recognition in Shared-Control Robotics
Jain, S., & Argall, B. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593766 · Cited by 57 · see citing works
Lin, C. J., Wang, K., Tadesse, A. A., & Woldegiorgis, B. H. (2021) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2021.12.001 · Cited by 53 · see citing works
Human Gaze Assisted Artificial Intelligence: A Review
Zhang, R., Saran, A., Liu, B., Zhu, Y., Guo, S., Niekum, S., Ballard, D., & Hayhoe, M. (2020) · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/689 · Cited by 48 · see citing works
Rossi, S., Rossi, A., & Dautenhahn, K. (2020) · International Journal of Social Robotics · doi:10.1007/s12369-020-00650-z · Cited by 47 · see citing works
MoGaze: A Dataset of Full-Body Motions that Includes Workspace Geometry and Eye-Gaze
Kratzer, P., Bihlmaier, S., Midlagajni, N. B., Prakash, R., Toussaint, M., & Mainprice, J. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3043167 · Cited by 47 · see citing works
Object Transfer Point Estimation for Fluent Human-Robot Handovers
Nemlekar, H., Dutia, D., & Li, Z. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794008 · Cited by 45 · see citing works
Human Factors Considerations for Enabling Functional Use of Exosystems in Operational Environments
Stirling, L., Siu, H. C., Jones, E. M., & Duda, K. (2018) · IEEE Systems Journal · doi:10.1109/jsyst.2018.2821689 · Cited by 44 · see citing works
Towards High Performance Low Complexity Calibration in Appearance Based Gaze Estimation
Chen, Z., & Shi, B. E. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3148386 · Cited by 41 · see citing works
Exploring tasks and challenges in human-robot collaborative systems: A review
Asif, S., Callari, T., Khan, F., Eimontaite, I., Hubbard, E.-M., Bahraini, M. S., Webb, P., & Lohse, N. (2026) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2025.103102 · Cited by 39 · see citing works
A network analytic approach to gaze coordination during a collaborative task
Andrist, S., Ruis, A. R., & Shaffer, D. W. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.07.017 · Cited by 39 · see citing works
The relevance of signal timing in human-robot collaborative manipulation
Cini, F., Banfi, T., Ciuti, G., Craighero, L., & Controzzi, M. (2021) · Science Robotics · doi:10.1126/scirobotics.abg1308 · Cited by 39 · see citing works
Toward Active Physical Human–Robot Interaction: Quantifying the Human State During Interactions
Hu, Y. H., Abe, N., Benallegue, M., Yamanobe, N., Venture, G., & Yoshida, E. (2022) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2021.3138684 · Cited by 39 · see citing works
Gaze-Based Intention Estimation for Shared Autonomy in Pick-and-Place Tasks
Fuchs, S., & Belardinelli, A. (2021) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2021.647930 · Cited by 39 · see citing works
Cooney, M. D., & Menezes, M. L. R. (2018) · Multimodal Technologies and Interaction · doi:10.3390/mti2030052 · Cited by 39 · see citing works
Predicting Intention Through Eye Gaze Patterns
Koochaki, F., & Najafizadeh, L. (2018) · IEEE Biomedical Circuits and Systems Conference (BioCAS) · doi:10.1109/biocas.2018.8584665 · Cited by 38 · see citing works
Mediating Human-Robot Interactions with Virtual, Augmented, and Mixed Reality
Szafir, D. J. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-21565-1_9 · Cited by 38 · see citing works
Zhang, Z., Peng, G., Wang, W., Chen, Y., Jia, Y., & Liu, S. (2022) · Sensors · doi:10.3390/s22114279 · Cited by 38 · see citing works
Hayes, B., & Shah, J. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989778 · Cited by 37 · see citing works
Dini, A., Murko, C., Yahyanejad, S., Augsdörfer, U., Hofbaur, M., & Paletta, L. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206301 · Cited by 36 · see citing works
Barz, M., & Sonntag, D. (2021) · Sensors · doi:10.3390/s21124143 · Cited by 34 · see citing works
Preference-Based Assistance Prediction for Human-Robot Collaboration Tasks
Grigore, E. C., Roncone, A., Mangin, O., & Scassellati, B. M. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593716 · Cited by 33 · see citing works
A scoping review of gaze and eye tracking-based control methods for assistive robotic arms
Fischer-Janzen, A., Wendt, T. M., & Laerhoven, K. V. (2024) · Frontiers in Robotics and AI · doi:10.3389/frobt.2024.1326670 · Cited by 36 · see citing works
Construction Robot Teleoperation Safeguard Based on Real-Time Human Hand Motion Prediction
Zhou, T., Zhu, Q., Shi, Y., & Du, J. (2022) · Journal of Construction Engineering and Management · doi:10.1061/(asce)co.1943-7862.0002289 · Cited by 32 · see citing works
Saleh, K., Hossny, M., & Nahavandi, S. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.12.091 · Cited by 30 · see citing works
Gaze Tracking Using an Unmodified Web Camera and Convolutional Neural Network
Ansari, M. F., Kasprowski, P., & Obetkal, M. (2021) · Applied Sciences · doi:10.3390/app11199068 · Cited by 30 · see citing works
Gaze-based Intention Anticipation over Driving Manoeuvres in Semi-Autonomous Vehicles
Wu, M., Louw, T., Lahijanian, M., Ruan, W., Huang, X., Merat, N., & Kwiatkowska, M. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967779 · Cited by 29 · see citing works
Singh, J., & Modi, N. (2019) · Heliyon · doi:10.1016/j.heliyon.2019.e03033 · Cited by 29 · see citing works
Offset Calibration for Appearance-Based Gaze Estimation via Gaze Decomposition
Chen, Z., & Shi, B. E. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093419 · Cited by 29 · see citing works
Zhou, T., Wang, Y., Zhu, Q., & Du, J. (2022) · Automation in Construction · doi:10.1016/j.autcon.2022.104232 · Cited by 27 · see citing works
Effects of Integrated Intent Recognition and Communication on Human-Robot Collaboration
Chang, M. L., Gutierrez, R. A., Khante, P., Short, E. S., & Thomaz, A. L. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593359 · Cited by 27 · see citing works
A neural integrator model for planning and value-based decision making of a robotics assistant
Wojtak, W., Ferreira, F., Vicente, P., Louro, L., Bicho, E. G., & Erlhagen, W. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-05224-8 · Cited by 25 · see citing works
Human-Robot Interaction in a Shared Augmented Reality Workspace
Qiu, S., Liu, H., Zhang, Z., Zhu, Y., & Zhu, S. C. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9340781 · Cited by 28 · see citing works
Visual Search Target Inference in Natural Interaction Settings with Machine Learning
Barz, M., Stauden, S., & Sonntag, D. (2020) · ACM Symposium on Eye Tracking Research and Applications (ETRA) · doi:10.1145/3379155.3391314 · Cited by 24 · see citing works
Mahadevan, K., Sousa, M., Tang, A., & Grossman, T. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445355 · Cited by 23 · see citing works
Vargas, A. M., Cominelli, L., Dell’Orletta⋄, F., & Scilingo, E. P. (2021) · Frontiers in Computer Science · doi:10.3389/fcomp.2020.591164 · Cited by 23 · see citing works
Eye Gaze for Assistive Manipulation
Aronson, R. M., & Admoni, H. (2020) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3371382.3377434 · Cited by 21 · see citing works
Optimizing the Timing of Intelligent Suggestion in Virtual Reality
Yu, D., Desai, R., Zhang, T., Benko, H., Jonker, T. R., & Gupta, A. (2022) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3526113.3545632 · Cited by 22 · see citing works
IVO Robot: A New Social Robot for Human-Robot Collaboration
Laplaza, J., Rodríguez-Linares, N., Domínguez-Vidal, J. E., Herrero, F., Hernandez, S., Lopez, A., Sanfeliu, A., & Garrell, A. (2022) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri53351.2022.9889458 · Cited by 22 · see citing works
Fostering short-term human anticipatory behavior in human-robot collaboration
Psarakis, L., Nathanael, D., & Marmaras, N. (2021) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2021.103241 · Cited by 22 · see citing works
What is Proactive Human-Robot Interaction? - A Review of a Progressive Field and Its Definitions
broek, M. K. V. D., & Moeslund, T. B. (2024) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3650117 · Cited by 21 · see citing works
Learning Semantics of Gestural Instructions for Human-Robot Collaboration
Shukla, D., Erkent, Ö., & Piater, J. (2018) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2018.00007 · Cited by 21 · see citing works
Detecting errors in pick and place procedures
Bovo, R., Binetti, N., Brumby, D. P., & Julier, S. (2020) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3377325.3377497 · Cited by 21 · see citing works
ERA: Expert Retrieval and Assembly for Early Action Prediction
Foo, L. G., Li, T., Rahmani, H., Ke, Q., & Liu, J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19830-4_38 · Cited by 20 · see citing works
Multi-modal Intention Prediction with Probabilistic Movement Primitives
Dermy, O., Charpillet, F., & Ivaldi, S. (2018) · Springer proceedings in advanced robotics · doi:10.1007/978-3-319-89327-3_14 · Cited by 20 · see citing works
Spiking Neural Networks for early prediction in human–robot collaboration
Zhou, T., & Wachs, J. P. (2019) · The International Journal of Robotics Research · doi:10.1177/0278364919872252 · Cited by 20 · see citing works
Zhu, Z., Zhang, D., Chi, C., Li, M., & Lee, D.-J. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2022.3210219 · Cited by 19 · see citing works
Preliminary Work on a Virtual Reality Interface for the Guidance of Underwater Robots
de la Cruz, M., Casañ, G. A., Sanz, P. J., & Marín, R. (2020) · Robotics · doi:10.3390/robotics9040081 · Cited by 18 · see citing works
Balancing Efficiency and Comfort in Robot-Assisted Bite Transfer
Belkhale, S., Gordon, E. K., Chen, Y., Srinivasa, S. S., Bhattacharjee, T., & Sadigh, D. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9812332 · Cited by 17 · see citing works
Inferring Goals with Gaze during Teleoperated Manipulation
Aronson, R. M., Almutlak, N., & Admoni, H. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636551 · Cited by 17 · see citing works
Hierarchical Intention Tracking for Robust Human-Robot Collaboration in Industrial Assembly Tasks
Huang, Z., Mun, Y.-J., Li, X., Xie, Y., Zhong, N., Liang, W., Geng, J., Chen, T., & Driggs-Campbell, K. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160515 · Cited by 17 · see citing works
Scenario-Based Programming of Voice-Controlled Medical Robotic Systems
Rogowski, A. (2022) · Sensors · doi:10.3390/s22239520 · Cited by 17 · see citing works
Transfer Learning of Human Preferences for Proactive Robot Assistance in Assembly Tasks
Nemlekar, H., Dhanaraj, N., Guan, A., Gupta, S. K., & Nikolaidis, S. (2023) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3568162.3576965 · Cited by 17 · see citing works
Domínguez-Vidal, J. E., Rodríguez, N., & Sanfeliu, A. (2024) · International Journal of Social Robotics · doi:10.1007/s12369-024-01103-7 · Cited by 17 · see citing works
Cui, Y., Poon, J., Miró, J. V., Yamazaki, K., Sugimoto, K., & Matsubara, T. (2018) · Autonomous Robots · doi:10.1007/s10514-018-9798-2 · Cited by 17 · see citing works
Person-Specific Gaze Estimation from Low-Quality Webcam Images
Ansari, M. F., Kasprowski, P., & Peer, P. (2023) · Sensors · doi:10.3390/s23084138 · Cited by 16 · see citing works
Mondellini, M., Prajod, P., Nicora, M. L., Chiappini, M., Micheletti, E., Storm, F. A., Vertechy, R., André, E., & Malosio, M. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1245857 · Cited by 16 · see citing works
Physical symbol grounding and instance learning through demonstration and eye tracking
Penkov, S., Bordallo, A., & Ramamoorthy, S. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989697 · Cited by 16 · see citing works
Seeming autonomy, technology and the uncanny valley
Gahrn-Andersen, R. (2020) · AI & Society · doi:10.1007/s00146-020-01040-9 · Cited by 16 · see citing works
Gaze-Speech Coordination Influences the Persuasiveness of Human-Robot Dialog in the Wild
Fischer, K., Langedijk, R. M., Nissen, L. D., Ramírez, E. R., & Palinko, O. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-62056-1_14 · Cited by 16 · see citing works
Predicting short-term next-active-object through visual attention and hand position
Jiang, J., Nan, Z., Chen, H., Chen, S., & Zheng, N. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.12.069 · Cited by 15 · see citing works
Preemptive Motion Planning for Human-to-Robot Indirect Placement Handovers
Choi, A., Jawed, M. K., & Joo, J. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811558 · Cited by 15 · see citing works
Social Moments: A Perspective on Interaction for Social Robotics
Durantin, G., Heath, S., & Wiles, J. (2017) · Frontiers in Robotics and AI · doi:10.3389/frobt.2017.00024 · Cited by 15 · see citing works
Correia, F., Melo, F. S., & Paiva, A. (2022) · Topics in Cognitive Science · doi:10.1111/tops.12634 · Cited by 17 · see citing works
Visual Search Target Inference Using Bag of Deep Visual Words
Stauden, S., Barz, M., & Sonntag, D. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00111-7_25 · Cited by 14 · see citing works
Invoking Principles of Groupware to Develop and Evaluate Present and Future Human-Agent Teams
Flathmann, C., Schelble, B. G., Tubre, B., McNeese, N. J., & Rodeghero, P. (2020) · International Conference on Human-Agent Interaction (HAI) · doi:10.1145/3406499.3415072 · Cited by 14 · see citing works
Human Movement Direction Classification using Virtual Reality and Eye Tracking
Pettersson, J., & Falkman, P. (2020) · Procedia Manufacturing · doi:10.1016/j.promfg.2020.10.015 · Cited by 14 · see citing works
Gaze-based Attention Recognition for Human-Robot Collaboration
Prajod, P., Nicora, M. L., Malosio, M., & André, E. (2023) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/3594806.3594819 · Cited by 14 · see citing works
Pettersson, J., & Falkman, P. (2023) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2023.1157957 · Cited by 13 · see citing works
Turn-Taking Prediction for Human–Robot Collaborative Assembly Considering Human Uncertainty
Xu, W., Feng, S., Yao, B., Ji, Z., & Liu, Z. (2023) · Journal of Manufacturing Science and Engineering · doi:10.1115/1.4063231 · Cited by 13 · see citing works
Rogowski, A., Bieliszczuk, K., & Rapcewicz, J. (2020) · Sensors · doi:10.3390/s20247287 · Cited by 13 · see citing works
Stargazer: An Interactive Camera Robot for Capturing How-To Videos Based on Subtle Instructor Cues
Li, J., Sousa, M., Mahadevan, K., Wang, B. K., Aoyagui, P. A., Yu, N., Yang, A., Balakrishnan, R., Tang, A., & Grossman, T. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580896 · Cited by 13 · see citing works
Unsupervised Outlier Detection in Appearance-Based Gaze Estimation
Chen, Z., Deng, D., Pi, J., & Shi, B. E. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00139 · Cited by 13 · see citing works
Two-Stage Clustering of Human Preferences for Action Prediction in Assembly Tasks
Nemlekar, H., Modi, J., Gupta, S. K., & Nikolaidis, S. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561649 · Cited by 14 · see citing works
- Authors
- Huang, C.-M., & Mutlu, B.
- Affiliations
- Yale University (US)
- University of Wisconsin–Madison (US)
- Venue
- 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI)
- Publisher
- IEEE
- Published
- 2016-03
- Pages
- 83-90
- OpenAlex
- W4229726131
- Cited by
- 227
- References
- 31
- Citations by year
- 2026: 17 · 2025: 28 · 2024: 31 · 2023: 27 · 2022: 28 · 2021: 21 · 2020: 24 · 2019: 22 · 2018: 20 · 2017: 8 · 2016: 1
- FWCI
- 28.71
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM/IEEE International Conference on Human-Robot Interaction (HRI) (publishedVersion)
- Funders
- National Science Foundation
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- anticipatory control, human-robot collaboration, gaze prediction, human-robot interaction, task completion time
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review