Using human knowledge awareness to adapt collaborative plan generation, explanation and monitoring
The DOI matches its Crossref record; 25 of the 28 references it cites were found in a registry or an index.
Abstract
One application of robotics is to assist humans in the achievement of tasks they face in both the workplace and domestic environments. In some situations, a task may require the robot and the human to act together in a collaborative way in order to reach a common goal. To achieve a collaborative plan, each agent (human, robot) needs to be aware of the tasks she/he must carry out and how to perform them. This paper addresses the issue of enhancing a robotic system with a dynamic model of its collaborator's knowledge concerning tasks of a shared plan. Using this model, the robot is able to adapt its collaborative plan generation, its abilities to give explanations and to monitor the overall plan execution. We present the algorithm we have elaborated to take advantage of the tree representation of our Hierarchical Task Network (HTN) planner to enhance the robot with appropriate explanation and execution monitoring abilities. To evaluate how our adaptive system is perceived by users and how much it improves the quality of the Human-Robot interaction, the outcome of a comparative study is presented.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Previous research explained this result when they showed that the explanation interface's complexity varies between humans and affects willingness to interact with the explanation [12, 50, 59].”
From Explainable recommendation: when design meets trust calibration (2021) · cites this paper as [50]
Citations
Cites
Does the chimpanzee have a theory of mind?
Premack, D., & Woodruff, G. (1978) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00076512 · Cited by 8,743
Does the autistic child have a “theory of mind” ?
Baron-Cohen, S., Leslie, A. M., & Frith, U. (1985) · Cognition · doi:10.1016/0010-0277(85)90022-8 · Cited by 8,599 · cited 1×
“An ability linked to this concept is perspective taking, which is widely studied in developmental literature [11], [12].”
BackgroundUnderstanding and sharing intentions: The origins of cultural cognition
Tomasello, M., Carpenter, M., Call, J., Behne, T., & Moll, H. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05000129 · Cited by 4,882
Joint action: bodies and minds moving together
SEBANZ, N., BEKKERING, H., & KNOBLICH, G. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.12.009 · Cited by 1,950
Helping and Cooperation at 14 Months of Age
Warneken, F., & Tomasello, M. (2007) · Infancy · doi:10.1111/j.1532-7078.2007.tb00227.x · Cited by 829
Cooperative Activities in Young Children and Chimpanzees
Warneken, F., Chen, F., & Tomasello, M. (2006) · Child Development · doi:10.1111/j.1467-8624.2006.00895.x · Cited by 559
Improved human-robot team performance using chaski, a human-inspired plan execution system
Shah, J., Wiken, J., Williams, B., & Breazeal, C. (2011) · Proceedings of the 6th international conference on Human-robot interaction · doi:10.1145/1957656.1957668 · Cited by 218
Using perspective taking to learn from ambiguous demonstrations
Breazeal, C., Berlin, M., Brooks, A., Gray, J., & Thomaz, A. L. (2006) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2006.02.004 · Cited by 118
User Modeling in a Distributed E-Learning Architecture
Brusilovsky, P. L., Александрович, С. С., & Shcherbinina, O. (2005) · Lecture notes in computer science · doi:10.1007/11527886_50 · Cited by 93
How Robot Verbal Feedback Can Improve Team Performance in Human-Robot Task Collaborations
Clair, A. S., & Matarić, M. J. (2015) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/2696454.2696491 · Cited by 90
Research works printed but not linked: 2
- 10.1023/a:1010091730257 · doi:10.1023/a:1010091730257
- brusilovskiy, 1994, The construction and application of student models in intelligent tutoring systems, Journal of Computer and Systems Sciences International, 32, 70
Cited by
Cobot programming for collaborative industrial tasks: An overview
El Zaatari, S., Marei, M., Li, W., & Usman, Z. (2019) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2019.03.003 · Cited by 470
Hentout, A., Aouache, M., Maoudj, A., & Akli, I. (2019) · Advanced Robotics · doi:10.1080/01691864.2019.1636714 · Cited by 462
Artificial cognition for social human–robot interaction: An implementation
Lemaignan, S., Warnier, M., Sisbot, E. A., Clodic, A., & Alami, R. (2017) · Artificial Intelligence · doi:10.1016/j.artint.2016.07.002 · Cited by 395
Self-citationAn implemented theory of mind to improve human-robot shared plans execution
Devin, S., & Alami, R. (2016) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2016.7451768 · Cited by 206
Self-citationAn Implemented Theory of Mind to Improve Human-Robot Shared Plans Execution
Devin, S., & Alami, R. (2016) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.5555/2906831.2906886 · Cited by 83
Self-citationExplainable recommendation: when design meets trust calibration
Naiseh, M., Al-Thani, D., Jiang, N., & Ali, R. (2021) · World Wide Web · doi:10.1007/s11280-021-00916-0 · Cited by 68
“Previous research explained this result when they showed that the explanation interface’s complexity varies between humans and affects willingness to interact with the explanation [12, 50, 59].”
BackgroundGörür, O. C., Rosman, B., Sivrikaya, F., & Albayrak, Ş. (2018) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3171221.3171256 · Cited by 66
Kaptein, F., Broekens, J., Hindriks, K., & Neerincx, M. (2017) · 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) · doi:10.1109/roman.2017.8172376 · Cited by 53
Schulz, R., Kratzer, P., & Toussaint, M. (2018) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2018.00036 · Cited by 51
Mahieu, C., Ongenae, F., Backere, F. D., Bonte, P., Turck, F. D., & Simoens, P. (2018) · Journal of Systems and Software · doi:10.1016/j.jss.2018.11.022 · Cited by 48
Building the Foundation of Robot Explanation Generation Using Behavior Trees
Zhao, H., Giger, D., Allspaw, J., Lee, M. S., Admoni, H., & Yanco, H. A. (2021) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3457185 · Cited by 48
Optimal Task and Motion Planning and Execution for Multiagent Systems in Dynamic Environments
Faroni, M., Umbrico, A., Beschi, M., Orlandini, A., Cesta, A., & Pedrocchi, N. (2023) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2023.3263380 · Cited by 47
Why bad coffee? Explaining BDI agent behaviour with valuings
Winikoff, M., Sidorenko, G., Dignum, V., & Dignum, F. P. M. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103554 · Cited by 47
Configuring Humans: What Roles Humans Play in HRI Research
Lee, H. R., Cheon, E., Lim, C., & Fischer, K. (2022) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri53351.2022.9889496 · Cited by 47
Izquierdo-Badiola, S., Canal, G., Rizzo, C., & Alenyà, G. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610055 · Cited by 46
Personalising Explainable Recommendations: Literature and Conceptualisation
Naiseh, M., Jiang, N., Ma, J., & Ali, R. (2020) · Advances in Intelligent Systems and Computing · doi:10.1007/978-3-030-45691-7_49 · Cited by 42
“Milliez et al. [38] develop an algorithm based on this idea to update the users’ knowledge model so that the system can adapt the explanation to this level of knowledge.”
BackgroundShort-Term Human-Robot Interaction through Conditional Planning and Execution
Sanelli, V., Cashmore, M., Magazzeni, D., & Iocchi, L. (2017) · Proceedings of the International Conference on Automated Planning and Scheduling · doi:10.1609/icaps.v27i1.13864 · Cited by 41
Ramachandruni, K., Kent, D., & Chernova, S. (2024) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3623387 · Cited by 34
A Framework for Service Robots in Smart Home: An Efficient Solution for Domestic Healthcare
Ramoly, N., Bouzeghoub, A., & Finance, B. (2018) · IRBM · doi:10.1016/j.irbm.2018.10.010 · Cited by 34
About Decisions During Human-Robot Shared Plan Achievement: Who Should Act and How?
Devin, S., Clodic, A., & Alami, R. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-70022-9_45 · Cited by 32
Self-citationExpect the Unexpected: Leveraging the Human-Robot Ecosystem to Handle Unexpected Robot Failures
Honig, S., & Oron-Gilad, T. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.656385 · Cited by 26
Görür, O. C., Rosman, B., Sivrikaya, F., & Albayrak, Ş. (2023) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3585276 · Cited by 25
See What I See: Enabling User-Centric Robotic Assistance Using First-Person Demonstrations
Wang, Y., Ajaykumar, G., & Huang, C. (2020) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3319502.3374820 · Cited by 25
Integrated task sequence planning and assignment for human–robot collaborative assembly station
Wang, Y., Wang, J., Feng, J., Liu, J., & Liu, X. (2022) · Flexible Services and Manufacturing Journal · doi:10.1007/s10696-022-09479-2 · Cited by 24
HATP/EHDA: A Robot Task Planner Anticipating and Eliciting Human Decisions and Actions
Buisan, G., Favier, A., Mayima, A., & Alami, R. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9812227 · Cited by 23
Self-citationExploiting a Human-Aware World Model for Dynamic Task Allocation in Flexible Human-Robot Teams
Riedelbauch, D., & Henrich, D. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794288 · Cited by 23
Improved Task Planning through Failure Anticipation in Human-Robot Collaboration
Izquierdo-Badiola, S., Canal, G., Rizzo, C., & Alenyà, G. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9812236 · Cited by 22
Robots for Social Justice (R4SJ): Toward a More Equitable Practice of Human-Robot Interaction
Zhu, Y., Wen, R., & Williams, T. (2024) · Proceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/3610977.3634944 · Cited by 19
Temporal Anticipation and Adaptation Methods for Fluent Human-Robot Teaming
Iqbal, T., & Riek, L. D. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561763 · Cited by 19
Dealing with On-Line Human-Robot Negotiations in Hierarchical Agent-based Task Planner
Sebastiani, E., Lallement, R., Alami, R., & Iocchi, L. (2017) · Proceedings of the International Conference on Automated Planning and Scheduling · doi:10.1609/icaps.v27i1.13862 · Cited by 18
Self-citationHelping People Through Space and Time: Assistance as a Perspective on Human-Robot Interaction
Newman, B. A., Aronson, R. M., Kitani, K., & Admoni, H. (2022) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.720319 · Cited by 17
A Human-Aware Task Planner Explicitly Reasoning About Human and Robot Decision, Action and Reaction
Buisan, G., & Alami, R. (2021) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3434074.3447231 · Cited by 15
Self-citationCoordinating flexible human-robot teams by local world state observation
Riedelbauch, D., & Henrich, D. (2017) · IEEE RO-MAN · doi:10.1109/roman.2017.8172425 · Cited by 14
Learning Action Duration and Synergy in Task Planning for Human-Robot Collaboration
Sandrini, S., Faroni, M., & Pedrocchi, N. (2022) · IEEE International Conference on Emerging Technologies and Factory Automation (ETFA) · doi:10.1109/etfa52439.2022.9921721 · Cited by 14
Explaining the Behavior of Remote Robots to Humans : An Agent-based Approach
Mualla, Y. (2020) · theses.fr (ABES) · doi:10.70675/387da533zcca9z4ec0zaeb2z4257ce794921 · Cited by 13
Adapting Cobot Behavior to Human Task Ordering Variability for Assembly Tasks
HMEDAN, B., Kilgus, D., Fiorino, H., Landry, A., & Pellier, D. (2022) · Proceedings of the ... International Florida Artificial Intelligence Research Society Conference · doi:10.32473/flairs.v35i.130645 · Cited by 12
Explainability in Self-Adaptive Systems: A Systematic Literature Review
Straub, R., Sihler, F., Torbati, A., Wang, C., Groner, R., Klös, V., & Tichy, M. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04200-2_19 · Cited by 10
Gottardi, A., Terreran, M., Pagello, E., & Menegatti, E. (2025) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2025.105318 · Cited by 10
Rohlfing, K. J., Främling, K., Lim, B., Alpsancar, S., & Thommes, K. (2026) · Springer eBooks · doi:10.1007/978-981-96-5290-7 · Cited by 10
Spline-based trajectory generation to estimate execution time in a robotic assembly cell
Saeed, M., Demasure, T., Hoedt, S., Aghezzaf, E., & Cottyn, J. (2022) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-022-09792-y · Cited by 10
Jácome, W. F. V., Gironza, M., Ordóñez, A., & Rendón, O. M. C. (2018) · IEEE Access · doi:10.1109/access.2018.2852649 · Cited by 9
Hautala, J. (2021) · Humanities and Social Sciences Communications · doi:10.1057/s41599-021-00893-9 · Cited by 8
Some essential skills and their combination in an architecture for a cognitive and interactive robotPreprint
Devin, S., Milliez, G., Fiore, M., Clodic, A., & Alami, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.00583 · Cited by 8
Self-citationUsing Theory of Mind in Explanations for Fostering Transparency in Human-Robot Interaction
Angelopoulos, G., Imparato, P., Rossi, A., & Rossi, S. (2023) · Lecture notes in computer science · doi:10.1007/978-981-99-8718-4_34 · Cited by 7
Robot Planning with Mental Models of Co-present Humans
Buckingham, D., Chita-Tegmark, M., & Scheutz, M. J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-62056-1_47 · Cited by 7
Robust Planning for Human-Robot Joint Tasks with Explicit Reasoning on Human Mental StatePreprint
Favier, A., Shekhar, S., & Alami, R. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.08879 · Cited by 6
Self-citationSarthou, G., Buisan, G., Clodic, A., & Alami, R. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636796 · Cited by 5
Self-citationNegotiating with robots : meshing plans and resolving conflicts in human-robot collaboration
Moon, A. (2017) · cIRcle (University of British Columbia) · doi:10.14288/1.0348225 · Cited by 5
A Theoretical Foundation for Erroneous Behavior in Human–Robot Interaction
Djogdom, G. V. T., Otis, M. J.-D., & Meziane, R. (2025) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-025-02221-8 · Cited by 4
SDN management based on Hierarchical Task Network and Network Functions Virtualization
Gironza, M., Jácome, W. F. V., Ordóñez, A., Estrada‐Solano, F., & Rendón, O. M. C. (2017) · IEEE Symposium on Computers and Communications (ISCC) · doi:10.1109/iscc.2017.8024713 · Cited by 4
Gradmann, M., Henrich, D., Orendt, E. M., Riedelbauch, D., Riedl, M., Spangenberg, M., & Werner, T. (2019) · Carl Hanser Verlag GmbH & Co. KG eBooks · doi:10.1007/978-3-446-45376-0_5 · Cited by 4
Symbolic and Geometric Planning for teams of Robots and Humans
Lallement, R. (2016) · theses.fr (ABES) · doi:10.70675/3be32a5cz9a53z4121zb344za987efbc14f6 · Cited by 4
Self-citationIntegrated COBOT, Human, and Manufacturing Task Kinematic Chain
Bi, Y., Rickli, J. L., & Djuric, A. (2021) · Lecture notes in mechanical engineering · doi:10.1007/978-3-030-90700-6_28 · Cited by 3
System model of an intelligent domain-oriented profiling system
Antonov, V. V., Kharisova, Z. I., Мансурова, З. Р., Rodionova, L. E., Kalimullin, N. R., Kulikov, G. G., & CJSC Ufa Scientific and Production Enterprise «Molniya», U. (2020) · Ontology of Designing · doi:10.18287/2223-9537-2020-10-3-338-350 · Cited by 3
Enabling Domain Experts to Model and Execute Tasks in Flexible Human-Robot Teams
Riedelbauch, D., Werner, T., & Henrich, A. D. (2017) · Springer eBooks · doi:10.1007/978-3-662-54441-9_2 · Cited by 3
Izquierdo-Badiola, S., Alenyà, G., & Rizzo, C. (2023) · IEEE RO-MAN · doi:10.1109/ro-man57019.2023.10309411 · Cited by 2
LEAF: Using Semantic Based Experience to Prevent Task Failures
Ramoly, N., Sfar, H., Bouzeghoub, A., & Finance, B. (2017) · Springer proceedings in advanced robotics · doi:10.1007/978-3-319-67361-5_44 · Cited by 2
Knowledge representation and exploitation for interactive and cognitive robots
Sarthou, G. (2021) · theses.fr (ABES) · doi:10.70675/624ce40cz548az4e5fzb844zae88b9e3e8e4 · Cited by 2
Mayima, A. (2021) · theses.fr (ABES) · doi:10.70675/b5ce9698z4bccz4401zac80z6c999ad58ed8 · Cited by 2
Explaining Robot Behaviour: Beliefs, Desires, and Emotions in Explanations of Robot Action
Kaptein, F. (2020) · Research Repository (Delft University of Technology) · doi:10.4233/uuid:1d92d61c-c124-4e7b-903e-bce246410bba · Cited by 1
Raisonnement sur le contexte et les croyances pour l'interaction homme-robot
Milliez, G. (2016) · theses.fr (ABES) · doi:10.70675/448809ddz9f2ez43f5z8cd6zb276f41a2245 · Cited by 1
Self-citationDecisional issues during human-robot joint action
Devin, S. (2017) · theses.fr (ABES) · doi:10.70675/51aee437za912z4e6aza91fz341b5bf21ac7 · Cited by 1
Ramoly, N. (2018) · theses.fr (ABES) · doi:10.70675/2baadeacza680z4483zb08dz6e47e64029be · Cited by 1
Gradmann, M., Henrich, D., Orendt, E. M., Riedelbauch, D., Riedl, M., Spangenberg, M., & Werner, T. (2024) · Carl Hanser Verlag GmbH & Co. KG eBooks · doi:10.1007/978-3-446-47460-4_5
Hierarchical Task Planning for Human-Robot Collaborative Assembly
Pegoraro, G., Giacomuzzo, G., Terreran, M., Ghidoni, S., Carli, R., & Romeres, D. (2025) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2025.12.022
Tchane Djogdom, G. V. (2024) · Constellation (Université du Québec à Chicoutimi)
Exploring the effect of the information amount in explanation on different gaming expertise levels
Zhou, J. (. (2023) · Research Repository (Delft University of Technology)
Izquierdo-Badiola, S., Rizzo, C., & Alenyà, G. (2022) · RECERCAT (Consorci de Serveis Universitaris de Catalunya)
Task and Motion Planning For Human-Robot Collaboration in a Dynamic Industrial Scenario
Gottardi, A. (n.d.) · Padua Research Archive (University of Padova)
Managing the sXAI Interaction: Beliefs, Goals, and Decisional Processes
Alami, R., & Wrede, B. (2026) · Springer eBooks · doi:10.1007/978-981-96-5290-7_11
Self-citationDecision Making in Human-Robot Interaction
Fiore, M. (2016) · theses.fr (ABES) · doi:10.70675/4e25b1fez7999z4895za5dazb6a00e449f23
Self-citationCollaborative Robot Technologies for Industrial Tasks
Li, W., Zaatari, S. E., Marei, M., Usman, Z., & Pham, D. T. (2026) · Springer series in advanced manufacturing · doi:10.1007/978-3-032-20817-0_2
Roy, S., Peretz, I., Sayfeld, L., & Edan, Y. (2026) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2026.1222566
Metadata
- Authors
- Milliez, G., Lallement, R., Fiore, M., & Alami, R.
- Affiliations
- Centre National de la Recherche Scientifique (FR)
- ORCID
- Alami, Rachid
- Venue
- 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI)
- Publisher
- IEEE
- Published
- 2016-03
- Pages
- 43-50
- OpenAlex
- W2321193439
- Cited by
- 60
- References
- 28
- Citations by year
- 2026: 3 · 2025: 2 · 2024: 3 · 2023: 3 · 2022: 8 · 2021: 11 · 2020: 5 · 2019: 4 · 2018: 6 · 2017: 9 · 2016: 6
- FWCI
- 4.49
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM/IEEE International Conference on Human-Robot Interaction (HRI) (publishedVersion)
- HAL (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Keywords
- human-robot collaboration, collaborative planning, knowledge awareness, hierarchical task networks, plan execution monitoring, adaptive planning, tree representation, human-robot interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.