Ten challenges for making automation a ‘team player’ in joint human-agent activity
Abstract
We propose 10 challenges for making automation components into effective "team players" when they interact with people in significant ways. Our analysis is based on some of the principles of human-centered computing that we have developed individually and jointly over the years, and is adapted from a more comprehensive examination of common ground and coordination.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
For the foreseeable future, AI systems will have fundamentally different cognitive qualities and abilities than biological systems.
“For the time being, AI systems will have fundamentally different cognitive qualities and abilities than biological systems.”
From Human- versus Artificial Intelligence (2021) · cites this paper as Klein et al., 2004
Cites
Clark, H. H. (1996) · doi:10.1017/cbo9780511620539 · Cited by 5,123 · see citing works
Clark, H. H., & Brennan, S. E. (1991) · Perspectives on socially shared cognition. · doi:10.1037/10096-006 · Cited by 4,555 · see citing works
Using language: Communicative acts
Clark, H. H. (1996) · Cited by 2,709 · see citing works
Using language: Index of names
Clark, H. H. (1996) · Cited by 2,708 · see citing works
Aviation Automation: The Search for A Human-centered Approach
Billings, C. E. (1996) · Medical Entomology and Zoology · Cited by 850 · see citing works
The ‘problem ’ with automation: inappropriate feedback and interaction, not ‘over-automation’
Norman, D. A. (1990) · Philosophical transactions of the Royal Society of London. Series B, Biological sciences · doi:10.1098/rstb.1990.0101 · Cited by 519 · see citing works
Cohen, P. R., & Levesque, H. J. (1991) · Noûs · doi:10.2307/2216075 · Cited by 360 · see citing works
1. How to make automated systems team players
Christoffersen, K., & Woods, D. D. (2002) · Advances in human performance and cognitive engineering research · doi:10.1016/s1479-3601(02)02003-9 · Cited by 352 · see citing works
Common Ground and Coordination in Joint Activity
Klein, G. L., Feltovich, P. J., Bradshaw, J. M., & Woods, D. D. (2005) · doi:10.1002/0471739448.ch6 · Cited by 340 · see citing works
Dimensions of Adjustable Autonomy and Mixed-Initiative Interaction
Bradshaw, J. M., Feltovich, P. J., Jung, H., Kulkarni, S., Taysom, W., & Uszok, A. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-25928-2_3 · Cited by 118 · see citing works
Learning From Automation Surprises and “Going Sour” Accidents
Sarter, N. B. (2000) · doi:10.1201/b12462-19 · Cited by 91 · see citing works
Team Play with a Powerful and Independent Agent: A Full-Mission Simulation Study
Sarter, N. B., & Woods, D. D. (2000) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872000779698178 · Cited by 88 · see citing works
(2003) · Multiagent systems, artificial societies, and simulated organizations · doi:10.1007/978-1-4419-9198-0 · Cited by 80 · see citing works
Not Now! Supporting Interruption Management by Indicating the Modality and Urgency of Pending Tasks
Ho, C., Nikolic, M. I., Waters, M. J., & Sarter, N. B. (2004) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.3.399.50397 · Cited by 73 · see citing works
Making Agents Acceptable to People
Bradshaw, J. M. (2007) · Springer eBooks · doi:10.1007/3-540-45023-8_1 · Cited by 65 · see citing works
Human-Machine Collaborative Planning
Allen, J. F., & Ferguson, G. (2002) · Cited by 60 · see citing works
Teamwork in Cyberspace: Using TEAMCORE to Make Agents Team-Ready
Tambe, M., Shen, W., Matarić, M. J., Pynadath, D. V., Goldberg, D., Modi, P. J., Qiu, Z., & Salemi, B. (1999) · Cited by 44 · see citing works
Woods, D. D. (2002) · eScholarship (California Digital Library) · Cited by 38 · see citing works
Woods, D. D. (2019) · Routledge eBooks · doi:10.4324/9781315782379-10 · Cited by 30 · see citing works
Making Agents Acceptable to People
Bradshaw, J. M., Beautement, P., Breedy, M. R., Bunch, L., Drakunov, S., Feltovich, P. J., Hoffman, R. R., Jeffers, R., Johnson, M., Kulkarni, S., et al. (2004) · Springer eBooks · doi:10.1007/978-3-662-07952-2_16 · Cited by 28 · see citing works
Feltovich, P. J., Bradshaw, J. M., Jeffers, R., Suri, N., & Uszok, A. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-25946-6_2 · Cited by 22 · see citing works
Teamwork-centered autonomy for extended human-agent interaction in space applications
Bradshaw, J. M., Acquisti, A., Allen, J. F., Breedy, M. R., Bunch, L., Chambers, N., Galescu, L., Goodrich, M. A., Jeffers, R., Johnson, M., et al. (2014) · Cited by 19 · see citing works
Flagged first, then by citations
3 of the 25 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthy
Shneiderman, B. (2020) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1741118 · Cited by 1,743 · see citing works
From Here to Autonomy: Lessons Learned From Human–Automation Research
Endsley, M. R. (2017) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816681350 · Cited by 898 · see citing works
Human- versus Artificial Intelligence
Korteling, J. E. (., van de Boer-Visschedijk, G. C., Blankendaal, R. A. M., Boonekamp, R. C., & Eikelboom, A. R. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.622364 · Cited by 619 · see citing works
“As digital machines they are equipped with a completely different operating system (digital vs biological) and with correspondingly different cognitive qualities and abilities than biological creatures, like humans and other animals (Moravec, 1988; Klein et al., 2004; Korteling et al., 2018a; Shneiderman, 2020a).”
BackgroundFundamentals of physiological computing
Fairclough, S. H. (2009) · Interacting with Computers · doi:10.1016/j.intcom.2008.10.011 · Cited by 608 · see citing works
Similarities and differences between human–human and human–automation trust: an integrative review
Madhavan, P., & Wiegmann, D. A. (2007) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220500337708 · Cited by 577 · see citing works
(2013) · doi:10.1109/hri.2013.6483603 · Cited by 595 · see citing works
Sheridan, T. B., & Parasuraman, R. (2005) · Reviews of Human Factors and Ergonomics · doi:10.1518/155723405783703082 · Cited by 479 · see citing works
Human-Centered Artificial Intelligence: Three Fresh Ideas
Shneiderman, B. (2020) · AIS Transactions on Human-Computer Interaction · doi:10.17705/1thci.00131 · Cited by 430 · see citing works
From ‘automation’ to ‘autonomy’: the importance of trust repair in human–machine interaction
de Visser, E. J., Pak, R., & Shaw, T. H. (2018) · Ergonomics · doi:10.1080/00140139.2018.1457725 · Cited by 416 · see citing works
Artificial cognition for social human–robot interaction: An implementation
Lemaignan, S., Warnier, M., Sisbot, E. A., Clodic, A., & Alami, R. (2016) · Artificial Intelligence · doi:10.1016/j.artint.2016.07.002 · Cited by 394 · see citing works
Xu, W., Dainoff, M. J., Ge, L., & Gao, Z. (2023) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2022.2041900 · Cited by 363 · see citing works
Legibility and predictability of robot motion
Dragan, A. D., Lee, K. C. T., & Srinivasa, S. S. (2013) · doi:10.5555/2447556.2447672 · Cited by 346 · see citing works
Coactive Design: Designing Support for Interdependence in Joint Activity
Johnson, M., Bradshaw, J. M., Feltovich, P. J., Jonker, C. M., van Riemsdijk, M. B., & Sierhuis, M. (2014) · Journal of Human-Robot Interaction · doi:10.5898/jhri.3.1.johnson · Cited by 316 · see citing works
Supporting Human-AI Teams:Transparency, explainability, and situation awareness
Endsley, M. R. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107574 · Cited by 332 · see citing works
Trusting Automation: Designing for Responsivity and Resilience
Chiou, E. K., & Lee, J. D. (2023) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208211009995 · Cited by 301 · see citing works
Communicating Intent of Automated Vehicles to Pedestrians
Habibovic, A., Lundgren, V. M., Andersson, J., Klingegård, M., Lagström, T., Sirkka, A., Fagerlönn, J., Edgren, C., Fredriksson, R., Krupenia, S. S., et al. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.01336 · Cited by 299 · see citing works
How can humans understand their automated cars? HMI principles, problems and solutions
Carsten, O., & Martens, M. H. (2019) · Cognition, Technology & Work · doi:10.1007/s10111-018-0484-0 · Cited by 284 · see citing works
The Seven Deadly Myths of "Autonomous Systems"
Bradshaw, J. M., Hoffman, R. R., Johnson, M., & Woods, D. D. (2013) · IEEE Intelligent Systems · doi:10.1109/mis.2013.70 · Cited by 218 · see citing works
Supervisory Control of Multiple Robots: Human-Performance Issues and User-Interface Design
Chen, J. Y. C., Barnes, M., & Harper-Sciarini, M. (2011) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2010.2056682 · Cited by 246 · see citing works
Xing, Y., Lv, C., Cao, D., & Hang, P. (2021) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2021.103199 · Cited by 215 · see citing works
Jonker, C. M., van Riemsdijk, M. B., & Vermeulen, B. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21268-0_8 · Cited by 210 · see citing works
Vorm, E. S., & Combs, D. J. Y. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2070107 · Cited by 211 · see citing works
Abbass, H. A. (2019) · Cognitive Computation · doi:10.1007/s12559-018-9619-0 · Cited by 200 · see citing works
Naturalistic Decision Making and Macrocognition
Maarten, S. J., Militello, L. G., Ormerod, T., & Lipshitz, R. (2017) · CRC Press eBooks · doi:10.1201/9781315597584 · Cited by 187 · see citing works
Madhavan, P., & Wiegmann, D. A. (2007) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872007x230154 · Cited by 176 · see citing works
Fiore, S. M., Wiltshire, T. J., Lobato, E. J. C., Jentsch, F. G., Huang, W. H., & Axelrod, B. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00859 · Cited by 172 · see citing works
Team situation awareness within the context of human-autonomy teaming
Demir, M., McNeese, N. J., & Cooke, N. J. (2016) · Cognitive Systems Research · doi:10.1016/j.cogsys.2016.11.003 · Cited by 142 · see citing works
No AI Is an Island: The Case for Teaming Intelligence
Johnson, M., & Vera, A. H. (2019) · AI Magazine · doi:10.1609/aimag.v40i1.2842 · Cited by 138 · see citing works
Holden, R. J. (2010) · Cognition Technology & Work · doi:10.1007/s10111-010-0141-8 · Cited by 134 · see citing works
Synthesizing Robot Motions Adapted to Human Presence
Sisbot, E. A., Marin-Urias, L. F., Broquère, X., Sidobre, D., & Alami, R. (2010) · International Journal of Social Robotics · doi:10.1007/s12369-010-0059-6 · Cited by 131 · see citing works
Adaptive skill as the Conditio sine qua non of expertise.
Ward, P., Gore, J., Hutton, R. J. B., Conway, G. E., & Hoffman, R. R. (2018) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2018.01.009 · Cited by 129 · see citing works
Walch, M., Mühl, K., Kraus, J., Stoll, T., Baumann, M. R. K., & Weber, M. (2017) · Human-computer interaction series · doi:10.1007/978-3-319-49448-7_10 · Cited by 123 · see citing works
Dragan, A. D., & Srinivasa, S. S. (2013) · Robotics: Science and Systems · doi:10.15607/rss.2013.ix.024 · Cited by 117 · see citing works
Review of a Pivotal Human Factors Article: “Humans and Automation: Use, Misuse, Disuse, Abuse”
Lee, J. D. (2008) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x288547 · Cited by 116 · see citing works
Why Do I Have to Drive Now? Post Hoc Explanations of Takeover Requests
Körber, M., Prasch, L., & Bengler, K. J. (2017) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720817747730 · Cited by 113 · see citing works
Design Lessons From AI’s Two Grand Goals: Human Emulation and Useful Applications
Shneiderman, B. (2020) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2020.2992669 · Cited by 119 · see citing works
Trust and Team Performance in Human–Autonomy Teaming
McNeese, N. J., Demir, M., Chiou, E. K., & Cooke, N. J. (2021) · International Journal of Electronic Commerce · doi:10.1080/10864415.2021.1846854 · Cited by 116 · see citing works
Adapt and overcome: Perceptions of adaptive autonomous agents for human-AI teaming
Hauptman, A. I., Schelble, B. G., McNeese, N. J., & Madathil, K. C. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107451 · Cited by 110 · see citing works
Team Structure and Team Building Improve Human–Machine Teaming With Autonomous Agents
Walliser, J. C., de Visser, E., Wiese, E., & Shaw, T. H. (2019) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/1555343419867563 · Cited by 105 · see citing works
Who/What Is My Teammate? Team Composition Considerations in Human–AI Teaming
McNeese, N. J., Schelble, B. G., Canonico, L. B., & Demir, M. (2021) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2021.3086018 · Cited by 106 · see citing works
Flumeri, G. D., Crescenzio, F. D., Berberian, B., Ohneiser, O., Kramer, J., Aricò, P., Borghini, G., Babiloni, F., Bagassi, S., & Piastra, S. (2019) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2019.00296 · Cited by 101 · see citing works
Experience in System Design for Human-Robot Teaming in Urban Search and Rescue
Kruijff, G.-J., Janíček, M., Keshavdas, S., Larochelle, B., Zender, H., Smets, N. J. J. M., Mioch, T., Neerincx, M. A., van Diggelen, J., Colas, F., et al. (2013) · Springer tracts in advanced robotics · doi:10.1007/978-3-642-40686-7_8 · Cited by 101 · see citing works
Team Coordination and Effectiveness in Human-Autonomy Teaming
Demir, M., Likens, A. D., Cooke, N. J., Amazeen, P. G., & McNeese, N. J. (2018) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2018.2877482 · Cited by 95 · see citing works
Lin, W. L. (2023) · Corporate Social Responsibility and Environmental Management · doi:10.1002/csr.2640 · Cited by 95 · see citing works
Dragan, A. D., & Srinivasa, S. S. (2018) · doi:10.1184/r1/6554969.v1 · Cited by 97 · see citing works
Hoffman, R. R., & Hancock, P. A. (2017) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816686248 · Cited by 93 · see citing works
Using Perceptual and Cognitive Explanations for Enhanced Human-Agent Team Performance
Neerincx, M. A., van der Waa, J., Kaptein, F., & van Diggelen, J. (2018) · Interacción · doi:10.1007/978-3-319-91122-9_18 · Cited by 88 · see citing works
The Fundamental Principle of Coactive Design: Interdependence Must Shape Autonomy
Johnson, M., Bradshaw, J. M., Feltovich, P. J., Jonker, C. M., van Riemsdijk, M. B., & Sierhuis, M. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21268-0_10 · Cited by 89 · see citing works
Function Allocation Considerations in the Era of Human Autonomy Teaming
Roth, E. M., Sushereba, C., Militello, L. G., Diiulio, J., & Ernst, K. M. (2019) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/1555343419878038 · Cited by 89 · see citing works
Interactive, Evolutionary Search in Upstream Object-Oriented Class Design
Simons, C. L., Parmee, I. C., & Gwynllyw, R. (2010) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2010.34 · Cited by 88 · see citing works
Fenwick, A., Molnár, G., & Frangos, P. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1272823 · Cited by 124 · see citing works
An HMI Concept to Improve Driver's Visual Behavior and Situation Awareness in Automated Vehicle
Yang, Y., Karakaya, B., Dominioni, G. C., Kawabe, K., & Bengler, K. J. (2018) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569986 · Cited by 86 · see citing works
Physiological correlates of discomfort in automated driving
Beggiato, M., Hartwich, F., & Krems, J. F. (2019) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2019.09.018 · Cited by 86 · see citing works
Autonomy and interdependence in human-agent-robot teams
Johnson, M., Bradshaw, J. M., Feltovich, P. J., Jonker, C. M., van Riemsdijk, M. B., & Sierhuis, M. (2012) · IEEE Intelligent Systems · doi:10.1109/mis.2012.1 · Cited by 86 · see citing works
Beyond Ecological Interface Design: Lessons From Concerns and Misconceptions
Borst, C., Flach, J. M., & Ellerbroek, J. (2014) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2014.2364984 · Cited by 79 · see citing works
Beyond Cooperative Robotics: The Central Role of Interdependence in Coactive Design
Johnson, M., Bradshaw, J. M., Feltovich, P. J., Hoffman, R. R., Jonker, C. M., van Riemsdijk, M. B., & Sierhuis, M. (2011) · IEEE Intelligent Systems · doi:10.1109/mis.2011.47 · Cited by 76 · see citing works
Teaming with industrial cobots: A socio‐technical perspective on safety analysis
Adriaensen, A., Costantino, F., Gravio, G. D., & Patriarca, R. (2021) · Human Factors and Ergonomics in Manufacturing & Service Industries · doi:10.1002/hfm.20939 · Cited by 75 · see citing works
See no evil: Cognitive challenges of security surveillance and monitoring.
Hodgetts, H. M., Vachon, F., Chamberland, C., & Tremblay, S. (2017) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2017.05.001 · Cited by 75 · see citing works
Integrating human observer inferences into robot motion planning
Dragan, A. D., & Srinivasa, S. S. (2014) · Autonomous Robots · doi:10.1007/s10514-014-9408-x · Cited by 73 · see citing works
Resilience is not control: healthcare, crisis management, and ICT
Nemeth, C., Wears, R. L., Patel, S. R., Rosen, G., & Cook, R. I. (2011) · Cognition Technology & Work · doi:10.1007/s10111-011-0174-7 · Cited by 73 · see citing works
Hoffman, R. R., & Woods, D. D. (2011) · IEEE Intelligent Systems · doi:10.1109/mis.2011.97 · Cited by 72 · see citing works
Derrick, D., Jenkins, J. L., & Nunamaker, J. (2011) · AIS Transactions on Human-Computer Interaction · doi:10.17705/1thci.00027 · Cited by 83 · see citing works
The Impact of Training on Human–Autonomy Team Communications and Trust Calibration
Johnson, C. J., Demir, M., McNeese, N. J., Gorman, J. C., Wolff, A. T., & Cooke, N. J. (2023) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208211047323 · Cited by 68 · see citing works
Tomorrow’s Human–Machine Design Tools: From Levels of Automation to Interdependencies
Johnson, M., Bradshaw, J. M., & Feltovich, P. J. (2017) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/1555343417736462 · Cited by 68 · see citing works
Norouzi, N., Kim, K., Hochreiter, J., Lee, M., Daher, S., Bruder, G., & Welch, G. (2018) · International Conference on Intelligent Virtual Agents · doi:10.1145/3267851.3267901 · Cited by 66 · see citing works
Team Situation Awareness and Conflict: A Study of Human–Machine Teaming
McNeese, N. J., Demir, M., Cooke, N. J., & She, M. (2021) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/15553434211017354 · Cited by 69 · see citing works
Interprofessional team dynamics and information flow management in emergency departments
Gilardi, S., Guglielmetti, C., & Pravettoni, G. (2013) · Journal of Advanced Nursing · doi:10.1111/jan.12284 · Cited by 67 · see citing works
Kulms, P., & Kopp, S. (2018) · Frontiers in Digital Humanities · doi:10.3389/fdigh.2018.00014 · Cited by 66 · see citing works
From Industry 5.0 to Forestry 5.0: Bridging the gap with Human-Centered Artificial Intelligence
Holzinger, A., Schweier, J., Gollob, C., Nothdurft, A., Hasenauer, H., Kirisits, T., Häggström, C., Visser, R. M., Cavalli, R., Spinelli, R., et al. (2024) · Current Forestry Reports · doi:10.1007/s40725-024-00231-7 · Cited by 77 · see citing works
A conceptual model of team dynamical behaviors and performance in human-autonomy teaming
Demir, M., Cooke, N. J., & Amazeen, P. G. (2018) · Cognitive Systems Research · doi:10.1016/j.cogsys.2018.07.029 · Cited by 65 · see citing works
Walch, M., Woide, M., Mühl, K., Baumann, M. R. K., & Weber, M. (2019) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3342197.3344531 · Cited by 62 · see citing works
de Laat, M. F., Joksimovíc, S., & Ifenthaler, D. (2020) · International Journal of Information and Learning Technology · doi:10.1108/ijilt-03-2020-0026 · Cited by 69 · see citing works
A Systematic Review of Interaction in Search-Based Software Engineering
Ramírez, A., Romero, J. R., & Simons, C. L. (2018) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2803055 · Cited by 61 · see citing works
Team communication behaviors of the human-automation teaming
Demir, M., McNeese, N. J., & Cooke, N. J. (2016) · IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support · doi:10.1109/cogsima.2016.7497782 · Cited by 60 · see citing works
Liao, M., Sundar, S. S., & Walther, J. B. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501936 · Cited by 59 · see citing works
Adaptive Automation in a Naval Combat Management System
Arciszewski, H. F. R., de Greef, T., & van Delft, J. H. (2009) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/tsmca.2009.2026428 · Cited by 59 · see citing works
Human-Robot Teaming: Concepts and Components for Design
Ma, L. M., Fong, T., Micire, M. J., Kim, Y. K., & Feigh, K. M. (2017) · Springer proceedings in advanced robotics · doi:10.1007/978-3-319-67361-5_42 · Cited by 58 · see citing works
Understanding the Role of Trust in Human-Autonomy Teaming
McNeese, N. J., Demir, M., Chiou, E. K., Cooke, N. J., & Yanikian, G. (2019) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2019.032 · Cited by 58 · see citing works
Toward Human-Aware Robot Task Planning
Alami, R., Clodic, A., Montreuil, V., Sisbot, E. A., & Chatila, R. (2006) · HAL · Cited by 58 · see citing works
Adriaensen, A., Decré, W., & Pintelon, L. M. (2019) · Safety · doi:10.3390/safety5040065 · Cited by 57 · see citing works
Human–automation teams and adaptable control for future air traffic management
Langan‐Fox, J., Canty, J. M., & Sankey, M. J. (2009) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2009.04.002 · Cited by 56 · see citing works
Man-Machine teaming: a problem of Agency
Berberian, B. (2019) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2019.01.049 · Cited by 57 · see citing works
Holden, R. J. (2011) · Theoretical Issues in Ergonomics Science · doi:10.1080/1463922x.2010.549249 · Cited by 56 · see citing works
Macrocognition: From Theory to Toolbox
Klein, G. A., & Wright, C. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00054 · Cited by 56 · see citing works
Design Patterns for Human-Cognitive Agent Teaming
Schulte, A., Donath, D., & Lange, D. S. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-40030-3_24 · Cited by 56 · see citing works
Synthetic Teammate Communication and Coordination With Humans
Demir, M., McNeese, N. J., Cooke, N. J., Ball, J. T., Myers, C. W., & Frieman, M. (2015) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931215591275 · Cited by 56 · see citing works
Improving Teamwork Competencies in Human-Machine Teams: Perspectives From Team Science
Stowers, K. L., Brady, L. L., MacLellan, C. J., Wohleber, R. W., & Eduardo Salas, A. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.590290 · Cited by 57 · see citing works
Multitasking by clinicians in the context of CPOE and CIS use.
Collins, S., Currie, L. M., Patel, V. L., Henry, S. B., & Cimino, J. J. (2007) · PubMed · Cited by 54 · see citing works
The Dynamics of Trust in Cyberdomains
Hoffman, R. R., Lee, J. D., Woods, D. D., Shadbolt, N., Miller, J. E., & Bradshaw, J. M. (2009) · IEEE Intelligent Systems · doi:10.1109/mis.2009.124 · Cited by 54 · see citing works
HATP: An HTN Planner for RoboticsPreprint
Lallement, R., de Silva, L., & Alami, R. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1405.5345 · Cited by 53 · see citing works
Human-machine plan conflict and conflict resolution in a visual search task
Pan, Y., & Xu, J. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2024.103377 · Cited by 54 · see citing works
Planning human centered robot activities
Montreuil, V., Clodic, A., Ransan, M., & Alami, R. (2007) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2007.4413992 · Cited by 52 · see citing works
Lundberg, J., & Johansson, B. J. E. (2020) · Cognition Technology & Work · doi:10.1007/s10111-020-00637-w · Cited by 51 · see citing works
Human-Swarm-Teaming Transparency and Trust Architecture
Hepworth, A., Baxter, D., Hussein, A., Yaxley, K. J., Debie, E. S., & Abbass, H. (2021) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2020.1003545 · Cited by 40 · see citing works
Schoonderwoerd, T., van Zoelen, E. M., den Bosch, K. V., & Neerincx, M. A. (2022) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2022.102831 · Cited by 51 · see citing works
Six challenges for human-AI Co-learning
van den Bosch, K., Schoonderwoerd, T., Blankendaal, R., & Neerincx, M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-22341-0_45 · Cited by 50 · see citing works
Egbert, S., & Leese, M. (2020) · Routledge eBooks · doi:10.4324/9780429328732 · Cited by 124 · see citing works
Zouinar, M. (2020) · Activites · doi:10.4000/activites.4941 · Cited by 54 · see citing works
Walter, M. R., Antone, M. E., Chuangsuwanich, E., Correa, A., Davis, R., Fletcher, L., Frazzoli, E., Friedman, Y., Glass, J. R., How, J. P., et al. (2014) · Journal of Field Robotics · doi:10.1002/rob.21539 · Cited by 50 · see citing works
The Evolution of Human-Autonomy Teams in Remotely Piloted Aircraft Systems Operations
Demir, M., McNeese, N. J., & Cooke, N. J. (2019) · Frontiers in Communication · doi:10.3389/fcomm.2019.00050 · Cited by 48 · see citing works
- Authors
- Klein, G., Woods, D. D., Bradshaw, J. M., Hoffman, R. R., & Feltovich, P. J.
- Affiliations
- Florida Institute for Human and Machine Cognition (US)
- Venue
- IEEE Intelligent Systems
- Published
- 2004-11
- Volume
- 19
- Issue
- 06
- Pages
- 91-95
- ISSN
- 1541-1672 (ISSN-L)
- OpenAlex
- W2026272086
- Cited by
- 590
- References
- 25
- Citations by year
- 2026: 23 · 2025: 21 · 2024: 41 · 2023: 33 · 2022: 48 · 2021: 55 · 2020: 40 · 2019: 42 · 2018: 42 · 2017: 34 · 2016: 32 · 2015: 15 · 2014: 28 · 2013: 22 · 2012: 20
- FWCI
- 13.44
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Intelligent Systems (publishedVersion)
- Funders
- Ohio State University
- Topics
- Social Sciences › Psychology › Social Psychology › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- human-agent interaction, human-centered computing, common ground, coordination, automation, team players
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review