Intelligent agent transparency in human–agent teaming for multi-UxV management
Open accessAbstract
Objective: We investigated the effects of level of agent transparency on operator performance, trust, and workload in a context of human–agent teaming for multirobot management. Background: Participants played the role of a heterogeneous unmanned vehicle (UxV) operator and were instructed to complete various missions by giving orders to UxVs through a computer interface. An intelligent agent (IA) assisted the participant by recommending two plans—a top recommendation and a secondary recommendation—for every mission. Method: A within-subjects design with three levels of agent transparency was employed in the present experiment. There were eight missions in each of three experimental blocks, grouped by level of transparency. During each experimental block, the IA was incorrect three out of eight times due to external information (e.g., commander’s intent and intelligence). Operator performance, trust, workload, and usability data were collected. Results: Results indicate that operator performance, trust, and perceived usability increased as a function of transparency level. Subjective and objective workload data indicate that participants’ workload did not increase as a function of transparency. Furthermore, response time did not increase as a function of transparency. Conclusion: Unlike previous research, which showed that increased transparency resulted in increased performance and trust calibration at the cost of greater workload and longer response time, our results support the benefits of transparency for performance effectiveness without additional costs. Application: The current results will facilitate the implementation of IAs in military settings and will provide useful data to the design of heterogeneous UxV teams.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
At least five studies used the trust predisposition scale by McKnight et al.
“at least fve studies (see e.g., [4,130]) used the trust predisposition scale by McKnight et al. [91]”
From Measuring and Understanding Trust Calibrations for Automated Systems: A Survey of the State-Of-The-Art and Future Directions (2023) · cites this paper as [91]
Only a few studies differentiated between different subconstructs of trust (performance, process, purpose).
“However, we also noticed that only a few studies diferentiated between diferent subconstructs of trust (performance, process, purpose) which is inherently included in many scales (e.g., [91]) but authors did not make use of this information.”
From Measuring and Understanding Trust Calibrations for Automated Systems: A Survey of the State-Of-The-Art and Future Directions (2023) · cites this paper as [91]
Opaqueness of AI's internal computational processes may decrease calibrated reliance on the system.
“Critically, the opaqueness of the AI's internal computational processes may decrease calibrated reliance on the system [63 , 64] .”
From Enhancing human-AI collaboration: The case of colonoscopy (2024) · cites this paper as [63]
Most existing studies on trust calibration have investigated how to maintain appropriate trust calibration by continuously presenting system information to prevent over-trust or under-trust.
“Most of the studies investigated how to maintain appropriate trust calibration by continuously presenting system information to prevent over-trust or under-trust.”
From Adaptive trust calibration for human-AI collaboration (2020) · cites this paper as [12]
Cites
Artificial intelligence: a modern approach
Kumar, D. A., Balasubramanian, S., Byeon, D. H., & Manerkar, P. G. V. (1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 22,182 · see citing works
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003 · see citing works
Artificial intelligence: A modern approach
Nilsson, N. J. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(96)00007-0 · Cited by 10,726 · see citing works
Toward a Theory of Situation Awareness in Dynamic Systems
Endsley, M. R. (1995) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779049543 · Cited by 8,875 · see citing works
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 8× · see citing works
“The opera- tor’s SA of the IA’s intent, reasoning, projected outcomes, and uncertainty should improve the operator’s subjective trust as well as trust calibration, which is proper reliance when the IA is correct and correct rejection when the IA is incorrect (Lee & See, 2004).”
BackgroundMethodInfluentialHumans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · see citing works
Usability Evaluation In Industry
(1996) · CRC Press eBooks · doi:10.1201/9781498710411 · Cited by 4,400 · see citing works
A model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 1× · see citing works
“…analysis (trust in the information and analysis displayed) and (b) decision and action selection (trust in the IA’s suggestions and decisions; Parasuraman, Sheridan, & Wickens, 2000), using a modified version of the Trust Between People and Automation questionnaire developed by Jian,…”
MethodWorking memory span tasks: A methodological review and user’s guide
Conway, A. R. A., Kane, M. J., Bunting, M. F., Hambrick, D. Z., Wilhelm, O., & Engle, R. W. (2005) · Psychonomic Bulletin & Review · doi:10.3758/bf03196772 · Cited by 2,882 · see citing works
Rayner, K. (2009) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470210902816461 · Cited by 2,682 · see citing works
Foundations for an Empirically Determined Scale of Trust in Automated Systems
Jian, J.-Y., Bisantz, A. M., & Drury, C. G. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0401_04 · Cited by 1,799 · see citing works
The role of visual attention in saccadic eye movements
Hoffman, J. E., & Subramaniam, B. (1995) · Perception & Psychophysics · doi:10.3758/bf03206794 · Cited by 1,444 · see citing works
The role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276 · see citing works
Eta Squared, Partial Eta Squared, and Misreporting of Effect Size in Communication Research
Levine, T. R., & Hullett, C. R. (2002) · Human Communication Research · doi:10.1111/j.1468-2958.2002.tb00828.x · Cited by 998 · see citing works
Instructional control of cognitive load in the training of complex cognitive tasks
Paas, F. G. W. C., & Van Merriënboer, J. J. G. (1994) · Educational Psychology Review · doi:10.1007/bf02213420 · Cited by 968 · see citing works
A dissociation between mental rotation and perspective-taking spatial abilities
Hegarty, M. (2004) · Intelligence · doi:10.1016/j.intell.2003.12.001 · Cited by 860 · see citing works
How in the World Did We Ever Get into That Mode? Mode Error and Awareness in Supervisory Control
Sarter, N. B., & Woods, D. D. (1995) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779049516 · Cited by 853 · see citing works
Wizard of Oz Studies in HRI: A Systematic Review and New Reporting Guidelines
Riek, L. D. (2012) · Journal of Human-Robot Interaction · doi:10.5898/jhri.1.1.riek · Cited by 778 · see citing works
Eye tracking in HCI and usability research
Poole, A., & Ball, L. J. (2006) · Encyclopedia of Human Computer Interaction · doi:10.4018/978-1-59140-562-7.ch034 · Cited by 690 · cited 1× · see citing works
“The SMI (SensoMotoric Instruments) Remote Eye-Tracking Device (RED) was used to collect ocular indices to measure visual attention (Hoffman & Subramaniam, 1995) and workload (Poole & Ball, 2006; Figure 1).”
MethodHuman–Agent Teaming for Multirobot Control: A Review of Human Factors Issues
Chen, J. Y. C., & Barnes, M. (2014) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2013.2293535 · Cited by 505 · see citing works
Self-citationUsability measurement in context
Bevan, N., & MACLEOD, M. (1994) · Behaviour and Information Technology · doi:10.1080/01449299408914592 · Cited by 456 · see citing works
Miller, C. A., & Parasuraman, R. (2007) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872007779598037 · Cited by 434 · see citing works
The benefits of imperfect diagnostic automation: a synthesis of the literature
Wickens, C. D., & Dixon, S. R. (2007) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220500370105 · Cited by 423 · see citing works
Measurement of trust in human-robot collaboration
Freedy, A., deVisser, E., Weltman, G., & Coeyman, N. (2007) · International Conference on Collaboration Technologies and Systems (CTS) · doi:10.1109/cts.2007.4621745 · Cited by 308 · see citing works
Groom, V., & Nass, C. (2007) · Interaction Studies Social Behaviour and Communication in Biological and Artificial Systems · doi:10.1075/is.8.3.10gro · Cited by 306 · see citing works
Supervisory Control of Multiple Robots: Human-Performance Issues and User-Interface Design
Chen, J. Y. C., Barnes, M., & Harper-Sciarini, M. (2011) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2010.2056682 · Cited by 246 · see citing works
Self-citationSituation Awareness-Based Agent Transparency
Chen, J. Y. C., Procci, K., Boyce, M. W., Wright, J. L., Garcia, A., & Barnes, M. (2014) · doi:10.21236/ada600351 · Cited by 201 · see citing works
Self-citationTrust and Reliance on an Automated Combat Identification System
Wang, L., Jamieson, G. A., & Hollands, J. G. (2009) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720809338842 · Cited by 157 · see citing works
Predicting Controller Capacity in Supervisory Control of Multiple UAVs
Cummings, M. L., & Mitchell, P. J. (2008) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/tsmca.2007.914757 · Cited by 140 · see citing works
Predicting work performance in nuclear power plants
Hwang, S., Yau, Y., Lin, Y., Chen, J., Huang, T.-H., Yenn, T., & Hsu, C. (2007) · Safety Science · doi:10.1016/j.ssci.2007.06.005 · Cited by 116 · see citing works
Self-citationThe World is not Enough: Trust in Cognitive Agents
de Visser, E. J., Krueger, F. W., McKnight, P. E., Scheid, S., Smith, M. A. B., Chalk, S., & Parasuraman, R. (2012) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181312561062 · Cited by 107 · see citing works
Transparency in a Human-Machine Context: Approaches for Fostering Shared Awareness/Intent
Lyons, J. B., & Havig, P. R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-07458-0_18 · Cited by 96 · see citing works
Working Memory, Metacognitive Uncertainty, and Belief Bias in Syllogistic Reasoning
Quayle, J. D., & Ball, L. J. (2000) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/713755945 · Cited by 89 · see citing works
Cook, M. B., & Smallman, H. S. (2008) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x354183 · Cited by 86 · see citing works
Human Interaction With Multiple Remote Robots
Lewis, M. (2013) · Reviews of Human Factors and Ergonomics · doi:10.1177/1557234x13506688 · Cited by 80 · see citing works
Linegang, M. P., Stoner, H. A., Patterson, M. J., Seppelt, B., Hoffman, J. D., Crittendon, Z. B., & Lee, J. D. (2006) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120605002304 · Cited by 76 · see citing works
Reference-Frame Misalignment and Cardinal Direction Judgments: Group Differences and Strategies.
Gugerty, L. J., & Brooks, J. O. (2004) · Journal of Experimental Psychology Applied · doi:10.1037/1076-898x.10.2.75 · Cited by 75 · see citing works
Neyedli, H., Hollands, J. G., & Jamieson, G. (2011) · Hum. Factors · doi:10.1177/0018720811413767 · Cited by 71 · see citing works
On using mixed-initiative control
Hardin, B., & Goodrich, M. A. (2009) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/1514095.1514126 · Cited by 70 · see citing works
Visualization of Uncertainty and Reasoning
Zuk, T., & Carpendale, S. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73214-3_15 · Cited by 67 · see citing works
Journal of Human-Robot Interaction
(2012) · Journal of Human-Robot Interaction · doi:10.5898/jhri/1.1 · Cited by 34 · see citing works
Coordination in Human-Agent-Robot Teamwork
Bradshaw, J. M., Feltovich, P. J., Johnson, M., Bunch, L., Breedy, M. R., Eskridge, T. C., Jung, H., Lott, J., & Uszok, A. (2008) · International Conference on Collaboration Technologies and Systems (CTS) · doi:10.1109/cts.2008.4543966 · Cited by 28 · see citing works
Oduor, K. F., & Wiebe, E. (2008) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120805200422 · Cited by 28 · see citing works
Statistical modelling of networked human-automation performance using working memory capacity
Ahmed, N. R., de Visser, E. J., Shaw, T. H., Mohamed-Ameen, A., Campbell, M., & Parasuraman, R. (2013) · Ergonomics · doi:10.1080/00140139.2013.855823 · Cited by 21 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302 · see citing works
Schaefer, K. E., Chen, J. Y. C., Szalma, J. L., & Hancock, P. A. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816634228 · Cited by 768 · see citing works
Self-citationHuman–Autonomy Teaming: A Review and Analysis of the Empirical Literature
O’Neill, T., McNeese, N. J., Barron, A. H., & Schelble, B. G. (2020) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720820960865 · Cited by 623 · see citing works
Transparency in artificial intelligence
Larsson, S., & Heintz, F. (2020) · Internet Policy Review · doi:10.14763/2020.2.1469 · Cited by 458 · see citing works
Towards a Theory of Longitudinal Trust Calibration in Human–Robot Teams
de Visser, E. J., Peeters, M. M. M., Jung, M. F., Kohn, S., Shaw, T. H., Pak, R., & Neerincx, M. A. (2020) · International Journal of Social Robotics · doi:10.1007/s12369-019-00596-x · Cited by 447 · see citing works
From ‘automation’ to ‘autonomy’: the importance of trust repair in human–machine interaction
de Visser, E. J., Pak, R., & Shaw, T. H. (2018) · Ergonomics · doi:10.1080/00140139.2018.1457725 · Cited by 416 · see citing works
Evaluating XAI: A comparison of rule-based and example-based explanations
van der Waa, J., Nieuwburg, E., Cremers, A., & Neerincx, M. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2020.103404 · Cited by 393 · see citing works
Explanations as Mechanisms for Supporting Algorithmic Transparency
Rader, E., Cotter, K., & Cho, J. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173677 · Cited by 388 · see citing works
Situation awareness-based agent transparency and human-autonomy teaming effectiveness
Chen, J. Y. C., Lakhmani, S. G., Stowers, K., Selkowitz, A. R., Wright, J. L., & Barnes, M. (2018) · Theoretical Issues in Ergonomics Science · doi:10.1080/1463922x.2017.1315750 · Cited by 341 · see citing works
Self-citationSupporting Human-AI Teams:Transparency, explainability, and situation awareness
Endsley, M. R. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107574 · Cited by 332 · see citing works
Adaptive trust calibration for human-AI collaboration
Okamura, K., & Yamada, S. (2020) · PLOS ONE · doi:10.1371/journal.pone.0229132 · Cited by 239 · see citing works
Evaluating Effects of User Experience and System Transparency on Trust in Automation
Yang, X. J., Unhelkar, V. V., Li, K., & Shah, J. A. (2017) · Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/2909824.3020230 · Cited by 208 · see citing works
Vorm, E. S., & Combs, D. J. Y. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2070107 · Cited by 211 · see citing works
Contrastive explanation: a structural-model approach
Miller, T. (2021) · The Knowledge Engineering Review · doi:10.1017/s0269888921000102 · Cited by 186 · see citing works
Challenges and opportunities for artificial intelligence in auditing: Evidence from the field
Kokina, J., Blanchette, S., Davenport, T. H., & Pachamanova, D. (2025) · International Journal of Accounting Information Systems · doi:10.1016/j.accinf.2025.100734 · Cited by 177 · see citing works
Du, N., Haspiel, J., Zhang, Q., Tilbury, D. M., Pradhan, A. K., Yang, X. J., & Robert, L. (2019) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2019.05.025 · Cited by 174 · see citing works
Kunze, A., Summerskill, S. J., Marshall, R., & Filtness, A. J. (2019) · Ergonomics · doi:10.1080/00140139.2018.1547842 · Cited by 165 · see citing works
van de Merwe, K., Mallam, S., & Nazir, S. (2022) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208221077804 · Cited by 172 · see citing works
Let's Think Together! Assessing Shared Mental Models, Performance, and Trust in Human-Agent Teams
Schelble, B. G., Flathmann, C., McNeese, N. J., Freeman, G., & Mallick, R. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3492832 · Cited by 160 · see citing works
Transparency and Explanation in Deep Reinforcement Learning Neural Networks
Iyer, R., Li, Y., Li, H., Lewis, M., Sundar, R., & Sycara, K. P. (2018) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3278721.3278776 · Cited by 154 · see citing works
Wischnewski, M., Krämer, N., & Müller, E. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581197 · Cited by 146 · see citing works
Understanding artificial intelligence ethics and safetyPreprint
Leslie, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.05684 · Cited by 268 · see citing works
Trustworthy AI and robotics: Implications for the AEC industry
Emaminejad, N., & Akhavian, R. (2022) · Automation in Construction · doi:10.1016/j.autcon.2022.104298 · Cited by 152 · see citing works
Communicating intent to develop shared situation awareness and engender trust in human-agent teams
Schaefer, K. E., Straub, E. R., Chen, J. Y. C., Putney, J., & Evans, A. W. (2017) · Cognitive Systems Research · doi:10.1016/j.cogsys.2017.02.002 · Cited by 136 · see citing works
Self-citationWeitz, K., Schiller, D., Schlagowski, R., Huber, T., & André, E. (2019) · Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents · doi:10.1145/3308532.3329441 · Cited by 136 · see citing works
A survey of multi-agent Human–Robot Interaction systems
Dahiya, A., Aroyo, A. M., Dautenhahn, K., & Smith, S. L. (2022) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2022.104335 · Cited by 137 · see citing works
Selten, F., Robeer, M., & Grimmelikhuijsen, S. (2023) · Public Administration Review · doi:10.1111/puar.13602 · Cited by 134 · see citing works
Wright, J. L., Chen, J. Y. C., & Lakhmani, S. G. (2020) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2019.2925717 · Cited by 102 · see citing works
Self-citationAgent Transparency: A Review of Current Theory and Evidence
Bhaskara, A., Skinner, M., & Loft, S. (2020) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2020.2965529 · Cited by 95 · see citing works
“Let me explain!”: exploring the potential of virtual agents in explainable AI interaction design
Weitz, K., Schiller, D., Schlagowski, R., Huber, T., & André, E. (2020) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-020-00332-0 · Cited by 122 · see citing works
Wang, X., & Qiu, X. (2024) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2024.103777 · Cited by 118 · see citing works
Trust and Team Performance in Human–Autonomy Teaming
McNeese, N. J., Demir, M., Chiou, E. K., & Cooke, N. J. (2021) · International Journal of Electronic Commerce · doi:10.1080/10864415.2021.1846854 · Cited by 116 · see citing works
Kim, T., & Song, H. (2021) · Telematics and Informatics · doi:10.1016/j.tele.2021.101595 · Cited by 101 · see citing works
A Review on Human–Machine Trust Evaluation: Human-Centric and Machine-Centric Perspectives
Gebru, B., Zeleke, L., Blankson, D., Nabil, M., Nateghi, S., Homaifar, A., & Tunstel, E. (2022) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2022.3144956 · Cited by 101 · see citing works
Ethics in human–AI teaming: principles and perspectives
Pflanzer, M., Traylor, Z., Lyons, J. B., Dubljević, V., & Nam, C. S. (2022) · AI and Ethics · doi:10.1007/s43681-022-00214-z · Cited by 106 · see citing works
Unveiling trust in AI: the interplay of antecedents, consequences, and cultural dynamics
Dang, Q., & Li, G. (2025) · AI & Society · doi:10.1007/s00146-025-02477-6 · Cited by 111 · see citing works
Individual Differences in Trust in Autonomous Robots: Implications for Transparency
Matthews, G., Lin, J., Panganiban, A. R., & Long, M. D. (2019) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2019.2947592 · Cited by 90 · see citing works
Musick, G., O’Neill, T., Schelble, B. G., McNeese, N. J., & Henke, J. B. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106852 · Cited by 91 · see citing works
Bao, Y., Gong, W., & Yang, K. (2023) · Systems · doi:10.3390/systems11090442 · Cited by 96 · see citing works
Trust and Distrust of Automated Parking in a Tesla Model X
Tenhundfeld, N. L., de Visser, E. J., Ries, A. J., Finomore, V. S., & Tossell, C. C. (2019) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720819865412 · Cited by 78 · see citing works
Sebok, A., & Wickens, C. D. (2017) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816665201 · Cited by 75 · see citing works
Learning From the Slips of Others: Neural Correlates of Trust in Automated Agents
de Visser, E. J., Beatty, P. J., Estepp, J. R., Kohn, S., Abubshait, A., Fedota, J. R., & McDonald, C. G. (2018) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2018.00309 · Cited by 73 · see citing works
Trust and Human-Machine Teaming: A Qualitative Study
Lyons, J. B., Wynne, K. T., Mahoney, S., & Roebke, M. A. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-817636-8.00006-5 · Cited by 73 · see citing works
Kumar, A., McMahon, G., Reid, T., & Jain, N. (2020) · IEEE Control Systems · doi:10.1109/mcs.2020.3019151 · Cited by 58 · see citing works
Benk, M., Kerstan, S., von Wangenheim, F., & Ferrario, A. (2024) · AI & Society · doi:10.1007/s00146-024-02059-y · Cited by 78 · see citing works
Shaping Trust Through Transparent Design: Theoretical and Experimental Guidelines
Lyons, J. B., Sadler, G. G., Koltai, K., Battiste, H., Ho, N., Hoffmann, L. C., Smith, D. E., Johnson, W. W., & Shively, R. J. (2016) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-41959-6_11 · Cited by 70 · see citing works
Human Performance Benefits of The Automation Transparency Design Principle
Skraaning, G., & Jamieson, G. A. (2019) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720819887252 · Cited by 67 · see citing works
The effects of explanations on automation bias
Vered, M., Livni, T., Howe, P. D. L., Miller, T., & Sonenberg, L. (2023) · Artificial Intelligence · doi:10.1016/j.artint.2023.103952 · Cited by 71 · see citing works
Automation Stages & Levels, 20 Years After
Wickens, C. D. (2017) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/1555343417727438 · Cited by 66 · see citing works
The IMPACT of Agent Transparency on Human Performance
Stowers, K. L., Kasdaglis, N., Rupp, M. A., Newton, O. B., Chen, J. Y. C., & Barnes, M. J. (2020) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2020.2978041 · Cited by 66 · see citing works
Self-citationUsing agent transparency to support situation awareness of the Autonomous Squad Member
Selkowitz, A. R., Lakhmani, S. G., & Chen, J. Y. C. (2017) · Cognitive Systems Research · doi:10.1016/j.cogsys.2017.02.003 · Cited by 62 · see citing works
Self-citationEffects of Uncertainty and Cognitive Load on User Trust in Predictive Decision Making
Zhou, J., Arshad, S. Z., Luo, S., & Chen, F. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-68059-0_2 · Cited by 59 · see citing works
Understanding the Role of Trust in Human-Autonomy Teaming
McNeese, N. J., Demir, M., Chiou, E. K., Cooke, N. J., & Yanikian, G. (2019) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2019.032 · Cited by 59 · see citing works
Robot Transparency and Team Orientation Effects on Human–Robot Teaming
Guznov, S. Y., Lyons, J. B., Pfahler, M. D., Heironimus, A., Woolley, M., Friedman, J., & Neimeier, A. (2019) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2019.1676519 · Cited by 57 · see citing works
Akash, K., Polson, K., Reid, T., & Jain, N. (2019) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2019.01.028 · Cited by 56 · see citing works
Gaczek, P., Leszczyński, G., & Mouakher, A. (2023) · Industrial Marketing Management · doi:10.1016/j.indmarman.2023.09.007 · Cited by 63 · see citing works
Calibrating Trust in Automation Through Familiarity With the Autoparking Feature of a Tesla Model X
Tenhundfeld, N. L., de Visser, E. J., Haring, K. S., Ries, A. J., Finomore, V. S., & Tossell, C. C. (2019) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/1555343419869083 · Cited by 52 · see citing works
Effect of automation transparency in the management of multiple unmanned vehicles
Bhaskara, A., Duong, L., Brooks, J., Li, R., McInerney, R., Skinner, M., Pongracic, H., & Loft, S. D. (2020) · Applied Ergonomics · doi:10.1016/j.apergo.2020.103243 · Cited by 53 · see citing works
Chen, J., Mishler, S., Hu, B., Li, N., & Proctor, R. W. (2018) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2018.05.010 · Cited by 50 · see citing works
Self-citationArtificial Intelligence and Groups: Effects of Attitudes and Discretion on Collaboration
Bezrukova, K., Griffith, T. L., Spell, C., Rice, V., & Yang, H. E. (2023) · Group & Organization Management · doi:10.1177/10596011231160574 · Cited by 51 · see citing works
Human-Swarm-Teaming Transparency and Trust Architecture
Hepworth, A., Baxter, D., Hussein, A., Yaxley, K. J., Debie, E. S., & Abbass, H. (2021) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2020.1003545 · Cited by 40 · see citing works
Zouinar, M. (2020) · Activites · doi:10.4000/activites.4941 · Cited by 54 · see citing works
(Over)Trusting AI Recommendations: How System and Person Variables Affect Dimensions of Complacency
Harbarth, L., Gößwein, E., Bodemer, D., & Schnaubert, L. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2301250 · Cited by 52 · see citing works
Trusting Autonomous Security Robots: The Role of Reliability and Stated Social Intent
Lyons, J. B., Vo, T. Q., Wynne, K. T., Mahoney, S., Nam, C. S., & Gallimore, D. M. (2020) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720820901629 · Cited by 49 · see citing works
Transparency: Transitioning From Human–Machine Systems to Human-Swarm Systems
Roundtree, K. A., Goodrich, M. A., & Adams, J. A. (2019) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/1555343419842776 · Cited by 49 · see citing works
Egoistic and altruistic motivation: How to induce users’ willingness to help for imperfect AI
Lee, Y., Ha, M., Kwon, S., Shim, Y., & Kim, J. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.06.009 · Cited by 49 · see citing works
Daronnat, S., Azzopardi, L., Halvey, M., & Dubiel, M. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.642201 · Cited by 45 · see citing works
Hussein, A., Elsawah, S., & Abbass, H. (2020) · Ergonomics · doi:10.1080/00140139.2020.1764112 · Cited by 42 · see citing works
Transparency in Autonomous Teammates
Panganiban, A. R., Matthews, G., & Long, M. D. (2019) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/1555343419881563 · Cited by 45 · see citing works
Effects of transparency on pilot trust and agreement in the autonomous constrained flight planner
Sadler, G. G., Battiste, H., Ho, N., Hoffmann, L., Johnson, W. W., Shively, R. J., Lyons, J. B., & Smith, D. E. (2016) · IEEE/AIAA Digital Avionics Systems Conference (DASC) · doi:10.1109/dasc.2016.7777998 · Cited by 44 · see citing works
Akash, K., Reid, T., & Jain, N. (2019) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2019.01.026 · Cited by 43 · see citing works
Is explainable artificial intelligence intrinsically valuable?
Colaner, N. R. (2021) · AI & Society · doi:10.1007/s00146-021-01184-2 · Cited by 43 · see citing works
Investigating the Effects of Perceived Teammate Artificiality on Human Performance and Cognition
Schelble, B. G., Flathmann, C., McNeese, N. J., O’Neill, T., Pak, R., & Namara, M. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2085191 · Cited by 42 · see citing works
The pursuit of happiness: the power and influence of AI teammate emotion in human-AI teamwork
Mallick, R., Flathmann, C., Lancaster, C., Hauptman, A. I., McNeese, N. J., & Freeman, G. (2023) · Behaviour and Information Technology · doi:10.1080/0144929x.2023.2277909 · Cited by 42 · see citing works
Intelligent Agent Transparency
Stowers, K. L., Kasdaglis, N., Newton, O. B., Lakhmani, S. G., Wohleber, R. W., & Chen, J. Z.-J. (2016) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213601392 · Cited by 42 · see citing works
Self-citationAutomated UAV tasks for search and surveillance
Kingston, D. B., Rasmussen, S., & Humphrey, L. R. (2016) · The proceedings of the IEEE Conference on Control Applications/The proceedings of the ... IEEE Conference on Control Applications · doi:10.1109/cca.2016.7587813 · Cited by 41 · see citing works
Thellman, S., & Tom Ziemke, B. (2021) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3461781 · Cited by 41 · see citing works
Taylor, S., Wang, M., & Jeon, M. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1121622 · Cited by 40 · see citing works
Impact of Transparency and Explanations on Trust and Situation Awareness in Human–Robot Teams
Ezenyilimba, A., Wong, M. E., Hehr, A. J., Demir, M., Wolff, A. T., Chiou, E. K., & Cooke, N. J. (2022) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/15553434221136358 · Cited by 39 · see citing works
Schodde, T., Hoffmann, L., Stange, S., & Kopp, S. (2019) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3366422 · Cited by 39 · see citing works
XFlag: Explainable Fake News Detection Model on Social Media
Chien, S.-Y. J., Yang, C., & Yu, F. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2062113 · Cited by 40 · see citing works
Towards Meaningfully Integrating Human-Autonomy Teaming in Applied Settings
Schelble, B. G., Flathmann, C., & Mcneese, N. J. (2020) · International Conference on Human-Agent Interaction · doi:10.1145/3406499.3415077 · Cited by 37 · see citing works
The Effects of Agent Transparency on Human Interaction with an Autonomous Robotic Agent
Selkowitz, A. R., Lakhmani, S. G., Chen, J. Y. C., & Boyce, M. W. (2015) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931215591246 · Cited by 34 · see citing works
Self-citationChien, S.-Y. J., Lin, Y., Lee, P.-J., Han, S., Lewis, M., & Sycara, K. P. (2018) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2018.03.005 · Cited by 35 · see citing works
Evaluation of Playbook Delegation Approach in Human-Autonomy Teaming for Single Pilot Operations
Tokadlı, G., Dorneich, M. C., & Matessa, M. (2021) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2021.1890485 · Cited by 33 · see citing works
Effects of Agent Transparency on human-autonomy teaming effectiveness
Chen, J. Y. C., Barnes, M., Selkowitz, A. R., & Stowers, K. (2016) · IEEE International Conference on Systems, Man and Cybernetics · doi:10.1109/smc.2016.7844505 · Cited by 34 · see citing works
Self-citationExplaining the News Feed Algorithm
Cotter, K., Cho, J., & Rader, E. J. (2017) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3027063.3053114 · Cited by 34 · see citing works
Brokerbot: A Cryptocurrency Chatbot in the Social-technical Gap of Trust
Lee, M., Frank, L. E., & IJsselsteijn, W. A. (2021) · Computer Supported Cooperative Work (CSCW) · doi:10.1007/s10606-021-09392-6 · Cited by 36 · see citing works
Bobko, P., Hirshfield, L., Eloy, L., Spencer, C., Doherty, E., Driscoll, J., & Obolsky, H. (2023) · Theoretical Issues in Ergonomics Science · doi:10.1080/1463922x.2022.2086644 · Cited by 33 · see citing works
Human-Autonomy Teaming and Agent Transparency
Chen, J. Y. C., Barnes, M. J., Selkowitz, A. R., Stowers, K. L., Lakhmani, S. G., & Kasdaglis, N. (2016) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/2876456.2879479 · Cited by 33 · see citing works
Self-citationEffects of Proactive Explanations by Robots on Human-Robot Trust
Zhu, L., & Williams, T. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-62056-1_8 · Cited by 33 · see citing works
Holder, E. W., & Wang, N. (2021) · Human-Intelligent Systems Integration · doi:10.1007/s42454-020-00021-z · Cited by 32 · see citing works
Exploring system wide trust prevalence and mitigation strategies with multiple autonomous agents
Walliser, J. C., de Visser, E., & Shaw, T. H. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2023.107671 · Cited by 33 · see citing works
Certifiable Trust in Autonomous Systems: Making the Intractable Tangible
Lyons, J. B., Clark, M. A., Wagner, A. R., & Schuelke, M. J. (2017) · AI Magazine · doi:10.1609/aimag.v38i3.2717 · Cited by 32 · see citing works
Human–Agent Team Dynamics: A Review and Future Research Opportunities
Iftikhar, R., Chiu, Y.-T., Khan, M. S., & Caudwell, C. B. (2023) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2023.3331369 · Cited by 31 · see citing works
Zhang, R., Flathmann, C., Musick, G., Schelble, B. G., McNeese, N. J., Knijnenburg, B. P., & Duan, W. (2023) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3635474 · Cited by 33 · see citing works
Explainable Autonomy: A Study of Explanation Styles for Building Clear Mental Models
Garcia, F. J. C., Robb, D. A., Liu, X., Laskov, A., Patrón, P., & Hastie, H. W. (2018) · International Conference on Natural Language Generation · doi:10.18653/v1/w18-6511 · Cited by 32 · see citing works
Deep learning, transparency, and trust in human robot teamwork
Lewis, M., Li, H., & Sycara, K. P. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-819472-0.00014-9 · Cited by 29 · see citing works
A Bayesian Trust Inference Model for Human-Multi-Robot Teams
Mahani, M. F., Jiang, L., & Wang, Y. (2020) · International Journal of Social Robotics · doi:10.1007/s12369-020-00705-1 · Cited by 30 · see citing works
A Review of Transparency (seeing-into) Models
Rajabiyazdi, F., & Jamieson, G. A. (2020) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc42975.2020.9282970 · Cited by 29 · see citing works
- Authors
- Mercado, J. E., Rupp, M. A., Chen, J. Y. C., Barnes, M. J., Barber, D., & Procci, K.
- Affiliations
- University of Central Florida (US)
- Corresponding author
- Mercado, Joseph E.
- Venue
- Human Factors: The Journal of the Human Factors and Ergonomics Society
- Publisher
- SAGE Publications
- Published
- 2016-02-11
- Volume
- 58
- Issue
- 3
- Pages
- 401-415
- ISSN
- 0018-7208 (ISSN-L)
- 1547-8181
- OpenAlex
- W2321972046
- Semantic Scholar
- 5161e7babcca03e87642f3a130c2d25e338bde9a
- Cited by
- 403
- References
- 44
- Citations by year
- 2026: 32 · 2025: 55 · 2024: 46 · 2023: 47 · 2022: 44 · 2021: 41 · 2020: 45 · 2019: 37 · 2018: 25 · 2017: 16 · 2016: 14 · 2015: 1
- FWCI
- 48.15
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Human Factors The Journal of the Human Factors and Ergonomics Society (publishedVersion, public-domain)
- PubMed (publishedVersion)
- Journal of International Crisis and Risk Communication Research (submittedVersion)
- Topics
- Social Sciences › Psychology › Social Psychology › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Engineering › Control and Systems Engineering › Military Strategy and Technology
- Keywords
- agent transparency, human-agent teaming, unmanned vehicles, intelligent agents, trust in automation, operator workload, operator performance, usability, military operations, heterogeneous robot teams, trust calibration
- MeSH terms
- Adult, Artificial Intelligence, Automation, Computer Simulation, Female, Humans, Male, Man-Machine Systems, Task Performance and Analysis, User-Computer Interface, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
