The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Intelligent Agent Transparency in Human–Agent Teaming for Multi-UxV Management
Open accessAbstract
Objective: We investigated the effects of level of agent transparency on operator performance, trust, and workload in a context of human–agent teaming for multirobot management. Background: Participants played the role of a heterogeneous unmanned vehicle (UxV) operator and were instructed to complete various missions by giving orders to UxVs through a computer interface. An intelligent agent (IA) assisted the participant by recommending two plans—a top recommendation and a secondary recommendation—for every mission. Method: A within-subjects design with three levels of agent transparency was employed in the present experiment. There were eight missions in each of three experimental blocks, grouped by level of transparency. During each experimental block, the IA was incorrect three out of eight times due to external information (e.g., commander’s intent and intelligence). Operator performance, trust, workload, and usability data were collected. Results: Results indicate that operator performance, trust, and perceived usability increased as a function of transparency level. Subjective and objective workload data indicate that participants’ workload did not increase as a function of transparency. Furthermore, response time did not increase as a function of transparency. Conclusion: Unlike previous research, which showed that increased transparency resulted in increased performance and trust calibration at the cost of greater workload and longer response time, our results support the benefits of transparency for performance effectiveness without additional costs. Application: The current results will facilitate the implementation of IAs in military settings and will provide useful data to the design of heterogeneous UxV teams.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“at least fve studies (see e.g., [4,130]) used the trust predisposition scale by McKnight et al. [91]”
From Measuring and Understanding Trust Calibrations for Automated Systems: A Survey of the State-Of-The-Art and Future Directions (2023) · cites this paper as [91]
In the citing paper
“However, we also noticed that only a few studies diferentiated between diferent subconstructs of trust (performance, process, purpose) which is inherently included in many scales (e.g., [91]) but authors did not make use of this information.”
From Measuring and Understanding Trust Calibrations for Automated Systems: A Survey of the State-Of-The-Art and Future Directions (2023) · cites this paper as [91]
In the citing paper
“Critically, the opaqueness of the AI's internal computational processes may decrease calibrated reliance on the system [63 , 64] .”
From Enhancing human-AI collaboration: The case of colonoscopy (2024) · cites this paper as [63]
In the citing paper
“Most of the studies investigated how to maintain appropriate trust calibration by continuously presenting system information to prevent over-trust or under-trust.”
From Adaptive trust calibration for human-AI collaboration (2020) · cites this paper as [12]
Citations
Cites
Artificial intelligence: a modern approach
Kumar, D. A., Balasubramanian, S., Byeon, D. H., & Manerkar, P. G. V. (1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 22,191
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
Artificial intelligence: A modern approach
Nilsson, N. J. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(96)00007-0 · Cited by 10,730
Toward a Theory of Situation Awareness in Dynamic Systems
Endsley, M. R. (1995) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779049543 · Cited by 8,875
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 8×
“The opera- tor’s SA of the IA’s intent, reasoning, projected outcomes, and uncertainty should improve the operator’s subjective trust as well as trust calibration, which is proper reliance when the IA is correct and correct rejection when the IA is incorrect (Lee & See, 2004).”
BackgroundMethodInfluentialHumans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554
Usability Evaluation In Industry
(1996) · CRC Press eBooks · doi:10.1201/9781498710411 · Cited by 4,445
A model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 1×
“…analysis (trust in the information and analysis displayed) and (b) decision and action selection (trust in the IA’s suggestions and decisions; Parasuraman, Sheridan, & Wickens, 2000), using a modified version of the Trust Between People and Automation questionnaire developed by Jian,…”
MethodWorking memory span tasks: A methodological review and user’s guide
Conway, A. R. A., Kane, M. J., Bunting, M. F., Hambrick, D. Z., Wilhelm, O., & Engle, R. W. (2005) · Psychonomic Bulletin & Review · doi:10.3758/bf03196772 · Cited by 2,882
Rayner, K. (2009) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470210902816461 · Cited by 2,682
Foundations for an Empirically Determined Scale of Trust in Automated Systems
Jian, J.-Y., Bisantz, A. M., & Drury, C. G. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0401_04 · Cited by 1,799
The role of visual attention in saccadic eye movements
Hoffman, J. E., & Subramaniam, B. (1995) · Perception & Psychophysics · doi:10.3758/bf03206794 · Cited by 1,566
The role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276
Eta Squared, Partial Eta Squared, and Misreporting of Effect Size in Communication Research
Levine, T. R., & Hullett, C. R. (2002) · Human Communication Research · doi:10.1111/j.1468-2958.2002.tb00828.x · Cited by 998
Instructional control of cognitive load in the training of complex cognitive tasks
Paas, F. G. W. C., & Van Merriënboer, J. J. G. (1994) · Educational Psychology Review · doi:10.1007/bf02213420 · Cited by 968
A dissociation between mental rotation and perspective-taking spatial abilities
Hegarty, M. (2004) · Intelligence · doi:10.1016/j.intell.2003.12.001 · Cited by 860
How in the World Did We Ever Get into That Mode? Mode Error and Awareness in Supervisory Control
Sarter, N. B., & Woods, D. D. (1995) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779049516 · Cited by 853
Wizard of Oz Studies in HRI: A Systematic Review and New Reporting Guidelines
Riek, L. D. (2012) · Journal of Human-Robot Interaction · doi:10.5898/jhri.1.1.riek · Cited by 778
Eye tracking in HCI and usability research
Poole, A., & Ball, L. J. (2006) · Encyclopedia of Human Computer Interaction · doi:10.4018/978-1-59140-562-7.ch034 · Cited by 690 · cited 1×
“The SMI (SensoMotoric Instruments) Remote Eye-Tracking Device (RED) was used to collect ocular indices to measure visual attention (Hoffman & Subramaniam, 1995) and workload (Poole & Ball, 2006; Figure 1).”
MethodHuman–Agent Teaming for Multirobot Control: A Review of Human Factors Issues
Chen, J. Y. C., & Barnes, M. J. (2014) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2013.2293535 · Cited by 554
Self-citationUsability measurement in context
Bevan, N., & MACLEOD, M. (1994) · Behaviour and Information Technology · doi:10.1080/01449299408914592 · Cited by 456
Miller, C. A., & Parasuraman, R. (2007) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872007779598037 · Cited by 434
The benefits of imperfect diagnostic automation: a synthesis of the literature
Wickens, C. D., & Dixon, S. R. (2007) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220500370105 · Cited by 423
Measurement of trust in human-robot collaboration
Freedy, A., deVisser, E., Weltman, G., & Coeyman, N. (2007) · International Conference on Collaboration Technologies and Systems (CTS) · doi:10.1109/cts.2007.4621745 · Cited by 308
Situation Awareness-Based Agent Transparency
Chen, J. Y., Procci, K., Boyce, M. W., Wright, J. L., Garcia, A. J., & Barnes, M. (2014) · Defense Technical Information Center (DTIC) · doi:10.21236/ada600351 · Cited by 306
Self-citationGroom, V., & Nass, C. (2007) · Interaction Studies Social Behaviour and Communication in Biological and Artificial Systems · doi:10.1075/is.8.3.10gro · Cited by 306
Supervisory Control of Multiple Robots: Human-Performance Issues and User-Interface Design
Chen, J. Y. C., Barnes, M., & Harper-Sciarini, M. (2011) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2010.2056682 · Cited by 246
Self-citationTrust and Reliance on an Automated Combat Identification System
Wang, L., Jamieson, G. A., & Hollands, J. G. (2009) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720809338842 · Cited by 157
Predicting Controller Capacity in Supervisory Control of Multiple UAVs
Cummings, M. L., & Mitchell, P. J. (2008) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/tsmca.2007.914757 · Cited by 140
Predicting work performance in nuclear power plants
Hwang, S., Yau, Y., Lin, Y., Chen, J., Huang, T.-H., Yenn, T., & Hsu, C. (2007) · Safety Science · doi:10.1016/j.ssci.2007.06.005 · Cited by 116
Self-citationThe World is not Enough: Trust in Cognitive Agents
de Visser, E. J., Krueger, F. W., McKnight, P. E., Scheid, S., Smith, M. A. B., Chalk, S., & Parasuraman, R. (2012) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181312561062 · Cited by 107
Transparency in a Human-Machine Context: Approaches for Fostering Shared Awareness/Intent
Lyons, J. B., & Havig, P. R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-07458-0_18 · Cited by 96
Working Memory, Metacognitive Uncertainty, and Belief Bias in Syllogistic Reasoning
Quayle, J. D., & Ball, L. J. (2000) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/713755945 · Cited by 89
Cook, M. B., & Smallman, H. S. (2008) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x354183 · Cited by 86
Human Interaction With Multiple Remote Robots
Lewis, M. (2013) · Reviews of Human Factors and Ergonomics · doi:10.1177/1557234x13506688 · Cited by 80
Linegang, M. P., Stoner, H. A., Patterson, M. J., Seppelt, B., Hoffman, J. D., Crittendon, Z. B., & Lee, J. D. (2006) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120605002304 · Cited by 76
Reference-Frame Misalignment and Cardinal Direction Judgments: Group Differences and Strategies.
Gugerty, L. J., & Brooks, J. O. (2004) · Journal of Experimental Psychology Applied · doi:10.1037/1076-898x.10.2.75 · Cited by 75
Neyedli, H., Hollands, J. G., & Jamieson, G. (2011) · Hum. Factors · doi:10.1177/0018720811413767 · Cited by 71
On using mixed-initiative control
Hardin, B., & Goodrich, M. A. (2009) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/1514095.1514126 · Cited by 70
Visualization of Uncertainty and Reasoning
Zuk, T., & Carpendale, S. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73214-3_15 · Cited by 67
Journal of Human-Robot Interaction
(2012) · Journal of Human-Robot Interaction · doi:10.5898/jhri/1.1 · Cited by 34
Oduor, K. F., & Wiebe, E. (2008) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120805200422 · Cited by 31
Coordination in Human-Agent-Robot Teamwork
Bradshaw, J. M., Feltovich, P. J., Johnson, M., Bunch, L., Breedy, M. R., Eskridge, T. C., Jung, H., Lott, J., & Uszok, A. (2008) · International Conference on Collaboration Technologies and Systems (CTS) · doi:10.1109/cts.2008.4543966 · Cited by 28
Statistical modelling of networked human-automation performance using working memory capacity
Ahmed, N. R., de Visser, E. J., Shaw, T. H., Mohamed-Ameen, A., Campbell, M., & Parasuraman, R. (2013) · Ergonomics · doi:10.1080/00140139.2013.855823 · Cited by 21
Research works printed but not linked: 5
- Douglass S., 2013, Design recommendations for adaptive intelligent tutoring systems learner modeling, 1, 111
- Draper M, H, 2013, Realizing autonomy via intelligent adaptive hybrid control: Adaptable autonomy for achieving UxV RSTA team decision superiority
- Ekstrom R. B., 1976, Manual for kit of factor-referenced cognitive tests
- Helldin T., 2014, Transparency for future semi-automated systems
- Spriggs S., 2014, Fusion system overview
Cited by
Sorted by citations
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Schaefer, K. E., Chen, J. Y. C., Szalma, J. L., & Hancock, P. A. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816634228 · Cited by 768
Self-citationHuman–Autonomy Teaming: A Review and Analysis of the Empirical Literature
O’Neill, T., McNeese, N. J., Barron, A. H., & Schelble, B. G. (2020) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720820960865 · Cited by 681
Transparency in artificial intelligence
Larsson, S., & Heintz, F. (2020) · Internet Policy Review · doi:10.14763/2020.2.1469 · Cited by 458
Towards a Theory of Longitudinal Trust Calibration in Human–Robot Teams
de Visser, E. J., Peeters, M. M. M., Jung, M. F., Kohn, S., Shaw, T. H., Pak, R., & Neerincx, M. A. (2020) · International Journal of Social Robotics · doi:10.1007/s12369-019-00596-x · Cited by 447
Metadata
- Authors
- Mercado, J. E., Rupp, M. A., Chen, J. Y. C., Barnes, M. J., Barber, D., & Procci, K.
- Affiliations
- University of Central Florida (US)
- Corresponding author
- Mercado, Joseph E.
- Venue
- Human Factors: The Journal of the Human Factors and Ergonomics Society
- Publisher
- SAGE Publications
- Published
- 2016-02-11
- Volume
- 58
- Issue
- 3
- Pages
- 401-415
- ISSN
- 0018-7208 (ISSN-L)
- 1547-8181
- OpenAlex
- W2321972046
- Semantic Scholar
- 5161e7babcca03e87642f3a130c2d25e338bde9a
- Cited by
- 403
- References
- 44
- Citations by year
- 2026: 32 · 2025: 55 · 2024: 46 · 2023: 47 · 2022: 44 · 2021: 41 · 2020: 45 · 2019: 37 · 2018: 25 · 2017: 16 · 2016: 14
- FWCI
- 48.15
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Human Factors The Journal of the Human Factors and Ergonomics Society (publishedVersion, public-domain)
- PubMed (publishedVersion)
- Journal of International Crisis and Risk Communication Research (submittedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Engineering › Control and Systems Engineering › Military Strategy and Technology
- Keywords
- agent transparency, human-agent teaming, unmanned vehicles, intelligent agents, trust in automation, operator workload, operator performance, usability, military operations, heterogeneous robot teams, trust calibration
- MeSH terms
- Adult, Artificial Intelligence, Automation, Computer Simulation, Female, Humans, Male, Man-Machine Systems, Task Performance and Analysis, User-Computer Interface, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
