The DOI matches its Crossref record; 24 of the 25 references it cites were found in a registry or an index; none of the 17 sources its claims cite is checked for support yet.
Adaptive Cognitive Mechanisms to Maintain Calibrated Trust and Reliance in Automation
Open accessAbstract
Trust calibration for a human–machine team is the process by which a human adjusts their expectations of the automation’s reliability and trustworthiness; adaptive support for trust calibration is needed to engender appropriate reliance on automation. Herein, we leverage an instance-based learning ACT-R cognitive model of decisions to obtain and rely on an automated assistant for visual search in a UAV interface. This cognitive model matches well with the human predictive power statistics measuring reliance decisions; we obtain from the model an internal estimate of automation reliability that mirrors human subjective ratings. The model is able to predict the effect of various potential disruptions, such as environmental changes or particular classes of adversarial intrusions on human trust in automation. Finally, we consider the use of model predictions to improve automation transparency that account for human cognitive biases in order to optimize the bidirectional interaction between human and machine through supporting trust calibration. The implications of our findings for the design of reliable and trustworthy automation are discussed.
Overview
CoChat Summary
TL;DR
The paper presents an instance-based learning ACT-R cognitive model of trust calibration and reliance decisions in an automation-aided visual search task, showing it reproduces human predictive-power statistics and subjective reliability ratings. It then uses the model to predict how transparency changes and adversarial disruptions can cause over- or under-reliance on automation.
Key findings
- Baseline model selected Automation about 72% of the time in the Age condition, 67% in Number, and 82% in both Text and Graphic; decision-stage mean PPP was 0.77 for Age, 0.79 for Number, and 0.82 for Text and Graphic.
- Model reliability estimates were 0.77 (Age), 0.80 (Number), 0.80 (Text), and 0.81 (Graphic), roughly matching human subjective ratings of 0.75, 0.74, 0.82, and 0.80.
- A Random disruption (10% of automation-selected trials, reducing overall reliability from 70% to about 63%) increased Commander choice by about 12% in Age, 8% in Number, and 8% in Text/Graphic; Frontload increased Commander choice by 9% in Age/Number and 7% in Text/Graphic versus Random.
- Frontload-Positive decreased Commander reliance by 12% (Age), 10% (Number), and 6% (Text/Graphic); Frontload-Commander decreased Commander reliance by 18% (Age), 17% (Number), and 9% (Text/Graphic). Low-to-high transparency transfer led to choosing unreliable automation almost 60% of the time, while high-to-low transfer increased automation reliance by 13–15% (Age 72 to 85; Number 67 to 82) and improved decision NPP from about 0.47 to 0.65 for Age and about 0.49 to about 0.74 for Number.
Methods
- Design: an instance-based learning theory model integrated into ACT-R, representing experiences as {situation cues, choice made, outcome}; blended retrievals estimate expected search time and automation reliability, and the model selects the assist type with the lowest expected search time and relies on automation if it is expected to be reliable.
- Data/sample: empirical data from the COBALT aided visual search task in Fallon et al. (2019); each block included 143 trials, and 20 simulations per condition were run, comparable to the N=16 human participants; all parameters were left at default ACT-R values (decay d=0.5, activation noise s=0.25, mismatch penalty MP=1.0, linear similarities over [0,−1.0]).
- Analysis: positive and negative predictive power statistics (PPP, NPP) for decision and search phases, reliability estimates via blended retrieval, and manipulations of cue transfer and disruptions (Random, Frontload, Midload, Frontload-Positive, Frontload-Commander).
Limitations
- Stated in the paper: the single COBALT interface does not separate actual automation performance reliability from the user’s perception of reliability or performance through the interface; direct observation of automation failure may produce different calibration, and remote unmanned settings may have no or delayed additional information. Future work may explore asynchronous or time-delayed feedback.
- Evident from the text: the work is a simulation study, and the paper states that findings can inform hypotheses and that additional human-subject experiments can confirm model predictions.
- Stated in the paper: the model only represents decisions about use of automation; decisions about other task aspects, such as when to initiate a task or trial, do not inform memory for the automation’s reliability.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
0 Valid · 8 Not valid · 16 Not checked · 93 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This cognitive model matches well with the human predictive power statistics measuring reliance decisions; we obtain from the model an internal estimate of automation reliability that mirrors human subjective ratings.”
§ Adaptive Cognitive Mechanisms to Maintain Calibrated Trust and Reliance in Automation > Abstract
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This cognitive model matches well with the human predictive power statistics measuring reliance decisions; we obtain from the model an internal estimate of automation reliability that mirrors human subjective ratings.”
§ Adaptive Cognitive Mechanisms to Maintain Calibrated Trust and Reliance in Automation > Abstract
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In both types of situations, we found ways to artificially increase and decrease appropriate reliance.”
§ Adaptive Cognitive Mechanisms to Maintain Calibrated Trust and Reliance in Automation > 4 Discussion
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Estimates of automation reliability are largely unchanged because the artificial increase in reliability is canceled by the induced reliance on automation in conditions where it is not usually warranted.”
§ Adaptive Cognitive Mechanisms to Maintain Calibrated Trust and Reliance in Automation > 3 Results > 3.2 Disrupting Cue–Behavior Relationship Impacts
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Estimates of automation reliability drop by about 10% across all conditions.”
§ Adaptive Cognitive Mechanisms to Maintain Calibrated Trust and Reliance in Automation > 3 Results > 3.2 Disrupting Cue–Behavior Relationship Impacts
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
40 more claims
Create a free account to see all 117 claims and to verify the 11 references still open.
- It may state two separate claims as one. 46
- Probably not a substantial claim. 33
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Adaptive Cognitive Mechanisms to Maintain Calibrated Trust and Reliance in Automation > 3 Results > 3.2 Disrupting Cue–Behavior Relationship Impacts
“Estimates of automation reliability also decreases significantly in all conditions.”
§ Adaptive Cognitive Mechanisms to Maintain Calibrated Trust and Reliance in Automation > 3 Results
“| Baseline | 0.77 | (0.06) | 0.80 | (0.16) | 0.80 | (0.06) | 0.81 | (0.07) | | Frontload | 0.82 | (0.07) | 0.81 | (0.09) | 0.81 | (0.06) | 0.83 | (0.06) |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Adaptive Cognitive Mechanisms to Maintain Calibrated Trust and Reliance in Automation > 3 Results
“the Decision stage decision’s mean NPP value was 0.48 for both Age and Text conditions”
§ Adaptive Cognitive Mechanisms to Maintain Calibrated Trust and Reliance in Automation > 3 Results
“but 0.81 for both Text and Graphic conditions”
Citations
Cites
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605
Humans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · cited 2×
“…the cues, both types of cues and diagnosticity of cues for reliable behavior, that is, we predict that calibration of trust through transparency cues can be manipulated to cause automation overreliance and under-reliance, or automation misuse and disuse, respectively (Parasuraman and Riley, 1997).”
BackgroundAn Integrated Theory of the Mind.
Anderson, J. R., Bothell, D., Byrne, M. D., Douglass, S., Lebiere, C., & Qin, Y. (2004) · Psychological Review · doi:10.1037/0033-295x.111.4.1036 · Cited by 2,978
Self-citationUnderstanding dynamics between initial trust and usage intentions of mobile banking
Kim, G., Shin, B., & Lee, H. G. (2009) · Information Systems Journal · doi:10.1111/j.1365-2575.2007.00269.x · Cited by 1,137
A Behavioral Decision Theory Approach to Modeling Dyadic Trust in Superiors and Subordinates
Butler, J. K., & Cantrell, R. S. (1984) · Psychological Reports · doi:10.2466/pr0.1984.55.1.19 · Cited by 597
Instance‐based learning in dynamic decision making
Gonzalez, C., Lerch, J. F., & Lebiere, C. (2003) · Cognitive Science · doi:10.1207/s15516709cog2704_2 · Cited by 535
Self-citationEl-Masri, M., & Tarhini, A. (2017) · Educational Technology Research and Development · doi:10.1007/s11423-016-9508-8 · Cited by 468
Instance-based learning: Integrating sampling and repeated decisions from experience.
Gonzalez, C., & Dutt, V. (2011) · Psychological Review · doi:10.1037/a0024558 · Cited by 255
Being Transparent about Transparency: A Model for Human-Robot Interaction
Lyons, J. B. (2013) · National Conference on Artificial Intelligence · Cited by 236
Research works printed but not linked: 2
- Bliss, 2006, Active Warnings: False Alarms, 231
- 2010, DHS Risk Lexicon 2010 EditionTech. Rep
Cited by
Mehrotra, S., Degachi, C., Vereschak, O., Jonker, C. M., & Tielman, M. L. (2024) · ACM Journal on Responsible Computing · doi:10.1145/3696449 · Cited by 256
The effects of explanations on automation bias
Vered, M., Livni, T., Howe, P. D. L., Miller, T., & Sonenberg, L. (2023) · Artificial Intelligence · doi:10.1016/j.artint.2023.103952 · Cited by 112
Psychological Traits and Appropriate Reliance: Factors Shaping Trust in AI
Küper, A., & Krämer, N. (2024) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2024.2348216 · Cited by 49
“…refers to the adjustment of expectations towards automation regarding its reliability, thus, trusting a system more or trusting it less, depending on its perceived capabilities, and by doing so leading to appropriate reliance (Lebiere et al., 2021; Okamura & Yamada, 2020; Y. Zhang et al., 2020).”
Intelligent Clinical Decision Support
Pinsky, M. R., Dubrawski, A. W., & Clermont, G. (2022) · Sensors · doi:10.3390/s22041408 · Cited by 44
Küper, A., Lodde, G. C., Livingstone, E., Schadendorf, D., & Krämer, N. (2025) · Journal of Medical Internet Research · doi:10.2196/58660 · Cited by 31
“Thus, it is important to correctly calibrate trust and thereby adjust expectations about the trustworthiness of systems [26,50,51].”
Aggarwal, P., Thakoor, O., Jabbari, S., Cranford, E. A., Lebiere, C. J., Tambe, M., & González, C. (2022) · Computers & Security · doi:10.1016/j.cose.2022.102671 · Cited by 31
Self-citationEngaging with AI: How Interface Design Shapes Human-AI Collaboration in High-Stakes Decision-MakingPreprint
Chen, Z., Luo, Y., & Sra, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.16627 · Cited by 30
Saghafian, M., Vatn, D. M. K., Moltubakk, S. T., Bertheussen, L. E., Petermann, F. M., Johnsen, S. O., & Alsos, O. A. (2024) · Safety Science · doi:10.1016/j.ssci.2024.106730 · Cited by 28
Choudhury, A., & Elkefi, S. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.966174 · Cited by 23
A Computational Model of Coupled Human Trust and Self-confidence Dynamics
Williams, K. J., Yuh, M. S., & Jain, N. (2023) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3594715 · Cited by 18
“Calibration of human trust in HAI is critical to preventing the pitfalls associated with humans under-trusting, or over-trusting autonomous systems [41, 44, 54, 73].”
BackgroundTeam Situation Awareness-Based Augmented Reality Head-Up Display Design for Security Requirements
You, F., Fu, Q., Yang, J., Chen, H., Cui, W., & Wang, J. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2231281 · Cited by 17
Objective Detection of Trust in Automated Urban Air Mobility: A Deep Learning-Based ERP Analysis
Li, Y., Zhang, S., He, R., & Holzapfel, F. (2024) · Aerospace · doi:10.3390/aerospace11030174 · Cited by 14
The Influence of Interdependence on Trust Calibration in Human-Machine Teams
Verhagen, R., Marcu, A., Neerincx, M. A., & Tielman, M. L. (2024) · Frontiers in artificial intelligence and applications · doi:10.3233/faia240203 · Cited by 14
Multi-device trust transfer: Can trust be transferred among multiple devices?
Okuoka, K., Enami, K., Kimoto, M., & Imai, M. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.920844 · Cited by 13
Muzahid, A. J. M., Zhao, X., & Wang, Z. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2412.08005 · Cited by 13
ATC Human Factors Involved in RPAS Contingency Management in Non-Segregated Airspace
Reyes, A., Barrado, C., Pastor, E., & Royo, P. (2023) · Applied Sciences · doi:10.3390/app13031408 · Cited by 9
Personalized Model‐Driven Interventions for Decisions From Experience
Cranford, E. A., Lebiere, C. J., González, C., Aggarwal, P., Somers, S., Mitsopoulos, K., & Tambe, M. (2024) · Topics in Cognitive Science · doi:10.1111/tops.12758 · Cited by 8
Self-citationBuilding Human-AI Reliance Through Cognitive Engagement and Exploratory AI Assistance
Raees, M., Khan, V.-J., & Papangelis, K. (2025) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3708319.3734171 · Cited by 6
Cognitive Architectures and their Applications
Lebiere, C. J., Cranford, E. A., Martin, M., Morrison, D., & Stocco, A. (2022) · IEEE International Conference on Collaboration and Internet Computing (CIC) · doi:10.1109/cic56439.2022.00018 · Cited by 6
Self-citationThe Learning Electronic Health Record
Clermont, G. (2023) · Critical Care Clinics · doi:10.1016/j.ccc.2023.03.004 · Cited by 6
The Enterprising and Elusive Prospects of Human-AI Collaboration
Gadiraju, U., & Balayn, A. (2025) · Springer eBooks · doi:10.1007/978-3-032-01940-0_7 · Cited by 5
Zhang, D., Luo, S., Liu, Y., Zhang, X., Hu, Y., Shen, J., Yi, P., Zhao, K., & Liu, W. (2026) · Humanities and Social Sciences Communications · doi:10.1057/s41599-026-06738-7 · Cited by 5
Braun, T., & Harasimiuk, D. E. (2023) · IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB) · doi:10.1109/cibcb56990.2023.10264892 · Cited by 4
Rooseleers, L. (2023) · Lirias · Cited by 4
Trusting as an Emergent: Implications for Design
Hoffman, R. R. (2024) · Ergonomics in Design The Quarterly of Human Factors Applications · doi:10.1177/10648046241295270 · Cited by 3
Alrowaie, F. (2026) · Processes · doi:10.3390/pr14142334 · Cited by 3
Characterizing Interaction Uncertainty in Human-Machine Teams
Wenskovitch, J. E., Fallon, C. K., Miller, K. H., & Dasgupta, A. (2024) · IEEE International Conference on Human-Machine Systems (ICHMS) · doi:10.1109/ichms59971.2024.10555605 · Cited by 3
Self-citationNew Insights in Brain-Computer Interface Systems
Kashou, N. H. (2024) · Artificial intelligence · doi:10.5772/intechopen.110989 · Cited by 2
Wang, X., Guo, L., Xu, L., Guan, L., Ge, P., & Gao, T. (2026) · Ergonomics · doi:10.1080/00140139.2026.2621032 · Cited by 2
Kasmarik, K., Khani, M. M., Abpeikar, S., Barlow, M., Carter, O. L., & Irish, M. (2024) · ACM Computing Surveys · doi:10.1145/3689626 · Cited by 2
Cognitive architectures for human factors in aviation and aerospace
Gluck, K. A., & King, J. M. (2022) · Elsevier eBooks · doi:10.1016/b978-0-12-420139-2.00005-8 · Cited by 2
From AI literacy to cognitive AI safety: Rethinking safe AI use in education.
Zainuddin, Z., Churiyah, M., Xiaoyu, W., & Halili, S. H. (2026) · Interactive Technology and Smart Education · doi:10.1108/itse-12-2025-0396 · Cited by 1
Khan, A., Islam, I., Mannakkara, N. N., Noakes, D., Mansour, A., Davies, L., Marcolin, C., Aquilina, A., Dignazi, F., Parsons, S., et al. (2026) · Future Cardiology · doi:10.1080/14796678.2026.2620956 · Cited by 1
Voice Design and Trust in Automated Vehicles: Findings and a Research Agenda
Chen, J., & Zhang, Q. (2025) · IEEE International Conference on Trust, Privacy and Security in Intelligent Systems and Applications (TPS-ISA) · doi:10.1109/tps-isa67132.2025.00085 · Cited by 1
Song, F., Savulescu, J., & Dunn, M. (2026) · AI & Society · doi:10.1007/s00146-026-02909-x · Cited by 1
Human– AI Interaction Fundamentals
Margetis, G., Ntoa, S., Leonidis, A., & Stephanidis, C. (2026) · Wiley eBooks · doi:10.1002/9781394266401.ch2 · Cited by 1
Resilient Safety in Advanced Air Mobility: A Framework for Sustainable Operations
Karachalios, M. (2026) · CRC Press eBooks · doi:10.1201/9781003546306 · Cited by 1
Yoon, H. J. (2026) · VTechWorks (Virginia Tech) · Cited by 1
Decision-Making at Intersections
Sutton, R., & Vangsness, L. (2022) · IEEE International Conference on Human-Machine Systems (ICHMS) · doi:10.1109/ichms56717.2022.9980722
EXPLORING THE ATTRIBUTES OF HIGH-PERFORMANCE OF A TEAM LEADER IN BUSINESS PROCESS OUTSOURCING
Villarba, L., & Moyon, C. P. (2024) · European Journal of Human Resource Management Studies · doi:10.46827/ejhrms.v7i2.1641
Perspective Chapter: A Model for Measuring Trust Using BCI in Human-Humanoid Interaction
Sorbello, R., & Calí, C. (2024) · Artificial intelligence · doi:10.5772/intechopen.115094
Cognitive assistance in extreme environments: A qualitative lens on human-robot teaming
Balasuriya, S. S., Edgar, G., & Sitbon, L. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-29266-8.00004-9
Osei, I., Carie, A., Kanithi, L. P., & Boadu, D. O. (2026) · Frontiers in Human Dynamics · doi:10.3389/fhumd.2026.1795513
Howell, B. C., Divis, K., Coram, J. L., & Gastelum, Z. (2026) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2026.638
Gumisiriza, J., Lei, M., Zhang, S., & Shaodan, Z. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6582143
Gumisiriza, J., Lei, M., Zhang, S., & Shaodan, Z. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6582145
The Digital Librarian: Navigating Human-Robot Interaction in the Information Age
Oyedokun, T. T., & Oyedokun, T. T. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/407563
Koellner, E. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6647458
Pekarev, J., & Värno, P. (2026) · Artificial Intelligence and Applications · doi:10.47852/bonviewaia62025549
Tretten, P., Illankoon, P., & Lööw, J. (2025) · International Conference on Business Research (ICBR) · doi:10.31705/icbr.2025.18
Robotics in prosthodontics: Current applications, challenges and future directions
Ruggiero, G., Zarone, F., Sorrentino, R., Mastrosimone, A., Risi, P. D., Mancino, R., & Ficuciello, F. (2026) · Digital Dentistry Journal · doi:10.1016/j.ddj.2026.100094
AI Assurance in UK Defence: Challenges in Operationalising JSP 936Preprint
Cockburn, C., & Farrow, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.09414
Wang, X., Alves, R. R., Hu, Q., & Chen, H. (2026) · Scientific Reports · doi:10.1038/s41598-026-63139-1
Expertise in AI-Assisted Software Development
van Willigen, D. A. (2026) · TU/e Research Portal
Christopoulos, A., Mystakidis, S., Perikos, I., Bourazeri, A., Michael, A., & Laakso, M. (2026) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2026.100378
Farnsworth, E. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-7709-4.ch006
Distributive Effects of AI Support: A Framework for Analyzing Performance Shifts Within Groups
Campagner, A., Natali, C., Fregosi, C., & Cabitza, F. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37976-4_16
AI-in-the-human-loop: an operational model for mature human-AI collaboration
Casadei, R., Delnevo, G., Bassi, B., Ceccarini, C., & Mirri, S. (2026) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-026-05135-x
Knowing When to Use Automation: Task-Specific Expertise and GPS Engagement in a Navigational Task
Padilla, J. G., & Patton, C. E. (2026) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/10711813261498789
Zou, X., Chen, C., Cai, Y., & Shen, Q. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2748077
Accountability over transparency: A heuristic path to calibrated trust in LLM medical advice
Song, H., Lyu, J., Yip, H., & Cheung, C. M. K. (2026) · AI Evidence-Based Medicine · doi:10.1097/ai9.0000000000000009
XAI as a Trust Calibration Mechanism in Teleoperated Human-Agent Systems: A Conceptual Framework
Arab, A., Mualla, Y., Fessant, F., & Abbas‐Turki, A. (2026) · International Conference on Human-Agent Interaction (HAI) · doi:10.1145/3841580.3841594
Metadata
- Authors
- Lebiere, C., Blaha, L. M., Fallon, C. K., & Jefferson, B.
- Affiliations
- Carnegie Mellon University (US)
- United States Air Force Research Laboratory (US)
- Pacific Northwest National Laboratory (US)
- Corresponding author
- Lebiere, Christian
- Venue
- Frontiers in Robotics and AI
- Publisher
- Frontiers Media SA
- Published
- 2021-05-24
- Volume
- 8
- Pages
- 652776-652776
- ISSN
- 2296-9144 (ISSN-L)
- PMC
- PMC8181412
- OpenAlex
- W3164041257
- Semantic Scholar
- 487686514f14e7504c4336902ce292d158c2a812
- Cited by
- 62
- References
- 25
- Citations by year
- 2026: 29 · 2025: 6 · 2024: 13 · 2023: 7 · 2022: 7
- FWCI
- 4.17
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Robotics and AI (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (publishedVersion, cc-by)
- OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Air Force Office of Scientific Research
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Risk and Safety Analysis
- Keywords
- trust calibration, reliance on automation, human-machine teams, instance-based learning, visual search, automation reliability, automation transparency, cognitive biases, trust in automation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-18, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-18 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.