The DOI matches its Crossref record; 24 of the 25 references it cites were found in a registry or an index; none of the 17 sources its claims cite is checked for support yet.
Adaptive Cognitive Mechanisms to Maintain Calibrated Trust and Reliance in Automation
Open accessAbstract
Trust calibration for a human–machine team is the process by which a human adjusts their expectations of the automation’s reliability and trustworthiness; adaptive support for trust calibration is needed to engender appropriate reliance on automation. Herein, we leverage an instance-based learning ACT-R cognitive model of decisions to obtain and rely on an automated assistant for visual search in a UAV interface. This cognitive model matches well with the human predictive power statistics measuring reliance decisions; we obtain from the model an internal estimate of automation reliability that mirrors human subjective ratings. The model is able to predict the effect of various potential disruptions, such as environmental changes or particular classes of adversarial intrusions on human trust in automation. Finally, we consider the use of model predictions to improve automation transparency that account for human cognitive biases in order to optimize the bidirectional interaction between human and machine through supporting trust calibration. The implications of our findings for the design of reliable and trustworthy automation are discussed.
Overview
CoChat Summary
TL;DR
The paper presents an instance-based learning ACT-R cognitive model of trust calibration and reliance decisions in an automation-aided visual search task, showing it reproduces human predictive-power statistics and subjective reliability ratings. It then uses the model to predict how transparency changes and adversarial disruptions can cause over- or under-reliance on automation.
Key findings
- Baseline model selected Automation about 72% of the time in the Age condition, 67% in Number, and 82% in both Text and Graphic; decision-stage mean PPP was 0.77 for Age, 0.79 for Number, and 0.82 for Text and Graphic.
- Model reliability estimates were 0.77 (Age), 0.80 (Number), 0.80 (Text), and 0.81 (Graphic), roughly matching human subjective ratings of 0.75, 0.74, 0.82, and 0.80.
- A Random disruption (10% of automation-selected trials, reducing overall reliability from 70% to about 63%) increased Commander choice by about 12% in Age, 8% in Number, and 8% in Text/Graphic; Frontload increased Commander choice by 9% in Age/Number and 7% in Text/Graphic versus Random.
- Frontload-Positive decreased Commander reliance by 12% (Age), 10% (Number), and 6% (Text/Graphic); Frontload-Commander decreased Commander reliance by 18% (Age), 17% (Number), and 9% (Text/Graphic). Low-to-high transparency transfer led to choosing unreliable automation almost 60% of the time, while high-to-low transfer increased automation reliance by 13–15% (Age 72 to 85; Number 67 to 82) and improved decision NPP from about 0.47 to 0.65 for Age and about 0.49 to about 0.74 for Number.
Methods
- Design: an instance-based learning theory model integrated into ACT-R, representing experiences as {situation cues, choice made, outcome}; blended retrievals estimate expected search time and automation reliability, and the model selects the assist type with the lowest expected search time and relies on automation if it is expected to be reliable.
- Data/sample: empirical data from the COBALT aided visual search task in Fallon et al. (2019); each block included 143 trials, and 20 simulations per condition were run, comparable to the N=16 human participants; all parameters were left at default ACT-R values (decay d=0.5, activation noise s=0.25, mismatch penalty MP=1.0, linear similarities over [0,−1.0]).
- Analysis: positive and negative predictive power statistics (PPP, NPP) for decision and search phases, reliability estimates via blended retrieval, and manipulations of cue transfer and disruptions (Random, Frontload, Midload, Frontload-Positive, Frontload-Commander).
Limitations
- Stated in the paper: the single COBALT interface does not separate actual automation performance reliability from the user’s perception of reliability or performance through the interface; direct observation of automation failure may produce different calibration, and remote unmanned settings may have no or delayed additional information. Future work may explore asynchronous or time-delayed feedback.
- Evident from the text: the work is a simulation study, and the paper states that findings can inform hypotheses and that additional human-subject experiments can confirm model predictions.
- Stated in the paper: the model only represents decisions about use of automation; decisions about other task aspects, such as when to initiate a task or trial, do not inform memory for the automation’s reliability.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
0 Valid · 8 Not valid · 16 Not checked · 93 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This cognitive model matches well with the human predictive power statistics measuring reliance decisions; we obtain from the model an internal estimate of automation reliability that mirrors human subjective ratings.”
§ Adaptive Cognitive Mechanisms to Maintain Calibrated Trust and Reliance in Automation > Abstract
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This cognitive model matches well with the human predictive power statistics measuring reliance decisions; we obtain from the model an internal estimate of automation reliability that mirrors human subjective ratings.”
§ Adaptive Cognitive Mechanisms to Maintain Calibrated Trust and Reliance in Automation > Abstract
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In both types of situations, we found ways to artificially increase and decrease appropriate reliance.”
§ Adaptive Cognitive Mechanisms to Maintain Calibrated Trust and Reliance in Automation > 4 Discussion
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Estimates of automation reliability are largely unchanged because the artificial increase in reliability is canceled by the induced reliance on automation in conditions where it is not usually warranted.”
§ Adaptive Cognitive Mechanisms to Maintain Calibrated Trust and Reliance in Automation > 3 Results > 3.2 Disrupting Cue–Behavior Relationship Impacts
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Estimates of automation reliability drop by about 10% across all conditions.”
§ Adaptive Cognitive Mechanisms to Maintain Calibrated Trust and Reliance in Automation > 3 Results > 3.2 Disrupting Cue–Behavior Relationship Impacts
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
40 more claims
Create a free account to see all 117 claims and to verify the 11 references still open.
- It may state two separate claims as one. 46
- Probably not a substantial claim. 33
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Adaptive Cognitive Mechanisms to Maintain Calibrated Trust and Reliance in Automation > 3 Results > 3.2 Disrupting Cue–Behavior Relationship Impacts
“Estimates of automation reliability also decreases significantly in all conditions.”
§ Adaptive Cognitive Mechanisms to Maintain Calibrated Trust and Reliance in Automation > 3 Results
“| Baseline | 0.77 | (0.06) | 0.80 | (0.16) | 0.80 | (0.06) | 0.81 | (0.07) | | Frontload | 0.82 | (0.07) | 0.81 | (0.09) | 0.81 | (0.06) | 0.83 | (0.06) |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Adaptive Cognitive Mechanisms to Maintain Calibrated Trust and Reliance in Automation > 3 Results
“the Decision stage decision’s mean NPP value was 0.48 for both Age and Text conditions”
§ Adaptive Cognitive Mechanisms to Maintain Calibrated Trust and Reliance in Automation > 3 Results
“but 0.81 for both Text and Graphic conditions”
Citations
Cites
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605
Humans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · cited 2×
“…the cues, both types of cues and diagnosticity of cues for reliable behavior, that is, we predict that calibration of trust through transparency cues can be manipulated to cause automation overreliance and under-reliance, or automation misuse and disuse, respectively (Parasuraman and Riley, 1997).”
BackgroundAn Integrated Theory of the Mind.
Anderson, J. R., Bothell, D., Byrne, M. D., Douglass, S., Lebiere, C., & Qin, Y. (2004) · Psychological Review · doi:10.1037/0033-295x.111.4.1036 · Cited by 2,978
Self-citationUnderstanding dynamics between initial trust and usage intentions of mobile banking
Kim, G., Shin, B., & Lee, H. G. (2009) · Information Systems Journal · doi:10.1111/j.1365-2575.2007.00269.x · Cited by 1,137
A Behavioral Decision Theory Approach to Modeling Dyadic Trust in Superiors and Subordinates
Butler, J. K., & Cantrell, R. S. (1984) · Psychological Reports · doi:10.2466/pr0.1984.55.1.19 · Cited by 597
Instance‐based learning in dynamic decision making
Gonzalez, C., Lerch, J. F., & Lebiere, C. (2003) · Cognitive Science · doi:10.1207/s15516709cog2704_2 · Cited by 535
Self-citationEl-Masri, M., & Tarhini, A. (2017) · Educational Technology Research and Development · doi:10.1007/s11423-016-9508-8 · Cited by 468
Instance-based learning: Integrating sampling and repeated decisions from experience.
Gonzalez, C., & Dutt, V. (2011) · Psychological Review · doi:10.1037/a0024558 · Cited by 255
Being Transparent about Transparency: A Model for Human-Robot Interaction
Lyons, J. B. (2013) · National Conference on Artificial Intelligence · Cited by 236
Complacency and Automation Bias in the Use of Imperfect Automation
Wickens, C. D., Clegg, B. A., Vieane, A. Z., & Sebok, A. L. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720815581940 · Cited by 176
System reliability, performance and trust in adaptable automation
Chavaillaz, A., Wastell, D. G., & Sauer, J. (2015) · Applied Ergonomics · doi:10.1016/j.apergo.2015.07.012 · Cited by 135
A Functional Model of Sensemaking in a Neurocognitive Architecture
Lebiere, C. J., Pirolli, P. L. T., Thomson, R., Paik, J., Rutledge-Taylor, M. F., Staszewski, J. J., & Anderson, J. R. (2013) · Computational Intelligence and Neuroscience · doi:10.1155/2013/921695 · Cited by 100
Self-citationAnesthesia Alarms in Context: An Observational Study
Seagull, F. J., & Sanderson, P. M. (2001) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872001775992453 · Cited by 99
Automation bias, accountability, and verification behaviors
Mosier, K. L., Skitka, L. J., Burdick, M. D., & Heers, S. T. (1996) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193129604000413 · Cited by 89
Instance-Based Decision Making Model of Repeated Binary Choice
Lebiere, C., Gonzalez, C., & Martin, M. (2018) · KiltHub Repository · doi:10.1184/r1/6571190 · Cited by 56
Self-citationGrover, S. L., Hasel, M. C., Manville, C., & Serrano-Archimi, C. (2014) · European Management Journal · doi:10.1016/j.emj.2014.01.002 · Cited by 50
Toward Personalized Deceptive Signaling for Cyber Defense Using Cognitive Models
Cranford, E. A., González, C., Aggarwal, P., Cooney, S., Tambe, M., & Lebiere, C. J. (2020) · Topics in Cognitive Science · doi:10.1111/tops.12513 · Cited by 44
Self-citationMatthews, G. (2020) · Personality and Individual Differences · doi:10.1016/j.paid.2020.110083 · Cited by 41
Adaptive Cyber Deception: Cognitively Informed Signaling for Cyber Defense
Cranford, E. A., González, C., Aggarwal, P., Cooney, S., Tambe, M., & Lebiere, C. J. (2020) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2020.232 · Cited by 39
Self-citationNo Effect of Cue Format on Automation Dependence in an Aided Signal Detection Task
Bartlett, M. L., & McCarley, J. S. (2018) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720818802961 · Cited by 34
What did you expect? CREAM analysis of hazardous incidents occurring on approach to rail signals
Phillips, R. O., & Sagberg, F. (2014) · Safety Science · doi:10.1016/j.ssci.2014.02.003 · Cited by 25
Fallon, C. K., Blaha, L. M., Jefferson, B. A., & Franklin, L. R. (2019) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181319631436 · Cited by 1
Self-citationModifying sensitivity/specificity for sensors using positive and negative predictive power measures
Repperger, D. W., Warm, J. S., Havig, P. R., Vidulich, M. A., & Finomore, V. S. (2009) · Proceedings of the IEEE 2009 National Aerospace & Electronics Conference (NAECON) · doi:10.1109/naecon.2009.5426630
Research works printed but not linked: 2
- Bliss, 2006, Active Warnings: False Alarms, 231
- 2010, DHS Risk Lexicon 2010 EditionTech. Rep
Cited by
Mehrotra, S., Degachi, C., Vereschak, O., Jonker, C. M., & Tielman, M. L. (2024) · ACM Journal on Responsible Computing · doi:10.1145/3696449 · Cited by 254
The effects of explanations on automation bias
Vered, M., Livni, T., Howe, P. D. L., Miller, T., & Sonenberg, L. (2023) · Artificial Intelligence · doi:10.1016/j.artint.2023.103952 · Cited by 112
Psychological Traits and Appropriate Reliance: Factors Shaping Trust in AI
Küper, A., & Krämer, N. (2024) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2024.2348216 · Cited by 49
“…refers to the adjustment of expectations towards automation regarding its reliability, thus, trusting a system more or trusting it less, depending on its perceived capabilities, and by doing so leading to appropriate reliance (Lebiere et al., 2021; Okamura & Yamada, 2020; Y. Zhang et al., 2020).”
Intelligent Clinical Decision Support
Pinsky, M. R., Dubrawski, A. W., & Clermont, G. (2022) · Sensors · doi:10.3390/s22041408 · Cited by 44
Küper, A., Lodde, G. C., Livingstone, E., Schadendorf, D., & Krämer, N. (2025) · Journal of Medical Internet Research · doi:10.2196/58660 · Cited by 31
“Thus, it is important to correctly calibrate trust and thereby adjust expectations about the trustworthiness of systems [26,50,51].”
Metadata
- Authors
- Lebiere, C., Blaha, L. M., Fallon, C. K., & Jefferson, B.
- Affiliations
- Carnegie Mellon University (US)
- United States Air Force Research Laboratory (US)
- Pacific Northwest National Laboratory (US)
- Corresponding author
- Lebiere, Christian
- Venue
- Frontiers in Robotics and AI
- Publisher
- Frontiers Media SA
- Published
- 2021-05-24
- Volume
- 8
- Pages
- 652776-652776
- ISSN
- 2296-9144 (ISSN-L)
- PMC
- PMC8181412
- OpenAlex
- W3164041257
- Semantic Scholar
- 487686514f14e7504c4336902ce292d158c2a812
- Cited by
- 62
- References
- 25
- Citations by year
- 2026: 29 · 2025: 6 · 2024: 13 · 2023: 7 · 2022: 7
- FWCI
- 4.17
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Robotics and AI (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (publishedVersion, cc-by)
- OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Air Force Office of Scientific Research
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Risk and Safety Analysis
- Keywords
- trust calibration, reliance on automation, human-machine teams, instance-based learning, visual search, automation reliability, automation transparency, cognitive biases, trust in automation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-18, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-18 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.