Human Trust-Based Feedback Control: Dynamically Varying Automation Transparency to Optimize Human-Machine Interactions
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
Aomation has become prevalent in the everyday lives of humans. However, despite significant technological advancements, human supervision and intervention are still necessary in almost all sectors of automation, ranging from manufacturing and transportation to disaster management and health care [1]. Therefore, it is expected that the future will be built around human?agent collectives [2] that will require efficient and successful interaction and coordination between humans and machines. It is well established that, to achieve this coordination, human trust in automation plays a central role [3]-[5]. For example, the benefits of automation are lost when humans override it due to a fundamental lack of trust [3], [5], and accidents may occur due to human mistrust in such systems [6]. Therefore, trust should be appropriately calibrated to avoid the disuse or misuse of automation [4].
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Markov decision processes: Discrete stochastic dynamic programming
Hazeghi, K., & Puterman, M. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291177 · Cited by 8,037
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 2×
“To fill this gap, researchers have proposed both deterministic models [4], [11], [39]–[44] and probabilistic models [14], [33], [45] of human trust dynamics.”
BackgroundAn introduction to hidden Markov models
Rabiner, L., & Juang, B. (1986) · IEEE ASSP Magazine · doi:10.1109/massp.1986.1165342 · Cited by 4,775
A model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 2×
“They correspond to the four information-processing stages of humans: (1) information acquisition (sensory processing), (2) information analysis (perception), (3) decision and action selection (decision-making), and (4) action implementation (response selection) [18], [19].”
BackgroundAnanny, M., & Crawford, K. (2018) · New Media & Society · doi:10.1177/1461444816676645 · Cited by 1,836 · cited 1×
“Furthermore, too much detail communicated through higher transparency can increase the time required to process the information [25] and distract the human from critical details [32].”
BackgroundFoundations for an Empirically Determined Scale of Trust in Automated Systems
Jian, J.-Y., Bisantz, A. M., & Drury, C. G. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0401_04 · Cited by 1,799
Trust, control strategies and allocation of function in human-machine systems
LEE, J., & MORAY, N. (1992) · Ergonomics · doi:10.1080/00140139208967392 · Cited by 1,459
MUIR, B. M., & MORAY, N. (1996) · Ergonomics · doi:10.1080/00140139608964474 · Cited by 993
MUIR, B. M. (1994) · Ergonomics · doi:10.1080/00140139408964957 · Cited by 873
Merritt, S. M., & Ilgen, D. R. (2008) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x288574 · Cited by 527 · cited 1×
“This is consistent with findings that recent widespread use of automation has led to humans trusting a system when they have no experience with it [69].”
ResultThe benefits of imperfect diagnostic automation: a synthesis of the literature
Wickens, C. D., & Dixon, S. R. (2007) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220500370105 · Cited by 423 · cited 1×
“Nevertheless, even imperfect acquisition and analysis automation at a reliability as low as 70% , can improve performance as compared to unaided human performance [20].”
BackgroundIntelligent agent transparency in human–agent teaming for multi-UxV management
Mercado, J. E., Rupp, M. A., Chen, J. Y. C., Barnes, M. J., Barber, D., & Procci, K. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720815621206 · Cited by 403 · cited 2×
“Researchers have developed various models of human trust [11]–[14] and have also shown that transparency has a significant effect on trust [8], [9] as well as workload [10], [15].”
BackgroundHumans: Still Vital After All These Years of Automation
Parasuraman, R., & Wickens, C. D. (2008) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x312198 · Cited by 401 · cited 1×
“They correspond to the four information-processing stages of humans: (1) information acquisition (sensory processing), (2) information analysis (perception), (3) decision and action selection (decision-making), and (4) action implementation (response selection) [18], [19].”
Backgroundde Vries, P., Midden, C., & Bouwhuis, D. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00039-9 · Cited by 264 · cited 1×
“On the other hand, regression models [37], [38] quantitatively capture trust but do not consider its dynamic response characteristics.”
BackgroundReaction Time Distribution Analysis of Neuropsychological Performance in an ADHD Sample
Hervey, A. S., Epstein, J. N., Curry, J. F., Tonev, S., Eugene Arnold, L., Keith Conners, C., Hinshaw, S. P., Swanson, J. M., & Hechtman, L. (2006) · Child Neuropsychology · doi:10.1080/09297040500499081 · Cited by 262 · cited 1×
“One of the most widely employed distribution for RT data has been an exponentially modified Gaussian (or ex-Gaussian) distribution [64], [77]–[83], defined as the convolution of an exponential distribution with a Gaussian distribution.”
Backgroundadaptive aiding for human/computer control
Rouse, W. B. (1988) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872088803000405 · Cited by 252
Planning with Trust for Human-Robot Collaboration
Chen, M., Nikolaidis, S., Soh, H., Hsu, D., & Srinivasa, S. (2018) · Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/3171221.3171264 · Cited by 221
Gao, J., & Lee, J. D. (2006) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/tsmca.2005.855783 · Cited by 124
Research works printed but not linked: 67
- 10.3389/fpsyg.2013.00647 · DOI
- 10.18637/jss.v067.i01 · DOI · Paper page
- 2018, R A Language and Environment for Statistical Computing
- cassandra, 0, Acting optimally in partially observable stochastic domains, Proc AAAI, 94, 1023
- 10.1002/9781118557426 · DOI
- 10.3389/fpsyg.2018.00612 · DOI
- 10.1006/ijhc.1994.1007 · DOI · Paper page
- 10.1177/014233129902100408 · DOI · Paper page
- 10.1007/s00766-017-0265-y · DOI · Paper page
- 10.1007/978-3-319-21067-4_24 · DOI
- desai, 2012, Modeling Trust to Improve Human-robot Interaction
- 10.1080/00221309.2013.817964 · DOI
- 10.1080/87565641.2011.650809 · DOI · Paper page
- crundall, 1999, Peripheral detection rates in drivers, Vis Veh, 7, 261
- 10.1016/j.ergon.2007.08.018 · DOI
- 10.1016/S0001-4575(03)00014-9 · DOI · Paper page
- 10.5555/2936924.2937071 · doi:10.5555/2936924.2937071
- 10.1037/0096-3445.128.1.32 · doi:10.1037/0096-3445.128.1.32 · Paper page
- 10.1145/506443.506619 · DOI · Paper page
- 10.1007/BF03395630 · DOI · Paper page
- shaughnessy, 2012, Research Methods in Psychology
- 10.1109/HRI.2016.7451741 · DOI · Paper page
- 0, Amazon Mechanical Turk—Welcome
- 10.1145/2629559 · DOI · Paper page
- 10.1007/978-3-319-40533-9 · DOI
- hancock, 0, An adaptive human-machine system, Proc IEEE Conf Systems Man and Cybernetics, 15, 627
- 10.3389/fnbot.2018.00083 · DOI · Paper page
- parasuraman, 1992, Theory and Design of Adaptive Automation in Aviation Systems
- 10.1109/CEC-EEE.2006.14 · DOI
- 10.1109/ICDEW.2007.4401070 · DOI · Paper page
- 10.5555/2900929.2901002 · doi:10.5555/2900929.2901002
- 10.1109/TASE.2016.2530623 · DOI
- 10.1037/0033-2909.109.2.340 · doi:10.1037/0033-2909.109.2.340 · Paper page
- 10.20982/tqmp.04.1.p035 · DOI · Paper page
- 10.1016/j.aap.2007.08.012 · DOI · Paper page
- 10.3141/1621-06 · DOI
- 10.1145/257089.257119 · DOI
- 10.1080/10439463.1994.9964679 · DOI · Paper page
- luce, 1986, Response Times Their Role in Inferring Elementary Mental Organization
- proctor, 2018, Human Factors in Simple and Complex Systems
- 10.1109/CSE.2009.297 · DOI
- 10.3390/ijerph14020203 · DOI
- 10.1037/1076-898X.6.1.44 · doi:10.1037/1076-898x.6.1.44 · Paper page
- moe, 0, Learning trust in dynamic multiagent environments using HMMs, Proc 13th Nordic Workshop Secure IT Systems 2008 (NordSec 2008)
- 10.1007/978-3-642-10383-4_42 · DOI
- xu, 2015, OPTIMo: Online Probabilistic Trust Inference Model for Asymmetric Human-Robot Collaborations, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI) HRI, 221
- 10.1016/S1570-6672(10)60129-8 · DOI
- ja«skowski, 1983, Distribution of the human reaction time measurements, Acta Neurobiol Exp, 43, 221
- 10.1016/0022-2496(65)90014-3 · DOI
- akash, 0, Improving human–machine collaboration through transparency-based feedback—Part I: Human trust and workload model, Proc IFAC Conf Cyber Phys Hum Syst, 315
- akash, 0, Improving human-machine collaboration through transparency-based feedback—Part II: Control design and synthesis, Proc IFAC Conf Cyber Phys Hum Syst, 322
- 10.1518/hfes.46.1.50.30392 · doi:10.1518/hfes.46.1.50.30392 · Paper page
- 10.1016/S0020-7373(87)80013-5 · DOI · Paper page
- richtel, 2015, Google's driverless cars run into problem Cars with drivers
- 10.1037/h0021740 · DOI · Paper page
- 10.1518/155723405783703082 · DOI · Paper page
- 10.1109/WHC.2009.4810835 · DOI
- 10.21236/ADA600351 · DOI · Paper page
- helldin, 2014, Transparency for future semi-automated systems Effects of transparency on operator performance workload and trust
- elsalamouny, 0, HMM-based trust model, Proc of the 3rd International Workshop on Formal Aspects in Security and Trust, 21
- cohen, 0, Trust in decision aids: A model and its training implications, Proc Command and Control Research and Technology Symp, 1
- 10.5555/1630659.1630806 · doi:10.5555/1630659.1630806
- 10.1109/HAPTIC.2003.1191253 · DOI
- 10.1037/0033-295X.83.3.190 · doi:10.1037/0033-295x.83.3.190 · Paper page
- 10.23919/ACC.2017.7963172 · DOI · Paper page
- 10.3233/WIA-130260 · DOI
- 10.1109/THMS.2018.2874188 · DOI · Paper page
Cited by
A Review on Human–Machine Trust Evaluation: Human-Centric and Machine-Centric Perspectives
Gebru, B., Zeleke, L., Blankson, D., Nabil, M., Nateghi, S., Homaifar, A., & Tunstel, E. (2022) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2022.3144956 · Cited by 101
“They further expanded their experiments [66] to dynamically vary and calibrate automation”
BackgroundBobko, P., Hirshfield, L., Eloy, L., Spencer, C., Doherty, E., Driscoll, J., & Obolsky, H. (2023) · Theoretical Issues in Ergonomics Science · doi:10.1080/1463922x.2022.2086644 · Cited by 33
A Computational Model of Coupled Human Trust and Self-confidence Dynamics
Williams, K. J., Yuh, M. S., & Jain, N. (2023) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3594715 · Cited by 18
“For example, models enabling cognitive state estimation and prediction could be used by automation to appropriately trigger system responses through methods such as transparency adaptation, automation behavior adaptation, or lexible autonomy[5, 38].”
BackgroundMethodInfluentialSelf-citationFormal Methods for Autonomous Systems
Wongpiromsarn, T., Ghasemi, M., Cubuktepe, M., Bakirtzis, G., Carr, S., Karabag, M. O., Neary, C., Gohari, P., & Topcu, U. (2023) · Foundations and Trends® in Systems and Control · doi:10.1561/2600000029 · Cited by 17
McMahon, G., Akash, K., Reid, T., & Jain, N. (2020) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2021.04.113 · Cited by 10
Self-citation
Metadata
- Authors
- Akash, K., McMahon, G., Reid, T., & Jain, N.
- Venue
- IEEE Control Systems
- Published
- 2020-12
- Volume
- 40
- Issue
- 6
- Pages
- 98-116
- ISSN
- 1066-033X (ISSN-L)
- 1941-000X
- OpenAlex
- W3040259477
- Cited by
- 72
- References
- 18
- FWCI
- 8.20
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.