The Influence of Risky Conditions in Trust in Autonomous Systems
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
In order to utilize the full range of benefits of autonomous systems, an understanding of how operators trust an automated system is vital. The level of risk in an environment is an important factor that many have suggested affects trust in automated and autonomous systems, but it has not been studied extensively. This study aims to explore the effect differing levels of risk can have on trust in an autonomous system with individuals that vary in their own risk profile. Using a UAV management task, participants worked with an autonomous teammate to protect an area from incoming enemies. Risk was assessed by how much money a participant stood to lose by not protecting the safe zone. Results partially support the hypothesis that trust decreases with increased risk, but results vary regarding behavioral trust and subjective trust. Overall, this experiment provides evidence that risk is an important situational factor that affects trust in automation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 2×
“Lee and See (2004) define trust as an attitude that an agent, whether human or automated, will help achieve an individual’s goals in a situation that is characterized by uncertainty and vulnerability.”
BackgroundHumans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · cited 1×
“On the other hand, complete disuse of automation may lead to turning off alarms or disabling alerts, which can lead to serious accidents (Parasuraman & Riley, 1997).”
BackgroundA model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195
Trust in Automation: Integrating Empirical Evidence on Factors That Influence Trust
Hoff, K. A., & Bashir, M. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814547570 · Cited by 2,817
Evaluation of a behavioral measure of risk taking: The balloon analogue risk task (BART)
Lejuez, C. W., Read, J. P., Kahler, C. W., Richards, J. B., Ramsey, S. E., Stuart, G. L., Strong, D. R., & Brown, R. A. (2002) · Journal of Experimental Psychology: Applied · doi:10.1037/1076-898x.8.2.75 · Cited by 2,336
Deutsch, M. (1958) · Journal of Conflict Resolution · doi:10.1177/002200275800200401 · Cited by 2,077
Foundations for an Empirically Determined Scale of Trust in Automated Systems
Jian, J.-Y., Bisantz, A. M., & Drury, C. G. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0401_04 · Cited by 1,799
Performance Consequences of Automation-Induced 'Complacency'
Parasuraman, R., Molloy, R., & Singh, I. L. (1993) · The International Journal of Aviation Psychology · doi:10.1207/s15327108ijap0301_1 · Cited by 875 · cited 1×
“Blindly trusting imperfect automation can lead to overreliance and a failure to catch errors, complacency, and allocating attention away from monitoring (Bagheri & Jamieson, 2004; Bailey & Scerbo, 2007; Parasuraman et al., 1993).”
BackgroundThe Structure of Optimal Trust: Moral and Strategic Implications
Wicks, A. C., Berman, S. L., & Jones, T. M. (1999) · The Academy of Management Review · doi:10.5465/amr.1999.1580443 · Cited by 785
Affective Processes in Human–Automation Interactions
Merritt, S. M. (2011) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811411912 · Cited by 260 · cited 3×
“Following the experimental trial, participants completed two subjective trust questionnaires (Merritt, 2011; Jian et al., 2000).”
BackgroundMethod
Cited by
From ‘automation’ to ‘autonomy’: the importance of trust repair in human–machine interaction
de Visser, E. J., Pak, R., & Shaw, T. H. (2018) · Ergonomics · doi:10.1080/00140139.2018.1457725 · Cited by 398
Self-citationMeasurement of trust in automation: A narrative review and reference guide
Kohn, S. C., de Visser, E. J., Wiese, E., Lee, Y.-C., & Shaw, T. H. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.604977 · Cited by 315
Self-citationNo Risk No Trust: Investigating Perceived Risk in Highly Automated Driving
Li, M., Holthausen, B. E., Stuck, R. E., & Walker, B. N. (2019) · Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications · doi:10.1145/3342197.3344525 · Cited by 80
“Therefore, a certain level of uncertainty about automation functionality is inherent when interacting with automated vehicles [24].”
Background(2021) · doi:10.1145/3461778.3461997 · Cited by 14
“The majority of the studies concluded that users’ trust in autonomous agents is inversely related to the degree of risk associated with the scenario [40, 56, 60].”
Background
Metadata
- Authors
- Satterfield, K., Baldwin, C., de Visser, E., & Shaw, T.
- Venue
- Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Publisher
- SAGE Publications
- Published
- 2017-09
- Volume
- 61
- Issue
- 1
- Pages
- 324-328
- ISSN
- 0163-5182 (ISSN-L)
- 1071-1813
- 2169-5067
- OpenAlex
- W2760796303
- Cited by
- 39
- References
- 11
- FWCI
- 2.63
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Influence of Risky Conditions in Trust in Autonomous Systems. https://app.cochat.ai/papers/10.1177/1541931213601562
- The paper
- Satterfield, K., Baldwin, C., de Visser, E., & Shaw, T. (2017). The Influence of Risky Conditions in Trust in Autonomous Systems. Proceedings of the Human Factors and Ergonomics Society Annual Meeting. https://doi.org/10.1177/1541931213601562
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.