Behavioral Measurement of Trust in Automation: The Trust Fall
The DOI matches its Crossref record; 24 of the 25 references it cites were found in a registry or an index.
Abstract
Stating that one trusts a system is markedly different from demonstrating that trust. To investigate trust in automation, we introduce the trust fall: a two-stage behavioral test of trust. In the trust fall paradigm, first the one learns the capabilities of the system, and in the second phase, the ‘fall,’ one’s choices demonstrate trust or distrust. Our first studies using this method suggest the value of measuring behaviors that demonstrate trust, compared with self-reports of one’s trust. Designing interfaces that encourage appropriate trust in automation will be critical for the safe and successful deployment of partially automated vehicles, and this will rely on a solid understanding of whether these interfaces actually inspire trust and encourage supervision.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, research has shown that subjective trust can be a poor predictor of actual reliance (Dzindolet et al., 2003; Miller et al., 2016; Papenmeier et al., 2022).”
From Exploring the effects of human-centered AI explanations on trust and reliance (2023) · cites this paper as Miller et al., 2016
In the citing paper
“people may claim to trust an AI system, yet behave in a way that suggests they do not (Miller et al., 2016).”
From Exploring the effects of human-centered AI explanations on trust and reliance (2023) · cites this paper as Miller et al., 2016
In the citing paper
“Prior work has highlighted that appropriate trust and reliance play a critical role in achieving complementary human-AI team performance [58, 90, 139, 141].”
From Dealing with Uncertainty: Understanding the Impact of Prognostic Versus Diagnostic Tasks on Trust and Reliance in Human-AI Decision Making (2024) · cites this paper as [90]
In the citing paper
“These parameters are commonly adapted in literature to capture the level of reliance within the human-AI interaction context.”
From Dealing with Uncertainty: Understanding the Impact of Prognostic Versus Diagnostic Tasks on Trust and Reliance in Human-AI Decision Making (2024) · cites this paper as [90]
In the citing paper
“However, this fnding supports that the subjective nature of trust in the AI system does not always follow the objective measure of reliance on the AI system [90, 114].”
From Dealing with Uncertainty: Understanding the Impact of Prognostic Versus Diagnostic Tasks on Trust and Reliance in Human-AI Decision Making (2024) · cites this paper as [90]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736 · cited 1×
“This definition is based on that used by Verberne et al. (2015), which in turn was derived from the definition by Mayer et al. (1995), who describe trust as “the willingness to be vulnerable to the actions of another party.””
MethodTrust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 2×
“A key challenge from a design standpoint is designing systems that individuals will trust appropriately; granting the system agency when appropriate, and taking control when human action may be warranted (J. D. Lee & See, 2004).”
Background(1997) · Choice Reviews Online · doi:10.5860/choice.34-3702 · Cited by 4,887
Humans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · cited 1×
“(Parasuraman & Riley, 1997; Sheridan, 2006).”
Machines and Mindlessness: Social Responses to Computers
Nass, C., & Moon, Y. (2000) · Journal of Social Issues · doi:10.1111/0022-4537.00153 · Cited by 4,022
Nass, C., Steuer, J., & Tauber, E. R. (1994) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/191666.191703 · Cited by 2,148 · cited 1×
“Pioneering work by Reeves and Nass (1996), Nass and Moon (2000), and Nass et al. (1994) suggests that humans nonconsciously treat computers and robotic systems as humanlike entities, developing a relationship through interaction.”
A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction
Hancock, P. A., Billings, D. R., Schaefer, K. E., Chen, J. Y. C., de Visser, E. J., & Parasuraman, R. (2011) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811417254 · Cited by 2,051 · cited 1×
“The behavior of the automated system is communicative by itself, with visual and audible channels along with environmental factors occupying a secondary role in trust model formation (Hancock et al., 2011; Ju, 2014).”
BackgroundFoundations for an Empirically Determined Scale of Trust in Automated Systems
Jian, J.-Y., Bisantz, A. M., & Drury, C. G. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0401_04 · Cited by 1,799
Lee, K. M. (2004) · Communication Theory · doi:10.1111/j.1468-2885.2004.tb00302.x · Cited by 1,631
Self-citationSome observations on mental models
Norman, D. A. (1983) · Medical Entomology and Zoology · Cited by 1,549
Blascovich, J., Loomis, J., Beall, A. C., Swinth, K. R., Hoyt, C. L., & Bailenson, J. N. (2002) · Psychological Inquiry · doi:10.1207/s15327965pli1302_01 · Cited by 1,280
Mental Models in Cognitive Science
Johnson-Laird, P. N. (1980) · Cognitive Science · doi:10.1016/s0364-0213(81)80005-5 · Cited by 1,273
Human and Computer Control of Undersea Teleoperators
Sheridan, T. B., & Verplank, W. L. (1978) · doi:10.21236/ada057655 · Cited by 1,227 · cited 1×
“Considering that in the near future automated driving systems will require human oversight and intervention in some situations, humans will need to act in a supervisory control role (Sheridan, 2006; Sheridan & Verplank, 1978).”
BackgroundMUIR, B. M., & MORAY, N. (1996) · Ergonomics · doi:10.1080/00140139608964474 · Cited by 993 · cited 1×
“Much of the research into trust in automation has been performed in a third-person frame, where the participant has no perception of direct risk in case of automation failure (J. D. Lee, 1991; Muir & Moray, 1996).”
BackgroundFilho, S. L., & Kane, B. T. (2016) · National Conference on Artificial Intelligence · Cited by 576
Young, M. S., & Stanton, N. A. (2002) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/0018720024497709 · Cited by 404 · cited 1×
“In a real critical situation, one may not have sufficient time or cognitive resources (Young & Stanton, 2002) available to make a reasoned decision, thus systems need to be designed so to avoid drivers inadvertently defeating safety features.”
BackgroundCognitive technologies: The design of joint human-machine cognitive systems
Woods, D. D. (1986) · AI Magazine · doi:10.1609/aimag.v6i4.511 · Cited by 183 · cited 1×
“This adaptive automation can be considered a joint-cognitive system (Woods, 1985), requiring sophisticated computing and in-vehicle sensing in order to determine driver state, in addition to developing a knowledge of the driver’s capabilities over time.”
BackgroundMcGehee, D. V., Mazzae, E. N., & Baldwin, G. H. S. (2000) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120004402026 · Cited by 178 · cited 1×
“Vehicle simulation has been shown to elicit similar reactions to on-road testing in critical situations (McGehee, Mazzae, & Baldwin, 2000), and the trust fall relies on the driver being highly present in the virtual environment, reacting as if threats to safety were real.”
MethodThe Design of Implicit Interactions
Ju, W. G. (2015) · Synthesis lectures on human-centered informatics · doi:10.2200/s00619ed1v01y201412hci028 · Cited by 116
Self-citationTrusting a Virtual Driver That Looks, Acts, and Thinks Like You
Verberne, F. M. F., Ham, J., & Midden, C. J. H. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720815580749 · Cited by 101 · cited 1×
“This definition is based on that used by Verberne et al. (2015), which in turn was derived from the definition by Mayer et al. (1995), who describe trust as “the willingness to be vulnerable to the actions of another party.””
MethodSheridan, T. B. (2006) · Wiley eBooks · doi:10.1002/0470048204.ch38 · Cited by 50
MEASURING TRUST OF HUMAN OPERATORS IN NEW GENERATION RESCUE ROBOTS
PARK, E., JENKINS, Q., & JIANG, X. (2008) · Proceedings of the JFPS International Symposium on Fluid Power · doi:10.5739/isfp.2008.489 · Cited by 39 · cited 1×
“High uncertainty situations, where an automated system will have difficulty determining a course of action, are common in the automotive field (Park, Jenkins, & Jiang, 2008), and human action may be required in order to resolve the ambiguities successfully.”
BackgroundMiller, D., & Ju, W. G. (2015) · National Conference on Artificial Intelligence · Cited by 17
Self-citationThe Dynamics of Trust in a Supervisory Control Simulation
Lee, J. D. (1991) · Proceedings of the Human Factors Society Annual Meeting · doi:10.1177/154193129103501712 · Cited by 15 · cited 1×
“Much of the research into trust in automation has been performed in a third-person frame, where the participant has no perception of direct risk in case of automation failure (J. D. Lee, 1991; Muir & Moray, 1996).”
Background
Research works printed but not linked: 5
- IJsselsteijn W. A., de Ridder H., Freeman J., Avons S. E. (2000). Presence: concept, determinants, and measurement (Vol. 3959, pp. 520–529).
- 10.1207/s15516709cog0401_4 · DOI
- Kahneman D., 2011, Thinking, fast and slow
- Norman D. A., 1983, Mental Models, 7, 7
- Woods D. D., 1985, AI Magazine, 6, 86
Cited by
Human trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921
“Although many researchers invested in developing new scales and behavioral measures for trust (Bartneck et al., 2009; Charalambous, Fletcher, & Webb, 2016; Headleand, Jackson, Williams, Priday, Teahan, &ApCenydd, 2016; Ho &MacDorman, 2010; Miller et al., 2016; Ullman & Malle, 2018; Walker, Verwey, &Martens, 2018), the…”
BackgroundAutomation, Algorithms, and Beyond: Why Work Design Matters More Than Ever in a Digital World
Parker, S. K., & Grote, G. (2022) · Applied Psychology · doi:10.1111/apps.12241 · Cited by 960
Trust and reliance on AI — An experimental study on the extent and costs of overreliance on AI
Klingbeil, A., Grützner, C., & Schreck, P. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108352 · Cited by 450
How can humans understand their automated cars? HMI principles, problems and solutions
Carsten, O., & Martens, M. H. (2019) · Cognition, Technology & Work · doi:10.1007/s10111-018-0484-0 · Cited by 284
“This difference between opinions as measured via questionnaires and signs of trust when experiencing automated driving has also been described as the Trust Fall (Miller et al. 2016).”
Kraus, J., Scholz, D., Stiegemeier, D., & Baumann, M. (2020) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720819853686 · Cited by 276
“Fifth, it would be interesting to include behavioral measures of trust and examine their relation to self-reported trust (e.g., Miller et al., 2016).”
Background
Metadata
- Authors
- Miller, D., Johns, M., Mok, B., Gowda, N., Sirkin, D., Lee, K., & Ju, W.
- Affiliations
- Stanford University (US)
- Renault (France) (FR)
- Venue
- Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Publisher
- SAGE Publications
- Published
- 2016-09
- Volume
- 60
- Issue
- 1
- Pages
- 1849-1853
- ISSN
- 0163-5182 (ISSN-L)
- 1071-1813
- 2169-5067
- OpenAlex
- W2514903130
- Cited by
- 71
- References
- 25
- Citations by year
- 2026: 5 · 2025: 6 · 2024: 12 · 2023: 7 · 2022: 6 · 2021: 7 · 2020: 15 · 2019: 9 · 2018: 4
- FWCI
- 6.83
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Proceedings of the Human Factors and Ergonomics Society Annual Meeting (publishedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Risk and Safety Analysis
- Keywords
- trust in automation, partially automated vehicles, human-machine interaction, driver monitoring, human factors in automation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.