A Meta-Analysis of Factors Influencing the Development of Trust in Automation: Implications for Human-Robot Interaction
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Public reporting burden for this collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection information.Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing the burden, to Department of Defense, Washington Headquarters Services, Directorate for Information Operations and Reports (0704-0188), 1215 Jefferson Davis Highway, Suite 1204, Arlington, VA 22202-4302.Respondents should be aware that notwithstanding any other provision of law, no person shall be subject to any penalty for failing to comply with a collection of information if it does not display a currently valid OMB control number.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 8×
“Current literature suggests that etiquette is related to trust and can lead to a higher probability of intent errors (Dzindolet et al., 2006; Lee and Moray, 1992; Lee and See, 2004; Lees and Lee, 2007; Merritt and Ilgen, 2008; Parasuraman and Miller, 2004).”
BackgroundInfluentialHumans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · cited 2×
“For example, Parasuraman and Riley (1997) incorporated the human-machine comparison in which automation was defined as “the execution by a machine agent (usually a computer) of a function that was previously carried out by a human” (p. 231).”
BackgroundA model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 6×
“Automation: (1) Machine execution of functions (Parasuraman et al., 2000); (2) “the execution by a machine agent (usually a computer) of a function that was previously carried out by a human” (Parasuraman and Riley, 1997, p. 231); (3) “the technology that actively selects data, transforms…”
BackgroundMethodInfluentialMachines and Mindlessness: Social Responses to Computers
Nass, C., & Moon, Y. (2000) · Journal of Social Issues · doi:10.1111/0022-4537.00153 · Cited by 4,022 · cited 1×
“Nass and Moon (2000) also suggest the importance of anthropomorphic appearance on automated systems.”
BackgroundA new scale for the measurement of interpersonal trust1
Rotter, J. B. (1967) · Journal of Personality · doi:10.1111/j.1467-6494.1967.tb01454.x · Cited by 3,503
Rempel, J. K., Holmes, J. G., & Zanna, M. P. (1985) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.49.1.95 · Cited by 3,146 · cited 1×
“Rempel et al. (1985) “… A generalized expectation related to the subjective probability an individual assigns to the occurrence of some set of future events” (p. 96).”
BackgroundBuilding consumer trust online
Hoffman, D. L., Novak, T. P., & Peralta, M. (1999) · Communications of the ACM · doi:10.1145/299157.299175 · Cited by 2,132
A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction
Hancock, P. A., Billings, D. R., Schaefer, K. E., Chen, J. Y. C., de Visser, E. J., & Parasuraman, R. (2011) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811417254 · Cited by 2,051 · cited 16×
“Here, we expand on our previous meta-analytic work in the field of human-robot interaction (HRI) to include all of human-automation interaction.”
BackgroundResultInfluentialSelf-citationAnxiety-related attentional biases and their regulation by attentional control.
Derryberry, D., & Reed, M. A. (2002) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.111.2.225 · Cited by 1,729
Trust, control strategies and allocation of function in human-machine systems
LEE, J., & MORAY, N. (1992) · Ergonomics · doi:10.1080/00140139208967392 · Cited by 1,459
The role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276 · cited 6×
“…et al. (2006) Merritt et al. (2012) Neyedli et al. (2009) Pak et al. (2012) Bagheri and Jamieson (2004) Bagheri (2004) Cummings et al. (2010) Dzindolet et al. (2003) Lee and Chung (2009) Lee et al. (2007) Merritt and Ilgen (2008) Neyedli et al. (2009) Wang et al. (2009) Wang et al.…”
BackgroundInfluentialOn-line trust: concepts, evolving themes, a model
Corritore, C. L., Kracher, B., & Wiedenbeck, S. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00041-7 · Cited by 1,200 · cited 2×
“In addition to these factors, Corritore et al. (2003) suggest that computer interface design criteria (e.g., ease of use, good visual design elements, information content, and reputation) can provide cues to the degree to which an aid will be perceived as trustworthy.”
BackgroundMUIR, B. M., & MORAY, N. (1996) · Ergonomics · doi:10.1080/00140139608964474 · Cited by 993
Performance Consequences of Automation-Induced 'Complacency'
Parasuraman, R., Molloy, R., & Singh, I. L. (1993) · The International Journal of Aviation Psychology · doi:10.1207/s15327108ijap0301_1 · Cited by 875 · cited 1×
“For example, trust in automation is directly tied to the outcome measurements of human-automation interaction, specifically automation use (see Beck et al., 2007; Moray et al., 2000; Muir and Moray, 1996; Parasuraman et al., 1993).”
BackgroundMUIR, B. M. (1994) · Ergonomics · doi:10.1080/00140139408964957 · Cited by 873 · cited 4×
“Properly calibrated trust creates a situation where the human user is engaged with the automation and participates at the appropriate level in the process (Muir, 1994).”
BackgroundInfluentialMerritt, S. M., & Ilgen, D. R. (2008) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x288574 · Cited by 527 · cited 7×
“Current literature suggests that etiquette is related to trust and can lead to a higher probability of intent errors (Dzindolet et al., 2006; Lee and Moray, 1992; Lee and See, 2004; Lees and Lee, 2007; Merritt and Ilgen, 2008; Parasuraman and Miller, 2004).”
BackgroundInfluentialBahner, J. E., Hüper, A.-D., & Manzey, D. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2008.06.001 · Cited by 279
Automation failures on tasks easily performed by operators undermine trust in automated aids
Madhavan, P., Wiegmann, D. A., & Lacson, F. C. (2006) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872006777724408 · Cited by 268
de Vries, P., Midden, C., & Bouwhuis, D. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00039-9 · Cited by 264 · cited 10×
“49 Definition Citation Definition Rempel and Holmes (1986) “In a general sense, trust is the degree of confidence you feel when you think about a relationship” (p. 28).”
BackgroundInfluentialLooije, R., Neerincx, M. A., & Cnossen, F. (2010) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.08.007 · Cited by 243 · cited 1×
“However, Looije et al. (2010) suggested that when interacting with adaptive automation, humans prefer adaptive automation that can learn, recognize, and respond to personality differences in humans as well as exhibiting specific personality traits itself.”
Backgroundde Visser, E., & Parasuraman, R. (2011) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/1555343411410160 · Cited by 207 · cited 1×
“In their work on adaptive aiding of human-robot teaming, de Visser and Parasuraman (2011) found that human-robot teams benefited from imperfect static automation in high-task-load conditions, and adaptive automation helped alleviate the workload of the operator.”
BackgroundParasuraman, R. (1987) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872088702900609 · Cited by 175 · cited 2×
“…has 12 shown that with sustained exposure to and use of information technologies, computer users develop trust in the accuracy of the data stored within a computer system despite the fact that there is upwards of 10% inaccuracies due to error (Klein et al., 1997; Parasuraman, 1987; Wiener 1985).”
BackgroundA General Model of Mixed-Initiative Human-Machine Systems
Riley, V. (1989) · Proceedings of the Human Factors Society Annual Meeting · doi:10.1177/154193128903300227 · Cited by 153
Cited by
Schaefer, K. E., Chen, J. Y. C., Szalma, J. L., & Hancock, P. A. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816634228 · Cited by 768
Self-citationMeasuring Trust in Human Robot Interactions: Development of the “Trust Perception Scale-HRI”
Schaefer, K. E. (2016) · Robust Intelligence and Trust in Autonomous Systems · doi:10.1007/978-1-4899-7668-0_10 · Cited by 270
Self-citationModeling and predicting trust dynamics in human–robot teaming: A Bayesian inference approach
Guo, Y., & Yang, X. J. (2021) · International Journal of Social Robotics · doi:10.1007/s12369-020-00703-3 · Cited by 133
A Review on Human–Machine Trust Evaluation: Human-Centric and Machine-Centric Perspectives
Gebru, B., Zeleke, L., Blankson, D., Nabil, M., Nateghi, S., Homaifar, A., & Tunstel, E. (2022) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2022.3144956 · Cited by 101
Detecting Human Trust Calibration in Automation: A Convolutional Neural Network Approach
Choo, S., & Nam, C. (2022) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2021.3137015 · Cited by 34
Metadata
- Authors
- Schaefer, K. E., Billings, D. R., Szalma, J. L., Adams, J. K., Sanders, T. L., Chen, J. Y., & Hancock, P. A.
- Publisher
- Defense Technical Information Center
- Published
- 2014-07-01
- OpenAlex
- W255083219
- Cited by
- 43
- References
- 23
- FWCI
- 0.66
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.