The DOI matches its Crossref record; 227 of the 235 references it cites were found in a registry or an index.
Trusting Automation: Designing for Responsivity and Resilience
Abstract
Objective This paper reviews recent articles related to human trust in automation to guide research and design for increasingly capable automation in complex work environments. Background Two recent trends—the development of increasingly capable automation and the flattening of organizational hierarchies—suggest a reframing of trust in automation is needed. Method Many publications related to human trust and human–automation interaction were integrated in this narrative literature review. Results Much research has focused on calibrating human trust to promote appropriate reliance on automation. This approach neglects relational aspects of increasingly capable automation and system-level outcomes, such as cooperation and resilience. To address these limitations, we adopt a relational framing of trust based on the decision situation, semiotics, interaction sequence, and strategy. This relational framework stresses that the goal is not to maximize trust, or to even calibrate trust, but to support a process of trusting through automation responsivity. Conclusion This framing clarifies why future work on trust in automation should consider not just individual characteristics and how automation influences people, but also how people can influence automation and how interdependent interactions affect trusting automation. In these new technological and organizational contexts that shift human operators to co-operators of automation, automation responsivity and the ability to resolve conflicting goals may be more relevant than reliability and reliance for advancing system design. Application A conceptual model comprising four concepts—situation, semiotics, strategy, and sequence—can guide future trust research and design for automation responsivity and more resilient human–automation systems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Although trust and reliance are closely related, they are distinct constructs.Trust is an attitude, while reliance is the behavioural outcome that follows from trust (Chiou & Lee, 2023).”
From Investigating appropriate reliance on AI-Based decision support systems: the role of expertise, trust, and self-confidence (2025) · cites this paper as Chiou & Lee, 2023
In the citing paper
“These measures are limited in their ability to capture students' inobservable reliance behaviors on Generative AI during problem-solving tasks that involve implicit shifts in cognitive strategies based on interactions with the environment or other participants (Chiou & Lee, 2023).”
From Measuring undergraduate students’ reliance on generative AI during problem-solving: Scale development and validation. (2025) · cites this paper as Chiou & Lee, 2023
In the citing paper
“Chiou and Lee [ 46 ] found that trust attitudes predict reliance behavior.”
From Psychological Factors Influencing Appropriate Reliance on AI-enabled Clinical Decision Support Systems: Experimental Web-Based Study Among Dermatologists (2025) · cites this paper as [46]
Citations
Cites
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
The future of employment: How susceptible are jobs to computerisation?
Frey, C. B., & Osborne, M. A. (2017) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2016.08.019 · Cited by 8,727
An attributional theory of achievement motivation and emotion
Weiner, B. (1985) · Psychological Review · doi:10.1037/0033-295x.92.4.548 · Cited by 7,846 · cited 1×
“The phenomenon of people attributing social qualities to nonliving entities has been extensively studied, and will not be belabored here (Epley et al., 2007; Heider & Simmel, 1944; Nass et al., 1994; Weiner, 1985).”
BackgroundTrust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 10×
“People’s perceptions of automation qualities and behaviors have long been the focus of understanding trust (Hancock et al., 2011; Schaefer et al., 2016), particularly how visual interpretation of trust signs (Lee & See, 2004).”
BackgroundInfluentialSelf-citationNielsen, R. P., & Axelrod, R. (1985) · The Academy of Management Review · doi:10.2307/257983 · Cited by 6,321
Emirbayer, M., & Mische, A. (1998) · American Journal of Sociology · doi:10.1086/231294 · Cited by 6,165
Trust, Reciprocity, and Social History
Berg, J., Dickhaut, J., & McCabe, K. (1995) · Games and Economic Behavior · doi:10.1006/game.1995.1027 · Cited by 5,548
Research works printed but not linked: 21
- Adler P. S, 1997, Perspectives on Work, 61
- Arrow K, 1974, The limits of organizations
- Bethel C. L., 2007, Proceedings - IEEE International Workshop on Robot and Human Interactive Communication, 732
- Garbis C., 1998, Proceedings of 9th Conference of Cognitive Ergonomics: Cognition and Cooperation, 151
- Groom V., 2007, Interaction studies, 8, 285
- Gutzwiller R. S., 2020, Human Factors: The Journal of the Human Factors and Ergonomics Society, 117
- Holmes J. G., 1989, Close relationships: Review of personality and social psychology
- Khasawneh M., 2003, Proceedings of the 8th Annual International Conference on Industrial Engineering — Theory, Applications and Practice, 216
- Lee J. D., 2004, CHI Letters, 6, 65
- Liew T. W., 2013, Educational Technology and Society, 16, 275
- Loewenstein G., 2003, Handbook of affective science, 619
- Madsen M., 2000, Proceedings of the 11th Australasian Conference on Information Systems, 6
- Nass C., 1994, CHI '94: Proceedings of the SIGCHI conference on Human factors in Computing Systems: Celebrating Interdependence, 72
- O’Neil K, 2016, Weapons of math destruction: How big data increases inequality and threatens democracy
- Riedl R., 2011, ICIS 2011 Proceedings
- Robinette P., 2013, AAAI spring symposium, 78
- Sarter N. B., 1997, Handbook of human factors & ergonomics
- Schelling T. C, 1960, The strategy of conflict
- Schultz A. C., 2007, AI magazine, 28, 92
- Woods D. D, 2005, DePaul Law Review, 54, 485
- Zhang Y., 2015, IEEE International Conference on Intelligent Robots and Systems, 3586
Cited by
Measurement of trust in automation: A narrative review and reference guide
Kohn, S. C., de Visser, E. J., Wiese, E., Lee, Y.-C., & Shaw, T. H. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.604977 · Cited by 315
“…TiA and its sibling human-robot trust (See: Lee and See, 2004; Hancock et al., 2011; Hoff and Bashir, 2015; Schaefer, 2016; de Visser et al., 2020; Chiou and Lee, 2021), these reviews do not thoroughly review or discuss trust measures nor offer guidance about when or how different trust…”
BackgroundSupporting Human-AI Teams:Transparency, explainability, and situation awareness
Endsley, M. R. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107574 · Cited by 309
Rosenbacke, R., Melhus, Å., McKee, M., & Stuckler, D. (2024) · JMIR AI · doi:10.2196/53207 · Cited by 305
“For the trust, they used the terminology used by Chiou and Lee [36] of appropriate XSL • FO RenderX reliance.”
MethodHopko, S., Wang, J., & Mehta, R. (2022) · Frontiers in Robotics and AI · doi:10.3389/frobt.2022.799522 · Cited by 171
“…of human-robot collaboration is also related to the hierarchy between the operator and cobot, where trust based on the cohesion of teaming is increasingly relevant when the operator and cobot are at the same level in decision making verses the cobot being used as a tool (Chiou and Lee, 2021).”
BackgroundMethodMehrotra, S., Degachi, C., Vereschak, O., Jonker, C. M., & Tielman, M. L. (2024) · ACM Journal on Responsible Computing · doi:10.1145/3696449 · Cited by 254
“Therefore, studying the entire continuum of trust beyond its appropriate level, i.e. over, under-, mis-, and The literature proposes terms like calibration points [107] or critical states [69]”
Metadata
- Authors
- Chiou, E. K., & Lee, J. D.
- Affiliations
- Arizona State University (US)
- University of Wisconsin–Madison (US)
- Corresponding author
- Chiou, Erin K.
- Venue
- Human Factors: The Journal of the Human Factors and Ergonomics Society
- Publisher
- SAGE Publications
- Published
- 2021-04-27
- Volume
- 65
- Issue
- 1
- Pages
- 137-165
- ISSN
- 0018-7208 (ISSN-L)
- 1547-8181
- OpenAlex
- W3158836591
- Cited by
- 301
- References
- 235
- Citations by year
- 2026: 64 · 2025: 78 · 2024: 59 · 2023: 57 · 2022: 31 · 2021: 12
- FWCI
- 38.91
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Human Factors The Journal of the Human Factors and Ergonomics Society (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Air Force Office of Scientific Research (FA9550-18-1-0067)
- National Science Foundation (FW HFT-1840085)
- Division of Graduate Education (1256259)
- U.S. Department of Homeland Security (17STQAC00001-03-00)
- National Aeronautics and Space Administration (80NSSC19K0654)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- trust in automation, human-automation interaction, resilience engineering, semiotics, interaction sequences, strategy, organizational flattening, conceptual model, system design
- MeSH terms
- Automation, Humans, Man-Machine Systems, Motivation, Reproducibility of Results, Trust
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Trusting Automation: Designing for Responsivity and Resilience. https://app.cochat.ai/papers/10.1177/00187208211009995
- The paper
- Chiou, E. K., & Lee, J. D. (2023). Trusting Automation: Designing for Responsivity and Resilience. Human Factors: The Journal of the Human Factors and Ergonomics Society. https://doi.org/10.1177/00187208211009995
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.