Theoretical Considerations and Development of a Questionnaire to Measure Trust in Automation
Open accessThe DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Abstract
The increasing number of interactions with automated systems has sparked the interest of researchers in trust in automation because it predicts not only whether but also how an operator interacts with an automation. In this work, a theoretical model of trust in automation is established and the development and evaluation of a corresponding questionnaire (Trust in Automation, TiA) are described.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The subjective trust in the AI system was assessed using the Trust in Automation questionnaire (TiA) [63], which is a commonly employed and validated tool for measuring trust [78, 116, 120].”
From Dealing with Uncertainty: Understanding the Impact of Prognostic Versus Diagnostic Tasks on Trust and Reliance in Human-AI Decision Making (2024) · cites this paper as [63]
In the citing paper
“Tasks with a larger number of constraints that need to be accounted for in decision-making are often more challenging for individuals to process, making them more likely to seek guidance from AI [63, 90, 111].”
From Dealing with Uncertainty: Understanding the Impact of Prognostic Versus Diagnostic Tasks on Trust and Reliance in Human-AI Decision Making (2024) · cites this paper as [63]
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
(1980) · Medical Entomology and Zoology · Cited by 25,810
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736
Power analysis and determination of sample size for covariance structure modeling.
MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.130 · Cited by 10,418
A Rationale and Test for the Number of Factors in Factor Analysis
Horn, J. L. (1965) · Psychometrika · doi:10.1007/bf02289447 · Cited by 8,714
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605
Sample size in factor analysis.
MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.1.84 · Cited by 5,497
le Coutre, W. (1953) · Das deutsche Kaufmannsbuch · doi:10.1007/978-3-663-13656-9_6 · Cited by 4,537
A model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195
Rempel, J. K., Holmes, J. G., & Zanna, M. P. (1985) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.49.1.95 · Cited by 3,146
Robins, R. W., Hendin, H. M., & Trzesniewski, K. H. (2001) · Personality and Social Psychology Bulletin · doi:10.1177/0146167201272002 · Cited by 3,041
The somatic marker hypothesis and the possible functions of the prefrontal cortex
Damasio, A. R. (1996) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1996.0125 · Cited by 2,847
The Performance of RMSEA in Models With Small Degrees of Freedom
Kenny, D. A., Kaniskan, B., & McCoach, D. B. (2015) · Sociological Methods & Research · doi:10.1177/0049124114543236 · Cited by 2,841
Trust in Automation: Integrating Empirical Evidence on Factors That Influence Trust
Hoff, K. A., & Bashir, M. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814547570 · Cited by 2,817
Rhemtulla, M., Brosseau-Liard, P. É., & Savalei, V. (2012) · Psychological Methods · doi:10.1037/a0029315 · Cited by 2,816
The reliability of a two-item scale: Pearson, Cronbach, or spearman-brown?
Eisinga, R., Grotenhuis, M. T., & Pelzer, B. (2013) · International Journal of Public Health · doi:10.1007/s00038-012-0416-3 · Cited by 2,695
Thanks coefficient alpha, we’ll take it from here.
McNeish, D. (2018) · Psychological Methods · doi:10.1037/met0000144 · Cited by 2,533
Barber, B. (1983) · DigitalGeorgetown (Georgetown University Library) · Cited by 2,495
Handbook of research methods in personality psychology
(2007) · Choice Reviews Online · doi:10.5860/choice.45-2315 · Cited by 2,373
The effect of the performance appraisal system on trust for management: A field quasi-experiment.
Mayer, R. C., & Davis, J. H. (1999) · Journal of Applied Psychology · doi:10.1037//0021-9010.84.1.123 · Cited by 2,247
Deutsch, M. (1958) · Journal of Conflict Resolution · doi:10.1177/002200275800200401 · Cited by 2,077
Foundations for an Empirically Determined Scale of Trust in Automated Systems
Jian, J.-Y., Bisantz, A. M., & Drury, C. G. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0401_04 · Cited by 1,799
Diamantopoulos, A., Sarstedt, M., Fuchs, C., Wilczynski, P., & Kaiser, S. (2012) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-011-0300-3 · Cited by 1,736
Generalized expectancies for interpersonal trust.
Rotter, J. B. (1971) · American Psychologist · doi:10.1037/h0031464 · Cited by 1,599
Toward Understanding and Measuring Conditions of Trust: Evolution of a Conditions of Trust Inventory
Butler, J. K. (1991) · Journal of Management · doi:10.1177/014920639101700307 · Cited by 1,526
Trust, control strategies and allocation of function in human-machine systems
LEE, J., & MORAY, N. (1992) · Ergonomics · doi:10.1080/00140139208967392 · Cited by 1,459
Using a single‐item approach to measure facet job satisfaction
Nagy, M. S. (2002) · Journal of Occupational and Organizational Psychology · doi:10.1348/096317902167658 · Cited by 1,043
MUIR, B. M., & MORAY, N. (1996) · Ergonomics · doi:10.1080/00140139608964474 · Cited by 993
MUIR, B. M. (1994) · Ergonomics · doi:10.1080/00140139408964957 · Cited by 873
JOB SATISFACTION: ARE ALL THE PARTS THERE?
SCARPELLO, V., & CAMPBELL, J. P. (1983) · Personnel Psychology · doi:10.1111/j.1744-6570.1983.tb02236.x · Cited by 857
The Effect of Motivational Orientation upon Trust and Suspicion
Deutsch, M. (1960) · Human Relations · doi:10.1177/001872676001300202 · Cited by 808
Foundations of Measurement, Vol. I: Additive and Polynomial Representations
Krantz, D. H., Luce, D., Suppes, P., & Tversky, A. (1971) · Cited by 764
Trust between humans and machines, and the design of decision aids
Muir, B. M. (1987) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(87)80013-5 · Cited by 762
Trust and Distrust Definitions: One Bite at a Time
Harrison McKnight, D., & Chervany, N. L. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-45547-7_3 · Cited by 747
Construct Validation in Social and Personality Research: Current Practice and Recommendations
Flake, J. K., Pek, J., & Hehman, E. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617693063 · Cited by 697
A Second Generation of Multivariate Analysis
Fornell, C. (1982) · Cited by 686
A Behavioral Decision Theory Approach to Modeling Dyadic Trust in Superiors and Subordinates
Butler, J. K., & Cantrell, R. S. (1984) · Psychological Reports · doi:10.2466/pr0.1984.55.1.19 · Cited by 597
Instrument Development in the Affective Domain
Gable, R. K., & Wolf, M. B. (1993) · Springer eBooks · doi:10.1007/978-94-011-1400-4 · Cited by 581
Similarities and differences between human–human and human–automation trust: an integrative review
Madhavan, P., & Wiegmann, D. A. (2007) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220500337708 · Cited by 577
Approaches to personality inventory construction: A comparison of merits.
Burisch, M. (1984) · American Psychologist · doi:10.1037//0003-066x.39.3.214 · Cited by 549
Merritt, S. M., & Ilgen, D. R. (2008) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x288574 · Cited by 527
Blomqvist, K. (1997) · Scandinavian Journal of Management · doi:10.1016/s0956-5221(97)84644-1 · Cited by 456
Hoeppner, B. B., Kelly, J. F., Urbanoski, K. A., & Slaymaker, V. (2011) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2011.04.005 · Cited by 444
Quantitative science and the definition of measurement in psychology
Michell, J. (1997) · British Journal of Psychology · doi:10.1111/j.2044-8295.1997.tb02641.x · Cited by 426
Introduction matters: Manipulating trust in automation and reliance in automated driving
Körber, M., Baseler, E., & Bengler, K. (2018) · Applied Ergonomics · doi:10.1016/j.apergo.2017.07.006 · Cited by 418
Self-citationHeene, M., Hilbert, S., Draxler, C., Ziegler, M., & Bühner, M. (2011) · Psychological Methods · doi:10.1037/a0024917 · Cited by 406
Instrument Development in the Affective Domain: School and Corporate Applications
McCoach, D. B., Gable, R. K., & Madura, J. P. (2013) · Springer eBooks · doi:10.1007/978-1-4614-7135-6 · Cited by 360
(2009) · Cited by 355
Hergeth, S., Lorenz, L., Vilimek, R., & Krems, J. F. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720815625744 · Cited by 355
Testtheorie und Fragebogenkonstruktion
(2008) · Springer-Lehrbuch · doi:10.1007/978-3-540-71635-8 · Cited by 345
Choosing the Optimal Number of Factors in Exploratory Factor Analysis: A Model Selection Perspective
Preacher, K. J., Zhang, G., Kim, C., & Mels, G. (2013) · Multivariate Behavioral Research · doi:10.1080/00273171.2012.710386 · Cited by 344
Assessing the Clinical Significance of Single Items Relative to Summated Scores
SLOAN, J. A., AARONSON, N., CAPPELLERI, J. C., FAIRCLOUGH, D. L., & VARRICCHIO, C. (2002) · Mayo Clinic Proceedings · doi:10.1016/s0025-6196(11)62218-0 · Cited by 256
Subjective rating scales: science or art?
Annett, J. (2002) · Ergonomics · doi:10.1080/00140130210166951 · Cited by 250
Hoffman, R. R., Johnson, M., Bradshaw, J. M., & Underbrink, A. (2013) · IEEE Intelligent Systems · doi:10.1109/mis.2013.24 · Cited by 229
Hergeth, S., Lorenz, L., & Krems, J. F. (2017) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816678714 · Cited by 221
Beggiato, M., Pereira, M., Petzoldt, T., & Krems, J. (2015) · Transportation Research Part F: Traffic Psychology and Behaviour · doi:10.1016/j.trf.2015.10.005 · Cited by 215
Conceptual Issues in the Study of Dynamic Hazard Warnings
Meyer, J. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.2.196.37335 · Cited by 214
On the consistency of individual classification using short scales.
Emons, W. H. M., Sijtsma, K., & Meijer, R. R. (2007) · Psychological Methods · doi:10.1037/1082-989x.12.1.105 · Cited by 180
Modeling Strategic Behavior in Human-Automation Interaction: Why an "Aid" Can (and Should) Go Unused
Kirlik, A. (1993) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872089303500203 · Cited by 177
Sakaluk, J. K., & Short, S. D. (2017) · The Journal of Sex Research · doi:10.1080/00224499.2015.1137538 · Cited by 160
Bisantz, A. M., & Seong, Y. (2001) · International Journal of Industrial Ergonomics · doi:10.1016/s0169-8141(01)00015-4 · Cited by 133
Psychometric characteristics of assessment procedures: An overview.
Hubley, A. M., & Zumbo, B. D. (2013) · American Psychological Association eBooks · doi:10.1037/14047-001 · Cited by 75
Drnec, K., Marathe, A. R., Lukos, J. R., & Metcalfe, J. S. (2016) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2016.00290 · Cited by 72
Assessing the Clinical Significance of Single Items Relative to Summated Scores
Sloan, J. A., Aaronson, N. K., Cappelleri, J. C., Fairclough, D. L., & Varricchio, C. G. (2002) · Mayo Clinic Proceedings · doi:10.4065/77.5.479 · Cited by 69
McCoach, D. B. (2003) · Journal for the Education of the Gifted · doi:10.1177/016235320302700104 · Cited by 49
Software to Sharpen Your Stats
Love, J., Selker, R., Verhagen, J., Marsman, M., Gronau, Q. F., Jamil, T., Šmíra, M., Epskamp, S., Wild, A., Ly, A., et al. (2015) · UvA-DARE (University of Amsterdam) · Cited by 42
Construction Strategies for Multiscale Personality Inventories
Burisch, M. (1978) · Applied Psychological Measurement · doi:10.1177/014662167800200110 · Cited by 22
Brown, R. D., & Galster, S. M. (2004) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120404800132 · Cited by 22
Neural Responses to Central and Peripheral Objects in the Lateral Occipital Cortex
Wang, B., Guo, J., Yan, T., Ohno, S., Kanazawa, S., Huang, Q., & Wu, J. (2016) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2016.00054 · Cited by 22
Research works printed but not linked: 4
- Gigerenzer G, Selten R (eds) (2002) Bounded rationality: the adaptive toolbox. MIT Press, Cambridge
- Körber M (2018) Individual differences in human-automation interaction: a driver-centered perspective on the introduction of automated vehicles. Dissertation, Technical University of Munich
- Madsen M, Gregor S (2000) Measuring human-computer trust. In: Proceedings of the 11th Australasian conference on information systems, pp 6–8
- Nunnally JC, Bernstein IH (1994) Psychometric theory, 3rd edn. McGraw-Hill, New York
Cited by
Trust and reliance on AI — An experimental study on the extent and costs of overreliance on AI
Klingbeil, A., Grützner, C., & Schreck, P. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108352 · Cited by 450
Measurement of trust in automation: A narrative review and reference guide
Kohn, S. C., de Visser, E. J., Wiese, E., Lee, Y.-C., & Shaw, T. H. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.604977 · Cited by 315
“High trust results in longer reaction times because over-reliance on the automation causes the operator to be unprepared to respond, requiring greater mental effort and duration to switch tasks (Beller et al., 2013; Helldin et al., 2013; Körber et al., 2018).”
BackgroundUncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty
Bhatt, U., Antorán, J., Zhang, Y., Liao, Q. V., Sattigeri, P., Fogliato, R., Melançon, G., Krishnan, R., Stanley, J., Tickoo, O., et al. (2021) · Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3461702.3462571 · Cited by 300
“Factors communities have a long history of studying trust in automation [74, 99, 106].”
BackgroundTrust in Robots: Challenges and Opportunities
Kok, B. C., & Soh, H. (2020) · Current Robotics Reports · doi:10.1007/s43154-020-00029-y · Cited by 221
“As such, there have been major pioneering efforts in the past decade to develop instruments that measure trust in human-robot interaction, most notably in the form of self-report scales [43, 80 – 85].”
BackgroundSchramowski, P., Stammer, W., Teso, S., Brugger, A., Herbert, F., Shao, X., Luigs, H.-G., Mahlein, A.-K., & Kersting, K. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0212-3 · Cited by 207
“To assess the participant’s trust in the model’s skills we used the Trust in Automation Questionnaire (TiA) [24].”
Method
Metadata
- Authors
- Körber, M.
- Affiliations
- Technical University of Munich (DE)
- Corresponding author
- Körber, Moritz
- ORCID
- Körber, Moritz
- Venue
- Advances in Intelligent Systems and Computing
- Publisher
- Springer International Publishing
- Published
- 2018-08-05
- Pages
- 13-30
- ISSN
- 2194-5357 (ISSN-L)
- 2194-5365
- OpenAlex
- W2800029302
- Cited by
- 317
- References
- 69
- Citations by year
- 2026: 60 · 2025: 66 · 2024: 59 · 2023: 49 · 2022: 34 · 2021: 26 · 2020: 16 · 2019: 6 · 2018: 1
- FWCI
- 21.88
- Type
- conference paper
- Language
- en
- Open access
- green
- osf.io
- Licence
- Locations
- Advances in intelligent systems and computing (publishedVersion)
- mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) (submittedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion, cc-by)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Risk and Safety Analysis
- Keywords
- trust in automation, questionnaire development, trust dimensions, organizational trust, human-automation interaction, autonomous driving, reliance on automation, operator monitoring, gaze behavior, factor structure, scale reliability, criterion validity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.