The Effect of Incorrect Reliability Information on Expectations, Perceptions, and Use of Automation
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Objective: We examined how providing artificially high or low statements about automation reliability affected expectations, perceptions, and use of automation over time. Background: One common method of introducing automation is providing explicit statements about the automation’s capabilities. Research is needed to understand how expectations from such introductions affect perceptions and use of automation. Method: Explicit-statement introductions were manipulated to set higher-than (90%), same-as (75%), or lower-than (60%) levels of expectations in a dual-task scenario with 75% reliable automation. Two experiments were conducted to assess expectations, perceptions, compliance, reliance, and task performance over (a) 2 days and (b) 4 days. Results: The baseline assessments showed initial expectations of automation reliability matched introduced levels of expectation. For the duration of each experiment, the lower-than groups’ perceptions were lower than the actual automation reliability. However, the higher-than groups’ perceptions were no different from actual automation reliability after Day 1 in either study. There were few differences between groups for automation use, which generally stayed the same or increased with experience using the system. Conclusion: Introductory statements describing artificially low automation reliability have a long-lasting impact on perceptions about automation performance. Statements including incorrect automation reliability do not appear to affect use of automation. Application: Introductions should be designed according to desired outcomes for expectations, perceptions, and use of the automation. Low expectations have long-lasting effects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 3×
“Expectations about system capabilities and functions influence dependence on automation (e.g., Cohen, Parasuraman, & Freeman, 1998; Lacson, Wiegmann, & Madhavan, 2005; Lee & Moray, 1992, 1994; Lee & See, 2004; Muir, 1994; Parasuraman & Riley, 1997).”
BackgroundMethodHumans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · cited 6×
“The reliability of the automation affects human dependence on automation (Lee & Moray, 1992; Muir, 1994; Parasuraman & Riley, 1997).”
BackgroundInfluentialA model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 1×
“Automation use can allow humans to focus on concurrent tasks, which can lead to better overall human–machine system performance (Parasuraman et al., 2000).”
BackgroundRosenthal, R., & Jacobson, L. (1968) · The Urban Review · doi:10.1007/bf02322211 · Cited by 3,878
Czaja, S. J., Charness, N., Fisk, A. D., Hertzog, C., Nair, S. N., Rogers, W. A., & Sharit, J. (2006) · Psychology and Aging · doi:10.1037/0882-7974.21.2.333 · Cited by 2,113 · cited 1×
“The demographics and health questionnaire, adapted from materials developed by the Center for Research and Education on Aging and Technology Enhancement (Czaja et al., 2006), was used to collect participant information.”
MethodSelf-citationTrust, control strategies and allocation of function in human-machine systems
LEE, J., & MORAY, N. (1992) · Ergonomics · doi:10.1080/00140139208967392 · Cited by 1,459
Cosmides, L. (1996) · Cognition · doi:10.1016/0010-0277(95)00664-8 · Cited by 1,293
The role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276 · cited 2×
“The shifting allocations of responsibilities can lead to safer, more efficient everyday tasks (Dzindolet, Peterson, Pomranky, Pierce, & Beck, 2003).”
BackgroundENDSLEY, M. R., & KABER, D. B. (1999) · Ergonomics · doi:10.1080/001401399185595 · Cited by 1,088
MUIR, B. M. (1994) · Ergonomics · doi:10.1080/00140139408964957 · Cited by 873 · cited 2×
“Expectations about system capabilities and functions influence dependence on automation (e.g., Cohen, Parasuraman, & Freeman, 1998; Lacson, Wiegmann, & Madhavan, 2005; Lee & Moray, 1992, 1994; Lee & See, 2004; Muir, 1994; Parasuraman & Riley, 1997).”
Background
Cited by
Introduction matters: Manipulating trust in automation and reliance in automated driving
Körber, M., Baseler, E., & Bengler, K. (2018) · Applied Ergonomics · doi:10.1016/j.apergo.2017.07.006 · Cited by 418
Chen, J., Mishler, S., Hu, B., Li, N., & Proctor, R. W. (2018) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2018.05.010 · Cited by 50
The Perception of Automation Reliability and Acceptance of Automated Advice
Hutchinson, J., Strickland, L., Farrell, S., & Loft, S. (2023) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208211062985 · Cited by 32
Lee, M., & Pitts, B. J. (2026) · Safety Science · doi:10.1016/j.ssci.2025.107062 · Cited by 4
Metadata
- Authors
- Barg-Walkow, L. H., & Rogers, W. A.
- Venue
- Human Factors: The Journal of the Human Factors and Ergonomics Society
- Publisher
- SAGE Publications
- Published
- 2015-10-30
- Volume
- 58
- Issue
- 2
- Pages
- 242-260
- ISSN
- 0018-7208 (ISSN-L)
- 1547-8181
- OpenAlex
- W1895697208
- Cited by
- 46
- References
- 15
- FWCI
- 5.74
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Effect of Incorrect Reliability Information on Expectations, Perceptions, and Use of Automation. https://app.cochat.ai/papers/10.1177/0018720815610271
- The paper
- Barg-Walkow, L. H., & Rogers, W. A. (2016). The Effect of Incorrect Reliability Information on Expectations, Perceptions, and Use of Automation. Human Factors: The Journal of the Human Factors and Ergonomics Society. https://doi.org/10.1177/0018720815610271
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.