The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
The ‘problem ’ with automation: inappropriate feedback and interaction, not ‘over-automation’
Open accessAbstract
As automation increasingly takes its place in industry, especially high risk industry, it is often blamed for causing harm and increasing the chance of human error when failures do occur. I propose that the problem is not the presence of automation, but rather its inappropriate design. The problem is that the operations under normal operating conditions are performed appropriately, but there is inadequate feedback and interaction with the humans who must control the overall conduct of the task. When the situations exceed the capabilities of the automatic equipment, then the inadequate feedback leads to difficulties for the human controllers. The problem, I suggest, is that the automation is at an intermediate level of intelligence, powerful enough to take over control that used to be done by people, but not powerful enough to handle all abnormalities. Moreover, its level of intelligence is insufficient to provide the continual, appropriate feedback that occurs naturally among human operators. This is the source of the current difficulties. To solve this problem, the automation should either be made less intelligent or more so, but the current level is quite inappropriate. The overall message is that it is possible to reduce error through appropriate design considerations. Appropriate design should assume the existence of error, it should continually provide feedback, it should continually interact with operators in an effective manner, and it should allow for the worst situations possible. What is needed is a soft, compliant technology, not a rigid, formal one.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Psychology of Everyday Things
Massaro, D. W., & Norman, D. A. (1990) · The American Journal of Psychology · doi:10.2307/1423268 · Cited by 3,466
Self-citationIn The Age of the Smart Machine: The Future of Work and Power.
Sirianni, C., & Zuboff, S. (1989) · Contemporary Sociology · doi:10.2307/2073307 · Cited by 3,257
Flight-deck automation: promises and problems
WIENER, E. L., & CURRY, R. E. (1980) · Ergonomics · doi:10.1080/00140138008924809 · Cited by 599
Human Detection and Diagnosis of System Failures
(1981) · Springer eBooks · doi:10.1007/978-1-4615-9230-3 · Cited by 439
The Technology of Team Navigation
(2014) · Intellectual Teamwork · doi:10.4324/9781315807645-16 · Cited by 401
Bainbridge, L. (1982) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)62897-0 · Cited by 321
Bainbridge, L. (1983) · Analysis, Design and Evaluation of Man–Machine Systems · doi:10.1016/b978-0-08-029348-6.50026-9 · Cited by 219
Sorkin, R. D., Kantowitz, B. H., & Kantowitz, S. C. (1988) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872088803000406 · Cited by 187
Auditory warning sounds in the work environment
Patterson, R. D. (1990) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1990.0091 · Cited by 169
FORUM: Why are people turning off our alarms?
Sorkin, R. D. (1988) · The Journal of the Acoustical Society of America · doi:10.1121/1.397232 · Cited by 165
Cited by
Humans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554
Engineering a Safer World: Systems Thinking Applied to Safety
(2012) · Choice Reviews Online · doi:10.5860/choice.49-6305 · Cited by 1,566
Automation, Algorithms, and Beyond: Why Work Design Matters More Than Ever in a Digital World
Parker, S. K., & Grote, G. (2022) · Applied Psychology · doi:10.1111/apps.12241 · Cited by 960
How in the World Did We Ever Get into That Mode? Mode Error and Awareness in Supervisory Control
Sarter, N. B., & Woods, D. D. (1995) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779049516 · Cited by 849
de Winter, J. C. F., Happee, R., Martens, M. H., & Stanton, N. A. (2014) · Transportation Research Part F: Traffic Psychology and Behaviour · doi:10.1016/j.trf.2014.06.016 · Cited by 739
Metadata
- Authors
- Norman, D. A.
- Venue
- Philosophical Transactions of the Royal Society of London. B, Biological Sciences
- Publisher
- The Royal Society
- Published
- 1990-04-12
- Volume
- 327
- Issue
- 1241
- Pages
- 585-593
- ISSN
- 0080-4622 (ISSN-L)
- 2054-0280
- OpenAlex
- W2153246402
- Cited by
- 510
- References
- 11
- FWCI
- 7.76
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The ‘problem ’ with automation: inappropriate feedback and interaction, not ‘over-automation’. https://app.cochat.ai/papers/10.1098/rstb.1990.0101
- The paper
- Norman, D. A. (1990). The ‘problem ’ with automation: inappropriate feedback and interaction, not ‘over-automation’. Philosophical Transactions of the Royal Society of London. B, Biological Sciences. https://doi.org/10.1098/rstb.1990.0101
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.