The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Imposing limits on autonomous systems
Open accessAbstract
Our present era is witnessing the genesis of a sea-change in the way that advanced technologies operate. Amongst this burgeoning wave of untrammelled automation there is now beginning to arise a cadre of ever-more independent, autonomous systems. The degree of interaction between these latter systems with any form of human controller is becoming progressively more diminished and remote; and this perhaps necessarily so. Here, I advocate for human-centred and human favouring constraints to be designed, programmed, promulgated and imposed upon these nascent forms of independent entity. I am not sanguine about the collective response of modern society to this call. Nevertheless, the warning must be voiced and the issue debated, especially among those who most look to mediate between people and technology. Practitioner Summary: Practitioners are witnessing the penetration of progressively more independent technical orthotics into virtually all systems' operations. This work enjoins them to advocate for sentient, rational and mindful human-centred approaches towards such innovations. Practitioners need to place user-centred concerns above either the technical or the financial imperatives which motivate this line of progress.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In general, autonomous systems are generative and learn, evolve and permanently change their functional capacities as a result of the input of operational and contextual information (Hancock 2017).”
From Trustworthy artificial intelligence (2021) · cites this paper as Hancock 2017
In the citing paper
“AI-based systems' actions necessarily become more indeterminate across time and are thus more challenging to predict (Hancock 2017), making trust interactions between humans and AI-based systems more complex and difficult to understand than trust interactions between humans and non-AI technologies.”
From Trustworthy artificial intelligence (2021) · cites this paper as Hancock 2017
Citations
Cites
I.—COMPUTING MACHINERY AND INTELLIGENCE
TURING, A. M. (1950) · Mind · doi:10.1093/mind/lix.236.433 · Cited by 10,290 · cited 1×
“One standard approach has been to adopt the criteria advocated by Alan Turing (1950).”
MethodThe future of employment: How susceptible are jobs to computerisation?
Frey, C. B., & Osborne, M. A. (2017) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2016.08.019 · Cited by 8,727
A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction
Hancock, P. A., Billings, D. R., Schaefer, K. E., Chen, J. Y. C., de Visser, E. J., & Parasuraman, R. (2011) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811417254 · Cited by 2,051 · cited 1×
“We see some such frissoms of concern in respect to human–robot interaction where the issues of trust and machine (robot) transparency are becoming of ever greater importance (Hancock et al. 2011; sanders et al. 2015).”
BackgroundSelf-citationMeasurement of Inequality of Incomes
Gini, C. (1921) · The Economic Journal · doi:10.2307/2223319 · Cited by 1,781
The Logic of Inductive Inference
Fisher, R. A. (1935) · Journal Of The Royal Statistical Society · doi:10.2307/2342435 · Cited by 1,308
124: The Logic of Inductive Inference.
Fisher, R. A. (1935) · Adelaide Research & Scholarship (AR&S) (University of Adelaide) · Cited by 881
Kurzweil, R. (2014) · Palgrave Macmillan UK eBooks · doi:10.1057/9781137349088_26 · Cited by 866
How in the World Did We Ever Get into That Mode? Mode Error and Awareness in Supervisory Control
Sarter, N. B., & Woods, D. D. (1995) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779049516 · Cited by 853
Moral machines: teaching robots right from wrong
(2009) · Choice Reviews Online · doi:10.5860/choice.46-4493 · Cited by 799
Wallach, W., & Allen, C. (2009) · Oxford University Press · doi:10.1093/acprof:oso/9780195374049.001.0001 · Cited by 711
Research works printed but not linked: 12
- Asimov I., 1942, I Robot
- Editorial, 2015, Private Eye
- Hancock P. A., 2011, The Ergonomist, 487, 4
- Hancock P. A., IIE Transactions on Occupational Ergonomics and Human Factors
- ICRC (International Committee of the Red Cross), 2014, Report of the ICRC Expert Meeting on ‘Autonomous Weapon Systems’
- Kourilsky P., 1975, Biochimie, 57
- Milton J., 1667, Paradise Lost
- Nietzsche F., 1878, Human All Too Human
- Murphy R. R., 2009, IEEE Intelligent Systems, 2
- Parsons H. M., 1990, Ergonomics of Hybrid Automated Systems, 787
- Stowers K., Ergonomics in Design
- Zax D., 2012, MIT Technology Review
Cited by
Sorted by citations
Items 101–161 of 161
Mueller, J. M. (2019) · IEEE International Symposium on Technology and Society (ISTAS) · doi:10.1109/istas48451.2019.8938010 · Cited by 6
Handling Trust Between Drivers and Automated Vehicles for Improved Collaboration
Azevedo-Sa, H., Yang, X. J., Robert, L., & Tilbury, D. M. (2021) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3434074.3446358 · Cited by 6
Normative Epistemology for Lethal Autonomous Weapons Systems
Devitt, S. K. (2021) · doi:10.1093/oso/9780197546048.003.0016 · Cited by 6
Development of Smart Librarian with the Virtual Assistant (PRIMO)
(2020) · Australian Journal of Engineering and Innovative Technology · doi:10.34104/ajeit.020.054065 · Cited by 6
Rodríguez, S., Zaroukian, E. G., Hoye, J., & Asher, D. E. (2022) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/15553434221129166 · Cited by 10
Teamwork and Communication Methods and Metrics for Human-Autonomy Teaming
Baker, A. L., Schaefer, K. E., & Hill, S. G. (2019) · Cited by 6
Yapay Zekâ Risklerinin Etik Yönünden Değerlendirilmesi
Efe, A. (2021) · DergiPark (Istanbul University) · Cited by 5
Hancock, P. A., Senders, J. W., & Lee, J. D. (2018) · The American Journal of Psychology · doi:10.5406/amerjpsyc.131.3.0381 · Cited by 5
Self-citationWhat Makes a Good Team? - Towards the Assessment of Driver-Vehicle Cooperation.
Petermeijer, S. M., Tinga, A. M., Jansen, R. J., de Reus, A. J. C., & van Waterschoot, B. M. (2021) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3409118.3475153 · Cited by 5
Addressing Accountability in Highly Autonomous Virtual Assistants
Galdón, F., & Wang, S. J. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-25629-6_2 · Cited by 5
Machining the mind to mind the machine
Hancock, P. A. (2022) · Theoretical Issues in Ergonomics Science · doi:10.1080/1463922x.2022.2062067 · Cited by 5
Self-citationGatea, A. K. (2024) · Financial and credit activity problems of theory and practice · doi:10.55643/fcaptp.6.59.2024.4565 · Cited by 9
Corporate Robot Motion Identity
Reinhardt, J., Schmidtler, J., & Bengler, K. J. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-96074-6_16 · Cited by 4
Die ethische Debatte um den Einsatz von ferngesteuerten und autonomen Waffensystemen
Koch, B. (2019) · Gerechter Frieden · doi:10.1007/978-3-658-26947-0_2 · Cited by 4
Human Perception of Inertial Mass for Joint Human-Robot Object Manipulation
Schmidtler, J., & Körber, M. (2018) · ACM Transactions on Applied Perception · doi:10.1145/3182176 · Cited by 4
Advisory adumbrations about autonomy’s acceptability
Hancock, P. A. (2022) · Human-Computer Interaction · doi:10.1080/07370024.2022.2039658 · Cited by 4
Self-citationAre autonomous cars really safer than human drivers?
Hancock, P. A. (2018) · doi:10.64628/aai.wquk6hnkq · Cited by 4
Self-citationIsles of autonomy: the rise of intelligent technologies
Hancock, P. A. (2025) · Ergonomics · doi:10.1080/00140139.2024.2447863 · Cited by 4
Self-citationMatters of Ethics, Trust, and Potential Liability for Autonomous Systems
Brill, J. C., Bliss, J. P., Hancock, P. A., Manzey, D., Meyer, J., & Vredenburgh, A. G. (2016) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213601070 · Cited by 3
Self-citationTeaching advanced technology (ADAS) and use of touch screens in driver training in Norway
Sætren, G. B., Vaag, J. R., Saghafian, M., Wigum, J. P., & Helde, R. (2024) · Cognition Technology & Work · doi:10.1007/s10111-024-00766-6 · Cited by 2
The big six model of AI trust: a unifying framework and 20-item scale for knowledge creation
Dickens, J. M., Uvet, H., Bauman, A., & Kwon, H. Y. (2026) · Journal of Knowledge Management · doi:10.1108/jkm-02-2025-0222 · Cited by 2
Pushparaj, K., Alam, S., Vijayaragavan, V., Gulyás, B., & Duong, V. (2022) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181322661053 · Cited by 2
Sebastian, L., & Schulte, A. (2024) · IEEE International Conference on Human-Machine Systems (ICHMS) · doi:10.1109/ichms59971.2024.10555606 · Cited by 2
Resilience in Operators, Technologies, and Systems
Hancock, P. A., & Cruit, J. K. (2024) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2024.3408804 · Cited by 2
Self-citationRoberts, A. P. J., Parnell, C. J., & Patel, M. (2024) · Ergonomics · doi:10.1080/00140139.2024.2392779 · Cited by 3
Xie, Y.-H., Guo, B., Jia, M., Xu, Z., & Tao, X. (2025) · Annals of Nuclear Energy · doi:10.1016/j.anucene.2025.111192 · Cited by 1
Human-Centered Artificial Intelligence: Trusted, Reliable & Safe.Preprint
Shneiderman, B. (2020) · arXiv (Cornell University) · Cited by 2
Optimising user engagement in highly automated virtual assistants to improve energy managementPreprint
Galdón, F., & Wang, S. J. (2020) · doi:10.46855/energy-proceedings-6696 · Cited by 2
Galdón, F., Hall, A., & Ferrarello, L. F. (2020) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-44267-5_14 · Cited by 1
Salmon, P. M., King, B. J., McLean, S. G., Read, G. J. M., Shanahan, C., & Devitt, S. K. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-15988-6.00002-9 · Cited by 1
Law and Infrastructure: Reliability, Automation Transition, and Irregularities of “U‐Space”
Nawaz, S. A. (2025) · Regulation & Governance · doi:10.1111/rego.70046 · Cited by 2
Human vigilance in the age of intelligent machines: Challenges and prospects
Hancock, P. A. (2026) · Ergonomics · doi:10.1080/00140139.2025.2609813 · Cited by 1
Self-citationThe Role of Accounts and Apologies in Mitigating Blame toward Human and Machine Agents
Stowers, K. L. (2017) · Journal of International Crisis and Risk Communication Research · Cited by 1
Footprint Reduction of Sensor Control Modules for Remote Portable Laboratories
ARGHIRESCU, S.-A., Sîrbu-Drăgan, M., & Fratu, O. (2022) · Sensors · doi:10.3390/s22041483 · Cited by 1
Examples of energy, transportation, and information with humanity
Han, W., Chan, C. C., Zhou, G. Y., Yuan, Z., Tan, Y., Rao, H., Lou, T., Wu, J., Shi, H., Zhou, A., et al. (2024) · Elsevier eBooks · doi:10.1016/b978-0-323-95521-8.00031-2 · Cited by 1
Neigel, A. R., & Hancock, G. M. (2019) · Advances in human and social aspects of technology book series · doi:10.4018/978-1-5225-7949-6.ch011 · Cited by 1
Sex Differences in Perceptions of Asynchronous Audiotactile Cues
Claypoole, V. L., & Brill, J. C. (2019) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181319631004 · Cited by 1
Developing human-autonomy teaming characteristics and guidance in aerospace operations
Tokadlı, G. (2021) · doi:10.31274/td-20240329-223 · Cited by 1
Conspicuity and Accidents: Data Versus Resource-Limited Differentiations
Hancock, P. A. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-96071-5_19
Self-citationThe Life and Contributions of Neville Moray
Hancock, P. A. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-96077-7_78
Self-citationChallenges to Systems Engineering
Faulkner, A., & Nicholson, M. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-820790-1.00015-2
Faulkner, A., & Nicholson, M. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-820790-1.00027-9
Density-Based Risk Assessments within Soft Safety Domains.
Sherstjuk, V., Zharikova, M., Levkivskyi, R., & Gusev, V. (2020)
An Approach to Modeling Simulated Military Human-agent Teaming
Hidalgo, M. (2020) · Journal of International Crisis and Risk Communication Research
Oswald, F. L., Imada, A. S., Behrend, T. S., Endsley, M. R., Hancock, P. A., Oswald, F. L., Spence, D., Weinger, M. B., & Warden, T. (2021) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181321651028
Self-citation(2020) · Elsevier eBooks · doi:10.1016/b978-0-12-820790-1.00045-0
Patnaik, P. (2022) · Advances in electronic government, digital divide, and regional development book series · doi:10.4018/978-1-7998-9710-1.ch006
From human-human trust to human-autonomous system trust
Pushparaj, K. (2022) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/161893
Towards a Comprehensive Model of Military Human-Agent Teaming
Hidalgo, M., & Jones, L.-R. (2023) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/21695067231192436
Walters, J. S. (2023) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/21695067231192545
Salmon, P. M. (2024) · Transportation Planning and Technology · doi:10.1080/03081060.2024.2427826
The Portrayel Of Morality In John Milton's Paradise Lost : A Critical Analysis
Iqbal, S., Malik, M. R., Hussain, A., & Rehman, A. U. (2025) · Annual Methodological Archive Research Review · doi:10.63075/vc43tm31
Self-driving cars and humans face inevitable collisions
Hancock, P. A. (2018) · The Conversation · doi:10.64628/aai.hcsyyk4gk
Self-citationNavarro, J., Hancock, P. A., Séguin, P., & Reynaud, E. (2026) · Ergonomics · doi:10.1080/00140139.2026.2616346
Self-citationCox, J. A., Ivory, B. E., Salmon, P. M., & Read, G. J. M. (2026) · AI & Society · doi:10.1007/s00146-026-02949-3
Controlling Chair: Experiencing User Autonomy versus Automation through an Interactive Artifact
Mlakar, S., Probst, K., & Weiss, A. (2025) · International Conference on Digital and Interactive Arts (ARTECH) · doi:10.1145/3773699.3773921
The Secret of the Dancing Mice: Intuiting the Inverted- U “Law” of Stress and Performance
Hancock, P. A. (2026) · The American Journal of Psychology · doi:10.5406/19398298.139.1.06
Self-citationDas, D. K., & Hassan, M. M. (2026) · Sustainability · doi:10.3390/su18126033
Zhu, Y., & Zhou, R. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2687131
A Framework on Human-Autonomy Unified Control and Strategies for eVTOL
Wang, N., Li, Y., & Zhang, S. (2026) · IEEE International Conference on Human-Machine Systems (ICHMS) · doi:10.1109/ichms69701.2026.11602175
A Human–Agent Trust Calibration Model for HFE Practitioners in Partial Mission Capable Recovery
Compierchio, A., Tretten, P., & Illankoon, P. (2026) · Safety · doi:10.3390/safety12050117
Metadata
- Authors
- Hancock, P. A.
- Affiliations
- University of Central Florida (US)
- Corresponding author
- Hancock, P. A.
- ORCID
- Hancock, P. A.
- Venue
- Ergonomics
- Publisher
- Informa UK Limited
- Published
- 2016-07-13
- Volume
- 60
- Issue
- 2
- Pages
- 284-291
- ISSN
- 0014-0139 (ISSN-L)
- 1366-5847
- OpenAlex
- W2471606134
- Cited by
- 162
- References
- 35
- Citations by year
- 2026: 10 · 2025: 10 · 2024: 10 · 2023: 18 · 2022: 20 · 2021: 24 · 2020: 26 · 2019: 15 · 2018: 15 · 2017: 8 · 2016: 5
- FWCI
- 22.30
- Type
- journal article
- Language
- en
- Open access
- Locations
- Ergonomics (publishedVersion)
- PubMed (publishedVersion)
- Journal of International Crisis and Risk Communication Research (submittedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Cybernetics and Technology in Society
- Keywords
- autonomous systems, human-centered design, human-automation interaction, user-centered design, human control, technology regulation, human factors in automation
- MeSH terms
- Automation, Humans, Ergonomics, Man-Machine Systems, Technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review