The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Imposing limits on autonomous systems
Open accessAbstract
Our present era is witnessing the genesis of a sea-change in the way that advanced technologies operate. Amongst this burgeoning wave of untrammelled automation there is now beginning to arise a cadre of ever-more independent, autonomous systems. The degree of interaction between these latter systems with any form of human controller is becoming progressively more diminished and remote; and this perhaps necessarily so. Here, I advocate for human-centred and human favouring constraints to be designed, programmed, promulgated and imposed upon these nascent forms of independent entity. I am not sanguine about the collective response of modern society to this call. Nevertheless, the warning must be voiced and the issue debated, especially among those who most look to mediate between people and technology. Practitioner Summary: Practitioners are witnessing the penetration of progressively more independent technical orthotics into virtually all systems' operations. This work enjoins them to advocate for sentient, rational and mindful human-centred approaches towards such innovations. Practitioners need to place user-centred concerns above either the technical or the financial imperatives which motivate this line of progress.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In general, autonomous systems are generative and learn, evolve and permanently change their functional capacities as a result of the input of operational and contextual information (Hancock 2017).”
From Trustworthy artificial intelligence (2021) · cites this paper as Hancock 2017
In the citing paper
“AI-based systems' actions necessarily become more indeterminate across time and are thus more challenging to predict (Hancock 2017), making trust interactions between humans and AI-based systems more complex and difficult to understand than trust interactions between humans and non-AI technologies.”
From Trustworthy artificial intelligence (2021) · cites this paper as Hancock 2017
Citations
Cites
I.—COMPUTING MACHINERY AND INTELLIGENCE
TURING, A. M. (1950) · Mind · doi:10.1093/mind/lix.236.433 · Cited by 10,290 · cited 1×
“One standard approach has been to adopt the criteria advocated by Alan Turing (1950).”
MethodThe future of employment: How susceptible are jobs to computerisation?
Frey, C. B., & Osborne, M. A. (2017) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2016.08.019 · Cited by 8,727
A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction
Hancock, P. A., Billings, D. R., Schaefer, K. E., Chen, J. Y. C., de Visser, E. J., & Parasuraman, R. (2011) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811417254 · Cited by 2,051 · cited 1×
“We see some such frissoms of concern in respect to human–robot interaction where the issues of trust and machine (robot) transparency are becoming of ever greater importance (Hancock et al. 2011; sanders et al. 2015).”
BackgroundSelf-citationMeasurement of Inequality of Incomes
Gini, C. (1921) · The Economic Journal · doi:10.2307/2223319 · Cited by 1,781
The Logic of Inductive Inference
Fisher, R. A. (1935) · Journal Of The Royal Statistical Society · doi:10.2307/2342435 · Cited by 1,308
124: The Logic of Inductive Inference.
Fisher, R. A. (1935) · Adelaide Research & Scholarship (AR&S) (University of Adelaide) · Cited by 881
Kurzweil, R. (2014) · Palgrave Macmillan UK eBooks · doi:10.1057/9781137349088_26 · Cited by 866
How in the World Did We Ever Get into That Mode? Mode Error and Awareness in Supervisory Control
Sarter, N. B., & Woods, D. D. (1995) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779049516 · Cited by 853
Moral machines: teaching robots right from wrong
(2009) · Choice Reviews Online · doi:10.5860/choice.46-4493 · Cited by 799
Wallach, W., & Allen, C. (2009) · Oxford University Press · doi:10.1093/acprof:oso/9780195374049.001.0001 · Cited by 711
Is the Brain's Mind a Computer Program?
Searle, J. R. (1990) · Scientific American · doi:10.1038/scientificamerican0190-26 · Cited by 638
de Chardin, P. T. (1955) · Medical Entomology and Zoology · Cited by 600
Inequality and Democratization
Ansell, B. W., & Samuels, D. (2014) · Cambridge University Press eBooks · doi:10.1017/cbo9780511843686 · Cited by 559
Carayon, P., Hancock, P. A., Leveson, N. G., Noy, I. Y., Sznelwar, L. I., & Hootegem, G. V. (2015) · Ergonomics · doi:10.1080/00140139.2015.1015623 · Cited by 312
Self-citationHedonomics: The Power of Positive and Pleasurable Ergonomics
Hancock, P., Pepe, A. A., & Murphy, L. L. (2005) · Ergonomics in Design The Quarterly of Human Factors Applications · doi:10.1177/106480460501300104 · Cited by 258
Self-citationBeyond Asimov: The Three Laws of Responsible Robotics
Murphy, R., & Woods, D. D. (2009) · IEEE Intelligent Systems · doi:10.1109/mis.2009.69 · Cited by 193
In search of vigilance: The problem of iatrogenically created psychological phenomena.
Hancock, P. A. (2012) · American Psychologist · doi:10.1037/a0030214 · Cited by 193
Self-citationBreazeal, C., Edsinger, A., Fitzpatrick, P., Scassellati, B. M., & Varchavskaia, P. (2023) · IEEE Intelligent Systems · doi:10.1109/mis.9670 · Cited by 147
Automation Technology and Human Performance: Current Research and Trends
Scerbo, M. W., & Mouloua, M. (1999) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 140
Automation: how much is too much?
Hancock, P. A. (2014) · Ergonomics · doi:10.1080/00140139.2013.816375 · Cited by 129
Self-citationDrone Warfare: Killing By Remote Control
Medea, & Benjamin, . (2013) · Cited by 97
Drone warfare: killing by remote control
Barnaby, F. (2014) · Medicine Conflict & Survival · doi:10.1080/13623699.2014.887452 · Cited by 87
The Turing test: the elusive standard of artificial intelligence
(2004) · Choice Reviews Online · doi:10.5860/choice.41-4084 · Cited by 74
Moor, J. H. (2003) · Studies in cognitive systems · doi:10.1007/978-94-010-0105-2 · Cited by 61
Mind, machine and morality: toward a philosophy of human-technology symbiosis
(2010) · Choice Reviews Online · doi:10.5860/choice.47-2523 · Cited by 52
Hancock, P. (2017) · CRC Press eBooks · doi:10.1201/9781315248905 · Cited by 42
Self-citationBartlett, F. C. (1962) · Ergonomics · doi:10.1080/00140136208930653 · Cited by 40
Asilomar and Recombinant DNA: The End of the Beginning
Hanna, K. E. (1991) · Cited by 30
The ultimate experiment: Man-made evolution
Wade, N. J. (1977) · DigitalGeorgetown (Georgetown University Library) · Cited by 29
Sans subjectivity - ergonomics is engineering
Hancock, P. A., Weaver, J. L., & Parasuraman, R. (2002) · Ergonomics · doi:10.1080/00140130210166898 · Cited by 29
Self-citationHollnagel, E. (2001) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220110113628 · Cited by 24
Henley, W. E. (1897) · Cited by 16
The Philosophy of Francis Bacon
Broad, C. D. (1927) · Cited by 13
On the Nature of Time in Conceptual and Computational Nervous Systems
Hancock (2007) · KronoScope · doi:10.1163/156852407x249034 · Cited by 10
Fredric Bartlett: through the lens of prediction
Hancock, P. A. (2007) · Ergonomics · doi:10.1080/00140130701802692 · Cited by 8
Self-citation
Research works printed but not linked: 12
- Asimov I., 1942, I Robot
- Editorial, 2015, Private Eye
- Hancock P. A., 2011, The Ergonomist, 487, 4
- Hancock P. A., IIE Transactions on Occupational Ergonomics and Human Factors
- ICRC (International Committee of the Red Cross), 2014, Report of the ICRC Expert Meeting on ‘Autonomous Weapon Systems’
- Kourilsky P., 1975, Biochimie, 57
- Milton J., 1667, Paradise Lost
- Nietzsche F., 1878, Human All Too Human
- Murphy R. R., 2009, IEEE Intelligent Systems, 2
- Parsons H. M., 1990, Ergonomics of Hybrid Automated Systems, 787
- Stowers K., Ergonomics in Design
- Zax D., 2012, MIT Technology Review
Cited by
Sorted by citations
Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthy
Shneiderman, B. (2020) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1741118 · Cited by 1,743
From Here to Autonomy: Lessons Learned From Human–Automation Research
Endsley, M. R. (2017) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816681350 · Cited by 898
Schaefer, K. E., Chen, J. Y. C., Szalma, J. L., & Hancock, P. A. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816634228 · Cited by 768
Self-citationHuman–Autonomy Teaming: A Review and Analysis of the Empirical Literature
O’Neill, T., McNeese, N. J., Barron, A. H., & Schelble, B. G. (2020) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720820960865 · Cited by 681
Trustworthy artificial intelligence
Thiebes, S., Lins, S., & Sunyaev, A. (2021) · Electronic Markets · doi:10.1007/s12525-020-00441-4 · Cited by 595
Metadata
- Authors
- Hancock, P. A.
- Affiliations
- University of Central Florida (US)
- Corresponding author
- Hancock, P. A.
- ORCID
- Hancock, P. A.
- Venue
- Ergonomics
- Publisher
- Informa UK Limited
- Published
- 2016-07-13
- Volume
- 60
- Issue
- 2
- Pages
- 284-291
- ISSN
- 0014-0139 (ISSN-L)
- 1366-5847
- OpenAlex
- W2471606134
- Cited by
- 162
- References
- 35
- Citations by year
- 2026: 10 · 2025: 10 · 2024: 10 · 2023: 18 · 2022: 20 · 2021: 24 · 2020: 26 · 2019: 15 · 2018: 15 · 2017: 8 · 2016: 5
- FWCI
- 22.30
- Type
- journal article
- Language
- en
- Open access
- Locations
- Ergonomics (publishedVersion)
- PubMed (publishedVersion)
- Journal of International Crisis and Risk Communication Research (submittedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Cybernetics and Technology in Society
- Keywords
- autonomous systems, human-centered design, human-automation interaction, user-centered design, human control, technology regulation, human factors in automation
- MeSH terms
- Automation, Humans, Ergonomics, Man-Machine Systems, Technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
