Cited by 162Human-Automation Interaction and SafetyEthics and Social Impacts of AICybernetics and Technology in Society

Imposing limits on autonomous systems

Open access
Hancock, P. A.·2017·Ergonomics

Abstract

Our present era is witnessing the genesis of a sea-change in the way that advanced technologies operate. Amongst this burgeoning wave of untrammelled automation there is now beginning to arise a cadre of ever-more independent, autonomous systems. The degree of interaction between these latter systems with any form of human controller is becoming progressively more diminished and remote; and this perhaps necessarily so. Here, I advocate for human-centred and human favouring constraints to be designed, programmed, promulgated and imposed upon these nascent forms of independent entity. I am not sanguine about the collective response of modern society to this call. Nevertheless, the warning must be voiced and the issue debated, especially among those who most look to mediate between people and technology. Practitioner Summary: Practitioners are witnessing the penetration of progressively more independent technical orthotics into virtually all systems' operations. This work enjoins them to advocate for sentient, rational and mindful human-centred approaches towards such innovations. Practitioners need to place user-centred concerns above either the technical or the financial imperatives which motivate this line of progress.

Integrity signals

Registry

Crossref · 10.1080/00140139.2016.1190035

Cites

35 of 35 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • In general, autonomous systems are generative and learn, evolve and permanently change their functional capacities as a result of the input of operational and contextual information.

    “In general, autonomous systems are generative and learn, evolve and permanently change their functional capacities as a result of the input of operational and contextual information (Hancock 2017).”

    From Trustworthy artificial intelligence (2021) · cites this paper as Hancock 2017

  • AI-based systems' actions necessarily become more indeterminate across time and are thus more challenging to predict, making trust interactions between humans and AI-based systems more complex and difficult to understand than trust interactions between humans and non-AI technologies.

    “AI-based systems' actions necessarily become more indeterminate across time and are thus more challenging to predict (Hancock 2017), making trust interactions between humans and AI-based systems more complex and difficult to understand than trust interactions between humans and non-AI technologies.”

    From Trustworthy artificial intelligence (2021) · cites this paper as Hancock 2017

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Hancock, P. A.
Affiliations
University of Central Florida (US)
Corresponding author
Hancock, P. A.
Venue
Ergonomics
Published
2016-07-13
Volume
60
Issue
2
Pages
284-291
ISSN
  • 0014-0139 (ISSN-L)
  • 1366-5847
OpenAlex
W2471606134
Cited by
162
References
35
Citations by year
2026: 10 · 2025: 10 · 2024: 10 · 2023: 18 · 2022: 20 · 2021: 24 · 2020: 26 · 2019: 15 · 2018: 15 · 2017: 8 · 2016: 5 · 2012: 1
FWCI
22.30
Type
journal article
Language
en
Open access
Locations
  • Ergonomics (publishedVersion)
  • PubMed (publishedVersion)
  • Journal of International Crisis and Risk Communication Research (submittedVersion)
Topics
  • Social Sciences › Psychology › Social Psychology › Human-Automation Interaction and Safety
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
  • Social Sciences › Arts and Humanities › History and Philosophy of Science › Cybernetics and Technology in Society
Keywords
autonomous systems, human-centered design, human-automation interaction, user-centered design, human control, technology regulation, human factors in automation
MeSH terms
Automation, Humans, Ergonomics, Man-Machine Systems, Technology

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review