Human behaviour with automated driving systems: a quantitative framework for meaningful human control
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Automated driving systems (ADS) with partial automation are currently available for the consumer. They are potentially beneficial to traffic flow, fuel consumption, and safety, but human behaviour whilst driving with ADS is poorly understood. Human behaviour is currently expected to lead to dangerous circumstances as ADS could place human drivers ‘out-of-the-loop’ or cause other types of adverse behavioural adaptation. This article introduces the concept of ‘meaningful human control’ to better address the challenges raised by ADS, and presents a new framework of human control over ADS by means of literature-based categorisation. Using standards set by European authorities for driver skills and road rules, this framework offers a unique, quantified perspective into the effects of ADS on human behaviour. One main result is a rapid and inconsistent decrease in required skill- and rule-based behaviour mismatching with the increasing amount of required knowledge-based behaviour. Furthermore, the development of higher levels of automation currently requires different human behaviour than feasible, as a mismatch between supply and demand in terms of behaviour arises. Implications, discrepancies and emerging mismatches this framework elicits are discussed, and recommendations towards future design strategies and research opportunities are made to provide a meaningful transition of human control over ADS.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Humans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · cited 1×
“…to a knowledge-based behaviour level (cf. exclamation mark sign at Table 1), but that requirement simultaneously beats the purpose of ADS altogether, as these systems—as goes for many other automated systems— are predominantly there to replace the human as the operator (Parasuraman and Riley 1997).”
BackgroundA model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 1×
“With extended exposure to driving with such systems activated, the consensus is that an actual loss of skill can be expected (e.g., Bainbridge 1983; Navarro 2018; Parasuraman, Sheridan, and Wickens 2000; Young and Stanton 2007).”
BackgroundRasmussen, J. (1983) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1983.6313160 · Cited by 3,434
Bainbridge, L. (1983) · Automatica · doi:10.1016/0005-1098(83)90046-8 · Cited by 2,205 · cited 3×
“…driving occurs throughout all levels of automation, it appears paramount to reconsider the driver’s role as a fall-back mechanism during automated driving, especially when given the time to ‘forget’ about their learned skills and rules (see also e.g., Bainbridge 1983; Navarro 2018; Spulber 2016).”
BackgroundMilakis, D., van Arem, B., & van Wee, B. (2017) · Journal of Intelligent Transportation Systems · doi:10.1080/15472450.2017.1291351 · Cited by 963
Towards a general theory of driver behaviour
Fuller, R. (2005) · Accident Analysis & Prevention · doi:10.1016/j.aap.2004.11.003 · Cited by 876
Meaningful Human Control over Autonomous Systems: A Philosophical Account
Santoni de Sio, F., & van den Hoven, J. (2018) · Frontiers in Robotics and AI · doi:10.3389/frobt.2018.00015 · Cited by 566
Modeling and Prediction of Human Behavior
Pentland, A., & Liu, A. (1999) · Neural Computation · doi:10.1162/089976699300016890 · Cited by 520
Behavioural impacts of Advanced Driver Assistance Systems–an overview
Brookhuis, K. A., De Waard, D., & Janssen, W. H. (2001) · European Journal of Transport and Infrastructure Research · doi:10.18757/ejtir.2001.1.3.3667 · Cited by 245 · cited 1×
“Behavioural changes such as, but certainly not limited to, becoming complacent and having to supervise an automated system will have to be accounted for in order to ensure safe driving with such systems (e.g., Brookhuis, De Waard, and Janssen 2001; Lindgren and Chen 2007; Stanton and Young 2005).”
Background
Cited by
Four Responsibility Gaps with Artificial Intelligence: Why they Matter and How to Address them
Santoni de Sio, F., & Mecacci, G. (2021) · Philosophy & Technology · doi:10.1007/s13347-021-00450-x · Cited by 490
“…2015; Moyes, 2016; Schwarz, 2018), MHC has been recently investigated in the field of automated driving systems (Calvert et al., 2018, 2019, 2020; Heikoop et al., 2019; Mecacci & Santoni de Sio, 2020; Santoni de Sio & van den Hoven, 2018) and medical automation (Braun et al., 2020; Ficuciello et…”
BackgroundSelf-citationThe ethical use of artificial intelligence in human resource management: a decision-making framework
Bankins, S. (2021) · Ethics and Information Technology · doi:10.1007/s10676-021-09619-6 · Cited by 181
“Determining the specifics of such control will often involve identifying the tasks of a work process and assessing the nature of human control needed within and across those tasks, particularly where they are inter-related (see Heikoop et al., 2019 for an autonomous vehicle example).”
BackgroundMeaningful human control: actionable properties for AI system development
Cavalcante Siebert, L., Lupetti, M. L., Aizenberg, E., Beckers, N., Zgonnikov, A., Veluwenkamp, H., Abbink, D., Giaccardi, E., Houben, G.-J., Jonker, C. M., et al. (2023) · AI and Ethics · doi:10.1007/s43681-022-00167-3 · Cited by 138
“example, a driver may have final authority over a fully autonomous car, but the driver’s loss of situational awareness, or even skill degradation as a result of systematic lack of engagement in the driving task, will limit the driver’s ability to exert that control authority [41, 65, 82].”
BackgroundMethod
Metadata
- Authors
- Heikoop, D. D., Hagenzieker, M., Mecacci, G., Calvert, S., Santoni De Sio, F., & van Arem, B.
- Venue
- Theoretical Issues in Ergonomics Science
- Publisher
- Informa UK Limited
- Published
- 2019-03-18
- Volume
- 20
- Issue
- 6
- Pages
- 711-730
- ISSN
- 1463-922X (ISSN-L)
- 1464-536X
- OpenAlex
- W2922272032
- Cited by
- 41
- References
- 9
- FWCI
- 6.65
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Human behaviour with automated driving systems: a quantitative framework for meaningful human control. https://app.cochat.ai/papers/10.1080/1463922x.2019.1574931
- The paper
- Heikoop, D. D., Hagenzieker, M., Mecacci, G., Calvert, S., Santoni De Sio, F., & van Arem, B. (2019). Human behaviour with automated driving systems: a quantitative framework for meaningful human control. Theoretical Issues in Ergonomics Science. https://doi.org/10.1080/1463922x.2019.1574931
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.