Human-in-the-loop AI: Requirements on future (unified) air traffic management systems
The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Intense drone traffic, exceeding human capabilities of manual control, is expected to occur during the last stage of Unified Traffic Management (UTM) and Unmanned Airspace System (UAS) service deployment in cities. In this paper, we discuss how humans and automation could collaborate to manage this airspace. We review theory on options for UTM airspace structure (volumes, points, networks, layers), machine learning, optimization, and human-automation collaboration. Based on simulation and visualization of two cities, we discuss four abilities: to discern traffic patterns, to recognize situations, to predict situational developments, and to function in varying conditions of rule-following habits of airspace users. We then discuss the challenge of collaborating though the use of advanced visual dashboards, for human-in-the loop AI but also for society-in-the-loop. Finally, we discuss how the challenge of human-automation collaboration can be expected to shift, as the capabilities of the machine increases.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The study proves that the present safety culture and regulatory regime in the aviation industry provide avenues for integrating artificial intelligence while ensuring human accountability.”
From Human-in-the-Loop Artificial Intelligence: A Systematic Review of Concepts, Methods, and Applications (2026) · cites this paper as [123]
Citations
Cites
WHAT ABOUT PEOPLE IN REGIONAL SCIENCE?
Hägerstraand, T. (1970) · Papers in Regional Science · doi:10.1111/j.1435-5597.1970.tb01464.x · Cited by 3,405
Bainbridge, L. (1983) · Automatica · doi:10.1016/0005-1098(83)90046-8 · Cited by 2,205
The plane with parallel coordinates
Inselberg, A. (1985) · The Visual Computer · doi:10.1007/bf01898350 · Cited by 1,423
Vehicle Routing Problems for Drone Delivery
Dorling, K., Heinrichs, J., Messier, G. G., & Magierowski, S. (2017) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2016.2582745 · Cited by 1,326
Human and Computer Control of Undersea Teleoperators
Sheridan, T. B., & Verplank, W. L. (1978) · doi:10.21236/ada057655 · Cited by 1,227
Ecological interface design: theoretical foundations
Vicente, K. J., & Rasmussen, J. (1992) · IEEE Transactions on Systems, Man and Cybernetics · doi:10.1109/21.156574 · Cited by 1,084
Joint Cognitive Systems: Foundations of Cognitive Systems Engineering
Hollnagel, E., & Woods, D. D. (2005) · Thammasat University Digital Collections · Cited by 787
Joint Cognitive Systems: Foundations of Cognitive Systems Engineering
Hollnagel, E., & Woods, D. D. (2005) · doi:10.1201/9781420038194 · Cited by 695
ThemeRiver: visualizing theme changes over time
Havre, S., Hetzler, B., & Nowell, L. (2002) · IEEE Symposium on Information Visualization 2000. INFOVIS 2000. Proceedings · doi:10.1109/infvis.2000.885098 · Cited by 416
MABA-MABA or Abracadabra? Progress on Human-Automation Co-ordination
Dekker, S. W. A., & Woods, D. D. (2002) · Cognition, Technology & Work · doi:10.1007/s101110200022 · Cited by 328
Algorithms for Routing an Unmanned Aerial Vehicle in the Presence of Refueling Depots
Sundar, K., & Rathinam, S. (2014) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2013.2279544 · Cited by 229
The Seven Deadly Myths of "Autonomous Systems"
Bradshaw, J. M., Hoffman, R. R., Johnson, M., & Woods, D. D. (2013) · IEEE Intelligent Systems · doi:10.1109/mis.2013.70 · Cited by 216
A multi-objective green UAV routing problem
Coelho, B. N., Coelho, V. N., Coelho, I. M., Ochi, L. S., Haghnazar K., R., Zuidema, D., Lima, M. S. F., & da Costa, A. R. (2017) · Computers & Operations Research · doi:10.1016/j.cor.2017.04.011 · Cited by 192
The unmanned aerial vehicle routing and trajectory optimisation problem, a taxonomic review
Coutinho, W. P., Battarra, M., & Fliege, J. (2018) · Computers & Industrial Engineering · doi:10.1016/j.cie.2018.04.037 · Cited by 188
Information Visualization: An Introduction
Spence, R. (2014) · Springer eBooks · doi:10.1007/978-3-319-07341-5 · Cited by 141
Two Heads Are Better than One: The Collaboration between AI and OR
Simon, H. A. (1987) · Interfaces · doi:10.1287/inte.17.4.8 · Cited by 132
Unmanned Aircraft System traffic management: Concept of operation and system architecture
Jiang, T., Geller, J., Ni, D., & Collura, J. (2016) · International Journal of Transportation Science and Technology · doi:10.1016/j.ijtst.2017.01.004 · Cited by 125
Metropolis: Relating Airspace Structure and Capacity for Extreme Traffic Densities
Sunil, E., Hoekstra, J. M., Ellerbroek, J., Bussink, F., Nieuwenhuisen, D., Vidosavljević, A., & Kern, S. (2015) · elib (German Aerospace Center) · Cited by 107
Kistan, T., Gardi, A., & Sabatini, R. (2018) · Aerospace · doi:10.3390/aerospace5040103 · Cited by 78
Capacity Estimation for Low Altitude Airspace
Bulusu, V., Polishchuk, V., Sengupta, R., & Sedov, L. (2017) · AIAA Aviation Technology, Integration, and Operations Conference (ATIO) · doi:10.2514/6.2017-4266 · Cited by 33
Lundberg, J., Arvola, M., Westin, C., Holmlid, S., Nordvall, M., & Josefsson, B. (2018) · Behaviour and Information Technology · doi:10.1080/0144929x.2018.1505951 · Cited by 28
Self-citationAn Unmanned Aerial Traffic Management solution for cities using an air parcel model
Foina, A. G., Krainer, C., & Sengupta, R. (2015) · International Conference on Unmanned Aircraft Systems (ICUAS) · doi:10.1109/icuas.2015.7152423 · Cited by 26
Urban Air Traffic Management (UTM) Implementation In Cities - Sampled Side-Effects
Lundberg, J., Palmerius, K. L., & Josefsson, B. (2018) · IEEE/AIAA Digital Avionics Systems Conference (DASC) · doi:10.1109/dasc.2018.8569869 · Cited by 24
Self-citationSupervised Learning Applied to Air Traffic Trajectory Classification
Bosson, C. S., & Nikoleris, T. (2018) · AIAA Information Systems-AIAA Infotech @ Aerospace · doi:10.2514/6.2018-1637 · Cited by 23
Noise Estimation for future large-scale small UAS Operations
Bulusu, V., Polishchuk, V., & Sedov, L. (2017) · Cited by 18
Context, cognition and control
Waern, Y. (2003) · CRC Press eBooks · doi:10.1201/9781482273014-10 · Cited by 11
Cognitive Work Analysis and Conceptual Designing for Unmanned Air Traffic Management in Cities
Lundberg, J., Westin, C., Arvola, M., Holmlid, S., & Josefsson, B. (2018) · European Conference on Cognitive Ergonomics · doi:10.1145/3232078.3232082 · Cited by 6
Self-citation
Research works printed but not linked: 3
- rasmussen, 1986, Infromation Processing and Human-Machine Interaction-An Approache to Cognitive Engineering (North-Holland Series in System Science and Engieering)
- naessens, 2017, Predicting flight routes with a Deep Neural Network in the operational Air Traffic Flow and Capacity Management system
- 2017, U-Space Blueprint
Cited by
A Review on Human–AI Interaction in Machine Learning and Insights for Medical Applications
Maadi, M., Akbarzadeh Khorshidi, H., & Aickelin, U. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18042121 · Cited by 116
“ML methods, the collaboration of humans and ML methods cannot be denied because two heads are better than one [2].”
MethodLazaros, K., Vrahatis, A. G., & Kotsiantis, S. (2026) · Entropy · doi:10.3390/e28040377 · Cited by 50
Ali, H., Pham, D.-T., Alam, S., Schultz, M., Li, M. Z., Wang, Y., Itoh, E., & Dương, V. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.103256 · Cited by 32
A systematic review on human-AI hybrid systems and human factors in air traffic management
Xia, Z., Chen, C., Hsieh, M.-H., Ma, G., Liu, B., Yu, X., Xin, S., & Dong, L. (2025) · Journal of Engineering Design · doi:10.1080/09544828.2025.2509056 · Cited by 28
“Predictive capabilities are essential, helping operators anticipate and respond to situational developments in real-time (Lemoine, Millot, and Debernard 1997; Lundberg et al. 2019).”
Reimagining human agency in AI-driven futures: a co-evolutionary scenario framework from aviation
Navarro-Meneses, F. J., & Pablo-Martí, F. (2025) · European Journal of Futures Research · doi:10.1186/s40309-025-00260-w · Cited by 10
“Finally, research on emerging operational technologies and interfaces explores new frontiers such as augmented reality displays, drone and urban air mobility (UAM) traffic management, and intelligent airport systems [8, 38].”
Metadata
- Authors
- Lundberg, J., Bång, M., Johansson, J., Cheaitou, A., Josefsson, B., & Tahboub, Z.
- Affiliations
- Linköping University (SE)
- University of Sharjah (AE)
- Luftfartsverket (Sweden) (SE)
- Dubai Aviation Engineering Projects,Dubai,UAE
- Venue
- 2019 IEEE/AIAA 38th Digital Avionics Systems Conference (DASC)
- Publisher
- IEEE
- Published
- 2019-09
- Pages
- 1-9
- OpenAlex
- W3022935990
- Cited by
- 10
- References
- 27
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 2 · 2022: 1 · 2021: 1 · 2020: 1
- FWCI
- 1.36
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE/AIAA Digital Avionics Systems Conference (DASC) (publishedVersion)
- Topics
- Physical Sciences › Engineering › Aerospace Engineering › Air Traffic Management and Optimization
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Engineering › Aerospace Engineering › Aerospace and Aviation Technology
- Keywords
- human-in-the-loop AI, human-automation collaboration, unmanned aircraft systems, urban airspace, airspace structure, machine learning, optimization, visual dashboards, situational awareness, traffic pattern recognition, rule-following
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.