UUX Evaluation of a Digitally Advanced Human–Machine Interface for Excavators
Open accessThe DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
With the evaluation of a next-generation human–machine interface (HMI) concept for excavators, this study aims to discuss the HMI quality measurement based on usability and user experience (UUX) metrics. Regarding the digital transformation of construction sites, future work environments will have to be capable of presenting various complex visual data and enabling efficient and safe interactivity while working. The evaluated HMI focused on introducing a touch display-based interface, providing advanced operation functions and different interaction modalities. The assessment of UUX should show whether the novel HMI can be utilised to perform typical tasks (usability) and how it is accepted and assessed in terms of non-instrumental qualities (user experience, UX). Using the collected data, this article also aims to contribute to the general discussion about the role of UX beyond usability in industrial applications and deepen the understanding of non-instrumental qualities when it comes to user-oriented process and machine design. The exploratory study examines insights into the application of elaborated UUX measuring tools like the User Experience Questionnaire (UEQ) on the interaction with industrial goods accompanied by their rating with other tools, namely System Usability Scale (SUS), Intuitive Interaction Questionnaire (INTUI) and the National Aeronautics and Space Administration (NASA) Task Load Index (NASA-TLX). Four goals are pursued in this study. The first goal is to compare in-depth two different ways of interaction with the novel HMI—namely one by a control pad on the right joystick and one by touch. Therefore, a sample of 17 subjects in total was split into two groups and differences in UUX measures were tested. Secondly, the performances of both groups were tested over the course of trials to investigate possible differences in detail. The third goal is to interpret measures of usability and user experience against existing benchmark values. Fourth and finally, we use the data gathered to analyse correlations between measures of UUX. The results of our study show that the different ways of interaction did not impact any of the measures taken. In terms of detailed performance analysis, both groups yielded differences in terms of time per action, but not between the groups. The comparison of UUX measures with benchmark values yielded mixed results. The UUX measures show some relevant significant correlations. The participants mostly reported enjoying the use of the HMI concept, but several practical issues (e.g., efficiency) still need to be overcome. Once again, the study confirms the urge of user inclusion in product development. Especially in the course of digitalisation, as big scale advancements of systems and user interfaces bring uncertainty for many manufacturers regarding whether or how a feature should be integrated.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Additionally, the rise in remote work and the growing dependence on specialized digital tools amplify the importance of visually comfortable and cognitively accessible interfaces [1,2].”
From The Impact of User Interface and Experience (UI/UX) Design on Visual Ergonomics: A Technical Approach for Reducing Human Error in Industrial Settings (2026) · cites this paper as [2]
In the citing paper
“These shortcomings are particularly problematic in industrial and safety-critical environments, where operators must process large volumes of information under time pressure and make decisions with limited tolerance for error [1-3].”
From The Impact of User Interface and Experience (UI/UX) Design on Visual Ergonomics: A Technical Approach for Reducing Human Error in Industrial Settings (2026) · cites this paper as [2]
In the citing paper
“Meanwhile, studies such as [2,7,1315,18,19,22,26,30,31] present users operating in structured work environments or performing complex functional tasks, whether in factories, hospitals, assembly plants, construction or technical training.”
From The Impact of User Interface and Experience (UI/UX) Design on Visual Ergonomics: A Technical Approach for Reducing Human Error in Industrial Settings (2026) · cites this paper as [2]
In the citing paper
“In industrial environments with multitasking and operational pressure, robust and clear interfaces are necessary to prevent errors [2,6,12,14,15,19,22,30].”
From The Impact of User Interface and Experience (UI/UX) Design on Visual Ergonomics: A Technical Approach for Reducing Human Error in Industrial Settings (2026) · cites this paper as [2]
In the citing paper
“Projected or multimodal interfaces in industrial workstations also contribute to reducing human errors [2,6,14,15,19].”
From The Impact of User Interface and Experience (UI/UX) Design on Visual Ergonomics: A Technical Approach for Reducing Human Error in Industrial Settings (2026) · cites this paper as [2]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
SUS: A 'Quick and Dirty' Usability Scale
(1996) · Usability Evaluation In Industry · doi:10.1201/9781498710411-35 · Cited by 8,989
Usability Evaluation In Industry
(1996) · CRC Press eBooks · doi:10.1201/9781498710411 · Cited by 4,354
NASA-Task Load Index (NASA-TLX); 20 Years Later
Hart, S. G. (2006) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120605000909 · Cited by 4,297 · cited 1×
“In none of the tests, the mode of interaction explained any additional variance.”
Construction and Evaluation of a User Experience Questionnaire
Laugwitz, B., Held, T., & Schrepp, M. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-89350-9_6 · Cited by 2,114 · cited 1×
“The UEQ has been developed for the evaluation of user experience of interfaces in professional domains and can be easily transferred to physical and cyber-physical products [32,33].”
de Winter, J. C. F., Gosling, S. D., & Potter, J. (2016) · Psychological Methods · doi:10.1037/met0000079 · Cited by 1,201
The Interplay of Beauty, Goodness, and Usability in Interactive Products
Hassenzahl, M. (2004) · Human-Computer Interaction · doi:10.1207/s15327051hci1904_2 · Cited by 1,083
Probes, toolkits and prototypes: three approaches to making in codesigning
Sanders, E. B.-N., & Stappers, P. J. (2014) · CoDesign · doi:10.1080/15710882.2014.888183 · Cited by 1,006
AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität
Hassenzahl, M., Burmester, M., & Koller, F. (2003) · Berichte des German Chapter of the ACM · doi:10.1007/978-3-322-80058-9_19 · Cited by 955 · cited 1×
“Accordingly, despite their conceptual and methodical fit, questionnaires such as meCUE [28] or AttrakDi ff [29] could not be applied.”
Needs, affect, and interactive products – Facets of user experience
Hassenzahl, M., Diefenbach, S., & Göritz, A. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2010.04.002 · Cited by 867 · cited 1×
“While traditional approaches to human-centred design consider the what and how, i.e., function, safety and ergonomics, UXD also considers the why, pleasure and joy or personal significance [19–21].”
Construction of a Benchmark for the User Experience Questionnaire (UEQ)
Schrepp, M., Hinderks, A., & Thomaschewski, J. (2017) · International Journal of Interactive Multimedia and Artificial Intelligence · doi:10.9781/ijimai.2017.445 · Cited by 822 · cited 2×
“REVIEW The detailed results 12 of 20”
Industrie 4.0 in Produktion, Automatisierung und Logistik: Anwendung · Technologien · Migration
(2014) · Springer eBooks · doi:10.1007/978-3-658-04682-8 · Cited by 679
Designing Collective Behavior in a Termite-Inspired Robot Construction Team
Werfel, J., Petersen, K., & Nagpal, R. (2014) · Science · doi:10.1126/science.1245842 · Cited by 599
How High is High? A Meta-Analysis of NASA-TLX Global Workload Scores
Grier, R. A. (2015) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931215591373 · Cited by 460 · cited 2×
“Spearman’s ranked correlation coe ffi cient.”
Determining what individual SUS scores mean
(2009) · Journal of Usability Studies archive · doi:10.5555/2835587.2835589 · Cited by 412
Item benchmarks for the system usability scale
(2018) · Journal of Usability Studies archive · doi:10.5555/3294033.3294037 · Cited by 355
Evaluation of hydraulic excavator Human–Machine Interface concepts using NASA TLX
Akyeampong, J., Udoka, S. J., Caruso, G., & Bordegoni, M. (2014) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2013.12.002 · Cited by 104 · cited 1×
“Akyeampong et al. presented a HMI concept for excavators using di ff erent types of head-up displays (HUD) and also measured the operators’ workload using the National Aeronautics and Space Administration Task Load Index (NASA-TLX) [12].”
meCUE – Ein modularer Fragebogen zur Erfassung des Nutzungserlebens
Minge, M., & Riedel, L. (2013) · Oldenbourg Wissenschaftsverlag eBooks · doi:10.1524/9783486781229.89 · Cited by 72
INTUI. Exploring the Facets of Intuitive Interaction
Ullrich, D., & Diefenbach, S. (2010) · Oldenbourg Wissenschaftsverlag eBooks · doi:10.1524/9783486853483.251 · Cited by 60
Sampaio, A. (2013) · ACM SIGSOFT Software Engineering Notes · doi:10.1145/2413038.2413056 · Cited by 58
Mensch-Maschine-Interaktion im Industrie 4.0-Zeitalter
Gorecky, D., Schmitt, M., & Loskyll, M. (2016) · Springer eBooks · doi:10.1007/978-3-662-53254-6_11 · Cited by 57
Sitompul, T. A., & Wallmyr, M. (2019) · ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry (VRCAI) · doi:10.1145/3359997.3365689 · Cited by 51 · cited 1×
“Sitompul and Wallmyr reported about the impact of digitalisation on heavy machinery and its operation as a reasoning for the introduction of augmented reality visualisations to reduce the stress level of the operators while increasing environmental awareness [13].”
A user-centred design approach for introducing computer-based process information systems
Kontogiannis, T., & Embrey, D. E. (1997) · Applied Ergonomics · doi:10.1016/s0003-6870(96)00041-5 · Cited by 45 · cited 1×
“There is high potential in using display-based interfaces, although these often come at the cost of usability and the need for relearning certain aspects of machine operation [6–8].”
Richter, M. M., & Flückiger, M. D. (2013) · IT kompakt · doi:10.1007/978-3-642-34832-7 · Cited by 38
Towards Haptic Images: A Survey on Touchscreen-Based Surface Haptics
Costes, A., Danieau, F., Argelaguet, F., Guillotel, P., & Lécuyer, A. (2020) · IEEE Transactions on Haptics · doi:10.1109/toh.2020.2984754 · Cited by 37 · cited 1×
“There is high potential in using display-based interfaces, although these often come at the cost of usability and the need for relearning certain aspects of machine operation [6–8].”
The analysis of excavator operation by skillful operator - extraction of common skills -
Sakaida, Y., Chugo, D., Yamamoto, H., & Asama, H. (2008) · SICE Annual Conference (SICE) · doi:10.1109/sice.2008.4654714 · Cited by 34 · cited 1×
“Referring to Sakaida et al. as well as Werfel et al. they point out the role of automation to ease work in hazardous environments and its role in the shift of work tasks towards high-level tasks such as planning and ensuring optimal operating parameters [1,10,11].”
Evaluating Mixed Reality Notifications to Support Excavator Operator Awareness
Wallmyr, M., Sitompul, T. A., Holstein, T., & Lindell, R. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-29381-9_44 · Cited by 34 · cited 2×
“User experience design (UXD) as a holistic approach to create valuable products aims at complementing instrumental qualities (directly task-related, covered by usability) with non-instrumental qualities of human–technology interaction [5,18].”
Challenges in evaluating skill transfer from construction equipment simulators
Dunston, P. S., Proctor, R. W., & Wang, X. (2011) · Theoretical Issues in Ergonomics Science · doi:10.1080/1463922x.2011.624647 · Cited by 32 · cited 2×
“The operation of a conventional excavator, therefore, is not very intuitive and the operators need years to master it [4,5].”
François, M., Crave, P., Osiurak, F., Fort, A., & Navarro, J. (2017) · Applied Ergonomics · doi:10.1016/j.apergo.2017.05.013 · Cited by 29 · cited 1×
“It considers e ffi ciency, e ff ectivity and user satisfaction [15] and its central role for work applications has been underpinned by many studies [16,17].”
Knowing, reasoning and visualizing in industrial design
Wölfel, C., Krzywinski, J., & Drechsel, F. (2013) · The Knowledge Engineering Review · doi:10.1017/s0269888913000258 · Cited by 26 · cited 1×
“While traditional approaches to human-centred design consider the what and how, i.e., function, safety and ergonomics, UXD also considers the why, pleasure and joy or personal significance [19–21].”
Self-citationUtilitarian or Experiential? An Analysis of Usability Questionnaires
Kun, C. T., & Sahari, N. (2014) · International Journal of Computer Theory and Engineering · doi:10.7763/ijcte.2015.v7.950 · Cited by 24 · cited 1×
“However, user experience is not just a holistic construct, where instrumental and non-instrumental qualities influence each other [25].”
Zeiner, K. M., Burmester, M., Haasler, K., Henschel, J., Laib, M., & Schippert, K. (2018) · Human Technology · doi:10.17011/ht/urn.201808103815 · Cited by 24 · cited 1×
“Corresponding research is just in its beginning, delivering initial findings on how user experience is special with industrial goods [22], in work contexts [23] or other multi-stakeholder domains.”
Butz, A. M., & Krüger, A. (2017) · De Gruyter eBooks · doi:10.1515/9783110476378 · Cited by 24
State of the art in excavators
Chacko, V., Yu, H., Cang, S., & Vlădăreanu, L. (2014) · International Conference on Advanced Mechatronic Systems · doi:10.1109/icamechs.2014.6911593 · Cited by 17 · cited 2×
“Referring to Sakaida et al. as well as Werfel et al. they point out the role of automation to ease work in hazardous environments and its role in the shift of work tasks towards high-level tasks such as planning and ensuring optimal operating parameters [1,10,11].”
Unveiling the Multiple and Complex Faces of Fidelity
Fiorineschi, L., & Rotini, F. (2019) · Proceedings of the ... International Conference on Engineering Design · doi:10.1017/dsi.2019.178 · Cited by 14 · cited 2×
“Group 2 (henceforth touch group) was instructed to solve the tasks using solely the touch display of the device.”
Rissanen, M. J., Rönkkö, K., & Tripathi, S. (2011) · Indian Conference on Human-Computer Interaction (IndiaHCI) · doi:10.1145/2407796.2407807 · Cited by 3 · cited 1×
“Corresponding research is just in its beginning, delivering initial findings on how user experience is special with industrial goods [22], in work contexts [23] or other multi-stakeholder domains.”
Die Kürzung des User Experience Questionnaire UEQ
Alberola, C., Brau, H., & Walter, G. (2017) · Gesellschaft für Informatik (GI) · doi:10.18420/muc2017-mci-0178 · Cited by 1 · cited 1×
“The UEQ has been developed for the evaluation of user experience of interfaces in professional domains and can be easily transferred to physical and cyber-physical products [32,33].”
Persson, D. (2018) · Chalmers Publication Library (Chalmers University of Technology) · Cited by 1
Research works printed but not linked: 2
- Tripathi, S. (2011). Understanding Industrial User Experience. An Excerpt from 1st International Workshop on Industrial User Experience. 3rd International Conference on Human Computer Interaction 2011, ACM.
- Wölfel, C., and Krzywinski, J. (2019). Human Needs as the Crux of the Matter in Product-Service Systems Development. Human Behaviour in Design: Proceedings of the 2nd SIG conference, Institut für Technische Produktentwicklung, Universität der Bundeswehr München.
Cited by
Human–robot collaboration for on-site construction
Zhang, M., Xu, R., Wu, H., Pan, J., & Luo, X. (2023) · Automation in Construction · doi:10.1016/j.autcon.2023.104812 · Cited by 170
Digital transformation in construction – a review
Samuelson, O., & Stehn, L. (2023) · Journal of Information Technology in Construction · doi:10.36680/j.itcon.2023.020 · Cited by 95
Rannertshauser, P., Kessler, M., & Arlinghaus, J. C. (2022) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2022.10.108 · Cited by 38
Usability assessment of compaction operator support systems using virtual prototyping
Makarov, D., Vahdatikhaki, F., Miller, S., Mowlaei, S., & Dorée, A. G. (2021) · Automation in Construction · doi:10.1016/j.autcon.2021.103784 · Cited by 24
Ding, R., Cheng, M., Han, Z., Wang, F., & Bing Hong, X. U. (2022) · Automation in Construction · doi:10.1016/j.autcon.2022.104145 · Cited by 21
Metadata
- Authors
- Lorenz, S., Helmert, J. R., Anders, R., Wölfel, C., & Krzywinski, J.
- Affiliations
- Technische Universität Dresden (DE)
- Independent Researcher, Görlitzer Straße 42, 01099 Dresden, Germany
- Corresponding author
- Lorenz, Sebastian
- Venue
- Multimodal Technologies and Interaction
- Publisher
- MDPI AG
- Published
- 2020-08-20
- Volume
- 4
- Issue
- 3
- Pages
- 57
- ISSN
- 2414-4088 (ISSN-L)
- OpenAlex
- W3063721765
- Cited by
- 16
- References
- 38
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 3 · 2023: 3 · 2022: 3 · 2021: 1
- FWCI
- 1.27
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Multimodal Technologies and Interaction (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Keywords
- human-machine interaction, excavators, user experience, usability, touch screen, joystick control, interaction modalities, User Experience Questionnaire, System Usability Scale, NASA-TLX, workload, construction machinery, user-centered design, performance evaluation, benchmark values
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.