Explainable Early Activity Recognition via Wearable Inertial Sensors for Human–Robot Collaboration in Agriculture
Open accessThe DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Abstract
In open-field agriculture, timely human activity recognition (HAR) is critical for anticipating worker actions and enabling proactive human–robot collaboration. This study developed an offline early HAR framework based on pre-segmented activity sequences. Long Short-Term Memory (LSTM) networks were used in conjunction with wearable inertial sensors mounted on the chest, cervical region, lumbar region, and right and left wrists. Accelerometer, gyroscope, and magnetometer signals were collected from 20 participants during an outdoor agricultural material-handling task, with a mobile ground robot serving as the receiving platform for the crate. Each activity was represented by cumulative prefixes from 30% to 100% of its duration. At the 30% observation ratio, the model achieved a macro-F1 score of 0.9314, compared with 0.9481 for the full sequence, corresponding to an absolute difference of 0.0167. Shapley Additive Explanations (SHAP) were also used to identify the body locations, sensor modalities, and signal channels that contributed most. The early decisions were mainly supported by sensors placed on the trunk, with wrist sensors providing complementary information, particularly for standing classification. Multimodal inertial information was also important. The most influential inputs were mainly gyroscope and magnetometer channels from the chest, cervical region, and lumbar region. In conclusion, the high performance at early observation ratios highlights the potential to support more adaptive and better-coordinated robot-assistance strategies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Vision-based navigation and guidance for agricultural autonomous vehicles and robots: A review
Bai, Y., Zhang, B., Xu, N., Zhou, J., Shi, J., & Diao, Z. (2023) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2022.107584 · Cited by 353
An Overview of Cooperative Robotics in Agriculture
Lytridis, C., Kaburlasos, V. G., Pachidis, T., Manios, M., Vrochidou, E., Kalampokas, T., & Chatzistamatis, S. (2021) · Agronomy · doi:10.3390/agronomy11091818 · Cited by 169
Approaches and Applications of Early Classification of Time Series: A Review
Gupta, A., Gupta, H. P., Biswas, B., & Dutta, T. (2020) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2020.3027279 · Cited by 167
Safety and ergonomics in human-robot interactive agricultural operations
Benos, L. T., Bechar, A., & Bochtis, D. (2020) · Biosystems Engineering · doi:10.1016/j.biosystemseng.2020.09.009 · Cited by 138
Self-citationBuerkle, A., Eaton, W. C., Lohse, N., Bamber, T., & Ferreira, P. (2021) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2021.102137 · Cited by 127
Inferring Human Intent and Predicting Human Action in Human–Robot Collaboration
Hoffman, G., Bhattacharjee, T., & Nikolaidis, S. (2023) · Annual Review of Control Robotics and Autonomous Systems · doi:10.1146/annurev-control-071223-105834 · Cited by 121
End-to-end learned early classification of time series for in-season crop type mapping
Rußwurm, M., Courty, N., Emonet, R., Lefèvre, S., Tuia, D., & Tavenard, R. (2023) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2022.12.016 · Cited by 107
Human–robot collaboration systems in agricultural tasks: A review and roadmap
Adamides, G., & Edan, Y. (2022) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2022.107541 · Cited by 100
Ding, L., Luo, J., Smith, D. M., Mackey, M. J., Fu, H., Davis, M. M., & Hu, Y. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19106336 · Cited by 91
Human–Robot Interaction in Agriculture: A Systematic Review
Benos, L. T., Moysiadis, V., Katerıs, D., Tagarakis, A. C., Busato, P., Pearson, S., & Bochtis, D. (2023) · Sensors · doi:10.3390/s23156776 · Cited by 79
Self-citationAiello, G., Catania, P., Vallone, M., & Venticinque, M. (2022) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2021.106637 · Cited by 74
Human Following and Guidance by Autonomous Mobile Robots: A Comprehensive Review
Eirale, A., Martini, M., & Chiaberge, M. (2025) · IEEE Access · doi:10.1109/access.2025.3548134 · Cited by 66
Reconfigurable agricultural robotics: Control strategies, communication, and applications
Martínez, H. A. H., Mondragon, I. F., González, S. R., & Martínez, L. F. P. (2025) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2025.110161 · Cited by 65
Exploring tasks and challenges in human-robot collaborative systems: A review
Asif, S., Callari, T. C., Khan, F., Eimontaite, I., Hubbard, E., Bahraini, M. S., Webb, P., & Lohse, N. (2025) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2025.103102 · Cited by 65
Wang, T., Liu, Z., Wang, L., Li, M., & Wang, X. V. (2024) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2024.102785 · Cited by 64
Moysiadis, V., Katikaridis, D., Benos, L. T., Busato, P., Anagnostis, A., Katerıs, D., Pearson, S., & Bochtis, D. (2022) · Applied Sciences · doi:10.3390/app12168160 · Cited by 59
Self-citationLeveraging explainable AI for sustainable agriculture: a comprehensive review of recent advances
Rajbongshi, A., Johora, F. T., Hossain, A., Sarker, M. S., Rahman, M. H., Rahman, M. W., Alotaibi, F. T., & Moni, M. A. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-025-11459-5 · Cited by 59
From Black Box to Glass Box: A Practical Review of Explainable Artificial Intelligence (XAI)
Liu, X., Huang, D., Yao, J., Dong, J., Song, L., Wang, H., Yao, C., & Chu, W. (2025) · AI · doi:10.3390/ai6110285 · Cited by 56
Human–Robot Collaboration in Modern Agriculture: A Review of the Current Research Landscape
Yerebakan, M. O., & Hu, B. (2024) · Advanced Intelligent Systems · doi:10.1002/aisy.202300823 · Cited by 54
Zhang, Y., Li, N., Zhang, L., Lin, J., Gao, X., & Chen, G. (2025) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2025.109968 · Cited by 54
Peng, C., Vougioukas, S. G., Slaughter, D. C., et al. (2022) · Journal of Field Robotics · doi:10.1002/rob.22106 · Cited by 48
Significant Features for Human Activity Recognition Using Tri-Axial Accelerometers
Bennasar, M., Price, B. A., Gooch, D., Bandara, A. K., & Nuseibeh, B. (2022) · Sensors · doi:10.3390/s22197482 · Cited by 38
Bin-Dog: A Robotic Platform for Bin Management in Orchards
Ye, Y., Wang, Z., Jones, D., et al. (2017) · Robotics · doi:10.3390/robotics6020012 · Cited by 37
Ki, M., Kim, D. H., Abdelhamid, M. A. A., & Pack, S. P. (2025) · Biosensors · doi:10.3390/bios15110737 · Cited by 35
Early Prediction of Human Intention for Human–Robot Collaboration Using Transformer Network
Zhang, X., Tian, S., Liang, X. P., Zheng, M., & Behdad, S. (2023) · Journal of Computing and Information Science in Engineering · doi:10.1115/1.4064258 · Cited by 32
Jalayer, R., Jalayer, M., Orsenigo, C., & Tomizuka, M. (2025) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2025.103110 · Cited by 32
A review of visual navigation for agricultural robots in open fields and controlled environments
Wang, R.-F., Xu, R., Chee, P. W., Wang, H., & Li, C. (2026) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2026.111754 · Cited by 32
Gesture Controlled Wireless Agricultural Weeding Robot
Gokul, S., Dhiksith, R., Sundaresh, S. A., & Gopinath, M. (2019) · International Conference on Advanced Computing and Communication Systems (ICACCS) · doi:10.1109/icaccs.2019.8728429 · Cited by 29
Vásconez, J. P., & Cheein, F. A. (2022) · Biosystems Engineering · doi:10.1016/j.biosystemseng.2022.08.010 · Cited by 27
Son, H., Lim, J. W., Park, S., Park, B., Han, J., Kim, H. B., Lee, M. C., Jang, K., Kim, G., & Chung, J. H. (2022) · IEEE Access · doi:10.1109/access.2022.3190618 · Cited by 24
Zheng, X., Otten, E., Reneman, M. F., & Lamoth, C. J. C. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109338 · Cited by 21
Explainable AI-Enhanced Human Activity Recognition for Human–Robot Collaboration in Agriculture
Benos, L. T., Tsaopoulos, D. E., Tagarakis, A. C., Katerıs, D., Busato, P., & Bochtis, D. (2025) · Applied Sciences · doi:10.3390/app15020650 · Cited by 21
Self-citationYamane, T., Kimura, M., & Morita, M. (2025) · Sensors · doi:10.3390/s25123780 · Cited by 19
Optimal Sensor Placement and Multimodal Fusion for Human Activity Recognition in Agricultural Tasks
Benos, L. T., Tsaopoulos, D. E., Tagarakis, A. C., Katerıs, D., & Bochtis, D. (2024) · Applied Sciences · doi:10.3390/app14188520 · Cited by 18
Self-citationHuman–Robot Interaction through Dynamic Movement Recognition for Agricultural Environments
Moysiadis, V., Benos, L. T., Karras, G. C., Katerıs, D., Peruzzi, A., Berruto, R., Papageorgiou, E. I., & Bochtis, D. (2024) · AgriEngineering · doi:10.3390/agriengineering6030146 · Cited by 17
Self-citationGil-Martín, M., López-Iniesta, J., Fernández-Martínez, F., & San-Segundo, R. (2023) · Sensors · doi:10.3390/s23135845 · Cited by 15
Apraiz, A., Lasa, G., Mazmela, M., Arana-Arexolaleiba, N., Elguea, Í., Escallada, O., Osa, N., & Etxabe, A. (2025) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2025.103045 · Cited by 15
Applications of robotics and extended reality in agriculture: A review
Anastasiou, E., Ntakos, G., Kanakari, E., Bitsika, S., Gemtou, M., Katsaragakis, M., Soudris, D., Volioti, C., Arvanitou, E.-M., Folina, M.-T., et al. (2025) · Smart Agricultural Technology · doi:10.1016/j.atech.2025.101521 · Cited by 15
Tree-SLAM: Semantic object SLAM for efficient mapping of individual trees in orchards
Rapado-Rincón, D., & Kootstra, G. (2025) · Smart Agricultural Technology · doi:10.1016/j.atech.2025.101439 · Cited by 12
Camilleri, M. A. (2026) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2026.124710 · Cited by 11
Neural network based agriculture activity detection using mobile accelerometer sensors
Sharma, S., Raval, J., & Jagyasi, B. G. (2014) · IEEE India Conference · doi:10.1109/indicon.2014.7030539 · Cited by 10
Deep learning for human locomotion analysis in lower-limb exoskeletons: a comparative study
Coser, O., Tamantini, C., Tortora, M., Furia, L., Sicilia, R., Zollo, L., & Soda, P. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2025.1597143 · Cited by 10
New Framework for Human Activity Recognition for Wearable Gait Rehabilitation Systems
Moawad, A., El-Khoreby, M. A., Fawaz, S. I., Issa, H. H., Awad, M. I., & Abdellatif, A. (2025) · Applied System Innovation · doi:10.3390/asi8020053 · Cited by 9
Human activity recognition algorithms for manual material handling activities
Sochopoulos, A., Poliero, T., Ahmad, J., Caldwell, D. G., & Natali, C. D. (2025) · Scientific Reports · doi:10.1038/s41598-024-81312-2 · Cited by 8
Robotics in Precision Agriculture: Task-, Platform-, and Evaluation-Oriented Review
Almtireen, N., & Ryalat, M. (2026) · Robotics · doi:10.3390/robotics15040081 · Cited by 8
CottonSim: A vision-guided autonomous robotic system for cotton harvesting in Gazebo simulation
Thayananthan, T., Zhang, X., Huang, Y., Chen, J., Wijewardane, N. K., Martins, V. S., Chesser, G. D., & Goodin, C. T. (2025) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2025.110963 · Cited by 8
Effective Sensor Selection for Human Activity Recognition via Shapley Value
Borella, E., Çakmakçi, U. B., Gottardis, E., Buratto, A., Marchioro, T., & Badia, L. (2024) · IEEE International Workshop on Metrology for Living Environment (MetroLivEnv) · doi:10.1109/metrolivenv60384.2024.10615860 · Cited by 6
Seeking optimal and explainable deep learning models for inertial-based posture recognition
Martins, D. R., Cerqueira, S. M., & Santos, C. P. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112700 · Cited by 6
Armstrong, D. P., Beach, T. A. C., & Fischer, S. L. (2024) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208231223429 · Cited by 5
Neirz, P., Allende, H., & Saavedra, C. (2026) · Scientific Reports · doi:10.1038/s41598-026-52883-z · Cited by 5
Worker posture recognition for understanding agricultural worker behaviors
Morio, Y., Inoue, T., Tanaka, T., & Murakami, K. (2017) · Engineering in Agriculture Environment and Food · doi:10.1016/j.eaef.2017.03.002 · Cited by 5
Mekruksavanich, S., & Jitpattanakul, A. (2025) · Informatics · doi:10.3390/informatics12040115 · Cited by 4
Human Activity Recognition Using an Accelerometer Magnitude Value
Pilataxi, J. I., Trujillo-Guerrero, M. F., Benavides, V., & Acosta, J. A. R. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-42520-3_37 · Cited by 2
A Video-Based Activity Classification of Human Pickers in Agriculture
Pal, A., Leite, A. C., Gjevestad, J., & From, P. (2023) · arXiv.org · doi:10.48550/arxiv.2311.10885 · Cited by 1
Agricultural worker behavioral recognition system for intelligent worker assistance
Morio, Y., Tanaka, T., & Murakami, K. (2017) · Engineering in Agriculture, Environment and Food · doi:10.1016/j.eaef.2016.09.001
Research works printed but not linked: 2
- Sundararajan, M., Taly, A., and Yan, Q. (2017, January 6–11). Axiomatic Attribution for Deep Networks. Proceedings of the 34th International Conference on Machine Learning (ICML), PMLR 70, Sydney, Australia.
- Awad, 2022, Learning Architecture for the Recognition of Walking and Prediction of Gait Period Using Wearable Sensors, Neurocomputing, 470, 1
Metadata
- Authors
- Benos, L., Skordilis, E., Berruto, R., & Bochtis, D.
- Affiliations
- Centre for Research and Technology Hellas (GR)
- University of Miami (US)
- University of Turin (IT)
- Corresponding author
- Benos, Lefteris
- Venue
- Information
- Publisher
- MDPI AG
- Published
- 2026-09-07
- Volume
- 17
- Issue
- 9
- Pages
- 865
- ISSN
- 2078-2489 (ISSN-L)
- OpenAlex
- W7211917291
- Cited by
- 0
- References
- 52
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Information (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Life Sciences › Agricultural and Biological Sciences › Plant Science › Smart Agriculture and AI
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Keywords
- human activity recognition, wearable inertial sensors, human-robot collaboration, agricultural robotics, explainable AI, SHAP, LSTM, multimodal sensor fusion, robotic assistance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.