A Tensor‐based Regression Approach for Human Motion Prediction
Open accessAbstract
Collaborative robotic systems will be a key enabling technology for current and future industrial applications. The main aspect of such applications is to guarantee safety for humans. To detect hazardous situations, current commercially available robotic systems rely on direct physical contact to the co‐working person. To further advance this technology, there are multiple efforts to develop predictive capabilities for such systems. Using motion tracking sensors and pose estimation systems combined with adequate predictive models, potential episodes of hazardous collisions between humans and robots can be predicted. Based on the provided predictive information, the robotic system can avoid physical contact by adjusting speed or position. A potential approach for such systems is to perform human motion prediction with machine learning methods like artificial neural networks (NNs). In our approach, the motion patterns of past seconds are used to predict future ones by applying a linear Tensor‐on‐Tensor Regression model, selected according to a similarity measure between motion sequences obtained by dynamic time warping (DTW). For test and validation of our proposed approach, industrial pseudo assembly tasks were recorded with a motion capture system, providing unique traceable Cartesian coordinates for each human joint. The prediction of repetitive human motions associated with assembly tasks, whose data vary significantly in length and have highly correlated variables, has been achieved in real time.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
GAN synthesizes data via adversarial generation, alleviates data scarcity and enables domain adaptation, and is used for sEMG data augmentation and cross-device adaptation.
“| GAN | Synthesize data via adversarial generation | Alleviate data scarcity, enable domain | sEMG data augmentation, cross-device |”
From Recent advances in intelligent wearable systems: from multiscale biomechanical features towards human motion intent prediction (2026) · cites this paper as [267]
Cites
Tensor Decompositions and Applications
Kolda, T. G., & Bader, B. W. (2009) · SIAM Review · doi:10.1137/07070111x · Cited by 10,595 · see citing works
Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields
Cao, Z., Simon, T., Wei, S.-E., & Sheikh, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.143 · Cited by 7,539 · see citing works
Carroll, J. D., & Chang, J.-J. (1970) · Psychometrika · doi:10.1007/bf02310791 · Cited by 4,783 · see citing works
A Multilinear Singular Value Decomposition
Lathauwer, L. D., Moor, B. D., & Vandewalle, J. P. L. (2000) · SIAM Journal on Matrix Analysis and Applications · doi:10.1137/s0895479896305696 · Cited by 4,222 · see citing works
Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural Environments
Ionescu, C., Papava, D., Olaru, V., & Sminchisescu, C. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.248 · Cited by 3,653 · see citing works
Nonnegative Matrix and Tensor Factorizations
Cichocki, A. S., Zdunek, R., Phan, A. H., & Амари, Ш.-И. (2009) · Wiley eBooks · doi:10.1002/9780470747278 · Cited by 1,404 · see citing works
Lubin, A., & Harris, C. W. (1965) · The American Journal of Psychology · doi:10.2307/1420518 · Cited by 1,380 · see citing works
Villani, V., Pini, F., Leali, F., & Secchi, C. (2018) · Mechatronics · doi:10.1016/j.mechatronics.2018.02.009 · Cited by 1,278 · see citing works
Computing and Visualizing Dynamic Time Warping Alignments inR: ThedtwPackage
Toni Giorgino, A. (2009) · Journal of Statistical Software · doi:10.18637/jss.v031.i07 · Cited by 1,263 · see citing works
On Human Motion Prediction Using Recurrent Neural Networks
Martínez, J., Black, M. J., & Romero, J. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.497 · Cited by 1,019 · see citing works
Colyer, S., Evans, M., Cosker, D. P., & Salo, A. (2018) · Sports Medicine - Open · doi:10.1186/s40798-018-0139-y · Cited by 635 · see citing works
Tensor Regression with Applications in Neuroimaging Data Analysis
Zhou, H., Li, L., & Hongtu Zhu, B. (2013) · Journal of the American Statistical Association · doi:10.1080/01621459.2013.776499 · Cited by 546 · see citing works
The Trajectron: Probabilistic Multi-Agent Trajectory Modeling With Dynamic Spatiotemporal Graphs
Ivanovic, B., & Pavone, M. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00246 · Cited by 479 · see citing works
3D human pose from silhouettes by relevance vector regression
Agarwal, A., & Triggs, B. (2004) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2004.1315258 · Cited by 386 · see citing works
GHUM & GHUML: Generative 3D Human Shape and Articulated Pose Models
Xu, H., Băzăvan, E. G., Zanfir, A., Freeman, W. T., Sukthankar, R., & Sminchisescu, C. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00622 · Cited by 347 · see citing works
The statistics of natural hand movements
Ingram, J. N., Kording, K. P., Howard, I. S., & Wolpert, D. M. (2008) · Experimental Brain Research · doi:10.1007/s00221-008-1355-3 · Cited by 332 · see citing works
Accurate 3D pose estimation from a single depth image
Ye, M., Wang, X., Yang, R., Ren, L., & Pollefeys, M. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126310 · Cited by 233 · see citing works
Convolutional Neural Network for Trajectory Prediction
Nikhil, N., & Morris, B. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11015-4_16 · Cited by 206 · see citing works
A review of 3D human pose estimation algorithms for markerless motion capture
Desmarais, Y., Mottet, D., Slangen, P., & Montesinos, P. (2021) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2021.103275 · Cited by 203 · see citing works
Human motion prediction for human-robot collaboration
Liu, H., & Wang, L. (2017) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2017.04.009 · Cited by 193 · see citing works
Tucker Tensor Regression and Neuroimaging Analysis
Li, X., Xu, D., Zhou, H., & Li, L. (2018) · Statistics in Biosciences · doi:10.1007/s12561-018-9215-6 · Cited by 162 · see citing works
3D Tracking of Human Motion Using Visual Skeletonization and Stereoscopic Vision
Zago, M., Luzzago, M., Marangoni, T., Cecco, M. D., Tarabini, M., & Galli, M. (2020) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2020.00181 · Cited by 151 · see citing works
Higher Order Partial Least Squares (HOPLS): A Generalized Multilinear Regression Method
Zhao, Q., Caiafa, C. F., Mandic, D. P., Chao, Z. C., Nagasaka, Y., Fujii, N., Zhang, L., & Cichocki, A. S. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.254 · Cited by 148 · see citing works
Teaching Robots to Predict Human Motion
Gui, L.-Y., Zhang, K., Wang, Y.-X., Liang, X., Moura, J. M. F., & Veloso, M. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594452 · Cited by 136 · see citing works
Feature Boosting Network For 3D Pose Estimation
Liu, J., Ding, H., Shahroudy, A., Duan, L., Jiang, X., Wang, G., & Kot, A. C. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2894422 · Cited by 134 · see citing works
Weakly Supervised 3D Human Pose and Shape Reconstruction with Normalizing Flows
Zanfir, A., Băzăvan, E. G., Xu, H., Freeman, W. T., Sukthankar, R., & Sminchisescu, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58539-6_28 · Cited by 124 · see citing works
Tensor Spaces and Numerical Tensor Calculus
Hackbusch, W. (2019) · Springer series in computational mathematics · doi:10.1007/978-3-030-35554-8 · Cited by 117 · see citing works
Lock, E. F. (2017) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2017.1401544 · Cited by 114 · see citing works
Human movement and ergonomics: An industry-oriented dataset for collaborative robotics
Maurice, P., Malaisé, A., Amiot, C., Paris, N., Richard, G.-J., Rochel, O., & Ivaldi, S. (2019) · The International Journal of Robotics Research · doi:10.1177/0278364919882089 · Cited by 107 · see citing works
Trends of Human-Robot Collaboration in Industry Contexts: Handover, Learning, and Metrics
Castro, A., da Silva, F. M. T. P., & Santos, V. M. F. (2021) · Sensors · doi:10.3390/s21124113 · Cited by 106 · see citing works
Multi-level Motion Attention for Human Motion Prediction
Mao, W., Liu, M., Salzmann, M., & Li, H. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01483-7 · Cited by 90 · see citing works
Du, X., Vasudevan, R., & Johnson‐Roberson, M. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2895266 · Cited by 80 · see citing works
Gahrooei, M. R., Yan, H., Paynabar, K., & Shi, J. (2019) · Technometrics · doi:10.1080/00401706.2019.1708463 · Cited by 70 · see citing works
Tensor neural network models for tensor singular value decompositions
Wang, X., Che, M., & Wei, Y. (2020) · Computational Optimization and Applications · doi:10.1007/s10589-020-00167-1 · Cited by 63 · see citing works
Bayesian Tensor RegressionPreprint
Guhaniyogi, R., Qamar, S., & Dunson, D. B. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.06490 · Cited by 58 · see citing works
Monitoring worker fatigue using wearable devices: A case study to detect changes in gait parameters
Baghdadi, A., Cavuoto, L., Jones-Farmer, A., Rigdon, S., Esfahani, E., & Megahed, F. (2019) · Journal of QualityTechnology · doi:10.1080/00224065.2019.1640097 · Cited by 57 · see citing works
Wu, Q., Jiang, Z., Hong, K., Liu, H., Yang, L. T., & Ding, J. (2021) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2021.3056912 · Cited by 55 · see citing works
Contour people: A parameterized model of 2D articulated human shape
Freifeld, O., Weiss, A., Zuffi, S., & Black, M. J. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540154 · Cited by 53 · see citing works
Human Motion prediction based on attention mechanism
Sang, H.-F., Chen, Z.-Z., & He, D.-K. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-019-08269-7 · Cited by 42 · see citing works
Multiview 3D Markerless Human Pose Estimation from OpenPose Skeletons
Slembrouck, M., Luong, H. Q., Gerlo, J., Schütte, K., Cauwelaert, D. V., Clercq, D. D., Vanwanseele, B., Veelaert, P., & Philips, W. R. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-40605-9_15 · Cited by 42 · see citing works
Automated Monitoring of Physical Fatigue Using Jerk
Zhang, L., Diraneyya, M. M., Ryu, J., Haas, C. T., & Abdel-Rahman, E. M. (2019) · International Symposium on Automation and Robotics in Construction (ISARC) · doi:10.22260/isarc2019/0132 · Cited by 31 · see citing works
Gahrooei, M. R., Paynabar, K., Pacella, M., & Shi, J. (2019) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2019.2941167 · Cited by 20 · see citing works
Supervised multiway factorization
Lock, E. F., & Li, G. (2018) · Electronic Journal of Statistics · doi:10.1214/18-ejs1421 · Cited by 20 · see citing works
Marker-Based Human Motion Capture in Multiview Sequences
Canton-Ferrer, C., Casas, J. R., & Pardàs, M. (2010) · EURASIP Journal on Advances in Signal Processing · doi:10.1155/2010/105476 · Cited by 19 · see citing works
3D contour following for a cylindrical end-effector using capacitive proximity sensors
Navarro, S. E., Koch, S., & Hein, B. (2016) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759038 · Cited by 19 · see citing works
Reduced-Rank Tensor-on-Tensor Regression and Tensor-Variate Analysis of Variance
Llosa, C., & Maitra, R. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3164836 · Cited by 18 · see citing works
Human Gait Analysis and Prediction Using the Levenberg-Marquardt Method
Alharbi, A., Equbal, K., Ahmad, S., Rahman, H. U., & Alyami, H. (2021) · Journal of Healthcare Engineering · doi:10.1155/2021/5541255 · Cited by 18 · see citing works
Miseikis, J., Knobelreiter, P., Brijacak, I., Yahyanejad, S., Glette, K., Elle, O. J., & Torresen, J. (2018) · IEEE/ASME International Conference on Advanced Intelligent Mechatronics · doi:10.1109/aim.2018.8452236 · Cited by 17 · see citing works
Contactless Control of a Kinematically Redundant Serial Manipulator Using Tomographic Sensors
Mühlbacher-Karrer, S., Brandstötter, M., Schett, D., & Zangl, H. (2016) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2016.2632973 · Cited by 13 · see citing works
Robust labeling of human motion markers in the presence of occlusions
Bascones, J. L. J., Graña, M., & López-Guede, J. M. (2019) · Neurocomputing · doi:10.1016/j.neucom.2018.05.132 · Cited by 13 · see citing works
Mišeikis, J., Brijačak, I., Yahyanejad, S., Glette, K., Elle, O. J., & Tørresen, J. (2018) · IEEE International Conference on Intelligence and Safety for Robotics (ISR) · doi:10.1109/iisr.2018.8535937 · Cited by 12 · see citing works
Hou, M., & Chaib-draa, B. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472870 · Cited by 9 · see citing works
Chen, Z., Wang, Y., Lin, D., Cheng, D. Z., Hong, L., Ed, H., & Cui, C. M. (2021) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3437963.3441770 · Cited by 9 · see citing works
Functional Data Analysis of Rowing Technique Using Motion Capture Data
Becker, A., Herrebrøden, H., Gonzalez-Sanchez, V. E., Nymoen, K., Freitas, C. M. D. S., Tørresen, J., & Jensenius, A. R. (2019) · International Conference on Movement and Computing (MOCO) · doi:10.1145/3347122.3347135 · Cited by 6 · see citing works
Siirtola, P., Koskimäki, H., & Röning, J. (2018) · International Conference on Pattern Recognition Applications and Methods · doi:10.5220/0006553302910299 · Cited by 5 · see citing works
Flagged first, then by citations
1 of the 56 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Transforming Robots into Cobots: A Sustainable Approach to Industrial Automation
Fernandez-Vega, M., Alfaro-Viquez, D., Zamora-Hernández, M.-A., García‐Rodríguez, J., & Azorín-López, J. (2025) · Electronics · doi:10.3390/electronics14112275 · Cited by 17 · see citing works
Chen, S., Peng, C., Yang, B., Lin, J., Zhou, L., Jiang, Z., Liu, Z., Liu, Y., & Tang, L. (2026) · npj Artificial Intelligence · doi:10.1038/s44387-026-00083-5 · Cited by 9 · see citing works
Ivanov, Y. S., Жиганов, С. В., Gorkavyy, M. A., Sukhorukov, S. I., & Grabar, D. M. (2023) · International Symposium on Intelligent Systems (INTELS) · doi:10.3390/engproc2023033019 · Cited by 6 · see citing works
Incremental Human Gait Prediction without Catastrophic Forgetting
Jakob, J., Hasenjäger, M., & Hammer, B. (2023) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci52147.2023.10371942 · Cited by 1 · see citing works
Liao, H., Chen, Y., Hu, B., Liang, X. P., & Behdad, S. (2025) · Journal of Computing and Information Science in Engineering · doi:10.1115/1.4067987 · Cited by 1 · see citing works
The ENBIS‐21 quality and reliability engineering international special issue
Bischoff, J., & Lepore, A. (2023) · Quality and Reliability Engineering International · doi:10.1002/qre.3266
Uddin, M. S. (2025) · Discover Robotics · doi:10.1007/s44430-025-00014-0
- Authors
- Gril, L., Wedenig, P., Torkar, C., & Kleb, U.
- Affiliations
- Joanneum Research (AT)
- Corresponding author
- Gril, Lorena
- Venue
- Quality and Reliability Engineering International
- Publisher
- Wiley
- Published
- 2022-06-21
- Volume
- 39
- Issue
- 2
- Pages
- 481-499
- ISSN
- 0748-8017 (ISSN-L)
- 1099-1638
- OpenAlex
- W4283203971
- Cited by
- 7
- References
- 56
- Citations by year
- 2026: 1 · 2025: 3 · 2023: 3
- FWCI
- 0.60
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Quality and Reliability Engineering International (publishedVersion, cc-by-nc-nd)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Bundesministerium für Klimaschutz, Umwelt, Energie, Mobilität, Innovation und Technologie
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Human Motion and Animation
- Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Keywords
- human motion prediction, collaborative robots, dynamic time warping, motion capture, real-time prediction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review