Performance Evaluation of Lower Limb Exoskeletons: A Systematic Review
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Benchmarks have long been used to verify and compare the readiness level of different technologies in many application domains. In the field of wearable robots, the lack of a recognized benchmarking methodology is one important impediment that may hamper the efficient translation of research prototypes into actual products. At the same time, an exponentially growing number of research studies are addressing the problem of quantifying the performance of robotic exoskeletons, resulting in a rich and highly heterogeneous picture of methods, variables and protocols. This review aims to organize this information, and identify the most promising performance indicators that can be converted into practical benchmarks. We focus our analysis on lower limb functions, including a wide spectrum of motor skills and performance indicators. We found that, in general, the evaluation of lower limb exoskeletons is still largely focused on straight walking, with poor coverage of most of the basic motor skills that make up the activities of daily life. Our analysis also reveals a clear bias towards generic kinematics and kinetic indicators, in spite of the metrics of human-robot interaction. Based on these results, we identify and discuss a number of promising research directions that may help the community to attain a comprehensive benchmarking methodology for robot-assisted locomotion more efficiently.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Esquenazi, A., Talaty, M., Packel, A., & Saulino, M. (2012) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/phm.0b013e318269d9a3 · Cited by 958 · cited 1×
“the third most covered motor skill in this review, with 22 publications, [8], [21]–[23], [32], [35], [42], [44], [51], [58], [59],”
BackgroundA soft robotic exosuit improves walking in patients after stroke
Awad, L. N., Bae, J., O’Donnell, K., De Rossi, S. M. M., Hendron, K., Sloot, L. H., Kudzia, P., Allen, S., Holt, K. G., Ellis, T. D., et al. (2017) · Science Translational Medicine · doi:10.1126/scitranslmed.aai9084 · Cited by 672
Zeilig, G., Weingarden, H., Zwecker, M., Dudkiewicz, I., Bloch, A., & Esquenazi, A. (2012) · The Journal of Spinal Cord Medicine · doi:10.1179/2045772312y.0000000003 · Cited by 537
A biologically inspired soft exosuit for walking assistance
Asbeck, A. T., De Rossi, S. M. M., Holt, K. G., & Walsh, C. J. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364914562476 · Cited by 450 · cited 1×
“12) Weight Bearing: Weight bearing is the fourth most covered motor skill, with 19 publications, [9], [20], [34], [51], [53], [73], [128], [130], [146], [149], [153], [160], [164], [172], [179]–[184].”
Farris, R. J., Quintero, H. A., Murray, S. A., Ha, K. H., Hartigan, C., & Goldfarb, M. (2014) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2013.2268320 · Cited by 208 · cited 1×
“the third most covered motor skill in this review, with 22 publications, [8], [21]–[23], [32], [35], [42], [44], [51], [58], [59],”
BackgroundDesign of an under-actuated exoskeleton system for walking assist while load carrying
Yu, S. N., Lee, H. D., Lee, S. H., Kim, W. S., Han, J. S., & Han, C. S. (2012) · Advanced Robotics · doi:10.1163/156855311x617506 · Cited by 37 · cited 2×
“12) Weight Bearing: Weight bearing is the fourth most covered motor skill, with 19 publications, [9], [20], [34], [51], [53], [73], [128], [130], [146], [149], [153], [160], [164], [172], [179]–[184].”
BackgroundThe Apollo number: space suits, self-support, and the walk-run transition
Carr, C. E., & McGee, J. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006614 · Cited by 26 · cited 1×
“20) Running: We found four publications [104], [191]–[193] that assessed running while wearing an exoskeleton.”
Background
Cited by
Systematic review on wearable lower-limb exoskeletons for gait training in neuromuscular impairments
Rodríguez-Fernández, A., Lobo-Prat, J., & Font-Llagunes, J. M. (2021) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-021-00815-5 · Cited by 435
Review of control strategies for lower-limb exoskeletons to assist gait
Baud, R., Manzoori, A. R., Ijspeert, A., & Bouri, M. (2021) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-021-00906-3 · Cited by 381
Opportunities and challenges in the development of exoskeletons for locomotor assistance
Siviy, C., Baker, L. M., Quinlivan, B. T., Porciuncula, F., Swaminathan, K., Awad, L. N., & Walsh, C. J. (2022) · Nature Biomedical Engineering · doi:10.1038/s41551-022-00984-1 · Cited by 258
An Analysis of Usability Evaluation Practices and Contexts of Use in Wearable Robotics
Meyer, J. T., Gassert, R., & Lambercy, O. (2021) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-021-00963-8 · Cited by 58
“…of device-oriented development and evaluation has been previously highlighted by works of Contreras-Vidal et al. and Pinto-Fernandez et al. [22, 40] who both summarized that in lower limb exoskeletons studies, evaluation outcomes on comfort, ergonomics, satisfaction, and/or mental demand…”
BackgroundKapsalyamov, A., Hussain, S., Brown, N. A. T., Goecke, R., Hayat, M., & Jamwal, P. K. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105500 · Cited by 45
Metadata
- Authors
- Pinto-Fernandez, D., Torricelli, D., Sanchez-Villamanan, M. D. C., Aller, F., Mombaur, K., Conti, R., Vitiello, N., Moreno, J. C., & Pons, J. L.
- Venue
- IEEE Transactions on Neural Systems and Rehabilitation Engineering
- Published
- 2020-07
- Volume
- 28
- Issue
- 7
- Pages
- 1573-1583
- ISSN
- 1534-4320 (ISSN-L)
- 1558-0210
- OpenAlex
- W3032317253
- Cited by
- 220
- References
- 7
- FWCI
- 2.91
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Performance Evaluation of Lower Limb Exoskeletons: A Systematic Review. https://app.cochat.ai/papers/10.1109/tnsre.2020.2989481
- The paper
- Pinto-Fernandez, D., Torricelli, D., Sanchez-Villamanan, M. D. C., Aller, F., Mombaur, K., Conti, R., Vitiello, N., Moreno, J. C., & Pons, J. L. (2020). Performance Evaluation of Lower Limb Exoskeletons: A Systematic Review. IEEE Transactions on Neural Systems and Rehabilitation Engineering. https://doi.org/10.1109/tnsre.2020.2989481
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.