The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Model-Based Reinforcement Learning for Closed-Loop Dynamic Control of Soft Robotic Manipulators
Open accessAbstract
Dynamic control of soft robotic manipulators is an open problem yet to be well explored and analyzed. Most of the current applications of soft robotic manipulators utilize static or quasi-dynamic controllers based on kinematic models or linearity in the joint space. However, such approaches are not truly exploiting the rich dynamics of a soft-bodied system. In this paper, we present a model-based policy learning algorithm for closed-loop predictive control of a soft robotic manipulator. The forward dynamic model is represented using a recurrent neural network. The closed-loop policy is derived using trajectory optimization and supervised learning. The approach is verified first on a simulated piecewise constant strain model of a cable driven under-actuated soft manipulator. Furthermore, we experimentally demonstrate on a soft pneumatically actuated manipulator how closed-loop control policies can be derived that can accommodate variable frequency control and unmodeled external loads.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Soft robotics: Technologies and systems pushing the boundaries of robot abilities
Laschi, C., Mazzolai, B., & Cianchetti, M. (2016) · Science Robotics · doi:10.1126/scirobotics.aah3690 · Cited by 1,570 · cited 1×
“models of these high-dimensional manipulators [1], [2].”
Self-citationLevine, S., & Koltun, V. (2013) · International Conference on Machine Learning · Cited by 906
Reinforcement learning of motor skills with policy gradients
Peters, J., & Schaal, S. (2008) · Neural Networks · doi:10.1016/j.neunet.2008.02.003 · Cited by 831
Control Strategies for Soft Robotic Manipulators: A Survey
George Thuruthel, T., Ansari, Y., Falotico, E., & Laschi, C. (2018) · Soft Robotics · doi:10.1089/soro.2017.0007 · Cited by 645
Self-citationStiffening in Soft Robotics: A Review of the State of the Art
Manti, M., Cacucciolo, V., & Cianchetti, M. (2016) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2016.2582718 · Cited by 637
Dynamic Model of a Multibending Soft Robot Arm Driven by Cables
Renda, F., Giorelli, M., Calisti, M., Cianchetti, M., & Laschi, C. (2014) · IEEE Transactions on Robotics · doi:10.1109/tro.2014.2325992 · Cited by 482
Self-citationLearning deep control policies for autonomous aerial vehicles with MPC-guided policy search
Zhang, T., Kahn, G., Levine, S., & Abbeel, P. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487175 · Cited by 452 · cited 1×
“The state-of-the-art approaches using variations of this idea are concerned with using learned local models [20], compound multistep controllers [21], and deep representation of the control policies [22].”
MethodLong-term time series prediction with the NARX network: An empirical evaluation
Menezes, J. M. P., & Barreto, G. A. (2008) · Neurocomputing · doi:10.1016/j.neucom.2008.01.030 · Cited by 446
A Study of Vicon System Positioning Performance
Merriaux, P., Dupuis, Y., Boutteau, R., Vasseur, P., & Savatier, X. (2017) · Sensors · doi:10.3390/s17071591 · Cited by 435
Learning Neural Network Policies with Guided Policy Search under Unknown Dynamics
Levine, S., & Abbeel, P. (2014) · Cited by 389
Discrete Cosserat Approach for Multisection Soft Manipulator Dynamics
Renda, F., Boyer, F., Dias, J., & Seneviratne, L. (2018) · IEEE Transactions on Robotics · doi:10.1109/tro.2018.2868815 · Cited by 335
Self-citationDesign, kinematics, and control of a soft spatial fluidic elastomer manipulator
Marchese, A. D., & Rus, D. (2016) · The International Journal of Robotics Research · doi:10.1177/0278364915587925 · Cited by 330
Robotic manipulators and the product of exponentials formula
Brockett, R. W. (2005) · Lecture Notes in Control and Information Sciences · doi:10.1007/bfb0031048 · Cited by 314
A comparison of direct and model-based reinforcement learning
Atkeson, C. G., & Santamaria, J. C. (2002) · Proceedings of International Conference on Robotics and Automation · doi:10.1109/robot.1997.606886 · Cited by 239
Dynamic control of soft robots interacting with the environment
Della Santina, C., Katzschmann, R. K., Biechi, A., & Rus, D. (2018) · 2018 IEEE International Conference on Soft Robotics (RoboSoft) · doi:10.1109/robosoft.2018.8404895 · Cited by 230
Learning to Control a Low-Cost Manipulator using Data-Efficient Reinforcement Learning
Deisenroth, M., Rasmussen, C., & Fox, D. (2011) · Robotics: Science and Systems VII · doi:10.15607/rss.2011.vii.008 · Cited by 205
Optimal control with learned local models: Application to dexterous manipulation
Kumar, V., Todorov, E., & Levine, S. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487156 · Cited by 202
Dynamics and trajectory optimization for a soft spatial fluidic elastomer manipulator
Marchese, A. D., Tedrake, R., & Rus, D. (2016) · The International Journal of Robotics Research · doi:10.1177/0278364915587926 · Cited by 198
Learning Closed Loop Kinematic Controllers for Continuum Manipulators in Unstructured Environments
Thuruthel, T. G., Falotico, E., Manti, M., Pratesi, A., Cianchetti, M., & Laschi, C. (2017) · Soft Robotics · doi:10.1089/soro.2016.0051 · Cited by 154
Self-citationControlling Soft Robots: Balancing Feedback and Feedforward Elements
Santina, C. D., Bianchi, M., Grioli, G., Angelini, F., Catalano, M. G., Garabini, M., & Bicchi, A. (2017) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2016.2636360 · Cited by 150
Best, C. M., Gillespie, M. T., Hyatt, P., Rupert, L., Sherrod, V., & Killpack, M. D. (2016) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2016.2580591 · Cited by 149
Dynamic Control of the Bionic Handling Assistant
Falkenhahn, V., Hildebrandt, A., Neumann, R., & Sawodny, O. (2016) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2016.2605820 · Cited by 149
Learning dynamic models for open loop predictive control of soft robotic manipulators
Thuruthel, T. G., Falotico, E., Renda, F., et al. (2017) · Bioinspiration & Biomimetics · doi:10.1088/1748-3190/aa839f · Cited by 149
Self-citationCombining the benefits of function approximation and trajectory optimization
Mordatch, I., & Todorov, E. (2014) · Robotics: Science and Systems · doi:10.15607/rss.2014.x.052 · Cited by 143
Ansari, Y. T., Manti, M., Falotico, E., Mollard, Y., Cianchetti, M., & Laschi, C. (2017) · International Journal of Advanced Robotic Systems · doi:10.1177/1729881416687132 · Cited by 121
Self-citationStable Open Loop Control of Soft Robotic Manipulators
Thuruthel, T. G., Falotico, E., Manti, M., & Laschi, C. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2797241 · Cited by 103
Self-citationSoft assistive robot for personal care of elderly people
Manti, M., Pratesi, A., Falotico, E., Cianchetti, M., & Laschi, C. (2016) · IEEE International Conference on Biomedical Robotics and Biomechatronics · doi:10.1109/biorob.2016.7523731 · Cited by 96
Self-citationScrew-Based Modeling of Soft Manipulators With Tendon and Fluidic Actuation
Renda, F., Cianchetti, M., Abidi, H., Dias, J. M. M., & Seneviratne, L. D. (2017) · Journal of Mechanisms and Robotics · doi:10.1115/1.4036579 · Cited by 45
Self-citationLearning compound multi-step controllers under unknown dynamics
Han, W., Levine, S., & Abbeel, P. (2015) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7354297 · Cited by 31
Cited by
Xavier, M. S., Tawk, C. D., Zolfagharian, A., Pinskier, J., Howard, D., Young, T., Lai, J., Harrison, S. M., Yong, Y. K., Bodaghi, M., et al. (2022) · IEEE Access · doi:10.1109/access.2022.3179589 · Cited by 418
Soft Robots Modeling: A Structured Overview
Armanini, C., Boyer, F., Mathew, A. T., Duriez, C., & Renda, F. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3231360 · Cited by 336
Self-citationData-Driven Control of Soft Robots Using Koopman Operator Theory
Bruder, D., Fu, X., Gillespie, R. B., Remy, C. D., & Vasudevan, R. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2020.3038693 · Cited by 309
Yasa, O., Toshimitsu, Y., Michelis, M. Y., Jones, L. S., Filippi, M., Buchner, T., & Katzschmann, R. K. (2023) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-062322-100607 · Cited by 290
Review of machine learning methods in soft robotics
Kim, D., Kim, S.-H., Kim, T., Kang, B. B., Lee, M., Park, W., Ku, S., Kim, D., Kwon, J., Lee, H., et al. (2021) · PLOS ONE · doi:10.1371/journal.pone.0246102 · Cited by 256
Metadata
- Authors
- Thuruthel, T. G., Falotico, E., Renda, F., & Laschi, C.
- Venue
- IEEE Transactions on Robotics
- Published
- 2019-02
- Volume
- 35
- Issue
- 1
- Pages
- 124-134
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2901112449
- Cited by
- 405
- References
- 29
- FWCI
- 8.40
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.