The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Model-Based Reinforcement Learning for Closed-Loop Dynamic Control of Soft Robotic Manipulators
Open accessAbstract
Dynamic control of soft robotic manipulators is an open problem yet to be well explored and analyzed. Most of the current applications of soft robotic manipulators utilize static or quasi-dynamic controllers based on kinematic models or linearity in the joint space. However, such approaches are not truly exploiting the rich dynamics of a soft-bodied system. In this paper, we present a model-based policy learning algorithm for closed-loop predictive control of a soft robotic manipulator. The forward dynamic model is represented using a recurrent neural network. The closed-loop policy is derived using trajectory optimization and supervised learning. The approach is verified first on a simulated piecewise constant strain model of a cable driven under-actuated soft manipulator. Furthermore, we experimentally demonstrate on a soft pneumatically actuated manipulator how closed-loop control policies can be derived that can accommodate variable frequency control and unmodeled external loads.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Soft robotics: Technologies and systems pushing the boundaries of robot abilities
Laschi, C., Mazzolai, B., & Cianchetti, M. (2016) · Science Robotics · doi:10.1126/scirobotics.aah3690 · Cited by 1,570 · cited 1×
“models of these high-dimensional manipulators [1], [2].”
Self-citationReinforcement learning of motor skills with policy gradients
Peters, J., & Schaal, S. (2008) · Neural Networks · doi:10.1016/j.neunet.2008.02.003 · Cited by 831
Control Strategies for Soft Robotic Manipulators: A Survey
George Thuruthel, T., Ansari, Y., Falotico, E., & Laschi, C. (2018) · Soft Robotics · doi:10.1089/soro.2017.0007 · Cited by 645
Self-citationStiffening in Soft Robotics: A Review of the State of the Art
Manti, M., Cacucciolo, V., & Cianchetti, M. (2016) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2016.2582718 · Cited by 637
Levine, S., & Koltun, V. (2013) · Cited by 586
Dynamic Model of a Multibending Soft Robot Arm Driven by Cables
Renda, F., Giorelli, M., Calisti, M., Cianchetti, M., & Laschi, C. (2014) · IEEE Transactions on Robotics · doi:10.1109/tro.2014.2325992 · Cited by 482
Self-citationLearning deep control policies for autonomous aerial vehicles with MPC-guided policy search
Zhang, T., Kahn, G., Levine, S., & Abbeel, P. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487175 · Cited by 452 · cited 1×
“The state-of-the-art approaches using variations of this idea are concerned with using learned local models [20], compound multistep controllers [21], and deep representation of the control policies [22].”
MethodLong-term time series prediction with the NARX network: An empirical evaluation
Menezes, J. M. P., & Barreto, G. A. (2008) · Neurocomputing · doi:10.1016/j.neucom.2008.01.030 · Cited by 446
A Study of Vicon System Positioning Performance
Merriaux, P., Dupuis, Y., Boutteau, R., Vasseur, P., & Savatier, X. (2017) · Sensors · doi:10.3390/s17071591 · Cited by 435
Learning Neural Network Policies with Guided Policy Search under Unknown Dynamics
Levine, S., & Abbeel, P. (2014) · Cited by 389
Cited by
Soft Robots Modeling: A Structured Overview
Armanini, C., Boyer, F., Mathew, A. T., Duriez, C., & Renda, F. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3231360 · Cited by 336
Self-citationData-Driven Control of Soft Robots Using Koopman Operator Theory
Bruder, D., Fu, X., Gillespie, R. B., Remy, C. D., & Vasudevan, R. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2020.3038693 · Cited by 309
Review of machine learning methods in soft robotics
Kim, D., Kim, S.-H., Kim, T., Kang, B. B., Lee, M., Park, W., Ku, S., Kim, D., Kwon, J., Lee, H., et al. (2021) · PLOS ONE · doi:10.1371/journal.pone.0246102 · Cited by 256
Soft Robot Control With a Learned Differentiable Model
Bern, J. M., Schnider, Y., Banzet, P., Kumar, N., & Coros, S. (2020) · 2020 3rd IEEE International Conference on Soft Robotics (RoboSoft) · doi:10.1109/robosoft48309.2020.9116011 · Cited by 103
Metadata
- Authors
- Thuruthel, T. G., Falotico, E., Renda, F., & Laschi, C.
- Venue
- IEEE Transactions on Robotics
- Published
- 2019-02
- Volume
- 35
- Issue
- 1
- Pages
- 124-134
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2901112449
- Cited by
- 405
- References
- 29
- FWCI
- 8.40
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Model-Based Reinforcement Learning for Closed-Loop Dynamic Control of Soft Robotic Manipulators. https://app.cochat.ai/papers/10.1109/tro.2018.2878318
- The paper
- Thuruthel, T. G., Falotico, E., Renda, F., & Laschi, C. (2019). Model-Based Reinforcement Learning for Closed-Loop Dynamic Control of Soft Robotic Manipulators. IEEE Transactions on Robotics. https://doi.org/10.1109/tro.2018.2878318
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.