Distributed Proprioception of 3D Configuration in Soft, Sensorized Robots via Deep Learning
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Creating soft robots with sophisticated, autonomous capabilities requires these systems to possess reliable, on-line proprioception of 3D configuration through integrated soft sensors. We present a framework for predicting a soft robot's 3D configuration via deep learning using feedback from a soft, proprioceptive sensor skin. Our framework introduces a kirigami-enabled strategy for rapidly sensorizing soft robots using off-the-shelf materials, a general kinematic description for soft robot geometry, and an investigation of neural network designs for predicting soft robot configuration. Even with hysteretic, non-monotonic feedback from the piezoresistive sensors, recurrent neural networks show potential for predicting our new kinematic parameters and, thus, the robot's configuration. One trained neural network closely predicts steady-state configuration during operation, though complete dynamic behavior is not fully captured. We validate our methods on a trunk-like arm with 12 discrete actuators and 12 proprioceptive sensors. As an essential advance in soft robotic perception, we anticipate our framework will open new avenues towards closed loop control in soft robotics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 2×
“We do not report the structure of κ i and ι i for LSTM architectures (see [24] for details).”
BackgroundDesign, fabrication and control of soft robots
Rus, D., & Tolley, M. T. (2015) · Nature · doi:10.1038/nature14543 · Cited by 5,825 · cited 1×
“S OFT robotics represents an auspicious new paradigm for designing robots with improved adaptability, resilience, safety, and more by introducing compliance and deformability in robot bodies [1].”
MethodSelf-citationDesign and Kinematic Modeling of Constant Curvature Continuum Robots: A Review
Webster, R. J., & Jones, B. A. (2010) · The International Journal of Robotics Research · doi:10.1177/0278364910368147 · Cited by 2,297 · cited 1×
“They can be derived from the corresponding elements in the standard parametrization [20], by exploiting a transition map connecting the bending and curvature variables used there with theΔx,i,Δy,i introduced here.”
BackgroundHighly stretchable electroluminescent skin for optical signaling and tactile sensing
Larson, C., Peele, B., Li, S., Robinson, S., Totaro, M., Beccai, L., Mazzolai, B., & Shepherd, R. (2016) · Science · doi:10.1126/science.aac5082 · Cited by 1,393 · cited 1×
“Molded fluidic elastomer actuators (FEAs) popularly used in soft robotics can be sensorized with flexible curvature sensors [3], liquid metal sensors [6], soft piezoresistive composites [7], elastomeric waveguides [5], or ionically conductive gels [4], [8].”
BackgroundOptoelectronically innervated soft prosthetic hand via stretchable optical waveguides
Zhao, H., O’Brien, K., Li, S., & Shepherd, R. F. (2016) · Science Robotics · doi:10.1126/scirobotics.aai7529 · Cited by 982 · cited 1×
“Molded fluidic elastomer actuators (FEAs) popularly used in soft robotics can be sensorized with flexible curvature sensors [3], liquid metal sensors [6], soft piezoresistive composites [7], elastomeric waveguides [5], or ionically conductive gels [4], [8].”
BackgroundDeep Learning: A Critical Appraisal
Marcus, G. (2018) · arXiv · doi:10.48550/arxiv.1801.00631 · Cited by 853 · cited 1×
“Since these techniques ignore the causal relationship between data [23], we can directly regress an approximation of the inverse system instead of estimating f i and h i and inverting them: where ψ ∈ R n internal is the internal state of the inverse model, and ˜ q i ∈ R 3 the estimation of the…”
MethodPerspectives on system identification
Ljung, L. (2010) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2009.12.001 · Cited by 707 · cited 1×
“Instead, we turn to black box nonlinear system identification [22], specifically deep learning.”
BackgroundSoft robot perception using embedded soft sensors and recurrent neural networks
Thuruthel, T. G., Shih, B., Laschi, C., & Tolley, M. T. (2019) · Science Robotics · doi:10.1126/scirobotics.aav1488 · Cited by 678 · cited 4×
“In [6], a soft robotic hand can predict flexion, lateral, and twist deformations in its fingers, and in [17], a recurrent neural network (RNN) is used to learn the tip position and contact forces of a single soft actuator.”
BackgroundMethodInfluentialPerspectives on System Identification
Ljung, L. (2008) · IFAC Proceedings Volumes · doi:10.3182/20080706-5-kr-1001.01215 · Cited by 438
Model-Based Reinforcement Learning for Closed-Loop Dynamic Control of Soft Robotic Manipulators
Thuruthel, T. G., Falotico, E., Renda, F., & Laschi, C. (2019) · IEEE Transactions on Robotics · doi:10.1109/tro.2018.2878318 · Cited by 405 · cited 1×
“Regarding control, learning-based strategies represent an alternative approach that bypasses the challenges of model-based methods [12].”
Method
Cited by
Magnetic Soft Materials and Robots
Kim, Y., & Zhao, X. (2022) · Chemical Reviews · doi:10.1021/acs.chemrev.1c00481 · Cited by 873
Octopus-inspired sensorized soft arm for environmental interaction
Xie, Z., Yuan, F., Liu, J., Tian, L., Chen, B., Fu, Z., Mao, S., Jin, T., Wang, Y., He, X., et al. (2023) · Science Robotics · doi:10.1126/scirobotics.adh7852 · Cited by 299
Yasa, O., Toshimitsu, Y., Michelis, M. Y., Jones, L. S., Filippi, M., Buchner, T., & Katzschmann, R. K. (2023) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-062322-100607 · Cited by 290
Russo, M., Sadati, S. M. H., Dong, X., Mohammad, A., Walker, I. D., Bergeles, C., Xu, K., & Axinte, D. A. (2023) · Advanced Intelligent Systems · doi:10.1002/aisy.202200367 · Cited by 263
Review of machine learning methods in soft robotics
Kim, D., Kim, S.-H., Kim, T., Kang, B. B., Lee, M., Park, W., Ku, S., Kim, D., Kwon, J., Lee, H., et al. (2021) · PLOS ONE · doi:10.1371/journal.pone.0246102 · Cited by 256
Metadata
- Authors
- Truby, R. L., Santina, C. D., & Rus, D.
- Venue
- IEEE Robotics and Automation Letters
- Published
- 2020-04
- Volume
- 5
- Issue
- 2
- Pages
- 3299-3306
- ISSN
- 2377-3766 (ISSN-L)
- 2377-3774
- OpenAlex
- W3008109267
- Cited by
- 196
- References
- 23
- FWCI
- 7.67
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.