The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Reinforcement Learning Control of a Flexible Two-Link Manipulator: An Experimental Investigation
Open accessAbstract
This article discusses the control design and experiment validation of a flexible two-link manipulator (FTLM) system represented by ordinary differential equations (ODEs). A reinforcement learning (RL) control strategy is developed that is based on actor–critic structure to enable vibration suppression while retaining trajectory tracking. Subsequently, the closed-loop system with the proposed RL control algorithm is proved to be semi-global uniform ultimate bounded (SGUUB) by Lyapunov’s direct method. In the simulations, the control approach presented has been tested on the discretized ODE dynamic model and the analytical claims have been justified under the existence of uncertainty. Eventually, a series of experiments in a Quanser laboratory platform are investigated to demonstrate the effectiveness of the presented control and its application effect is compared with PD control.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neuronlike adaptive elements that can solve difficult learning control problems
Barto, A. G., Sutton, R. S., & Anderson, C. W. (1983) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1983.6313077 · Cited by 3,233
Konda, V. R., & Tsitsiklis, J. N. (2002) · Cited by 2,202
Online actor–critic algorithm to solve the continuous-time infinite horizon optimal control problem
Vamvoudakis, K. G., & Lewis, F. L. (2010) · Automatica · doi:10.1016/j.automatica.2010.02.018 · Cited by 1,703
Reinforcement Learning and Dynamic Programming Using Function Approximators
Busoniu, L., Babuska, R., De Schutter, B., & Ernst, D. (2017) · CRC Press eBooks · doi:10.1201/9781439821091 · Cited by 919
Konda, V. R., & Tsitsiklis, J. N. (2003) · SIAM Journal on Control and Optimization · doi:10.1137/s0363012901385691 · Cited by 709
Adaptive Fuzzy Neural Network Control for a Constrained Robot Using Impedance Learning
He, W., & Dong, Y. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2665581 · Cited by 642
Self-citationEvent-Triggered Adaptive Tracking Control for Multiagent Systems With Unknown Disturbances
Zhang, Y., Sun, J. Q., Liang, H., & Li, H. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2869084 · Cited by 380
Adaptive Fuzzy Backstepping Tracking Control for Strict-Feedback Systems With Input Delay
Li, H., Wang, L., Du, H., & Boulkroune, A. (2017) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2016.2567457 · Cited by 347
Vibration Control of a Flexible Beam With Output Constraint
He, W., & Ge, S. S. (2015) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2015.2400427 · Cited by 327
Self-citationPlatoon Formation Control With Prescribed Performance Guarantees for USVs
Dai, S.-L., He, S., Lin, H., & Wang, C. (2018) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2017.2758743 · Cited by 327
Neural Network Control of a Flexible Robotic Manipulator Using the Lumped Spring-Mass Model
Sun, C., He, W., & Hong, J. (2017) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2016.2562506 · Cited by 321
Self-citationNeural Learning Control of Marine Surface Vessels With Guaranteed Transient Tracking Performance
Dai, S.-L., Wang, M., & Wang, C. (2016) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2015.2504553 · Cited by 314
Physical Human–Robot Interaction of a Robotic Exoskeleton By Admittance Control
Li, Z., Huang, B., Ye, Z., Deng, M., & Yang, C. (2018) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2018.2821649 · Cited by 306
Self-citationAdaptive Neural Control of Uncertain Nonlinear Systems Using Disturbance Observer
Chen, M., Shao, S.-Y., & Jiang, B. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2667680 · Cited by 292
Reinforcement Learning Output Feedback NN Control Using Deterministic Learning Technique
Xu, B., Yang, C., & Shi, Z. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2292704 · Cited by 257
Self-citationExperience Replay for Real-Time Reinforcement Learning Control
Adam, S., Busoniu, L., & Babuska, R. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2106494 · Cited by 255
Liu, D., Xu, Y., Wei, Q., & Liu, X. (2018) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2017.7510739 · Cited by 235
Reinforcement learning and optimal adaptive control: An overview and implementation examples
Khan, S. G., Herrmann, G., Lewis, F. L., Pipe, T., & Melhuish, C. (2012) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2012.03.004 · Cited by 234
Model-Free Robust Adaptive Control of Humanoid Robots With Flexible Joints
Jin, M., Lee, J., & Tsagarakis, N. G. (2017) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2016.2588461 · Cited by 219
Boundary Adaptive Robust Control of a Flexible Riser System With Input Nonlinearities
Zhao, Z., He, X., Ren, Z., & Wen, G. (2019) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2018.2882734 · Cited by 214
Wu, Y., Jiang, B., & Wang, Y. (2020) · ISA Transactions · doi:10.1016/j.isatra.2019.09.020 · Cited by 204
Wu, Y., Jiang, B., & Lu, N. (2019) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2017.2757264 · Cited by 198
Motion trajectory prediction based on a CNN-LSTM sequential model
Xie, G., Shangguan, A., Fei, R., Ji, W., Ma, W., & Hei, X. (2020) · Science China Information Sciences · doi:10.1007/s11432-019-2761-y · Cited by 194
Asymmetric Bimanual Control of Dual-Arm Exoskeletons for Human-Cooperative Manipulations
Li, Z., Huang, B., Ajoudani, A., Yang, C., Su, C.-Y., & Bicchi, A. (2018) · IEEE Transactions on Robotics · doi:10.1109/tro.2017.2765334 · Cited by 193
Self-citationLi, R., & Qiao, H. (2019) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2019.2945135 · Cited by 185
Integrated Direct/Indirect Adaptive Robust Control of Hydraulic Manipulators With Valve Deadband
Mohanty, A., & Yao, B. (2011) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2010.2051037 · Cited by 184
Modeling and Optimal Control of Human-Like Running
Schultz, G., & Mombaur, K. (2010) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2009.2035112 · Cited by 172
Neural Networks-Based Fault Tolerant Control of a Robot via Fast Terminal Sliding Mode
Zhang, S., Yang, P., Kong, L., Chen, W., Fu, Q., & Peng, K. (2019) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2019.2933050 · Cited by 151
Three-Dimensional Dynamics for Cable-Driven Soft Manipulator
Wang, H., Wang, C., Chen, W., Liang, X., & Liu, Y. (2016) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2016.2606547 · Cited by 148
Image-Based Visual Servoing of Helical Microswimmers for Planar Path Following
Xu, T., Guan, Y., Liu, J., & Wu, X. (2019) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2019.2911985 · Cited by 145
Model-Based Reinforcement Learning for Infinite-Horizon Approximate Optimal Tracking
Kamalapurkar, R., Andrews, L., Walters, P., & Dixon, W. E. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2511658 · Cited by 144
Niu, B., Li, H., Zhang, Z., Li, J., Hayat, T., & Alsaadi, F. E. (2018) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2018.2866519 · Cited by 134
Coordination of Multiple Robotic Fish With Applications to Underwater Robot Competition
Yu, J., Wang, C., & Xie, G. (2015) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2015.2425359 · Cited by 120
3-D Path Following of Helical Microswimmers With an Adaptive Orientation Compensation Model
Wu, X., Liu, J., Huang, C., Su, M., & Xu, T. (2019) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2019.2947071 · Cited by 114
Adaptive Suboptimal Output-Feedback Control for Linear Systems Using Integral Reinforcement Learning
Zhu, L. M., Modares, H., Gan, O. P., Lewis, F. L., & Yue, B. (2014) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2014.2322778 · Cited by 108
Dynamic Morphology and Swimming Properties of Rotating Miniature Swimmers With Soft Tails
Xu, T., Yu, J., Vong, C.-I., Wang, B., Wu, X., & Zhang, L. (2019) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2019.2912404 · Cited by 108
Kimura, H., & Kobayashi, S. (1998) · Tokyo Tech Research Repository (Tokyo Institute of Technology) · Cited by 107
A 3D Finite Element Method for Flexible Multibody Systems
Gerstmayr, J., & Schöberl, J. (2006) · Multibody System Dynamics · doi:10.1007/s11044-006-9009-3 · Cited by 89
Bio-inspired robotic impedance adaptation for human-robot collaborative tasks
Zeng, C., Yang, C., & Chen, Z. (2020) · Science China Information Sciences · doi:10.1007/s11432-019-2748-x · Cited by 64
Self-citationRen, Y. S., Chen, M., & Liu, J. (2019) · Science China Information Sciences · doi:10.1007/s11432-018-9636-3 · Cited by 61
Kimura, H., & Kobayashi, S. (2000) · Medical Entomology and Zoology · Cited by 48
Research works printed but not linked: 24
- 10.1177/1077546311403181 · doi:10.1177/1077546311403181
- 10.1109/TCST.2017.2756962 · doi:10.1109/tcst.2017.2756962
- 10.1109/TIE.2009.2029528 · DOI
- 10.1109/TIE.2016.2573270 · doi:10.1109/tie.2016.2573270
- wu, 0, 3D path following of helical micro-swimmers with an adaptive orientation compensation model, IEEE Trans Autom Sci Eng
- sun, 2009, An analysis of a neural dynamical approach to solving optimization problems, IEEE Trans Autom Control, 54, 1972, 10.1109/TAC.2009.2023963 · doi:10.1109/tac.2009.2023963
- 10.1109/TCST.2015.2457877 · DOI
- 10.1109/TIE.2017.2674592 · doi:10.1109/tie.2017.2674592
- 10.1109/AMS.2009.136 · doi:10.1109/ams.2009.136
- 10.2514/3.21402 · doi:10.2514/3.21402
- 10.1109/TRO.2015.2441473 · doi:10.1109/tro.2015.2441473
- 10.1109/TRO.2014.2347573 · doi:10.1109/tro.2014.2347573
- luc, 2018, Robust adaptive tracking control based on state feedback controller with integrator terms for elastic joint robots with uncertain parameters, IEEE Trans Control Syst Technol, 26, 2259, 10.1109/TCST.2017.2749564 · doi:10.1109/tcst.2017.2749564
- 10.1109/TAC.2018.2872204 · doi:10.1109/tac.2018.2872204
- 10.1109/JAS.2017.7510820 · doi:10.1109/jas.2017.7510820
- 10.1109/TSMC.2019.2922305 · doi:10.1109/tsmc.2019.2922305
- 10.1109/TSMC.2018.2843523 · doi:10.1109/tsmc.2018.2843523
- 10.1016/j.automatica.2014.10.117 · doi:10.1016/j.automatica.2014.10.117
- 10.1108/AA-12-2018-0264 · doi:10.1108/aa-12-2018-0264
- 10.1109/TCST.2016.2606346 · doi:10.1109/tcst.2016.2606346
- 10.1109/TNNLS.2018.2803827 · doi:10.1109/tnnls.2018.2803827
- 10.1109/TMECH.2010.2098970 · doi:10.1109/tmech.2010.2098970
- 10.1109/TMECH.2014.2375638 · doi:10.1109/tmech.2014.2375638
- 10.1109/TSMC.2017.2700433 · doi:10.1109/tsmc.2017.2700433
Cited by
Cao, S., Sun, L., Jiang, J., & Zuo, Z. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3116713 · Cited by 221
Optimized-Based Fault-Tolerant Control of an Electro-Hydraulic System with Disturbance Rejection
Phan, V. D., & Ahn, K. K. (2022) · Applied Sciences · doi:10.3390/app12189197 · Cited by 17
Metadata
- Authors
- He, W., Gao, H., Zhou, C., Yang, C., & Li, Z.
- Venue
- IEEE Transactions on Systems, Man, and Cybernetics: Systems
- Published
- 2021-12
- Volume
- 51
- Issue
- 12
- Pages
- 7326-7336
- ISSN
- 2168-2216 (ISSN-L)
- 2168-2232
- OpenAlex
- W3009523569
- Cited by
- 284
- References
- 41
- FWCI
- 21.48
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- National Natural Science Foundation of China (61933001, 61873298)
- National Key Research and Development Program of China (2019YFB1703600)
- Joint Funds of Equipment Preresearch and Ministry of Education of China (6141A02033339)
- Beijing Top Discipline for Artificial Intelligent Science and Engineering, University Science and Technology Beijing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.