Model-Free reinforcement learning with continuous action in practice
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Reinforcement learning methods are often considered as a potential solution to enable a robot to adapt to changes in real time to an unpredictable environment. However, with continuous action, only a few existing algorithms are practical for real-time learning. In such a setting, most effective methods have used a parameterized policy structure, often with a separate parameterized value function. The goal of this paper is to assess such actor-critic methods to form a fully specified practical algorithm. Our specific contributions include 1) developing the extension of existing incremental policy-gradient algorithms to use eligibility traces, 2) an empirical comparison of the resulting algorithms using continuous actions, 3) the evaluation of a gradient-scaling technique that can significantly improve performance. Finally, we apply our actor-critic algorithm to learn on a robotic platform with a fast sensorimotor cycle (10ms). Overall, these results constitute an important step towards practical real-time learning control with continuous action.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Self-citationLearning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Self-citation(1999) · Cited by 5,147
Self-citationSimple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 3,416
Reinforcement Learning in Continuous Time and Space
Doya, K. (2000) · Neural Computation · doi:10.1162/089976600300015961 · Cited by 960
Simple statistical gradient-following algorithms for connectionist reinforcement learning
Williams, R. J. (1992) · Machine Learning · doi:10.1023/a:1022672621406 · Cited by 817
Peters, J., & Schaal, S. (2008) · Neurocomputing · doi:10.1016/j.neucom.2007.11.026 · Cited by 738
Autonomous Helicopter Aerobatics through Apprenticeship Learning
Abbeel, P., Coates, A., & Ng, A. Y. (2010) · The International Journal of Robotics Research · doi:10.1177/0278364910371999 · Cited by 584
Policy gradient reinforcement learning for fast quadrupedal locomotion
Kohl, N., & Stone, P. (2004) · IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004 · doi:10.1109/robot.2004.1307456 · Cited by 564
Natural actor–critic algorithms
Bhatnagar, S., Sutton, R. S., Ghavamzadeh, M., & Lee, M. (2009) · Automatica · doi:10.1016/j.automatica.2009.07.008 · Cited by 559
Self-citation
Cited by
Items 101–200 of 238
Mathewson, K. W., & Pilarski, P. M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.06979 · Cited by 16
Self-citationA Reinforcement Learning Based Approach for Automated Lane Change ManeuversPreprint
Wang, P., Chan, C., & Fortelle, A. D. L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.07871 · Cited by 13
An Off-policy Policy Gradient Theorem Using Emphatic WeightingsPreprint
Imani, E., Graves, E., & White, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.09013 · Cited by 54
Xie, Z., Lu, L., Wang, H., Su, B., Liu, Y., & Xu, X. (2023) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208231177574 · Cited by 17
Wu, G., Zhang, D., Miao, Z., Bao, W., & Cao, J. (2024) · Electronics · doi:10.3390/electronics13071281 · Cited by 16
Lin, T., Tappiti, C., Lu, L., & Lin, T.-K. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110058 · Cited by 15
A deep reinforcement learning process based on robotic training to assist mental health patients
Altameem, T. A., Amoon, M., & Altameem, A. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-04855-1 · Cited by 13
Reinforcement Learning Control for Robot Arm Grasping Based on Improved DDPG
Qi, G., & Li, Y. (2021) · Chinese Control Conference (CCC) · doi:10.23919/ccc52363.2021.9550413 · Cited by 12
Actor-Expert: A Framework for using Q-learning in Continuous Action SpacesPreprint
Lim, S. (2019) · arXiv (Cornell University) · doi:10.7939/r3-qgdp-3872 · Cited by 15
A Modified Convergence DDPG Algorithm for Robotic Manipulation
Afzali, S. R., Shoaran, M., & Karimian, G. (2023) · Neural Processing Letters · doi:10.1007/s11063-023-11393-z · Cited by 14
Natural Temporal Difference Learning
Dabney, W., & Thomas, P. S. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.9018 · Cited by 14
Application of the Free Energy Principle to Estimation and Control
van de Laar, T., Özçelikkale, A., & Wymeersch, H. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3095711 · Cited by 19
Automated Driving Maneuvers under Interactive Environment based on Deep Reinforcement LearningPreprint
Wang, P., Chan, C., & Li, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.09200 · Cited by 11
Structured Output Feedback Control for Linear Quadratic Regulator Using Policy Gradient Method
Takakura, S., & Sato, K. (2023) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2023.3264176 · Cited by 10
Multiscale Computation and Dynamic Attention in Biological and Artificial Intelligence
Badman, R. P., Hills, T. T., & Akaishi, R. (2020) · Brain Sciences · doi:10.3390/brainsci10060396 · Cited by 13
Zhao, Z., Zhao, Y., Ma, H., Li, Y., Rahman, S., Han, D., Zhang, H., & Zhang, J. (2021) · Optical Fiber Technology · doi:10.1016/j.yofte.2021.102571 · Cited by 10
Online resolution adaptation and resource allocation for edge-assisted video analytics
Li, Y., Li, Y., Chen, Y., Tong, J., Tian, X., & Chi, K. (2024) · Computer Networks · doi:10.1016/j.comnet.2024.110342 · Cited by 11
Learning to teleoperate an upper-limb assistive humanoid robot for bimanual daily-living tasks
Connan, M., Sierotowicz, M., Henze, B., Porges, O., Albu‐Schäffer, A., Roa, M. A., & Castellini, C. (2021) · Biomedical Physics & Engineering Express · doi:10.1088/2057-1976/ac3881 · Cited by 13
Stabilization of vertical motion of a vehicle on bumpy terrain using deep reinforcement learning*
Salvi, A., Coleman, J., Buzhardt, J., Krovi, V., & Tallapragada, P. (2022) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2022.11.197 · Cited by 9
Differentiable Sampling with Flexible Reference Word Order for Neural Machine Translation
Xu, W., Niu, X., & Carpuat, M. J. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1207 · Cited by 13
Visual Navigation with Asynchronous Proximal Policy Optimization in Artificial Agents
Zeng, F., & Wang, C. (2020) · Journal of Robotics · doi:10.1155/2020/8702962 · Cited by 14
Shen, S., Shen, G., Shen, Y., Liu, D.-Y., Yang, X. C., & Kong, X. (2020) · KSII Transactions on Internet and Information Systems · doi:10.3837/tiis.2020.11.002 · Cited by 10
Platform Behavior under Market Shocks: A Simulation Framework and Reinforcement-Learning Based Study
Wang, X., Ma, G. Q., Eden, A., Li, C., Trott, A., Zheng, S., & Parkes, D. C. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583523 · Cited by 9
Value-free reinforcement learning: Policy optimization as a minimal model of operant behaviorPreprint
Bennett, D., Niv, Y., & Langdon, A. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ew58m · Cited by 12
Predictive reinforcement learning: map-less navigation method for mobile robot
Dobriborsci, D., Zashchitin, R., Kakanov, M. A., Aumer, W., & Osinenko, P. (2023) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-023-02197-y · Cited by 10
Error-related potential-based shared autonomy via deep recurrent reinforcement learning
Wang, X., Chen, H., & Lin, C. (2022) · Journal of Neural Engineering · doi:10.1088/1741-2552/aca4fb · Cited by 11
Implicit incremental natural actor critic algorithm
Iwaki, R., & Asada, M. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.10.007 · Cited by 8
Quadratic Q-network for Learning Continuous Control for Autonomous VehiclesPreprint
Wang, P., Li, H., & Chan, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.00074 · Cited by 17
AutoAssign+: Automatic Shared Embedding Assignment in streaming recommendation
Liu, Z., Chen, K., Song, F., Chen, B., Zhao, X., Guo, H., & Tang, R. (2023) · Knowledge and Information Systems · doi:10.1007/s10115-023-01951-1 · Cited by 9
Reinforcement Learning-Based Detection for State Estimation Under False Data Injection
Jiang, W., Yang, W. D., Zhou, J., Ding, W., Luo, Y., & Liu, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3076538 · Cited by 7
Yoon, S., Cho, J., Dixit, G., & Chen, I.-R. (2021) · Wiley eBooks · doi:10.1002/9781119723950.ch20 · Cited by 7
Active Disparity Sampling for Stereo Matching With Adjoint Network
Zhang, C., Meng, G., Tian, K., Ni, B., & Xiang, S. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3343105 · Cited by 7
Modeling User Retention through Generative Flow Networks
Liu, Z., Liu, S., Yang, B., Xue, Z., Cai, Q., Zhao, X., Zhang, Z., Hu, L., Li, H., & Jiang, P. (2024) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3637528.3671531 · Cited by 17
Object Detection Method Using Image and Number of Objects on Image as Label
Choi, K.-H., & Ha, J.-E. (2024) · IEEE Access · doi:10.1109/access.2024.3452728 · Cited by 6
A Real-time Algorithm for USV Navigation Based on Deep Reinforcement Learning
Zhou, Z., Zheng, Y., Liu, K., Xu, H., & Qu, C. (2019) · IEEE International Conference on Signal, Information and Data Processing (ICSIDP) · doi:10.1109/icsidp47821.2019.9173280 · Cited by 6
Using Deep Reinforcement Learning for mmWave Real-Time Scheduling
Gahtan, B., Cohen, R., Bronstein, A. M., & Kedar, G. (2023) · International Conference on the Network of the Future (NOF) · doi:10.1109/nof58724.2023.10302794 · Cited by 6
Crowdfunding Dynamics Tracking: A Reinforcement Learning Approach
Wang, J., Zhang, H., Liu, Q., Pan, Z. K., & Tao, H. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6087 · Cited by 7
Short-Term Trajectory Planning in TORCS using Deep Reinforcement Learning
Capo, E., & Loiacono, D. (2020) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci47803.2020.9308138 · Cited by 9
Dobriborsci, D., Osinenko, P., & Aumer, W. (2022) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2022.09.610 · Cited by 9
Differentiable Physics Simulation
Liang, J., & Lin, M. C. (2020) · International Conference on Learning Representations · Cited by 6
Graph Partitioning and Sparse Matrix Ordering using Reinforcement Learning and Graph Neural NetworksPreprint
Gatti, A., Hu, Z., Smidt, T., Ng, E., & Ghysels, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.03546 · Cited by 16
Generalization of Reinforcement Learning with Policy-Aware Adversarial Data AugmentationPreprint
Zhang, H., & Guo, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.15587 · Cited by 22
Yonezawa, H., Yonezawa, A., & KAJIWARA, I. (2025) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2025.113570 · Cited by 6
QDRL: QoS-Aware Deep Reinforcement Learning Approach for Tor's Circuit Scheduling
Basyoni, L., Erbad, A., Mohamed, A. M. S., & Guizani, M. (2022) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2022.3179569 · Cited by 5
A Deep Reinforcement Learning-Based Approach for Android GUI Testing
Gao, Y., Tao, C., Guo, H., & Gao, J. Z. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25201-3_20 · Cited by 5
Metatrace: Online Step-size Tuning by Meta-gradient Descent for Reinforcement Learning Control.Preprint
Young, K., Wang, B., & Taylor, M. E. (2018) · arXiv (Cornell University) · Cited by 5
Benhamou, E. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3391216 · Cited by 6
Combined Constraint on Behavior Cloning and Discriminator in Offline Reinforcement Learning
Kidera, S., Shintani, K., Tsuneda, T., & Yamane, S. (2024) · IEEE Access · doi:10.1109/access.2024.3361030 · Cited by 4
Learning to Code: Coded Caching via Deep Reinforcement Learning
Naderializadeh, N., & Asghari, S. M. (2019) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf44664.2019.9048907 · Cited by 4
Learning to Engage in Interactive Digital Art
Tong, Z., & Kulić, D. (2021) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3397481.3450691 · Cited by 4
Reinforcement learning technology for air combat confrontation of unmanned aerial vehicle
Zhou, H., Zhang, X. Y., & Zhang, Z. (2022) · International Conference on Computer Graphics, Artificial Intelligence, and Data Processing (ICCAID) · doi:10.1117/12.2631651 · Cited by 4
Learn to Race: Sequential Actor-Critic Reinforcement Learning for Autonomous Racing
Liu, R., Zhuang, W., Tong, F., & Yin, G. (2023) · IEEE International Automated Vehicle Validation Conference (IAVVC) · doi:10.1109/iavvc57316.2023.10328086 · Cited by 4
Transformer-Based Deep Reinforcement Learning in VizDoom
Sopov, V., & Makarov, I. (2022) · Communications in computer and information science · doi:10.1007/978-3-031-15168-2_9 · Cited by 7
Reinforcement Learning in Education 4.0: Open Applications and Deployment Challenges
Dake, D. K. (2023) · International Journal of Computer Science and Information Technology · doi:10.5121/ijcsit.2023.15304 · Cited by 8
A reinforcement learning-based approach to testing GUI of moblie applications
Tao, C., Wang, F., Gao, Y., Guo, H., & Gao, J. Z. (2024) · World Wide Web · doi:10.1007/s11280-024-01252-9 · Cited by 4
Data-Driven Grinding Control Using Reinforcement Learning
Guo, L., Wang, H., & Zhang, J. (2019) · IEEE International Conference on High Performance Computing and Communications; IEEE International Conference on Smart City; IEEE International Conference on Data Science and Systems (HPCC/SmartCity/DSS) · doi:10.1109/hpcc/smartcity/dss.2019.00395 · Cited by 4
Learning a model-free robotic continuous state-action task through contractive Q-network
Davari, M.-J., Alipour, K., Hadi, A., & Tarvirdizadeh, B. (2017) · Artificial Intelligence and Robotics (IRANOPEN) · doi:10.1109/rios.2017.7956453 · Cited by 4
Adaptive Variance for Changing Sparse-Reward Environments
Lin, X., Guo, P., Florensa, C., & Held, D. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793650 · Cited by 4
Wang, F., Tao, C., & Gao, J. Z. (2024) · Service Oriented Computing and Applications · doi:10.1007/s11761-024-00413-y · Cited by 3
An Adaptive Threshold for the Canny Edge with Weak Label
Choi, K.-H., & Ha, J.-E. (2025) · Applied Sciences · doi:10.3390/app152212158 · Cited by 5
Anwendung von Reinforcement Learning in industriellen cyberphysischen Systemen
David, H. A., Bahrpeyma, F., & Reichelt, D. (2023) · Fachkonferenz Angewandte Automatisierungstechnik in Lehre und Entwicklung (AALE) · doi:10.33968/2023.10 · Cited by 3
Increasing Crop Yield Using Agriculture Sensing Data in Smart Plant Factory
Zheng, Z., Yan, P., Chen, Y., Cai, J., & Zhu, F. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-68884-4_29 · Cited by 3
Sequential Decision Making with “Sequential Information” in Deep Reinforcement Learning
Xu, A., Yuan, L., & Liu, Y. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20868-3_13 · Cited by 3
A Learning-Based Nonlinear Model Predictive Control Approach for Autonomous Driving
Du, L., Sun, B., Huang, X., Wang, X., & Li, P. (2023) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2023.10.1388 · Cited by 3
Chen, Y., Wang, K., Song, G., & Jiang, X. (2023) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2023.3339131 · Cited by 4
A Strong Maneuvering Target-Tracking Filtering Based on Intelligent Algorithm
Li, J., Liang, X., Yuan, S., Li, H., & Gao, C. (2024) · International Journal of Aerospace Engineering · doi:10.1155/2024/9981332 · Cited by 3
Intelligent SDN Routing: A Threshold-Based and LSTM-Enhanced Deep Q-Network Routing Algorithm
Liu, B., Yang, B., Sun, R., Liang, Z., Sun, Z. X., & Li, Z. (2023) · International Conference on Electronics, Computers and Communication Technology (CECCT) · doi:10.1145/3637494.3638727 · Cited by 3
The Improved Algorithm of Deep Q-learning Network Based on Eligibility Trace
Liu, B., Ye, X., Zhou, C., Liu, Y., Zhang, Q., & Dong, F. L. (2020) · International Conference on Control, Automation and Robotics (ICCAR) · doi:10.1109/iccar49639.2020.9108040 · Cited by 3
Deep Reinforcement Learning in Human Activity Recognition: A SurveyPreprint
Nikpour, B., Sinodinos, D., & Armanfard, N. (2022) · doi:10.36227/techrxiv.19172369 · Cited by 7
The State of AI-Empowered Backscatter Communications: A Comprehensive SurveyPreprint
Ahmed, M., Hussain, T., Ali, K., Mirza, M. A., Khan, W. U., Ihsan, A., Xu, F., & Han, Z. (2023) · doi:10.36227/techrxiv.22245958.v1 · Cited by 3
Can Deep Reinforcement Learning Solve the Portfolio Allocation Problem? (PhD Manuscript)Preprint
Benhamou, E. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4599800 · Cited by 3
Reinforcement Learning When All Actions Are Not Always Available
Chandak, Y., Theocharous, G., Metevier, B., & Thomas, P. S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5740 · Cited by 2
Blind Adaptive Gait Planning on Non-stationary Environments via Continual Reinforcement Learning
Hu, H., & Liu, Y. (2021) · IEEE International Conference on Unmanned Systems (ICUS) · doi:10.1109/icus52573.2021.9641095 · Cited by 2
Sood, S., Sun, G., Li, P., & Sartoretti, G. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10802000 · Cited by 16
Physics-guided airfoil optimization design for shock buffet suppression
Ma, Q., Gao, C., Wu, X., & Zhang, W. (2026) · Advances in Aerodynamics · doi:10.1186/s42774-025-00228-1 · Cited by 3
Policy Learning with Deep Koopman Operator Networks
Zhao, D., Li, Y., Yang, X., & Shi, Y. (2023) · International Conference on Advanced Robotics and Mechatronics (ICARM) · doi:10.1109/icarm58088.2023.10218748 · Cited by 2
Simion Zoo: A training workbench for reinforcement learning allowing distributed experimentation
Fernandez‐Gauna, B., & Graña, M. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.127030 · Cited by 3
A Hierarchical Reinforcement Learning Approach for Adaptive Quadruped Locomotion of a Rat Robot
Zhang, Z., Huang, Y., Zhao, Z., Bing, Z., Knoll, A., & Huang, K. (2023) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio58561.2023.10354896 · Cited by 2
A Model-Free Deep Reinforcement Learning Approach to Piano Fingering Generation
Iman, A. P., & Ahn, C. W. (2024) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai59869.2024.00016 · Cited by 2
Actor-critic reinforcement learning for the feedback control of a swinging chain
Dengler, C., & Lohmann, B. (2018) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2018.07.308 · Cited by 2
Reinforcement Learning Motivated Feedforward Control Approach for Disturbance Rejection and Tracking
Faktorovich, I., Bøhn, C., & Vogelsang, J. (2021) · European Control Conference (ECC) · doi:10.23919/ecc54610.2021.9655160 · Cited by 2
Using Deep Reinforcement Learning for the Continuous Control of Robotic ArmsPreprint
Lötzsch, W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.06746 · Cited by 5
Deep Reinforcement Learning in Human Activity Recognition: A SurveyPreprint
Nikpour, B., Sinodinos, D., & Armanfard, N. (2022) · doi:10.36227/techrxiv.19172369.v3 · Cited by 3
Mit Automatisierung gegen den Klimawandel
(2023) · doi:10.33968/2023.01 · Cited by 2
A stable method for task priority adaptation in quadratic programming via reinforcement learning
Testa, A., Laghi, M., Bianco, E. D., Raiola, G., Hoffman, E. M., & Ajoudani, A. (2024) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2024.102857 · Cited by 2
Learnable Game-Theoretic Policy Optimization for Data-Centric Self-Explanation Rationalization
Zhao, Y., Wang, Z., Yu, X., Li, X., Liang, J., & Li, R. (2025) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2025.3638864 · Cited by 10
Reinforcement learning for road pricing: a review and future directions
Vermeulen, O., Siebes, A. P. J. M., & Velegrakis, Y. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-025-11393-6 · Cited by 1
Abeyruwan, S. W., & Visser, U. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-29339-4_30 · Cited by 1
GeNGA: a generalization of natural gradient ascent with positive and
Thomas, P. S. (2014) · International Conference on Machine Learning · Cited by 1
Implicit Incremental Natural Actor Critic
Iwaki, R., & Asada, M. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-70087-8_77 · Cited by 1
Implementing Inductive Logic into Embedded Industrial Control System with Polynomial Ring on F2
Luo, M., & Yu, S. P. (2021) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac51774.2021.00012 · Cited by 1
Optimizing RF Energy Harvesting Systems for IoT Applications using Reinforcement Learning
Lima, L. S. C., Trevisoli, R. D., Suyama, R., Casella, I. R. S., Doria, R. T., & Capovilla, C. E. (2023) · Symposium on Internet of Things (SIoT) · doi:10.1109/siot60039.2023.10390257 · Cited by 1
Multi-policy Soft Actor-Critic Reinforcement Learning for Autonomous Racing
Tong, F., Liu, R., Yin, G., Zhang, S., & Zhuang, W. (2024) · IEEE International Workshop on Advanced Motion Control (AMC) · doi:10.1109/amc58169.2024.10505444 · Cited by 1
Reinforcement Learning from Clip
Zhu, S., Zhang, K., & Pan, H. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-7244-5_21 · Cited by 1
Guo, X., Yan, W., & Cui, R. (2018) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc.2018.8431133 · Cited by 1
HDGS: A Hybrid Dialogue Generation System using Adversarial Learning
Yu, H., Li, A., Jiang, R., Jia, Y., Zhao, X., & Han, W. (2019) · IEEE International Conference on Data Science in Cyberspace · doi:10.1109/dsc.2019.00028 · Cited by 2
GAN-Based Planning Model in Deep Reinforcement Learning
Chen, S., Jiang, J., Zhang, X., Wu, J., & Lu, G. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-61616-8_26 · Cited by 1
Similarities between policy gradient methods in reinforcement and supervised learning.
Benhamou, E., & Saltiel, D. (2020) · The European Symposium on Artificial Neural Networks · Cited by 1
Graph Partitioning and Sparse Matrix Ordering using Reinforcement Learning.
Gatti, A., Hu, Z., Ghysels, P., Ng, E., & Smidt, T. (2021) · Cited by 1
Learning Teleoperation of an Assistive Humanoid Platform by Intact and Upper-Limb Disabled Users
Connan, M., Sierotowicz, M., Henze, B., Porges, O., Albu‐Schäffer, A., Roa, M. A., & Castellini, C. (2021) · Biosystems & biorobotics · doi:10.1007/978-3-030-70316-5_27 · Cited by 1
Metadata
- Authors
- Degris, T., Pilarski, P. M., & Sutton, R. S.
- Affiliations
- Institut national de recherche en sciences et technologies du numérique (FR)
- University of Alberta (CA)
- Venue
- 2012 American Control Conference (ACC)
- Publisher
- IEEE
- Published
- 2012-06
- Pages
- 2177-2182
- ISSN
- 0743-1619 (ISSN-L)
- OpenAlex
- W2024390895
- Cited by
- 239
- References
- 19
- Citations by year
- 2026: 4 · 2025: 12 · 2024: 26 · 2023: 41 · 2022: 14 · 2021: 32 · 2020: 28 · 2019: 34 · 2018: 20 · 2017: 10 · 2016: 3 · 2015: 3 · 2014: 10 · 2013: 2
- FWCI
- 3.68
- Type
- conference paper
- Language
- en
- Open access
- green
- inria.hal.science
- Licence
- other-oa
- Locations
- Proceedings of the ... American Control Conference/Proceedings of the American Control Conference (publishedVersion)
- HAL (submittedVersion, other-oa)
- Funders
- Alberta Innovates
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Control and Systems Engineering › Adaptive Dynamic Programming Control
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- model-free reinforcement learning, continuous actions, actor-critic, eligibility traces, gradient scaling, robot learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.