A Hybrid Pure Pursuit–PID and TD3 Control Framework for Differential-Drive Mobile Robots
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
In this study, a hybrid control structure that combines classical control methods with reinforcement learning is proposed for target tracking of a differential-drive mobile robot. In the proposed framework, Pure Pursuit–based reference generation and an inner-loop Proportional–Integral–Derivative (PID) controller are integrated with the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm. While the classical Pure Pursuit–PID structure ensures baseline stability and safety, the TD3-based learning component enhances performance by generating corrective torque contributions when classical control becomes insufficient. First, experiments are conducted under nominal system conditions to demonstrate that the proposed approach preserves the fundamental behavior of the classical controller and achieves comparable trajectory-tracking performance. Subsequently, the robustness of the control schemes is evaluated under parametric uncertainties applied to the chassis and wheel masses. Experimental results show that the classical PID-based control structure fails to achieve stable convergence under these uncertainties, whereas the proposed reinforcement learning–enhanced controller consistently reaches the target in a stable and reliable manner across all tested scenarios, achieving a 100% success rate. Quantitative analysis further indicates that the proposed method significantly improves convergence behavior and tracking stability by reducing trajectory deviations and eliminating oscillatory behavior observed in the classical controller. Furthermore, the influence of key learning components—such as minibatch size, replay buffer capacity, optimization algorithm, and network architecture—on control performance is systematically analyzed through a comprehensive ablation study. The results demonstrate that the proposed residual learning approach provides superior stability and robustness, effectively overcoming the practical limitations of classical control methods. Accordingly, this study presents a reliable and generalizable mobile robot control architecture capable of coping with model uncertainties and dynamic variations that are inevitable in real-world applications.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Soft actor-critic Off-policy maximum entropy deep reinforcement learning with a stochastic actor
Haarnoja, T., Zhou, A., Abbeel, P., & Levine, S. (2018) · arXiv · doi:10.48550/arxiv.1801.01290 · Cited by 5,594 · cited 1×
“…algorithms such as Deep Deterministic Policy Gradient (DDPG), Proximal Policy Optimization (PPO), and Soft Actor–Critic (SAC) have been successfully applied to continuous-state and continuous-action control problems, including mobile robot navigation and path-following tasks [27], [28], [29].”
MuJoCo: A physics engine for model-based control
Todorov, E., Erez, T., & Tassa, Y. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6386109 · Cited by 4,767 · cited 1×
“These concerns have motivated the development of hybrid control frameworks that combine classical control strategies with learning-based methods [35].”
Addressing Function Approximation Error in Actor-Critic Methods
Fujimoto, S., van Hoof, H., & Meger, D. (2018) · arXiv · doi:10.48550/arxiv.1802.09477 · Cited by 3,650 · cited 3×
“The Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm was introduced to mitigate several limitations observed in earlier deterministic policy gradient methods, particularly value overestimation and training instability [12].”
Schaul, T., Quan, J., Antonoglou, I., & Silver, D. (2015) · arXiv · doi:10.48550/arxiv.1511.05952 · Cited by 3,120
Deep reinforcement learning based mobile robot navigation: A review
Zhu, K., & Zhang, T. (2021) · Tsinghua Science and Technology · doi:10.26599/tst.2021.9010012 · Cited by 499 · cited 1×
“A key advantage of RL lies in its ability to learn control policies directly through interaction with the environment, without requiring explicit mathematical models of system dynamics [25], [26].”
A Review of some Pure-Pursuit based Path Tracking Techniques for Control of Autonomous Vehicle
Samuel, M., Hussein, M., & Binti, M. (2016) · International Journal of Computer Applications · doi:10.5120/ijca2016908314 · Cited by 179 · cited 1×
“Among geometric-based path-following meth-ods, the Pure Pursuit algorithm has received considerable attention [17], [18].”
Review of Wheeled Mobile Robots’ Navigation Problems and Application Prospects in Agriculture
Gao, X., Li, J., Fan, L., Zhou, Q., Yin, K., Wang, J., Song, C., Huang, L., & Wang, Z. (2018) · IEEE Access · doi:10.1109/access.2018.2868848 · Cited by 173 · cited 2×
“Autonomous target tracking and path-following problems for mobile robots have long been central topics in the robotics literature [2], [14].”
Deep Reinforcement Learning of Mobile Robot Navigation in Dynamic Environment: A Review
Zhu, Y., Hasan, W. Z. W., Ramli, H. R., Norsahperi, N. M. H., Kassim, M. S. M., & Yao, Y. (2025) · Sensors · doi:10.3390/s25113394 · Cited by 116 · cited 1×
“In recent years, reinforcement learning (RL)-based control methods have emerged as promising alternatives to classical approaches in mobile robot con-trol [9], [24].”
Regulated pure pursuit for robot path tracking
Macenski, S., Singh, S., Martín, F., et al. (2023) · Autonomous Robots · doi:10.1007/s10514-023-10097-6 · Cited by 100 · cited 1×
“Its widespread adoption is largely due to its simple geometric formulation, ease of implementation, and low computational complexity, which make it well suited for real-time mobile robot and autonomous vehicle applications [19], [20].”
Vehicle Path Tracking Control Using Pure Pursuit With MPC-Based Look-Ahead Distance Optimization
Kim, S., Lee, J., Han, K., & Choi, S. B. (2023) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2023.3304427 · Cited by 89 · cited 1×
“Fixed parameter selection limits the adaptability of the algorithm and can result in suboptimal performance under varying operating conditions, including sharp turns, velocity changes, and external disturbances [21], [22].”
Metadata
- Authors
- Demircioglu, U., Bakir, H., Almarri, B., & Abdul Hafez, A. H.
- Affiliations
- Faculty of Engineering and Natural Sciences, Sivas University of Science and Technology, Sivas, Türkiye
- King Faisal University (SA)
- Department of Computer Science, College of Computer Sciences and Information Technology, King Faisal University, Al-Ahsa, Saudi Arabia
- Venue
- IEEE Access
- Published
- 2026
- Volume
- 14
- Pages
- 80817-80838
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W7160621918
- Cited by
- 0
- References
- 31
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- IEEE Access (publishedVersion, cc-by-nc-nd)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Deanship of Scientific Research, Vice Presidency for Graduate Studies and Scientific Research, King Faisal University, Saudi Arabia, (KFU262319)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Control and Systems Engineering › Control and Dynamics of Mobile Robots
- Physical Sciences › Engineering › Control and Systems Engineering › Adaptive Dynamic Programming Control
- Keywords
- differential drive robot, target tracking, pure pursuit, PID control, TD3, trajectory tracking, parameter uncertainty, robustness, residual learning, ablation study
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Hybrid Pure Pursuit–PID and TD3 Control Framework for Differential-Drive Mobile Robots. https://app.cochat.ai/papers/10.1109/access.2026.3691502
- The paper
- Demircioglu, U., Bakir, H., Almarri, B., & Abdul Hafez, A. H. (2026). A Hybrid Pure Pursuit–PID and TD3 Control Framework for Differential-Drive Mobile Robots. IEEE Access. https://doi.org/10.1109/access.2026.3691502
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.