The DOI matches its Crossref record; 33 of the 36 references it cites were found in a registry or an index.
Lifelong Federated Reinforcement Learning: A Learning Architecture for Navigation in Cloud Robotic Systems
Open accessAbstract
This letter was motivated by the problem of how to make robots fuse and transfer their experience so that they can effectively use prior knowledge and quickly adapt to new environments. To address the problem, we present a learning architecture for navigation in cloud robotic systems: Lifelong Federated Reinforcement Learning (LFRL). In the letter, we propose a knowledge fusion algorithm for upgrading a shared model deployed on the cloud. Then, effective transfer learning methods in LFRL are introduced. LFRL is consistent with human cognitive science and fits well in cloud robotic systems. Experiments show that LFRL greatly improves the efficiency of reinforcement learning for robot navigation. The cloud robotic system deployment also shows that LFRL is capable of fusing prior knowledge. In addition, we release a cloud robotic navigation-learning website to provide the service based on LFRL: www.shared-robotics.com.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Through communication rounds, the server can accumulate a significant knowledge of different robots to build a powerful learning model, and thus the imitation learning efficiency and accuracy of local robots can be improved in comparison with centralized learning approaches.”
From Federated Learning for Internet of Things: A Comprehensive Survey (2021) · cites this paper as [164]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Through communication rounds, the server can accumulate a significant knowledge of different robots to build a powerful learning model, and thus the imitation learning efficiency and accuracy of local robots can be improved in comparison with centralized learning approaches.”
From Federated Learning for Internet of Things: A Comprehensive Survey (2021) · cites this paper as [164]
In the citing paper
“FL can assist to improve the security and privacy of medical industry data analysis and prediction by incorporating a data protection system [25, 161, 162] .”
From Federated learning-based AI approaches in smart healthcare: Concepts, taxonomies, challenges and open issues (2023) · cites this paper as [161]
In the citing paper
“Hospital mortality prediction, duration of stay, or rather the rate of admission can also be examined using FL-based models for the proper management of some critical care units in the hospital while protecting the privacy of in-hospital data [161, 166].”
From Federated learning-based AI approaches in smart healthcare: Concepts, taxonomies, challenges and open issues (2023) · cites this paper as [161]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Target-driven visual navigation in indoor scenes using deep reinforcement learning
Zhu, Y., Mottaghi, R., Kolve, E., Lim, J. J., Gupta, A., Fei-Fei, L., & Farhadi, A. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989381 · Cited by 1,533
Rusu, A. A., Rabinowitz, N. C., Desjardins, G., Soyer, H., Kirkpatrick, J., Kavukcuoglu, K., Pascanu, R., & Hadsell, R. (2016) · arXiv · doi:10.48550/arxiv.1606.04671 · Cited by 1,307
Federated Learning for Mobile Keyboard Prediction
Hard, A., Rao, K., Mathews, R., Ramaswamy, S., Beaufays, F., Augenstein, S., Eichner, H., Kiddon, C., & Ramage, D. (2018) · arXiv · doi:10.48550/arxiv.1811.03604 · Cited by 1,148
Reinforcement Learning with Unsupervised Auxiliary TasksPreprint
Jaderberg, M., Mnih, V., Czarnecki, W. M., Schaul, T., Leibo, J. Z., Silver, D., & Kavukcuoglu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.05397 · Cited by 1,117
In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning
Wang, X., Han, Y., Wang, C., Zhao, Q., Chen, X., & Chen, M. (2019) · IEEE Network · doi:10.1109/mnet.2019.1800286 · Cited by 1,030 · cited 1×
“Different from the traditional joint learning method where multiple edges are learning at the same time, LFRLA adopts the method of first training then mergingto reduce the dependence on the quality of communication[25][26].”
MethodFederated Learning of Deep Networks using Model AveragingPreprint
McMahan, H. B., Moore, E., Ramage, D., & y Arcas, B. A. (2016) · arXiv (Cornell University) · Cited by 1,005
Optimal and Autonomous Control Using Reinforcement Learning: A Survey
Kiumarsi, B., Vamvoudakis, K. G., Modares, H., & Lewis, F. L. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2773458 · Cited by 924
End-to-End Learning of Driving Models from Large-Scale Video Datasets
Xu, H., Gao, Y., Yu, F., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.376 · Cited by 884
Research works printed but not linked: 1
- kuffner, 0, Cloud-enabled robots, Proc Int Conf Humanoid Robot
Cited by
Sorted by citations
Items 201–242 of 242
Zhang, D., Bao, W., Ji, W., Zhang, X., Zhou, J., & Zhang, Y. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130430 · Cited by 1
A Study of Virtual Concept Drift in Federated Data Stream Learning
Chen, X., Zhang, T., Yang, G., & Wang, S. (2024) · International Conference on Mobility, Sensing and Networking (MSN) · doi:10.1109/msn63567.2024.00149 · Cited by 1
A Survey on Cloud Robotics and Automation
Ghotkar, M. T. (2020) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2020.6319 · Cited by 1
A Video Stitching System of Underwater Image
Wang, Z., Wu, H., Yu, T., Fu, M., Liu, B., Cheng, J., Ye, Q., Zhang, N., Huang, S., Lu, X., et al. (2021) · IEEE International Conference on High Performance Computing and Communications; IEEE International Conference on Smart City; IEEE International Conference on Data Science and Systems (HPCC/SmartCity/DSS) · doi:10.1109/hpcc-dss-smartcity-dependsys53884.2021.00159 · Cited by 1
Self-citationA Study on Efficient Reinforcement Learning Through Knowledge Transfer
Glatt, R., da Silva, F. L., Bianchi, R. A. C., & Costa, A. H. R. (2022) · Adaptation, learning, and optimization · doi:10.1007/978-3-031-11748-0_14 · Cited by 2
Camouflage Design of Analysis Based on HSV Color Statistics and K-means ClusteringPreprint
Wei, X., Zhou, M., & Liu, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.07968 · Cited by 1
Self-citationDDoS attack detection method based on feature extraction of deep belief networkPreprint
Li, Y., Shang, Z., & Mingrui, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.07889 · Cited by 1
Federated LQR: Learning through Sharing.Preprint
Ren, Z., Zhong, A., Zhou, Z., & Li, N. (2020) · arXiv (Cornell University) · Cited by 1
Federated Ensemble Model-based Reinforcement Learning.Preprint
Wang, J., Hu, J. W., Mills, J., & Min, G. (2021) · arXiv (Cornell University) · Cited by 1
Life detection strategy based on infrared vision and ultra-wideband radar data fusionPreprint
Li, Y., & Zhou, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.01564
A Books Recommendation Approach Based on Online Bookstore DataPreprint
Wei, X., Chen, J., Chen, J., & Liu, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.06542
Self-citationAssessment of Urban Ecological Service value used in Urban Rail Transit ProjectPreprint
Li, Y., & Chen, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.06572
Options of Different Rescue Periods on Transport ToolsPreprint
Zhou, M., Chen, J., & Liu, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.07494
Self-citationEvaluation Pattern on Refugee CrisisPreprint
Chen, J., Zhou, M., & Liu, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.07408
Self-citationTo save the Environmental degradation: Please pay for ecosystem services!Preprint
Li, Y., Chen, J., & Liu, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.04139
Self-citationMulti-dimensional Fatigue Driving Detection Method Based on SVM Improved by the Kernel Function
Sun, Y., Cheng, J., Chen, M., Zeng, M., Fan, Z., Sun, J., Liu, J., Chen, Z., & Wang, Y. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-78618-2_3
A Near-Optimal Solution to a Class of Deep Structured Teams with Nonlinear Dynamics
Fathi, V., Roudneshin, M., & Aghdam, A. G. (2021) · Mediterranean Conference on Control and Automation (MED) · doi:10.1109/med51440.2021.9480212
Distributed Unsupervised Visual Representation Learning with Fused FeaturesPreprint
Wu, Y., Wang, Z., Zeng, D., Li, M., Shi, Y., & Hu, J. (2021) · arXiv (Cornell University)
Yu, L., Wang, J., Nan, Y., Wenyue, X., Li, D., & Feng, Q. (2021) · IEEE International Conference on Information Technology, Big Data and Artificial Intelligence (ICIBA) · doi:10.1109/iciba52610.2021.9688106
2019 Index IEEE Robotics and Automation Letters Vol. 4
(2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2955867
(2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2933977
محمد, ن. س., & سالم, د. ع. م. ح. (2023) · تکنولوجيا التعليم سلسلة دراسات وبحوث · doi:10.21608/tesr.2023.289908
Analysis of Robot Skill Learning Methods and Secondary Approaches to Enhance Learning
Özen, B. K., & Demirbilek, B. H. (2022) · International Conference on Mechanical Engineering and Robotics Research (ICMERR) · doi:10.1109/icmerr56497.2022.10097826
Cimurs, R., Turkovs, V., Banis, M., & Koršunovs, A. (2023) · Algorithms · doi:10.3390/a16090412
A Review on Bayesian Meta-Learning for Robot Mapping and NavigationPreprint
Nayak, S. K., & Pal, S. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4673996
Integration of federated learning paradigms into electronic health record systems
Obakhena, H. I., Imoize, A. L., & Anyasi, F. I. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-13897-3.00017-5 · Cited by 1
Communication-Efficient Federated Reinforcement Learning: Recent Advances and Open Challenges
Fabbro, N. D., Mitra, A., & Pappas, G. J. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-14081-5.00071-4
FedRAL: Cost-Effective Distributed Annotation via Federated Reinforced Active Learning
Lazaridis, Y., Kastellos, A., Psaltis, A., & Daras, P. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10930759
Multifaceted Applications of Federated Learning: Beyond Neural Networks
Legler, T., Hegiste, V., & Ruskowski, M. (2025) · Lecture notes in mechanical engineering · doi:10.1007/978-3-031-86489-6_28
Adaptive Confidence-Weighted Policy Aggregation: A Novel Method for Federated Reinforcement LearningPreprint
Azar, N. A., Shahmansoorian, A., & Davoudi, M. (2025) · Research Square · doi:10.21203/rs.3.rs-6665562/v1
Federated Intelligence in Web: A Tutorial
Yan, P., Chen, S., & Long, G. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3701716.3715864
Privacy Preserving Advanced Persistent Threat Detection Using Fed-Adv-LSTM
Heraguemi, L., Korba, A. A., & Ghoualmi‐Zine, N. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-78940-3_18
Federated Learning Based Decision Making for Autonomous Driving in Extreme Scenarios
Zhang, Y., Hou, Y., & Ho, I. W. (2025) · IEEE Vehicular Technology Conference · doi:10.1109/vtc2025-fall65116.2025.11310761
Rahim, S., & Khalil, S. (2026) · Lecture notes in electrical engineering · doi:10.1007/978-981-95-2820-2_17
Subspaces of Policies for Deep Reinforcement Learning
Gaya, J.-B. (2024) · theses.fr (ABES) · doi:10.70675/c266cfc3z60a1z40d5zbc2fz7d342ac5d605
Distributed multi-agent proximal policy optimization for non-holonomic robot trajectory planning
Yu, J., & Zhou, J. (2026) · Digital engineering. · doi:10.1016/j.dte.2026.100123
Transformer-enhanced deep Q-Learning for adaptive robot path planning in dynamic environments
Sharma, H., Tiwari, R., Shukla, S., & Kumar, S. (2026) · Cluster Computing · doi:10.1007/s10586-026-06072-2
Akbari, M., Ghasemi, S., Talabi, O., Yekanlou, A., & Cai, J. (2026) · IEEE Internet of Things Journal · doi:10.1109/jiot.2026.3711992
Personalized Federated Learning of Driver Prediction Models for Autonomous Driving
Nakanoya, M., Im, J., Qiu, H., Katti, S., Pavone, M., & Chinchali, S. (2021) · arXiv · doi:10.48550/arxiv.2112.00956 · Cited by 9
Metadata
- Authors
- Liu, B., Wang, L., & Liu, M.
- Affiliations
- Shenzhen Institutes of Advanced Technology (CN)
- Hong Kong University of Science and Technology (HK)
- Venue
- IEEE Robotics and Automation Letters
- Published
- 2019-10
- Volume
- 4
- Issue
- 4
- Pages
- 4555-4562
- ISSN
- 2377-3766 (ISSN-L)
- 2377-3774
- OpenAlex
- W2911450448
- Cited by
- 242
- References
- 36
- Citations by year
- 2026: 5 · 2025: 29 · 2024: 38 · 2023: 40 · 2022: 33 · 2021: 50 · 2020: 27 · 2019: 20
- FWCI
- 15.00
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Robotics and Automation Letters (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Shenzhen Science and Technology Innovation Commission (JCYJ2017081853518789)
- Guangdong Science and Technology Plan Guangdong-Hong Kong Cooperation Innovation Platform (2018B050502009)
- National Natural Science Foundation of China (61603376, U1713211)
- Shenzhen Science, Technology and Innovation Commission (JCYJ20160428154842603)
- Basic Research Project of Shanghai Science and Technology Commission (16JC1401200)
- Chengzhong Xu from University of Macau
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Engineering › Control and Systems Engineering › Robotics and Automated Systems
- Keywords
- lifelong learning, federated reinforcement learning, robot navigation, cloud robotics, knowledge fusion, transfer learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
