The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Deep Reinforcement Learning for Mobile Edge Caching: Review, New Features, and Open Issues
Abstract
Mobile edge caching is a promising technique to reduce network traffic and improve the quality of experience of mobile users. However, mobile edge caching is a challenging decision making problem with unknown future content popularity and complex network characteristics. In this article, we advocate the use of DRL to solve mobile edge caching problems by presenting an overview of recent works on mobile edge caching and DRL. We first examine the key issues in mobile edge caching and review the existing learning- based solutions proposed in the literature. We also discuss the unique features in the application of DRL in mobile edge caching, and illustrate an example of DRL-based mobile edge caching with trace-data-driven simulation results. This article concludes with a discussion of several open issues that call for substantial future research efforts.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Traditional RL algorithms are limited by the requirement for handcrafting features and the flaw that hardly handling high-dimensional observation data and actions [239].”
From Convergence of Edge Computing and Deep Learning: A Comprehensive Survey (2020) · cites this paper as [239]
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Deep Reinforcement Learning: A Brief Survey
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2743240 · Cited by 4,733 · cited 1×
“By combining RL deep learning, deep reinforcement learning DRL) enables agents to optimize their control in environment by automatically learning knowledge directly from raw, high-dimensional observations [3].”
BackgroundA Brief Survey of Deep Reinforcement Learning
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · arXiv · doi:10.48550/arxiv.1708.05866 · Cited by 4,733
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Dueling Network Architectures for Deep Reinforcement Learning
Wang, Z., Schaul, T., Hessel, M., van Hasselt, H., Lanctot, M., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06581 · Cited by 3,300
Living on the edge: The role of proactive caching in 5G wireless networks
Bastug, E., Bennis, M., & Debbah, M. (2014) · IEEE Communications Magazine · doi:10.1109/mcom.2014.6871674 · Cited by 1,146
Learning-based optimization of cache content in a small cell base station
Blasco, P., & Gunduz, D. (2014) · 2014 IEEE International Conference on Communications (ICC) · doi:10.1109/icc.2014.6883600 · Cited by 298
Cooperative Content Caching in 5G Networks with Mobile Edge Computing
Zhang, K., Leng, S., He, Y., Maharjan, S., & Zhang, Y. (2018) · IEEE Wireless Communications · doi:10.1109/mwc.2018.1700303 · Cited by 250
Placing dynamic content in caches with small population
Leconte, M., Paschos, G. S., Gkatzikis, L., Draief, M., Vassilaras, S., & Chouvardas, S. (2016) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom.2016.7524380 · Cited by 153
Cited by
Deep Learning in Mobile and Wireless Networking: A Survey
Zhang, C., Patras, P., & Haddadi, H. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2904897 · Cited by 1,768
Deep Learning With Edge Computing: A Review
Chen, J., & Ran, X. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2921977 · Cited by 1,540
“There are generally two approaches to apply deep learning in a caching system: use deep learning for content popularity prediction or use deep reinforcement learning to decide a caching policy [53].”
BackgroundConvergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498
“Traditional RL algorithms are limited by the requirement for handcrafting features and the flaw that hardly handling high-dimensional observation data and actions [239].”
BackgroundPham, Q.-V., Fang, F., Ha, V. N., Piran, M. J., Le, M., Le, L. B., Hwang, W.-J., & Ding, Z. (2020) · IEEE Access · doi:10.1109/access.2020.3001277 · Cited by 870
“D TUTORIALS TABLE V: Summary of key MEC problems that can be solved by machine learning techniques. Applications Existing Works Proposed Framework Challenges Edge caching DRL-based caching strategies [368], [369], [372]–[374], [392], [393] ● Combination of transfer learning and DRL to further exploit knowledge from ot…”
BackgroundInfluentialDeep reinforcement learning for cyber security
Nguyen, T. T., & Reddi, V. J. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3121870 · Cited by 620
“Mobile edge caching [47] Maximize offloading traffic.”
Metadata
- Authors
- Zhu, H., Cao, Y., Wang, W., Jiang, T., & Jin, S.
- Affiliations
- Huazhong University of Science and Technology (CN)
- Southeast University (CN)
- Venue
- IEEE Network
- Published
- 2018-11
- Volume
- 32
- Issue
- 6
- Pages
- 50-57
- ISSN
- 0890-8044 (ISSN-L)
- 1558-156X
- OpenAlex
- W2903523957
- Cited by
- 153
- References
- 16
- Citations by year
- 2026: 4 · 2025: 6 · 2024: 15 · 2023: 24 · 2022: 32 · 2021: 29 · 2020: 29 · 2019: 13 · 2018: 1
- FWCI
- 11.15
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Network (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Caching and Content Delivery
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Computer Networks and Communications › Age of Information Optimization
- Keywords
- mobile edge caching, deep reinforcement learning, content placement, content popularity, network traffic reduction, quality of experience, trace-driven simulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Deep Reinforcement Learning for Mobile Edge Caching: Review, New Features, and Open Issues. https://app.cochat.ai/papers/10.1109/mnet.2018.1800109
- The paper
- Zhu, H., Cao, Y., Wang, W., Jiang, T., & Jin, S. (2018). Deep Reinforcement Learning for Mobile Edge Caching: Review, New Features, and Open Issues. IEEE Network. https://doi.org/10.1109/mnet.2018.1800109
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.