A deep reinforcement learning-based framework for content caching
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Content caching at the edge nodes is a promising technique to reduce the data traffic in next-generation wireless networks. Inspired by the success of Deep Reinforcement Learning (DRL) in solving complicated control problems, this work presents a DRL-based framework with Wolpertinger architecture for content caching at the base station. The proposed framework is aimed at maximizing the long-term cache hit rate, and it requires no knowledge of the content popularity distribution. To evaluate the proposed framework, we compare the performance with other caching algorithms, including Least Recently Used (LRU), Least Frequently Used (LFU), and First-In First-Out (FIFO) caching strategies. Meanwhile, since the Wolpertinger architecture can effectively limit the action space size, we also compare the performance with Deep Q-Network to identify the impact of dropping a portion of the actions. Our results show that the proposed framework can achieve improved short-term cache hit rate and improved and stable long-term cache hit rate in comparison with LRU, LFU, and FIFO schemes. Additionally, the performance is shown to be competitive in comparison to Deep Q-learning, while the proposed framework can provide significant savings in runtime.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As illustrated in [233] [234], the complexity of optimization algorithms can be transferred to the training of DNNs, and thus breaking the practical limitation of employing them.”
From Convergence of Edge Computing and Deep Learning: A Comprehensive Survey (2020) · cites this paper as [234]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Compared DQL-based algorithms searching the whole action space, the trained DRL agent with DDPG and Wolpertinger architecture is able to achieve competitive cache hit rates while reducing the runtime.”
From Convergence of Edge Computing and Deep Learning: A Comprehensive Survey (2020) · cites this paper as [241]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
High performance cache replacement using re-reference interval prediction (RRIP)
Jaleel, A., Theobald, K. B., Steely, S. C., & Emer, J. (2010) · Proceedings of the 37th annual international symposium on Computer architecture · doi:10.1145/1815961.1815971 · Cited by 641
Learning-based optimization of cache content in a small cell base station
Blasco, P., & Gunduz, D. (2014) · 2014 IEEE International Conference on Communications (ICC) · doi:10.1109/icc.2014.6883600 · Cited by 298
Reinforcement Learning in Large Discrete Action Spaces.Preprint
Dulac-Arnold, G., Evans, R., Sunehag, P., & Coppin, B. (2015) · arXiv (Cornell University) · Cited by 292
Caching performance of content centric networks under multi-path routing (and more)
Rossi, D., & Rossini, G. (2011) · HAL (Le Centre pour la Communication Scientifique Directe) · Cited by 291
Deep Reinforcement Learning in Large Discrete Action Spaces
Dulac-Arnold, G., Evans, R., van Hasselt, H., Sunehag, P., Lillicrap, T., Hunt, J., Mann, T., Weber, T., Degris, T., & Coppin, B. (2015) · arXiv · doi:10.48550/arxiv.1512.07679 · Cited by 290
High performance cache replacement using re-reference interval prediction (RRIP)
Jaleel, A., Theobald, K. B., Steely, S. C., & Emer, J. (2010) · ACM SIGARCH Computer Architecture News · doi:10.1145/1816038.1815971 · Cited by 264
Popularity-driven content caching
Li, S., Xu, J., van der Schaar, M., & Li, W. (2016) · IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications · doi:10.1109/infocom.2016.7524381 · Cited by 158
Placing dynamic content in caches with small population
Leconte, M., Paschos, G., Gkatzikis, L., Draief, M., Vassilaras, S., & Chouvardas, S. (2016) · IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications · doi:10.1109/infocom.2016.7524380 · Cited by 151
Learning Based Content Caching and Sharing for Wireless Networks
Song, J., Sheng, M., Quek, T. Q. S., Xu, C., & Wang, X. (2017) · IEEE Transactions on Communications · doi:10.1109/tcomm.2017.2713384 · Cited by 144
Cited by
Items 101–200 of 231
QoE-Driven Proactive Caching With DRL in Sustainable Cloud-to-Edge Continuum
He, X., Jiang, Y., Cui, H., Liu, Y., Chen, M., Guizani, M., & Mumtaz, S. (2025) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2025.3577197 · Cited by 13
Hit Ratio and Latency Optimization for Caching Systems: A Survey
Tran, A.-T., Lakew, D. S., Nguyen, T. V., Tuong, V. D., Truong, T. P., Dao, N., & Cho, S. (2021) · International Conference on Information Networking · doi:10.1109/icoin50884.2021.9334019 · Cited by 13
Krishna, K. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1441250 · Cited by 11
Intelligent edge content caching: A deep recurrent reinforcement learning method
Xu, H., Sun, Y., Gao, J., & Guo, J. (2022) · Peer-to-Peer Networking and Applications · doi:10.1007/s12083-022-01369-6 · Cited by 12
Chou, P.-Y., Chen, W.-Y., Wang, C.-Y., Hwang, R., & Chen, W.-T. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3128741 · Cited by 13
Machine learning model evaluation for 360° video caching
Uddin, M. M., & Park, J. (2022) · IEEE World AI IoT Congress (AIIoT) · doi:10.1109/aiiot54504.2022.9817292 · Cited by 12
Bose, T., Chatur, N., Baberwal, S., & Adhya, A. (2024) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2024.3400510 · Cited by 12
Xiang, H., Yan, S., & Peng, M. (2019) · IEEE Vehicular Technology Conference · doi:10.1109/vtcfall.2019.8891508 · Cited by 10
Zhang, X., Cheng, H., Yu, Z., & Xiong, N. N. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3094507 · Cited by 10
Reinforcement Learning for Proactive Caching of Contents with Different Demand Probabilities
Somuyiwa, S. O., Gündüz, D., & György, A. (2018) · International Symposium on Wireless Communication Systems · doi:10.1109/iswcs.2018.8491205 · Cited by 10
Reinforcement Learning-Based Adaptive Bitrate Caching at MEC Server
Lekharu, A., Chauhan, A. P. S., Sur, A., & Patra, M. (2024) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2024.3367333 · Cited by 12
Reinforced multi-modal cyberbullying detection with subgraph neural networks
Luo, K., Zheng, C., & Guan, Z. (2024) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-024-02384-0 · Cited by 14
Duan, W., Li, X., Huang, Y., Cao, H., & Zhang, X. (2024) · Electronics · doi:10.3390/electronics13030663 · Cited by 9
A Learning-Based Caching Mechanism for Edge Content Delivery
Torabi, H., Khazaei, H., & Litoiu, M. (2024) · ACM/SPEC International Conference on Performance Engineering (ICPE) · doi:10.1145/3629526.3645037 · Cited by 14
A Deep Reinforcement Learning-Based Caching Strategy for Internet of Things
Nasehzadeh, A., & Wang, P. (2020) · IEEE/CIC International Conference on Communications in China (ICCC) · doi:10.1109/iccc49849.2020.9238811 · Cited by 11
Deep Multi‐Agent Reinforcement Learning for Cooperative Edge Caching
Gursoy, M. C., Zhong, C., & Velipasalar, S. (2019) · Wiley eBooks · doi:10.1002/9781119562306.ch21 · Cited by 10
Self-citationMaiti, R., Madhukumar, A. S., & Ernest, T. Z. H. (2026) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2026.3669379 · Cited by 15
Achieving Optimal Cache Utility in Constrained Wireless Networks through Federated Learning
Chilukuri, S., & Pesch, D. (2020) · IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM) · doi:10.1109/wowmom49955.2020.00053 · Cited by 12
Cheng, X., Gao, M., Gao, Q., & Peng, X. (2023) · ICT Express · doi:10.1016/j.icte.2023.01.005 · Cited by 8
Zhu, L., Li, B., & Tan, L. (2024) · Ad Hoc Networks · doi:10.1016/j.adhoc.2024.103643 · Cited by 10
Content Caching Policy for 5G Network Based on Asynchronous Advantage Actor-Critic Method
Shi, Z., Li, L., Xu, Y., Li, X., Chen, W., & Han, Z. (2019) · Globecom · doi:10.1109/globecom38437.2019.9014268 · Cited by 8
A Personalized Learning Scheme for Internet of Vehicles Caching
Oualil, S., Oucheikh, R., Kamili, M. E., & Berrada, I. (2021) · Globecom · doi:10.1109/globecom46510.2021.9685308 · Cited by 10
The interplay between artificial intelligence and fog radio access networks
Xia, W., Zhang, X., Zheng, G., Zhang, J., Jin, S., & Zhu, H. (2020) · China Communications · doi:10.23919/jcc.2020.08.001 · Cited by 9
SmartChoices: Hybridizing Programming and Machine LearningPreprint
Cărbune, V., Coppey, T., Daryin, A. N., Deselaers, T., Sarda, N., & Yagnik, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.00619 · Cited by 19
DRL-Based Collaborative Edge Content Replication with Popularity Distillation
Yan, H., Chen, Z., Wang, Z., et al. (2021) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme51207.2021.9428134 · Cited by 7
Meta-reinforcement learning for edge caching in vehicular networks
Sakr, H. M., & Elsabrouty, M. M. (2023) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-023-04583-z · Cited by 11
Dynamic Caching in Space Over Heterogeneous Mega-Constellations: A DRL-Guided Approach
Zhang, Y., Kishk, M. A., & Alouini, M. (2024) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2024.3427612 · Cited by 8
Artificial Intelligence Advancement for 6G Communication: A Visionary Approach
Miya, J., Raj, S., Ansari, M. A., Kumar, S. M., & Kumar, R. (2023) · Springer eBooks · doi:10.1007/978-3-031-30101-8_15 · Cited by 10
Impact of Prediction Uncertainty of Popularity Distribution on Proactive Caching
Cong, P., Qi, K., & Yang, C. (2019) · IEEE/CIC International Conference on Communications in China (ICCC) · doi:10.1109/iccchina.2019.8855954 · Cited by 11
Federated Deep Reinforcement Learning for Multimodal Content Caching in Edge-Cloud Networks
Feng, W., Zuo, X., Zhang, R., Zhu, Y., Wang, C., Guo, J., & Sun, C. (2025) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2025.3545924 · Cited by 11
Learning Automata based Cache Update Policy in Fog-enabled Vehicular Adhoc Networks
Rout, R. R., Obaidat, M. S., Vineeth Kumar, R., et al. (2022) · doi:10.1109/arace56528.2022.00025 · Cited by 6
Lim, J., Kim, D., & Yoo, Y. (2024) · IEEE Access · doi:10.1109/access.2024.3390429 · Cited by 6
A Smart Cache Content Update Policy Based on Deep Reinforcement Learning
Li, L., Kwong, C. F., Liu, Q., & Wang, J. (2020) · Wireless Communications and Mobile Computing · doi:10.1155/2020/8836592 · Cited by 6
Blockchain-Enabled Intelligent Video Caching and Transcoding in Clustered MEC Networks
Li, Y., & Wan, Z. (2021) · Security and Communication Networks · doi:10.1155/2021/7443260 · Cited by 8
Deep Deterministic Policy Gradient-Based Edge Caching: An Inherent Performance Tradeoff
Lei, M., Li, Q., Wu, R., Pandharipande, A., & Ge, X. (2021) · Globecom · doi:10.1109/globecom46510.2021.9685454 · Cited by 6
An Adaptive, Energy-Efficient DRL-Based and MCMC-Based Caching Strategy for IoT Systems
Karras, A., Karras, C., Karydis, I., Avlonitis, M., & Sioutas, S. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-49361-4_4 · Cited by 8
Smart Edge Caching-Aided Partial Opportunistic Interference Alignment in HetNets
Zheng, J., Gao, L. C., Wang, H., Niu, J., Ren, J., Guo, H., Yang, X., & Liu, Y. (2020) · Mobile Networks and Applications · doi:10.1007/s11036-020-01568-6 · Cited by 7
Content Caching Policy Based on GAN and Distributional Reinforcement Learning
Weng, H., Li, L., Cheng, Q., Chen, W., & Han, Z. (2020) · International Conference on Communications · doi:10.1109/icc40277.2020.9148620 · Cited by 6
Mobility Prediction-Based Wireless Edge Caching Using Deep Reinforcement Learning
Cai, Y., Chen, Y., Ding, M., Cheng, P., & Li, J. (2021) · IEEE/CIC International Conference on Communications in China (ICCC) · doi:10.1109/iccc52777.2021.9580283 · Cited by 6
Optimized D-RAN Aware Data Retrieval for 5G Information Centric Networks
Kottursamy, K., Khan, A. U. R., Sadayapillai, B., & Raja, G. (2021) · Wireless Personal Communications · doi:10.1007/s11277-021-09392-1 · Cited by 6
End-to-End Deep Learning Proactive Content Caching Framework
Bakr, E. M., Ben-Ammar, H., Eraqi, H. M., Aly, S. G., ElBatt, T., & Ghamri-Doudane, Y. M. (2022) · Globecom · doi:10.1109/globecom48099.2022.10001030 · Cited by 6
Content-centric Caching Using Deep Reinforcement Learning in Mobile Computing
Wang, C., Gai, K., Guo, J., Zhu, L., & Zhang, Z. (2019) · International Conference on High Performance Big Data and Intelligent Systems (HPBD&IS) · doi:10.1109/hpbdis.2019.8735483 · Cited by 6
Learning-based cooperative content caching and sharing for multi-layer vehicular networks
Shi, J., Ni, Y., Cai, L., & Du, Z. (2024) · High-Confidence Computing · doi:10.1016/j.hcc.2024.100277 · Cited by 5
Sridhar, S. K., & Amutharaj, J. (2021) · International Conference on Disruptive Technologies for Multi-Disciplinary Research and Applications (CENTCON) · doi:10.1109/centcon52345.2021.9688177 · Cited by 7
Zhang, X., Hu, Z., Zheng, M., Liang, Y., Xiao, H., Zheng, H., & Xu, A. (2023) · Applied Sciences · doi:10.3390/app13106115 · Cited by 5
An Incremental Learning Based Edge Caching System: From Modeling to Evaluation
Xu, G., Tang, B., Yuan, L., Xue, Y., Gao, Z., Mostafa, S., & Sung, C. W. (2020) · IEEE Access · doi:10.1109/access.2020.2965249 · Cited by 5
Predictive Caching for AR/VR Experiences in a Household Scenario
Zehtabian, S., Razghandi, M., Bölöni, L. L., & Turgut, D. (2020) · 2012 International Conference on Computing, Networking and Communications (ICNC) · doi:10.1109/icnc47757.2020.9049692 · Cited by 5
Trend-Aware Proactive Caching via Tensor Train Decomposition: A Bayesian Viewpoint
Mehrizi, S., Vu, T. X., Chatzinotas, S., & Ottersten, B. (2021) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2021.3075071 · Cited by 6
OPTIMIZATION OF SMART MOBILE DEVICE WORK TIME USING COMPOSITE OFFLOAD DECISION ALGORITHMIC APPROACH
Sridhar, S. K., Jeyabalan, S., & Amutharaj, J. (2021) · Indian Journal of Computer Science and Engineering · doi:10.21817/indjcse/2021/v12i4/211204119 · Cited by 4
A smart admission control and cache replacement approach in content delivery networks
Abdo, L., Ahmad, I., & Abed, S. (2023) · Cluster Computing · doi:10.1007/s10586-023-04095-7 · Cited by 4
Learning to Code: Coded Caching via Deep Reinforcement Learning
Naderializadeh, N., & Asghari, S. M. (2019) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf44664.2019.9048907 · Cited by 4
Effective Big Data Caching through Reinforcement Learning
Tracolli, M., Baioletti, M., Poggioni, V., et al. (2020) · IEEE International Conference on Machine Learning and Applications (ICMLA) · doi:10.1109/icmla51294.2020.00231 · Cited by 4
Streaming Machine Learning for Supporting Data Prefetching in Modern Data Storage Systems
Filho, E. R. L., Yang, L., Fu, K., et al. (2023) · doi:10.1145/3588982.3603608 · Cited by 4
Collaborative Edge Caching: a Meta Reinforcement Learning Approach with Edge Sampling
Mao, Y., He, B., Zhou, S., et al. (2023) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme55011.2023.00171 · Cited by 4
FiLiP: A File Lifecycle-based Profiler for hierarchical storage
Khelili, A., Robert, S., & Zertal, S. (2022) · Híradástechnika/Infocommunications journal · doi:10.36244/icj.2022.4.4 · Cited by 4
Smart Caching in a Data Lake for High Energy Physics Analysis
Tedeschi, T., Baioletti, M., Ciangottini, D., Poggioni, V., Spiga, D., Storchi, L., & Tracolli, M. (2023) · Journal of Grid Computing · doi:10.1007/s10723-023-09664-z · Cited by 7
Caching for Edge Inference at Scale: A Mean Field Multi-Agent Reinforcement Learning Approach
Lu, Y., Zhang, M., & Tang, M. (2023) · Globecom · doi:10.1109/globecom54140.2023.10436965 · Cited by 4
Liao, K.-M., Chen, G.-Y., & Chen, Y. (2019) · Asia-Pacific Network Operations and Management Symposium (APNOMS) · doi:10.23919/apnoms.2019.8893099 · Cited by 4
Lee, D., & Song, M. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3538916 · Cited by 3
SkyML: A MLaaS Federation Design for Multicloud-Based Multimedia Analytics
Xie, S., Xue, Y., Zhu, Y., & Wang, Z. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3521768 · Cited by 6
Federated Deep Reinforcement Learning for Aerial Content Caching in Multi-UAV Networks
Yuan, W., Xu, C., & Xie, X. (2024) · Globecom · doi:10.1109/globecom52923.2024.10900946 · Cited by 3
Sun, Y., & Peng, M. (2019) · IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC) · doi:10.1109/pimrc.2019.8904455 · Cited by 2
Khuntia, P., Hazra, R., & Chong, P. H. J. (2020) · International Journal of Communication Systems · doi:10.1002/dac.4315 · Cited by 3
Link-Level Throughput Maximization Using Deep Reinforcement Learning
Jamshidiha, S., Pourahmadi, V., Mohammadi, A., & Bennis, M. (2020) · IEEE Networking Letters · doi:10.1109/lnet.2020.3000334 · Cited by 3
Reinforcement Learning for Smart Caching at the CMS experiment
Tedeschi, T., Tracolli, M., Ciangottini, D., et al. (2021) · doi:10.22323/1.378.0009 · Cited by 3
Latency-aware content caching and cost-aware migration in SDN based on MEC
Li, C., Zhu, L., & Luo, Y. (2021) · Wireless Networks · doi:10.1007/s11276-021-02813-w · Cited by 3
Application of Machine Learning Algorithm in Cache Replacement Strategy
Wang, Y. (2021) · International Symposium on Parallel Architectures, Algorithms and Programming · doi:10.1109/paap54281.2021.9720449 · Cited by 3
Enhancing Location Privacy through P2P Network and Caching in Anonymizer
Liu, P., Xie, S., Shen, Z., & Wang, H. (2022) · KSII Transactions on Internet and Information Systems · doi:10.3837/tiis.2022.05.013 · Cited by 3
Liu, P., Yao, C., Li, C., Zhang, S., & Li, X. (2023) · Wireless Communications and Mobile Computing · doi:10.1155/2023/2852085 · Cited by 5
Intelligent Cooperative Caching at Mobile Edge based on Offline Deep Reinforcement Learning
Wang, Z., Hu, J. W., Min, G., & Zhao, Z. (2023) · ACM Transactions on Sensor Networks · doi:10.1145/3623398 · Cited by 3
Swarm Reinforcement Learning for Collaborative Content Caching in Information Centric Networks
Yang, J., Chen, L., Tang, J., Li, J., & Yang, W. (2023) · International Conference on Communications · doi:10.1109/icc45041.2023.10278917 · Cited by 5
UPR-AECS: An Active Edge Caching Strategy Integrating User Preference Representation
Wen, H., & Zhang, L. (2023) · IEEE International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/icpads60453.2023.00382 · Cited by 3
Caching Salon: From Classical to Learning-Based Approaches
Zhao, Y., Zhang, X., Yang, K., Fan, Q., Guo, D., Lyu, Y., Yin, H., & Ma, Z. (2019) · IEEE International Symposium on Service-Oriented System Engineering (SOSE) · doi:10.1109/sose.2019.00046 · Cited by 3
A New Cache Update Scheme Using Reinforcement Learning for Coded Video Streaming Systems
Kim, Y.-S., Lee, J.-M., Ryu, J.-Y., & Ban, T.-W. (2021) · Sensors · doi:10.3390/s21082867 · Cited by 4
IntellCache: An Intelligent Web Caching Scheme for Multimedia Contents
Niloy, N. T., & Islam, M. S. (2020) · International Conference on Informatics, Electronics & Vision (ICIEV) · doi:10.1109/icievicivpr48672.2020.9306604 · Cited by 4
Feedforward Neural Networks for Caching: Enough or Too Much?Preprint
Fedchenko, V., Neglia, G., & Ribeiro, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.06930 · Cited by 3
Proactive Optimization with Machine Learning: Femto-caching with Future Content PopularityPreprint
Wu, J., Sun, C., & Yang, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.13446 · Cited by 5
Filho, E. R. L., Savva, G., Yang, L., Fu, K., Shen, J., & Herodotou, H. (2025) · Future Internet · doi:10.3390/fi17040170 · Cited by 2
LACE: Mitigating cold-starts in serverless with a multi-task mixture-of-experts caching
Huang, C., Huang, Y., Feng, J., Liang, S., Yan, M., & Wu, J. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-00473-4 · Cited by 2
Reinforcement learning for caching with space-time popularity dynamics
Sadeghi, A., Giannakis, G. B., Wang, G., & Sheikholeslami, F. (2021) · Institution of Engineering and Technology eBooks · doi:10.1049/pbte096e_ch19 · Cited by 3
Predicting Reuse Interval for Optimized Web Caching: An LSTM-Based Machine Learning Approach
Li, P., Guo, Y., & Gu, Y. (2022) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1109/sc41404.2022.00091 · Cited by 9
STRCacheML: A Machine Learning-Assisted Content Caching Policy for Streaming Services
Mahara, A., Fuentes, J., Poellabauer, C., & Rishe, N. D. (2024) · International Conference on Artificial Intelligence and Big Data (AIBD) · doi:10.5121/csit.2024.140409 · Cited by 2
A Deep Learning Cache Framework for Privacy Security on Heterogeneous IoT Networks
Li, J. H., Feng, M., & Li, S. (2024) · IEEE Access · doi:10.1109/access.2024.3422487 · Cited by 2
Smart Data-Driven Proactive Push to Edge Network for User-Generated Videos
Ma, X., Li, Q., Peng, J., et al. (2024) · doi:10.1109/infocom52122.2024.10621410 · Cited by 2
A High Performance AI-Powered Cache Mechanism for IoT Devices
Dai, W., & Zhang, M. (2024) · International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC) · doi:10.1109/cyberc62439.2024.00022 · Cited by 2
Collaborative Content Caching in IIoT: A Multi-Agent Reinforcement Learning-Based Approach
Kang, B., Peng, K., & Chen, Y. (2024) · IEEE International Conference on Smart Internet of Things (SmartIoT) · doi:10.1109/smartiot62235.2024.00084 · Cited by 2
CALC: A Content-Aware Learning Cache for Storage Systems
Kachmar, M., & Kaeli, D. R. (2021) · IEEE International Conference on Networking, Architecture and Storage (NAS) · doi:10.1109/nas51552.2021.9605381 · Cited by 2
ARC-learning: A Self-tuning Cache Policy under Dynamic Popularity
Shen, Z. X., Jiang, B., Wang, X., et al. (2022) · IEEE International Conference on Computer and Communications (ICCC) · doi:10.1109/iccc56324.2022.10065823 · Cited by 2
Dynamic Edge Caching via Online Meta-RL
Mao, Y., Zhou, S., Liu, H., Wang, Z., & Zhu, W. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191608 · Cited by 2
Cost Efficient Intelligent Sensing Big Data Caching in ICN-IoT Networks
Yang, M., Deyun Gao, A., Hu, X., & Qin, Y. (2023) · International Conference on Communications · doi:10.1109/icc45041.2023.10278641 · Cited by 3
Caching Suggestions Using Reinforcement Learning
on behalf of the CMS Collaboration, Tracolli, M., Baioletti, M., et al. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-64583-0_57 · Cited by 2
Coded Caching for Time-Varying Files Popularities and Asynchronous Delivery
Amir, M., Bedeer, E. E., Ahmed, M. H., et al. (2021) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2021.3091636 · Cited by 2
Application of deep learning algorithms and architectures in the new generation of mobile networks
Dašić, D., Vučetić, M., Ilić, N., Stanković, M. S., & Beko, M. (2021) · Serbian Journal of Electrical Engineering · doi:10.2298/sjee2103397d · Cited by 2
A review of applications of supervised learning to future networks
Bilson, S., & Thompson, A. (2022) · doi:10.47120/npl.ms40 · Cited by 3
Miss-Triggered Content Cache Replacement Under Partial Observability: Transformer-Decoder Q-Learning
Kim, H. J., Sun, T.-J., & Huh, E. (2025) · Mathematics · doi:10.3390/math13193217 · Cited by 2
Lahande, P. V., Kaveri, P. R., & Saini, J. R. (2023) · Informatics · doi:10.3390/informatics10030064 · Cited by 3
Multi-Agent Deep-Q Network-Based Cache Replacement Policy for Content Delivery Networks
Dassanayake, J. K., Wang, M., Hameed, M. Z., & Yang, N. (2024) · Future Internet · doi:10.3390/fi16080292 · Cited by 1
Enhancing Edge Caching with User Preferences and Access Patterns in Wireless Networks
Wen, H., & Zhang, L. (2024) · IEEE International Symposium on Parallel and Distributed Processing with Applications (ISPA) · doi:10.1109/ispa63168.2024.00302 · Cited by 1
Meng, F., Chen, B., Xiu, Z., et al. (2024) · doi:10.1109/icftic64248.2024.10913366 · Cited by 1
Machine Learning for Predictive Database Caching Strategies: A state-of-the-art review
Afrin, S., Mahmud, M. A. A., Salam, A., Abdullah-Al-Jubair, M., & Mridha, M. F. (2024) · International Conference on Computing Advancements (ICCA) · doi:10.1145/3723178.3723250 · Cited by 3
Metadata
- Authors
- Zhong, C., Gursoy, M. C., & Velipasalar, S.
- Affiliations
- Syracuse University (US)
- Venue
- 2018 52nd Annual Conference on Information Sciences and Systems (CISS)
- Publisher
- IEEE
- Published
- 2018-03
- Pages
- 1-6
- OpenAlex
- W2963805280
- Semantic Scholar
- 62e318b1ca1dc63924a70e5372bf39d39ad78727
- Cited by
- 231
- References
- 15
- Citations by year
- 2026: 6 · 2025: 11 · 2024: 27 · 2023: 29 · 2022: 37 · 2021: 44 · 2020: 39 · 2019: 29 · 2018: 9
- FWCI
- 25.00
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Conference on Information Sciences and Systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Caching and Content Delivery
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Computer Networks and Communications › Age of Information Optimization
- Keywords
- content caching, edge computing, deep reinforcement learning, cache hit rate, base station caching, action space reduction, deep Q-network, LRU, LFU, FIFO, wireless networks, data traffic reduction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.