A deep reinforcement learning-based framework for content caching
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Content caching at the edge nodes is a promising technique to reduce the data traffic in next-generation wireless networks. Inspired by the success of Deep Reinforcement Learning (DRL) in solving complicated control problems, this work presents a DRL-based framework with Wolpertinger architecture for content caching at the base station. The proposed framework is aimed at maximizing the long-term cache hit rate, and it requires no knowledge of the content popularity distribution. To evaluate the proposed framework, we compare the performance with other caching algorithms, including Least Recently Used (LRU), Least Frequently Used (LFU), and First-In First-Out (FIFO) caching strategies. Meanwhile, since the Wolpertinger architecture can effectively limit the action space size, we also compare the performance with Deep Q-Network to identify the impact of dropping a portion of the actions. Our results show that the proposed framework can achieve improved short-term cache hit rate and improved and stable long-term cache hit rate in comparison with LRU, LFU, and FIFO schemes. Additionally, the performance is shown to be competitive in comparison to Deep Q-learning, while the proposed framework can provide significant savings in runtime.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As illustrated in [233] [234], the complexity of optimization algorithms can be transferred to the training of DNNs, and thus breaking the practical limitation of employing them.”
From Convergence of Edge Computing and Deep Learning: A Comprehensive Survey (2020) · cites this paper as [234]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Compared DQL-based algorithms searching the whole action space, the trained DRL agent with DDPG and Wolpertinger architecture is able to achieve competitive cache hit rates while reducing the runtime.”
From Convergence of Edge Computing and Deep Learning: A Comprehensive Survey (2020) · cites this paper as [241]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
High performance cache replacement using re-reference interval prediction (RRIP)
Jaleel, A., Theobald, K. B., Steely, S. C., & Emer, J. (2010) · Proceedings of the 37th annual international symposium on Computer architecture · doi:10.1145/1815961.1815971 · Cited by 641
Learning-based optimization of cache content in a small cell base station
Blasco, P., & Gunduz, D. (2014) · 2014 IEEE International Conference on Communications (ICC) · doi:10.1109/icc.2014.6883600 · Cited by 298
Reinforcement Learning in Large Discrete Action Spaces.Preprint
Dulac-Arnold, G., Evans, R., Sunehag, P., & Coppin, B. (2015) · arXiv (Cornell University) · Cited by 292
Caching performance of content centric networks under multi-path routing (and more)
Rossi, D., & Rossini, G. (2011) · HAL (Le Centre pour la Communication Scientifique Directe) · Cited by 291
Deep Reinforcement Learning in Large Discrete Action Spaces
Dulac-Arnold, G., Evans, R., van Hasselt, H., Sunehag, P., Lillicrap, T., Hunt, J., Mann, T., Weber, T., Degris, T., & Coppin, B. (2015) · arXiv · doi:10.48550/arxiv.1512.07679 · Cited by 290
High performance cache replacement using re-reference interval prediction (RRIP)
Jaleel, A., Theobald, K. B., Steely, S. C., & Emer, J. (2010) · ACM SIGARCH Computer Architecture News · doi:10.1145/1816038.1815971 · Cited by 264
Popularity-driven content caching
Li, S., Xu, J., van der Schaar, M., & Li, W. (2016) · IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications · doi:10.1109/infocom.2016.7524381 · Cited by 158
Placing dynamic content in caches with small population
Leconte, M., Paschos, G., Gkatzikis, L., Draief, M., Vassilaras, S., & Chouvardas, S. (2016) · IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications · doi:10.1109/infocom.2016.7524380 · Cited by 151
Learning Based Content Caching and Sharing for Wireless Networks
Song, J., Sheng, M., Quek, T. Q. S., Xu, C., & Wang, X. (2017) · IEEE Transactions on Communications · doi:10.1109/tcomm.2017.2713384 · Cited by 144
Cited by
Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
Luong, N. C., Hoang, D. T., Gong, S., Niyato, D., Wang, P., Liang, Y.-C., & Kim, D. I. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2916583 · Cited by 2,060
Deep Learning With Edge Computing: A Review
Chen, J., & Ran, X. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2921977 · Cited by 1,540
Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498
“[192] DRL DDPG Maximize the long-term cache hit rate”
BackgroundMethodApplication of Machine Learning in Wireless Networks: Key Techniques and Open Issues
Sun, Y., Peng, M., Zhou, Y., Huang, Y., & Mao, S. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2924243 · Cited by 678
Quantum Machine Learning for 6G Communication Networks: State-of-the-Art and Vision for the Future
Nawaz, S. J., Sharma, S. K., Wyne, S., Patwary, M. N., & Asaduzzaman, M. (2019) · IEEE Access · doi:10.1109/access.2019.2909490 · Cited by 658
Deep Reinforcement Learning for Mobile 5G and Beyond: Fundamentals, Applications, and Challenges
Xiong, Z., Zhang, Y., Niyato, D., Deng, R., Wang, P., & Wang, L.-C. (2019) · IEEE Vehicular Technology Magazine · doi:10.1109/mvt.2019.2903655 · Cited by 285
A Gentle Introduction to Reinforcement Learning and its Application in Different Fields
Naeem, M., Rizvi, S. T. H., & Coronato, A. (2020) · IEEE Access · doi:10.1109/access.2020.3038605 · Cited by 257
Applications of Multi-Agent Reinforcement Learning in Future Internet: A Comprehensive Survey
Li, T., Zhu, K., Luong, N. C., Niyato, D., Wu, Q., Zhang, Y., & Chen, B. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3160697 · Cited by 251
Sun, Y., Peng, M., & Mao, S. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2871020 · Cited by 219
Distributed Deep Learning-based Offloading for Mobile Edge Computing Networks
Huang, L., Feng, X., Feng, A., Huang, Y., & Qian, L. P. (2022) · Mobile Networks and Applications · doi:10.1007/s11036-018-1177-x · Cited by 181
Zahmatkesh, H., & Al-Turjman, F. (2020) · Sustainable Cities and Society · doi:10.1016/j.scs.2020.102139 · Cited by 169
Deep Reinforcement Learning-Based Edge Caching in Wireless Networks
Zhong, C., Gursoy, M. C., & Velipasalar, S. (2020) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2020.2968326 · Cited by 159
Self-citationEnabling AI in Future Wireless Networks: A Data Life Cycle Perspective
Nguyen, D. C., Cheng, P., Ding, M., Lopez-Perez, D., Pathirana, P. N., Li, J., Seneviratne, A., Li, Y., & Poor, H. V. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3024783 · Cited by 160
Shuja, J., Bilal, K., Alasmary, W., Sinky, H., & Alanazi, E. (2021) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2021.103005 · Cited by 176
Intelligent Video Caching at Network Edge: A Multi-Agent Deep Reinforcement Learning Approach
Wang, F., Wang, F., Liu, J., Shea, R., & Sun, L. (2020) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom41043.2020.9155373 · Cited by 153
Drones’ Edge Intelligence Over Smart Environments in B5G: Blockchain and Federated Learning Synergy
Alsamhi, S. H., Almalki, F. A., Afghah, F., Hawbani, A., Shvetsov, A. V., Lee, B., & Song, H. (2022) · IEEE Transactions on Green Communications and Networking · doi:10.1109/tgcn.2021.3132561 · Cited by 139
Deep Reinforcement Learning for Adaptive Caching in Hierarchical Content Delivery Networks
Sadeghi, A., Wang, G., & Giannakis, G. B. (2019) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2019.2936193 · Cited by 143
Deep Reinforcement Learning Approaches for Content Caching in Cache-Enabled D2D Networks
Li, L., Xu, Y., Yin, J., Liang, W. J., Li, X., Chen, W., & Han, Z. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2951509 · Cited by 124
UAVs as an Intelligent Service: Boosting Edge Intelligence for Air-Ground Integrated Networks
Dong, C., Shen, Y. C., Qu, Y., Wang, K., Zheng, J., Wu, Q., & Wu, F. (2021) · IEEE Network · doi:10.1109/mnet.011.2000651 · Cited by 116
Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Survey
Majid, A. Y., Saaybi, S., van Rietbergen, T., François-Lavet, V., Prasad, R. R. V., & Verhoeven, C. J. M. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3264540 · Cited by 143
Enabling technologies for AI empowered 6G massive radio access networks
Shahjalal, M. A., Kim, W., Khalid, W., Moon, S., Khan, M. A., Liu, S., Lim, S., Kim, E., Yun, D.-W., Lee, J., et al. (2022) · ICT Express · doi:10.1016/j.icte.2022.07.002 · Cited by 99
Li, C., Zhang, Y., Gao, X., & Luo, Y. (2022) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2022.03.001 · Cited by 87
Dynamic Content Update for Wireless Edge Caching via Deep Reinforcement Learning
Wu, P., Li, J., Shi, L. X., Ding, M., Cai, K., & Yang, F. (2019) · IEEE Communications Letters · doi:10.1109/lcomm.2019.2931688 · Cited by 79
PSAC: Proactive Sequence-Aware Content Caching via Deep Learning at the Network Edge
Zhang⋆, Y., Li, Y., Wang, R., Lu, J., Ma, X., & Qiu, M. (2020) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2020.2990963 · Cited by 73
Cooperative Edge Caching: A Multi-Agent Deep Learning Based Approach
Zhang, Y., Feng, B., Quan, W., Tian, A., Sood, K., Lin, Y., & Zhang, H. (2020) · IEEE Access · doi:10.1109/access.2020.3010329 · Cited by 75
Towards Lightweight and Robust Machine Learning for CDN Caching
Berger, D. S. (2018) · ACM Workshop on Hot Topics in Networks (HotNets) · doi:10.1145/3286062.3286082 · Cited by 76
Deep Learning for Wireless Coded Caching With Unknown and Time-Variant Content Popularity
Zhang, Z., & Tao, M. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3030973 · Cited by 73
Artificial Intelligence for Wireless Caching: Schemes, Performance, and Challenges
Sheraz, M., Ahmed, M., Hou, X., Li, Y., Jin, D., Han, Z., & Jiang, T. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3008362 · Cited by 68
A Survey on Reinforcement Learning-Aided Caching in Heterogeneous Mobile Edge Networks
Νομικός, Ν., Zoupanos, S., Charalambous, T., & Krikidis, I. (2022) · IEEE Access · doi:10.1109/access.2022.3140719 · Cited by 69
Learning Automata Based Q-Learning for Content Placement in Cooperative Caching
Yang, Z., Liu, Y., Chen, Y., & Jiao, L. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2020.2982136 · Cited by 61
Collaborative Multi-Agent Multi-Armed Bandit Learning for Small-Cell Caching
Xu, X., Tao, M., & Shen, C. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.2966599 · Cited by 64
Viewport-Aware Deep Reinforcement Learning Approach for 360$^\circ$ Video Caching
Maniotis, P., & Thomos, N. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3052339 · Cited by 66
PA-Cache: Evolving Learning-Based Popularity- Aware Content Caching in Edge Networks
Fan, Q., Li, X., Li, J., He, Q., Wang, K., & Wen, J. (2021) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2021.3053645 · Cited by 68
TinyML Algorithms for Big Data Management in Large-Scale IoT Systems
Karras, A., Γιάνναρος, Α., Karras, C., Theodorakopoulos, L., Mammassis, C. S., Krimpas, G. A., & Sioutas, S. (2024) · Future Internet · doi:10.3390/fi16020042 · Cited by 83
Cooperative Edge Caching Based on Temporal Convolutional Networks
Zhang, X., Qi, Z., Min, G., Miao, W., Fan, Q., & Ma, Z. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2021.3135257 · Cited by 57
Deep Multi-Agent Reinforcement Learning Based Cooperative Edge Caching in Wireless Networks
Zhong, C., Gursoy, M. C., & Velipasalar, S. (2019) · International Conference on Communications · doi:10.1109/icc.2019.8762084 · Cited by 53
Self-citationAraf, S., Saha, A. S., Kazi, S. H., Tran, N. H. K., & Alam, M. G. R. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3209079 · Cited by 58
Qiu, Y. Y., Niu, J., Zhu, X., Zhu, K., Yao, Y., Ren, B., & Ren, T. (2022) · Journal of Sensor and Actuator Networks · doi:10.3390/jsan11040057 · Cited by 65
A Game-Theoretic Approach to Cache and Radio Resource Management in Fog Radio Access Networks
Sun, Y., Peng, M., & Mao, S. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2935098 · Cited by 51
Cocktail Edge Caching: Ride Dynamic Trends of Content Popularity With Ensemble Learning
Zong, T., Li, C., Lei, Y., Li, G., Cao, H., & Liu, Y. (2022) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2022.3193680 · Cited by 55
DQN-enabled content caching and quantum ant colony-based computation offloading in MEC
Li, C., Zhang, Y., & Luo, Y. (2022) · Applied Soft Computing · doi:10.1016/j.asoc.2022.109900 · Cited by 44
A Survey of Deep Learning for Data Caching in Edge Network
Wang, Y., & Friderikos, V. (2020) · Informatics · doi:10.3390/informatics7040043 · Cited by 45
Enabling AI in future wireless networks: a data life cycle perspective
Nguyen, D. C., Cheng, P., Ding, M., López‐Pérez, D., Pathirana, P. N., Li, J., Seneviratne, A. P., Li, Y., & Poor, H. V. (2024) · Figshare · Cited by 36
Deep Reinforcement Learning for Cooperative Edge Caching in Future Mobile Networks
Ding, L., Han, Y., Wang, C., Shi, G., Wang, X., Li, X., & Leung, V. C. M. (2019) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc.2019.8885516 · Cited by 33
Deep Reinforcement Learning for Network Selection Over Heterogeneous Health Systems
Chkirbene, Z., Abdellatif, A. A., Mohamed, A. M. S., Erbad, A., & Guizani, M. (2021) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2021.3058037 · Cited by 40
Guo, X., Xue, X., Yan, F., et al. (2021) · Journal of Optical Communications and Networking · doi:10.1364/jocn.438950 · Cited by 33
A Generalization Performance Study Using Deep Learning Networks in Embedded Systems
Gorospe, J., Mulero, R., Arbelaitz, O., Muguerza, J., & Antón, M. Á. (2021) · Sensors · doi:10.3390/s21041031 · Cited by 32
Guo, B., Zhang, X., Sheng, Q., & Yang, H. (2020) · IEEE Access · doi:10.1109/access.2020.2964258 · Cited by 30
SPICE-IT: Smart COVID-19 pandemic controlled eradication over NDN-IoT
Khan, M. T. R., Saad, M. M., Tariq, M. A., Akram, J., & Kim, D. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.03.005 · Cited by 32
A Deep Reinforcement Learning-Based Caching Strategy for IoT Networks With Transient Data
Wu, H., Nasehzadeh, A., & Wang, P. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3199677 · Cited by 36
AI/ML for beyond 5G systems: Concepts, technology enablers & solutions
Taleb, T., Benzaïd, C., Addad, R. A., & Samdanis, K. (2023) · Computer Networks · doi:10.1016/j.comnet.2023.110044 · Cited by 46
Shrisha, H. S., & Boregowda, U. (2022) · Results in Engineering · doi:10.1016/j.rineng.2022.100345 · Cited by 30
Urban Intelligence With Deep Edges
White, G., & Clarke, S. (2020) · IEEE Access · doi:10.1109/access.2020.2963912 · Cited by 35
Feedforward Neural Networks for Caching
Fedchenko, V., Neglia, G., & Ribeiro, B. (2019) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/3308897.3308958 · Cited by 31
Agile Cache Replacement in Edge Computing via Offline-Online Deep Reinforcement Learning
Wang, Z., Hu, J. W., Min, G., Zhao, Z., & Wang, Z. (2024) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2024.3368763 · Cited by 27
Malektaji, S., Ebrahimzadeh, A., Elbiaze, H., Glitho, R., & Kianpisheh, S. (2021) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2021.3086721 · Cited by 31
MagNet: Cooperative Edge Caching by Automatic Content Congregating
Peng, J., Li, Q., Ma, X., Jiang, Y., Dong, Y., Hu, C., & Chen, M. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3512146 · Cited by 30
Information fusion on delivery: A survey on the roles of mobile edge caching systems
Nguyen, T.-V., Tran, A.-T., Dao, N., Moon, H., & Cho, S. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.08.029 · Cited by 30
Towards Real-Time Video Caching at Edge Servers: A Cost-Aware Deep Q-Learning Solution
Cui, L., Ni, E., Zhou, Y., Wang, Z., Zhang, L., Liu, J., & Xu, Y. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3125803 · Cited by 28
Caching in Dynamic Environments: A Near-Optimal Online Learning Approach
Zhou, S., Wang, Z., Hu, C., Mao, Y., Yan, H., Zhang, S., Wu, C., & Zhu, W. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3132156 · Cited by 28
Knowledge-defined networking: Applications, challenges and future work
Ashtari, S., Zhou, I., Abolhasan, M., Shariati, N., Lipman, J., & Ni, W. (2022) · Array · doi:10.1016/j.array.2022.100136 · Cited by 37
Wang, K., Deng, N., & Li, X. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3176360 · Cited by 29
Zhou, X., Liu, Z., Guo, M., Zhao, J., & Wang, J. (2021) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2021.3115793 · Cited by 26
Reinforcement Learning for Intelligent Healthcare Systems: A Comprehensive SurveyPreprint
Abdellatif, A. A., Mhaisen, N., Chkirbene, Z., Mohamed, A. M. S., Erbad, A., & Guizani, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.04087 · Cited by 44
MADRL-Based Joint Edge Caching and Bitrate Selection for Multicategory 360° Video Streaming
Zeng, J., Zhou, X., & Li, K. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3287187 · Cited by 27
AutoCache: Employing Machine Learning to Automate Caching in Distributed File Systems
Herodotou, H. (2019) · IEEE International Conference on Data Engineering Workshops (ICDEW) · doi:10.1109/icdew.2019.00-21 · Cited by 27
LSTM for Mobility Based Content Popularity Prediction in Wireless Caching Networks
Mou, H., Liu, Y., & Wang, L. (2019) · IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/gcwkshps45667.2019.9024419 · Cited by 22
SiloD: A Co-design of Caching and Scheduling for Deep Learning Clusters
Zhao, H., Han, Z., Yang, Z. C., Zhang, Q., Li, M., Yang, F., Zhang, Q., Li, B., Yang, Y., Qiu, L., et al. (2023) · European Conference on Computer Systems · doi:10.1145/3552326.3567499 · Cited by 37
Deep Reinforcement Learning for MEC Streaming with Joint User Association and Resource Management
Chou, P.-Y., Chen, W.-Y., Wang, C.-Y., Hwang, R., & Chen, W.-T. (2020) · International Conference on Communications · doi:10.1109/icc40277.2020.9149086 · Cited by 22
A Survey on Requirements of Future Intelligent Networks: Solutions and Future Research Directions
Husen, A., Chaudary, M. H., & Ahmad, F. (2022) · ACM Computing Surveys · doi:10.1145/3524106 · Cited by 26
Learning paradigms for communication and computing technologies in IoT systems
Ejaz, W., Basharat, M., Saadat, S., Khattak, A. M., Naeem, M., & Anpalagan, A. (2020) · Computer Communications · doi:10.1016/j.comcom.2020.01.043 · Cited by 22
Decentralized Multi-Agent Multi-Armed Bandit Learning With Calibration for Multi-Cell Caching
Xu, X., & Tao, M. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2020.3045050 · Cited by 21
Learning from optimal caching for content delivery
Yan, G., Li, J., & Towsley, D. (2021) · ACM International Conference on emerging Networking EXperiments and Technologies (CoNEXT) · doi:10.1145/3485983.3494855 · Cited by 20
Radenkovic, M., & Huynh, V. S. H. (2020) · IEEE Access · doi:10.1109/access.2020.3027707 · Cited by 37
Multi-Agent Deep Reinforcement Learning for content caching within the Internet of Vehicles
Knari, A., Derfouf, M., Koulali, M.-A., & Khoumsi, A. (2023) · Ad Hoc Networks · doi:10.1016/j.adhoc.2023.103305 · Cited by 24
Caching by User Preference With Delayed Feedback for Heterogeneous Cellular Networks
Huang, Z., Hu, B., & Pan, J. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3035377 · Cited by 19
Ye, C., Cui, Y., Yang, Y., & Wang, R. (2019) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2919724 · Cited by 20
Learning a Hybrid Proactive and Reactive Caching Policy in Wireless Edge Under Dynamic Popularity
Qi, K., Han, S., & Yang, C. (2019) · IEEE Access · doi:10.1109/access.2019.2936866 · Cited by 22
Yin, J., Li, L., Xu, Y., Liang, W. J., Zhang, H., & Han, Z. (2018) · IEEE Global Conference on Signal and Information Processing · doi:10.1109/globalsip.2018.8646427 · Cited by 18
DCoL: Distributed Collaborative Learning for Proactive Content Caching at Edge Networks
Khanal, S., Thar, K., & Huh, E. (2021) · IEEE Access · doi:10.1109/access.2021.3080512 · Cited by 20
A Deep Reinforcement Learning-based Task Scheduling Algorithm for Energy Efficiency in Data Centers
Song, P., Chi, C., Ji, K., Liu, Z., Zhang, F., Zhang, S., Qiu, D., & Wan, X. (2021) · International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn52240.2021.9522309 · Cited by 20
Ashraf, M. W. A., Raza, A., Singh, A. R., Rathore, R. S., Damaj, I., & Song, H. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3445640 · Cited by 26
Cocktail Edge Caching: Ride Dynamic Trends of Content Popularity with Ensemble Learning
Zong, T., Li, C., Lei, Y., Li, G., Cao, H., & Liu, Y. (2021) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom42981.2021.9488910 · Cited by 19
Krishnan, N. N., Torkildson, E. G., Mandayam, N. B., Raychaudhuri, D., Rantala, E.-H., & Doppler, K. (2019) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2019.2942917 · Cited by 20
Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
Luong, N. C., Hoang, D. T., Gong, S., Niyato, D., Wang, P., Liang, Y.-C., & Kim, D. I. (2018) · arXiv · doi:10.48550/arxiv.1810.07862 · Cited by 17
Wan, Z., & Li, Y. (2020) · Wireless Communications and Mobile Computing · doi:10.1155/2020/6684293 · Cited by 17
CoLEAP: Cooperative Learning-Based Edge Scheme With Caching and Prefetching for DASH Video Delivery
Shi, W., Wang, C., Jiang, Y., Li, Q., Shen, G., & Muntean, G. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3029893 · Cited by 17
Cost Effective MLaaS Federation: A Combinatorial Reinforcement Learning Approach
Xie, S., Xue, Y., Zhu, Y., & Wang, Z. (2022) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom48880.2022.9796701 · Cited by 19
Joint Cache Size Scaling and Replacement Adaptation for Small Content Providers
Ye, J., Li, Z., Wang, Z., Zheng, Z., Hu, H., & Zhu, W. (2021) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom42981.2021.9488694 · Cited by 16
Deep Reinforcement Learning Based Coded Caching Scheme in Fog Radio Access Networks
Zhou, Y., Peng, M., Yan, S., et al. (2018) · IEEE/CIC International Conference on Communications in China (ICCC) · doi:10.1109/iccchinaw.2018.8674478 · Cited by 15
LEAP: learning-based smart edge with caching and prefetching for adaptive video streaming
Shi, W., Li, Q., Wang, C., Shen, G., Li, W., Wu, Y., & Jiang, Y. (2019) · International Workshop on Quality of Service · doi:10.1145/3326285.3329051 · Cited by 21
Raven: belady-guided, predictive (deep) learning for in-memory and content caching
Hu, X., Ramadan, E., Ye, W., Tian, F., & Zhang, Z.-L. (2022) · ACM International Conference on emerging Networking EXperiments and Technologies (CoNEXT) · doi:10.1145/3555050.3569134 · Cited by 21
A Cooperative Caching System in Heterogeneous Edge Networks
Peng, J., Li, Q., Tang, X., Zhao, D., Hu, C., & Jiang, Y. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3336955 · Cited by 15
OA-Cache: Oracle Approximation-Based Cache Replacement at the Network Edge
Qiu, S., Fan, Q., Li, X., et al. (2023) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2023.3239664 · Cited by 14
Caching User-Generated Content in Distributed Autonomous Networks via Contextual Bandit
Chen, D., Xu, W., Wang, H., Qi, Y., Li, R., Zhou, P., & Guo, S. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3349849 · Cited by 13
Learning-based Fuzzy Bitrate Matching at the Edge for Adaptive Video Streaming
Shi, W., Li, Q., Wang, C., Zou, L., Shen, G., Zhang, P., & Jiang, Y. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3511944 · Cited by 13
Route-Based Proactive Content Caching Using Self-Attention in Hierarchical Federated Learning
Khanal, S., Thar, K., & Huh, E. (2022) · IEEE Access · doi:10.1109/access.2022.3157637 · Cited by 18
Predictive edge caching through deep mining of sequential patterns in user content retrievals
Li, C., Wang, X., Zong, T., Cao, H., & Liu, Y. (2023) · Computer Networks · doi:10.1016/j.comnet.2023.109866 · Cited by 13
Adaptive Compression for Online Computer Vision: An Edge Reinforcement Learning Approach
He, Z., Li, H., Wang, Z., Xia, S., & Zhu, W. (2021) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3447878 · Cited by 14
Wang, Y., Deng, K., Ren, Y., Chan, J., Tian, G., & Jensen, C. S. (2024) · IEEE Access · doi:10.1109/access.2024.3468377 · Cited by 21
Metadata
- Authors
- Zhong, C., Gursoy, M. C., & Velipasalar, S.
- Affiliations
- Syracuse University (US)
- Venue
- 2018 52nd Annual Conference on Information Sciences and Systems (CISS)
- Publisher
- IEEE
- Published
- 2018-03
- Pages
- 1-6
- OpenAlex
- W2963805280
- Semantic Scholar
- 62e318b1ca1dc63924a70e5372bf39d39ad78727
- Cited by
- 231
- References
- 15
- Citations by year
- 2026: 6 · 2025: 11 · 2024: 27 · 2023: 29 · 2022: 37 · 2021: 44 · 2020: 39 · 2019: 29 · 2018: 9
- FWCI
- 25.00
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Conference on Information Sciences and Systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Caching and Content Delivery
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Computer Networks and Communications › Age of Information Optimization
- Keywords
- content caching, edge computing, deep reinforcement learning, cache hit rate, base station caching, action space reduction, deep Q-network, LRU, LFU, FIFO, wireless networks, data traffic reduction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.