The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Optimal and Scalable Caching for 5G Using Reinforcement Learning of Space-Time Popularities
Open accessAbstract
Small basestations (SBs) equipped with caching units have potential to handle the unprecedented demand growth in heterogeneous networks. Through low-rate, backhaul connections with the backbone, SBs can prefetch popular files during off-peak traffic hours, and service them to the edge at peak periods. To intelligently prefetch, each SB must learn what and when to cache, while taking into account SB memory limitations, the massive number of available contents, the unknown popularity profiles, as well as the space-time popularity dynamics of user file requests. In this paper, local and global Markov processes model user requests, and a reinforcement learning (RL) framework is put forth for finding the optimal caching policy when the transition probabilities involved are unknown. Joint consideration of global and local popularity demands along with cache-refreshing costs allow for a simple, yet practical asynchronous caching approach. The novel RL-based caching relies on a Q-learning algorithm to implement the optimal policy in an online fashion, thus, enabling the cache control unit at the SB to learn, track, and possibly adapt to the underlying dynamics. To endow the algorithm with scalability, a linear function approximation of the proposed Q-learning scheme is introduced, offering faster convergence as well as reduced complexity and memory requirements. Numerical tests corroborate the merits of the proposed approach in various realistic settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“But [7] is based on Q-Learning, which is not feasible for the practical MEC system where the stateaction space is tremendous”
From In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning (2019) · cites this paper as [7]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
Artificial intelligence: a modern approach
Kumar, D. A., Balasubramanian, S., Byeon, D. H., & Manerkar, P. G. V. (1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 22,191
Watkins, C., & Dayan, P. (1992) · Machine-mediated learning · doi:10.1023/a:1022676722315 · Cited by 14,277
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Artificial intelligence: A modern approach
Nilsson, N. J. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(96)00007-0 · Cited by 10,730
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Reinforcement Learning: An Introduction
Johnson, J. D., Li, J., & Chen, Z. (2000) · Neurocomputing · doi:10.1016/s0925-2312(00)00324-6 · Cited by 8,825
Andrews, J. G., Buzzi, S., Choi, W., Hanly, S. V., Lozano, A., Soong, A. C. K., & Zhang, J. C. (2014) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2014.2328098 · Cited by 8,106
Web caching and Zipf-like distributions: evidence and implications
Breslau, L., Cao, P., Fan, L., Phillips, G., & Shenker, S. J. (1999) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infcom.1999.749260 · Cited by 3,485
Device-to-device communication as an underlay to LTE-advanced networks
Doppler, K., Rinne, M., Wijting, C., Ribeiro, C. B., & Hugl, K. (2009) · IEEE Communications Magazine · doi:10.1109/mcom.2009.5350367 · Cited by 1,904
Flagged first, then by citations
Research works printed but not linked: 1
- lillicrap, 2016, Proc Int Conf Learn Representations
Cited by
Sorted by citations
Items 101–200 of 255
Cocktail Edge Caching: Ride Dynamic Trends of Content Popularity with Ensemble Learning
Zong, T., Li, C., Lei, Y., Li, G., Cao, H., & Liu, Y. (2021) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom42981.2021.9488910 · Cited by 17
Autonomous Cache Resource Slicing and Content Placement at Virtualized Mobile Edge Network
Sun, G., Al-Ward, H., Boateng, G. O., & Liu, G. (2019) · IEEE Access · doi:10.1109/access.2019.2923021 · Cited by 17
Deep learning-based edge caching for multi-cluster heterogeneous networks
Yang, J., Zhang, J., Ma, C., Wang, H., Zhang, J., & Zheng, G. (2020) · Neural Computing and Applications · doi:10.1007/s00521-019-04040-z · Cited by 16
Machine Learning for Multimedia Communications
Thomos, N., Maugey, T., & Toni, L. (2022) · Sensors · doi:10.3390/s22030819 · Cited by 19
Mean-Field Game Theory Based Optimal Caching Control in Mobile Edge Computing
Feng, H., Guo, S., Liu, D., & Yang, Y. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3193764 · Cited by 15
A Feature-Based Bayesian Method for Content Popularity Prediction in Edge-Caching Networks
Mehrizi, S., Tsakmalis, A., Chatzinotas, S., & Ottersten, B. (2019) · Open Repository and Bibliography (University of Luxembourg) · Cited by 15
Hu, X., Ramadan, E., Ye, W., Tian, F., & Zhang, Z.-L. (2022) · ACM International Conference on emerging Networking EXperiments and Technologies (CoNEXT) · doi:10.1145/3555050.3569134 · Cited by 14
Optimal Dynamic Proactive Caching Via Reinforcement Learning
Sadeghi, A., Sheikholeslami, F., & Giannakis, G. B. (2018) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc.2018.8445899 · Cited by 14
Self-citationElastic FemtoCaching: Scale, Cache, and Route
Kwak, J., Paschos, G. S., & Iosifidis, G. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3056503 · Cited by 14
Zhang, X., Zheng, G., Lambotharan, S., Nakhai, M. R., & Wong, K. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2020.2977895 · Cited by 14
Cooperative content delivery in UAV-RSU assisted vehicular networks
Al-Hilo, A., Samir, M., Assi, C. M., Sharafeddine, S., & Ebrahimi, D. (2020) · ACM MobiCom Workshop on Drone Assisted Wireless Communications for 5G and Beyond (DroneCom) · doi:10.1145/3414045.3415947 · Cited by 16
Online Caching With no Regret: Optimistic Learning via Recommendations
Mhaisen, N., Iosifidis, G., & Leith, D. J. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3317943 · Cited by 13
Optimistic No-regret Algorithms for Discrete Caching
Mhaisen, N., Sinha, A., Paschos, G. S., & Iosifidis, G. (2022) · Proceedings of the ACM on Measurement and Analysis of Computing Systems · doi:10.1145/3570608 · Cited by 13
Energy and Latency Efficient Caching in Mobile Edge Networks: Survey, Solutions, and Challenges
Mohammed, L. B., Anpalagan, A., & Jaseemuddin, M. (2023) · Wireless Personal Communications · doi:10.1007/s11277-023-10187-9 · Cited by 13
Caching With Finite Buffer and Request Delay Information: A Markov Decision Process Approach
Hui, H., Chen, W., & Wang, L. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.2989513 · Cited by 12
Content Placement Learning for Success Probability Maximization in Wireless Edge Caching Networks
Garg, N., Sellathurai, M., & Ratnarajah, T. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682841 · Cited by 12
Hit Ratio and Latency Optimization for Caching Systems: A Survey
Tran, A.-T., Lakew, D. S., Nguyen, T. V., Tuong, V. D., Truong, T. P., Dao, N., & Cho, S. (2021) · International Conference on Information Networking · doi:10.1109/icoin50884.2021.9334019 · Cited by 12
An Optimal Peak Hour Content Server Cache Update Scheduling Algorithm for 5G HetNets
Ma, M., & Wong, V. W. S. (2019) · International Conference on Communications · doi:10.1109/icc.2019.8761705 · Cited by 12
Online Reinforcement Learning of X-Haul Content Delivery Mode in Fog Radio Access Networks
Moon, J., Simeone, O., Park, S.-H., & Lee, I. (2019) · IEEE Signal Processing Letters · doi:10.1109/lsp.2019.2932193 · Cited by 12
Distributed Edge Caching in Ultra-Dense Fog Radio Access Networks: A Mean Field Approach
Hu, Y., Jiang, Y., Bennis, M., & Zheng, F. (2018) · IEEE Vehicular Technology Conference · doi:10.1109/vtcfall.2018.8690593 · Cited by 12
In-Network Caching for Hybrid Satellite-Terrestrial Networks Using Deep Reinforcement Learning
Garg, N., Sellathurai, M., & Ratnarajah, T. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053906 · Cited by 11
An Artificial Intelligence Enabled F-RAN Testbed
Lu, Z., Hu, Z., Han, Z., Wang, L., Knopp, R., & Zhang, Y. (2020) · IEEE Wireless Communications · doi:10.1109/mwc.001.1900386 · Cited by 11
Q-Learning for Content Placement in Wireless Cooperative Caching
Yang, Z., Liu, Y., & Chen, Y. (2018) · Globecom · doi:10.1109/glocom.2018.8647993 · Cited by 11
Joint Task Offloading and Data Caching in Mobile Edge Computing
Zhang, N., Guo, S., Dong, Y., Jiang, Q., & Jiao, J. (2019) · International Conference on Mobile Ad-Hoc and Sensor Networks (MSN) · doi:10.1109/msn48538.2019.00053 · Cited by 11
Pires, S., Ziviani, A., & Sampaio, L. N. (2021) · PeerJ Computer Science · doi:10.7717/peerj-cs.418 · Cited by 10
Hong, G., Yang, B., Su, W., Li, H., Huang, Z., & Taleb, T. (2023) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2023.3336824 · Cited by 10
Reinforcement Learning for Proactive Caching of Contents with Different Demand Probabilities
Somuyiwa, S. O., Gündüz, D., & György, A. (2018) · International Symposium on Wireless Communication Systems · doi:10.1109/iswcs.2018.8491205 · Cited by 10
Content Placement with Unknown Popularity in Fog Radio Access Networks
Zhou, Y., Yan, S., & Peng, M. (2019) · IEEE International Conference on Industrial Internet (ICII) · doi:10.1109/icii.2019.00068 · Cited by 10
Deep Reinforcement Learning Empowered Edge Collaborative Caching Scheme for Internet of Vehicles
Liu, X., Xu, S., Yang, C., Wang, Z., Zhang, H., Chi, J., & Li, Q. (2021) · Computer Systems Science and Engineering · doi:10.32604/csse.2022.022103 · Cited by 10
Age-Aware Status Update Control for Energy Harvesting IoT Sensors via Reinforcement Learning
Hatami, M., Jahandideh, M., Leinonen, M., & Codreanu, M. (2020) · IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC) · doi:10.1109/pimrc48278.2020.9217302 · Cited by 10
AoI and Energy-Driven Dynamic Cache Updates for Wireless Edge Networks
Yuan, Y., Yang, B., Su, W., Li, H., Wang, C., Liu, Q., & Taleb, T. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3470847 · Cited by 9
Multi-Agent Federated $Q$-Learning Algorithms for Wireless Edge Caching
Liu, Z., Garg, N., & Ratnarajah, T. (2024) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2024.3473738 · Cited by 9
Experimental Verification of SDN/NFV in Integrated mmWave Access and Mesh Backhaul Networks
Nakamura, M. M., Nishiuchi, H., Nakazato, J., Koslowski, K., Daube, J., Santos, R., Tran, G. K., & Sakaguchi, K. (2020) · IEICE Transactions on Communications · doi:10.1587/transcom.2020nvp0002 · Cited by 9
Learning at the Edge: Smart Content Delivery in Real World Mobile Social Networks
Bian, K., Gao, C., Tao, Y., Zhang, Y., Song, L., Dong, S., & Li, X. (2019) · IEEE Network · doi:10.1109/mnet.2019.1800294 · Cited by 9
A Reinforcement Learning Approach for D2D-Assisted Cache-Enabled HetNets
Tang, J., Tang, H., Zhao, N., Cumanan, K., Zhang, S., & Zhou, Y. J. (2019) · Globecom · doi:10.1109/globecom38437.2019.9014027 · Cited by 9
Privacy-Preserving Distributed Edge Caching for Mobile Data Offloading in 5G Networks
Zeng, Y., Huang, Y., Liu, J. Y., & Yang, Y. (2020) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs47774.2020.00106 · Cited by 9
Deep Multi‐Agent Reinforcement Learning for Cooperative Edge Caching
Gursoy, M. C., Zhong, C., & Velipasalar, S. (2019) · doi:10.1002/9781119562306.ch21 · Cited by 9
Yuan, Y., Su, W., Hong, G., Li, H., & Wang, C. (2024) · Mobile Networks and Applications · doi:10.1007/s11036-023-02287-4 · Cited by 8
Maiti, R., Madhukumar, A. S., & Ernest, T. Z. H. (2026) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2026.3669379 · Cited by 11
Online Learning Models for Content Popularity Prediction in Wireless Edge Caching
Garg, N., Sellathurai, M., Bettagere, B., Bhatia, V., & Ratnarajah, T. (2019) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf44664.2019.9048682 · Cited by 8
On Attacking Future 5G Networks with Adversarial Examples: Survey
Zolotukhin, M., Zhang, D., Hämäläinen, T., & Miraghaei, P. (2022) · Network · doi:10.3390/network3010003 · Cited by 9
Cheng, X., Gao, M., Gao, Q., & Peng, X. (2023) · ICT Express · doi:10.1016/j.icte.2023.01.005 · Cited by 8
Data-Driven Next-Generation Wireless Networking: Embracing AI for Performance and Security
Xue, J., Qu, Z., Zhao, S., Liu, Y., & Lu, Z. (2023) · International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn58024.2023.10230189 · Cited by 10
Age-of-Information Aware Caching and Delivery for Infrastructure-Assisted Connected Vehicles
Park, S., Park, C., Jung, S., Choi, M., & Kim, J. (2024) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2024.3384952 · Cited by 8
Content Caching Policy for 5G Network Based on Asynchronous Advantage Actor-Critic Method
Shi, Z., Li, L., Xu, Y., Li, X., Chen, W., & Han, Z. (2019) · Globecom · doi:10.1109/globecom38437.2019.9014268 · Cited by 8
A study on the impact of mobility on caching in non-standalone 5G vehicular networks
Siahpoosh, S. A. A., & Rezaei, F. (2023) · Vehicular Communications · doi:10.1016/j.vehcom.2023.100595 · Cited by 8
Reinforcement Learning for 5G Caching with Dynamic Cost
Sadeghi, A., Sheikholeslami, F., Matrques, A. G., & Giannakis, G. B. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8462673 · Cited by 8
Self-citationEdge Caching Based on Deep Reinforcement Learning
Niknia, F., Wang, P., Agarwal, A., & Wang, Z. (2023) · IEEE/CIC International Conference on Communications in China (ICCC) · doi:10.1109/iccc57788.2023.10233394 · Cited by 7
Learning based Content Caching for Wireless Networks
Masood, A., Lakew, D. S., & Cho, S. (2020) · International Conference on Information Networking · doi:10.1109/icoin48656.2020.9016489 · Cited by 7
Caching dynamic contents with varying popularity
Krishna, A., Burra, R., & Singh, C. (2021) · International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt) · doi:10.23919/wiopt52861.2021.9589297 · Cited by 7
A Reinforcement Learning Based Data Caching in Wireless Networks
Sheraz, M. A., Shafique, S., Imran, S., Asif, M., Ullah, R., Ibrar, M., Khan, J., & Wuttisittikulkij, L. (2022) · Applied Sciences · doi:10.3390/app12115692 · Cited by 7
Rostampoor, J., & Adve, R. (2022) · IEEE Transactions on Communications · doi:10.1109/tcomm.2022.3226186 · Cited by 7
Artificial Intelligence Advancement for 6G Communication: A Visionary Approach
Miya, J., Raj, S., Ansari, M. A., Kumar, S. M., & Kumar, R. (2023) · Springer eBooks · doi:10.1007/978-3-031-30101-8_15 · Cited by 8
Intelligent scaling for 6G IoE services for resource provisioning
Alharbi, A., Alyami, H., Poongodi, M., Rauf, H. T., & Kadry, S. (2021) · PeerJ Computer Science · doi:10.7717/peerj-cs.755 · Cited by 7
RetractedPrivacy-Preserving Federated Reinforcement Learning for Popularity-Assisted Edge Caching
Zheng, C., Liu, S., Huang, Y., & Quek, T. Q. S. (2021) · Globecom · doi:10.1109/globecom46510.2021.9685242 · Cited by 7
Dynamic Content Updates in Heterogeneous Wireless Networks
Abad, M. S. H., Özfatura, E., Erçetin, Ö., & Gündüz, D. (2019) · Annual Conference on Wireless On-demand Network Systems and Services (WONS) · doi:10.23919/wons.2019.8795490 · Cited by 7
Barricades in Network Transformation from 4G to 5G in India
Puri, S., Rai, R. S., & Saxena, K. (2018) · International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO) · doi:10.1109/icrito.2018.8748303 · Cited by 6
Deep Deterministic Policy Gradient-Based Edge Caching: An Inherent Performance Tradeoff
Lei, M., Li, Q., Wu, R., Pandharipande, A., & Ge, X. (2021) · Globecom · doi:10.1109/globecom46510.2021.9685454 · Cited by 6
Polyzos, K. D., Lu, Q., Sadeghi, A., & Giannakis, G. B. (2021) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf53345.2021.9723135 · Cited by 6
Self-citationBin, H., Wang, D., Li, H., & Zhao, C. (2022) · International Conference on Information and Education Technology (ICIET) · doi:10.1109/iciet55102.2022.9779044 · Cited by 6
AI Enabled Resource Allocation in Future Mobile Networks
Mughal, U. R., Khan, M. A., Beg, A., & Mughal, G. Q. (2020) · IEEE/IFIP Network Operations and Management Symposium (NOMS) · doi:10.1109/noms47738.2020.9110397 · Cited by 6
Content Caching Policy Based on GAN and Distributional Reinforcement Learning
Weng, H., Li, L., Cheng, Q., Chen, W., & Han, Z. (2020) · International Conference on Communications · doi:10.1109/icc40277.2020.9148620 · Cited by 6
Content Popularity Prediction in Fog-RANs: A Bayesian Learning Approach
Tao, Y., Jiang, Y., Zheng, F., Bennis, M., & You, X. (2021) · Globecom · doi:10.1109/globecom46510.2021.9685947 · Cited by 6
Learning to Cooperate in D2D Caching Networks
Paschos, G. S., Destounis, A., & Iosifidis, G. (2019) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc.2019.8815445 · Cited by 6
Learning-based cooperative content caching and sharing for multi-layer vehicular networks
Shi, J., Ni, Y., Cai, L., & Du, Z. (2024) · High-Confidence Computing · doi:10.1016/j.hcc.2024.100277 · Cited by 5
Privacidade do Usuário em Aprendizado Colaborativo: Federated Learning, da Teoria à Prática
Neto, H. C., Mattos, D. M. F., & Fernandes, N. (2020) · doi:10.5753/sbc.8285.6.3 · Cited by 5
An Incremental Learning Based Edge Caching System: From Modeling to Evaluation
Xu, G., Tang, B., Yuan, L., Xue, Y., Gao, Z., Mostafa, S., & Sung, C. W. (2020) · IEEE Access · doi:10.1109/access.2020.2965249 · Cited by 5
Joint Cache Placement and Delivery Design using Reinforcement Learning for Cellular Networks
Amidzadeh, M., Al–Tous, H., Tirkkonen, O., & Zhang, J. (2021) · IEEE Vehicular Technology Conference · doi:10.1109/vtc2021-spring51267.2021.9448674 · Cited by 5
Trend-Aware Proactive Caching via Tensor Train Decomposition: A Bayesian Viewpoint
Mehrizi, S., Vu, T. X., Chatzinotas, S., & Ottersten, B. (2021) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2021.3075071 · Cited by 5
Caching, transcoding, delivery and learning for advanced video streaming services
Choi, M., Xiang, T., Lim, H., Kim, Y., Ahn, M., Oh, S., & Kim, H. (2024) · ICT Express · doi:10.1016/j.icte.2024.05.012 · Cited by 4
Tero: Offloading CDN Traffic to Massively Distributed Devices
Vanerio, J., Hügerich, L., & Schmid, S. (2024) · International Conference on Distributed Computing and Networking (ICDCN) · doi:10.1145/3631461.3631556 · Cited by 4
Distributed Network Caching via Dynamic Programming
Sadeghi, A., Marques, A. G., & Giannakis, G. B. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682210 · Cited by 4
Self-citationA Survey of Resource Management in Cloud and Edge Computing
Zhang, Y., & Xu, K. (2020) · Springer eBooks · doi:10.1007/978-981-15-0138-8_2 · Cited by 4
Prefetching and caching for minimizing service costs: Optimal and approximation strategies
Quan, G., Eryılmaz, A., Tan, J. R., & Shroff, N. B. (2020) · Performance Evaluation · doi:10.1016/j.peva.2020.102149 · Cited by 4
Cooperative Scenarios for Multi-Agent Reinforcement Learning in Wireless Edge Caching
Garg, N., & Ratnarajah, T. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414319 · Cited by 4
Dynamic Caching in a Hybrid Millimeter-wave/Microwave C-RAN
Rostampoor, J., & Adve, R. (2022) · IEEE International Conference on Communications workshops · doi:10.1109/iccworkshops53468.2022.9882165 · Cited by 4
Hatami, M., Leinonen, M., & Codreanu, M. (2019) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf44664.2019.9048832 · Cited by 4
Active Content Popularity Learning via Query-by-Committee for Edge Caching
Bommaraveni, S., Vu, T. X., Vuppala, S., Chatzinotas, S., & Ottersten, B. (2019) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf44664.2019.9048947 · Cited by 4
Hierarchical Caching via Deep Reinforcement Learning
Sadeghi, A., Wang, G., & Giannakis, G. B. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054485 · Cited by 4
Self-citationTensor Completion based Prediction in Wireless Edge Caching
Garg, N., & Ratnarajah, T. (2020) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf51394.2020.9457546 · Cited by 4
Joint Service Scheduling and Content Caching Over Unreliable Channels
Nie, T., Luo, J., Gao, L. X., Zheng, F., & Yu, L. C. (2020) · Globecom · doi:10.1109/globecom42002.2020.9322536 · Cited by 4
Sa’ad, U., Lakew, D. S., & Cho, S. (2021) · International Conference on Information Networking · doi:10.1109/icoin50884.2021.9333855 · Cited by 4
Synergy of Edge Intelligence and Blockchain: A Comprehensive SurveyPreprint
Wang, X., Ren, X., Qiu, C., Xiong, Z., Yao, H., & Leung, V. C. M. (2021) · doi:10.36227/techrxiv.14724360 · Cited by 4
Fu, Y., Qin, P. D., & Wu, K. (2025) · IEEE Transactions on Networking · doi:10.1109/ton.2025.3591933 · Cited by 3
Tan, F., Peng, Y., & Liu, Q. (2023) · Sensors · doi:10.3390/s23198295 · Cited by 3
Tang, W., Gao, M., Gao, Q., & Peng, X. (2023) · IEEE International Conference on Frontiers Technology of Information and Computer (ICFTIC) · doi:10.1109/icftic59930.2023.10456230 · Cited by 3
Performance Estimation and Evaluation Framework for Caching Policies in Hierarchical Caches
Ramadan, E., Babaie, P., & Zhang, Z.-L. (2019) · Computer Communications · doi:10.1016/j.comcom.2019.05.006 · Cited by 3
An approximate dynamic programming approach for collaborative caching
Yang, X., & Thomos, N. (2020) · Engineering Optimization · doi:10.1080/0305215x.2020.1767098 · Cited by 3
Manzoor, S., & Mian, A. N. (2021) · International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt) · doi:10.23919/wiopt52861.2021.9589853 · Cited by 3
Multi-server Intelligent Task Caching Strategy for Edge Computing
Ge, H., Ma, S., Song, X., Li, S., Liu, L., Chen, X., Zhou, T., & Gong, H. (2022) · 2022 4th International Conference on Natural Language Processing (ICNLP) · doi:10.1109/icnlp55136.2022.00103 · Cited by 3
Cost Efficient Intelligent Sensing Big Data Caching in ICN-IoT Networks
Yang, M., Deyun Gao, A., Hu, X., & Qin, Y. (2023) · International Conference on Communications · doi:10.1109/icc45041.2023.10278641 · Cited by 3
Cache Network Management Using BIG Cache Abstraction
Babaie, P., Ramadan, E., & Zhang, Z.-L. (2019) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom.2019.8737407 · Cited by 3
Joint Optimization of Caching and Transport in Proactive Edge Cloud
Sardellitti, S., Costanzo, F., & Merluzzi, M. (2018) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco.2018.8553288 · Cited by 3
Stay Longer at the Network's Edge: A Novel Proactive Caching Policy through Sojourn Time
Denis, J., Maatouk, A., Hajri, S. E., & Assaad, M. (2018) · Globecom · doi:10.1109/glocom.2018.8647314 · Cited by 3
A novel context-aware caching scheme for 5G networks
Islam, N. (2019) · International Conference on Mathematics, Actuarial Science, Computer Science and Statistics (MACS) · doi:10.1109/macs48846.2019.9024819 · Cited by 3
Adaptive Caching via Deep Reinforcement Learning.Preprint
Sadeghi, A., Wang, G., & Giannakis, G. B. (2019) · arXiv (Cornell University) · Cited by 3
Self-citationDynamic Coded Caching in Wireless Networks Using Multi-Agent Reinforcement LearningPreprint
Pedersen, J., Amat, A. G. I., Brännström, F., & Rosnes, E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.06724 · Cited by 3
Synergy of Edge Intelligence and Blockchain: A Comprehensive SurveyPreprint
Wang, X., Ren, X., Qiu, C., Xiong, Z., Yao, H., & Leung, V. C. M. (2021) · doi:10.36227/techrxiv.14724360.v1 · Cited by 3
A Survey of AI-Enabled Architectures for Next-Generation Wireless Communication NetworksPreprint
Javed, A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5508578 · Cited by 3
Reinforcement learning for caching with space-time popularity dynamics
Sadeghi, A., Giannakis, G. B., Wang, G., & Sheikholeslami, F. (2021) · Institution of Engineering and Technology eBooks · doi:10.1049/pbte096e_ch19 · Cited by 2
Self-citation
Metadata
- Authors
- Sadeghi, A., Sheikholeslami, F., & Giannakis, G. B.
- Affiliations
- University of Minnesota (US)
- Venue
- IEEE Journal of Selected Topics in Signal Processing
- Published
- 2018-02
- Volume
- 12
- Issue
- 1
- Pages
- 180-190
- ISSN
- 1932-4553 (ISSN-L)
- 1941-0484
- OpenAlex
- W2746390786
- Cited by
- 257
- References
- 39
- Citations by year
- 2026: 5 · 2025: 5 · 2024: 23 · 2023: 21 · 2022: 32 · 2021: 41 · 2020: 57 · 2019: 58 · 2018: 15
- FWCI
- 23.68
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Journal of Selected Topics in Signal Processing (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1423316, 1508993, 1514056, 1711471)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Caching and Content Delivery
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Computer Networks and Communications › Age of Information Optimization
- Keywords
- content caching, small cells, 5G, reinforcement learning, Q-learning, prefetching, edge caching, Markov processes, linear function approximation, scalability, heterogeneous networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
