Learning to Continuously Optimize Wireless Resource in Episodically Dynamic Environment
Open accessThe DOI matches its Crossref record; 79 of the 81 references it cites were found in a registry or an index.
Abstract
There has been a growing interest in developing data-driven, in particular deep neural network (DNN) based methods for modern communication tasks. For a few popular tasks such as power control, beamforming, and MIMO detection, these methods achieve state-of-the-art performance while requiring less computational efforts, less channel state information (CSI), etc. However, it is often challenging for these approaches to learn in a dynamic environment where parameters such as CSIs keep changing.This work develops a methodology that enables data-driven methods to continuously learn and optimize in a dynamic environment. Specifically, we consider an "episodically dynamic" setting where the environment changes in "episodes", and in each episode the environment is stationary. We propose a continual learning (CL) framework for wireless systems, which can incrementally adapt the learning models to the new episodes, without forgetting models learned from the previous episodes. Our design is based on a novel min-max formulation which ensures certain "fairness" across different episodes. Finally, we demonstrate the effectiveness of the CL approach by customizing it to a popular DNN based model for power control, and testing using both synthetic and real data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Transfer learning [103] and continual learning [277] have recently been adopted to address such task mismatch issue in the”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [277]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Overcoming catastrophic forgetting in neural networks
Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1611835114 · Cited by 7,899
Li, Z., & Hoiem, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2773081 · Cited by 4,202
iCaRL: Incremental Classifier and Representation Learning
Rebuffi, S.-A., Kolesnikov, A., Sperl, G., & Lampert, C. H. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.587 · Cited by 3,988 · cited 2×
“As its name suggests, rehearsal based methods use a small set of samples for later training rehearsal, either through selecting and storing the most represented samples such as the incremental classifier, representation learning (iCaRL) [30] and gradient episodic memory (GEM) [28], or use generative models to generate…”
BackgroundMethodCatastrophic Interference in Connectionist Networks: The Sequential Learning Problem
McCloskey, M., & Cohen, N. J. (1989) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60536-8 · Cited by 3,770
Deep learning for computer vision: A brief review
Voulodimos, A., Doulamis, N., Doulamis, A., & Protopapadakis, E. (2018) · Computational Intelligence and Neuroscience · doi:10.1155/2018/7068349 · Cited by 3,403 · cited 1×
“Deep learning has been successful in many applications such as computer vision [2], natural language processing [3], and recommender systems [4]; see [5] for an overview.”
BackgroundContinual lifelong learning with neural networks: A review
Parisi, G. I., Kemker, R., Part, J. L., Kanan, C., & Wermter, S. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.01.012 · Cited by 3,117
An Introduction to Deep Learning for the Physical Layer
O'Shea, T., & Hoydis, J. (2017) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2017.2758370 · Cited by 2,980 · cited 1×
“Recent works have also demonstrated that deep learning can be applied in communication systems, either by replacing an individual component in the system (such as signal detection [6,7], channel decoding [8], channel estimation [9,10], power allocation [11–15], beamforming [16,17] and wireless scheduling [18]), or by…”
Background
Research works printed but not linked: 1
- sun, 2020, Learning to continuously optimize wireless resource in episodically dynamic environment, arXiv preprint arXiv 2011 00177
Cited by
Edge artificial intelligence for 6g: vision, enabling technologies, and applications
Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126076 · Cited by 829
Learning Power Allocation for Multi-Cell-Multi-User Systems With Heterogeneous Graph Neural Networks
Guo, J., & Yang, C. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3100133 · Cited by 148
Adapting to Dynamic LEO-B5G Systems: Meta-Critic Learning Based Efficient Resource Scheduling
Yuan, Y., Lei, L., Vu, T. X., Chang, Z., Chatzinotas, S., & Sun, S. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3178171 · Cited by 63
Sun, H., Pu, W., Fu, X., Chang, T., & Hong, M. (2022) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2022.3143372 · Cited by 59
Self-citationAlgorithm Unrolling for Massive Access via Deep Neural Networks With Theoretical Guarantee
Shi, Y., Choi, H., Shi, Y., & Zhou, Y. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3100500 · Cited by 48
Metadata
- Authors
- Sun, H., Pu, W., Zhu, M., Fu, X., Chang, T.-H., & Hong, M.
- Affiliations
- University of Minnesota (US)
- Shenzhen Research Institute of Big Data (CN)
- Oregon State University (US)
- Venue
- ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- Publisher
- IEEE
- Published
- 2021-06-06
- Pages
- 4945-4949
- ISSN
- 1520-6149 (ISSN-L)
- OpenAlex
- W3102141882
- Cited by
- 21
- References
- 81
- Citations by year
- 2025: 3 · 2023: 3 · 2022: 6 · 2021: 9
- FWCI
- 2.08
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE International Conference on Acoustics Speech and Signal Processing (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Wireless Network Optimization
- Physical Sciences › Computer Science › Computer Networks and Communications › Wireless Communication Networks Research
- Keywords
- continual learning, deep neural network, power control, min-max formulation, beamforming, MIMO detection, channel state information
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Learning to Continuously Optimize Wireless Resource in Episodically Dynamic Environment. https://app.cochat.ai/papers/10.1109/icassp39728.2021.9413503
- The paper
- Sun, H., Pu, W., Zhu, M., Fu, X., Chang, T.-H., & Hong, M. (2021). Learning to Continuously Optimize Wireless Resource in Episodically Dynamic Environment. ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). https://doi.org/10.1109/icassp39728.2021.9413503
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.