Learning State Selection for Reconfigurable Antennas: A Multi-Armed Bandit Approach
The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Reconfigurable antennas are capable of dynamically re-shaping their radiation patterns in response to the needs of a wireless link or a network. In order to utilize the benefits of reconfigurable antennas, selecting an optimal antenna state for communication is essential and depends on the availability of full channel state information for all the available antenna states. We consider the problem of reconfigurable antenna state selection in a single user MIMO system. We first formulate the state selection as a multi-armed bandit problem that aims to optimize arbitrary link quality metrics. We then show that by using online learning under a multi-armed bandit framework, a sequential decision policy can be employed to learn optimal antenna states without instantaneous full CSI and without a priori knowledge of wireless channel statistics. Our objective is to devise an adaptive state selection technique when the channels corresponding to all the states are not directly observable and compare our results against the case of a known model or genie with full information. We evaluate the performance of the proposed antenna state selection technique by identifying key link quality metrics and using measured channels in a 2 × 2 MIMO OFDM system. We show that the proposed technique maximizes long term link performance with reduced channel training frequency.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Goldsmith, A. (2005) · Cambridge University Press eBooks · doi:10.1017/cbo9780511841224 · Cited by 10,658
(2006) · Choice Reviews Online · doi:10.5860/choice.43-4686 · Cited by 8,128
Finite-time Analysis of the Multiarmed Bandit Problem
Auer, P., Cesa-Bianchi, N., & Fischer, P. (2002) · Machine Learning · doi:10.1023/a:1013689704352 · Cited by 6,033
Wolniansky, P. W., Foschini, G. J., Golden, G. D., & Valenzuela, R. A. (2002) · 1998 URSI International Symposium on Signals, Systems, and Electronics. Conference Proceedings (Cat. No.98EX167) · doi:10.1109/issse.1998.738086 · Cited by 3,527
Asymptotically efficient adaptive allocation rules
Lai, T. L., & Robbins, H. (1985) · Advances in Applied Mathematics · doi:10.1016/0196-8858(85)90002-8 · Cited by 2,406
Bandit processes and dynamic allocation indices
Gittins, J. C. (1979) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1979.tb01068.x · Cited by 1,487 · cited 2×
“In the seminal work of Gittins [21], it was shown that the optimal policy of MAB with Bayesian formulation where reward distributions are known, has a simple index structure, i.”
BackgroundSwitching Between Diversity and Multiplexing in MIMO Systems
Heath, R. W., & Paulraj, A. J. (2005) · IEEE Transactions on Communications · doi:10.1109/tcomm.2005.849774 · Cited by 414
Distributed Learning in Multi-Armed Bandit With Multiple Players
Liu, K., & Zhao, Q. (2010) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2010.2062509 · Cited by 385
On myopic sensing for multi-channel opportunistic access: structure, optimality, and performance
Zhao, Q., Krishnamachari, B., & Liu, K. (2008) · IEEE Transactions on Wireless Communications · doi:10.1109/t-wc.2008.071349 · Cited by 360
Anantharam, V., Varaiya, P., & Walrand, J. (1987) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1987.1104491 · Cited by 358
Research works printed but not linked: 2
- 0, Rice University WARP Project
- 0, Adant
Cited by
Quantum Machine Learning for 6G Communication Networks: State-of-the-Art and Vision for the Future
Nawaz, S. J., Sharma, S. K., Wyne, S., Patwary, M. N., & Asaduzzaman, M. (2019) · IEEE Access · doi:10.1109/access.2019.2909490 · Cited by 658
Reconfigurable Antennas: Design and Applications
Costantine, J., Tawk, Y., Barbin, S. E., & Christodoulou, C. G. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2396000 · Cited by 448
Fast mmwave Beam Alignment via Correlated Bandit Learning
Wu, W. R., Cheng, N., Zhang, N., Yang, P., Zhuang, W., & Shen, X. (2019) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2940454 · Cited by 154
Online Learning for Position-Aided Millimeter Wave Beam Training
Va, V., Shimizu, T., Bansal, G., & Heath, R. W. (2019) · IEEE Access · doi:10.1109/access.2019.2902372 · Cited by 133
Jamming Bandits—A Novel Learning Method for Optimal Jamming
Amuru, S., Tekin, C., van der Schaar, M., & Buehrer, R. M. (2015) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2015.2510643 · Cited by 112
Successive Bayesian Reconstructor for Channel Estimation in Fluid Antenna Systems
Zhang, Z., Zhu, J., Dai, L., & Heath, R. W. (2024) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2024.3515135 · Cited by 130
DoA Estimation Using Compact CRLH Leaky-Wave Antennas: Novel Algorithms and Measured Performance
Paaso, H., Gulati, N., Patron, D., Hakkarainen, A., Werner, J., Dandekar, K. R., Valkama, M., & Mämmelä, A. (2017) · IEEE Transactions on Antennas and Propagation · doi:10.1109/tap.2017.2724584 · Cited by 49
Self-citationRelay Selection in Underwater Acoustic Cooperative Networks: A Contextual Bandit Approach
Li, X., Liu, J., Yan, L., Han, S., & Guan, X. (2016) · IEEE Communications Letters · doi:10.1109/lcomm.2016.2625300 · Cited by 40
Bahceci, I., Hasan, M., Duman, T. M., & Cetiner, B. A. (2016) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2016.2626291 · Cited by 31
Cai, J., Zhong, R., & Li, Y. (2019) · PLoS ONE · doi:10.1371/journal.pone.0215672 · Cited by 33
Achieving Arbitrary Signals Transmission Using a Single Radio Frequency Chain
Zhou, L., Khan, F. A., Ratnarajah, T., & Papadias, C. B. (2015) · IEEE Transactions on Communications · doi:10.1109/tcomm.2015.2493140 · Cited by 26
Relay Selection for Underwater Acoustic Sensor Networks: A Multi-User Multi-Armed Bandit Formulation
Li, X., Liu, J., Yan, L., Han, S., & Guan, X. (2018) · IEEE Access · doi:10.1109/access.2018.2801350 · Cited by 24
Pattern Reconfigurable UHF RFID Reader Antenna Array
Tajin, M. A. S., & Dandekar, K. R. (2020) · IEEE Access · doi:10.1109/access.2020.3031296 · Cited by 24
Self-citationFast Beam Alignment via Pure Exploration in Multi-Armed Bandits
Wei, Y. M., Zhong, Z., & Tan, V. Y. F. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3217131 · Cited by 22
Achievable Rate Maximization Pattern Design for Reconfigurable MIMO Antenna Array
Wang, H., Li, A., Liu, Y., Qin, Q., Song, L., & Li, Y. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3238069 · Cited by 29
Online Learning-Based Reconfigurable Antenna Mode Selection Exploiting Channel Correlation
Zhao, T., Li, M., & Pan, Y. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3076760 · Cited by 24
Fast Reconfigurable Antenna State Selection with Hierarchical Thompson Sampling
Zhao, T., Li, M., & Poloczek, M. (2019) · International Conference on Communications · doi:10.1109/icc.2019.8761809 · Cited by 17
QTAccel: A Generic FPGA based Design for Q-Table based Reinforcement Learning Accelerators
Meng, Y., Kuppannagari, S. R., Rajat, R., Srivastava, A., Kannan, R., & Prasanna, V. K. (2020) · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · doi:10.1109/ipdpsw50202.2020.00024 · Cited by 17
Training-Based Antenna Selection for PER Minimization: A POMDP Approach
Padmanabhan, S., Stephen, R. G., Murthy, C. R., & Coupechoux, M. (2015) · IEEE Transactions on Communications · doi:10.1109/tcomm.2015.2455504 · Cited by 15
Off-policy Learning for Remote Electrical Tilt Optimization
Vannella, F., Jeong, J., & Proutière, A. (2020) · IEEE Vehicular Technology Conference · doi:10.1109/vtc2020-fall49728.2020.9348456 · Cited by 15
Deep Learning-Based Channel Extrapolation for Pattern Reconfigurable Massive MIMO
Liang, M., & Li, A. (2023) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2023.3323803 · Cited by 14
Online Reconfigurable Antenna State Selection based on Thompson Sampling
Zhao, T., Li, M., & Ditzler, G. (2019) · 2012 International Conference on Computing, Networking and Communications (ICNC) · doi:10.1109/iccnc.2019.8685555 · Cited by 13
Off-Policy Learning in Contextual Bandits for Remote Electrical Tilt Optimization
Vannella, F., Jeong, J., & Proutière, A. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3202041 · Cited by 12
Mitigating RF jamming attacks at the physical layer with machine learning
Jacovic, M., Rey, X. R., Mainland, G., & Dandekar, K. R. (2022) · IET Communications · doi:10.1049/cmu2.12461 · Cited by 12
Self-citationSniffer Channel Assignment With Imperfect Monitoring for Cognitive Radio Networks
Xu, J., Wang, Q., Zeng, K., Liu, M., & Liu, W. (2015) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2015.2495259 · Cited by 14
Integrated Beam Tracking and Communication for (Sub-)mmWave Links With Stochastic Mobility
Ronquillo, N., Gau, C.-S., & Javidi, T. (2023) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2023.3284432 · Cited by 11
Sneh, A., Ram, S. S., Darak, S. J., & Tewari, A. (2024) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2024.3391905 · Cited by 10
Learning Optimal Antenna Tilt Control Policies: A Contextual Linear Bandit Approach
Vannella, F., Proutière, A., Jedra, Y., & Jeong, J. (2022) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom48880.2022.9796783 · Cited by 10
Experimental evaluation of a reconfigurable antenna system for blind interference alignment
Begashaw, S., Chacko, J., Gulati, N., Nguyen, D. H., Kandasamy, N., & Dandekar, K. R. (2016) · The ... IEEE Annual Wireless and Microwave Technology Conference · doi:10.1109/wamicon.2016.7483855 · Cited by 10
Self-citationA systematic learning method for optimal jamming
Amuru, S., Tekin, C., van der Schaar, M., & Buehrer, R. M. (2015) · International Conference on Communications · doi:10.1109/icc.2015.7248754 · Cited by 10
Wu, Y., Koch, J., Vossiek, M., & Gerstacker, W. (2021) · IEEE International Conference on Communications workshops · doi:10.1109/iccworkshops50388.2021.9473531 · Cited by 9
Adaptive Link Optimization for 802.11 UAV Uplink Using a Reconfigurable Antenna
Wolfe, S., Begashaw, S., Liu, Y., & Dandekar, K. R. (2018) · IEEE Military Communications Conference (MILCOM) · doi:10.1109/milcom.2018.8599696 · Cited by 9
Self-citationA compact dual circular patch pattern reconfigurable antenna
Abdulkawi, W. M., Malik, W. A., Sheta, A. F., & Alkanhal, M. A. S. (2018) · Microwave and Optical Technology Letters · doi:10.1002/mop.31429 · Cited by 8
Rate and Channel Adaptation in Cognitive Radio Networks Under Time-Varying Constraints
Qureshi, M. A., & Tekin, C. (2020) · IEEE Communications Letters · doi:10.1109/lcomm.2020.3015823 · Cited by 8
Joint Symbol-Level Precoding and Radiation Pattern Design for Downlink Reconfigurable MIMO
Wang, H., Zhang, L., Liang, M., Li, A., Liu, F., Li, Y., & Song, L. (2024) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2024.3368704 · Cited by 7
Learning Optimal Antenna Tilt Control Policies: A Contextual Linear Bandits Approach
Vannella, F., Proutière, A., Jedra, Y., & Jeong, J. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3424192 · Cited by 7
Active Reconfigurable MIMO Communications: Capacity Maximization Pattern Design
Wang, H., Li, A., Liu, Y., Qin, Q., Song, L., & Li, Y. (2022) · IEEE Sensor Array and Multichannel Signal Processing Workshop (SAM) · doi:10.1109/sam53842.2022.9827894 · Cited by 7
Online Learning for Spectrum Sensing and Reconfigurable Antenna Control
Wanuga, K., Gulati, N., Saarnisaari, H., & Dandekar, K. R. (2014) · International Conference on Cognitive Radio Oriented Wireless Networks (CROWNCOM) · doi:10.4108/icst.crowncom.2014.255737 · Cited by 7
Self-citationMIMO Communication with Polarization Reconfigurable Antennas
Castellanos, M. R., & Heath, R. W. (2021) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf53345.2021.9723156 · Cited by 7
Throughput optimization in multi-hop wireless networks with reconfigurable antennas
Hou, Y., Li, M., & Zeng, K. (2017) · 2012 International Conference on Computing, Networking and Communications (ICNC) · doi:10.1109/iccnc.2017.7876201 · Cited by 7
Reconfigurable Antennas and Their Applications
Costantine, J., Tawk, Y., & Christodoulou, C. G. (2015) · Springer eBooks · doi:10.1007/978-981-4560-75-7_61-1 · Cited by 7
Costantine, J., Tawk, Y., & Christodoulou, C. G. (2016) · Springer eBooks · doi:10.1007/978-981-4560-44-3_61 · Cited by 6
Enhancing Blind Interference Alignment with Reinforcement Learning
Begashaw, S., Nguyen, D. H., & Dandekar, K. R. (2016) · Globecom · doi:10.1109/glocom.2016.7841815 · Cited by 6
Self-citationData Offloading in Heterogeneous Dynamic Fog Computing Network: A Contextual Bandit Approach
Shan, Y., Wang, H., Cao, Z., & Yury, K. (2021) · International Conference on Computer Communication and the Internet (ICCCI) · doi:10.1109/iccci51764.2021.9486800 · Cited by 5
Bshara, O., Pano, V., Tajin, M. A. S., Rey, X. R., & Dandekar, K. R. (2021) · IEEE Access · doi:10.1109/access.2021.3097936 · Cited by 5
Self-citationMulti-User Symbol-Level Precoding for Downlink Reconfigurable MIMO Communication Systems
Wang, H., Li, A., Shen, Y., Vucetic, B. S., & Li, Y. (2022) · International Symposium on Wireless Communication Systems · doi:10.1109/iswcs56560.2022.9940400 · Cited by 5
Fast Beam Alignment via Pure Exploration in Multi-armed Bandits
Wei, Y. M., Zhong, Z., Tan, V. Y. F., & Wang, C. (2022) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit50566.2022.9834431 · Cited by 5
Costantine, J., Tawk, Y., & Christodoulou, C. G. (2015) · Springer eBooks · doi:10.1007/978-981-4560-75-7_61-2 · Cited by 5
A Miniaturized Reconfigurable CRLH Leaky-Wave Antenna Using Complementary Split-Ring Resonators
Patron, D., Liu, Y., & Dandekar, K. R. (2018) · Journal of Electrical and Computer Engineering · doi:10.1155/2018/6839028 · Cited by 4
Self-citationSecond-order multi-armed bandit learning for online optimization in communication and networks
Du, Z., Jiang, B., Xu, K., Wei, S., Wang, S., & Zhu, H. (2019) · ACM Turing Celebration Conference - China (ACM TURC) · doi:10.1145/3321408.3323078 · Cited by 3
TAMU‐RPL: Thompson sampling‐based multichannel RPL
Gomes, P. H., & Krishnamachari, B. (2019) · Transactions on Emerging Telecommunications Technologies · doi:10.1002/ett.3806 · Cited by 3
On the Design of Pattern Reconfigurable Alford Loop Antennas
Tajin, M. A. S., & Dandekar, K. R. (2021) · International Conference on Electromagnetics in Advanced Applications (ICEAA) · doi:10.1109/iceaa52647.2021.9539565 · Cited by 3
Self-citationMachine Learning-Based Beam Alignment in mmWave Networks
Yang, P., Wu, W. R., Zhang, N., & Shen, X. (2021) · Wireless networks · doi:10.1007/978-3-030-88630-1_3 · Cited by 3
Beam Learning - Using Machine Learning for Finding Beam DirectionsPreprint
Amuru, S. (2019) · arXiv (Cornell University) · doi:10.13140/rg.2.2.11918.41281 · Cited by 3
Two-Dimensional Beam Selection by Multiarmed Bandit Algorithm Based on a Quantum Walk
Arai, M., Yamagami, T., Mihana, T., Horisaki, R., & Hasegawa, M. (2025) · IEEE Transactions on Quantum Engineering · doi:10.1109/tqe.2025.3555145 · Cited by 3
Wang, H., Li, A., Liu, Y., Qin, Q., Song, L., & Li, Y. (2022) · IEEE Vehicular Technology Conference · doi:10.1109/vtc2022-spring54318.2022.9860955 · Cited by 2
Online Antenna Mode Selection for Reconfigurable MIMO via Adaptive Bandit
Zhang, B., & Li, A. (2023) · International Conference on Wireless Communications and Signal Processing (WCSP) · doi:10.1109/wcsp58612.2023.10404876 · Cited by 2
Reinforcement learning system to mitigate small-cell interference through directionality
Paatelma, A., Nguyen, D. H., Saarnisaari, H., Kandasamy, N., & Dandekar, K. R. (2017) · IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC) · doi:10.1109/pimrc.2017.8292393 · Cited by 2
Self-citationFast beam tracking in Massive MIMO by Laser Chaos Decision Maker
Asano, H., Arai, M., & Hasegawa, M. (2025) · Nonlinear Theory and Its Applications IEICE · doi:10.1587/nolta.16.495 · Cited by 1
Hossain, M. S., Anim, K., Mainland, G., & Dandekar, K. R. (2025) · IEEE Journal of Radio Frequency Identification · doi:10.1109/jrfid.2025.3586561 · Cited by 1
Self-citationPattern Design for Linear Precoded Reconfigurable MU-MISO Communication System
Zhang, B., Zhong, T., & Li, A. (2025) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2025.3589431 · Cited by 1
Design and implementation of the Secondary User-Enhanced Spectrum Sharing (SUESS) radio
Lackpour, A., Mason, S., Hamilton, C., Tigreros, D., Giovannucci, M., Marcou, M., Liu, Y., Jacovic, M., & Dandekar, K. R. (2017) · IEEE International Symposium on Dynamic Spectrum Access Networks · doi:10.1109/dyspan.2017.7920785 · Cited by 1
Self-citationArai, M., & Hasegawa, M. (2024) · International Conference on Artificial Intelligence in Information and Communication (ICAIIC) · doi:10.1109/icaiic60209.2024.10463301 · Cited by 1
Performance of pattern diversity in reconfigurable antenna arrays
Sworo, G. D., Dandekar, K. R., & Kam, M. (2016) · Conference on Information Sciences and Systems · doi:10.1109/ciss.2016.7460477 · Cited by 1
Self-citationAmuru, S. (2017) · International Conference on Communications · doi:10.1109/icc.2017.7996561 · Cited by 1
Millimetre wave coarse beamforming using outband sub‐6 GHz reconfigurable antennas
Bshara, O., Pano, V., Tajin, M. A. S., & Dandekar, K. R. (2021) · IET Communications · doi:10.1049/cmu2.12285
Self-citationRadiation Pattern Design for Reconfigurable MU-MISO System with Zero-Forcing Precoding
Zhang, B., Zhong, T., Liang, M., & Li, A. (2025) · IEEE Vehicular Technology Conference · doi:10.1109/vtc2025-spring65109.2025.11174671
Arai, M., Yamagami, T., Mihana, T., Horisaki, R., & Hasegawa, M. (2026) · International Conference on Artificial Intelligence in Information and Communication (ICAIIC) · doi:10.1109/icaiic68212.2026.11454408
Metadata
- Authors
- Gulati, N., & Dandekar, K. R.
- Affiliations
- Drexel University (US)
- ORCID
- Dandekar, Kapil R.
- Venue
- IEEE Transactions on Antennas and Propagation
- Published
- 2014-03
- Volume
- 62
- Issue
- 3
- Pages
- 1027-1038
- ISSN
- 0018-926X (ISSN-L)
- 1558-2221
- OpenAlex
- W2088530598
- Cited by
- 69
- References
- 39
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 5 · 2023: 4 · 2022: 8 · 2021: 8 · 2020: 4 · 2019: 9 · 2018: 4 · 2017: 5 · 2016: 6 · 2015: 8 · 2014: 1
- FWCI
- 8.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Antennas and Propagation (publishedVersion)
- Funders
- National Science Foundation (0916480)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Antenna Design and Analysis
- Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Wireless Communication Techniques
- Keywords
- reconfigurable antenna, multi-armed bandits, online learning, partial channel state information, MIMO-OFDM, link quality metrics, channel training, radiation pattern shaping
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.