Learning State Selection for Reconfigurable Antennas: A Multi-Armed Bandit Approach
The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Reconfigurable antennas are capable of dynamically re-shaping their radiation patterns in response to the needs of a wireless link or a network. In order to utilize the benefits of reconfigurable antennas, selecting an optimal antenna state for communication is essential and depends on the availability of full channel state information for all the available antenna states. We consider the problem of reconfigurable antenna state selection in a single user MIMO system. We first formulate the state selection as a multi-armed bandit problem that aims to optimize arbitrary link quality metrics. We then show that by using online learning under a multi-armed bandit framework, a sequential decision policy can be employed to learn optimal antenna states without instantaneous full CSI and without a priori knowledge of wireless channel statistics. Our objective is to devise an adaptive state selection technique when the channels corresponding to all the states are not directly observable and compare our results against the case of a known model or genie with full information. We evaluate the performance of the proposed antenna state selection technique by identifying key link quality metrics and using measured channels in a 2 × 2 MIMO OFDM system. We show that the proposed technique maximizes long term link performance with reduced channel training frequency.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Goldsmith, A. (2005) · Cambridge University Press eBooks · doi:10.1017/cbo9780511841224 · Cited by 10,658
(2006) · Choice Reviews Online · doi:10.5860/choice.43-4686 · Cited by 8,128
Finite-time Analysis of the Multiarmed Bandit Problem
Auer, P., Cesa-Bianchi, N., & Fischer, P. (2002) · Machine Learning · doi:10.1023/a:1013689704352 · Cited by 6,033
Wolniansky, P. W., Foschini, G. J., Golden, G. D., & Valenzuela, R. A. (2002) · 1998 URSI International Symposium on Signals, Systems, and Electronics. Conference Proceedings (Cat. No.98EX167) · doi:10.1109/issse.1998.738086 · Cited by 3,527
Asymptotically efficient adaptive allocation rules
Lai, T. L., & Robbins, H. (1985) · Advances in Applied Mathematics · doi:10.1016/0196-8858(85)90002-8 · Cited by 2,406
Bandit processes and dynamic allocation indices
Gittins, J. C. (1979) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1979.tb01068.x · Cited by 1,487 · cited 2×
“In the seminal work of Gittins [21], it was shown that the optimal policy of MAB with Bayesian formulation where reward distributions are known, has a simple index structure, i.”
BackgroundSwitching Between Diversity and Multiplexing in MIMO Systems
Heath, R. W., & Paulraj, A. J. (2005) · IEEE Transactions on Communications · doi:10.1109/tcomm.2005.849774 · Cited by 414
Distributed Learning in Multi-Armed Bandit With Multiple Players
Liu, K., & Zhao, Q. (2010) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2010.2062509 · Cited by 385
On myopic sensing for multi-channel opportunistic access: structure, optimality, and performance
Zhao, Q., Krishnamachari, B., & Liu, K. (2008) · IEEE Transactions on Wireless Communications · doi:10.1109/t-wc.2008.071349 · Cited by 360
Anantharam, V., Varaiya, P., & Walrand, J. (1987) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1987.1104491 · Cited by 358
Cognitive Medium Access: Exploration, Exploitation, and Competition
Lai, L., El Gamal, H., Jiang, H., & Poor, H. V. (2011) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2010.65 · Cited by 351
Design and Evaluation of a Reconfigurable Antenna Array for MIMO Systems
Piazza, D., Kirsch, N. J., Forenza, A., Heath, R. W., & Dandekar, K. R. (2008) · IEEE Transactions on Antennas and Propagation · doi:10.1109/tap.2008.916908 · Cited by 276
Self-citationAiming Perfectly in the Dark-Blind Interference Alignment Through Staggered Antenna Switching
Gou, T., Wang, C., & Jafar, S. A. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2129517 · Cited by 255
Error vector magnitude to SNR conversion for nondata-aided receivers
Mahmoud, H. A., & Arslan, H. (2009) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2009.080862 · Cited by 225
Gai, Y., Krishnamachari, B., & Jain, R. (2010) · 2010 IEEE Symposium on New Frontiers in Dynamic Spectrum (DySPAN) · doi:10.1109/dyspan.2010.5457857 · Cited by 224
Design, Fabrication, and Measurements of an RF-MEMS-Based Self-Similar Reconfigurable Antenna
Anagnostou, D. E., Zheng, G., Chryssomallis, M. T., Lyke, J. C., Ponchak, G. E., Papapolymerou, J., & Christodoulou, C. G. (2006) · IEEE Transactions on Antennas and Propagation · doi:10.1109/tap.2005.863399 · Cited by 223
(2011) · Compact Antennas for Wireless Communications and Terminals · doi:10.1002/9781118603437.ch10 · Cited by 217
A novel radiation pattern and frequency reconfigurable single turn square spiral microstrip antenna
Huff, G. H., Feng, J., Zhang, S., & Bernhard, J. T. (2003) · IEEE Microwave and Wireless Components Letters · doi:10.1109/lmwc.2003.808714 · Cited by 206
A reconfigurable slot antenna with switchable polarization
Fries, M. K., Grani, M., & Vahldieck, R. (2003) · IEEE Microwave and Wireless Components Letters · doi:10.1109/lmwc.2003.817148 · Cited by 203
Maximizing MIMO Capacity in Sparse Multipath With Reconfigurable Antenna Arrays
Sayeed, A. M., & Raghavan, V. (2007) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2007.897057 · Cited by 200
Bernhard, J. T. (2007) · Synthesis lectures on antennas · doi:10.2200/s00067ed1v01y200707ant004 · Cited by 174
Anantharam, V., Varaiya, P., & Walrand, J. C. (1987) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1987.1104485 · Cited by 146
Performance Study of Pattern Reconfigurable Antennas in MIMO Communication Systems
Boerman, J. D., & Bernhard, J. T. (2008) · IEEE Transactions on Antennas and Propagation · doi:10.1109/tap.2007.913141 · Cited by 127
On the error vector magnitude as a performance metric and comparative analysis
Shafik, R., Rahman, M. S., Islam, A. B. M. T., & Ashraf, N. S. (2006) · International Conference on Emerging Technologies · doi:10.1109/icet.2006.335992 · Cited by 98
A reconfigurable multiple-input multiple-output communication system
Grau, A., Jafarkhani, H., & Flaviis, F. D. (2008) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2008.060905 · Cited by 88
Decentralized Online Learning Algorithms for Opportunistic Spectrum Access
Gai, Y., & Krishnamachari, B. (2011) · Globecom · doi:10.1109/glocom.2011.6134253 · Cited by 81
Cognitive Engine Design for Link Adaptation: An Application to Multi-Antenna Systems
Volos, H. I., & Buehrer, R. M. (2010) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2010.070910.091651 · Cited by 42
A technique for antenna configuration selection for reconfigurable circular patch arrays
Piazza, D., Kountouriotis, J., D'Amico, M. M. G., & Dandekar, K. R. (2009) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2008.080212 · Cited by 34
Self-citationReduced Overhead Training for Multi Reconfigurable Antennas with Beam-Tilting Capability
Eslami, H., Sukumar, C. P., Rodrigo, D., Mopidevi, S., Eltawil, A. M., Jofre, L., & Cetiner, B. A. (2010) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2010.091510.100267 · Cited by 31
Performance Improvement of a Wideband MIMO System by Using Two-Port RLWA
Piazza, D., D'Amico, M. M. G., & Dandekar, K. R. (2009) · IEEE Antennas and Wireless Propagation Letters · doi:10.1109/lawp.2009.2026594 · Cited by 25
Self-citationKe, L., & Wang, Z. (2012) · IEEE Transactions on Information Theory · doi:10.1109/tit.2012.2185483 · Cited by 24
Two port reconfigurable CRLH leaky wave antenna with improved impedance matching and beam tuning
Piazza, D., Michele, D., & Dandekar, K. R. (2009) · Virtual Community of Pathological Anatomy (University of Castilla La Mancha) · Cited by 22
Self-citationTwo port reconfigurable CRLH leaky wave antenna with improved impedance matching and beam tuning
Piazza, Michèle, & Dandekar (2009) · European Conference on Antennas and Propagation · Cited by 22
Dual-band reconfigurable antenna for base-station applications
Jung, Y. (2010) · Electronics Letters · doi:10.1049/el.2010.2622 · Cited by 13
Impact of pattern reconfigurable antennas on Interference Alignment over measured channels
Bahl, R., Gulati, N., Dandekar, K. R., & Jaggard, D. L. (2012) · IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/glocomw.2012.6477634 · Cited by 11
Self-citationTwo port reconfigurable circular patch antenna for MIMO systems
Piazza, D., Mookiah, P., D'Amico, M. M. G., & Dandekar, K. R. (2007) · European Conference on Antennas and Propagation · doi:10.1049/ic.2007.0883 · Cited by 10
Self-citationLink Performance Improvement Using Reconfigurable Multiantenna Systems
Sukumar, C. P., Eslami, H., Eltawil, A. M., & Cetiner, B. A. (2009) · IEEE Antennas and Wireless Propagation Letters · doi:10.1109/lawp.2009.2028300 · Cited by 10
Learning algorithm for reconfigurable antenna state selection
Gulati, N., Gonzalez, D., & Dandekar, K. R. (2012) · IEEE Radio and Wireless Symposium (RWS) · doi:10.1109/rws.2012.6175375 · Cited by 6
Self-citationPerformance analysis of a reconfigurable antenna system for MIMO communications
Kountouriotis, J., Piazza, D., Dandekar, K. R., D'Amico, M. M. G., & Guardiani, C. (2011) · Virtual Community of Pathological Anatomy (University of Castilla La Mancha) · Cited by 3
Self-citation
Research works printed but not linked: 2
- 0, Rice University WARP Project
- 0, Adant
Cited by
Quantum Machine Learning for 6G Communication Networks: State-of-the-Art and Vision for the Future
Nawaz, S. J., Sharma, S. K., Wyne, S., Patwary, M. N., & Asaduzzaman, M. (2019) · IEEE Access · doi:10.1109/access.2019.2909490 · Cited by 658
Reconfigurable Antennas: Design and Applications
Costantine, J., Tawk, Y., Barbin, S. E., & Christodoulou, C. G. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2396000 · Cited by 448
Fast mmwave Beam Alignment via Correlated Bandit Learning
Wu, W. R., Cheng, N., Zhang, N., Yang, P., Zhuang, W., & Shen, X. (2019) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2940454 · Cited by 154
Online Learning for Position-Aided Millimeter Wave Beam Training
Va, V., Shimizu, T., Bansal, G., & Heath, R. W. (2019) · IEEE Access · doi:10.1109/access.2019.2902372 · Cited by 133
Jamming Bandits—A Novel Learning Method for Optimal Jamming
Amuru, S., Tekin, C., van der Schaar, M., & Buehrer, R. M. (2015) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2015.2510643 · Cited by 112
Metadata
- Authors
- Gulati, N., & Dandekar, K. R.
- Affiliations
- Drexel University (US)
- ORCID
- Dandekar, Kapil R.
- Venue
- IEEE Transactions on Antennas and Propagation
- Published
- 2014-03
- Volume
- 62
- Issue
- 3
- Pages
- 1027-1038
- ISSN
- 0018-926X (ISSN-L)
- 1558-2221
- OpenAlex
- W2088530598
- Cited by
- 69
- References
- 39
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 5 · 2023: 4 · 2022: 8 · 2021: 8 · 2020: 4 · 2019: 9 · 2018: 4 · 2017: 5 · 2016: 6 · 2015: 8 · 2014: 1
- FWCI
- 8.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Antennas and Propagation (publishedVersion)
- Funders
- National Science Foundation (0916480)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Antenna Design and Analysis
- Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Wireless Communication Techniques
- Keywords
- reconfigurable antenna, multi-armed bandits, online learning, partial channel state information, MIMO-OFDM, link quality metrics, channel training, radiation pattern shaping
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.