The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Semisupervised Deep Reinforcement Learning in Support of IoT and Smart City Services
Open accessAbstract
Smart services are an important element of the smart cities and the Internet of Things (IoT) ecosystems where the intelligence behind the services is obtained and improved through the sensory data. Providing a large amount of training data is not always feasible; therefore, we need to consider alternative ways that incorporate unlabeled data as well. In recent years, deep reinforcement learning (DRL) has gained great success in several application domains. It is an applicable method for IoT and smart city scenarios where auto-generated data can be partially labeled by users' feedback for training purposes. In this paper, we propose a semisupervised DRL model that fits smart city applications as it consumes both labeled and unlabeled data to improve the performance and accuracy of the learning agent. The model utilizes variational autoencoders as the inference engine for generalizing optimal policies. To the best of our knowledge, the proposed model is the first investigation that extends DRL to the semisupervised paradigm. As a case study of smart city applications, we focus on smart buildings and apply the proposed model to the problem of indoor localization based on Bluetooth low energy signal strength. Indoor localization is the main component of smart city services since people spend significant time in indoor environments. Our model learns the best action policies that lead to a close estimation of the target locations with an improvement of 23% in terms of distance to the target and at least 67% more received rewards compared to the supervised DRL model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408
Internet of Things: A Survey on Enabling Technologies, Protocols, and Applications
Al-Fuqaha, A., Guizani, M., Mohammadi, M., Aledhari, M., & Ayyash, M. (2015) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2015.2444095 · Cited by 8,630
Self-citationKLEPEIS, N. E., NELSON, W. C., OTT, W. R., ROBINSON, J. P., TSANG, A. M., SWITZER, P., BEHAR, J. V., HERN, S. C., & ENGELMANN, W. H. (2001) · Journal of Exposure Science & Environmental Epidemiology · doi:10.1038/sj.jea.7500165 · Cited by 4,803
(2006) · The MIT Press eBooks · doi:10.7551/mitpress/9780262033589.001.0001 · Cited by 4,280
Target-driven visual navigation in indoor scenes using deep reinforcement learning
Zhu, Y., Mottaghi, R., Kolve, E., Lim, J. J., Gupta, A., Fei-Fei, L., & Farhadi, A. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989381 · Cited by 1,533
Semi-Supervised Learning with Deep Generative Models
Kingma, D. P., Rezende, D. J., Mohamed, S., & Welling, M. (2014) · UvA-DARE (University of Amsterdam) · doi:10.48550/arxiv.1406.5298 · Cited by 1,415
Resource Management with Deep Reinforcement Learning
Mao, H., Alizadeh, M., Menache, I., & Kandula, S. (2016) · Proceedings of the 15th ACM Workshop on Hot Topics in Networks · doi:10.1145/3005745.3005750 · Cited by 1,353 · cited 1×
“[22] formulated the problem of job scheduling with multiple resource demands as a DRL process.”
BackgroundConcrete Problems in AI Safety
Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., & Mané, D. (2016) · arXiv · doi:10.48550/arxiv.1606.06565 · Cited by 1,314
Location Fingerprinting with Bluetooth Low Energy Beacons
Faragher, R., & Harle, R. (2015) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2015.2430281 · Cited by 879
Scheffer, T. (2005) · Encyclopedia of Data Warehousing and Mining · doi:10.4018/978-1-59140-557-3.ch192 · Cited by 624
Traffic signal timing via deep reinforcement learning
Li, L., Lv, Y., & Wang, F.-Y. (2016) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2016.7508798 · Cited by 609
Deep Learning via Semi-supervised Embedding
Weston, J., Ratle, F., Mobahi, H., & Collobert, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_34 · Cited by 534
An Uncertain Future: Forecasting from Static Images Using Variational Autoencoders
Walker, J., Doersch, C., Gupta, A., & Hebert, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46478-7_51 · Cited by 449
Active Object Localization with Deep Reinforcement Learning
Caicedo, J. C., & Lazebnik, S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.286 · Cited by 447
DeepFi: Deep learning for indoor fingerprinting using channel state information
Wang, X., Gao, L., Mao, S., & Pandey, S. (2015) · 2015 IEEE Wireless Communications and Networking Conference (WCNC) · doi:10.1109/wcnc.2015.7127718 · Cited by 381
A survey on indoor positioning systems
Mainetti, L., Patrono, L., & Sergi, I. (2014) · 2014 22nd International Conference on Software, Telecommunications and Computer Networks (SoftCOM) · doi:10.1109/softcom.2014.7039067 · Cited by 296
Bluetooth positioning using RSSI and triangulation methods
Wang, Y., Yang, X., Zhao, Y., Liu, Y., & Cuthbert, L. (2013) · 2013 IEEE 10th Consumer Communications and Networking Conference (CCNC) · doi:10.1109/ccnc.2013.6488558 · Cited by 291
Language Understanding for Text-based Games using Deep Reinforcement Learning
Narasimhan, K., Kulkarni, T., & Barzilay, R. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1001 · Cited by 285
Deep Neural Networks for wireless localization in indoor and outdoor environments
Zhang, W., Liu, K., Zhang, W., Zhang, Y., & Gu, J. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.02.055 · Cited by 272
An Indoor Location-Aware System for an IoT-Based Smart Museum
Alletto, S., Cucchiara, R., Del Fiore, G., Mainetti, L., Mighali, V., Patrono, L., & Serra, G. (2016) · IEEE Internet of Things Journal · doi:10.1109/jiot.2015.2506258 · Cited by 263
Microlocation for Internet-of-Things-Equipped Smart Buildings
Zafari, F., Papapanagiotou, I., & Christidis, K. (2015) · IEEE Internet of Things Journal · doi:10.1109/jiot.2015.2442956 · Cited by 249
Deep Reinforcement Learning With Visual Attention for Vehicle Classification
Zhao, D., Chen, Y., & Lv, L. (2017) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2016.2614675 · Cited by 198
Optimal medication dosing from suboptimal clinical examples: a deep reinforcement learning approach
Nemati, S., Ghassemi, M. M., & Clifford, G. D. (2016) · 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2016.7591355 · Cited by 195
Indoor smartphone localization via fingerprint crowdsourcing: challenges and approaches
Wang, B., Chen, Q., Yang, L. T., & Chao, H.-C. (2016) · IEEE Wireless Communications · doi:10.1109/mwc.2016.7498078 · Cited by 175
Deep Reinforcement Learning with a Natural Language Action Space
He, J., Chen, J., He, X., Gao, J., Li, L., Deng, L., & Ostendorf, M. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1153 · Cited by 164
Deep Reinforcement Learning Solutions for Energy Microgrids Management
François-Lavet, V., Taralla, D., Ernst, D., & Raphael Fonteneau, D. (2016) · ORBi (University of Liège) · Cited by 128
Enhancing integrated indoor/outdoor mobility in a smart campus
Torres-Sospedra, J., Avariento, J., Rambla, D., Montoliu, R., Casteleyn, S., Benedito-Bordonau, M., Gould, M. D., & Huerta, J. (2015) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2015.1049541 · Cited by 117
Experiment of indoor position presumption based on RSSI of Bluetooth LE beacon
Kajioka, S., Mori, T., Uchiya, T., Takumi, I., & Matsuo, H. (2014) · 2014 IEEE 3rd Global Conference on Consumer Electronics (GCCE) · doi:10.1109/gcce.2014.7031308 · Cited by 108
Semi-supervised deep extreme learning machine for Wi-Fi based localization
Gu, Y., Chen, Y., Liu, J., & Jiang, X. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.04.011 · Cited by 96
Indoor positioning of shoppers using a network of Bluetooth Low Energy beacons
Dickinson, P., Cielniak, G., Szymanezyk, O., & Mannion, M. (2016) · International Conference on Indoor Positioning and Indoor Navigation · doi:10.1109/ipin.2016.7743684 · Cited by 92
Semi-supervised Learning for WLAN Positioning
Pulkkinen, T., Roos, T., & Myllymäki, P. J. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21735-7_44 · Cited by 69
Deep Reinforcement Learning with a Natural Language Action SpacePreprint
He, J., Chen, J., He, X., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.04636 · Cited by 28
A location-aware architecture for heterogeneous building automation systems
Mainetti, L., Mighali, V., & Patrono, L. (2015) · IFIP/IEEE International Symposium on Integrated Network Management (IM) · doi:10.1109/inm.2015.7140434 · Cited by 25
A New Location-Aware Authorization Mechanism for Indoor Environments
Moreno, M. V., Hernández-Ramos, J. L., & Skármeta, A. (2014) · International Conference on Advanced Information Networking and Applications Workshops (WAINA) · doi:10.1109/waina.2014.160 · Cited by 23
Cited by
Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
Luong, N. C., Hoang, D. T., Gong, S., Niyato, D., Wang, P., Liang, Y.-C., & Kim, D. I. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2916583 · Cited by 2,060
Deep Learning in Mobile and Wireless Networking: A Survey
Zhang, C., Patras, P., & Haddadi, H. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2904897 · Cited by 1,768
Deep Learning for IoT Big Data and Streaming Analytics: A Survey
Mohammadi, M., Al-Fuqaha, A., Sorour, S., & Guizani, M. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2844341 · Cited by 1,471
Self-citationA Survey of Deep Learning: Platforms, Applications and Emerging Research Trends
Hatcher, W. G., & Yu, W. (2018) · IEEE Access · doi:10.1109/access.2018.2830661 · Cited by 654
“) across centralized and distributed cloud computing frameworks, utilizing IoT devices and some novel mechanisms [67], [85], [95], [101], [134], [142], [160].”
BackgroundLu, Y., Huang, X., Zhang, K., Maharjan, S., & Zhang, Y. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.3017668 · Cited by 491
Metadata
- Authors
- Mohammadi, M., Al-Fuqaha, A., Guizani, M., & Oh, J.-S.
- Venue
- IEEE Internet of Things Journal
- Published
- 2018-04
- Volume
- 5
- Issue
- 2
- Pages
- 624-635
- ISSN
- 2327-4662 (ISSN-L)
- OpenAlex
- W2623902153
- Cited by
- 435
- References
- 39
- FWCI
- 26.57
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.