Enabling Cognitive Smart Cities Using Big Data and Machine Learning: Approaches and Challenges
Open accessThe DOI matches its Crossref record; 14 of the 16 references it cites were found in a registry or an index.
Abstract
The development of smart cities and their fast-paced deployment is resulting in the generation of large quantities of data at unprecedented rates. Unfortunately, most of the generated data is wasted without extracting potentially useful information and knowledge because of the lack of established mechanisms and standards that benefit from the availability of such data. Moreover, the highly dynamic nature of smart cities calls for a new generation of machine learning approaches that are flexible and adaptable to cope with the dynamicity of data to perform analytics and learn from real-time data. In this article, we shed light on the challenge of underutilizing the big data generated by smart cities from a machine learning perspective. In particular, we present the phenomenon of wasting unlabeled data. We argue that semi-supervision is a must for smart cities to address this challenge. We also propose a three-level learning framework for smart cities that matches the hierarchical nature of big data generated by smart cities with a goal of providing different levels of knowledge abstraction. The proposed framework is scalable to meet the needs of smart city services. Fundamentally, the framework benefits from semi-supervised deep reinforcement learning where a small amount of data that has users' feedback serves as labeled data, while a larger amount without such users' feedback serves as unlabeled data. The framework utilizes a mix of labeled and unlabeled data to converge toward better control policies instead of wasting the unlabeled data. This article also explores how deep reinforcement learning and its shift toward semi-supervision can handle the cognitive side of smart city services and improve their performance by providing several use cases spanning the different domains of smart cities. We also highlight several challenges as well as promising future research directions for incorporating machine learning and high-level intelligence into smart city services.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The recent advances of edge computing migrate the massive computation from the remote cloud to the local edge, enabling more low-latency and secure manufacturing [129].”
From Deep learning for edge computing applications: A State-of-the-Art survey (2020) · cites this paper as [129]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Internet of Things: A Survey on Enabling Technologies, Protocols, and Applications
Al-Fuqaha, A., Guizani, M., Mohammadi, M., Aledhari, M., & Ayyash, M. (2015) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2015.2444095 · Cited by 8,630
Self-citationContext Aware Computing for The Internet of Things: A Survey
Perera, C., Zaslavsky, A., Christen, P., & Georgakopoulos, D. (2014) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2013.042313.00197 · Cited by 2,861
Semi-Supervised Learning with Deep Generative Models
Kingma, D. P., Rezende, D. J., Mohamed, S., & Welling, M. (2014) · UvA-DARE (University of Amsterdam) · doi:10.48550/arxiv.1406.5298 · Cited by 1,415
Cognitive internet of things: A new paradigm beyond connection
Wu, Q., Ding, G., Xu, Y., Feng, S., Du, Z., Wang, J., & Long, K. (2014) · IEEE Internet of Things Journal · doi:10.1109/jiot.2014.2311513 · Cited by 550
Semisupervised Deep Reinforcement Learning in Support of IoT and Smart City Services
Mohammadi, M., Al-Fuqaha, A., Guizani, M., & Oh, J.-S. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2017.2712560 · Cited by 435
Self-citationEnabling smart cities through a cognitive management framework for the internet of things
Vlacheas, P., Giaffreda, R., Stavroulaki, V., Kelaidonis, D., Foteinos, V., Poulios, G., Demestichas, P., Somov, A., Biswas, A., & Moessner, K. (2013) · IEEE Communications Magazine · doi:10.1109/mcom.2013.6525602 · Cited by 409
Incorporating Intelligence in Fog Computing for Big Data Analysis in Smart Cities
Tang, B., Chen, Z., Hefferman, G., Pei, S., Wei, T., He, H., & Yang, Q. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2679740 · Cited by 353
Intelligent Metering for Urban Water: A Review
Boyle, T., Giurco, D., Mukheibir, P., Liu, A., Moy, C., White, S., & Stewart, R. (2013) · Water · doi:10.3390/w5031052 · Cited by 218
Toward better horizontal integration among IoT services
Al-Fuqaha, A., Khreishah, A., Guizani, M., Rayes, A., & Mohammadi, M. (2015) · IEEE Communications Magazine · doi:10.1109/mcom.2015.7263375 · Cited by 198
Self-citationSmart Home: Cognitive Interactive People-Centric Internet of Things
Feng, S., Setoodeh, P., & Haykin, S. (2017) · IEEE Communications Magazine · doi:10.1109/mcom.2017.1600682cm · Cited by 157
Fuzzy knowledge representation in cognitive cities
Kaltenrieder, P., Portmann, E., & Myrach, T. (2015) · IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) · doi:10.1109/fuzz-ieee.2015.7337951 · Cited by 36
Transfer Learning in Body Sensor Networks Using Ensembles of Randomized Trees
Casale, P., Altini, M., & Amft, O. (2015) · IEEE Internet of Things Journal · doi:10.1109/jiot.2015.2389335 · Cited by 13
Smart Grid Paybacks: The Chattanooga Example
Talbot, D., & Paz-Canales, M. (2017) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 1
Research works printed but not linked: 1
- han, 2015, Learning Both Weights and Connections for Efficient Neural Network, Advances in neural information processing systems, 1135
Cited by
Federated Learning for Internet of Things: A Comprehensive Survey
Nguyen, D. C., Ding, M., Pathirana, P. N., Seneviratne, A., Li, J., & Vincent Poor, H. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3075439 · Cited by 1,503
“To realize smart cities, AI/ML techniques have been widely adopted to provide intelligence properties thanks to their ability to handle real-time big data generated from sensors, devices, and human activities [152].”
BackgroundDeep Learning for IoT Big Data and Streaming Analytics: A Survey
Mohammadi, M., Al-Fuqaha, A., Sorour, S., & Guizani, M. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2844341 · Cited by 1,471
Self-citationFederated Learning for Internet of Things: A Comprehensive Survey
Nguyen, D., Ding, M., Pathirana, P. N., Seneviratne, A., Li, J., & Poor, H. (2021) · Deakin Research Online (Deakin University) · Cited by 889
Applications of Blockchains in the Internet of Things: A Comprehensive Survey
Ali, M. S., Vecchio, M., Pincheira, M., Dolui, K., Antonelli, F., & Rehmani, M. H. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2886932 · Cited by 855
Artificial intelligence for the metaverse: A survey
Huynh-The, T., Pham, Q.-V., Pham, X.-Q., Nguyen, T. T., Han, Z., & Kim, D.-S. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105581 · Cited by 710
Metadata
- Authors
- Mohammadi, M., & Al-Fuqaha, A.
- Affiliations
- Western Michigan University (US)
- ORCID
- Mohammadi, Mehdi
- Venue
- IEEE Communications Magazine
- Published
- 2018-02
- Volume
- 56
- Issue
- 2
- Pages
- 94-101
- ISSN
- 0163-6804 (ISSN-L)
- OpenAlex
- W2787114603
- Cited by
- 377
- References
- 16
- Citations by year
- 2026: 18 · 2025: 33 · 2024: 37 · 2023: 47 · 2022: 56 · 2021: 66 · 2020: 70 · 2019: 41 · 2018: 9
- FWCI
- 35.24
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Communications Magazine (publishedVersion)
- arXiv (Cornell University) (publishedVersion)
- arXiv (Cornell University)
- Topics
- Social Sciences › Urban Studies › Smart Cities and Technologies
- Physical Sciences › Computer Science › Information Systems › Internet of Things and AI
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- smart cities, big data, unlabeled data, knowledge abstraction, real-time analytics, user feedback, control policy learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.