Big Data Analytics for Large-scale Wireless Networks: Challenges and Opportunities
The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
The wide proliferation of various wireless communication systems and wireless devices has led to the arrival of big data era in large-scale wireless networks. Big data of large-scale wireless networks has the key features of wide variety, high volume, real-time velocity, and huge value leading to the unique research challenges that are different from existing computing systems. In this article, we present a survey of the state-of-art big data analytics (BDA) approaches for large-scale wireless networks. In particular, we categorize the life cycle of BDA into four consecutive stages: Data Acquisition, Data Preprocessing, Data Storage, and Data Analytics. We then present a detailed survey of the technical solutions to the challenges in BDA for large-scale wireless networks according to each stage in the life cycle of BDA. Moreover, we discuss the open research issues and outline the future directions in this promising area.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
MapReduce: simplified data processing on large clusters
Dean, J., & Ghemawat, S. (2008) · Communications of the ACM · doi:10.1145/1327452.1327492 · Cited by 18,476
Abdi, H., & Williams, L. J. (2010) · WIREs Computational Statistics · doi:10.1002/wics.101 · Cited by 11,104
Top 10 algorithms in data mining
Wu, X., Kumar, V., Ross Quinlan, J., Ghosh, J., Yang, Q., Motoda, H., McLachlan, G. J., Ng, A., Liu, B., Yu, P. S., et al. (2008) · Knowledge and Information Systems · doi:10.1007/s10115-007-0114-2 · Cited by 5,667 · cited 1×
“…is considered as an instance of supervised learning while clustering is considered as an example of unsupervised learning algorithms The typical classification algorithms include na ¨ ıve Bayes, Bayes networks, k -Nearest Neighbors ( k - NN), support vector machines (SVMs) and C4.5 [183].”
MethodEfficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215 · cited 1×
“Recently, deep learning architectures have received extensive attention [190].”
BackgroundBlockchain challenges and opportunities: a survey
Zheng, Z., Xie, S., Dai, H. N., Chen, X., & Wang, H. (2018) · International Journal of Web and Grid Services · doi:10.1504/ijwgs.2018.095647 · Cited by 3,651
Self-citation(2007) · doi:10.1145/1294261.1294281 · Cited by 3,447
A Survey of Data Mining and Machine Learning Methods for Cyber Security Intrusion Detection
Buczak, A. L., & Guven, E. (2016) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2015.2494502 · Cited by 3,332 · cited 1×
“ssion. Anomaly Detection (or outlier detection) is to identify objects that do not comply with an expected pattern as given. Anomaly detection approaches can be categorized into the following types [184]: (a) supervised anomaly detection schemes, (b) unsupervised anomaly detection schemes, and (c) semi-supervised anom…”
BackgroundMobile Edge Computing: A Survey on Architecture and Computation Offloading
Mach, P., & Becvar, Z. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2682318 · Cited by 3,258
Chen, M., Mao, S., & Liu, Y. (2014) · Mobile Networks and Applications · doi:10.1007/s11036-013-0489-0 · Cited by 2,913 · cited 1×
“[6] gives a survey on BDA from the aspect of enabling technologies .”
BackgroundLin, J., Yu, W., Zhang, N., Yang, X., Zhang, H., & Zhao, W. (2017) · IEEE Internet of Things Journal · doi:10.1109/jiot.2017.2683200 · Cited by 2,793
Wu, X., Zhu, X., Wu, G.-Q., & Ding, W. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2013.109 · Cited by 2,410
Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks
Zhang, C., Li, P., Sun, G., Guan, Y., Xiao, B., & Cong, J. (2015) · Proceedings of the 2015 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/2684746.2689060 · Cited by 2,158 · cited 1×
“For example, there are some efforts in FPGA-oriented Convolutional neural network (CNN) [233] and FPGA deep learning algorithm [234], which have the better performance than those implemented in common PCs.”
A review of internet of things for smart home: challenges and solutions
Risteska Stojkoska, B. L., & Trivodaliev, K. V. (2017) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2016.10.006 · Cited by 1,397 · cited 1×
“om the ambiance. The typical killer applications of IoT include the logistic management with Radio-Frequency Identification (RFID) technology [34], environmental monitoring with WSNs [35], smart homes [36], e-health [37], smart grids [38], Maritime Industry [39], smart city [40], etc. Wireless sensor networks (WSNs) ca…”
BackgroundTrojaning Attack on Neural Networks
Liu, Y., Ma, S., Aafer, Y., Lee, W.-C., Zhai, J., Wang, W., & Zhang, X. (2018) · Proceedings 2018 Network and Distributed System Security Symposium · doi:10.14722/ndss.2018.23291 · Cited by 1,270
Blockchain for internet of things: a survey
Dai, H.-N., Zheng, Z., & Zhang, Y. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2920987 · Cited by 1,246
Self-citationDeep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training
Lin, Y., Han, S., Mao, H., Wang, Y., & Dally, W. J. (2017) · arXiv · doi:10.48550/arxiv.1712.01887 · Cited by 1,134 · cited 1×
“resources at different computing devices. However, it is challenging to allocate and coordinate various computing resources distributed in large scale networks. Lightweight BDA schemes. It is shown [250] that AlexNet (i.e., a typical convolutional neural network) has the model size of 240MB, consequently resulting in…”
BackgroundToward Scalable Systems for Big Data Analytics: A Technology Tutorial
Hu, H., Wen, Y., Chua, T.-S., & Li, X. (2014) · IEEE Access · doi:10.1109/access.2014.2332453 · Cited by 1,099 · cited 3×
“The study of [5] presents a tutorial on BDA from the scalability of BDA platforms.”
BackgroundCache in the air: exploiting content caching and delivery techniques for 5G systems
Wang, X., Chen, M., Taleb, T., Ksentini, A., & Leung, V. (2014) · IEEE Communications Magazine · doi:10.1109/mcom.2014.6736753 · Cited by 1,063 · cited 2×
“dea of content-centric networks is to cache the popular contests at the intermediate servers (base stations, gateways or routers) so that the user demands for the same content can be fulfilled locally [76]. As a result, a lot of traffic can be significantly reduced. The collected data will be further transmitted to the s…”
BackgroundMachine learning in wireless sensor networks: Algorithms, strategies, and applications
Alsheikh, M. A., Lin, S., Niyato, D., & Tan, H.-P. (2014) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2014.2320099 · Cited by 965
Collaborative Mobile Edge Computing in 5G Networks: New Paradigms, Scenarios, and Challenges
Tran, T. X., Hajisami, A., Pandey, P., & Pompili, D. (2017) · IEEE Communications Magazine · doi:10.1109/mcom.2017.1600863 · Cited by 874
Manipulating Machine Learning: Poisoning Attacks and Countermeasures for Regression Learning
Jagielski, M., Oprea, A., Biggio, B., Liu, C., Nita-Rotaru, C., & Li, B. (2018) · 2018 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2018.00057 · Cited by 861
Cheng, Y., Wang, D., Zhou, P., & Zhang, T. (2018) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2765695 · Cited by 817 · cited 1×
“g lightweight BDA schemes and compressing BDA models [251]. It requires the efforts in hardware design, optimization, data compression, distributed computing and machine learning to achieve this goal [252]. IX. CONCLUSION In this paper, we present a detailed survey on big data analytics (BDA) for large scale wireless…”
MethodFadlullah, Z. M., Tang, F., Mao, B., Kato, N., Akashi, O., Inoue, T., & Mizutani, K. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2707140 · Cited by 810 · cited 1×
“There are two typical deep learning approaches: Convolutional Neural Networks (CNNs) and Deep Belief Networks (DBNs) [191].”
BackgroundBig data for development: a review of promises and challenges
Hilbert, M. (2016) · Development Policy Review · doi:10.1111/dpr.12142 · Cited by 679
Internet-of-Things-Based Smart Cities: Recent Advances and Challenges
Mehmood, Y., Ahmad, F., Yaqoob, I., Adnane, A., Imran, M., & Guizani, S. (2017) · IEEE Communications Magazine · doi:10.1109/mcom.2017.1600514 · Cited by 673 · cited 1×
“ic management with Radio-Frequency Identification (RFID) technology [34], environmental monitoring with WSNs [35], smart homes [36], e-health [37], smart grids [38], Maritime Industry [39], smart city [40], etc. Wireless sensor networks (WSNs) can be regarded a subcategory of IoT technologies [41]. WSNs were first propo…”
BackgroundRobust Network Traffic Classification
Zhang, J., Chen, X., Xiang, Y., Zhou, W., & Wu, J. (2015) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2014.2320577 · Cited by 391
Toward efficient and privacy-preserving computing in big data era
Lu, R., Zhu, H., Liu, X., Liu, J. K., & Shao, J. (2014) · IEEE Network · doi:10.1109/mnet.2014.6863131 · Cited by 325
Machine learning for vehicular networks: Recent advances and application examples
Ye, H., Liang, L., Ye Li, G., Kim, J., Lu, L., & Wu, M. (2018) · IEEE Vehicular Technology Magazine · doi:10.1109/mvt.2018.2811185 · Cited by 303
Live Data Analytics With Collaborative Edge and Cloud Processing in Wireless IoT Networks
Sharma, S. K., & Wang, X. (2017) · IEEE Access · doi:10.1109/access.2017.2682640 · Cited by 241 · cited 1×
“[121] [118] [120] [47] [122] [124] [123] [125] [126] [68] [127] Data storage: Reliability & Persistency Scalability Efficiency [145] [147] [75] [151] [150] [136] [135] [32] [215] [130] [148] [149] [216] Data Analytics: Temporal-spatial correlation [203] [204] [207]Efficiency Privacy Real-time [198] [199] [200] [201]…”
Social influence modeling using information theory in mobile social networks
Peng, S., Yang, A., Cao, L., Yu, S., & Xie, D. (2017) · Information Sciences · doi:10.1016/j.ins.2016.08.023 · Cited by 200
Distributed Real-Time Anomaly Detection in Networked Industrial Sensing Systems
Chen, P.-Y., Yang, S., & McCann, J. A. (2015) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2014.2350451 · Cited by 148 · cited 2×
“30] [148] [149] [216] Data Analytics: Temporal-spatial correlation [203] [204] [207]Efficiency Privacy Real-time [198] [199] [200] [201] [51] [202] [208] [54] [209] [205] [214] [210] [211] [212] [213] [217] [218] [219] [220] [221] [222] [68] method, which uses the training data derived from both reference-tag coordinat…”
BackgroundVisualization of Driving Behavior Based on Hidden Feature Extraction by Using Deep Learning
Liu, H., Taniguchi, T., Tanaka, Y., Takenaka, K., & Bando, T. (2017) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2017.2649541 · Cited by 141
El Khayat, I., Geurts, P., & Leduc, G. (2010) · Wireless Networks · doi:10.1007/s11276-008-0129-y · Cited by 34
Cited by
Blockchain for internet of things: a survey
Dai, H.-N., Zheng, Z., & Zhang, Y. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2920987 · Cited by 1,246
Self-citationPrecision agriculture using IoT data analytics and machine learning
Akhter, R., & Sofi, S. A. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2021.05.013 · Cited by 557
Wu, Y., Dai, H.-N., & Wang, H. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3025916 · Cited by 323
Self-citationWu, Y., Dai, H.-N., Wang, H., Xiong, Z., & Guo, S. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3158270 · Cited by 323
Self-citationZuo, Y., Wu, Y., Min, G., Huang, C., & Pei, K. (2020) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2020.2966615 · Cited by 94
Metadata
- Authors
- Dai, H.-N., Wong, R. C.-W., Wang, H., Zheng, Z., & Vasilakos, A. V.
- Venue
- ACM Computing Surveys
- Published
- 2019-09-13
- Volume
- 52
- Issue
- 5
- Pages
- 1-36
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W4288079681
- Cited by
- 124
- References
- 33
- FWCI
- 21.53
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.