Big IoT Data Analytics: Architecture, Opportunities, and Open Research Challenges
Open accessThe DOI matches its Crossref record; 85 of the 87 references it cites were found in a registry or an index.
Abstract
Voluminous amounts of data have been produced, since the past decade as the miniaturization of Internet of things (IoT) devices increases. However, such data are not useful without analytic power. Numerous big data, IoT, and analytics solutions have enabled people to obtain valuable insight into large data generated by IoT devices. However, these solutions are still in their infancy, and the domain lacks a comprehensive survey. This paper investigates the state-of-the-art research efforts directed toward big IoT data analytics. The relationship between big data analytics and IoT is explained. Moreover, this paper adds value by proposing a new architecture for big IoT data analytics. Furthermore, big IoT data analytic types, methods, and technologies for big data mining are discussed. Numerous notable use cases are also presented. Several opportunities brought by data analytics in IoT paradigm are then discussed. Finally, open research challenges, such as privacy, big data mining, visualization, and integration, are presented as future research directions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Data that is generated by IoT devices are streaming data that continues to grow in volume and velocity and is considered by a few researchers as pure big data (Marjani et al., 2017).”
From IoMT amid COVID-19 pandemic: Application, architecture, technology, and security (2021) · cites this paper as Marjani et al., 2017
Citations
Cites
A new mathematical model for relative quantification in real-time RT-PCR
Pfaffl, M. W. (2001) · Nucleic Acids Research · doi:10.1093/nar/29.9.e45 · Cited by 34,610 · cited 1×
“Consequently, two existing architectures have been proposed for real-time analysis: parallel processing clusters using traditional relational databases and memory-based computing platforms [33].”
MethodThe Internet of Things: A survey
Atzori, L., Iera, A., & Morabito, G. (2010) · Computer Networks · doi:10.1016/j.comnet.2010.05.010 · Cited by 15,613
Internet of Things (IoT): A vision, architectural elements, and future directions
Gubbi, J., Buyya, R., Marusic, S., & Palaniswami, M. (2013) · Future Generation Computer Systems · doi:10.1016/j.future.2013.01.010 · Cited by 12,293 · cited 3×
“For example, [13] offered an IoT architecture with cloud computing at the center and a model of end-to-end interaction among various stakeholders in a cloud-centric IoT framework for better comparison with the proposed IoT architecture.”
BackgroundMethodFog computing and its role in the internet of things
Bonomi, F., Milito, R., Zhu, J., & Addepalli, S. (2012) · Proceedings of the first edition of the MCC workshop on Mobile cloud computing · doi:10.1145/2342509.2342513 · Cited by 6,244
(2011) · Cited by 5,203
Beyond the hype: Big data concepts, methods, and analytics
Gandomi, A., & Haider, M. (2015) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2014.10.007 · Cited by 4,226 · cited 1×
“Furthermore, customer buying predictions and social media trends are analyzed through predictive analytics [61] (see Table 2).”
BackgroundData-intensive applications, challenges, techniques and technologies: A survey on Big Data
Philip Chen, C. L., & Zhang, C.-Y. (2014) · Information Sciences · doi:10.1016/j.ins.2014.01.015 · Cited by 3,047 · cited 5×
“Different analytic types are used according to the requirements of IoT applications [32].”
BackgroundMethodInfluentialA Survey of Clustering Data Mining Techniques
Berkhin, P. (2006) · Grouping Multidimensional Data · doi:10.1007/3-540-28349-8_2 · Cited by 2,804 · cited 1×
“Divisive clusters are created in the opposite manner by dividing a single cluster that contains all data objects into smaller appropriate clusters [57].”
BackgroundThe rise of big data on cloud computing: Review and open research issues
Hashem, I. A. T., Yaqoob, I., Anuar, N. B., Mokhtar, S., Gani, A., & Ullah Khan, S. (2015) · Information Systems · doi:10.1016/j.is.2014.07.006 · Cited by 2,656 · cited 2×
“algorithms used in big data analysis, which is not rising linearly with the rapid increase in computational resources [19].”
MethodSelf-citationWu, X., Zhu, X., Wu, G.-Q., & Ding, W. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2013.109 · Cited by 2,410 · cited 1×
“Moreover, researchers have selected existing data mining algorithms in different manners to (a) improve single source knowledge discovery, (b) implement data mining methods for multi-source platforms, and (c) study and analyze dynamic data mining methods and stream data [84].”
Background
Research works printed but not linked: 15
- kreps, 2011, KAFKA: A distributed messaging system for log processing, Proc NET, 1
- ali, 2016, Big data-driven smart policing: big data-based patrol car dispatching, J Geotech Transp Eng, 1, 1
- oswal, 2013, Big data analytic and visualization on mobile devices, Proceedings of National Conference on New Horizons in IT-NCNHIT, 223
- gantz, 2011, Extracting value from chaos, iDC IView, 1142, 1
- russom, 2011, Big Data Analytics
- chen, 2014, Related Technologies in Big Data, 11
- pettey, 2015, Five Ways the Internet of Things Will Benefit the Supply Chain
- tohamy, 2015, What you need to know about the Internet of Things, MHD Supply Chain Solutions, 45, 32
- sherly, 2015, Internet of Things based smart transportation systems, International Journal of Engineering Research and Technology, 2
- 2013, Five Big Data Challenges and How to Overcome Them With Visual Analytics
- 2013, White Paper Big Data Visualization Turning Big Data Into Big Insights
- agrawal, 2012, Challenges and Opportunities with Big Data A Community White Paper Developed by Leading Researchers Across the United States
- russom, 2011, Big Data Analytics, 1
- lavalle, 2011, Big data, analytics and the path from insights to value, Mit Sloan Manag Rev, 52, 21
- ciufo, 2014, Industrial Equipment Talking on the IoT? Bet- ter get a Gateway (Device)
Cited by
An Overview of Internet of Things (IoT) and Data Analytics in Agriculture: Benefits and Challenges
Elijah, O., Rahman, T. A., Orikumhi, I., Leow, C. Y., & Hindia, M. H. D. N. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2844296 · Cited by 1,467
“There are several DA methods which has been discussed in detail in [95].”
MethodCICIoT2023: A Real-Time Dataset and Benchmark for Large-Scale Attacks in IoT Environment
Neto, E. C. P., Dadkhah, S., Ferreira, R., Zohourian, A., Lu, R., & Ghorbani, A. A. (2023) · Sensors · doi:10.3390/s23135941 · Cited by 1,194
A Survey of Machine and Deep Learning Methods for Internet of Things (IoT) Security
Al-Garadi, M. A., Mohamed, A., Al-Ali, A. K., Du, X., Ali, I., & Guizani, M. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2988293 · Cited by 1,392
“in which the electricity between suppliers and consumers is handled smartly to improve efficiency, safety and real-time monitoring [66]–[68].”
BackgroundA Review on the Use of Blockchain for the Internet of Things
Fernandez-Carames, T. M., & Fraga-Lamas, P. (2018) · IEEE Access · doi:10.1109/access.2018.2842685 · Cited by 1,078
The Future of Healthcare Internet of Things: A Survey of Emerging Technologies
Qadri, Y. A., Nauman, A., Zikria, Y. B., Vasilakos, A. V., & Kim, S. W. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2973314 · Cited by 840
“Authors in [167], [168] and [169] have identified the challenges of implementing big data analytics in H-IoT and IoT in general.”
Background
Metadata
- Authors
- Marjani, M., Nasaruddin, F. H., Gani, A., Karim, A., Hashem, M., Siddiqa, A., & Yaqoob, I.
- Affiliations
- University of Malaya (MY)
- Bahauddin Zakariya University (PK)
- ORCID
- Venue
- IEEE Access
- Published
- 2017
- Volume
- 5
- Pages
- 5247-5261
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2613310014
- Cited by
- 980
- References
- 87
- Citations by year
- 2026: 30 · 2025: 80 · 2024: 88 · 2023: 112 · 2022: 145 · 2021: 185 · 2020: 152 · 2019: 116 · 2018: 62 · 2017: 10
- FWCI
- 173.11
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion)
- Charles Sturt University Research Output (CRO) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Malaysian Ministry of Higher Education under University Malaya Research Grant (UMRG) Project/Program (UM.0000168/HRU.RP.IT, RP029D-14AET)
- Topics
- Physical Sciences › Computer Science › Information Systems › Internet of Things and AI
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Social Sciences › Decision Sciences › Information Systems and Management › Big Data Technologies and Applications
- Keywords
- Internet of Things, big data analytics, big data mining, data visualization, data privacy, data integration, IoT use cases, open problems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.