Machine learning with big data: challenges and approaches.
Open accessThe DOI matches its Crossref record; 108 of the 109 references it cites were found in a registry or an index.
Abstract
The Big Data revolution promises to transform how we live, work, and think by enabling process optimization, empowering insight discovery and improving decision making. The realization of this grand potential relies on the ability to extract value from such massive data through data analytics; machine learning is at its core because of its ability to learn from data and provide data driven insights, decisions, and predictions. However, traditional machine learning approaches were developed in a different era, and thus are based upon multiple assumptions, such as the data set fitting entirely into memory, what unfortunately no longer holds true in this new context. These broken assumptions, together with the Big Data characteristics, are creating obstacles for the traditional techniques. Consequently, this paper compiles, summarizes, and organizes machine learning challenges with Big Data. In contrast to other research that discusses challenges, this work highlights the cause–effect relationship by organizing challenges according to Big Data Vs or dimensions that instigated the issue: volume, velocity, variety, or veracity. Moreover, emerging machine learning approaches and techniques are discussed in terms of how they are capable of handling the various challenges with the ultimate objective of helping practitioners select appropriate solutions for their use cases. Finally, a matrix relating the challenges and approaches is presented. Through this process, this paper provides a perspective on the domain, identifies research gaps and opportunities, and provides a strong foundation and encouragement for further research in the field of machine learning with Big Data.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, training these models requires large, diverse, and well-labeled datasets [94].”
From A Review of Passenger Counting in Public Transport Concepts with Solution Proposal Based on Image Processing and Machine Learning (2024) · cites this paper as [94]
In the citing paper
“it is also shifting from a single domain (e.g., domain expertise, or expert systems) to a cross-disciplinary approach through collaboration”
From Challenges and Future Directions of Big Data and Artificial Intelligence in Education (2020) · cites this paper as L’heureux et al., 2017
Citations
Cites
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927 · cited 1×
“• Regularization paths [92] for linear models supports linear regression, two-class logistic regression, and multinomial regression problems.”
MethodThe WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750 · cited 1×
“However, at the moment, they support a limited number of algorithms compared to the R language [73], MATLAB [74], or Weka [75].”
MethodRepresentation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001 · cited 1×
“Representation learning is also often referred to as feature learning [100].”
BackgroundEnsemble methods in machine learning
Dietterich, T. G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45014-9_1 · Cited by 8,408
(2011) · Cited by 5,203
Multiple comparisons among means
Dunn, O. J. (1961) · Journal of the American Statistical Association · doi:10.1080/01621459.1961.10482090 · Cited by 5,006 · cited 1×
“It suggests that if testing m hypotheses with a desired significance of α, each individual hypothesis should be tested at a significance level of α/m [43].”
BackgroundResilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing
Zaharia, M., Chowdhury, M., Das, T., Dave, A., Ma, J. H., McCauley, M., Franklin, M. J. M., Shenker, S. J., & Stoica, I. G. (2012) · UC Berkeley · Cited by 4,891
The Hadoop Distributed File System
Shvachko, K., Kuang, H., Radia, S., & Chansler, R. (2010) · 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST) · doi:10.1109/msst.2010.5496972 · Cited by 4,834 · cited 8×
“In these stages, independent of the category of manipulations, processes can be embedded to capture data provenance and therefore remedy provenance challenge; an example is the Reduce and Map Provenance (RAMP) developed for MapReduce as an extension for Hadoop [64].”
MethodInfluentialHan, S., Mao, H., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1510.00149 · Cited by 4,662 · cited 1×
“Deep compression has been proposed as a way of speeding up processing without the loss of accuracy [105].”
Background
Research works printed but not linked: 20
- goodfellow, 2016, Deep Learning
- marz, 2014, Apache Storm
- rouse, 2011, Machine Learning Definition
- 2015, R A Language and Environment for Statistical Computing, 1
- 2014, IBM Watson Ecosystem Program
- wu, 2016, Google’s neural machine translation system Bridging the gap between human and machine translation
- 2016, Machine Learning American
- 2016, Google Cloud Machine Learning
- 2016, Matlab
- 2013, Billion Devices Will Wirelessly Connect to the Internet of Everything in 2020
- krikorian, 2010, Twitter by the Numbers Twitter
- 2016, H20
- 2016, Apache Mahout
- abadi, 2016, TensorFlow Large-Scale Machine Learning on Heterogeneous Systems
- langford, 2007, Vowpal wabbit online learning project
- rouse, 2009, Predictive Analytics Definition
- sukumar, 2014, Machine learning in the big data era: Are we there yet?, Proc 20th ACM SIGKDD Conf Knowl Discovery Data Mining Workshop Data Sci Social Good (KDD), 1
- 2016, GPU Applications Transforming Computational Research and Engineering
- torrey, 2010, Handbook of Research on Machine Learning Applications and Trends
- 2016, Apache Giraph
Cited by
Items 401–500 of 1,002
Impact of Missing Values in Machine Learning: A Comprehensive AnalysisPreprint
Ahmad, A. F., Sayeed, M. S., Alshammari, K., & Ahmed, I. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.08295 · Cited by 20
Hybrid AI Systems for Tool Wear Monitoring in Manufacturing: A Systematic Review
Saatçı, B. T., Ulaş, M., & Gürgenç, T. (2025) · Applied Sciences · doi:10.3390/app16010208 · Cited by 15
IIoT System for Intelligent Detection of Bottleneck in Manufacturing Lines
Aguilar, M. J. R., Abad, I., & Cerrada, J. A. (2023) · Applied Sciences · doi:10.3390/app14010323 · Cited by 13
Billert, A. M., Yu, R., Erschen, S., Frey, M., & Gauterin, F. (2024) · Big Data Mining and Analytics · doi:10.26599/bdma.2023.9020028 · Cited by 15
Pang, D., Wang, S., Ge, D., Lin, W., Kang, Y., & Li, R. (2024) · Journal of the Knowledge Economy · doi:10.1007/s13132-024-01969-y · Cited by 13
“This method enabled students to participate in self-directed pre-class studies and consolidate their learning after the session, using instructional tasks and educational materials provided by instructors within a structured teaching framework.”
RetractedSaeed, A., Li, C., & Gan, Z. (2024) · Energy · doi:10.1016/j.energy.2024.131590 · Cited by 13
Li, J., Pan, N., Yao, Y., Li, G., Cheng, Z., Lu, Y., Liu, S., & Liu, W. (2024) · Ecological Informatics · doi:10.1016/j.ecoinf.2024.102686 · Cited by 13
Madsen, P. M., Dillon, R. L., & Morris, E. T. (2024) · Risk Analysis · doi:10.1111/risa.15075 · Cited by 13
“As data are collected over multiple years in incident management systems, many of the challenges associated with “Big Data” appear, including the volume, velocity, variety, and veracity (L’Heureux et al., 2017).”
Securing Federated Learning: Approaches, Mechanisms and Opportunities
Moshawrab, M., Adda, M., Bouzouane, A., Ibrahim, H., & Raad, A. (2024) · Electronics · doi:10.3390/electronics13183675 · Cited by 14
Malware Classification Using Few-Shot Learning Approach
Alfarsi, K., Rasheed, S., & Ahmad, I. A. (2024) · Information · doi:10.3390/info15110722 · Cited by 13
Andrade, M. H. B., Szejka, A. L., & Mas, F. (2025) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-025-15473-3 · Cited by 13
“One feature that makes machine learning enjoyable is its ability to extract relevant information from large volumes of data [30].”
Cai, C., Hong, S., Ma, M., Feng, H., Du, S., Chow, M., Teo, W. L.-L., Liu, S., & Fan, X. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13633-2 · Cited by 16
“As a result, these models face challenges such as data imbalance, feature engineering, and issues related to variance and bias (L’heureux et al., 2017).”
Applying machine learning to big data streams : An overview of challenges
Augenstein, C., Spangenberg, N., & Franczyk, B. (2017) · International Conference on Soft Computing & Machine Intelligence (ISCMI) · doi:10.1109/iscmi.2017.8279592 · Cited by 15
“The following table 1 summarizes findings from literature [7, 8, 12] and shows specific challenges for machine learning.”
BackgroundMotor Insurance Claim Status Prediction using Machine Learning Techniques
Alamir, E., Urgessa, T., Hunegnaw, A., & GopiKrishna, T. (2021) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2021.0120354 · Cited by 13
“Big data initially emerged as a term in order to describe data sets whose amount or size is beyond the capability of traditional databases, to capture, store, analyze, manage, and too complex to analyze by traditional data processing techniques and database management tools [9] [13].”
BackgroundBlockchain Based Big Data Solutions for Internet of Things (IoT) and Smart Cities
Kummar, S., Bhushan, B., & Bhatia, S. (2022) · Intelligent systems reference library · doi:10.1007/978-3-030-99329-0_15 · Cited by 14
A Real-Time Application for the Analysis of Multi-Purpose Vending Machines with Machine Learning
Cao, Y., Ikenoya, Y., Kawaguchi, T., Hashimoto, S., & Morino, T. (2023) · Sensors · doi:10.3390/s23041935 · Cited by 13
“Note that the above researchers relied on big data to develop their algorithms and they focus on the products inside the vending machine rather than the vending machine itself.”
A Data Reconstruction Algorithm Based on Neural Network for Compressed Sensing
Tian, L., Li, G., & Wang, C. (2017) · International Conference on Advanced Cloud and Big Data · doi:10.1109/cbd.2017.57 · Cited by 13
“With the availability of big data and the rapid development of computer hardware, researchers have paid more attentions to machine learning [9].”
BackgroundAmplifying Inter-Message Distance: On Information Divergence Measures in Big Data
She, R., Liu, S., & Fan, P. (2017) · IEEE Access · doi:10.1109/access.2017.2768385 · Cited by 13
Akbar, W., Wu, W., Faheem, M. R., Saleem, S., Javed, A., & Saleem, M. A. (2020) · International Conference on Electrical, Communication, and Computer Engineering (ICECCE) · doi:10.1109/icecce49384.2020.9179467 · Cited by 16
“In the Big Data platform, Alexandra et al. [10] discussed the complexities of machine learning techniques.”
MethodBig data reliability: A critical review
Sharma, S., Kumar, N., & Kaswan, K. S. (2021) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-202503 · Cited by 17
“Thelearningprocessbeginswiththe observationsthatlookforspecificdatapatternsto makebetterfuturisticdecisionsbasedonproviding examples[30].”
Badalič, V. (2023) · Critical Military Studies · doi:10.1080/23337486.2023.2170539 · Cited by 16
“Machine learning algorithms used for metadata analysis are based on statistics, and they extract statistical trends from the available data (L’Heureux et al. 2017).”
MethodEdgeFL: A Lightweight Decentralized Federated Learning Framework
Zhang, H., Bosch, J., & Olsson, H. H. (2024) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac61105.2024.00081 · Cited by 15
“Traditional machine learning models typically require centralizing all the data in one location for training, which can be challenging due to data privacy concerns, legal restrictions, and computational constraints [1].”
BackgroundDigital Twin as A New Approach to Data Management: A Review
Malaibari, M., Siddiqui, M., Xie, S., Bahramimianrood, B., Abdoli, S., & Djukic, L. (2024) · Procedia CIRP · doi:10.1016/j.procir.2024.06.028 · Cited by 17
Transforming Physiology and Healthcare through Foundation Models
Godwin, R. C., Tung, A., Berkowitz, D. E., & Melvin, R. L. (2025) · Physiology · doi:10.1152/physiol.00048.2024 · Cited by 13
Provatas, N., Konstantinou, I., & Koziris, N. (2025) · IEEE Access · doi:10.1109/access.2025.3535085 · Cited by 16
“While various Map-Reduce approaches have been discussed in the learning domain, the iterative approach of these algorithms is in contrast with the nature of the Map-Reduce paradigm [63].”
Le-Xuan, T., Nguyen, T. C., Bui-Tien, T., & Tran, H. N. (2025) · Engineering Structures · doi:10.1016/j.engstruct.2025.120668 · Cited by 12
Pourramezani, K., Baghaee, H. R., & Gharehpetian, G. B. (2025) · Energy Reports · doi:10.1016/j.egyr.2025.08.049 · Cited by 13
Intelligence on the graph: Graph neural networks for mechanistic drug target discovery
Chen, J., Fan, N., Lu, Y., Yang, J., Song, W., Sheng, H., Yang, Y., Chen, S., & Wang, J. (2025) · Journal of Pharmaceutical Analysis · doi:10.1016/j.jpha.2025.101508 · Cited by 12
“Large-scale graphs impose significant memory and computational burdens, and sparse, diverse node features complicate reliable embedding learning [61].”
Novel Machine Learning for Big Data Analytics in Intelligent Support Information Management Systems
Lv, Z., Lou, R., Feng, H., Chen, D., & Lv, H. (2021) · ACM Transactions on Management Information Systems · doi:10.1145/3469890 · Cited by 15
“Finally, they provided a solid foundation for data analysis and encouraged further research and development in big data analysis and machine learning [14].”
BackgroundMachine learning: a bibliometric analysis
Martins, E., & Galegale, N. V. (2023) · International Journal of Innovation · doi:10.5585/2023.24056 · Cited by 14
Development of Prediction Method for Dimensional Stability of 3D-Printed Objects
Min, K.-E., Jang, J., Shin, J.-S., Kim, C., & Yi, S. (2023) · Applied Sciences · doi:10.3390/app131911027 · Cited by 12
“…in handling voluminous and intricate datasets, its capability to automate decision-making processes, its ability to identify intricate patterns or anomalies that may pose difficulties for humans, and its potential to enhance predictive accuracy and generate valuable insights over time [22,23].”
BackgroundGallucci, F., Fonseca, G., Vieira, D. C., Yaginuma, L. E., Gheller, P. F., Brito, S., & Corbisier, T. N. (2023) · Ocean and Coastal Research · doi:10.1590/2675-2824071.22070fg · Cited by 13
“ML follows a principle of predictive analytics and life-long learning, which means that a monitoring program based on ML can be constantly recalibrated as new data is collected to generate better predictions (L’Heureux et al., 2017).”
MethodIdentifying Irregular Power Usage by Turning Predictions into Holographic Spatial Visualizations
Glauner, P., Dahringer, N., Puhachov, O., Meira, J. A., Valtchev, P., State, R., & Duarte, D. (2017) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2017.40 · Cited by 12
“It has been argued that covariate shift is currently one of the main impediments in a wide range of real-world Big Data machine learning problems [41].”
BackgroundManifold Alignment via Global and Local Structures Preserving PCA Framework
Abeo, T. A., Shen, X., Ganaa, E. D., Zhu, Q., Bao, B., & Zha, Z.-J. (2019) · IEEE Access · doi:10.1109/access.2019.2906244 · Cited by 12
“Therefore, transforming these datasets to a latent low-dimensional space has become urgent [2], [3].”
BackgroundSáez, J. A., & Corchado, E. (2019) · IEEE Access · doi:10.1109/access.2019.2930355 · Cited by 13
“Big data [5], [16] is defined as high volume, velocity and/or variety data requiring of new processing techniques to be addressed.”
BackgroundSalman, S., Payrovnaziri, S. N., Liu, X., Rengifo‐Moreno, P., & He, Z. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9206678 · Cited by 13
“The necessity of dealing with heterogeneous data is not limited to medical applications, but it is shared among many other applications of machine learning [7].”
BackgroundA Look at Machine Learning in the Modern Age of Sustainable Future Secured Smart Cities
Monteiro, A. C. B., França, R. P., Arthur, R., & Iano, Y. (2021) · Advanced sciences and technologies for security applications · doi:10.1007/978-3-030-72139-8_17 · Cited by 14
A MapReduce Approach for Traffic Matrix Estimation in SDN
Queiroz, W., Capretz, M. A. M., & Dantas, M. A. R. (2020) · IEEE Access · doi:10.1109/access.2020.3016249 · Cited by 12
“To solve the issue of aggregating the collected traffic data statistics in near real-time, this paper proposes an approach to TM estimation that uses a Big Data programming model called MapReduce [11]–[14], [19].”
MethodSelf-citationChallenges of AI in Wireless Networks for IoTPreprint
Ahmad, I., Shahabuddin, S., Kumar, T., Harjula, E., Meisel, M., Juntti, M. J., Sauter, T., & Ylianttila, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.04705 · Cited by 15
“In IoT, the huge amount of diverse data generated by the massive number of connected IoT devices will require very high memory and processing resources [11].”
BackgroundMethodBig data, machine learning and uncertainty in foresight studies
da Silva, V. M., & Salles-Filho, S. L. M. (2024) · foresight · doi:10.1108/fs-12-2022-0187 · Cited by 14
Yousaf, A., Zhao, Z., Akhtar, N., Aizaz, M., & Shahzadi, M. (2025) · Chemical Engineering Journal · doi:10.1016/j.cej.2025.161299 · Cited by 11
Qi, H., Zhou, J., Khandelwal, M., Onifade, M., Lawal, A. I., Li, C., Bada, S. O., & Genc, B. (2025) · Fuel · doi:10.1016/j.fuel.2025.136065 · Cited by 12
Big Data Analytics for the Daily Living Activities of the People with Dementia
Moldovan, D., Olosutean, A., Chifu, V. R., Pop, C. B., Cioara, T., Anghel, I. M., & Salomie, I. (2018) · IEEE International Conference on Intelligent Computer Communication and Processing (ICCP) · doi:10.1109/iccp.2018.8516595 · Cited by 13
“Big Data challenges related to the application of the classical Machine Learning algorithms on several case studies, one of them being the recognition of the activities, are presented in [13].”
BackgroundgenerateData—A 2D data generator
Fachada, N., & Rosa, A. C. (2020) · Software Impacts · doi:10.1016/j.simpa.2020.100017 · Cited by 11
“Massive amounts of data are being produced everyday, raising a number of challenges on its storing and processing [1–3].”
BackgroundMachine Learning and Fuzzy Logic in Electronics: Applying Intelligence in Practice
Ivanova, M., Petkova, P., & Petkov, N. (2021) · Electronics · doi:10.3390/electronics10222878 · Cited by 11
“The main aim is for the collected big data to be processed and studied in such a way to give meaningful knowledge when problems have to be solved or decisions have to be made.”
BackgroundClosing the information gaps: a systematic review of research on delay and disruption claims
Ali, B., Aibinu, A. A., & Paton-Cole, V. (2022) · Construction Innovation · doi:10.1108/ci-04-2022-0080 · Cited by 11
How to Support ML End-User Programmers through a Conversational Agent
Garcia, E. J. A., Pimentel, J. F., Feng, Z., Gerosa, M. A., Steinmacher, I., & Sarma, A. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3608130 · Cited by 19
“Empirical studies have reported challenges ML-EUPs face when developing ML software.”
BackgroundMethodInfluentialArtificial Intelligence for Sport Injury Prediction
Owen, R., Owen, J. A., & Evans, S. L. (2024) · Springer eBooks · doi:10.1007/978-3-031-67256-9_5 · Cited by 14
A New Improved Baum-Welch Algorithm for Unsupervised Learning for Continuous-Time HMM Using Spark
Sassi, I., Anter, S., & Bekkhoucha, A. (2019) · International journal of intelligent engineering and systems · doi:10.22266/ijies2020.0229.20 · Cited by 12
“This huge amount of data has opened the door for improved modelling and prediction techniques [2].”
BackgroundFeature Selection in Big Data: Trends and Challenges
Tiwari, S. R., & Rana, K. K. (2020) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-981-15-4474-3_9 · Cited by 11
Liu, X., Xiao, Z., Yang, S. T., Zhang, R., Li, X., & Du, Z. (2021) · IEEE Access · doi:10.1109/access.2021.3107498 · Cited by 13
“Training an accurate and robust predictive model requires a high-quality dataset [27]–[29].”
BackgroundA Big Data Approach for the Extraction of Fuzzy Emerging Patterns
García-Vico, Á. M., González, P., Carmona, C. J., & del Jesús, M. J. (2019) · Cognitive Computation · doi:10.1007/s12559-018-9612-7 · Cited by 12
“Therefore, the processing of big data imposes new challenges [68].”
BackgroundClassification by Clustering (CbC): An Approach of Classifying Big Data Based on Similarities
Khan, S. S., Ahamed, S., Jannat, M., Shatabda, S., & Farid, D. M. (2019) · Algorithms for intelligent systems · doi:10.1007/978-981-13-7564-4_50 · Cited by 11
Mathew, V., Chacko, A. M., & Udhayakumar, A. (2018) · International Symposium on Embedded Computing and System Design (ISED) · doi:10.1109/ised.2018.8704120 · Cited by 11
“Accuracy computation was performed by developing models in two ways [5].”
MethodSadiku, M. N. O., Foreman, J., & Musa, S. M. (2020) · International Journal of Engineering Technologies and Management Research · doi:10.29121/ijetmr.v5.i9.2018.287 · Cited by 11
“Common machine learning algorithms include artificial neural networks, fuzzy logic, and genetic algorithms [8,9].”
BackgroundAF-DNDF: Asynchronous Federated Learning of Deep Neural Decision Forests
Zhang, H., Bosch, J., Olsson, H. H., & Koppisetty, A. C. (2021) · 2021 47th Euromicro Conference on Software Engineering and Advanced Applications (SEAA) · doi:10.1109/seaa53835.2021.00047 · Cited by 10
Non-linearity of Metabolic Pathways Critically Influences the Choice of Machine Learning Model
Lo-Thong-Viramoutou, O., Charton, P., Cadet, X. F., Grondin-Pérez, B., Saavedra, E., Damour, C., & Cadet, F. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2022.744755 · Cited by 12
“Creating an efficient ML model depends on the availability of a large amount of experimental data (L’Heureux et al., 2017; Schmidt et al., 2019).”
MethodChen, D., Cao, C., Kloosterman, R., Parsa, R., & Raman, S. (2024) · Journal of Medical Internet Research · doi:10.2196/58578 · Cited by 10
“…of noninferiority trials evaluating the performance of AI interventions compared with standard-of-care controls should require consistent reporting and justification for sample size [19] and should consider the use and challenges of large-scale training and validation cohorts for AI models [20].”
Priyadharshini, P. N., Karpagam, V., & Chamkha, A. J. (2025) · Multiscale and Multidisciplinary Modeling Experiments and Design · doi:10.1007/s41939-025-00838-8 · Cited by 10
Zhao, H., Pan, C., Liu, M., Jiao, D., & Zhu, H. (2025) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2025.3568030 · Cited by 10
“Thus,itishardtoapplydeeplearning locallybasedonBigData,andtheirdatashouldbemassively aggregated in a cloud server for centralized learning, to improve the performances of the intelligent tasks [4].”
Damir, S. S., Probst, J., deMello, A. J., & Stavrakis, S. (2025) · Chemistry - Methods · doi:10.1002/cmtd.202500069 · Cited by 12
Explainable artificial intelligence models for detecting suspicious bank transactions
Narasapuram, N. K., Shah, S. A. A., Shiratuddin, M. F., & Sohel, F. A. (2026) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-026-02994-w · Cited by 12
Behravan, A., Abboush, M., & Obermaisser, R. (2019) · Advances in Science and Engineering Technology International Conferences (ASET) · doi:10.1109/icaset.2019.8714453 · Cited by 10
“The other superiority is the boosting up performance of deep learning algorithms with an increase in the amount of data, in contrast to the machine learning algorithms which are not very suitable for a huge amount of data [12].”
BackgroundPrediction of good sleep with physical activity and light exposure: a preliminary study
Park, K., Lee, S. E., Lee, C., Hwang, H. D., Yoon, D. H., Choi, E. C., & Lee, E. M. (2022) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.9872 · Cited by 10
“41 Yet, data quality is as important as data quantity.”
ABO3 Perovskites’ Formability Prediction and Crystal Structure Classification using Machine Learning
Ahmad, M. U., Akib, A. A. R., Raihan, M. M. S., & Shams, A. B. (2022) · International Conference on Innovations in Science, Engineering and Technology (ICISET) · doi:10.1109/iciset54810.2022.9775906 · Cited by 12
“Machine learning makes it possible to input an enormous volume of data and present data-driven recommendations, based on advanced statistical models [12].”
BackgroundBig Data Influence on The Corporate Social Responsibility: Benefits and Challenges
Ujjwal, D., Uniyal, V., Pandey, S., Akram, S. V., Pachouri, V., & Negi, P. (2023) · International Conference on Computational Intelligence, Communication Technology and Networking (CICTN) · doi:10.1109/cictn57981.2023.10140910 · Cited by 10
Sentiment Data Analysis for Detecting Social Sense after COVID-19 using Hybrid Optimization Method
Seth, R., & Sharaff, A. (2023) · SN Computer Science · doi:10.1007/s42979-023-02017-3 · Cited by 10
“[27] studied that massive datasets have a variety of challenges because of traditional ML algorithms that are designed for smaller datasets, and for large dataset different adaptive machine learning algorithms which include deep learning as well as online learning.”
BackgroundMontasari, R. (2024) · Advanced sciences and technologies for security applications · doi:10.1007/978-3-031-50454-9_10 · Cited by 10
Raj, N., Murali, J., Singh‐Peterson, L., & Downs, N. J. (2024) · Mathematics · doi:10.3390/math12152376 · Cited by 11
Thomson, C. J., Tully, T. N., Stone, E. S., Morrell, C. B., Scheme, E., Warren, D. J., Hutchinson, D. T., Clark, G. A., & George, J. A. (2024) · Journal of Neural Engineering · doi:10.1088/1741-2552/ad94a7 · Cited by 10
Engineering Federated Learning Systems: A Literature Review
Zhang, H., Bosch, J., & Olsson, H. H. (2021) · Lecture notes in business information processing · doi:10.1007/978-3-030-67292-8_17 · Cited by 11
Methods for Assessing, Predicting, and Improving Data Veracity: A survey
Assiri, F. Y. (2020) · ADCAIJ ADVANCES IN DISTRIBUTED COMPUTING AND ARTIFICIAL INTELLIGENCE JOURNAL · doi:10.14201/adcaij202094530 · Cited by 11
“In addition, predicting data veracity suffers from many issues that arise from data uncertainty, data provenance, and noisy data (L’Heureux et al., 2017).”
BackgroundBioactivity characterization of herbal molecules
Félix-Cuencas, L., Hechavarría, E. A. D., Jarro, A., Parola-Contreras, I., Escamilla-García, A., Torres‐Pacheco, I., García‐Trejo, J. F., Soto-Zarazúa, G. M., & Guevara-González, R. G. (2021) · Elsevier eBooks · doi:10.1016/b978-0-323-85852-6.00007-x · Cited by 11
An Improved Generating Energy Prediction Method Based on Bi-LSTM and Attention Mechanism
He, B., Ma, R., Zhang, W., Zhu, J., & Zhang, X. (2022) · Electronics · doi:10.3390/electronics11121885 · Cited by 10
Deep-Stacked Convolutional Neural Networks for Brain Abnormality Classification Based on MRI Images
Rumala, D. J., van Ooijen, P. M. A., Rachmadi, R. F., Sensusiati, A. D., & Purnama, I. K. E. (2023) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-023-00828-7 · Cited by 10
“However, machine learning algorithms may not be optimal for such image classification problem as they take longer to reach convergence [13] and require manual feature extraction, which is time-consuming and liable to errors when applied to large datasets [14–16].”
BackgroundMethodInfluentialIdentification of Coronary Artery Disease using Extra Tree Classification
Wahid, N., Zaidi, A. T., Dhiman, G., Manwal, M., Soni, D., & Maaliw, R. R., III (2023) · International Conference on Inventive Computation Technologies (ICICT) · doi:10.1109/icict57646.2023.10134338 · Cited by 10
“and this training is facilitated by the machine's exposure to data [3].”
BackgroundParallel Metaheuristic Algorithms for Solving Imbalanced Data Classification Problems
Alweshah, M., Almiani, M., Alkhalaileh, S., Kassaymeh, S., Hezzam, E. A., & Alomoush, W. (2023) · IEEE Access · doi:10.1109/access.2023.3324061 · Cited by 10
“…was Yongqiang Cheng . technological limitations, massive amounts of data cannot be handled by using conventional techniques, yet ‘‘big data,’’ as it is generally named, is already serving as a genuine and effective means by which to tackle humanity’s most pressing concerns [3], [4], [5].”
BackgroundEnabling RF data analytics services and applications via cloudification
Cooklev, T., Poulkov, V. K., Bennett, D., & Tonchev, K. (2018) · IEEE Aerospace and Electronic Systems Magazine · doi:10.1109/maes.2018.170108 · Cited by 10
“An overview of the emerging ML approaches as fundamental components of data analytics and some of the challenges in this field are presented in [19].”
BackgroundRossi, A., Alberini, F., & Brunazzi, E. (2021) · Process Safety and Environmental Protection · doi:10.1016/j.cherd.2021.10.037 · Cited by 10
Different analytical frameworks and bigdata model for internet of things
Chahal, A., Gulia, P., & Gill, N. S. (2022) · Indonesian Journal of Electrical Engineering and Computer Science · doi:10.11591/ijeecs.v25.i2.pp1159-1166 · Cited by 10
Crime Rate Prediction Using Machine Learning
Sharaff, A., Kushwaha, P. K., Dwivedi, S. P., Krishna, O., Singh, S., & Thakur, D. (2023) · International Conference on Contemporary Computing and Informatics (IC3I) · doi:10.1109/ic3i59117.2023.10398085 · Cited by 10
Backorder Prediction in Inventory Management: Classification Techniques and Cost Considerations
Maitra, S., & Kundu, S. (2023) · International Computer Science and Engineering Conference · doi:10.1109/icsec59635.2023.10329654 · Cited by 9
“However, despite the progress made, the field of AI and ML in supply chain management, including backorder forecasting, is still in its early stages [5].”
BackgroundArtificial Intelligence based Intrusion Detection System – A Detailed Survey
Sharma, V., Shah, D. J., Sharma, S. K., & Gautam, S. (2024) · ITM Web of Conferences · doi:10.1051/itmconf/20246504002 · Cited by 11
“[51,52].”
Hussain, T., Ullah, A., Khalid, R. Z., Ahmad, F., Li, F., & Khan, A. (2025) · Particuology · doi:10.1016/j.partic.2024.12.006 · Cited by 9
A novel interval prediction method in wind speed based on deep learning and combination prediction
Chen, X., Han, T., Cheng, P., & Da, X. (2025) · Scientific Reports · doi:10.1038/s41598-025-03188-0 · Cited by 9
Mobile medical systems for equitable healthcare
Chan, J., Goel, M., Gollakota, S., & Nandakumar, R. (2025) · Nature Reviews Bioengineering · doi:10.1038/s44222-025-00330-5 · Cited by 11
“Machine learning models are typically designed to work with a single data type and cannot easily integrate heterogeneous data streams 138 .”
InfluentialAn Overview of Big Data and Machine Learning Paradigms
Sassi, I., Anter, S., & Bekkhoucha, A. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-11928-7_21 · Cited by 11
Big Data with Decision Tree Induction
Sabah, S., Anwar, S. Z. B., Afroze, S., Azad, M. A., Shatabda, S., & Farid, D. M. (2019) · International Conference on Software, Knowledge, Information Management and Applications (SKIMA) · doi:10.1109/skima47702.2019.8982419 · Cited by 9
“[9] presented emerging machine learning techniques and discussed the several challenges and how to handle those challenges in Big Data.”
BackgroundBig Data Analytics for Electrical Systems using Machine Learning Algorithms
Satyanarayana, S. V., & Madhavi, P. (2023) · IEEE International Conference on Technology, Engineering, Management for Societal Impact using Marketing, Entrepreneurship and Talent (TEMSMET) · doi:10.1109/temsmet56707.2023.10149919 · Cited by 9
AI and BDA impact on Stakeholders' Responses to Education Technology Adoption
Elshamly, A., & Gameel, Z. A. A. (2023) · MIGRATION LETTERS · doi:10.59670/ml.v20i8.5738 · Cited by 9
“In Saudi Arabia, AI integration aligns with Vision 2030's educational goals and can help address the educational challenges faced by a youthful population (Guan et al., 2020; L'Heureux et al., 2017; Luan et al., 2020; Nye, 2014; Tsai, 2000; Webb et al., 2020).”
BackgroundMethodInfluentialWeighing finishing pigs in motion: A walk-over scale for accurate weight estimation
Decarie, F., Grant, C., & Dallago, G. M. (2025) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2025.110019 · Cited by 9
On the Performance of Hierarchical Temporal Memory Predictions of Medical Streams in Real Time
El‐Ganainy, N. O., Balasingham, I., Halvorsen, P. S., & Rosseland, L. A. (2019) · International Symposium on Medical Information and Communication Technology · doi:10.1109/ismict.2019.8743902 · Cited by 9
“HTM is a recent machine learning paradigm having the power to learn and predict in real time using high order predictions and Hebbian-like learning method that mimics the brain [1-3, 7-9].”
BackgroundMethodInfluentialBig Data Classification: Applications and Challenges
Pramanik, P. K. D., Mukhopadhyay, M., & Pal, S. (2021) · Studies in big data · doi:10.1007/978-981-33-6400-4_4 · Cited by 11
A SURVEY ON DEEP LEARNING TECHNIQUES FOR BIG DATA IN BIOMETRICS
Jaseena, K. U. (2018) · International Journal of Advanced Research in Computer Science · doi:10.26483/ijarcs.v9i1.5136 · Cited by 9
“In [13], an analysis of the challenges connected with machine learning in big data is defined.”
BackgroundMachine learning and data analytics
Pezoulas, V. C., Exarchos, T. P., & Fotiadis, D. I. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-816507-2.00007-4 · Cited by 10
Kim, J. H., & Yoon, S. W. (2020) · IEEE Access · doi:10.1109/access.2020.3040733 · Cited by 9
“Neural network structures can overcome the limitations of empirical methods because they can identify data characteristics that a human observer cannot detect [22].”
BackgroundKarsi, R., Zaim, M., & Alami, J. E. (2021) · IAES International Journal of Artificial Intelligence · doi:10.11591/ijai.v10.i4.pp990-996 · Cited by 9
“The concept of big data has emerged to bring together all technologies for the collection, storage, and processing of massive data that traditional tools can not process [7], [8].”
BackgroundIMPACTO DE LAS ACTIVIDADES DE INNOVACIÓN EN LAS VENTAS DE COMPAÑÍAS PERUANAS DE LIMA Y CALLAO
Rodríguez, P. B. V., Medina, S. F. R., Ponce, C. E. R., Zapata, N. A. S., & Quispe, J. A. D. (2022) · Journal of Globalization Competitiveness and Governability · doi:10.3232/gcg.2022.v16.n3.01 · Cited by 9
Predicting agricultural drought in central Europe by using machine learning algorithms
Harsányi, E. (2025) · Journal of Agriculture and Food Research · doi:10.1016/j.jafr.2025.101783 · Cited by 16
A comprehensive survey of stream reasoning and its integration with knowledge graphs
Özbulak, G. A. T., Manzo, G., Shrestha, Y. R., & Calbimonte, J.-P. (2025) · Knowledge and Information Systems · doi:10.1007/s10115-025-02589-x · Cited by 8
Metadata
- Authors
- L'Heureux, A., Grolinger, K., Elyamany, H. F., & Capretz, M. A. M.
- Affiliations
- Western University (CA)
- Suez Canal University (EG)
- Venue
- IEEE Access
- Published
- 2017
- Volume
- 5
- Pages
- 7776-7797
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2609731728
- Cited by
- 1,023
- References
- 109
- Citations by year
- 2026: 50 · 2025: 175 · 2024: 128 · 2023: 145 · 2022: 130 · 2021: 138 · 2020: 105 · 2019: 88 · 2018: 53 · 2017: 11
- FWCI
- 112.99
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- NSERC CRD at Western University (477530-14)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Big Data Technologies and Applications
- Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Keywords
- big data challenges, volume, velocity, varieties, honesty, scalable learning, data-driven decision making, research gaps
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.