Machine learning with big data: challenges and approaches.
Open accessThe DOI matches its Crossref record; 108 of the 109 references it cites were found in a registry or an index.
Abstract
The Big Data revolution promises to transform how we live, work, and think by enabling process optimization, empowering insight discovery and improving decision making. The realization of this grand potential relies on the ability to extract value from such massive data through data analytics; machine learning is at its core because of its ability to learn from data and provide data driven insights, decisions, and predictions. However, traditional machine learning approaches were developed in a different era, and thus are based upon multiple assumptions, such as the data set fitting entirely into memory, what unfortunately no longer holds true in this new context. These broken assumptions, together with the Big Data characteristics, are creating obstacles for the traditional techniques. Consequently, this paper compiles, summarizes, and organizes machine learning challenges with Big Data. In contrast to other research that discusses challenges, this work highlights the cause–effect relationship by organizing challenges according to Big Data Vs or dimensions that instigated the issue: volume, velocity, variety, or veracity. Moreover, emerging machine learning approaches and techniques are discussed in terms of how they are capable of handling the various challenges with the ultimate objective of helping practitioners select appropriate solutions for their use cases. Finally, a matrix relating the challenges and approaches is presented. Through this process, this paper provides a perspective on the domain, identifies research gaps and opportunities, and provides a strong foundation and encouragement for further research in the field of machine learning with Big Data.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, training these models requires large, diverse, and well-labeled datasets [94].”
From A Review of Passenger Counting in Public Transport Concepts with Solution Proposal Based on Image Processing and Machine Learning (2024) · cites this paper as [94]
In the citing paper
“it is also shifting from a single domain (e.g., domain expertise, or expert systems) to a cross-disciplinary approach through collaboration”
From Challenges and Future Directions of Big Data and Artificial Intelligence in Education (2020) · cites this paper as L’heureux et al., 2017
Citations
Cites
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927 · cited 1×
“• Regularization paths [92] for linear models supports linear regression, two-class logistic regression, and multinomial regression problems.”
MethodThe WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750 · cited 1×
“However, at the moment, they support a limited number of algorithms compared to the R language [73], MATLAB [74], or Weka [75].”
MethodRepresentation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001 · cited 1×
“Representation learning is also often referred to as feature learning [100].”
BackgroundEnsemble methods in machine learning
Dietterich, T. G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45014-9_1 · Cited by 8,408
(2011) · Cited by 5,203
Multiple comparisons among means
Dunn, O. J. (1961) · Journal of the American Statistical Association · doi:10.1080/01621459.1961.10482090 · Cited by 5,006 · cited 1×
“It suggests that if testing m hypotheses with a desired significance of α, each individual hypothesis should be tested at a significance level of α/m [43].”
BackgroundResilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing
Zaharia, M., Chowdhury, M., Das, T., Dave, A., Ma, J. H., McCauley, M., Franklin, M. J. M., Shenker, S. J., & Stoica, I. G. (2012) · UC Berkeley · Cited by 4,891
The Hadoop Distributed File System
Shvachko, K., Kuang, H., Radia, S., & Chansler, R. (2010) · 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST) · doi:10.1109/msst.2010.5496972 · Cited by 4,834 · cited 8×
“In these stages, independent of the category of manipulations, processes can be embedded to capture data provenance and therefore remedy provenance challenge; an example is the Reduce and Map Provenance (RAMP) developed for MapReduce as an extension for Hadoop [64].”
MethodInfluentialHan, S., Mao, H., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1510.00149 · Cited by 4,662 · cited 1×
“Deep compression has been proposed as a way of speeding up processing without the loss of accuracy [105].”
Background
Research works printed but not linked: 20
- goodfellow, 2016, Deep Learning
- marz, 2014, Apache Storm
- rouse, 2011, Machine Learning Definition
- 2015, R A Language and Environment for Statistical Computing, 1
- 2014, IBM Watson Ecosystem Program
- wu, 2016, Google’s neural machine translation system Bridging the gap between human and machine translation
- 2016, Machine Learning American
- 2016, Google Cloud Machine Learning
- 2016, Matlab
- 2013, Billion Devices Will Wirelessly Connect to the Internet of Everything in 2020
- krikorian, 2010, Twitter by the Numbers Twitter
- 2016, H20
- 2016, Apache Mahout
- abadi, 2016, TensorFlow Large-Scale Machine Learning on Heterogeneous Systems
- langford, 2007, Vowpal wabbit online learning project
- rouse, 2009, Predictive Analytics Definition
- sukumar, 2014, Machine learning in the big data era: Are we there yet?, Proc 20th ACM SIGKDD Conf Knowl Discovery Data Mining Workshop Data Sci Social Good (KDD), 1
- 2016, GPU Applications Transforming Computational Research and Engineering
- torrey, 2010, Handbook of Research on Machine Learning Applications and Trends
- 2016, Apache Giraph
Cited by
Items 601–700 of 1,002
Kan, J.-C., Passos, M. V., Destouni, G., Barquet, K., Ferreira, C., & Kalantari, Z. (2026) · Sustainable Cities and Society · doi:10.1016/j.scs.2026.107142 · Cited by 5
Shen, X., He, S., Zhao, B., Ma, S., Jiang, J., Li, S., & Pan, S. (2026) · Journal of Manufacturing Processes · doi:10.1016/j.jmapro.2026.02.024 · Cited by 5
Convergence Rate for $l^{q}$ -Coefficient Regularized Regression With Non-i.i.d. Sampling
Guo, Q., Ye, P., & Cai, B. (2018) · IEEE Access · doi:10.1109/access.2018.2817215 · Cited by 5
“The task is to find a good approximation fz of the regression function, which is derived from some learning algorithm, see [1], [2] and the references therein.”
BackgroundGonçalves, D. M., Henriques, R., & Costa, R. S. (2021) · Cancers · doi:10.3390/cancers13133217 · Cited by 5
“As highlighted in Figure 3, the size of the cohort, as well as its dimensionality, sparsity, regularities and dependencies among the collected variables are determinant factors across classic point systems [43,44].”
BackgroundDevelopment of a vision-based automated hole assembly system with quality inspection
Kim, D., TabkhPaz, M., Park, S. S., & Lee, J. (2023) · Manufacturing Letters · doi:10.1016/j.mfglet.2023.08.018 · Cited by 5
An Effective Forecasting Approach of Temperature Enabling Climate Change Analysis in Saudi Arabia
Qasem, S. N., & Alzanin, S. M. (2024) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2024.0150372 · Cited by 5
“In contrast, machine learning (ML) is particularly worthy of dealing with big information [7], traffic recovery [8], social mobilization and migration prediction [9], seeing minute patterns [10], and responding to shifting circumstances [11].”
BackgroundSaravanan, M. S., & Thisin, S. (2024) · International Conference on Advances in Data Engineering and Intelligent Computing Systems (ADICS) · doi:10.1109/adics58448.2024.10533651 · Cited by 5
“We propose a groundbreaking approach to advance patient monitoring and optimize healthcare outcomes by seamlessly integrating Artificial Intelligence (AI) and the Internet of Things (IoT), driven by the overarching goal of addressing data heterogeneity [3, 4].”
BackgroundЕфективність застосування методів класифікації для задач інтелектуального аналізу великих даних
Петрина, В., & Doroshenko, A. (2024) · Науковий вісник НЛТУ України · doi:10.36930/40340516 · Cited by 5
Neto, L. A. A., Freire, A. M., & Silva, L. P. (2025) · Biomedicines · doi:10.3390/biomedicines13010208 · Cited by 5
García-Torres, M. (2025) · Journal of Heuristics · doi:10.1007/s10732-025-09550-9 · Cited by 5
Selective Multistart Optimization Based on Adaptive Latin Hypercube Sampling and Interval Enclosures
Nikas, I. A., Georgopoulos, V. P., & Loukopoulos, V. C. (2025) · Mathematics · doi:10.3390/math13111733 · Cited by 5
Predicting ESG Scores Using Firms' Financial Indicators: A Machine Learning Regression Approach
Alsayyad, M., & Fadel, S. (2025) · Journal of Sustainable Development of Energy Water and Environment Systems · doi:10.13044/j.sdewes.d13.0653 · Cited by 5
Pacheco, A. D., & Reyes-Garcia, C. A. (2021) · Journal of Experimental & Theoretical Artificial Intelligence · doi:10.1080/0952813x.2021.1925972 · Cited by 5
Using Slightly Imbalanced Binary Classification to Predict the Efficiency of Winter Road Maintenance
Hatamzad, M., Polanco, G., & Casselgren, J. (2021) · IEEE Access · doi:10.1109/access.2021.3131702 · Cited by 7
“Classification is a supervised ML method, whereas clustering is an unsupervised ML method [21].”
MethodSmartic: A smart tool for Big Data analytics and IoT
Sayeed, M. S., Ahmad, A. F., & Peng, T. C. (2022) · F1000Research · doi:10.12688/f1000research.73613.1 · Cited by 6
Assessing Spurious Correlations in Big Search Data
Richman, J. T., & Roberts, R. J. (2023) · Forecasting · doi:10.3390/forecast5010015 · Cited by 5
Feature selection for regression tasks base on explainable artificial intelligence procedures
Kowalski, P. A., & Walczak, M. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191064 · Cited by 8
“models based on large amounts of multidimensional data, for example, in the field of big data [2].”
BackgroundSmart Police: A Hybrid Deep Learning Model for Crime Proactivity Assessment
Vijayalakshmi, M., & Norbu, R. (2023) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt56998.2023.10308231 · Cited by 5
Aswanuwath, L., Pannakkong, W., Buddhakulsomsiri, J., Karnjana, J., & Huynh, V. (2023) · Energies · doi:10.3390/en17010078 · Cited by 5
Performance Study of Distributed Big Data Analysis in YARN Cluster
Ahn, H. Y., Kim, H., & You, W. (2018) · International Conference on Information and Communication Technology Convergence (ICTC) · doi:10.1109/ictc.2018.8539474 · Cited by 6
“Various ML approaches, such as deep learning, online learning, transfer learning, and ensemble learning have lots of interest in big data since give assistance to make more accurate models and timely predictions [4].”
BackgroundAn Emperical Study on Application of Big Data Analytics to Automate Service Desk Business Process
Lo, D. C.-T., Tiba, K., Buciumas, S., & Ziller, F. (2019) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac.2019.10285 · Cited by 5
“K-Means is one of the most popular unsupervised "clustering" algorithms based on Euclidean distance [1, 34].”
BackgroundTowards a Conceptual Approach of Analytical Engineering for Big Data
Rossi, R. (2020) · International Journal of Engineering and Technology · doi:10.7763/ijet.2020.v12.1176 · Cited by 5
“correlation, Machine Learning algorithms, among others [46], [47] and [48], which enable the integrated definition of”
MethodBig Data and Machine Learning for Forestalling Customer Churn Using Hybrid Software
Butgereit, L. L. (2020) · Conference on Information Communications Technology and Society (ICTAS) · doi:10.1109/ictas47918.2020.233972 · Cited by 5
“Machine Learning, on the other hand, describes a process of learning from data and subsequently providing insights and predictions [3].”
BackgroundReview of Trends in Automatic Human Activity Recognition in Vehicle Based in Synthetic Data
Coimbra, A., Neto, C., Ferreira, D. L. A., Duarte, J., Oliveira, D., Hak, F., Gonçalves, F., Fonseca, J., Lori, N. F., Abelha, A., et al. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-62365-4_35 · Cited by 6
SMaRT: A Framework for Social Media Based Recommender for Tourism
Renjith, S., Sreekumar, A., & Jathavedan, M. (2021) · Transactions on computational science and computational intelligence · doi:10.1007/978-3-030-49500-8_26 · Cited by 6
Data Analytics and Its Applications in Brief
Sahu, N. K., Patnaik, M., & Snigdh, I. (2021) · Advances in data mining and database management book series · doi:10.4018/978-1-7998-6673-2.ch008 · Cited by 5
Wanganga, G., & Qu, Y. (2020) · International Conference on Computational Science and Computational Intelligence (CSCI) · doi:10.1109/csci51800.2020.00086 · Cited by 5
“We can broadly group machine learning into supervised, unsupervised, and reinforcement machine learning [15].”
MethodOn Assessing The Safety of Reinforcement Learning algorithms Using Formal Methods
Mindom, P. S. N., Nikanjam, A., Khomh, F., & Mullins, J. (2021) · IEEE International Conference on Software Quality, Reliability and Security (QRS) · doi:10.1109/qrs54544.2021.00037 · Cited by 7
Data Mining based Dimensionality Reduction Techniques
Soni, A., Rasool, A., Dubey, A., & Khare, N. (2022) · International Conference for Advancement in Technology (ICONAT) · doi:10.1109/iconat53423.2022.9725846 · Cited by 6
“Dimensionality reduction technique reduces the features/attributes in a dataset while preserving most of the information in the original dataset [2].”
BackgroundMethodInfluentialTerminology for a FAIR Framework for the Virus Outbreak Data Network-Africa
Plug, R. B. F., Liang, Y., Aktau, A., Basajja, M., Oladipo, F. O., & van Reisen, M. (2022) · Data Intelligence · doi:10.1162/dint_a_00167 · Cited by 5
“However, these developments towards automated data processing pose numerous challenges, from the perspective of society [2] and technology [3].”
BackgroundTowards semantically enhanced detection of emerging quality-related concerns in source code
Krasniqi, R., & Do, H. (2023) · Software Quality Journal · doi:10.1007/s11219-023-09614-8 · Cited by 5
“Linstead et al. (2007) leveraged the effectiveness of the LDA to automatically extract functional concepts in the form of topics from source code. Savage et al. (2010) introduced a topic visualization tool called TopicXP for discovering topics located in source code. Recently, linguistic information was also used for…”
MethodInfluentialA Preliminary Study on Learning Challenges in Machine Learning-based Flight Delay Prediction
Mustapha, I. B., Shamsuddin, S. M., & Hasan, S. (2019) · International Journal of Innovative Computing · doi:10.11113/ijic.v9n1.204 · Cited by 5
“Class balancing is merely carried out based on the general knowledge that imbalance in class distribution is a major hinderance to optimal classifier performance in ML [5].”
BackgroundA Survey on Scheduling Techniques in the Edge Cloud: Issues, Challenges and Future DirectionsPreprint
(2022) · Research Square · doi:10.21203/rs.3.rs-1360831/v2 · Cited by 6
Machine Learning-Based Disease Diagnosis:A Bibliometric AnalysisPreprint
Ahsan, M. M., & Siddique, Z. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2201.02755 · Cited by 5
“Due to continually generating a large amount of data in medical domains, the researcher and practitioners are drawn to applied Machine Learning [2, 3].”
BackgroundA Bibliographic Exploration: Tackling Heavy Metal ContaminationPreprint
Ding, Y. (2024) · Preprints.org · doi:10.20944/preprints202401.0625.v1 · Cited by 5
Benchmarking of Quantum SVM and Classical ML Algorithms for Prediction of Therapeutic ProteinsPreprint
Tijare, P. A., Mehta, N. K., & Raghava, G. P. S. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.04.30.651419 · Cited by 5
“[ 10][11][12] QML takes advantage of core quantum computing principles like entanglement, superposition, and quantum parallelism to create algorithms that are at least in theory, outperforming classical machine learning in case of speed and efficiency.”
Machine learning-Enabled Network Traffic Analysis
Aouedi, O. (2022) · theses.fr (ABES) · doi:10.70675/98b92b52z17b2z43b7zb42ez26f74d2fff67 · Cited by 5
Wireless Sensors for Multi‐modal Health Monitoring
Ajum, N., Iftikhar, S., Kalsoom, T., & Rehman, M. U. (2024) · Wiley eBooks · doi:10.1002/9781394257744.ch4 · Cited by 4
Sinap, V. (2025) · Gazi Üniversitesi Fen Bilimleri Dergisi Part C Tasarım ve Teknoloji · doi:10.29109/gujsc.1544987 · Cited by 4
Cerchione, R. (2025) · R and D Management · doi:10.1111/radm.12778 · Cited by 6
A multiscale Bayesian approach to quantification and denoising of energy-dispersive x-ray data
Torruella, P., Halimi, A., Tovaglieri, L., Lichtensteiger, C., Alexander, D. T. L., & Hébert, C. (2025) · Machine Learning Science and Technology · doi:10.1088/2632-2153/add8e1 · Cited by 4
“For this, having training data of sufficient quality and abundance is crucial to avoid common machine learning pitfalls such as overfitting, biases, and propagation of imbalances in the training set [17].”
Genetic features for drug responses in cancer — Investigating an ensemble-feature-selection approach
Schlüter, J., & Schönhuth, A. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.110572 · Cited by 4
“It can handle large datasets and identify patterns that may not be apparent through traditional statistical methods [14, 15].”
Lumumba, V. W., Muriithi, D. K., & Oundo, M. B. (2025) · American Journal of Artificial Intelligence · doi:10.11648/j.ajai.20250902.15 · Cited by 4
Deng, W. (2025) · SAGE Open · doi:10.1177/21582440251398597 · Cited by 4
“Secondly, by employing sophisticated big data and machine learning techniques, AI robots can rapidly and exhaustively extract valuable investment insights and subtle risk signals from immense, heterogeneous market datasets (L’Heureux et al., 2017).”
Hu, Q., Zhang, Q., Che, D., Wang, F., Zhang, Z., & Zhou, J. (2026) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2026.112263 · Cited by 4
Fairley, J. L., Kapoor, M., & Sharma, D. (2026) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2026.03.001 · Cited by 4
Data Quality Awareness: A Journey from Traditional Data Management to Data Science Systems
Dong, S., Sahri, S., & Palpanas, T. (2026) · ACM SIGMOD Record · doi:10.1145/3829088.3829090 · Cited by 4
“Thebigdata challenges amplify the effect of poor data quality in ML pipelines [83, 130].”
Li, Q., Shi, W., Wang, N., & Wang, G. (2025) · International Journal of Orthopaedic and Trauma Nursing · doi:10.1016/j.ijotn.2025.101161 · Cited by 4
Assessing housing exposure to landslide hazards using hybrid machine learning and spatial modeling
Ha, H., Bui, Q. D., Nguyen, V., Tran, X. T., Nguyen, D. Q., & Luu, C. (2025) · Modeling Earth Systems and Environment · doi:10.1007/s40808-025-02428-6 · Cited by 4
“The ML techniques are designed to analyze large amounts of data from various sources and can address high dimensionality very well (L’heureux et al. 2017).”
Detecting the Undetected: Machine Learning in Early Disease Diagnosis
Rathi, K., Sharma, S., & Barnwal, A. P. (2025) · Basic & Clinical Pharmacology & Toxicology · doi:10.1111/bcpt.70104 · Cited by 4
“Several publicly accessible datasets have played a crucial role in advancing ML research in healthcare [73]: • Kaggle: A popular platform for data science competitions, Kaggle hosts numerous datasets related to disease detection, including cancer screening and cardiovascular risk assessment [74].”
Costa, S., Medjkane, M., & Maquaire, O. (2025) · Géomorphologie relief processus environnement · doi:10.4000/14mnx · Cited by 4
Future Trends in AI, Machine Learning, and Big Data: Implications for Technical Leadership
Verma, H. (2025) · International Journal of Engineering & Extended Technologies Research · doi:10.15662/ijeetr.2025.0704017 · Cited by 4
Kelam, H., & Venkatesan, M. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-981-13-1882-5_24 · Cited by 4
Bu, Y., Shi, L., & Ma, B. (2023) · Journal of environmental chemical engineering · doi:10.1016/j.jece.2023.109928 · Cited by 4
The Role of Machine Learning in Managing Uncertainty in Projects – A View on Early Warning Systems
Ekambaram, A., Vågbø, P. C., & der Leyen, B. S. V. (2022) · European Conference on Management, Leadership and Governance (ECMLG) · doi:10.34190/ecmlg.18.1.932 · Cited by 4
Arasan, K. K., & Anandhakumar, P. (2023) · Journal of Circuits Systems and Computers · doi:10.1142/s021812662450021x · Cited by 4
Natural clines and human management impact the genetic structure of Algerian honey bee populations
Salvatore, G., Amar, A. C. B., Canale‐Tabet, K., Fridi, R., Aoul, N. T., Saci, S., Labarthe, E., Palombo, V., D’Andrea, M., Alain Vignal, A., et al. (2023) · Genetics Selection Evolution · doi:10.1186/s12711-023-00864-5 · Cited by 4
“As the number of features increases, the ability of the algorithm to accurately predict outcomes may decrease [35].”
BackgroundMinimizing time complexity for IOT-IDS based feature selection approach
Khamees, D. H., & Essa, E. I. (2024) · International Journal of Communication and Information Technology · doi:10.33545/2707661x.2024.v5.i1b.82 · Cited by 4
Sahadevan, D., Ali, H. A., & Khan, M. (2024) · Lecture notes in networks and systems · doi:10.1007/978-981-97-6581-2_14 · Cited by 4
AI-Driven Geospatial Analysis of Indoor Radon Levels: A Case Study in Chungcheongbuk-do, South Korea
Widya, L. K., Rezaie, F., Lee, J., Lee, J., Park, B. R., Yoo, J., Lee, W., & Lee, S. (2025) · Earth Systems and Environment · doi:10.1007/s41748-025-00582-6 · Cited by 4
“Machine learning is a powerful tool for solving complicated challenges involving several variables, and is effective for handling missing data, noise, and big data processing (L’Heureux et al. 2017; Zhou et al. 2017 ).”
Prototype of Domain-Specific Language for Uniform Access to Vector Databases
Akik, E., Vještica, M., Dimitrieski, V., Čeliković, M., & Ristić, S. (2024) · IEEE International Scientific Conference on Informatics (Informatics) · doi:10.1109/informatics62280.2024.10900871 · Cited by 4
“Vector databases have emerged as crucial tools in AI-powered applications [4].”
Aleb, N. (2025) · Network Modeling Analysis in Health Informatics and Bioinformatics · doi:10.1007/s13721-025-00516-2 · Cited by 4
Jain, A. M. (2025) · International Journal of Intelligent Systems and Applications in Engineering · doi:10.17762/ijisae.v13i1s.7419 · Cited by 4
Permafrost carbon controlled by vegetation and climate in the Tibetan Plateau
Zhang, X., Zhang, S., Chen, H., & Fan, J. (2025) · Environmental Earth Sciences · doi:10.1007/s12665-025-12325-x · Cited by 5
“For instance, L’heureux et al. (2017) highlights that ML models often struggle to capture extreme values under sparse sample conditions.”
HP_FLAP: homomorphic and polymorphic federated learning aggregation of parameters framework
Moshawrab, M., Adda, M., Bouzouane, A., Ibrahim, H., & Raad, A. (2025) · Cybersecurity · doi:10.1186/s42400-024-00341-6 · Cited by 4
“Although model accuracy depends on technical architecture, data quality, feature processing, and other factors, higher data availability for training has been shown to result in models with better accuracy (Lheureux et al. 2017; Zhou et al. 2017).”
Big Data application on signal processing systems
Tikhonyuk, A. I., Дмитриевич, Е. С., & Chadov, T. A. (2018) · 2018Systems of Signal Synchronization, Generating and Processing in Telecommunications (SYNCHROINFO) · doi:10.1109/synchroinfo.2018.8456931 · Cited by 4
“This task has been already solved [6] and here we will treat this task as an application for big data analysis [5], [7], [9], [10], [11], [12], [13], [15].”
MethodShibli, M., & Mathew, B. (2019) · International Journal of Intelligent Systems and Applications · doi:10.5815/ijisa.2019.04.01 · Cited by 4
“Machine learning challenges with Big Data were compiled, summarized, and organized in paper [23].”
MethodTowards Smart Emergency Management: Trends and Challenges of Feature Engineering
Sahoh, B., & Choksuriwong, A. (2018) · International Computer Science and Engineering Conference · doi:10.1109/icsec.2018.8712690 · Cited by 4
“ML consists of learning a task from real-world experience to improve its performance [14].”
BackgroundStrategies and Challenges in Big Data: A Short Review
Kumar, D. K. S., & D’Mello, D. A. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-16660-1_4 · Cited by 5
From Ensemble Learning to Meta-Analytics: A Review on Trends in Business Applications
Haque, M. N., & Moscato, P. (2019) · Springer eBooks · doi:10.1007/978-3-030-06222-4_18 · Cited by 6
Machine learning is a powerful tool to study the effect of cancer on species and ecosystems
Dujon, A. M., Vittecoq, M., Bramwell, G., Thomas, F., & Újvári, B. (2021) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13703 · Cited by 4
“The increasing need for predictive modelling has driven re - cent advances in the use of machine learning algorithms in science (Dujon & Schofield, 2019; L'Heureux et al., 2017; Lecun et al., 2015).”
BackgroundMethodInfluentialTrends of Evolutionary Machine Learning to Address Big Data Mining
Hamida, S. B., Benjelloun, G., & Hmida, H. (2021) · Lecture notes in business information processing · doi:10.1007/978-3-030-85977-0_7 · Cited by 4
Analytical Engineering for Data Stream
Rossi, R., & Hirama, K. (2022) · Journal of Computer and Communications · doi:10.4236/jcc.2022.107002 · Cited by 6
Knowledge inference from home appliances data
Firte, C., Iamnitchi, L., Portase, R. L., Tolas, R., Potolea, R., Dînșoreanu, M., & Lemnaru, C. (2022) · IEEE International Conference on Intelligent Computer Communication and Processing (ICCP) · doi:10.1109/iccp56966.2022.10053977 · Cited by 5
“Subsequently, the authors of [5] affirm that the characteristics are in a number of 4, adding ”Veracity” to the list.”
BackgroundVLC Indoor Positioning Using RFR and SVM Reduced Features Machine Learning Techniques
Affan, A., Asif, H. M., & Tarhuni, N. G. (2023) · Wireless Telecommunications Symposium · doi:10.1109/wts202356685.2023.10131742 · Cited by 4
“AIbased algorithms have been bases for higher accuracy in these tasks, however, these algorithms require a large amount of data for training to provide higher accuracy [23], [24].”
Reading Big Data by Machine Learning: The Used of Computer Science for Human Life
Subagio, H., & Sitepu, R. B. (2023) · Jurnal Penelitian Pendidikan IPA · doi:10.29303/jppipa.v9i10.4752 · Cited by 4
“…was first coined in the early 2000s when Big Data was used to describe “the explosion in the quantity (and sometimes, quality) of available and potentially relevant data, largely the result of recent and unprecedented advancements in data recording and storage technology” (L’heureux et al., 2017) .”
MethodStreaming Processing for ADL Monitoring in Smart Home Environments
Cardinale, Y., Ramírez, J. M. N., Garamendi, I., & de Fez, I. (2024) · IEEE Access · doi:10.1109/access.2024.3430395 · Cited by 5
“Big Data benefits and challenges related to the application of the classical machine learning algorithms on several study cases (including ADL recognition), have been presented in many works [79], [80], [81].”
BackgroundActive Learning for Mining Big Data
Jahan, S., Shatabda, S., & Farid, D. M. (2018) · International Conference on Computer and Information Technology (ICCIT) · doi:10.1109/iccitechn.2018.8631973 · Cited by 4
A Data-Driven Compensation Method for Production Index of Hydrometallurgical Process
Li, K., Wang, F., He, D., & Zhao, L. (2019) · IEEE Access · doi:10.1109/access.2019.2911357 · Cited by 4
A Systematic Frame Work Using Machine Learning Approaches in Supply Chain Forecasting
Prahathish, K., Naren, J., Ganesan, V., Akhil, S., Kumar, K. D., & Gupta, S. (2020) · Learning and analytics in intelligent systems · doi:10.1007/978-3-030-39033-4_15 · Cited by 4
Efficient Machine Learning Algorithms for Medical Big Data Analysis
Julia, J. P. M., & Bennet, D. (2022) · International Conference on Applied Artificial Intelligence and Computing (ICAAIC) · doi:10.1109/icaaic53929.2022.9792790 · Cited by 4
“This is the major drawback of the existing classification algorithms [8][9][10].”
MethodA Modulation Layer to Increase Neural Network Robustness Against Data Quality Issues
Abdelhack, M., Zhang, J., Tripathi, S., Fritz, B. A., Felsky, D., Avidan, M. S., Chen, Y., & King, C. R. (2023) · Transactions on machine learning research · doi:10.48550/arxiv.2107.08574 · Cited by 4
The Investigation into Deep Learning Classifiers Towards Imbalanced Text Data
Azizah, L. N., Khotimah, P. H., Arisal, A., Rozie, A. F., Munandar, D., Riswantini, D., Nugraheni, E., Suwarningsih, W., & Kurniasari, D. (2022) · International Conference on Networking, Information Systems & Security (NISS) · doi:10.1109/niss55057.2022.10085611 · Cited by 3
“[4], Japkowicz and Stephen showed that in an experiment, the severity of an imbalanced class problem depends on the complexity of the problem, the coefficient of the imbalanced class, and the total training sample size.”
BackgroundUAV Application With XAI and Soft Computing Methods to Protect Privacy of Power-Data in Smart Grids
Gan, Y., Xiao, Z., Ke, T., & Liang, Z. (2025) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2025.3551519 · Cited by 3
“In [15], the authors have discussed the challenges and approaches for merging machine intelligence methods with Big-data for analyzing the privacy and security of data.”
AL-QAYSI, B. R., Rosa-Zurera, M., & Aldujaili, A. A. (2025) · AI · doi:10.3390/ai6050089 · Cited by 3
Zhang, Z., Shi, H., Cao, W., Li, K., & Chen, L. (2025) · Ionics · doi:10.1007/s11581-025-06540-6 · Cited by 4
“In recent years, with advancements in data-driven technologies, machine learning and neural network methods have enabled prediction by directly extracting the implicit relationships among multidimensional features such as voltage, current, and temperature from historical data [35, 36].”
From Attention to Distraction: Driver State Analysis From an Engineering Perspective – A Review
Uccello, L., Mastinu, G. R. M., Gobbi, M., & Zaffaroni, I. (2025) · IEEE Access · doi:10.1109/access.2025.3638622 · Cited by 3
“However, the successful application of ML algorithms depends heavily on the availability of extensive, high-quality databases for training and validation [34].”
Le, J., Rusin, W., Joosten, A., Cannesson, M., & Pal, R. (2026) · Current Opinion in Anaesthesiology · doi:10.1097/aco.0000000000001624 · Cited by 3
Learning Robust Node Representations via Graph Neural Network and Multilayer Perceptron Classifier
Sejan, M. A. S., Rahman, M. H., Aziz, M. A., Hameed, I., Islam, M. S., Sabuj, S. R., & Song, H. (2026) · Mathematics · doi:10.3390/math14040680 · Cited by 3
Industry 4.0 Technologies in Circular Food Supply Chains: A Systematic Literature Review
Bansal, P., Karassin, O., & Dora, M. K. (2026) · Circular Economy · doi:10.55845/joce-2025-32101 · Cited by 3
Kpodo, J., & Nejadhashemi, A. P. (2026) · Information Processing in Agriculture · doi:10.1016/j.inpa.2026.06.004 · Cited by 3
Selvaraj, R., & Nagarajan, S. (2022) · NANO · doi:10.1142/s1793292022500576 · Cited by 3
Trujillo, L., Nation, J., Muñoz, L., & Galván, E. (2023) · AI Communications · doi:10.3233/aic-230104 · Cited by 3
“Some of these issues include the brittleness of some ML models [32], the necessity for overwhelming amounts of data in some domains [23], and the apparent existence, but still elusive, overarching master algorithm [10].”
Enhancing Security for Internet of Things Based System
Haque, M. A., Sonal, D., Ahmad, S., & Kumar, K. (2023) · Algorithms for intelligent systems · doi:10.1007/978-981-99-3485-0_68 · Cited by 3
Assessment of the real‐time pattern recognition capability of machine learning algorithms
Polytarchos, E., Bardaki, C., & Pramatari, K. C. (2024) · Statistical Analysis and Data Mining The ASA Data Science Journal · doi:10.1002/sam.11701 · Cited by 3
“Generating knowledge and detecting patterns in a data stream environment is a challenging topic that has recently gained a lot of attention in the context of online pattern recognition, either concerning big data [35, 43] or online learning facets [6, 50, 59].”
BackgroundYuan, J., Wang, Q., Wang, J., Fan, Y., Jiao, W., & Li, A. (2024) · Electronics · doi:10.3390/electronics13234755 · Cited by 4
Evaluasi Kinerja Algoritma Machine learning pada Dataset Skala Besar
Lusiyanti, D., Musdalifah, S., Sahari, A., & Fajri, I. A. (2025) · Mathvision Jurnal Matematika · doi:10.55719/mv.v7i1.1661 · Cited by 6
“Namun, salah satu tantangan utama dalam penerapan ML pada dataset besar adalah efisiensi komputasi, waktu eksekusi, serta performa model dalam menangani volume data yang tinggi [7].”
Advanced transmission line fault protection including the voltage sag
Al-Sultan, M., & Avcı, İ. (2025) · Journal of Renewable and Sustainable Energy · doi:10.1063/5.0246904 · Cited by 3
Global Structure of the Cislunar Magnetotail and Its Evolution During Substorms
Sitnov, M. I., Stephens, G. K., Artemyev, A. V., Motoba, T., & Tsyganenko, N. A. (2025) · Journal of Geophysical Research Space Physics · doi:10.1029/2025ja034018 · Cited by 3
“The Big Data challenge (e.g., L’Heureux et al., 2017) has been met during the recent ML revolution by modern artificial neural networks (LeCun et al., 2015).”
Valliammal, N., & Shanmugapriya, D. (2019) · Advances in information security, privacy, and ethics book series · doi:10.4018/978-1-5225-9611-0.ch015 · Cited by 4
Metadata
- Authors
- L'Heureux, A., Grolinger, K., Elyamany, H. F., & Capretz, M. A. M.
- Affiliations
- Western University (CA)
- Suez Canal University (EG)
- Venue
- IEEE Access
- Published
- 2017
- Volume
- 5
- Pages
- 7776-7797
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2609731728
- Cited by
- 1,023
- References
- 109
- Citations by year
- 2026: 50 · 2025: 175 · 2024: 128 · 2023: 145 · 2022: 130 · 2021: 138 · 2020: 105 · 2019: 88 · 2018: 53 · 2017: 11
- FWCI
- 112.99
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- NSERC CRD at Western University (477530-14)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Big Data Technologies and Applications
- Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Keywords
- big data challenges, volume, velocity, varieties, honesty, scalable learning, data-driven decision making, research gaps
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.