Machine learning with big data: challenges and approaches.
Open accessThe DOI matches its Crossref record; 108 of the 109 references it cites were found in a registry or an index.
Abstract
The Big Data revolution promises to transform how we live, work, and think by enabling process optimization, empowering insight discovery and improving decision making. The realization of this grand potential relies on the ability to extract value from such massive data through data analytics; machine learning is at its core because of its ability to learn from data and provide data driven insights, decisions, and predictions. However, traditional machine learning approaches were developed in a different era, and thus are based upon multiple assumptions, such as the data set fitting entirely into memory, what unfortunately no longer holds true in this new context. These broken assumptions, together with the Big Data characteristics, are creating obstacles for the traditional techniques. Consequently, this paper compiles, summarizes, and organizes machine learning challenges with Big Data. In contrast to other research that discusses challenges, this work highlights the cause–effect relationship by organizing challenges according to Big Data Vs or dimensions that instigated the issue: volume, velocity, variety, or veracity. Moreover, emerging machine learning approaches and techniques are discussed in terms of how they are capable of handling the various challenges with the ultimate objective of helping practitioners select appropriate solutions for their use cases. Finally, a matrix relating the challenges and approaches is presented. Through this process, this paper provides a perspective on the domain, identifies research gaps and opportunities, and provides a strong foundation and encouragement for further research in the field of machine learning with Big Data.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, training these models requires large, diverse, and well-labeled datasets [94].”
From A Review of Passenger Counting in Public Transport Concepts with Solution Proposal Based on Image Processing and Machine Learning (2024) · cites this paper as [94]
In the citing paper
“it is also shifting from a single domain (e.g., domain expertise, or expert systems) to a cross-disciplinary approach through collaboration”
From Challenges and Future Directions of Big Data and Artificial Intelligence in Education (2020) · cites this paper as L’heureux et al., 2017
Citations
Cites
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927 · cited 1×
“• Regularization paths [92] for linear models supports linear regression, two-class logistic regression, and multinomial regression problems.”
MethodThe WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750 · cited 1×
“However, at the moment, they support a limited number of algorithms compared to the R language [73], MATLAB [74], or Weka [75].”
MethodRepresentation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001 · cited 1×
“Representation learning is also often referred to as feature learning [100].”
BackgroundEnsemble methods in machine learning
Dietterich, T. G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45014-9_1 · Cited by 8,408
(2011) · Cited by 5,203
Multiple comparisons among means
Dunn, O. J. (1961) · Journal of the American Statistical Association · doi:10.1080/01621459.1961.10482090 · Cited by 5,006 · cited 1×
“It suggests that if testing m hypotheses with a desired significance of α, each individual hypothesis should be tested at a significance level of α/m [43].”
BackgroundResilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing
Zaharia, M., Chowdhury, M., Das, T., Dave, A., Ma, J. H., McCauley, M., Franklin, M. J. M., Shenker, S. J., & Stoica, I. G. (2012) · UC Berkeley · Cited by 4,891
The Hadoop Distributed File System
Shvachko, K., Kuang, H., Radia, S., & Chansler, R. (2010) · 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST) · doi:10.1109/msst.2010.5496972 · Cited by 4,834 · cited 8×
“In these stages, independent of the category of manipulations, processes can be embedded to capture data provenance and therefore remedy provenance challenge; an example is the Reduce and Map Provenance (RAMP) developed for MapReduce as an extension for Hadoop [64].”
MethodInfluentialHan, S., Mao, H., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1510.00149 · Cited by 4,662 · cited 1×
“Deep compression has been proposed as a way of speeding up processing without the loss of accuracy [105].”
Background
Research works printed but not linked: 20
- goodfellow, 2016, Deep Learning
- marz, 2014, Apache Storm
- rouse, 2011, Machine Learning Definition
- 2015, R A Language and Environment for Statistical Computing, 1
- 2014, IBM Watson Ecosystem Program
- wu, 2016, Google’s neural machine translation system Bridging the gap between human and machine translation
- 2016, Machine Learning American
- 2016, Google Cloud Machine Learning
- 2016, Matlab
- 2013, Billion Devices Will Wirelessly Connect to the Internet of Everything in 2020
- krikorian, 2010, Twitter by the Numbers Twitter
- 2016, H20
- 2016, Apache Mahout
- abadi, 2016, TensorFlow Large-Scale Machine Learning on Heterogeneous Systems
- langford, 2007, Vowpal wabbit online learning project
- rouse, 2009, Predictive Analytics Definition
- sukumar, 2014, Machine learning in the big data era: Are we there yet?, Proc 20th ACM SIGKDD Conf Knowl Discovery Data Mining Workshop Data Sci Social Good (KDD), 1
- 2016, GPU Applications Transforming Computational Research and Engineering
- torrey, 2010, Handbook of Research on Machine Learning Applications and Trends
- 2016, Apache Giraph
Cited by
Items 201–300 of 1,002
Kołodziej, J., & González–Vélez, H. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-16272-6 · Cited by 40
Scientometric Analysis of Artificial Intelligence (AI) for Geohazard Research
Jiang, S., Ma, J., Liu, Z., & Guo, H. (2022) · Sensors · doi:10.3390/s22207814 · Cited by 37
“AI has proven its capability in dealing with high-dimensional and large-scale datasets by providing satisfactory predictions [11].”
BackgroundPredicting online shopping cart abandonment with machine learning approaches
Rausch, T. M., Derra, N. D., & Wolf, L. (2022) · International Journal of Market Research · doi:10.1177/1470785320972526 · Cited by 36
“However, support vector machines may become computationally infeasible on very large datasets like clickstream data (L’Heureux et al., 2017).”
BackgroundMethodInfluentialBig data analytics in healthcare: data sources, tools, challenges, and opportunities
Badawy, M., Ramadan, N., & Hefny, H. A. (2024) · Journal of Electrical Systems and Information Technology · doi:10.1186/s43067-024-00190-w · Cited by 36
“There may be sensitive or private information in the medical records and data obtained from patients [70].”
Enhancing Water Level Prediction Using Ensemble Machine Learning Models: A Comparative Analysis
Alsulamy, S. H., Kumar, V., Kişi, Ö., Kedam, N., & Rathnayake, N. (2025) · Water Resources Management · doi:10.1007/s11269-025-04142-5 · Cited by 36
“These models, which leverage various machine learning (ML) techniques, have gained popularity due to their ability to process large datasets and detect patterns without requiring extensive physical knowledge (L’Heureux et al. 2017; Xu et al. 2024).”
Khan, Z., Naeem, M., Khalil, U., Khan, D. M., Aldahmani, S., & Hamraz, M. (2019) · IEEE Access · doi:10.1109/access.2019.2922432 · Cited by 39
Data Analytics in the Internet of Things: A Survey
Saleem, T. J., & Chishti, M. A. (2019) · Scalable Computing Practice and Experience · doi:10.12694/scpe.v20i4.1562 · Cited by 40
Is Artificial Intelligence Better Than Human Clinicians in Predicting Patient Outcomes?
Lee, J. (2020) · Journal of Medical Internet Research · doi:10.2196/19918 · Cited by 36
“This AI advantage is crucial for extracting and using data-driven insights from big data [31]; it is also key to the recent successful breakthroughs in ML, particularly in deep learning [32], in a number of problem domains, including medical imaging [33].”
BackgroundTowards data sharing economy on Internet of Things: a semantic for telemetry data
Halim, D. K., & Hutagalung, S. (2022) · Journal Of Big Data · doi:10.1186/s40537-021-00549-0 · Cited by 37
Context-aware Big Data Quality Assessment: A Scoping Review
Fadlallah, H., Kilany, R., Dhayne, H., Haddad, R. E., Haque, R., Taher, Y., & Jaber, A. H. (2023) · Journal of Data and Information Quality · doi:10.1145/3603707 · Cited by 50
“[91] stated that handling dirty and noisy data is one of the main challenges that face machine learning algorithms in a big data context.”
BackgroundVerma, P., Kumar, V., Mittal, A., Rathore, B., Jha, A., & Rahman, M. S. (2023) · The TQM Journal · doi:10.1108/tqm-02-2021-0062 · Cited by 35
Chen, X., Singh, M. M., & Geyer, P. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111774 · Cited by 38
Moreno, C., Carrasco, R. A., & Herrera‐Viedma, E. (2019) · International Journal of Interactive Multimedia and Artificial Intelligence · doi:10.9781/ijimai.2019.06.003 · Cited by 35
“However, the emergence of Big Data [7] has made these models obsolete, and market-oriented companies do not know how to adapt given the wide variety of products and services that composes the so-called Big Data ecosystems.”
BackgroundBig Data Analytics using Machine Learning Techniques
Mittal, S., & Sangwan, O. P. (2019) · International Conference on Cloud Computing, Data Science & Engineering (Confluence) · doi:10.1109/confluence.2019.8776614 · Cited by 40
Verhelst, H. M., Stannat, A., & Mecacci, G. (2020) · Science and Engineering Ethics · doi:10.1007/s11948-020-00254-w · Cited by 41
“The challenges that these currently available counterterrorism datasets create in training machine learning algorithms are explained by the three well known mathematical phenomena of class imbalance, curse of dimensionality and spurious correlations (L’Heureux et al. 2017).”
BackgroundInfluentialMachine Learning for Cloud Detection of Globally Distributed Sentinel-2 Images
Cilli, R., Monaco, A., Amoroso, N., Tateo, A., Tangaro, S., & Bellotti, R. (2020) · Remote Sensing · doi:10.3390/rs12152355 · Cited by 36
“machine learning accuracy [57,58], the only statistically significant drop in performance we observed were ∼4% in accuracy and ∼10% in F1.”
BackgroundA New Real Time Clinical Decision Support System Using Machine Learning for Critical Care Units
El‐Ganainy, N. O., Balasingham, I., Halvorsen, P. S., & Rosseland, L. A. (2020) · IEEE Access · doi:10.1109/access.2020.3030031 · Cited by 38
“This is achieved with time delays, buffering, and storage [12]–[14], [19]–[21].”
BackgroundChen, Y., Yu, W., Sun, X., Wan, L., Tao, Y., & Xu, X. (2021) · Applied Acoustics · doi:10.1016/j.apacoust.2021.108128 · Cited by 35
“Recently, artificial intelligence (AI) technologies, such as machine learning algorithms and big data networking and analysis, have been developed and used in the fields of atmospheric science, medical, climate change, terrestrial communication, etc. [8].”
BackgroundThe detection of mild traumatic brain injury in paediatrics using artificial neural networks
Ellethy, H., Chandra, S. S., & Nasrallah, F. A. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104614 · Cited by 39
Performance evaluation of feature selection and tree-based algorithms for traffic classification
Aouedi, O., Piamrat, K., & Parrein, B. (2021) · IEEE International Conference on Communications workshops · doi:10.1109/iccworkshops50388.2021.9473580 · Cited by 36
“Thereby, in classification domains, some features can hinder the classification process, where the increase in the data dimensionality may decrease the predictive ability of an algorithm as well as cause an extra computational cost (e.g., storage and processing) [4].”
Sha, Y., Faber, J., Gou, S., Liu, B., Li, W., Schramm, S., Horst Stöcker, B., Steckenreiter, T., Vnucec, D., Wetzstein, N., et al. (2022) · Measurement · doi:10.1016/j.measurement.2022.110897 · Cited by 35
“1 Data Augmentation In general, machine learning is driven by big data [33].”
BackgroundTaxonomy of Machine Learning Algorithms and Its Applications
Rani, P., Kumar, R., Jain, A., & Lamba, R. (2020) · Journal of Computational and Theoretical Nanoscience · doi:10.1166/jctn.2020.8922 · Cited by 36
A Bayesian perspective of statistical machine learning for big data
Sambasivan, R., Das, S., & Sahu, S. K. (2020) · Computational Statistics · doi:10.1007/s00180-020-00970-8 · Cited by 38
Zhai, Y., Huang, Y., Xu, Y. W., Gan, J., Cao, H., Deng, W., Labati, R. D., Piuri, V., & Scotti, F. (2020) · IEEE Access · doi:10.1109/access.2020.2980248 · Cited by 41
“…T S (here is CASIA-WebFace) and a target domain D T , a learning task T T (here is LSAFBD), the purpose of transfer learning is to improve the learning of target prediction function f ( T ( · )) in DT using the knowledge in D S and T S , where D S (cid:54)= D T , or T S (cid:54)= T T [51], [52].”
MethodSha, Y., Faber, J., Gou, S., Liu, B., Li, W., Schramm, S., Horst Stöcker, B., Steckenreiter, T., Vnucec, D., Wetzstein, N., et al. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.104904 · Cited by 42
“2 Data Augmentation In general, machine learning is driven by big data[52].”
BackgroundJariwala, N., Putta, C. L., Gatade, K., Umarji, M., Rahman, S. N. R., Pawde, D. M., Sree, A., Kamble, A. S., Goswami, A., Chakraborty, P., et al. (2023) · Journal of Drug Delivery Science and Technology · doi:10.1016/j.jddst.2023.104751 · Cited by 40
Protein–ligand data at scale to support machine learning
Edwards, A. M., Owen, D. R., Zhang, L., Young, D. W., Willson, T. M., Wellnitz, J., Wang, Y., Walsh, J. J., Vernet, E., Tropsha, A., et al. (2025) · Nature Reviews Chemistry · doi:10.1038/s41570-025-00737-z · Cited by 39
“The large size and high dimensionality of these data also leverage respective analytical techniques that have been extensively developed by the ML/AI community 32,33 and employed in cheminformatics for drug discovery applications 34 .”
Mechanics and bio-interface engineering in flexible biosensors for continuous health monitoring
Qaiser, N., Suryaprabha, T., Vetrano, F., Hwang, B., & El‐Atab, N. (2026) · npj Flexible Electronics · doi:10.1038/s41528-025-00524-2 · Cited by 34
Tipu, R. K., Suman, S., & Batra, V. (2023) · Asian Journal of Civil Engineering · doi:10.1007/s42107-023-00768-1 · Cited by 35
“ML models have the ability to learn complex patterns and relationships from large datasets, enabling them to make accurate predictions based on a multitude of input variables (Camacho et al., 2018; L’Heureux et al., 2017; Zhou et al., 2017).”
Requirements Engineering in Machine Learning Projects
Gjorgjevikj, A., Mishev, K., Antovski, L., & Trajanov, D. (2023) · IEEE Access · doi:10.1109/access.2023.3294840 · Cited by 38
“Other examples of assumptions are those related to the data distribution across different classes in the real dataset, assumptions that the statistical properties are similar across the entire dataset [94], and similar.”
BackgroundMedical Multimedia Big Data Analysis Modeling Based on DBN Algorithm
Yang, Y. (2020) · IEEE Access · doi:10.1109/access.2020.2967075 · Cited by 33
“In order to obtain good research results, many research institutes pay great attention to the quality of data in the process of researching genes [14]–[16].”
BackgroundLeveraging transfer learning with deep learning for crime prediction
Butt, U. M., Letchmunan, S., Hassan, F. H., & Koh, T. W. (2024) · PLoS ONE · doi:10.1371/journal.pone.0296486 · Cited by 32
Machine Learning Prediction of Gas Hydrates Phase Equilibrium in Porous Medium
Beheshtian, S., Roodbari, S. K., Ghorbani, H., Azodinia, M., & Mudabbir, M. (2024) · IEEE International Symposium on Applied Computational Intelligence and Informatics (SACI) · doi:10.1109/saci60582.2024.10619733 · Cited by 32
Sahraoui, M., Laouissi, A., Karmi, Y., Abderazek, H., Hani, M., Chetbani, Y., Belaadi, A., Alshaikh, I. M. H., & Ghernaout, D. (2025) · Results in Engineering · doi:10.1016/j.rineng.2025.105561 · Cited by 32
An Overview of the Machine Learning Applied in Smart Cities
França, R. P., Monteiro, A. C. B., Arthur, R., & Iano, Y. (2020) · Lecture notes in intelligent transportation and infrastructure · doi:10.1007/978-3-030-60922-1_5 · Cited by 34
Al‐Hmouz, R., Pedrycz, W., Balamash, A. S., & Morfeq, A. (2020) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2020.3043659 · Cited by 32
Cooperative Approaches to Data Sharing and Analysis for Industrial Internet of Things Ecosystems
Baars, H., Tank, A., Weber, P., Kemper, H.-G., Lasi, H., & Pedell, B. (2021) · Applied Sciences · doi:10.3390/app11167547 · Cited by 37
“a shift of attention toward more predictive analytical systems owing to the rise of ML [38].”
BackgroundXiang, H., Xi, Y., Mao, D., Mahdianpari, M., Zhang, J., Wang, M., Jia, M., Yu, F., & Wang, Z. (2023) · Global Ecology and Conservation · doi:10.1016/j.gecco.2023.e02397 · Cited by 37
A survey of digital circuit testing in the light of machine learning
Pradhan, M., & Bhattacharya, B. B. (2020) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1360 · Cited by 32
A Review on Intelligent Recognition with Logging Data: Tasks, Current Status and Challenges
Zhu, X., Zhang, H., Ren, Q., Zhang, L., Huang, G., Shang, Z., & Sun, J. (2024) · Surveys in Geophysics · doi:10.1007/s10712-024-09853-9 · Cited by 32
“As a data science method, ML needs to satisfy some assumptions: (i) independent identical distribution; (ii) existence of feature space; (iii) existence of objective function, which sets certain conditions for effective application of ML (L’Heureux et al. 2017).”
Linear Cost-sensitive Max-margin Embedded Feature Selection for SVM
Aram, K. Y., Lam, S. S., & Khasawneh, M. T. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.116683 · Cited by 31
Meier, S., Klarmann, S., Thielen, N., Pfefferer, C., Kuhn, M., & Franke, J. E. (2023) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2023.08.024 · Cited by 31
Forecasting cyberattacks with incomplete, imbalanced, and insignificant data
Okutan, A., Werner, G., Yang, S. J., & McConky, K. T. (2018) · Cybersecurity · doi:10.1186/s42400-018-0016-5 · Cited by 31
“However, extracting these signals from continuously growing big data in a meaningful way requires special treatment (L’Heureux et al. 2017; Al-Jarrah et al. 2015).”
MethodMortazavizadeh, F., Bolonio, D., Mirzaei, M., Ng, J. L., Mortazavizadeh, S. V., Dehghani, A., Mortezavi, S., & Ghadirzadeh, H. (2025) · Journal of Hydroinformatics · doi:10.2166/hydro.2025.258 · Cited by 30
Wyngaard, J., Barbieri, L. K., Thomer, A. K., Adams, J., Sullivan, D., Parr, C. S., Shrestha, S. R., Crosby, C., Klump, J., & Bell, T. W. (2019) · Remote Sensing · doi:10.3390/rs11151797 · Cited by 36
“the international Earth and space science community’s effort to develop standards that will connect 137 researchers, publishers and data repositories[33,34], and the increase in efforts to utilise Machine 138 Learning tools on classical Big Data for a multitude of applications including the Geo-sciences[35,36].”
BackgroundMehltretter, J., Fratila, R., Benrimoh, D. A., Kapelner, A. D., Perlman, K., Snook, E., Israel, S. A., Armstrong, C., Miresco, M., & Turecki, G. (2020) · Computational Psychiatry · doi:10.1162/cpsy_a_00029 · Cited by 31
Deep Neural Networks Applied to Stock Market Sentiment Analysis
Correia, F. F., Madureira, A. M., & Bernardino, J. (2022) · Sensors · doi:10.3390/s22124409 · Cited by 30
“DNNs can be trained in a supervised training mode, where the target attribute to be predicted or classified is present in the training data, or in an unsupervised mode, where the training data are automatically generated from unlabeled data with little human intervention [4].”
BackgroundSheng, J., Wang, B., Zhang, Q., Zhou, R., Wang, L., & Yu, X. (2021) · Heliyon · doi:10.1016/j.heliyon.2021.e07287 · Cited by 31
“As mentioned previously, the imbalance of training data affects classification results [39].”
BackgroundGenerative adversarial networks for unbalanced fetal heart rate signal classification
Puspitasari, R. D. I., Ma’Sum, M. A., Alhamidi, M. R., Kurnianingsih, K., & Jatmiko, W. (2021) · ICT Express · doi:10.1016/j.icte.2021.06.007 · Cited by 29
Sheetal, A., Jiang, Z., & Milia, L. V. D. (2022) · Applied Psychology · doi:10.1111/apps.12435 · Cited by 34
Medicine and health of 21st Century: Not just a high biotech-driven solution
Assidi, M., Buhmeida, A. S., & Budowle, B. (2022) · npj Genomic Medicine · doi:10.1038/s41525-022-00336-7 · Cited by 31
From Concept to Implementation: The Data-Centric Development Process for AI in Industry
Luley, P.-P., Deriu, J., Yan, P., Schatte, G. A., & Stadelmann, T. (2023) · IEEE Swiss Conference on Data Science (SDS) · doi:10.1109/sds57534.2023.00017 · Cited by 34
“Based on the assumption that a model performs better when trained with more data [2], the only emphasis given to the data itself is to collect”
MethodLand Cover Segmentation of Airborne LiDAR Data Using Stochastic Atrous Network
Arief, H. A., Strand, G., Tveite, H., & Indahl, U. G. (2018) · Remote Sensing · doi:10.3390/rs10060973 · Cited by 31
“However, due to the complexity of the data and the difficulty of generating features of interest, most of the current techniques suffer from scaling problems when transferred to larger datasets [6].”
BackgroundA Survey on Recent Applications of Machine Learning with Big Data in Additive Manufacturing Industry
Alabi, M. O., Nixon, K. J., & Botef, I. (2018) · American Journal of Engineering and Applied Sciences · doi:10.3844/ajeassp.2018.1114.1124 · Cited by 30
Framework for atomic-level characterisation of quantum computer arrays by machine learning
Usman, M., Wong, Y. Z., Hill, C. D., & Hollenberg, L. C. L. (2020) · npj Computational Materials · doi:10.1038/s41524-020-0282-0 · Cited by 28
Lee, K. F. A., Gan, W., & Christopoulos, G. I. (2021) · Sensors · doi:10.3390/s21113843 · Cited by 27
Diagnostic analysis for outlier detection in big data analytics
Ridzuan, F., & Zainon, W. M. N. W. (2022) · Procedia Computer Science · doi:10.1016/j.procs.2021.12.189 · Cited by 27
A design concept of big data analytics model for managers in hospitality industries
Mousavian, S., Miah, S. J., & Zhong, Y. (2023) · Personal and Ubiquitous Computing · doi:10.1007/s00779-023-01714-3 · Cited by 27
Machine learning for fast development of advanced energy materials
Farhadi, B., You, J., Zheng, D., Liu, L., Wu, S., Li, J., Li, Z., Wang, K., & Liu, S. F. (2023) · Next Materials · doi:10.1016/j.nxmate.2023.100025 · Cited by 31
Data-driven machine learning for alloy research: Recent applications and prospects
Gao, X., Wang, H., Tan, H., Xing, L., & Hu, Z. (2023) · Materials Today Communications · doi:10.1016/j.mtcomm.2023.106697 · Cited by 35
Participant and Sample Selection for Efficient Online Federated Learning in UAV Swarms
Wu, F., Qu, Y., Wu, T., Dong, C., Guo, K., Wu, Q., & Guo, S. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3363181 · Cited by 27
“W ITH the advancement of machine learning (ML) techniques [1], the need for larger training data sets is progressively growing to ensure the accuracy of ML models.”
MethodMachine learning applied to digital phenotyping: A systematic literature review and taxonomy
dos Santos, M. P., Heckler, W. F., Bavaresco, R. S., & Barbosa, J. L. V. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108422 · Cited by 30
How does robotic process automation create value for firms?
Durão, D., & Reis, A. (2024) · Information Systems and e-Business Management · doi:10.1007/s10257-024-00685-z · Cited by 26
Physics-Informed Representation Alignment for Sparse Radio-Map Reconstruction
Jia, H., Chen, W., Huang, Z., Wang, L., Xiao, H., Jia, N., Wu, K., Lai, S., Tian, B., & Yue, Y. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3758161 · Cited by 26
Prediction of Cervical Cancer using Voting and DNN Classifiers
Rayavarapu, K., & Kolli, V. K. K. (2018) · International Conference on Current Trends towards Converging Technologies (ICCTCT) · doi:10.1109/icctct.2018.8551176 · Cited by 26
“Machine learning is one of the key components in big data revolution said by McKinsey Global Institute [4] because it can effectively find out hidden knowledge and unknown patterns in the specified datasets.”
BackgroundJameel, S. M., Hashmani, M. A., Rehman, M., & Budiman, A. (2020) · Sensors · doi:10.3390/s20205811 · Cited by 26
Machine learning-based data-driven robust optimization approach under uncertainty
Zhang, C., Wang, Z., & Wang, X. (2022) · Journal of Process Control · doi:10.1016/j.jprocont.2022.04.013 · Cited by 26
Event-case correlation for process mining using probabilistic optimization
Bayomie, D., Ciccio, C. D., & Mendling, J. (2023) · Information Systems · doi:10.1016/j.is.2023.102167 · Cited by 26
Dehkordi, A. T., Zoej, M. J. V., Mehran, A., Jafari, M., & Chegoonian, A. M. (2024) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2024.3364020 · Cited by 28
Sun, Q., & Yang, L. (2019) · CSEE Journal of Power and Energy Systems · doi:10.17775/cseejpes.2018.00830 · Cited by 48
de Souza, A. A., Barcelos, T., Muñoz, R., Villarroel, R. H., & da Silva, L. A. (2019) · IEEE Access · doi:10.1109/access.2019.2924343 · Cited by 28
“According to the work of [33], it is fundamental to define a priori questions to be answered at the end of the process so that the application of data mining tasks can achieve an”
An organic artificial synaptic memristor for neuromorphic computing
Gao, K., Sun, B. T., Yang, B., Cao, Z., Cui, Y., Wang, M., Kong, C., Zhou, G., Luo, S., Chen, X., et al. (2025) · Applied Materials Today · doi:10.1016/j.apmt.2025.102628 · Cited by 27
Machine Learning‐Assisted Simulations and Predictions for Battery Interfaces
Sun, Z., Li, X., Wu, Y., Gu, Q., & Zheng, S. (2025) · Advanced Intelligent Systems · doi:10.1002/aisy.202400626 · Cited by 26
Fast machine learning for building management systems
Mshragi, M., & Petri, I. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11226-6 · Cited by 33
Pati, A. K., Tripathy, A. R., & Subudhi, S. (2025) · Measurement · doi:10.1016/j.measurement.2025.119122 · Cited by 28
A Comprehensive Study of Big Data Machine Learning Approaches and Challenges
Singh, N., Singh, D. P., & Pant, B. (2017) · International Conference on Next Generation Computing and Information Systems (ICNGCIS) · doi:10.1109/icngcis.2017.14 · Cited by 25
“This study will provide an insight for the following Section II provides a short survey of the customary machine learning strategies with their challenges, taken after by a number of sophisticated learning processes in latest researches that either shows potential or genuinely necessary for comprehending the big data…”
BackgroundArtificial Intelligence, Machine Learning, and Surgical Science: Reality Versus Hype
Hechi, M. W. E., Ward, T. M., An, G. C., Maurer, L. R., Moheb, M. N. E., Tsoulfas, G., & Kaafarani, H. M. A. (2021) · Journal of Surgical Research · doi:10.1016/j.jss.2021.01.046 · Cited by 27
Machine Learning and Artificial Intelligence for Surgical Decision Making
Byerly, S. E., Maurer, L. R., Mantero, A. M. A., Naar, L., An, G. C., & Kaafarani, H. M. A. (2021) · Surgical Infections · doi:10.1089/sur.2021.007 · Cited by 26
Ardebili, A. A., Longo, A., & Ficarella, A. (2021) · E3S Web of Conferences · doi:10.1051/e3sconf/202131209002 · Cited by 32
Discretization-Based Feature Selection as a Bilevel Optimization Problem
Said, R., Elarbi, M., Bechikh, S., Coello, C. A. C., & Saïd, L. B. (2022) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2022.3192113 · Cited by 25
“MACHINE learning applications encompass several fields, such as big data [1], predictive and data analytics [2]–[4], speech recognition [5], and bioinformatics [6].”
BackgroundPoger, D., Yen, L., & Braet, F. (2023) · Histochemistry and Cell Biology · doi:10.1007/s00418-023-02191-8 · Cited by 28
Application of machine learning techniques in population pharmacokinetics/pharmacodynamics modeling
Uno, M., Nakamaru, Y., & Yamashita, F. (2024) · Drug Metabolism and Pharmacokinetics · doi:10.1016/j.dmpk.2024.101004 · Cited by 30
Serious gaming as a means of facilitating truly smart cities: a narrative review
Cavada, M., & Rogers, C. D. F. (2019) · Behaviour and Information Technology · doi:10.1080/0144929x.2019.1677775 · Cited by 25
“This would also bene fi t citizens (social, health, safety, even data interrogation are some of the possibilities) provided that participants are skill-literate and willing to share personal information (L ’ Heureux 2015; L ’ Heureux et al. 2017).”
BackgroundRadovan, A., Mršić, L., Đambić, G., & Mihaljević, B. (2024) · Eng · doi:10.3390/eng5040172 · Cited by 24
Kong, G., Peng, J., & Corcoran, J. (2025) · Computational Urban Science · doi:10.1007/s43762-025-00178-w · Cited by 37
“Machine learning techniques offer a promising solution to these challenges (Duarte & Álvarez, 2019; L’heureux et al., 2017; MacEachern & Forkert, 2021).”
REVIEW OF MACHINE LEARNING TECHNIQUES FOR VOLUMINOUS INFORMATION MANAGEMENT
Pandian, A. P. (2019) · Journal of Soft Computing Paradigm · doi:10.36548/jscp.2019.2.005 · Cited by 24
“CHANLLENGES FOR MACHINE LEARNING IN BIG DATA [12], [34], [35]”
BackgroundMeng, Q., Xiao, K., Shen, D., Zhu, H., & Xiong, H. (2022) · INFORMS journal on computing · doi:10.1287/ijoc.2022.1182 · Cited by 25
Salome, P., Sforazzini, F., Brugnara, G., Kudak, A., Dostal, M., Herold‐Mende, C. C., Heiland, S., Debus, J., Abdollahi, A., & Knoll, M. (2023) · Cancers · doi:10.3390/cancers15030965 · Cited by 24
“Robust radiomics models often require large amounts of data; therefore, MR images are usually collected from multiple centres, sites, and scanners [7].”
Pang, J., Liang, B., Ding, R., Yan, Q., Chen, R., & Xu, J. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad304 · Cited by 26
Feature Selection and Evolutionary Rule Learning for Big Data in Smart Building Energy Management
Rodríguez-Mier, P., Mucientes, M., & Bugarín, A. (2019) · Cognitive Computation · doi:10.1007/s12559-019-09630-6 · Cited by 24
Beyond 5G: Big Data Processing for Better Spectrum Utilization
Kliks, A., Kulacz, L., Kryszkiewicz, P., Bogucka, H., Dryjanski, M., Isaksson, M., Koudouridis, G. P., & Tengkvist, P. (2020) · IEEE Vehicular Technology Magazine · doi:10.1109/mvt.2020.2988415 · Cited by 24
Edge Computing-Based Ensemble Learning Model for Health Care Decision Systems
Vincent, A. C. S. R., & Sengan, S. (2024) · Scientific Reports · doi:10.1038/s41598-024-78225-5 · Cited by 23
A Comparative Study of Music Recommendation Systems
Patel, A., & Wadhvani, R. (2018) · IEEE International Students' Conference on Electrical, Electronics and Computer Science (SCEECS) · doi:10.1109/sceecs.2018.8546852 · Cited by 23
“The important thing to keep in mind is the volume, veracity, and velocity of music records generating because of user interaction[11].”
BackgroundPrakaash, A. S., & Sivakumar, K. (2020) · International Journal of Wavelets Multiresolution and Information Processing · doi:10.1142/s0219691320500745 · Cited by 23
The Democratization of Artificial Intelligence: Net Politics in the Era of Learning Algorithms
Sudmann, A. (2019) · transcript Verlag eBooks · doi:10.1515/9783839447192 · Cited by 44
Feature Selection Techniques for Big Data Analytics
Albattah, W., Khan, R. U., Alsharekh, M. F., & Khasawneh, S. F. (2022) · Electronics · doi:10.3390/electronics11193177 · Cited by 26
Smart batch process: The evolution from 1D and 2D to new 3D perspectives in the era of Big Data
Zhou, Y., & Gao, F. (2023) · Journal of Process Control · doi:10.1016/j.jprocont.2023.103088 · Cited by 26
Leukel, J., Scheurer, L., & Sugumaran, V. (2024) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2024.137397 · Cited by 24
A Reinforcement Learning-Based QAM/PSK Symbol Synchronizer
Matta, M., Cardarilli, G. C., Nunzio, L. D., Fazzolari, R., Giardino, D., Nannarelli, A., Re, M., & Spanò, S. (2019) · IEEE Access · doi:10.1109/access.2019.2938390 · Cited by 24
“ML is applied in several fields, such as medicine [2], financial trading [3], big data management [4], imaging and image processing [5], security [6], [7], mobile apps [8] and more.”
Quadri, T. W., Akpan, E. D., Elugoke, S. E., Olasunkanmi, L. O., Sheetal, Singh, A. K., Pani, B., Tuteja, J., Shukla, S. K., Verma, C., et al. (2025) · Applied Physics Reviews · doi:10.1063/5.0228503 · Cited by 22
Metadata
- Authors
- L'Heureux, A., Grolinger, K., Elyamany, H. F., & Capretz, M. A. M.
- Affiliations
- Western University (CA)
- Suez Canal University (EG)
- Venue
- IEEE Access
- Published
- 2017
- Volume
- 5
- Pages
- 7776-7797
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2609731728
- Cited by
- 1,023
- References
- 109
- Citations by year
- 2026: 50 · 2025: 175 · 2024: 128 · 2023: 145 · 2022: 130 · 2021: 138 · 2020: 105 · 2019: 88 · 2018: 53 · 2017: 11
- FWCI
- 112.99
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- NSERC CRD at Western University (477530-14)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Big Data Technologies and Applications
- Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Keywords
- big data challenges, volume, velocity, varieties, honesty, scalable learning, data-driven decision making, research gaps
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.