Machine learning with big data: challenges and approaches.
Open accessThe DOI matches its Crossref record; 108 of the 109 references it cites were found in a registry or an index.
Abstract
The Big Data revolution promises to transform how we live, work, and think by enabling process optimization, empowering insight discovery and improving decision making. The realization of this grand potential relies on the ability to extract value from such massive data through data analytics; machine learning is at its core because of its ability to learn from data and provide data driven insights, decisions, and predictions. However, traditional machine learning approaches were developed in a different era, and thus are based upon multiple assumptions, such as the data set fitting entirely into memory, what unfortunately no longer holds true in this new context. These broken assumptions, together with the Big Data characteristics, are creating obstacles for the traditional techniques. Consequently, this paper compiles, summarizes, and organizes machine learning challenges with Big Data. In contrast to other research that discusses challenges, this work highlights the cause–effect relationship by organizing challenges according to Big Data Vs or dimensions that instigated the issue: volume, velocity, variety, or veracity. Moreover, emerging machine learning approaches and techniques are discussed in terms of how they are capable of handling the various challenges with the ultimate objective of helping practitioners select appropriate solutions for their use cases. Finally, a matrix relating the challenges and approaches is presented. Through this process, this paper provides a perspective on the domain, identifies research gaps and opportunities, and provides a strong foundation and encouragement for further research in the field of machine learning with Big Data.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, training these models requires large, diverse, and well-labeled datasets [94].”
From A Review of Passenger Counting in Public Transport Concepts with Solution Proposal Based on Image Processing and Machine Learning (2024) · cites this paper as [94]
In the citing paper
“it is also shifting from a single domain (e.g., domain expertise, or expert systems) to a cross-disciplinary approach through collaboration”
From Challenges and Future Directions of Big Data and Artificial Intelligence in Education (2020) · cites this paper as L’heureux et al., 2017
Citations
Cites
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927 · cited 1×
“• Regularization paths [92] for linear models supports linear regression, two-class logistic regression, and multinomial regression problems.”
MethodThe WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750 · cited 1×
“However, at the moment, they support a limited number of algorithms compared to the R language [73], MATLAB [74], or Weka [75].”
MethodRepresentation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001 · cited 1×
“Representation learning is also often referred to as feature learning [100].”
BackgroundEnsemble methods in machine learning
Dietterich, T. G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45014-9_1 · Cited by 8,408
(2011) · Cited by 5,203
Multiple comparisons among means
Dunn, O. J. (1961) · Journal of the American Statistical Association · doi:10.1080/01621459.1961.10482090 · Cited by 5,006 · cited 1×
“It suggests that if testing m hypotheses with a desired significance of α, each individual hypothesis should be tested at a significance level of α/m [43].”
BackgroundResilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing
Zaharia, M., Chowdhury, M., Das, T., Dave, A., Ma, J. H., McCauley, M., Franklin, M. J. M., Shenker, S. J., & Stoica, I. G. (2012) · UC Berkeley · Cited by 4,891
The Hadoop Distributed File System
Shvachko, K., Kuang, H., Radia, S., & Chansler, R. (2010) · 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST) · doi:10.1109/msst.2010.5496972 · Cited by 4,834 · cited 8×
“In these stages, independent of the category of manipulations, processes can be embedded to capture data provenance and therefore remedy provenance challenge; an example is the Reduce and Map Provenance (RAMP) developed for MapReduce as an extension for Hadoop [64].”
MethodInfluentialHan, S., Mao, H., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1510.00149 · Cited by 4,662 · cited 1×
“Deep compression has been proposed as a way of speeding up processing without the loss of accuracy [105].”
Background
Research works printed but not linked: 20
- goodfellow, 2016, Deep Learning
- marz, 2014, Apache Storm
- rouse, 2011, Machine Learning Definition
- 2015, R A Language and Environment for Statistical Computing, 1
- 2014, IBM Watson Ecosystem Program
- wu, 2016, Google’s neural machine translation system Bridging the gap between human and machine translation
- 2016, Machine Learning American
- 2016, Google Cloud Machine Learning
- 2016, Matlab
- 2013, Billion Devices Will Wirelessly Connect to the Internet of Everything in 2020
- krikorian, 2010, Twitter by the Numbers Twitter
- 2016, H20
- 2016, Apache Mahout
- abadi, 2016, TensorFlow Large-Scale Machine Learning on Heterogeneous Systems
- langford, 2007, Vowpal wabbit online learning project
- rouse, 2009, Predictive Analytics Definition
- sukumar, 2014, Machine learning in the big data era: Are we there yet?, Proc 20th ACM SIGKDD Conf Knowl Discovery Data Mining Workshop Data Sci Social Good (KDD), 1
- 2016, GPU Applications Transforming Computational Research and Engineering
- torrey, 2010, Handbook of Research on Machine Learning Applications and Trends
- 2016, Apache Giraph
Cited by
Items 301–400 of 1,002
Morganti, L., Rudenå, A., Brunklaus, B., Bomark, P., Armijo, A., Skog, J., Zaffagnini, T., Pracucci, A., & Larraz, J. A. (2025) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2025.146074 · Cited by 22
“A key aspect of DSM is semantic data processing, which addresses ambiguity in information and enhances communication between systems (L ’ Heureux et al., 2017).”
Sullivan, B. P., Arias–Nava, E. H., Desai, S., Rebull, J. S., Rossi, M., Ramundo, L., & Terzi, S. (2021) · IET Collaborative Intelligent Manufacturing · doi:10.1049/cim2.12012 · Cited by 26
Billert, A. M., Frey, M., & Gauterin, F. (2022) · IEEE Open Journal of Intelligent Transportation Systems · doi:10.1109/ojits.2022.3177007 · Cited by 24
Lenaers, I., Boudt, K., & Moor, L. D. (2023) · International Journal of Housing Markets and Analysis · doi:10.1108/ijhma-11-2022-0172 · Cited by 23
Zennaro, F., Furlan, E., Canu, D. M., Alcázar, L. A., Rosati, G., Solidoro, C., Aslan, S., & Critto, A. (2023) · Ecological Indicators · doi:10.1016/j.ecolind.2023.111245 · Cited by 22
“…that ML needs a large volume of data covering proper range of variability to be trained, and shows high performing skills in a big data context (L ’ Heureux et al., 2017), the availability of high temporal resolute WQ monitored data within the Venice Lagoon has made it possible to develop a…”
Land use land cover classification using Sentinel imagery based on deep learning models
Sawant, S. T., & Ghosh, J. K. (2024) · Journal of Earth System Science · doi:10.1007/s12040-024-02298-z · Cited by 23
“Models created using machine learning cannot learn incrementally, so training on extensive data can become dif B cult (Polikar 2012; L’heureux et al .”
Jin, L., Guo, B., Jiang, Y., Wang, F., Xie, X., & Gao, M. (2018) · IEEE Access · doi:10.1109/access.2018.2878150 · Cited by 22
A context-aware machine learning-based approach
do Nascimento, N. M., Alencar, P., de Lucena, C. J. P., & Cowan, D. D. (2018) · Computer Science and Software Engineering · Cited by 47
Nassar, K. I., Galvão, T. L. P., Gouveia, J. D., & Gomes, J. R. B. (2025) · The Journal of Physical Chemistry C · doi:10.1021/acs.jpcc.4c08353 · Cited by 21
Performance Evaluation of Data-driven Intelligent Algorithms for Big data Ecosystem
Junaid, M., Ali, S., Siddiqui, I. F., Nam, C.-S., Qureshi, N. M. F., Kim, J., & Shin, D. R. (2022) · Wireless Personal Communications · doi:10.1007/s11277-021-09362-7 · Cited by 21
“It is built on top of the Hadoop platform and operates in the background to facilitate the delivery of trustworthy, consistent, and high-speed computing on huge data [10–12].”
MethodRole of federated learning in healthcare systems: A survey
Rana, N., & Marwaha, H. (2023) · Mathematical Foundations of Computing · doi:10.3934/mfc.2023023 · Cited by 23
Application of Machine Learning Based on Structured Medical Data in Gastroenterology
Kim, H., Gong, E. J., & Bang, C. S. (2023) · Biomimetics · doi:10.3390/biomimetics8070512 · Cited by 21
Adaptive Method for Feature Selection in the Machine Learning Context
Touati, Y. E., Slimane, J. B., & Saidani, T. S. (2024) · Engineering Technology & Applied Science Research · doi:10.48084/etasr.7401 · Cited by 21
“Machine Learning (ML) models face certain challenges as they handle increasingly large datasets, resulting in a rise in model complexity and a significant demand on processing resources [1].”
BackgroundJafarzadeh, F., Moghaddam, A. A., Razzagh, S., Barzegar, R., Cloutier, V., & Rosa, É. (2024) · Groundwater for Sustainable Development · doi:10.1016/j.gsd.2024.101296 · Cited by 22
Čeponis, D., & Goranin, N. (2020) · Applied Sciences · doi:10.3390/app10072373 · Cited by 24
“Such a task, combined with Big Data, requires reanalyzing applicability of traditional ML methods and looking into another promising field, specifically, DL [52,53].”
MethodApplication of Algorithmic Cognitive Decision Trust Modeling for Cyber Security Within Organisations
Rodgers, W., Attah‐Boakye, R., & Adams, K. (2020) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2020.3019218 · Cited by 26
Amo, D., Gómez, P., Hernández-Ibáñez, L. A., & Fonseca, D. (2021) · Applied Sciences · doi:10.3390/app11020806 · Cited by 25
Pariaman, H., Luciana, G. M., Wisyaldin, M. K., & Hisjam, M. (2021) · Evergreen · doi:10.5109/4372264 · Cited by 25
“This approach uses historic CM data to bring up information finding and accurate decision-making 14) .”
Rajnoha, R., & Hadač, J. (2021) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2021.3113502 · Cited by 23
Interpretable machine learning with reject option
Brinkrolf, J., & Hammer, B. (2018) · at - Automatisierungstechnik · doi:10.1515/auto-2017-0123 · Cited by 21
Advances in the Design and Discovery of Organic Semiconductors Aided by Machine Learning
Ogbaje, M., Bhat, V., & Risko, C. M. (2025) · Annual Review of Materials Research · doi:10.1146/annurev-matsci-080423-011746 · Cited by 21
Fault Detection of Li–Ion Batteries in Electric Vehicles: A Comprehensive Review
Li, H., Shaukat, H., Zhu, R., Kaleem, M. B., & Wu, Y. (2025) · Sustainability · doi:10.3390/su17146322 · Cited by 20
Application of Irrigation Decision‐Making Methods for Smart Irrigation Systems: A Review
Liu, Y., Yan, H., Zhang, C., Zhang, J., Wang, G., Zhang, D., Bao, R., & Han, Y. (2026) · Irrigation and Drainage · doi:10.1002/ird.70098 · Cited by 20
“However, a considerable amount of clean, representative and nonsparse data is still required to properly formulate these models (L'heureux et al. 2017).”
The Role of Big Data in Advancing Artificial Intelligence: Methods and Case Studies
Katangoori, A. (2026) · International Journal of Artificial Intelligence and Machine Learning · doi:10.51483/ijaiml.6.1.2026.37-54 · Cited by 20
Aram, K. Y., Lam, S. S., & Khasawneh, M. T. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110421 · Cited by 23
Kim, S., Lee, E., Hwang, H., Pyo, J., Yun, D., Baek, S., & Cho, K. H. (2024) · Water Research X · doi:10.1016/j.wroa.2024.100228 · Cited by 20
“…autonomously (Szegedy et al., 2015; Zhou et al., 2017), simplify complex dynamics, such as hydrogeological processes, handle vast datasets efficiently (L ’ heureux et al., 2017; Rasp et al., 2018; Talukdar et al., 2023), and provide rapid and accurate predictions of hydrological conditions.”
BackgroundFatima, M., Hanif, S., Elsharkawy, E. R., Zafar, F., Zulfiqar, A., Khan, M. A., Akhtar, N., Fareed, Z., El-Bahy, Z. M., Shafiq, Z., et al. (2024) · Microchemical Journal · doi:10.1016/j.microc.2024.110921 · Cited by 20
Predicting Student Performance in a Programming Tutoring System Using AI and Filtering Techniques
Ilić, M., Kekovic, G., Mikić, V., Mangaroska, K., Kopanja, L., & Vesin, B. (2024) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2024.3431473 · Cited by 22
Enabling efficient and low-effort decentralized federated learning with the EdgeFL framework
Zhang, H., Bosch, J., & Olsson, H. H. (2024) · Information and Software Technology · doi:10.1016/j.infsof.2024.107600 · Cited by 22
Cancers classification based on deep neural networks and emotional learning approach
Jafarpisheh, N., & Teshnehlab, M. (2018) · IET Systems Biology · doi:10.1049/iet-syb.2018.5002 · Cited by 20
“Therefore, approaches such as the deep neural networks (DNNs) [6, 7] are widely used in their different aspects and, according to Ravi et al.”
MethodPerformance Analysis of Anomaly Based Network Intrusion Detection Systems
Abedin, M. Z., Siddiquee, K. N. E. A., Bhuyan, M. S., Karim, R., Hossein, M. S., & Andersson, K. (2018) · IEEE Conference on Local Computer Networks Workshops (LCN Workshops) · doi:10.1109/lcnw.2018.8628599 · Cited by 22
“The research community has made efforts analyzing prospects and challenges of machine learning models for developing smart systems based on AI [16][17][18].”
BackgroundDewi, K. C., Murfi, H., & Abdullah, S. (2019) · International Conference on Science in Information Technology · doi:10.1109/icsitech46713.2019.8987520 · Cited by 24
“One of them is ensemble learning [4].”
Real, A., Pérez‐Sanz, A., García-Gonzalo, P., Castillo-Michel, H. A., Gismera, M. J., & Lobo, M. C. (2020) · Journal of Environmental Management · doi:10.1016/j.jenvman.2020.111073 · Cited by 20
Maleknia, S., Tavassolifar, M. J., Mottaghitalab, F., Zali, M. R., & Meyfour, A. (2022) · Molecular Medicine · doi:10.1186/s10020-022-00513-5 · Cited by 20
Zhang, J., Liu, X., Qin, Y., Fan, Y., & Cheng, S. (2024) · Land · doi:10.3390/land13091527 · Cited by 21
Transformative Effects of Big Data on Advanced Data Analytics: Open Issues and Critical Challenges
Kumari, S., & Muthulakshmi, P. (2022) · Journal of Computer Science · doi:10.3844/jcssp.2022.463.479 · Cited by 19
“A new report (L’heureux et al., 2017) shows that AI calculations will be the fundamental piece of big data examination in the short future.”
BackgroundByzantine-robust Federated Learning via Cosine Similarity Aggregation
Zhu, T., Guo, Z., Yao, C., Tan, J., Dou, S., Wang, W., & Han, Z. (2024) · Computer Networks · doi:10.1016/j.comnet.2024.110730 · Cited by 28
Advance in Significant Wave Height Prediction: A Comprehensive Survey
Mo, J., Wang, X., Huang, S., & Wang, R. (2024) · Complex System Modeling and Simulation · doi:10.23919/csms.2024.0019 · Cited by 20
Haining, K., Brunner, G., Gajwani, R., Groß, J., Gumley, A. I., Lawrie, S. M., Schwannauer, M., Schultze‐Lutter, F., & Uhlhaas, P. J. (2021) · Schizophrenia Research · doi:10.1016/j.schres.2021.02.019 · Cited by 19
Estado de la cuestión de la inteligencia artificial y los sistemas de aprendizaje autónomo
Alastruey, C. F. (2021) · Sociología y Tecnociencia · doi:10.24197/st.extra_2.2021.182-195 · Cited by 19
Saeed, A., Li, C., Zhu, Q., & Ahmad, B. (2025) · IEEE Transactions on Sustainable Energy · doi:10.1109/tste.2025.3543420 · Cited by 18
Principe, R. A. A., Chiarini, N., & Viviani, M. (2025) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.70019 · Cited by 26
Ahmed, Y. S., & Milani, A. S. (2025) · Decision Analytics Journal · doi:10.1016/j.dajour.2025.100591 · Cited by 24
Saeed, A., Li, C., Rubaiee, S., Danish, M., & Anwar, S. (2025) · Energy · doi:10.1016/j.energy.2025.137979 · Cited by 19
Sayyad, J. K., Attarde, K., & Yılmaz, B. (2024) · Big Data and Cognitive Computing · doi:10.3390/bdcc8080081 · Cited by 18
Big Data Analytics with Machine Learning: Challenges, Innovations, and Applications
Niazi, S. (2024) · Journal of Engineering and Computational Intelligence Review · doi:10.63544/55gqb291 · Cited by 18
Metric transfer learning via geometric knowledge embedding
Ahmadvand, M., & Tahmoresnezhad, J. (2020) · Applied Intelligence · doi:10.1007/s10489-020-01853-7 · Cited by 19
Weigl, S., Wittmann, E., Rück, T., Bierl, R., & Matysik, F. (2020) · Sensors and Actuators B Chemical · doi:10.1016/j.snb.2020.129001 · Cited by 18
RLSTM: A New Framework of Stock Prediction by Using Random Noise for Overfitting Prevention
Zheng, H., Zhou, Z., & Chen, J. (2021) · Computational Intelligence and Neuroscience · doi:10.1155/2021/8865816 · Cited by 18
“A better performance can be got as the amount of data increases [25].”
BackgroundKhushaba, R. N., Melkumyan, A., & Hill, A. J. (2021) · Mathematical Geosciences · doi:10.1007/s11004-021-09970-w · Cited by 22
RBLJAN: Robust Byte-Label Joint Attention Network for Network Traffic Classification
Xiao, X., Wang, S., Hu, G., Li, Q., Mao, K., Luo, X., Zhang, B., & Xia, S. (2024) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2024.3478838 · Cited by 23
“Inaddition,Lietal.”
Federated Learning-Based Model for Predicting Mortality: Systematic Review and Meta-Analysis
Tahir, N., Jung, C., Lee, S., Azizah, N., Ho, W., & Li, T. (2025) · Journal of Medical Internet Research · doi:10.2196/65708 · Cited by 19
Jubair, H., & Mehenaz, M. (2025) · Digital Health · doi:10.1177/20552076251355365 · Cited by 20
“18,19”
Understanding Student Navigation Patterns in Game-Based Learning
Liu, M., Cai, Y. C., Han, S., & Shao, P. (2022) · Journal of Learning Analytics · doi:10.18608/jla.2022.7637 · Cited by 20
“…the effectiveness of the games and gain a deeper understanding of student learning processes to make informed decisions regarding game design, interventions, and using games for teaching and learning purposes (Gursoy et al., 2017; Ifenthaler et al., 2019; L’Heureux et al., 2017; Loh & Sheng, 2015).”
BackgroundThe Evolution of Voice Assistants: From Text-to-Speech to Conversational AI
Jampala, R., Kola, D. S., Gummadi, A. N., Bhavanam, M., & Pannerselvam, I. (2024) · International Conference on Intelligent Data Communication Technologies and Internet of Things (IDCIoT) · doi:10.1109/idciot59759.2024.10467739 · Cited by 17
“This evolution stems from significant strides in machine learning, natural language processing (NLP), and voice recognition technologies, fundamentally altering the nature of our technological engagement [1].”
BackgroundMoving Health Literacy Research and Practice towards a Vision of Equity, Precision and Transparency
Guo, S., Yu, X., & Okan, O. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17207650 · Cited by 18
“In the field of big data and public health, machine learning is a fundamental component of data analytics that provides data-driven insights, decisions, and predictions [68,69].”
BackgroundBig Data Privacy and Challenges for Machine Learning
Himthani, P., Dubey, G. P., Sharma, B. M., & Taneja, A. (2020) · International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC) · doi:10.1109/i-smac49090.2020.9243527 · Cited by 17
“Machine Learning is a very vast domain with a lot of application areas [22].”
BackgroundMultivariate online regression analysis with heterogeneous streaming data
Luo, L., & Song, P. X. ‐. (2021) · Canadian Journal of Statistics · doi:10.1002/cjs.11667 · Cited by 17
“Incorporating dynamic heterogeneity and correlation into the analysis of data streams leads to increased complexity in modelling and statistical inference and is a difficult problem, even in offline settings (L’Heureux et al., 2017; Sadik, Gruenwald & Leal, 2018).”
BackgroundA fuzzy partition-based method to classify social messages assessing their emotional relevance
Cardone, B., Martino, F. D., & Senatore, S. (2022) · Information Sciences · doi:10.1016/j.ins.2022.02.028 · Cited by 18
Navigating the fusion of federated learning and big data: a systematic review for the AI landscape
Haripriya, R., Khare, N., Pandey, M., & Biswas, S. (2025) · Cluster Computing · doi:10.1007/s10586-024-05070-6 · Cited by 18
“Effectively handling the immense magnitude, diversity, and speed of big data necessitates a resilient infrastructure and potent analytical instruments, the implementation of which can be expensive and intricate [98].”
Nyangiwe, N. N., Kenfack, A. D. K., Thantsha, N. M., & Msimanga, M. (2025) · Energy Science & Engineering · doi:10.1002/ese3.70423 · Cited by 19
“Oftentimes, such a model fails to generalise to other systems, thus resulting in a limitation in applicability for many real‐world applications [134, 135].”
A domain-region based evaluation of ML performance robustness to covariate shift
Bayram, F., & Ahmed, B. S. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-08622-w · Cited by 19
“However, this assumption is often not satisfied in real-world applications [1].”
BackgroundData Quality, Bias, and Strategic Challenges in Reinforcement Learning for Healthcare: A Survey
Rahman, A. U., Saqia, B., Alsenani, Y. S., & Ullah, I. (2024) · International Journal of Data Informatics and Intelligent Computing · doi:10.59461/ijdiic.v3i3.128 · Cited by 20
Supervised machine learning for microbiomics: Bridging the gap between current and best practices
Dudek, N. K., Chakhvadze, M., Kobakhidze, S., Kantidze, O. L., & Gankin, Y. V. (2024) · Machine Learning with Applications · doi:10.1016/j.mlwa.2024.100607 · Cited by 20
Nguyen, H. N., Kim, C. H., & Kim, J.-M. (2018) · Applied Sciences · doi:10.3390/app8112332 · Cited by 16
Automatic Annotation Performance of TextBlob and VADER on Covid Vaccination Dataset
Alenzi, B. M., Khan, M. B., Hasanat, M. H. A., Saudagar, A. K. J., AlKhathami, M., & AlTameem, A. (2022) · Intelligent Automation & Soft Computing · doi:10.32604/iasc.2022.025861 · Cited by 16
Mining big data to help make informed decisions for designing effective digital educational games
Liu, M., Li, C., Pan, Z., & Pan, X. (2019) · Interactive Learning Environments · doi:10.1080/10494820.2019.1639061 · Cited by 17
“Learning analytics allows researchers to extract large amounts of data from educational contexts in order to understand learners ’ behaviors and optimize their learning environments (Castro, Vellido, Nebot, & Mugica, 2007; L ’ Heureux, Grolinger, Elyamany, & Capretz, 2017).”
BackgroundZheng, Z., Qi, L., Wang, H., Pan, A., & Zhou, J. H. (2019) · IET Power Electronics · doi:10.1049/iet-pel.2019.0593 · Cited by 17
“In many fields, machine recognition performance using features from deep learning has exceeded human performance [18].”
BackgroundWei, J., Qi, S., Wang, W., Jiang, L., Gao, H., Zhao, F., Al-Bukhaiti, K., & Wan, A. (2025) · Contemporary Mathematics · doi:10.37256/cm.6220256459 · Cited by 15
“Furthermore, AI cannot fully replace the advantages of human group decision-making and may, in certain instances, intensify the complexities involved in being decision-making processes [99, 117].”
Khanal, S., Kumar, A., Kumar, P., Thakur, P., Chander, A. M., Verma, R., Tapwal, A., Chauhan, V., Kumar, D., & Kumar, D. (2025) · Chinese Herbal Medicines · doi:10.1016/j.chmed.2025.05.003 · Cited by 15
“Beyond technical constraints, biases in dataset selection, algorithm design, and human decision-making undermine model reliability (L’heureux et al., 2017).”
Silpa, N., & Rao, V. V. R. M. (2021) · Indian Journal of Computer Science and Engineering · doi:10.21817/indjcse/2021/v12i5/211205050 · Cited by 15
Zhou, Y., Harris, R., & Tranos, E. (2023) · Journal of Geovisualization and Spatial Analysis · doi:10.1007/s41651-023-00142-4 · Cited by 15
“Additionally, traditional machine learning methods rely on statistical probability principles, assuming data are independently and identically distributed (L’heureux et al. 2017); however, they are not applicable in the case of datasets where there is spatial heterogeneity.”
MethodFaridli, E. M., Abidin, N., Sutama, S., Sutopo, A., & Murtiyasa, B. (2024) · Jurnal EDUCATIO Jurnal Pendidikan Indonesia · doi:10.29210/1202423797 · Cited by 15
“Input sumber daya meliputi sumber daya manusia (kepala sekolah, guru, karyawan, siswa) dan sumber daya selebihnya (peralatan, perlengkapan, uang, bahan dan sebagainya) (Anugrah et al., 2022; L’heureux et al., 2017; Ruyani et al., 2022).”
BackgroundSeasonal heatwave forecasting with explainable machine learning and remote sensing data
Kan, J.-C., Passos, M. V., Destouni, G., Barquet, K., Ferreira, C., & Kalantari, Z. (2025) · Stochastic Environmental Research and Risk Assessment · doi:10.1007/s00477-025-03020-1 · Cited by 16
“These models rely heavily on the quality and availability of training data and are unable to generate predictions beyond the patterns captured in the provided data (L’Heureux et al. 2017).”
A review at Machine Learning algorithms targeting big data challenges
Rathor, A., & Gyanchandani, M. (2017) · International Conference on Electrical, Electronics, Communication, Computer and Optimization Techniques (ICEECCOT) · doi:10.1109/iceeccot.2017.8284604 · Cited by 20
She, R., Liu, S., Wan, S., Xiong, K., & Fan, P. (2019) · IEEE Access · doi:10.1109/access.2019.2926518 · Cited by 18
Big Data Analytics in Health Care: A Review Paper
Yousef, M. (2021) · International Journal of Computer Science and Information Technology · doi:10.5121/ijcsit.2021.13202 · Cited by 20
“Medical data obtained by healthcare providers from individuals and their medical records may contain private and confidential data [32].”
A Review on IoT with Big Data Analytics
Ahmad, A. F., Sayeed, M. S., Tan, C. P., Tan, K. G., Bari, M. A., & Hossain, F. (2021) · doi:10.1109/icoict52021.2021.9527503 · Cited by 20
Process monitoring for quality — A multiple classifier system for highly unbalanced data
Escobar, C. A., Macias, D., & Morales-Menéndez, R. (2021) · Heliyon · doi:10.1016/j.heliyon.2021.e08123 · Cited by 16
“The business value of implementing real-time processing is the ability for instantaneous streaming of information and reaction [65] and this value has to prevail for a company to keep investing and develop new products and services.”
BackgroundImplementation of machine learning for human aspect in information security awareness
Siwi, S., & Fitri, S. (2021) · Istrazivanja i projektovanja za privredu · doi:10.5937/jaes0-28530 · Cited by 16
“Feature selection has been used to reduce irrelevant data, unnecessary feature extraction, and determine a subset of relevant features based on specific criteria [17] [18].”
BackgroundMethodMagzymov, D., Ratnakar, R. R., Dindoruk, B., & Johns, R. T. (2022) · Journal of Petroleum Science and Engineering · doi:10.1016/j.petrol.2022.111056 · Cited by 15
Improved GRU prediction of paper pulp press variables using different pre-processing methods
Mateus, B. C., Mendes, M., Farinha, J. T., Cardoso, A. J. M., Assis, R., & Soltanali, H. (2022) · Production & Manufacturing Research · doi:10.1080/21693277.2022.2155263 · Cited by 18
“Maintenance 4.0 is about predicting future asset failures and ultimately determining the most effective preventive measures by applying advanced analytics techniques to Big Data about the technical condition, usage, environment, maintenance history and similar assets elsewhere and, in fact, anything that might correla…”
InfluentialGenetic-efficient fine-tuning with layer pruning on multimodal Covid-19 medical imaging
Ismail, W. N., Alsalamah, H. A., & Mohamed, E. A. E. M. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-09194-5 · Cited by 18
Big Data Classification Using Scale-Free Binary Particle Swarm Optimization
Gupta, S. L., Baghel, A. S., & Iqbal, A. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-981-13-0761-4_109 · Cited by 15
Game, P., Vaze, V. M., & Emmanuel, M. (2019) · Evolutionary Intelligence · doi:10.1007/s12065-019-00267-w · Cited by 15
Distributed Tree-Based Machine Learning for Short-Term Load Forecasting With Apache Spark
Zainab, A., Ghrayeb, A., Abu‐Rub, H., Refaat, S. S., & Bouhali, O. (2021) · IEEE Access · doi:10.1109/access.2021.3072609 · Cited by 15
“, handling large size of data stored historically in the data centers [2].”
BackgroundA Comprehensive Video Dataset for Surgical Laparoscopic Action Analysis
Ye, Z., Zhou, R., Deng, Z., Wang, D., Zhu, Y., Jin, X., Zhang, L., Chen, T., Zhang, H., & Wang, M. (2025) · Scientific Data · doi:10.1038/s41597-025-05093-7 · Cited by 15
“Today, datasets are essential for the advancement of AI research 11 .”
Fonseca, G., & Vieira, D. C. (2023) · Ocean and Coastal Research · doi:10.1590/2675-2824071.22044gf · Cited by 15
Montasari, R. (2024) · Advanced sciences and technologies for security applications · doi:10.1007/978-3-031-50454-9_9 · Cited by 14
Gao, J., Gui, W., Xie, X., Wan, R., Yin, S., & Yang, C. (2025) · IEEE Transactions on Power Electronics · doi:10.1109/tpel.2025.3568276 · Cited by 15
Jia, H., Xu, Y., Tian, G., Zhou, M., Zhang, J., & Zhang, H. (2018) · IEEE Access · doi:10.1109/access.2018.2870596 · Cited by 14
“Also, the data-driven based sustainable FLA problem is an interesting topic as our future work [59-63].”
BackgroundData Science on Industrial Data—Today’s Challenges in Brown Field Applications
Klaeger, T., Gottschall, S., & Oehm, L. (2021) · Challenges · doi:10.3390/challe12010002 · Cited by 14
Evaluating the Values of Sources in Transfer Learning
Parvez, M. R., & Chang, K.-W. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.402 · Cited by 22
NetGenes: A Database of Essential Genes Predicted Using Features From Interaction Networks
Senthamizhan, V., Ravindran, B., & Raman, K. (2021) · Frontiers in Genetics · doi:10.3389/fgene.2021.722198 · Cited by 14
“In practice, increasing the dataset size boosts the variance and, in turn, reduces the classification capability of the model (L’Heureux et al., 2017).”
MethodMachine learning algorithms in Bigdata Analysis and its applications: A review
Khoshaba, F. S., Kareem, S. W., Awla, H. Q., & Mohammed, C. M. (2022) · International Congress on Human-Computer Interaction, Optimization and Robotic Applications (ICHORA) · doi:10.1109/hora55278.2022.9799848 · Cited by 15
Enhancing Image Annotation With Object Tracking and Image Retrieval: A Systematic Review
Fernandes, R., Pessoa, A. C. P., Salgado, M., de Paiva, A. C., Paçal, İ., & Cunha, A. M. T. D. S. (2024) · IEEE Access · doi:10.1109/access.2024.3406018 · Cited by 14
“Artificial intelligence, particularly machine learning and deep learning has revolutionized how we process and interpret large volumes of visual data [1].”
BackgroundFlexible Learning-Free Segmentation and Reconstruction of Neural Volumes
Shahbazi, A., Kinnison, J., Vescovi, R., Du, M., Hill, R., Joesch, M., Takeno, M. M., Zeng, H., da Costa, N. M., Grutzendler, J., et al. (2018) · Scientific Reports · doi:10.1038/s41598-018-32628-3 · Cited by 16
Shao, B., & Leeson, M. S. (2019) · Internet of Things · doi:10.1016/j.iot.2019.100077 · Cited by 14
“Moreover, machine learning coupled with the big data revolution is changing ways of living, working, studying and thinking [16].”
BackgroundOverview of Machine Learning Methods in ADHD Prediction
Sethu, N., & Vyas, R. (2020) · Springer eBooks · doi:10.1007/978-981-15-2063-1_3 · Cited by 17
Demigha, S. (2020) · International Conference on Computational Science and Computational Intelligence (CSCI) · doi:10.1109/csci51800.2020.00259 · Cited by 14
“On the other hand, Machine Learning refers to one of the branches of AI has the capacity to give machines access to data and let them learn for themselves [14], [15].”
Background
Metadata
- Authors
- L'Heureux, A., Grolinger, K., Elyamany, H. F., & Capretz, M. A. M.
- Affiliations
- Western University (CA)
- Suez Canal University (EG)
- Venue
- IEEE Access
- Published
- 2017
- Volume
- 5
- Pages
- 7776-7797
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2609731728
- Cited by
- 1,023
- References
- 109
- Citations by year
- 2026: 50 · 2025: 175 · 2024: 128 · 2023: 145 · 2022: 130 · 2021: 138 · 2020: 105 · 2019: 88 · 2018: 53 · 2017: 11
- FWCI
- 112.99
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- NSERC CRD at Western University (477530-14)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Big Data Technologies and Applications
- Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Keywords
- big data challenges, volume, velocity, varieties, honesty, scalable learning, data-driven decision making, research gaps
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.