Machine learning with big data: challenges and approaches.
Open accessThe DOI matches its Crossref record; 108 of the 109 references it cites were found in a registry or an index.
Abstract
The Big Data revolution promises to transform how we live, work, and think by enabling process optimization, empowering insight discovery and improving decision making. The realization of this grand potential relies on the ability to extract value from such massive data through data analytics; machine learning is at its core because of its ability to learn from data and provide data driven insights, decisions, and predictions. However, traditional machine learning approaches were developed in a different era, and thus are based upon multiple assumptions, such as the data set fitting entirely into memory, what unfortunately no longer holds true in this new context. These broken assumptions, together with the Big Data characteristics, are creating obstacles for the traditional techniques. Consequently, this paper compiles, summarizes, and organizes machine learning challenges with Big Data. In contrast to other research that discusses challenges, this work highlights the cause–effect relationship by organizing challenges according to Big Data Vs or dimensions that instigated the issue: volume, velocity, variety, or veracity. Moreover, emerging machine learning approaches and techniques are discussed in terms of how they are capable of handling the various challenges with the ultimate objective of helping practitioners select appropriate solutions for their use cases. Finally, a matrix relating the challenges and approaches is presented. Through this process, this paper provides a perspective on the domain, identifies research gaps and opportunities, and provides a strong foundation and encouragement for further research in the field of machine learning with Big Data.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, training these models requires large, diverse, and well-labeled datasets [94].”
From A Review of Passenger Counting in Public Transport Concepts with Solution Proposal Based on Image Processing and Machine Learning (2024) · cites this paper as [94]
In the citing paper
“it is also shifting from a single domain (e.g., domain expertise, or expert systems) to a cross-disciplinary approach through collaboration”
From Challenges and Future Directions of Big Data and Artificial Intelligence in Education (2020) · cites this paper as L’heureux et al., 2017
Citations
Cites
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927 · cited 1×
“• Regularization paths [92] for linear models supports linear regression, two-class logistic regression, and multinomial regression problems.”
MethodThe WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750 · cited 1×
“However, at the moment, they support a limited number of algorithms compared to the R language [73], MATLAB [74], or Weka [75].”
MethodRepresentation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001 · cited 1×
“Representation learning is also often referred to as feature learning [100].”
BackgroundEnsemble methods in machine learning
Dietterich, T. G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45014-9_1 · Cited by 8,408
(2011) · Cited by 5,203
Multiple comparisons among means
Dunn, O. J. (1961) · Journal of the American Statistical Association · doi:10.1080/01621459.1961.10482090 · Cited by 5,006 · cited 1×
“It suggests that if testing m hypotheses with a desired significance of α, each individual hypothesis should be tested at a significance level of α/m [43].”
BackgroundResilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing
Zaharia, M., Chowdhury, M., Das, T., Dave, A., Ma, J. H., McCauley, M., Franklin, M. J. M., Shenker, S. J., & Stoica, I. G. (2012) · UC Berkeley · Cited by 4,891
The Hadoop Distributed File System
Shvachko, K., Kuang, H., Radia, S., & Chansler, R. (2010) · 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST) · doi:10.1109/msst.2010.5496972 · Cited by 4,834 · cited 8×
“In these stages, independent of the category of manipulations, processes can be embedded to capture data provenance and therefore remedy provenance challenge; an example is the Reduce and Map Provenance (RAMP) developed for MapReduce as an extension for Hadoop [64].”
MethodInfluentialHan, S., Mao, H., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1510.00149 · Cited by 4,662 · cited 1×
“Deep compression has been proposed as a way of speeding up processing without the loss of accuracy [105].”
Background
Research works printed but not linked: 20
- goodfellow, 2016, Deep Learning
- marz, 2014, Apache Storm
- rouse, 2011, Machine Learning Definition
- 2015, R A Language and Environment for Statistical Computing, 1
- 2014, IBM Watson Ecosystem Program
- wu, 2016, Google’s neural machine translation system Bridging the gap between human and machine translation
- 2016, Machine Learning American
- 2016, Google Cloud Machine Learning
- 2016, Matlab
- 2013, Billion Devices Will Wirelessly Connect to the Internet of Everything in 2020
- krikorian, 2010, Twitter by the Numbers Twitter
- 2016, H20
- 2016, Apache Mahout
- abadi, 2016, TensorFlow Large-Scale Machine Learning on Heterogeneous Systems
- langford, 2007, Vowpal wabbit online learning project
- rouse, 2009, Predictive Analytics Definition
- sukumar, 2014, Machine learning in the big data era: Are we there yet?, Proc 20th ACM SIGKDD Conf Knowl Discovery Data Mining Workshop Data Sci Social Good (KDD), 1
- 2016, GPU Applications Transforming Computational Research and Engineering
- torrey, 2010, Handbook of Research on Machine Learning Applications and Trends
- 2016, Apache Giraph
Cited by
Items 501–600 of 1,002
Khudhur, D. Y., Shibghatullah, A. S., Shaker, K., Latif, A. A., & Muda, Z. C. (2025) · Algorithms · doi:10.3390/a18120772 · Cited by 10
Wu, Y., Sicard, B. S., & Gadsden, S. A. (2024) · MacSphere (McMaster University) · doi:10.71548/3591 · Cited by 8
Big data decision tree for continuous-valued attributes based on unbalanced cut points
Ma, S., & Zhai, J. (2023) · Journal Of Big Data · doi:10.1186/s40537-023-00816-2 · Cited by 8
Wang, Z., Yang, Y., Suo, S., Guo, J., & Rao, W.-F. (2024) · Materials Today Communications · doi:10.1016/j.mtcomm.2024.108216 · Cited by 10
Khiavi, A. N. (2024) · Journal of Hydrology · doi:10.1016/j.jhydrol.2024.131220 · Cited by 10
Thomas, R., Sujithra, M., & Senthilkumar, B. (2024) · Advances in business information systems and analytics book series · doi:10.4018/979-8-3693-8844-0.ch003 · Cited by 9
Chen, Y., Meng, T., Wu, M., Hu, W., Yang, D., & Wu, W. (2025) · Sensors and Actuators A Physical · doi:10.1016/j.sna.2025.116434 · Cited by 8
Assessing the Number of Criteria in GIS ‐Based Multicriteria Evaluation: A Machine Learning Approach
Zhao, L. Q., Dragićević, S., Balram, S., & Pérez, L. (2025) · Geographical Analysis · doi:10.1111/gean.70004 · Cited by 8
Rodríguez-Ibáñez, M., Muñoz-Romero, S., Soguero-Ruíz, C., Gimeno-Blanes, F.-J., & Rojo‐Álvarez, J. L. (2019) · IEEE Access · doi:10.1109/access.2019.2923533 · Cited by 8
“In a more general context, we can say today that Big-Data technologies have emerged and developed rapidly in recent years [3], and they are showing the potential to extract relevant information from large amounts of data in a number of (cid:28)elds [4].”
BackgroundLow Power Wide Area Networks Operating in the ISM Band- Overview and Unresolved Challenges
Stoynov, V., Poulkov, V. K., & Valkova-Jarvis, Z. (2019) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-030-23976-3_10 · Cited by 8
Artificial Intelligence, Big Data, and Value Co-creation: A Conceptual Model
Abbad, M., Jaber, F., AlQeisi, K., & Eletter, S. F. K. (2021) · Studies in computational intelligence · doi:10.1007/978-3-030-62796-6_28 · Cited by 9
Aldraimli, M., Soria, D., Grishchuck, D., Ingram, S., Lyon, R., Mistry, A., Oliveira, J., Samuel, R. J., Shelley, L. E. A., Osman, S. O. S., et al. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104624 · Cited by 10
Magzymov, D., Ratnakar, R. R., Dindoruk, B., & Johns, R. T. (2021) · SPE Annual Technical Conference and Exhibition · doi:10.2118/206359-ms · Cited by 11
Petersen, P., & Sax, E. (2022) · SN Computer Science · doi:10.1007/s42979-022-01233-7 · Cited by 8
Synthetic Data and Its Evaluation Metrics for Machine Learning
Kiran, A., & Kumar, S. S. (2023) · Smart innovation, systems and technologies · doi:10.1007/978-981-19-7447-2_43 · Cited by 10
Optimized stacking ensemble models for the prediction of diabetic progression
Daliya, V. K., & Ramesh, T. K. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-14858-4 · Cited by 11
A Case Study on AI Engineering Practices: Developing an Autonomous Stock Trading System
Grote, M., & Bogner, J. (2023) · IEEE/ACM International Conference on AI Engineering – Software Engineering for AI (CAIN) · doi:10.1109/cain58948.2023.00032 · Cited by 8
“[29] summarized big data challenges for machine learning model development.”
BackgroundImproving the Process of Disruption Claims: Identification of the Difficulties and Expectations
Ali, B., Aibinu, A. A., & Paton-Cole, V. (2023) · Journal of Management in Engineering · doi:10.1061/jmenea.meeng-5536 · Cited by 8
Wongso, B. I., Agustin, K., & Sutapa, I. N. (2024) · AIP conference proceedings · doi:10.1063/5.0181587 · Cited by 8
Pathway toward prior knowledge-integrated machine learning in engineering
Chen, X., & Geyer, P. (2023) · Building Simulation Conference proceedings · doi:10.26868/25222708.2023.1481 · Cited by 9
Saqib, P., Qamar, U., Aslam, A., & Ahmad, A. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-22868-2_15 · Cited by 8
Chen, P., Li, P., Li, Q., & Zhang, D. (2019) · IEEE Access · doi:10.1109/access.2019.2934476 · Cited by 8
“learning-based approaches need a large number of data for training, the labeled data about a specific subclass are always not sufficient in most practical applications [1].”
BackgroundThe Role of Big Data and Machine Learning in COVID-19
Ababneh, M. A.-K., Aljarrah, A., & Karagözlü, D. (2020) · BRAIN BROAD RESEARCH IN ARTIFICIAL INTELLIGENCE AND NEUROSCIENCE · doi:10.18662/brain/11.2sup1/89 · Cited by 8
Deep-Learning-Based Fault Occurrence Prediction of Public Trains in South Korea
Caliwag, A. C., Han, S., Park, K.-J., & Lim, W. (2022) · Transportation Research Record Journal of the Transportation Research Board · doi:10.1177/03611981211064893 · Cited by 8
“In L’Heureuz et al., challenges encountered by several traditional techniques are complied, summarized, and organized ( 12 ).”
BackgroundGarcia, M., Juan, A., Doss‐Gollin, J., & Bedient, P. B. (2023) · Engineering Applications of Computational Fluid Mechanics · doi:10.1080/19942060.2023.2225584 · Cited by 8
“However, surrogate methods require the problem being learned to be static (L’Heureux et al., 2017).”
MethodDetecting Coal Pulverizing System Anomaly Using a Gated Recurrent Unit and Clustering
Chen, Z., Yan, Z., Jiang, H., Que, Z., Gao, G., & Xu, Z. (2020) · Sensors · doi:10.3390/s20113271 · Cited by 8
“In this case, the data-driven approach, which makes use of historical CM data to enable knowledge discovery and precise decision making, receives much more attention [6].”
MethodPoswell, B., & Barnard, A. S. (2025) · ACS Nano · doi:10.1021/acsnano.5c00239 · Cited by 7
Li, H., Liu, Y., & Liu, L. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.112150 · Cited by 7
Interpretable Deep Neural Network Deployment for Concrete Compressive Strength Prediction
Hamed, A. K., Alsaadawi, M. M., & Elshaarawy, M. K. (2026) · Journal of Building Pathology and Rehabilitation · doi:10.1007/s41024-025-00752-z · Cited by 7
Li, G., Gao, Y., Ren, J., & Chen, S. (2026) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2026.3671203 · Cited by 7
“However, the main drawback of these methods lies in the generally shallow structure of machine learning models, which makes it difficult to capture the complex correlation features in encrypted traffic and results in insufficient adaptability to high-dimensional traffic data with variable patterns [23].”
Sassi, I., Anter, S., & Bekkhoucha, A. (2021) · IAES International Journal of Artificial Intelligence · doi:10.11591/ijai.v10.i3.pp789-800 · Cited by 7
“Although the posterior decoding algorithm has shown its processing speed, efficiency and accuracy, it generally has some drawbacks when handling big data specifically the suboptimal complexity and high execution time [12].”
Rawat, V., Singh, D. P., Singh, N., & Kumar, S. (2023) · International Conference on Inventive Research in Computing Applications (ICIRCA) · doi:10.1109/icirca57980.2023.10220768 · Cited by 8
Predicting Weather Conditions for Improving Crop Productivity Using Machine Learning Approaches
Anand, V., Rajput, V. D., Minkina, T., Манджиева, С. С., Sharma, A., Kumar, S., & Konstantinova, E. (2024) · Advances in environmental engineering and green technologies book series · doi:10.4018/979-8-3693-1471-5.ch008 · Cited by 7
Langlois, G. P., Buch, J., & Darbon, J. (2024) · Entropy · doi:10.3390/e26080691 · Cited by 8
“Due to this enormous number, large-scale MaxEnt models need efficient and robust algorithms to perform well.”
lncRNA localization and feature interpretability analysis
Li, J., Ju, Y., Zou, Q., & Ni, F. (2024) · Molecular Therapy — Nucleic Acids · doi:10.1016/j.omtn.2024.102425 · Cited by 7
Zou, Y., Shi, H., Cao, W., Wang, S., Nie, S., & Zhang, Q. (2025) · Energy · doi:10.1016/j.energy.2025.137020 · Cited by 15
Handling imperfection: A taxonomy for machine learning on data with data quality defects
Hagn, M., Heinrich, B., Krapf, T., & Schiller, A. (2025) · Decision Support Systems · doi:10.1016/j.dss.2025.114493 · Cited by 9
GALAX: A Framework for Geospatial Analysis Leveraging AutoML and eXplainable AI
Wang, P., Yuan, Y., Li, L., & Lu, Y. (2025) · Annals of the American Association of Geographers · doi:10.1080/24694452.2025.2591684 · Cited by 7
“Machine learning approaches have revolutionized spatial analysis by offering powerful ways to capture complex patterns and relationships in geographical data with fewer assumptions about the underlying data structure (L’heureux et al. 2017; Kyriazos and Poga 2024).”
Measuring the Accuracy Levels Regarding the Dual Business Function Criticality Classifier
Ποδάρας, Α. (2018) · IEEE Access · doi:10.1109/access.2018.2860976 · Cited by 7
“The classifier, which is based on the supervised learning [18] approach to the induction of decision trees, is 89.”
DETECTION OF OSTEOPOROSIS IN DEFECTED BONES USING RADTORCH AND DEEP LEARNING TECHNIQUES
Shahzad, M., Khan, T. F., Bashir, M., Sabir, M. A., Ashraf, F., Hashmi, S., Zahoor, F., & Jaskani, F. H. (2021) · International Journal of Engineering Applied Sciences and Technology · doi:10.33564/ijeast.2021.v06i04.015 · Cited by 7
“[22]–[25] Magnetic resonance images was presented in 1987 and is the most broadly utilized technique for diagnosing osteoporosis in clinical practice.”
MethodA Scalable Framework for Customer Sentiment Analysis in the Telecommunication Industry
Skoularikis, K., Savvas, I. Κ., Garani, G., & Kakarontzas, G. (2021) · Telecommunications Forum (TELFOR) · doi:10.1109/telfor52709.2021.9653423 · Cited by 7
Johannesen, N. J., Kolhe, M. L., & Goodwin, M. (2022) · International Conference on Smart and Sustainable Technologies (SpliTech) · doi:10.23919/splitech55088.2022.9854355 · Cited by 7
“Thus the observation can be a result of an improved energy system, and not anomaly [19].”
BackgroundSentimental Analysis of Job Classification using Machine Learning Algorithms
Nagaraj, P., Muneeswaran, V., Ram, K. K., Vamsi, P., Reddy, V. V. V., & Sridhar, D. (2023) · International Conference on Communication and Electronics Systems (ICCES) · doi:10.1109/icces57224.2023.10192717 · Cited by 7
“[16] It is challenging to determine the likelihood or probability of observing a specific real value, such as X1.”
BackgroundKopp, T., Weitemeyer, R., Beyer, J., Ziegler, D., & Hess, R. (2023) · HMD Praxis der Wirtschaftsinformatik · doi:10.1365/s40702-023-00996-8 · Cited by 7
Eke, D., Eke, D., & Stahl, B. C. (2023) · Frontiers in Big Data · doi:10.3389/fdata.2023.1240660 · Cited by 10
Wang, L., Mao, X., Wei, X., Yu, H., Tang, W., Zhang, L., Yi, W., Zhang, J., & Gou, L. (2023) · Ecological Indicators · doi:10.1016/j.ecolind.2023.111516 · Cited by 8
Adopting Big Data Analytics Strategy in Telecommunication Industry
YAYAH, F. C., Ghauth, K. I., & Ting, C. (2017) · Journal of Computer Science & Computational Mathematics · doi:10.20967/jcscm.2017.03.002 · Cited by 7
“Machine learning is important by supporting data scientist to solve the computation problem [1-7] efficiently.”
BackgroundStrengthening Digital Twin Applications based on Machine Learning for Complex Equipment
Ren, Z., & Wan, J. (2021) · Design, Automation, and Test in Europe · doi:10.23919/date51398.2021.9474133 · Cited by 8
Topic Based Partitioning for Selective Search Using Sharding Technique
Dhulavvagol, P. M., Totad, S. G., & Bhandage, N. (2022) · International Conference for Advancement in Technology (ICONAT) · doi:10.1109/iconat53423.2022.9726020 · Cited by 7
García-Vico, Á. M., Carmona, C. J., González, P., & del Jesús, M. J. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.10.028 · Cited by 8
An Interactive Task Analysis Framework and Interactive System Research for Computer Aided Diagnosis
Chen, R., Hua, Q., Ji, X., Liu, Y., Wang, H., -, L. J., Liu, J., & Feng, J. H. (2017) · IEEE Access · doi:10.1109/access.2017.2761235 · Cited by 7
A Model for Rapid Selection and COVID-19 Prediction with Dynamic and Imbalanced Data
Kim, J., & Kwon, O. (2021) · Sustainability · doi:10.3390/su13063099 · Cited by 7
“Various studies have been conducted using various methods to resolve class imbalances [35].”
A Thematic Review on Data Quality Challenges and Dimension in the Era of Big Data
Ridzuan, F., Zainon, W. M. N. W., & Noor, M. Z. M. (2021) · Lecture notes in electrical engineering · doi:10.1007/978-981-16-2406-3_56 · Cited by 7
Deep learning-driven screening of emerging contaminants: Innovations and technological advances
Yao, Y., Yuan, K., Jiang, Y., Li, X., Yang, Q., Zhao, B., Deng, J., Hao, C., & Luan, T. (2025) · TrAC Trends in Analytical Chemistry · doi:10.1016/j.trac.2025.118536 · Cited by 6
Prajapati, U., Chawla, N., Chaudhary, T., Kaushlendra, K., & Kaur, D. (2025) · Sensors and Actuators A Physical · doi:10.1016/j.sna.2025.117359 · Cited by 6
Lai, C. H.-L., Kwok, A. P. K., & Wong, K.-C. (2024) · Journal of Personalized Medicine · doi:10.3390/jpm14090981 · Cited by 7
Huang, Z., Qian, X., Li, P., Shen, X., Hou, L., Li, Y., & Yuan, M. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.103309 · Cited by 6
Landslide Susceptibility Assessment in Ya’an Based on Coupling of GWR and TabNet
Li, J., Wang, R., Shi, W., Yang, L., Wei, J., Liu, F., & Xiong, K. (2025) · Remote Sensing · doi:10.3390/rs17152678 · Cited by 8
Coded Decentralized Learning With Gradient Descent for Big Data Analytics
Yue, J., & Xiao, M. (2019) · IEEE Communications Letters · doi:10.1109/lcomm.2019.2930513 · Cited by 6
“these MDS-based codes become impractical [1], [7] because”
BackgroundMethodInfluentialGeoAI-Enhanced Techniques to Support Geographical Knowledge Discovery from Big Geospatial Data
Zhou, X. (2019) · Cited by 7
Attributes Reduction in Big Data
Albattah, W., Khan, R. U., & Khan, K. (2020) · Applied Sciences · doi:10.3390/app10144901 · Cited by 6
“However, to improve efficiency, a trade-off is critical between efficiency and application size [4].”
BackgroundPersonalized Medicine for the Critically Ill Patient: A Narrative Review
Lazăr, A. E., & Azamfirei, L. (2022) · Processes · doi:10.3390/pr10061200 · Cited by 8
Relational Deep Learning Detection with Multi-Sequence Representation for Insider Threats
Alshehri, A. (2022) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2022.0130587 · Cited by 9
“It is worth mentioning that increasing data volume results in improving the learning accuracy as per Bonferonni’s principle [17].”
BackgroundA review about COVID-19 in the MENA region: environmental concerns and machine learning applications
Meskher, H., Belhouari, S. B., Thakur, A. K., Sathyamurthy, R., Singh, P., Khelfaoui, I., & Saidur, R. (2022) · Environmental Science and Pollution Research · doi:10.1007/s11356-022-23392-z · Cited by 6
Kamm, S., Sahlab, N., Jazdi, N., & Weyrich, M. (2023) · Procedia CIRP · doi:10.1016/j.procir.2023.06.061 · Cited by 6
“Data coming from different sources can have different meanings and interpretations of the same values and labels, which require a uniform formal and semantic data description to resolve this heterogeneity [27].”
BackgroundResearch on the construction of personalized learning system supported by big data in education
Zhao, X., & Lao, L. (2023) · Applied Mathematics and Nonlinear Sciences · doi:10.2478/amns.2023.2.00438 · Cited by 6
Rananga, N., & Venter, H. S. (2026) · International Journal of Information Security · doi:10.1007/s10207-026-01266-6 · Cited by 6
“L’Heureux et al. [49] emphasize the difficulties of consistently establishing the best tools and techniques to combat particular challenges.”
Performance Analysis of Online Machine Learning Frameworks for Anomaly Detection in IoT Data Streams
Ray, S. K., & Susan, S. (2024) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt61001.2024.10724326 · Cited by 6
“One of these assumptions [6] is that the entire dataset could fit into the memory, which is no longer true in the current context.”
BackgroundImproved Bald Eagle Search Optimization Algorithm for Feature Selection in Classification
Feng, J., Zhang, X., & Zhang, L. (2024) · International Journal of Computational Intelligence Systems · doi:10.1007/s44196-024-00691-6 · Cited by 6
“As the big data era unfolds, the advent of extensive datasets has reshaped the landscape of ML [5].”
Dong, C., Wu, F., Qu, Y., Akerkar, R. A., Wu, T., Zhou, F., Wu, Q., & Guo, S. (2024) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2024.3520557 · Cited by 6
“With the advancement of artificial intelligence (AI) technology, machine learning (ML) [4] enables AAVs to perform more intelligent tasks such as target tracking.”
Camerota, C., Pappone, L., Pecorella, T., & Esposito, F. (2024) · International Conference on Network and Service Management (CNSM) · doi:10.23919/cnsm62983.2024.10814607 · Cited by 9
“To address a robust model and limit spurious correlation, the literature investigates methods to determine the minimum sample size [5], [6].”
The authors are with Universitas Indonesia, I., Maharani, D., Murfi, H., & Satria, Y. (2019) · International Journal of Machine Learning and Computing · doi:10.18178/ijmlc.2019.9.6.866 · Cited by 6
Big data Predictive Analytics for Apache Spark using Machine Learning
Junaid, M., Wagan, S. A., Qureshi, N. M. F., Nam, C. S., & Shin, D. R. (2020) · Global Conference on Wireless and Optical Technologies (GCWOT) · doi:10.1109/gcwot49901.2020.9391620 · Cited by 6
“Big data model with Hadoop as the backbone supports Spark to provide reliable and fast computation for data analytics [4],[5],[6].”
MethodChen, Y., & Pan, L. (2021) · Journal of Healthcare Engineering · doi:10.1155/2021/2541751 · Cited by 8
“[36] described the challenges associated with machine learning approaches in the big data platforms and reported that the machine learning methods are best suitable for the prediction of challenges in big data analytics.”
BackgroundRetractedInnovative Technologies: Applications in the Present and Considerations for the Future
Issa, T., & Isaias, P. T. (2022) · Springer eBooks · doi:10.1007/978-1-4471-7513-1_8 · Cited by 6
Renjith, S., Sreekumar, A., & Jathavedan, M. (2022) · Acta Scientiarum. Technology/Acta scientiarum. Technology · doi:10.4025/actascitechnol.v44i1.58653 · Cited by 8
Optimize output of a piezoelectric cantilever by machine learning ensemble algorithms
Du, J.-X., Chen, H., Yang, Y., & Rao, W.-F. (2022) · Materials Today Communications · doi:10.1016/j.mtcomm.2022.103688 · Cited by 7
ELDA: Learning Explicit Dual-Interactions for Healthcare Analytics
Cai, Q., Zheng, K., Ooi, B. C., Wang, W., & Yao, C. (2022) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde53745.2022.00034 · Cited by 11
“To analyze such valuable data, there is an increasing demand for using advanced deep learning libraries [1], [2], [3] to design powerful models as part of database management systems (DBMS) [4], [5], [6], which can facilitate complex analytics [7], [8].”
BackgroundWhite Box: On the Prediction of Collaborative Filtering Recommendation Systems’ Performance
Paun, I., Moshfeghi, Y., & Ntarmos, N. (2022) · ACM Transactions on Internet Technology · doi:10.1145/3554979 · Cited by 8
“Predicting and modelling resource utilisation has always been a popular topic due to the ever-growing data and the challenges associated with it (e.g., availability, security, consistency, etc.) [58].”
BackgroundMulti-level Attention Fusion for Multimodal Driving Maneuver Recognition
Liu, J., Liu, Y., Tian, C., Zhao, M., Zeng, X., & Song, L. (2022) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas48785.2022.9937710 · Cited by 6
“However, these traditional machine learning methods rely on hand-crafted features, which are limited by human domain knowledge [15].”
BackgroundBackorder Prediction in Inventory Management: Classification Techniques and Cost Considerations
Maitra, S., & Kundu, S. (2022) · ECTI Transactions on Computer and Information Technology (ECTI-CIT) · doi:10.37936/ecti-cit.2023174.253571 · Cited by 6
Event Analysis on Power Communication Networks With Big Data for Maintenance Forms
Feijoo-Martínez, J. R., Muñoz-Romero, S., Soguero-Ruíz, C., Castro-Fernández, M., & Rojo‐Álvarez, J. L. (2018) · IEEE Access · doi:10.1109/access.2018.2881797 · Cited by 6
“oped in recent years, and they constitute nowadays a promising technology to extract relevant information from large amounts of data in a number of applications [5].”
BackgroundShe, R., Liu, S., & Fan, P. (2019) · Entropy · doi:10.3390/e21050439 · Cited by 6
Proposed Solutions for Smart Traffic Lights using Machine Learninig and Internet of Thing
Hassak, I. E., & Addaim, A. (2019) · International Conference on Wireless Networks and Mobile Communications (WINCOM) · doi:10.1109/wincom47513.2019.8942430 · Cited by 6
“1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 60 61 62 63 64 65 978-1-7281-2625-8/19/$31.00 ©2019 IEEE Keywords—Big Data, Machine Learning, IoT, CCTV, Traffic Lights I. INTRODUCTION In recent years, the…”
MethodInfluentialCross-Modal Hashing Retrieval Based on Density Clustering
Qi, X., Zeng, X., & Tang, H. (2020) · IEEE Access · doi:10.1109/access.2020.2978876 · Cited by 7
Recognizing Indonesian Acronym and Expansion Pairs with Supervised Learning and MapReduce
Abidin, T. F., Mahazir, A., Subianto, M., Munadi, K., & Ferdhiana, R. (2020) · Information · doi:10.3390/info11040210 · Cited by 6
“Hadoop is a parallel and distributed processing platform that uses the MapReduce computing paradigm [31,32] to uniformly distribute the computing tasks across data nodes to rapidly process large amounts of data on the Hadoop distributed file system (HDFS) [33].”
MethodMeasuring the Performance of Inventory Management System using Arena Simulator
Alsolami, F. J. (2020) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2020.0110624 · Cited by 6
“Internet of Things (IoT) [12], cloud computing [18], and big data [19] are some current development in computing field that allows the organization to enhance their information technology infrastructure.”
BackgroundA Review on Recent Machine Learning Algorithms Used in CAD diagnosis
Miriyala, G. P., Sinha, A. K., Jayakody, D. N. K., & Sharma, A. (2021) · International Conference on Information and Automation for Sustainability (ICIAfS) · doi:10.1109/iciafs52090.2021.9605854 · Cited by 6
Unexpected Effects of Online no-Substitution k-means ClusteringPreprint
Moshkovitz, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.06818 · Cited by 6
Data Quality Antipatterns for Software AnalyticsPreprint
Bhatia, A., Lin, D., Rajbahadur, G. K., Adams, B., & Hassan, A. E. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.12560 · Cited by 6
Labiadh, M. (2021) · theses.fr (ABES) · doi:10.70675/8405bf5az8849z4284za9d2zc9f8d4413bb8 · Cited by 6
BFGTP: A BERT-Guided Two-Stage Molecular Representation Learning Framework for Toxicity Prediction
Hu, K., He, Y., Wei, J., Sun, C., Geng, J., Wei, L., & Su, R. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3556766 · Cited by 5
“However, with the increase in toxicity data volume and the availability of multiplepublicdatabases,machinelearning-basedmethodsmay struggle to comprehensively handle large-scale data and might fail to capture the complex nonlinear relationships present in the data [23], [24].”
Cai, W., Huang, L., & Zou, Z. (2025) · Journal of Computing in Civil Engineering · doi:10.1061/jccee5.cpeng-6376 · Cited by 6
Hybrid ensemble models for scour depth prediction around spur dikes
Singh, B., & Minocha, V. K. (2025) · Measurement · doi:10.1016/j.measurement.2025.118277 · Cited by 6
RODRIGUEZ‐SAONA, L. E., & Castellví, S. D. L. (2025) · Advances in food and nutrition research · doi:10.1016/bs.afnr.2025.04.001 · Cited by 5
Integrating Conventional Models and AI for Intelligent Sensor Data Processing: A Review
Yang, C., Chen, X., Shao, G., Du, X., & Zhu, Q. (2025) · IEEE Sensors Journal · doi:10.1109/jsen.2025.3602686 · Cited by 6
“In addition, this approach relies entirely on sensor data [26], failing to optimize data processing with known information and theories, resulting in unnecessary training and computational resource waste.”
Rchid, A. M., Attia, M., Mahmoud, M. E. M., Aoulmi, Z., & Mahmoud, A. K. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.112621 · Cited by 5
Husain, S. O., Narayana, V. A., Annapurna, T., Kumar, B. S., Shunmugapriya, V., & Srihari, T. (2025) · International Conference on Metaverse and Current Trends in Computing (ICMCTC) · doi:10.1109/icmctc62214.2025.11196711 · Cited by 5
“Additionally, ML based approaches require large amounts of labeled datasets and are thus not suitable for zero day failure scenarios [7].”
Shiravand, S., Sabouri‐Ghomi, S., Rabiee, N., & Soroushian, S. (2025) · Structures · doi:10.1016/j.istruc.2025.110594 · Cited by 5
Beiler, M., Bauer, N. M., Baumgartner, J., & Braun, M. (2025) · International Journal of Fatigue · doi:10.1016/j.ijfatigue.2025.109459 · Cited by 5
Metadata
- Authors
- L'Heureux, A., Grolinger, K., Elyamany, H. F., & Capretz, M. A. M.
- Affiliations
- Western University (CA)
- Suez Canal University (EG)
- Venue
- IEEE Access
- Published
- 2017
- Volume
- 5
- Pages
- 7776-7797
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2609731728
- Cited by
- 1,023
- References
- 109
- Citations by year
- 2026: 50 · 2025: 175 · 2024: 128 · 2023: 145 · 2022: 130 · 2021: 138 · 2020: 105 · 2019: 88 · 2018: 53 · 2017: 11
- FWCI
- 112.99
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- NSERC CRD at Western University (477530-14)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Big Data Technologies and Applications
- Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Keywords
- big data challenges, volume, velocity, varieties, honesty, scalable learning, data-driven decision making, research gaps
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.