Machine learning with big data: challenges and approaches.
Open accessThe DOI matches its Crossref record; 108 of the 109 references it cites were found in a registry or an index.
Abstract
The Big Data revolution promises to transform how we live, work, and think by enabling process optimization, empowering insight discovery and improving decision making. The realization of this grand potential relies on the ability to extract value from such massive data through data analytics; machine learning is at its core because of its ability to learn from data and provide data driven insights, decisions, and predictions. However, traditional machine learning approaches were developed in a different era, and thus are based upon multiple assumptions, such as the data set fitting entirely into memory, what unfortunately no longer holds true in this new context. These broken assumptions, together with the Big Data characteristics, are creating obstacles for the traditional techniques. Consequently, this paper compiles, summarizes, and organizes machine learning challenges with Big Data. In contrast to other research that discusses challenges, this work highlights the cause–effect relationship by organizing challenges according to Big Data Vs or dimensions that instigated the issue: volume, velocity, variety, or veracity. Moreover, emerging machine learning approaches and techniques are discussed in terms of how they are capable of handling the various challenges with the ultimate objective of helping practitioners select appropriate solutions for their use cases. Finally, a matrix relating the challenges and approaches is presented. Through this process, this paper provides a perspective on the domain, identifies research gaps and opportunities, and provides a strong foundation and encouragement for further research in the field of machine learning with Big Data.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, training these models requires large, diverse, and well-labeled datasets [94].”
From A Review of Passenger Counting in Public Transport Concepts with Solution Proposal Based on Image Processing and Machine Learning (2024) · cites this paper as [94]
In the citing paper
“it is also shifting from a single domain (e.g., domain expertise, or expert systems) to a cross-disciplinary approach through collaboration”
From Challenges and Future Directions of Big Data and Artificial Intelligence in Education (2020) · cites this paper as L’heureux et al., 2017
Citations
Cites
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927 · cited 1×
“• Regularization paths [92] for linear models supports linear regression, two-class logistic regression, and multinomial regression problems.”
MethodThe WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750 · cited 1×
“However, at the moment, they support a limited number of algorithms compared to the R language [73], MATLAB [74], or Weka [75].”
MethodRepresentation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001 · cited 1×
“Representation learning is also often referred to as feature learning [100].”
BackgroundEnsemble methods in machine learning
Dietterich, T. G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45014-9_1 · Cited by 8,408
(2011) · Cited by 5,203
Multiple comparisons among means
Dunn, O. J. (1961) · Journal of the American Statistical Association · doi:10.1080/01621459.1961.10482090 · Cited by 5,006 · cited 1×
“It suggests that if testing m hypotheses with a desired significance of α, each individual hypothesis should be tested at a significance level of α/m [43].”
BackgroundResilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing
Zaharia, M., Chowdhury, M., Das, T., Dave, A., Ma, J. H., McCauley, M., Franklin, M. J. M., Shenker, S. J., & Stoica, I. G. (2012) · UC Berkeley · Cited by 4,891
The Hadoop Distributed File System
Shvachko, K., Kuang, H., Radia, S., & Chansler, R. (2010) · 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST) · doi:10.1109/msst.2010.5496972 · Cited by 4,834 · cited 8×
“In these stages, independent of the category of manipulations, processes can be embedded to capture data provenance and therefore remedy provenance challenge; an example is the Reduce and Map Provenance (RAMP) developed for MapReduce as an extension for Hadoop [64].”
MethodInfluentialHan, S., Mao, H., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1510.00149 · Cited by 4,662 · cited 1×
“Deep compression has been proposed as a way of speeding up processing without the loss of accuracy [105].”
Background
Research works printed but not linked: 20
- goodfellow, 2016, Deep Learning
- marz, 2014, Apache Storm
- rouse, 2011, Machine Learning Definition
- 2015, R A Language and Environment for Statistical Computing, 1
- 2014, IBM Watson Ecosystem Program
- wu, 2016, Google’s neural machine translation system Bridging the gap between human and machine translation
- 2016, Machine Learning American
- 2016, Google Cloud Machine Learning
- 2016, Matlab
- 2013, Billion Devices Will Wirelessly Connect to the Internet of Everything in 2020
- krikorian, 2010, Twitter by the Numbers Twitter
- 2016, H20
- 2016, Apache Mahout
- abadi, 2016, TensorFlow Large-Scale Machine Learning on Heterogeneous Systems
- langford, 2007, Vowpal wabbit online learning project
- rouse, 2009, Predictive Analytics Definition
- sukumar, 2014, Machine learning in the big data era: Are we there yet?, Proc 20th ACM SIGKDD Conf Knowl Discovery Data Mining Workshop Data Sci Social Good (KDD), 1
- 2016, GPU Applications Transforming Computational Research and Engineering
- torrey, 2010, Handbook of Research on Machine Learning Applications and Trends
- 2016, Apache Giraph
Cited by
Items 801–900 of 1,002
Data-Driven Computational Intelligence for Scientific Programming
Rubio‐Largo, Á., Preciado, J. C., & Iribarne, L. (2019) · Scientific Programming · doi:10.1155/2019/5235706 · Cited by 3
“…concept of amount of data. challenge is no longer the evolution and development of the technology, the current issue is not related with the production and acquisition of data, and now we are treating with new challenges and problems regarding the processing of these data to build information [6].”
BackgroundConsensus-based Interpretable Deep Neural Networks with Application to Mortality PredictionPreprint
Salman, S., Payrovnaziri, S. N., Liu, X., Rengifo‐Moreno, P., & He, Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.05849 · Cited by 2
Privacidad y gestión de la identidad en procesos de analítica de aprendizaje
Amo, D. (2019) · Gredos (University of Salamanca) · doi:10.14201/gredos.137397 · Cited by 5
Yu, W., Chen, Y., Zhang, C., Chen, Y., Wei, H., Chen, Z., & Zhang, Y. (2023) · Research Square · doi:10.21203/rs.3.rs-3562680/v1 · Cited by 2
Futures studies and foresight for science, technology and innovation
da Silva, V. M. (2021) · doi:10.47749/t/unicamp.2021.1164751 · Cited by 2
Dimensionality Reduction by Machine Learning for Cost-Effective Data AnalysisPreprint
Asaduzzaman, A. S., Uddin, M. R., & Sibai, F. N. (2024) · doi:10.36227/techrxiv.171332281.12206851/v1 · Cited by 2
Discrete Choice Models: Model Selection and Challenges in ApplicationsPreprint
Jiang, J., & Anderson, C. K. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4810909 · Cited by 2
Zhao, N., Bui, T., Yu, J. Y., & Dzięciołowski, K. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.07033 · Cited by 2
“In practice, classifiers are trained on large-scale datasets [1], often requiring substantial computational time and e ff ort.”
Ein Framework zur Analyse komplexer Produktportfolios mittels Machine Learning
Mehlstäubl, J. (2023) · Qucosa (Saxon State and University Library Dresden) · Cited by 2
Coutinho, M. D. A. A. (2022) · RIUnB Institutional Repository (University of Brasília) · doi:10.26512/2022.02.d.43971 · Cited by 2
Arbulu, J. F. V., Raimundo, J. L. C., Rodríguez, P. B. V., Zapata, N. A. S., & Quispe, J. A. D. (2021) · International Journal of Financial Research · doi:10.5430/ijfr.v12n2p251 · Cited by 1
A mini review on modeling magnetostriction behavior of magnetorheological solid materials
Rohim, M. A. S., Nazmi, N., Bahiuddin, I., Mazlan, S. A., & Nordin, N. A. (2022) · IEEE Symposium on Computer Applications & Industrial Electronics (ISCAIE) · doi:10.1109/iscaie54458.2022.9794552 · Cited by 1
Database dependence comparison in detection of physical access voice spoofing attacks
Chica, M., Gomez-Alanis, A., Roselló, E., Gomez, A. M., Gonzalez, J. A. S., & Peinado, A. M. (2022) · IberSPEECH · doi:10.21437/iberspeech.2022-41 · Cited by 1
“Currently, the most common approach for the detection of spoofing attacks is based on the use of machine learning [10].”
BackgroundBittar, F. H. B., Barbero, A. P. L., Ferreira, V. H., dos Santos, A. B., de Souza, D. S., Pinho, A. D. C., & Silva, V. N. H. (2023) · Electric Power Systems Research · doi:10.1016/j.epsr.2023.109848 · Cited by 1
Federated Learning-based neural networks for autonomous driving
Ma, T. (2024) · Applied and Computational Engineering · doi:10.54254/2755-2721/49/20241157 · Cited by 2
Fall Detection and Efficiency Enhancement via Wearable Technology
Işık, A. E., Köseoglu, I., & Öner, R. (2023) · International Conference on Engineering and Emerging Technologies (ICEET) · doi:10.1109/iceet60227.2023.10525997 · Cited by 2
Mupupuni, D., Guntu, A., Hong, L., Hasan, K., & Keel, L. (2024) · IEEE International Conference on Electro Information Technology · doi:10.1109/eit60633.2024.10609878 · Cited by 1
“This is also reflected in the application of models developed from these datasets to be employed in new operational situations [11].”
MethodMoshawrab, M., Adda, M., Bouzouane, A., Ibrahim, H., & Raad, A. (2024) · Electronics · doi:10.3390/electronics13183716 · Cited by 1
Leveraging Machine Learning for Effective Data Management
Sellami, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-662-70140-9_1 · Cited by 1
Federated Learning: An Overview of Attacks and Defense Methods
Sameera, K. M., Arikkat, D. R., Vinod, P., A., R. R. K., Aneez, A., & Conti, M. (2025) · Springer eBooks · doi:10.1007/978-3-031-83157-7_14 · Cited by 2
Haidenthaler, A., Schreyer, M. L., Pfeiffer, P., & Fragner, W. (2025) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-025-15506-x · Cited by 2
“The algorithm is designed to be efficiently implemented in Apache Spark [17] and has an appropriate processing time for the use case [21].”
Gu, Y., Razavi, S., & Yang, H. (2025) · Transportation Research Record Journal of the Transportation Research Board · doi:10.1177/03611981251332259 · Cited by 1
“These traditional ML models offer a level of simplicity ( 26 ) and interpretability that is particularly advantageous in the preliminary stages of developing classification frameworks ( 27 , 28 ) for traffic queuing dynamics.”
Predicting mechanical properties of elastomer honeycombs using fast image-based measurements
Kim, H., Conway, C. H., Özerinç, S., Tawfick, S., & King, W. P. (2025) · Materials & Design · doi:10.1016/j.matdes.2025.114119 · Cited by 1
Towards a Privacy-by-Design Framework for ML-Enabled Systems
Sens, Y. (2025) · IEEE/ACM International Conference on AI Engineering – Software Engineering for AI (CAIN) · doi:10.1109/cain66642.2025.00037 · Cited by 2
“The recent advancements in ML, especially DL, rely on processing vast amounts of data for training and evaluating ML models [1].”
Mathivanan, N. M. N., Xi, D. F. Y., Lee, G. C. S., Vosse, C. D., Shamsudin, S. F., & Mansor, M. M. (2025) · IEEE Symposium on Computer Applications & Industrial Electronics (ISCAIE) · doi:10.1109/iscaie64985.2025.11080844 · Cited by 1
“While machine learning models have proven effective in various contexts, they often encounter difficulties when applied to sets with heterogeneous characteristics, such as those that differ by demographic factors or geographic location [12].”
López, M. Á., & Petrelli, M. (2025) · Artificial Intelligence in Geosciences · doi:10.1016/j.aiig.2025.100153 · Cited by 3
Hao, Y., Zhang, J., Sun, X., Qu, Z., Xu, Z., Zhu, Y., & Dai, Y. (2025) · Journal of Electroceramics · doi:10.1007/s10832-025-00424-x · Cited by 2
Exploring biological research hotspots through a novel bibliometric approach
Chen, S., Wang, J., Huang, X., Chen, K., Fu, L., & Ding, Y. (2025) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2025.108680 · Cited by 1
Pedroza, G., Paquet, M., & Dion, B. (2025) · INCOSE International Symposium · doi:10.1002/iis2.70011 · Cited by 1
Büyük veri ile muhasebe süreçlerinin dönüşümü: Yeni uygulamalar ve yöntemler
İçerli, M. Y., & Kabadayi, T. Ö. (2025) · Nevşehir Hacı Bektaş Veli Üniversitesi SBE Dergisi · doi:10.30783/nevsosbilen.1675515 · Cited by 2
Towards Local Learning Algorithm on Apache Spark for Large Datasets
Bui-Vo, Q.-B., & Do, T. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-3358-9_21 · Cited by 1
The Revolution of Artificial Intelligence in Digital Accounting—Opportunities and Challenges
Luchkov, K., Chipriyanova, G., & Chipriyanov, M. (2025) · Advances in Science, Technology & Innovation/Advances in science, technology & innovation · doi:10.1007/978-3-031-90131-7_18 · Cited by 2
Mneme: A Parallel Preprocessing Framework for Large Tabular Datasets
Sofotasios, A., Metaxakis, D., & Hadjidoukas, P. E. (2026) · International Journal of Parallel Programming · doi:10.1007/s10766-026-00817-7 · Cited by 1
“In this context, a key challenge is that a large amount of data suffers from low quality, consisting of noise, conflicting or redundant information, missing values, and inconsistencies, making it unsuitable for direct use in ML models [6].”
Li, X., & Wu, G. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131512 · Cited by 1
Cengil, A. B., Ekşioğlu, B., Ekşioğlu, S. D., Hayes, C. J., BOGULSKI, C. A., & Ali, M. M. (2025) · JMIR Medical Informatics · doi:10.2196/78030 · Cited by 1
Machine Learning Application in Aquatic Health Prediction
Pruseth, B., Raut, S. S., Panda, S. P., & Das, B. K. (2026) · Sustainability Sciences in Asia and Africa · doi:10.1007/978-981-95-2573-7_3 · Cited by 1
Li, W., Xiao, K. J., Gu, B., Zheng, H., Shao, D., Mo, R., Wu, Q., & Yang, Q. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2025.1731854 · Cited by 2
“However, ML methods still face challenges in handling data noise, ensuring cross-institutional generalizability, and their dependence on data quality (21–23).”
Zhu, Y., Li, Y., Guo, X., Zhao, J., Li, X., Liu, J., Chen, Y., & Huang, L. (2026) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2026.3656266 · Cited by 1
“First, machine learning and data mining algorithms usually assume that the feature space and distribution are consistent in both the training and testing datasets [23].”
Gu, Z., Chen, T., Chen, X., Shengjie, Z. H. O. U., Jiahui, X. U., Lin, X., Liu, S., Cui, Y.-J., Wang, S., & Hongying, L. I. (2026) · Environmental Research Communications · doi:10.1088/2515-7620/ae3a48 · Cited by 1
Loggenberg, K., Strever, A. E., & Münch, Z. (2026) · Geomatics · doi:10.3390/geomatics6010012 · Cited by 1
Bridging detection and forecasting: Refined WaveNet for robust smart building energy monitoring
Berrima, C., Tra, V., & Amayri, M. (2026) · Sustainable Energy Grids and Networks · doi:10.1016/j.segan.2026.102142 · Cited by 1
A Fatigue Model Incorporating Temperature Effect for Predicting High-Cycle Fatigue Life of Alloys
Zhang, X., Wei, Y.-H., Su, B., Li, X.-D., Zhang, S., Ye, W., & Yao, J. (2026) · International Journal of Applied Mechanics · doi:10.1142/s1758825126500298 · Cited by 1
Precursor-based multi-class Bayesian meta-learning on rare event prediction for process systems
Wen, H., & Khan, F. I. (2026) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2026.109687 · Cited by 1
Recent challenges, opportunities, and issues in various data analytics
Kannadhasan, S., & Nagarajan, R. (2023) · Elsevier eBooks · doi:10.1016/b978-0-323-98352-5.00012-4 · Cited by 1
Lü, K., He, X., Qin, Z., Li, X., & Du, Z. (2023) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3583780.3614873 · Cited by 1
“With the development of the Internet, artificial intelligence, and the digital economy, data in various industries exhibits characteristics such as large scale, complex structure, high dimensionality, and semantic diversity [26, 30, 38].”
BackgroundJin, H., Choi, J. Y., Cho, S., & Kim, K. (2025) · IEEE Access · doi:10.1109/access.2025.3623702 · Cited by 1
“Machine learning models have demonstrated their ability to effectively process large, complex, and heterogeneous datasets [8].”
Exploration of hepatitis B virus infection dynamics through physics-informed deep learning approach
Das, B. C., Sutradhar, R., & Dalal, D. C. (2026) · Mathematical Biosciences · doi:10.1016/j.mbs.2026.109780 · Cited by 1
“ML algorithms are capable of addressing some limitations of traditional methods, including handling large datasets [9], improving the accuracy of prediction [10], and establishing complex and non-linear relationships between model variables and parameters [11].”
Introduction to IoT , AI , and ML in Sustainable Communication
Alharrani, S., Ibraheem, A., & Goktas, P. (2025) · Wiley eBooks · doi:10.1002/9781394337262.ch01 · Cited by 1
Predicting Transformer Hotspot Temperature: A Comparative Study of FNN and LSTM-PCA
Hamdar, L., Loenders, R., Çalık, H., & Hertem, D. V. (2025) · IEEE PES Innovative Smart Grid Technologies Europe · doi:10.1109/isgteurope64741.2025.11305292 · Cited by 1
“The main issue with big data in machine learning is that many models are designed for small-scale datasets, making them inefficient for large and complex environments [13].”
Mitigating High Dimensionality and Few Training Data with a Quantum Kernel Learning Approach
Neto, M. Q. N., Bessa, J. A., & de Freitas, R. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-15984-7_13 · Cited by 1
Critical Review on Verification and Validation Frameworks for AI-based Diagnostics in Military CBM+
Hwang, Y.-Y., Ka, H., Kim, J., Son, J., Shim, H., Choi, J., & Kim, H. (2026) · KSII Transactions on Internet and Information Systems · doi:10.3837/tiis.2026.03.005 · Cited by 1
Using Artificial Intelligence for Automatic Scoring
Latif, E., & Zhaı, X. (2026) · Springer eBooks · doi:10.1007/978-3-032-06565-0_2 · Cited by 1
Al‐Kindi, K. M., & Al-Thani, G. S. S. (2026) · Applied Water Science · doi:10.1007/s13201-026-02870-6 · Cited by 1
“Machine learning methods can manage these complex multidimensional datasets more effectively than traditional methods (L’heureux et al. 2017; Wilson and Anwar 2024).”
Bic-DC: Scalable and Privacy-Preserving Multi-Party Collaborative Data Cleaning
Xi, Y., Guo, Y., Zhang, C., Zhang, P., Liu, H., & Jia, X. (2026) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2026.3707938 · Cited by 1
On the Traceability of Results from Deep Learning-Based Cloud Services
Werner Bailer, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-73603-7_50 · Cited by 1
(CF)2 architecture: contextual collaborative filtering
Bachmann, D., Grolinger, K., ElYamany, H. F., Higashino, W. A., Capretz, M. A. M., Fekri, M., & Gopalakrishnan, B. (2018) · Information Retrieval · doi:10.1007/s10791-018-9332-3 · Cited by 2
“This results in creating separate local models for each cluster (Al-Jarrah et al. 2015; L’Heureux et al. 2017).”
BackgroundSelf-citationAn Evaluation of Neural Networks Performance for Job Scheduling in a Public Cloud Environment
Goga, K., Xhafa, F., & Terzo, O. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-93659-8_69 · Cited by 1
Fast, General Parallel Computation for Machine Learning
Yancey, R. E., & Matloff, N. (2018) · International Conference on Parallel Processing Workshops (ICPPW) · doi:10.1145/3229710.3229716 · Cited by 1
A Model-Driven Approach to Evolve Recommender Systems
IFCE, Oliveira, Y., Silveira, L., IFCE, de Souza, C. T., & IFCE (2018) · Brazilian Symposium on Multimedia and the Web · doi:10.5753/webmedia.2018.4572 · Cited by 1
A Data Streams Processing Platform for Matching Information Demand and Data Supply
Grabis, J., Kampars, J., Pinka, K., & Pekša, J. (2019) · Lecture notes in business information processing · doi:10.1007/978-3-030-21297-1_10 · Cited by 1
Entornos de trabajo para procesamiento de datos masivos y aprendizaje automático
Guzmán-Ponce, A., Rosas, R. M. V., Marcial‐Romero, J. R., & Eleuterio, R. A. (2018) · Research in Computing Science · doi:10.13053/rcs-147-5-17 · Cited by 2
“Los campos de investigaci´on y desarrollo de aprendizaje autom´atico son diversos, no obstante en la literatura se consideran b´asicamente tres enfoques de proceso de aprendizaje [13]: aprendizaje supervisado, aprendizaje no supervisado y semi-supervisado.”
BackgroundGram-Schmidt Orthogonalization for Feature Ranking and Selection — A Case Study of Claim Prediction
Dewi, Y. R., Murfi, H., & Satri, Y. (2020) · International Journal of Machine Learning and Computing · doi:10.18178/ijmlc.2020.10.1.898 · Cited by 1
Edge-cloud IoT Data Analytics: Intelligence at the Edge with Deep Learning
Ghosh, A. M. (2020) · Scholarship@Western (Western University) · Cited by 1
Sanila, S., & Sathyalakshmi, S. (2020) · Advances in intelligent systems and computing · doi:10.1007/978-981-15-5788-0_22 · Cited by 1
Mishra, A., Kumar, A., Mishra, S., & Sanjay, H. A. (2020) · Advances in intelligent systems and computing · doi:10.1007/978-981-15-5788-0_65 · Cited by 1
Analysis of Macroeconomic Determinants of Peruvian Gold Export Value in the Period 2003-2019
Jaco, C. A. T., Alhuay, M. K. M., Rodríguez, P. B. V., Zapata, N. A. S., & Quispe, J. A. D. (2021) · International Journal of Financial Research · doi:10.5430/ijfr.v12n2p43 · Cited by 1
Wanganga, G., & Qu, Y. (2020) · International Conference on Computational Science and Computational Intelligence (CSCI) · doi:10.1109/csci51800.2020.00277 · Cited by 2
“We can broadly group machine learning into supervised, unsupervised, and reinforcement machine learning [9].”
MethodAngelopoulos, M., & Pollalis, Y. (2021) · Archives of Business Research · doi:10.14738/abr.96.10291 · Cited by 2
Seddik, S., Routaib, H., & Haddadi, A. E. (2021) · Lecture notes in networks and systems · doi:10.1007/978-3-030-90321-3_60 · Cited by 1
Design Principles for Machine Learning Marketplaces in Enterprise Systems
Hütsch, M., & Wulfert, T. (2022) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2022.872 · Cited by 1
“When big data or data stream must be handled a corresponding architecture must be developed, as indicated by [69].”
Opportunities and challenges in healthcare with the management of big biomedical data
Battineni, G. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-91907-4.00017-0 · Cited by 1
Big Data Analytics: Deep Content-Based Prediction with Sampling Perspective
Albattah, W., & Albahli, S. (2022) · Computer Systems Science and Engineering · doi:10.32604/csse.2023.021548 · Cited by 2
Formal Concept Analysis and Extensions for Complex Data Analytics
Kwuida, L., & Missaoui, R. (2021) · Springer eBooks · doi:10.1007/978-3-030-93278-7_1 · Cited by 1
Fahrudin, T. M., Riyantoko, P. A., & Hindrayani, K. M. (2022) · International Conference on Informatics, Multimedia, Cyber and Information System (ICIMCIS) · doi:10.1109/icimcis56303.2022.10017465 · Cited by 1
“As a result, massive amounts of data identify the opportunity to reduce reliance on human insight by drawing from larger, more complicated and difficult, and occasionally improved data sets [7].”
BackgroundThe Application of Big Data Analysis in the Hierarchical Management of Automobile Customers
Wang, H. (2022) · Advances in economics, business and management research/Advances in Economics, Business and Management Research · doi:10.2991/978-94-6463-036-7_264 · Cited by 1
Unsupervised Machine Learning for the Quadratic Assignment Problem
Luong, T. V., & Taillard, É. D. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-26504-4_9 · Cited by 1
Mengüç, E. C. (2023) · Ömer Halisdemir Üniversitesi Mühendislik Bilimleri Dergisi · doi:10.28948/ngumuh.1234303 · Cited by 1
Big data and data analytics in 5G mobile networks
Leliopoulos, P., & Drigas, A. S. (2023) · Global Journal of Engineering and Technology Advances · doi:10.30574/gjeta.2023.15.3.0114 · Cited by 2
“The origin and quality of Big Data together determine the element of truth, but they also pose some challenges [18].”
BackgroundInfluentialAlgorithmic Design Considerations of Big Data Analytics
Di, L., & Yu, G. (2023) · Springer remote sensing/photogrammetry · doi:10.1007/978-3-031-33932-5_11 · Cited by 1
Varghese, J., & Selvan, P. T. (2023) · Journal of Advanced Research in Applied Sciences and Engineering Technology · doi:10.37934/araset.32.1.238251 · Cited by 1
Raj, M., Pandey, K., & Saini, J. R. (2023) · IEEE International Conference on Contemporary Computing and Communications (InC4) · doi:10.1109/inc457730.2023.10263115 · Cited by 1
“The machine learning paradigm can even assist near or real time analysis [19].”
BackgroundTowards automatic generation of image recognition models for industrial robot arms
Arnarson, H., Bremdal, B. A., & Hanssen, M. F. (2023) · IEEE International Conference on Emerging Technologies and Factory Automation (ETFA) · doi:10.1109/etfa54631.2023.10275616 · Cited by 1
“Volume relates to the amount of data, variety describes the types of data that are available, velocity is related to the speed at which the data is generated and the speed the data is processed, and veracity refers to the reliability (correctness) of the data [11].”
BackgroundA Unified Process on Opportunities for Federated Learning in Big Data with IoT
Anitha, G., & Jegatheesan, A. (2023) · International Conference on Advances in Electrical, Electronics and Computational Intelligence (ICAEECI) · doi:10.1109/icaeeci58247.2023.10370988 · Cited by 1
“In that very same vein, [6] examines the combination of FL with IIoT from three events: safety, storing, and IIoT submissions.”
BackgroundFilho, F. R. D. S., Paillard, G. A. L., do Carmo, R. A. F., de Lima, E. T., & Bonfim, M. (2023) · Anais do ... Simpósio Brasileiro de Informática na Educação/Anais do Simpósio Brasileiro de Informática na Educação · doi:10.5753/sbie.2023.235298 · Cited by 2
Gondo, G. E., Holtman, L. B., & Rena, R. (2023) · Journal of Public Administration · doi:10.53973/jopa.2023.58.3.a4 · Cited by 1
Machine Learning-Based Methods for Pneumonia Disease Detection in Health Industry
Goyal, M., Goyal, K., Chhabra, M., & Kumar, R. (2024) · BENTHAM SCIENCE PUBLISHERS eBooks · doi:10.2174/9789815165432124070013 · Cited by 1
Big Data y Fog Computing aplicados al sistema de la salud
González, S. G., & Figueredo, D. D. Á. (2023) · Journal TechInnovation · doi:10.47230/journal.techinnovation.v2.n2.2023.106-116 · Cited by 1
“Gestionar el mar de datos que mueve el término BD no es una tarea fácil, capturar datos, almacenarlos y analizarlos, luego compartirlos, transferirlos, consultarlos, ac-tualizarlos oportunamente, de manera que los sistemas informáticos tradicionales no pueden hacerlo (L’heureux et al., 2017).”
BackgroundPermutation-invariant linear classifiers
Lausser, L. M., Szekely, R., & Kestler, H. A. (2024) · Machine Learning · doi:10.1007/s10994-024-06561-8 · Cited by 1
“Nevertheless, these new classification tasks come also with new challenges (L’Heureux et al., 2017).”
IDHPre: Intradialytic Hypotension Prediction Model Based on Fully Observed Features
Yao, Y., Kuang, Z.-M., Yang, X., Wang, B., Niu, Z., Yang, J., Hu, L., Zhou, X., & Hu, P. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-5689-6_9 · Cited by 1
AI-Powered Local Crime Prediction
Maurya, A. K., Jaiswal, A., Kumar, A., Kumar, A., & Pippal, S. K. (2025) · doi:10.38124/ijisrt/25apr1316 · Cited by 1
Data science in chemical engineering
López-Flores, F. J., Ochoa-Barragán, R., Raya-Tapia, A. Y., Márquez, C. R., & Ponce‐Ortega, J. M. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-29058-9.00002-1 · Cited by 2
A kinetic-based regularization method for data science applications
Ganguly, A., Gabbana, A., RAO, V. V. V. R., Succi, S., & Ansumali, S. (2025) · Machine Learning Science and Technology · doi:10.1088/2632-2153/adf93a · Cited by 2
“Big data science and accompanying machine learning (ML) techniques have profoundly impacted both scientific and societal domains, transforming our ability to collect, store, and navigate unprecedented amounts of data [1–3].”
Xu, P., Liu, K., Lin, Y., Fu, X., Fan, C., & Song, C. (2025) · Geo-spatial Information Science · doi:10.1080/10095020.2025.2542969 · Cited by 1
“In contrast, machine learning methods offer unique advantages in addressing complex nonlinear problems (L’heureux et al. 2017; Maxwell, Warner, and Fang 2018; Rogan et al. 2003).”
A Survey of Preprocessing Techniques for Flow Cytometry Data in Classification Tasks
Núñez-Nepomuceno, D., Sáez, J. A., & Carmona‐Sáez, P. (2025) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbbio.2025.3612573 · Cited by 1
“In addition, flow cytometry classification tasks can generate datasets with potentially millions of features, requiring substantial computational resources [26], [27].”
Combinatorial U-Curve Optimization for Multi-Task Learning: A Task Selection Approach
Bonás, G. K., Reis, M. S., & Raimundo, M. M. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11227230 · Cited by 1
“With the increase in data generation worldwide, driven by the advancement of IoT technologies [1], machine learning has been explored for its ability to learn from data, providing insights, predictions, and decisions based on them [2].”
Gholamiangonabadi, D., Danish, M. U., Chen, Z., & Grolinger, K. (2026) · Machine Learning with Applications · doi:10.1016/j.mlwa.2026.101046 · Cited by 2
Self-citationUsing Big Data for fault diagnosis in legacy manufacturing production lines
Morales, C., Henriquez, K., & Muoz, R. (2018) · IEEE International Conference on Automatica · doi:10.1109/ica-acca.2018.8609768 · Cited by 1
“[7] presenta el estado del arte en la aplicación de aprendizaje de máquina en el análisis de grandes”
BackgroundAsymmetric Compressive Learning Guarantees With Applications to Quantized Sketches
Schellekens, V., & Jacques, L. (2022) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2022.3157486 · Cited by 1
“In order to keep up with the accelerating rate at which data is produced, the design of novel resource-efficient learning paradigms has thus grown into an important research area [1]–[3].”
A Semi-supervised Learning Application for Hand Posture Classification
Nan, K., Hu, S., Luo, H., Wong, P., & Ardakani, S. P. (2023) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-031-33614-0_10 · Cited by 1
Nonparametric Variational Infinite Libby-Novick Beta Mixture Model for Medical Data Clustering
Azzam, D., Azam, M., & Bouguila, N. (2025) · IEEE International Symposium on Industrial Electronics (ISIE) · doi:10.1109/isie62713.2025.11124694 · Cited by 1
“This challenge has catalyzed significant research in more sophisticated modeling approaches that can accurately represent and extract meaningful insights from these complex distributions [3].”
Metadata
- Authors
- L'Heureux, A., Grolinger, K., Elyamany, H. F., & Capretz, M. A. M.
- Affiliations
- Western University (CA)
- Suez Canal University (EG)
- Venue
- IEEE Access
- Published
- 2017
- Volume
- 5
- Pages
- 7776-7797
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2609731728
- Cited by
- 1,023
- References
- 109
- Citations by year
- 2026: 50 · 2025: 175 · 2024: 128 · 2023: 145 · 2022: 130 · 2021: 138 · 2020: 105 · 2019: 88 · 2018: 53 · 2017: 11
- FWCI
- 112.99
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- NSERC CRD at Western University (477530-14)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Big Data Technologies and Applications
- Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Keywords
- big data challenges, volume, velocity, varieties, honesty, scalable learning, data-driven decision making, research gaps
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.