Machine learning with big data: challenges and approaches.
Open accessThe DOI matches its Crossref record; 108 of the 109 references it cites were found in a registry or an index.
Abstract
The Big Data revolution promises to transform how we live, work, and think by enabling process optimization, empowering insight discovery and improving decision making. The realization of this grand potential relies on the ability to extract value from such massive data through data analytics; machine learning is at its core because of its ability to learn from data and provide data driven insights, decisions, and predictions. However, traditional machine learning approaches were developed in a different era, and thus are based upon multiple assumptions, such as the data set fitting entirely into memory, what unfortunately no longer holds true in this new context. These broken assumptions, together with the Big Data characteristics, are creating obstacles for the traditional techniques. Consequently, this paper compiles, summarizes, and organizes machine learning challenges with Big Data. In contrast to other research that discusses challenges, this work highlights the cause–effect relationship by organizing challenges according to Big Data Vs or dimensions that instigated the issue: volume, velocity, variety, or veracity. Moreover, emerging machine learning approaches and techniques are discussed in terms of how they are capable of handling the various challenges with the ultimate objective of helping practitioners select appropriate solutions for their use cases. Finally, a matrix relating the challenges and approaches is presented. Through this process, this paper provides a perspective on the domain, identifies research gaps and opportunities, and provides a strong foundation and encouragement for further research in the field of machine learning with Big Data.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, training these models requires large, diverse, and well-labeled datasets [94].”
From A Review of Passenger Counting in Public Transport Concepts with Solution Proposal Based on Image Processing and Machine Learning (2024) · cites this paper as [94]
In the citing paper
“it is also shifting from a single domain (e.g., domain expertise, or expert systems) to a cross-disciplinary approach through collaboration”
From Challenges and Future Directions of Big Data and Artificial Intelligence in Education (2020) · cites this paper as L’heureux et al., 2017
Citations
Cites
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927 · cited 1×
“• Regularization paths [92] for linear models supports linear regression, two-class logistic regression, and multinomial regression problems.”
MethodThe WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750 · cited 1×
“However, at the moment, they support a limited number of algorithms compared to the R language [73], MATLAB [74], or Weka [75].”
MethodRepresentation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001 · cited 1×
“Representation learning is also often referred to as feature learning [100].”
BackgroundEnsemble methods in machine learning
Dietterich, T. G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45014-9_1 · Cited by 8,408
(2011) · Cited by 5,203
Multiple comparisons among means
Dunn, O. J. (1961) · Journal of the American Statistical Association · doi:10.1080/01621459.1961.10482090 · Cited by 5,006 · cited 1×
“It suggests that if testing m hypotheses with a desired significance of α, each individual hypothesis should be tested at a significance level of α/m [43].”
BackgroundResilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing
Zaharia, M., Chowdhury, M., Das, T., Dave, A., Ma, J. H., McCauley, M., Franklin, M. J. M., Shenker, S. J., & Stoica, I. G. (2012) · UC Berkeley · Cited by 4,891
The Hadoop Distributed File System
Shvachko, K., Kuang, H., Radia, S., & Chansler, R. (2010) · 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST) · doi:10.1109/msst.2010.5496972 · Cited by 4,834 · cited 8×
“In these stages, independent of the category of manipulations, processes can be embedded to capture data provenance and therefore remedy provenance challenge; an example is the Reduce and Map Provenance (RAMP) developed for MapReduce as an extension for Hadoop [64].”
MethodInfluentialHan, S., Mao, H., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1510.00149 · Cited by 4,662 · cited 1×
“Deep compression has been proposed as a way of speeding up processing without the loss of accuracy [105].”
Background
Research works printed but not linked: 20
- goodfellow, 2016, Deep Learning
- marz, 2014, Apache Storm
- rouse, 2011, Machine Learning Definition
- 2015, R A Language and Environment for Statistical Computing, 1
- 2014, IBM Watson Ecosystem Program
- wu, 2016, Google’s neural machine translation system Bridging the gap between human and machine translation
- 2016, Machine Learning American
- 2016, Google Cloud Machine Learning
- 2016, Matlab
- 2013, Billion Devices Will Wirelessly Connect to the Internet of Everything in 2020
- krikorian, 2010, Twitter by the Numbers Twitter
- 2016, H20
- 2016, Apache Mahout
- abadi, 2016, TensorFlow Large-Scale Machine Learning on Heterogeneous Systems
- langford, 2007, Vowpal wabbit online learning project
- rouse, 2009, Predictive Analytics Definition
- sukumar, 2014, Machine learning in the big data era: Are we there yet?, Proc 20th ACM SIGKDD Conf Knowl Discovery Data Mining Workshop Data Sci Social Good (KDD), 1
- 2016, GPU Applications Transforming Computational Research and Engineering
- torrey, 2010, Handbook of Research on Machine Learning Applications and Trends
- 2016, Apache Giraph
Cited by
Items 701–800 of 1,002
Deris, M. M., Hamid, M. A., Ibrahim, N., Efendi, R., & Yanto, I. T. R. (2019) · International Conference on Information and Communication Systems (ICICS) · doi:10.1109/iacs.2019.8809135 · Cited by 3
Evaluating the Boundaries of Big Data Environments for Machine Learning
Ismail, F. N., Woodford, B. J., & Licorish, S. A. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-35288-2_21 · Cited by 3
Instructor Performance Evaluation Through Machine Learning Algorithms
Sowmiya, J., & Kalaiselvi, K. (2020) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-37218-7_84 · Cited by 3
Papasotiriou, T. (2019) · Proceedings of the International Conference on Computer-Aided Architectural Design Research in Asia · doi:10.52842/conf.caadria.2019.2.815 · Cited by 3
Loukrakpam, M., & Choudhury, M. (2020) · Circuits Systems and Signal Processing · doi:10.1007/s00034-020-01415-9 · Cited by 3
“In recent years, machine learning has become a critical technique to extract meaningful information from large amount of data [30,37,39].”
BackgroundApplication of Big Data and Machine Learning
Sharma, N., Gautam, S. K., Henry, A., & Kumar, A. (2020) · Wiley eBooks · doi:10.1002/9781119654834.ch12 · Cited by 3
Waters, J., Rodas, M. O., Orden, K. V., & Hricko, M. (2020) · IEEE International Conference on Human-Machine Systems (ICHMS) · doi:10.1109/ichms49158.2020.9209542 · Cited by 4
“[2] The problems operators are trying to solve are not amenable to simple one button yes/no solutions.”
BackgroundLashkaripour, Z. (2020) · International journal of scientific and technology research · Cited by 5
Machine Learning Techniques and Frameworks for Heterogeneous Data Fusion in Big Data Analytics
Divya, G., & Manish, T. I. (2020) · International Conference on Electronics, Communication and Aerospace Technology (ICECA) · doi:10.1109/iceca49313.2020.9297563 · Cited by 3
“Data heterogeneity techniques can be broadly classified as syntactic and semantic heterogeneity [2][3].”
BackgroundContent-based prediction: big data sampling perspective
Albattah, W., & Albahli, S. (2019) · International Journal of Engineering & Technology · doi:10.14419/ijet.v8i4.30150 · Cited by 3
“serious constraints attached to each machine, and the results are totally dependent upon the amount of information that is provided for processing and the amount of information a machine can handle [7].”
BackgroundMethodInfluentialSupervised Analysis for Phenotype Identification: The Case of Heart Failure Ejection Fraction Class
López, C., Holgado, J. L., Cortés, R., Saurí, I., Fernández-Giménez, A., Calderón, J. M., Núñez, J. E., & Redón, J. (2021) · Bioengineering · doi:10.3390/bioengineering8060085 · Cited by 3
A Hybrid Approach for Semantic Image Annotation
Sezen, A., Turhan, Ç., & Şengül, G. (2021) · IEEE Access · doi:10.1109/access.2021.3114968 · Cited by 3
“Moreover, the immense computational power required to train a model such as this one is not cost-effective and limits the usage of hardware at hand [11], [12].”
BackgroundChinchmalatpure, M., & Dhore, M. P. (2020) · International Journal of Engineering and Advanced Technology · doi:10.35940/ijeat.c4828.029320 · Cited by 3
Byzantine Resilient Non-Convex SCSG With Distributed Batch Gradient Computations
Bulusu, S., Khanduri, P., Kafle, S., Sharma, P., & Varshney, P. K. (2021) · IEEE Transactions on Signal and Information Processing over Networks · doi:10.1109/tsipn.2021.3129352 · Cited by 5
Ganguly, P., Parihar, G., & Sivagami, M. (2021) · Lecture notes in electrical engineering · doi:10.1007/978-981-16-6448-9_20 · Cited by 6
Precision nutrition: approach for understanding intra-individual biological variation
Kim, Y. (2022) · Journal of Nutrition and Health · doi:10.4163/jnh.2022.55.1.1 · Cited by 3
Valliammal, N., & Shanmugapriya, D. (2021) · IGI Global eBooks · doi:10.4018/978-1-6684-3662-2.ch032 · Cited by 3
Applying Machine Learning and Dynamic Resource Allocation Techniques in Fifth Generation Networks
Bouras, C. J., Michos, E., & Prokopiou, I. (2022) · Lecture notes in networks and systems · doi:10.1007/978-3-030-99584-3_57 · Cited by 3
Transparent Quality Optimization for Machine Learning-Based Regression in Neurology
Wendt, K., Trentzsch, K., Haase, R., Weidemann, M. L., Weidemann, R. R., Aßmann, U., & Ziemssen, T. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12060908 · Cited by 3
“, explainability, modularity or reusability, can be contrary design objectives; hence a trade-off has to be achieved [2,3].”
BackgroundMethodA Review of Machine Learning Techniques (MLT) in Health Informatics
Rawat, V., Singh, D. P., Singh, N., & Tiwari, U. K. (2023) · Lecture notes in electrical engineering · doi:10.1007/978-981-19-8136-4_3 · Cited by 3
Li, X. (2023) · Academic Journal of Business & Management · doi:10.25236/ajbm.2023.050317 · Cited by 3
“Another reason is that machine learning algorithms can be trained on historical data and then applied to new, unseen data, making them suitable for making predictions on future insurance claims [12-14].”
BackgroundBig data and machine learning and the impact on education
Leliopoulos, P., Stavridis, S., & Drigas, A. S. (2023) · World Journal of Advanced Research and Reviews · doi:10.30574/wjarr.2023.18.3.1054 · Cited by 3
“A significant issue of Big Data is to violate these assumptions, making traditional algorithms unusable or greatly hindering their performance [2].”
BackgroundMethodInfluentialAn Unequal Error Protection-based Coded Transmission for Federated Learning
Lu, Q., Xu, R., Liu, C., Li, S., & Bai, B. (2023) · IEEE/CIC International Conference on Communications in China (ICCC) · doi:10.1109/icccworkshops57813.2023.10233736 · Cited by 3
“Artificial intelligence (AI) is envisioned to intertwine with people’s daily life [1]-[5].”
BackgroundLiu, C. (2023) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780197653609.013.26 · Cited by 4
Unravelling the Enigma of Machine Learning Model Interpretability in Enhancing Disease Prediction
Tripathi, R. K. P., & Tiwari, S. (2023) · Advances in systems analysis, software engineering, and high performance computing book series · doi:10.4018/978-1-6684-8531-6.ch007 · Cited by 3
Prayaga, L., Devulapalli, K., Prayaga, C. S., Wade, A., Reddy, G. S. H., & Pola, S. S. H. (2024) · International Journal of Data Analytics · doi:10.4018/ijda.343311 · Cited by 3
“…researchers confront two main challenges: (1) obtain a sufficiently large data set necessary for constructing meaningful machine learning models (L’Heureux et al., 2017) and (2) high-dimensional data sets are becoming more prevalent across multiple disciplines (Yuan, 2023) including genetics…”
Real-Time Logistics and Warehouse Integration via Networks of the Future and Dynamic Digital Twins
Khetani, N., Sharma, A., & Kulkarni, A. (2023) · IEEE Engineering Informatics · doi:10.1109/ieeeconf58110.2023.10520525 · Cited by 3
“As the number of variables increases, the complexity of the models required to accurately represent the relationships within the data also grows [39].”
BackgroundAlmeida, M. L. S., Cavalcanti, A. O., Sarai, R., Silva, M. A., de Melo, P. R. V., da Silva, A. A. M., Caldas, R., Buarque, F., & Trombini-Souza, F. (2024) · Applied Sciences · doi:10.3390/app14167093 · Cited by 3
Xu, N., Cai, Y., Tong, Y., Tang, L., Zhou, Y., Gong, Y., Wang, J., Wang, J., Chen, Y., Jiang, Q., et al. (2024) · Parasitology Research · doi:10.1007/s00436-024-08331-w · Cited by 3
Towards a Model-Driven Approach to Enable Uniform Access to Vector Databases
Akik, E., Vještica, M., Dimitrieski, V., Kordić, S., & Ristić, S. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-70421-5_19 · Cited by 3
Client Specific Dynamic Aggregation for Non-IID Federated Learning
Altomare, V., Thakur, D., Guzzo, A., & Piccialli, F. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825156 · Cited by 5
Pham, T. H., & Raahemi, B. (2025) · Algorithms · doi:10.3390/a18030154 · Cited by 3
Judicial Resilience: How Judges Manage Pressures in China’s Anti-crime Campaigns
Feng, Y., & Yu, Z. (2024) · Journal of Chinese Political Science · doi:10.1007/s11366-024-09885-3 · Cited by 3
“Given the large sample size, we employed context analysis and extracted variables via regular expression matching, which is a common method for extracting context variables [15].”
Albattah, W., & Ullah, R. (2018) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2018.090846 · Cited by 3
“The ability of any machine to learn depends upon the amount of information it can handle and the limit to which it can process [4].”
BackgroundDai, Q., Zhu, L., Wang, P., Li, G., & Chen, J. (2019) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-030-06161-6_55 · Cited by 3
A Model For Enhancing The Structure And Strategy In An E-Learning Environment
Subha, S., & Priya, S. B. (2019) · International Conference on Computing and Communications Technologies (ICCCT) · doi:10.1109/iccct2.2019.8824857 · Cited by 3
“According to the survey of the McKinsey Global Institute, Machine learning is considered as one of the main drivers of Big Data revolution [5].”
MethodA Study of Deterioration in Classification Models in Real-Time Big Data Environment
Uddin, V., Rizvi, S. S. H., Hashmani, M. A., Jameel, S. M., & Ansari, T. A. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-33582-3_8 · Cited by 3
A Generic Architectural Framework for Machine Learning on Data Streams
Augenstein, C., Zschörnig, T., Spangenberg, N., Wehlitz, R., & Franczyk, B. (2020) · Lecture notes in business information processing · doi:10.1007/978-3-030-40783-4_6 · Cited by 3
Comparative Study of Big Data Heterogeneity Solutions
Sabri, H. M., El-Din, A. M. G., Amer, A. A., & Senousy, M. B. (2020) · Lecture notes in networks and systems · doi:10.1007/978-981-15-3075-3_29 · Cited by 3
Big Data Preprocessing Phase in Engendering Quality Data
Kotiyal, B., & Pathak, H. (2021) · Lecture notes in electrical engineering · doi:10.1007/978-981-16-2354-7_7 · Cited by 3
A Deep-Network Piecewise Linear Approximation Formula
Zeng, G. L. (2021) · IEEE Access · doi:10.1109/access.2021.3109173 · Cited by 3
“The availability of huge amount of data makes machine learning practical [7].”
BackgroundA Survey of IoT Software Platforms
Astropekakis, K., Drakakis, E., Grammatikakis, K., & Goumopoulos, C. (2022) · Lecture notes in networks and systems · doi:10.1007/978-3-030-87049-2_10 · Cited by 4
Tabiban, A., Zhao, H., Jarraya, Y., Pourzandi, M., & Wang, L. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-22295-5_19 · Cited by 4
“This can be explained by the possibility that our translation models trained by larger datasets may become more biased [33] due to the Automatically generated report: By the detection time, there are 4 operations performed in 3 hours corresponding to the alert entity of vm vmmal.”
MethodAn Enhanced Comparative Assessment of Ensemble Learning for Credit Scoring
(2018) · International Journal of Machine Learning and Computing · doi:10.18178/ijmlc.2018.8.5.721 · Cited by 3
Big Pimpin’. Een big data-benadering van de verspreiding van het leenwoord pimpen in het Nederlands
Pijpops, D., Pascale, S. D., de Velde, F. V., & Zenner, E. (2023) · Taal en tongval · doi:10.5117/tet2023.1.005.pijp · Cited by 3
Mapping the Internet: Modelling Entity Interactions in Complex Heterogeneous NetworksPreprint
Mandlík, Š., & Pevný, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.09650 · Cited by 3
Monika, E., & Kumar, T. R. (2024) · Research Square · doi:10.21203/rs.3.rs-5215161/v1 · Cited by 3
Data Science Project Barriers—A Systematic Review
Labarrère, N., Costa, L., & Lima, R. M. (2025) · Data · doi:10.3390/data10080132 · Cited by 2
Unified Deep Ensemble Architecture for Multiple Classification Tasks
Mistry, K., & Mandal, B. (2024) · Lecture notes in networks and systems · doi:10.1007/978-3-031-66329-1_35 · Cited by 2
SoK: Opportunities for Accelerating Multi - Party Computation via Trusted Hardware
Liu, T., Huang, Z., Li, J., Niu, J., Chen, G., & Zhang, Y. (2024) · International Symposium on Secure and Private Execution Environment Design (SEED) · doi:10.1109/seed61283.2024.00024 · Cited by 4
“Nowadays, the data volume involved in analyses and computations has grown exponentially due to the pursuit of more accurate and effective training and inference in Machine Learning (ML) [1].”
BackgroundHigh-resolution snow depth modeling in South Korea using radar-based precipitation data
Kim, S., Park, J., Chung, G., & Kim, D. (2025) · Stochastic Environmental Research and Risk Assessment · doi:10.1007/s00477-024-02902-0 · Cited by 2
“The third approach is machine learning, a versatile set of tools that can model complex relationships in data using a wide range of techniques, including neural networks, decision trees, and support vector machines (L’heureux et al. 2017 ).”
AI-Powered Local Crime Prediction
Maurya, A. K., Jaiswal, A., Kumar, A., Kumar, A., & Pippal, S. K. (2025) · doi:10.38124/ijisrt/25apr1315 · Cited by 2
Bhattacharya, K., Srinivasan, V., Keshwani, S., & Chakrabarti, A. (2025) · Journal of Computing and Information Science in Engineering · doi:10.1115/1.4068637 · Cited by 2
Parreño, C. M., Giles, D., & Corletto, F. (2025) · Scientific Reports · doi:10.1038/s41598-025-01991-3 · Cited by 2
“Anaesthesia typically reduces metabolic heat production rates by 20–30% 21 , and some anaesthetic drugs can induce vasodilation, contributing to heat loss 22 .”
SpyShield: a Spyfall inspired defense mechanism against poisoning attacks in federated learning
Elgharieb, Y., Alexan, W., El-Aasser, M., & Ghantous, M. M. (2025) · Scientific Reports · doi:10.1038/s41598-025-16158-3 · Cited by 2
“In classic ML, data from various sources is aggregated and collected for model training, which has raised concerns about privacy, security, and the practicality of aggregating large volumes of data into a single location 11 .”
Privacy Preserving Ordinal-Meta Learning with VLMs for Fine-Grained Fruit Quality Prediction
Jain, R., Patwardhan, M. S., Mishra, A., Deshpande, P., & Rai, B. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00045 · Cited by 2
“However, to be effective, it requires a lot of labeled data, in terms of fruit images annotated with a freshness index [9, 23].”
Type-II neural symmetry detection with Lie theory
Gabel, A., Quax, R., & Gavves, E. (2025) · Scientific Reports · doi:10.1038/s41598-025-17098-8 · Cited by 2
“Traditionally, advancements in deep learning have relied on computational scaling through the accrual of progressively larger data sets 19 .”
The Case for Sustainable AI in the Creative Industry
Sowriraghavan, A. (2025) · Women in engineering and science · doi:10.1007/978-3-031-95890-8_10 · Cited by 2
Bayati, K., Beheshti, S., & Umapathy, K. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.115154 · Cited by 2
Morfino, V., Rampone, S., & Weitschek, E. (2019) · Soft Computing · doi:10.1007/s00500-019-04366-9 · Cited by 2
Prediction of Safe-Zone Evolution in Poisonous Environment Based on Deep Learning
Xv, J., & Hou, Z. (2019) · IEEE Access · doi:10.1109/access.2019.2960451 · Cited by 2
Cruz-Reyes, H., Reyes-Nava, A., Rendón, E., & Alejo, R. P. (2018) · Research in Computing Science · doi:10.13053/rcs-147-5-15 · Cited by 2
“Hoy en día en áreas como ML, el reconocimiento de patrones (PR por sus siglas en inglés), y la minería de datos (DM por sus siglas en inglés) se ha demostrado que el desbalance de clases es un problema crucial que afecta la eficiencia del algoritmo [21, 26], incluso en Big Data se considera como uno de los principales…”
BackgroundInfluentialCorreia, F. F., Madureira, A. M., & Bernardino, J. (2022) · Lecture notes in networks and systems · doi:10.1007/978-3-030-96299-9_20 · Cited by 2
Tang, P. P., Tam, I. L., Jia, Y., & Leung, S.-W. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-053447 · Cited by 2
Improving Custom Vision cognitive services model
Maghraby, A. E. (2021) · Journal of ACS Advances in Computer Science · doi:10.21608/asc.2021.240134 · Cited by 2
“[18] Figure 20:image of background Samples”
Statistical techniques for big data analytics in IoT-enabled green supply chain management: a survey
Saleha, W. A., Abdelkaderb, S. M., Rashada, H., & Abdel-Gawad, A. F. (2022) · Al-Mağallah Al-ʿArabiyyaẗ Lil-Qiyās wa Al-Taqwīm · doi:10.21608/ajme.2023.274181 · Cited by 3
Approaches Involving Big Data Analytics (BDA) Using Machine Learning, Described
Tiwari, S. (2022) · IEEE Global Conference for Advancement in Technology (GCAT) · doi:10.1109/gcat55367.2022.9972108 · Cited by 3
“Furthermore, multiple researchers have described the difficulty in dealing with such a vast and unparalleled volume of data composed of various data and sometimes even issuing data [35].”
BackgroundA New Hybrid Artificial Intelligence Model for Diseases Identification
Maiti, A., Abarda, A., & Hanini, M. (2023) · Lecture notes in networks and systems · doi:10.1007/978-3-031-26852-6_76 · Cited by 2
Chang, K., Jia, T., Zhou, Y., Shu, Z., Liu, J., Sun, J., Zheng, Q., Tian, H., Xia, J., Yang, K., et al. (2023) · World Journal of Traditional Chinese Medicine · doi:10.4103/2311-8571.372326 · Cited by 2
DMobile-ELA: Digital Image Forgery Detection via cascaded Atrous MobileNet and Error Level Analysis
Fathalla, K. M., Sowelem, M., & Fathalla, R. (2023) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2023.0140318 · Cited by 2
“With the increasing volumes of media and the advancements of editing technologies, traditional models will not provide adequate solution to the problem [21].”
BackgroundInnovación en el desempeño de las empresas del interior del Perú
Quintana, S. L. R., Leandro, A. A. M., Rodríguez, P. B. V., & Olguín, J. P. (2023) · Revista Venezolana de Gerencia · doi:10.52080/rvgluz.28.103.19 · Cited by 2
Artificial neural networks applied to time series for flood prediction
Mesquita, L. A. F., Ranieri, C. M., & Ueyama, J. (2023) · doi:10.5753/eniac.2023.234355 · Cited by 2
“With the advent of artificial intelligence, a range of opportunities has emerged to address issues that previously had limited scope [Aurelien 2019, ’L’heureux et al. 2017].”
BackgroundClustering as a Catalyst for Big Data Classification (CC-BC)
Halder, M., Shopnil, S., Arafat, Y., Chowdhury, M. M., Jobayer, S. H., & Farid, D. M. (2023) · International Conference on Computer and Information Technology (ICCIT) · doi:10.1109/iccit60459.2023.10441188 · Cited by 2
“Big data, which can be characterized by three factors—volume, variety, and velocity—presents a complex tapestry made up of enormous amounts of information, varied qualities, and dynamic streams of incoming and outgoing data [2].”
BackgroundKNOWLEDGE MANAGEMENT APPROACH IN COMPARATIVE STUDY OF AIR POLLUTION PREDICTION MODEL
Rohajawati, S., SETYODEWI, H., TRESNANTO, F. M. A., MARIANTHI, D., & Sihotang, M. T. B. (2024) · Applied Computer Science · doi:10.35784/acs-2024-11 · Cited by 2
“Unfortunately, some of these assumptions no longer align with the current context, along with the characteristics of Big Data, posing challenges for conventional techniques (L’Heureux et al., 2017).”
BackgroundIkhlaq, U., & Kechadi, T. (2023) · Congress in Computer Science, Computer Engineering, and Applied Computing (CSCE) · doi:10.1109/csce60160.2023.00239 · Cited by 3
“2) Velocity [8]: Agroclimatic indices data is collected at 15-minute intervals over 10 years, highlighting the velocity dimension.”
BackgroundMethodInfluentialNeto, G. F., Macêdo, B. D. S., Boratto, T. H. D. A., Gontijo, T. S., Bodini, M., Saporetti, C. M., & Goliatt, L. (2025) · Mathematical and Computational Applications · doi:10.3390/mca30010016 · Cited by 2
Semantic-Based Anomaly Detection Approach for Large-Scale Time Series Data in Acceleration Events
Tichomirov, D., Ferraris, A., & Lamprecht, A. (2025) · International Journal on Semantic Web and Information Systems · doi:10.4018/ijswis.373313 · Cited by 2
Linhares, F. C., Arruda, F. A. C., & Larriera, C. (2025) · Journal of Economy and Technology · doi:10.1016/j.ject.2025.05.002 · Cited by 3
Amrullah, A., Gopindo, R., Ledyawati, & Pakpahan, F. N. (2024) · Business and Investment Review · doi:10.61292/birev.187 · Cited by 2
Chaouch, M., & Al-Hamed, O. M. (2025) · IEEE Access · doi:10.1109/access.2025.3591883 · Cited by 2
“Studies by [18] and [19] have demonstrated how the big data paradigm has disrupted these traditional assumptions, rendering many classical algorithms unstable or significantly reducing their effectiveness in handling large-scale, dynamic datasets.”
Kemei, E. K., Laerhoven, K. V., Karuri, N. W., & Tewo, R. K. (2025) · Applied Computing and Intelligence · doi:10.3934/aci.2025015 · Cited by 2
Xinyan, Z., Quan, L., Shuai, L., Feng, H., Liang, L., Zuojun, T., Shen, H., Zhilong, B., & Jing, X. (2025) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2025.110982 · Cited by 2
TopoFormer: Integrating Transformers and ConvLSTMS for Coastal Topography Prediction
Munian, S., Karakuş, O., Russell, W., & Nelson, G. (2025) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss55030.2025.11313955 · Cited by 2
“However, environmental and logistical challenges—such as adverse weather, high wave energy, and inaccessible shallow slopes—often hinder the collection of complete MLWS data, leaving gaps in surveys that can undermine topographic analysis and coastal management efforts [3, 4].”
Predicting the internal model of a robotic system from its morphology
Duran, A. J., & del Pobil, A. P. (2018) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2018.08.014 · Cited by 2
Multilevel Classification Framework of fMRI Data: A Big Data Approach
Pani, L., Karmakar, S., Misra, C., & Dash, S. R. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-818146-1.00006-4 · Cited by 2
A Support Vector Machine Cost Function in Simulated Annealing for Network Intrusion Detection
Chowdhury, M. N., & Ferens, K. (2019) · Advances in Science Technology and Engineering Systems Journal · doi:10.25046/aj040334 · Cited by 2
“Machine learning has the ability to learn from the big data and perform statistical analysis to provide data-driven insights, discover hidden patterns, make decisions and predictions [2].”
BackgroundKhan, M. J., Wang, R., Sun, D. W., & Li, G. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-41418-4_19 · Cited by 2
Singh, N., & Kaur, A. (2020) · Advances in medical diagnosis, treatment, and care (AMDTC) book series · doi:10.4018/978-1-7998-3069-6.ch013 · Cited by 2
Mirza, B., Syed, T., Khan, B., & Malik, Y. (2021) · ACM Computing Surveys · doi:10.1145/3427476 · Cited by 4
“Crowd-sourcing [61] has resulted in low quality data due to the mechanical nature and intrinsic weak controls [95].”
BackgroundSupriya, M. S., & Sasidaran, K. (2021) · Advances in data mining and database management book series · doi:10.4018/978-1-7998-6673-2.ch004 · Cited by 2
An Evaluation of Autoencoder Neural Network Role in Iot Edge Computing
KAKIZ, A. T., Kakız, M. T., & Çoban, R. (2022) · Osmaniye Korkut Ata Üniversitesi Fen Bilimleri Enstitüsü Dergisi · doi:10.47495/okufbed.1037534 · Cited by 2
Real-Time Human–Machine Interaction Through Voice Augmentation Using Artificial Intelligence
Sumaiya, M. N., Sreekanth, B. V., Akash, U. S., Kala, A. S., & Gowda, G. M. D. (2022) · Lecture notes in networks and systems · doi:10.1007/978-981-19-2940-3_10 · Cited by 2
Towards Data Science for Cybersecurity: Machine Learning Advances as Glowing Perspective
Mihăilescu, M. I., & Niță, Ș. L. (2022) · Lecture notes in networks and systems · doi:10.1007/978-3-031-16078-3_2 · Cited by 2
Case Study Analysis of the Use of Cloud Computing for Assessing Big Data Risks
Fataftah, F., & Isong, B. (2023) · Journal of Information Systems and Informatics · doi:10.51519/journalisi.v5i2.478 · Cited by 2
“New advanced coding and access control systems are designed to prevent these concerns, and there is a need for increased intervention to manage these big data [22] ethically.”
BackgroundDetection and Classification of Type 2 Diabetes using Machine Learning Techniques
Keerthana, N. (2023) · International Conference on Advancements in Electrical, Electronics, Communication, Computing and Automation (ICAECA) · doi:10.1109/icaeca56562.2023.10201205 · Cited by 2
“In [6] suggested a patient-specific model for treating type 2 diabetes with diet and exercise.”
BackgroundEfficient Online Edge Learning for UAV Object Detection via Adaptive Batch Size Fitting
Wu, F., Qu, Y., Wang, W., Dong, C., Jing, Y., Zhang, L., & Wu, Q. (2023) · International Conference on Big Data Computing and Communications (BigCom) · doi:10.1109/bigcom61073.2023.00033 · Cited by 2
“To further improve the performance of UAVs, it is an inevitable trend to use artificial intelligence (AI), especially machine learning (ML) [2] techniques, to enable UAVs to operate independently and intelligently.”
MethodTowards a disease prediction system: BioBERT-based medical profile representation
Hatoum, R., Alkhazraji, A., Ibrahim, Z. A. A., Dhayni, H., & Sbeity, I. (2024) · IAES International Journal of Artificial Intelligence · doi:10.11591/ijai.v13.i2.pp2314-2322 · Cited by 2
“A pivotal aspect lies in meticulously choosing appropriate data sources to bolster the efficacy of predictive models [2] and ensure alignment with practical expectations.”
BackgroundCuzzocrea, A. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia231000 · Cited by 2
openData Marco de trabajo para la publicación de datos abiertos en Cuba
Luna, R. A., González, H., Reyes, A. T., & Torres, A. R. (2021) · Revista Cubana de Transformación Digital · Cited by 2
Metadata
- Authors
- L'Heureux, A., Grolinger, K., Elyamany, H. F., & Capretz, M. A. M.
- Affiliations
- Western University (CA)
- Suez Canal University (EG)
- Venue
- IEEE Access
- Published
- 2017
- Volume
- 5
- Pages
- 7776-7797
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2609731728
- Cited by
- 1,023
- References
- 109
- Citations by year
- 2026: 50 · 2025: 175 · 2024: 128 · 2023: 145 · 2022: 130 · 2021: 138 · 2020: 105 · 2019: 88 · 2018: 53 · 2017: 11
- FWCI
- 112.99
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- NSERC CRD at Western University (477530-14)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Big Data Technologies and Applications
- Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Keywords
- big data challenges, volume, velocity, varieties, honesty, scalable learning, data-driven decision making, research gaps
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.