The DOI matches its Crossref record; 90 of the 90 references it cites were found in a registry or an index.
Machine learning on big data: Opportunities and challenges
Open accessAbstract
Machine learning (ML) is continuously unleashing its power in a wide range of applications. It has been pushed to the forefront in recent years partly owing to the advent of big data. ML algorithms have never been better promised while challenged by big data. Big data enables ML algorithms to uncover more fine-grained patterns and make more timely and accurate predictions than ever before; on the other hand, it presents major challenges to ML such as model scalability and distributed computing. In this paper, we introduce a framework of ML on big data (MLBiD) to guide the discussion of its opportunities and challenges. The framework is centered on ML which follows the phases of preprocessing, learning, and evaluation. In addition, the framework is also comprised of four other components, namely big data, user, domain, and system. The phases of ML and the components of MLBiD provide directions for identification of associated opportunities and challenges and open up future work in many unexplored or under explored research areas.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
(2016) · Cited by 11,679
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Artificial intelligence: A modern approach
Nilsson, N. J. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(96)00007-0 · Cited by 10,583
Machine learning: Trends, perspectives, and prospects
Jordan, M. I., & Mitchell, T. M. (2015) · Science · doi:10.1126/science.aaa8415 · Cited by 9,955
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795
(2010) · Cited by 4,411
Research works printed but not linked: 20
- Y.Z.Y.-M.Cheung, Discretizing Numerical Attributes in Decision Tree for Big Data Analysis, in: Proceedings of the 2014 IEEE International Conference on Data Mining Workshop (ICDMW), 2014.
- Nguyen-Dinh, 2013, Combining crowd-generated media and personal data: semi-supervised learning for context recognition, Proc. 1st ACM Int. Workshop Pers. data meets Distrib. Multimed., 35, 10.1145/2509352.2509396 · doi:10.1145/2509352.2509396
- Su, 2014, Effective and efficient data sampling using bitmap indices, Clust. Comput., 17, 1081, 10.1007/s10586-014-0360-5 · doi:10.1007/s10586-014-0360-5
- T.Yang, Q.Lin, R.Jin, Big data analytics: Optimization and randomization, in: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2015, pp. 2327–2327. · doi:10.1145/2783258.2789989
- Yue, 2017, A data-intensive approach for discovering user similarities in social behavioral interactions based on the bayesian network, Neurocomputing, 219, 364, 10.1016/j.neucom.2016.09.042 · doi:10.1016/j.neucom.2016.09.042
- Borkar, 2012, Declarative systems for large-scale machine learning, IEEE Data Eng. Bull., 35, 24
- Theano Development Team, Theano: A Python framework for fast computation of mathematical expression. Available: arXiv:1605.02688. · arXiv
- P.Domingos, G.Hulten, A General Method for Scaling Up Machine Learning Algorithms and its Application to Clustering, presented at Proceedings of the Eighteenth International Conference on Machine Learning, 2001, pp. 106–113.
- K.L.C.Zhu, M.Savvides, Distributed class dependent feature analysis — A big data approach, in: proceedings of the 2014 IEEE International Conference on Big Data, 2014.
- Yui, 2013, A database-Hadoop hybrid approach to Scalable machine learning, IEEE Int. Congr. Big Data (BigData Congr.), 1
- L.Bagheri, H.Goote, A.Hasan, G.Hazard, Risk adjustment of patient expenditures: A big data analytics approach, in Proceedings of the 2013 IEEE International Conference on Big Data, 2013.
- Krizhevsky, 2012, Imagen. Classif. Deep convolutional Neural Netw.
- Deng, 2009, Construction and analysis of a large scale image ontology, Vis. Sci. Soc., 1
- E.Bortnikov, A.Frank, E.Hillel, S.Rao, Predicting execution bottlenecks in map-reduce clusters, in: Proceedings of the 4th USENIX conference on Hot Topics in Cloud Ccomputing, 2012, pp. 18–18.
- Kashyap, 2015, Big Data Anal. Bioinforma.: A Mach. Learn. Perspect.
- J.Xu, C.Tekin, M.van der Schaar, Learning optimal classifier chains for real-time big data mining, in Proceedings 51st Annu. Allerton Conference Comm., Control and Comput. (Allerton'13), 2013.
- G.De Francisci Morales, SAMOA: a platform for mining big data streams, in: Proceedings of the 22nd International Conference on World Wide Web, 2013, pp. 777–778. · doi:10.1145/2487788.2488042
- Q.Yang, Big data, lifelong machine learning and transfer learning, in: Proceedings of the sixth ACM international conference on Web search and data mining, 2013, pp. 505–506. · doi:10.1145/2433396.2433459
- Wang, 2012, Breaking the curse of kernelization: budgeted stochastic gradient descent for large-scale SVM training, The J. Mach. Learn. Res., 13, 3103
- Armes, M, 2013, Using Big data and predictive machine learning in aerospace test environments, IEEE Autotestcon
Cited by
Literature review of Industry 4.0 and related technologies
Oztemel, E., & Gursev, S. (2020) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-018-1433-8 · Cited by 2,143
Digital twin: values, challenges and enablers from a modeling perspective
Rasheed, A., San, O., & Kvamsdal, T. (2020) · IEEE Access · doi:10.1109/access.2020.2970143 · Cited by 1,952
A Topic Modeling Comparison Between LDA, NMF, Top2Vec, and BERTopic to Demystify Twitter Posts
Egger, R., & Yu, J. (2022) · Frontiers in Sociology · doi:10.3389/fsoc.2022.886498 · Cited by 970
Review of Image Classification Algorithms Based on Convolutional Neural Networks
Chen, L., Li, S., Bai, Q., Yang, J., Jiang, S., & Miao, Y. (2021) · Remote Sensing · doi:10.3390/rs13224712 · Cited by 789
Ahmad, T., Madonski, R., Zhang, D., Huang, C., & Mujeeb, A. (2022) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2022.112128 · Cited by 711
A survey towards an integration of big data analytics to big insights for value-creation
Saggi, M. K., & Jain, S. (2018) · Information Processing & Management · doi:10.1016/j.ipm.2018.01.010 · Cited by 494
Real-time big data processing for anomaly detection: A survey
Ariyaluran Habeeb, R. A., Nasaruddin, F., Gani, A., Targio Hashem, I. A., Ahmed, E., & Imran, M. (2019) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2018.08.006 · Cited by 487
Ağbulut, Ü., Gürel, A. E., & Biçen, Y. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.110114 · Cited by 424
A Survey on Security Threats and Defensive Techniques of Machine Learning: A Data Driven View
Liu, Q., Li, P., Zhao, W., Cai, W., Yu, S., & Leung, V. C. M. (2018) · IEEE Access · doi:10.1109/access.2018.2805680 · Cited by 421
Usuga Cadavid, J. P., Lamouri, S., Grabot, B., Pellerin, R., & Fortin, A. (2020) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-019-01531-7 · Cited by 387
A comprehensive survey on recent metaheuristics for feature selection
Dokeroglu, T., Deniz, A., & Kiziloz, H. E. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.04.083 · Cited by 356
Big Data Analytics in Building the Competitive Intelligence of Organizations
Ranjan, J., & Foropon, C. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2020.102231 · Cited by 309
Machine learning-driven new material discovery
Cai, J., Chu, X., Xu, K., Li, H., & Wei, J. (2020) · Nanoscale Advances · doi:10.1039/d0na00388c · Cited by 296
A transformer-based approach to irony and sarcasm detection
Potamias, R. A., Siolas, G., & Stafylopatis, A. G. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-05102-3 · Cited by 278
Rangel-Martinez, D., Nigam, K. D. P., & Ricardez-Sandoval, L. A. (2021) · Chemical Engineering Research and Design · doi:10.1016/j.cherd.2021.08.013 · Cited by 260
Implications of big data analytics in developing healthcare frameworks – A review
Palanisamy, V., & Thirunavukarasu, R. (2019) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2017.12.007 · Cited by 259
Deep learning in big data Analytics: A comparative study
Jan, B., Farman, H., Khan, M., Imran, M., Islam, I. U., Ahmad, A., Ali, S., & Jeon, G. (2019) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2017.12.009 · Cited by 254
CIoT-Net: a scalable cognitive IoT based smart city network architecture
Park, J.-H., Salim, M. M., Jo, J. H., Sicato, J. C. S., Rathore, S., & Park, J. H. (2019) · Human-centric Computing and Information Sciences · doi:10.1186/s13673-019-0190-9 · Cited by 121
Reviewing Federated Machine Learning and Its Use in Diseases Prediction
Moshawrab, M., Adda, M., Bouzouane, A., Ibrahim, H., & Raad, A. (2023) · Sensors · doi:10.3390/s23042112 · Cited by 114
Smart Surveillance as an Edge Network Service: From Harr-Cascade, SVM to a Lightweight CNN
Nikouei, S. Y., Chen, Y., Song, S., Xu, R., Choi, B.-Y., & Faughnan, T. (2018) · 2018 IEEE 4th International Conference on Collaboration and Internet Computing (CIC) · doi:10.1109/cic.2018.00042 · Cited by 105
Cresswell, K., Callaghan, M., Khan, S., Sheikh, Z., Mozaffar, H., & Sheikh, A. (2020) · Health Informatics Journal · doi:10.1177/1460458219900452 · Cited by 87
Digital Twin: Values, Challenges and Enablers
Rasheed, A., San, O., & Kvamsdal, T. (2019) · arXiv · doi:10.48550/arxiv.1910.01719 · Cited by 81
Towards Trustworthy Machine Learning in Production: An Overview of the Robustness in MLOps Approach
Bayram, F., & Ahmed, B. S. (2025) · ACM Computing Surveys · doi:10.1145/3708497 · Cited by 48
Privacy-preserving security of IoT networks: A comparative analysis of methods and applications
Wakili, A., & Bakkali, S. (2025) · Cyber Security and Applications · doi:10.1016/j.csa.2025.100084 · Cited by 30
The University of North Carolina at Charlotte, Zhou, L., Rudin, C., Duke University, Gombolay, M., Georgia Institute of Technology, Spohrer, J., International Society of Service Innovation Professionals, Zhou, M., Juji, et al. (2023) · AIS Transactions on Human-Computer Interaction · doi:10.17705/1thci.00085 · Cited by 20
Self-citationSimClone: Detecting Tabular Data Clones Using Value Similarity
Yang, X., Rajbahadur, G. K., Lin, D., Wang, S., & Jiang, Z. M. (. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3676961 · Cited by 3
Metadata
- Authors
- Zhou, L., Pan, S., Wang, J., & Vasilakos, A. V.
- Venue
- Neurocomputing
- Publisher
- Elsevier BV
- Published
- 2017-05
- Volume
- 237
- Pages
- 350-361
- ISSN
- 0925-2312 (ISSN-L)
- OpenAlex
- W2576683119
- Cited by
- 1,228
- References
- 90
- FWCI
- 117.74
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- www.elsevier.com/open-access/userlicense/1.0/ (am, 309 d)
- doi.org/10.15223/policy-017 (stm-asf)
- doi.org/10.15223/policy-037 (stm-asf)
- doi.org/10.15223/policy-012 (stm-asf)
- doi.org/10.15223/policy-029 (stm-asf)
- doi.org/10.15223/policy-004 (stm-asf)
- Funders
- National Science Foundation (1527684)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.