The DOI matches its Crossref record; 90 of the 90 references it cites were found in a registry or an index.
Machine learning on big data: Opportunities and challenges
Open accessAbstract
Machine learning (ML) is continuously unleashing its power in a wide range of applications. It has been pushed to the forefront in recent years partly owing to the advent of big data. ML algorithms have never been better promised while challenged by big data. Big data enables ML algorithms to uncover more fine-grained patterns and make more timely and accurate predictions than ever before; on the other hand, it presents major challenges to ML such as model scalability and distributed computing. In this paper, we introduce a framework of ML on big data (MLBiD) to guide the discussion of its opportunities and challenges. The framework is centered on ML which follows the phases of preprocessing, learning, and evaluation. In addition, the framework is also comprised of four other components, namely big data, user, domain, and system. The phases of ML and the components of MLBiD provide directions for identification of associated opportunities and challenges and open up future work in many unexplored or under explored research areas.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
(2016) · Cited by 11,679
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Artificial intelligence: A modern approach
Nilsson, N. J. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(96)00007-0 · Cited by 10,583
Machine learning: Trends, perspectives, and prospects
Jordan, M. I., & Mitchell, T. M. (2015) · Science · doi:10.1126/science.aaa8415 · Cited by 9,955
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795
(2010) · Cited by 4,411
Research works printed but not linked: 20
- Y.Z.Y.-M.Cheung, Discretizing Numerical Attributes in Decision Tree for Big Data Analysis, in: Proceedings of the 2014 IEEE International Conference on Data Mining Workshop (ICDMW), 2014.
- Nguyen-Dinh, 2013, Combining crowd-generated media and personal data: semi-supervised learning for context recognition, Proc. 1st ACM Int. Workshop Pers. data meets Distrib. Multimed., 35, 10.1145/2509352.2509396 · doi:10.1145/2509352.2509396
- Su, 2014, Effective and efficient data sampling using bitmap indices, Clust. Comput., 17, 1081, 10.1007/s10586-014-0360-5 · doi:10.1007/s10586-014-0360-5
- T.Yang, Q.Lin, R.Jin, Big data analytics: Optimization and randomization, in: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2015, pp. 2327–2327. · doi:10.1145/2783258.2789989
- Yue, 2017, A data-intensive approach for discovering user similarities in social behavioral interactions based on the bayesian network, Neurocomputing, 219, 364, 10.1016/j.neucom.2016.09.042 · doi:10.1016/j.neucom.2016.09.042
- Borkar, 2012, Declarative systems for large-scale machine learning, IEEE Data Eng. Bull., 35, 24
- Theano Development Team, Theano: A Python framework for fast computation of mathematical expression. Available: arXiv:1605.02688. · arXiv
- P.Domingos, G.Hulten, A General Method for Scaling Up Machine Learning Algorithms and its Application to Clustering, presented at Proceedings of the Eighteenth International Conference on Machine Learning, 2001, pp. 106–113.
- K.L.C.Zhu, M.Savvides, Distributed class dependent feature analysis — A big data approach, in: proceedings of the 2014 IEEE International Conference on Big Data, 2014.
- Yui, 2013, A database-Hadoop hybrid approach to Scalable machine learning, IEEE Int. Congr. Big Data (BigData Congr.), 1
- L.Bagheri, H.Goote, A.Hasan, G.Hazard, Risk adjustment of patient expenditures: A big data analytics approach, in Proceedings of the 2013 IEEE International Conference on Big Data, 2013.
- Krizhevsky, 2012, Imagen. Classif. Deep convolutional Neural Netw.
- Deng, 2009, Construction and analysis of a large scale image ontology, Vis. Sci. Soc., 1
- E.Bortnikov, A.Frank, E.Hillel, S.Rao, Predicting execution bottlenecks in map-reduce clusters, in: Proceedings of the 4th USENIX conference on Hot Topics in Cloud Ccomputing, 2012, pp. 18–18.
- Kashyap, 2015, Big Data Anal. Bioinforma.: A Mach. Learn. Perspect.
- J.Xu, C.Tekin, M.van der Schaar, Learning optimal classifier chains for real-time big data mining, in Proceedings 51st Annu. Allerton Conference Comm., Control and Comput. (Allerton'13), 2013.
- G.De Francisci Morales, SAMOA: a platform for mining big data streams, in: Proceedings of the 22nd International Conference on World Wide Web, 2013, pp. 777–778. · doi:10.1145/2487788.2488042
- Q.Yang, Big data, lifelong machine learning and transfer learning, in: Proceedings of the sixth ACM international conference on Web search and data mining, 2013, pp. 505–506. · doi:10.1145/2433396.2433459
- Wang, 2012, Breaking the curse of kernelization: budgeted stochastic gradient descent for large-scale SVM training, The J. Mach. Learn. Res., 13, 3103
- Armes, M, 2013, Using Big data and predictive machine learning in aerospace test environments, IEEE Autotestcon
Cited by
Literature review of Industry 4.0 and related technologies
Oztemel, E., & Gursev, S. (2020) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-018-1433-8 · Cited by 2,143
Digital twin: values, challenges and enablers from a modeling perspective
Rasheed, A., San, O., & Kvamsdal, T. (2020) · IEEE Access · doi:10.1109/access.2020.2970143 · Cited by 1,952
Review of Image Classification Algorithms Based on Convolutional Neural Networks
Chen, L., Li, S., Bai, Q., Yang, J., Jiang, S., & Miao, Y. (2021) · Remote Sensing · doi:10.3390/rs13224712 · Cited by 789
Ahmad, T., Madonski, R., Zhang, D., Huang, C., & Mujeeb, A. (2022) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2022.112128 · Cited by 711
A survey towards an integration of big data analytics to big insights for value-creation
Saggi, M. K., & Jain, S. (2018) · Information Processing & Management · doi:10.1016/j.ipm.2018.01.010 · Cited by 494
Metadata
- Authors
- Zhou, L., Pan, S., Wang, J., & Vasilakos, A. V.
- Venue
- Neurocomputing
- Publisher
- Elsevier BV
- Published
- 2017-05
- Volume
- 237
- Pages
- 350-361
- ISSN
- 0925-2312 (ISSN-L)
- OpenAlex
- W2576683119
- Cited by
- 1,228
- References
- 90
- FWCI
- 117.74
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- www.elsevier.com/open-access/userlicense/1.0/ (am, 309 d)
- doi.org/10.15223/policy-017 (stm-asf)
- doi.org/10.15223/policy-037 (stm-asf)
- doi.org/10.15223/policy-012 (stm-asf)
- doi.org/10.15223/policy-029 (stm-asf)
- doi.org/10.15223/policy-004 (stm-asf)
- Funders
- National Science Foundation (1527684)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Machine learning on big data: Opportunities and challenges. https://app.cochat.ai/papers/10.1016/j.neucom.2017.01.026
- The paper
- Zhou, L., Pan, S., Wang, J., & Vasilakos, A. V. (2017). Machine learning on big data: Opportunities and challenges. Neurocomputing. https://doi.org/10.1016/j.neucom.2017.01.026
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.