Machine learning with big data: challenges and approaches.
Open accessThe DOI matches its Crossref record; 108 of the 109 references it cites were found in a registry or an index.
Abstract
The Big Data revolution promises to transform how we live, work, and think by enabling process optimization, empowering insight discovery and improving decision making. The realization of this grand potential relies on the ability to extract value from such massive data through data analytics; machine learning is at its core because of its ability to learn from data and provide data driven insights, decisions, and predictions. However, traditional machine learning approaches were developed in a different era, and thus are based upon multiple assumptions, such as the data set fitting entirely into memory, what unfortunately no longer holds true in this new context. These broken assumptions, together with the Big Data characteristics, are creating obstacles for the traditional techniques. Consequently, this paper compiles, summarizes, and organizes machine learning challenges with Big Data. In contrast to other research that discusses challenges, this work highlights the cause–effect relationship by organizing challenges according to Big Data Vs or dimensions that instigated the issue: volume, velocity, variety, or veracity. Moreover, emerging machine learning approaches and techniques are discussed in terms of how they are capable of handling the various challenges with the ultimate objective of helping practitioners select appropriate solutions for their use cases. Finally, a matrix relating the challenges and approaches is presented. Through this process, this paper provides a perspective on the domain, identifies research gaps and opportunities, and provides a strong foundation and encouragement for further research in the field of machine learning with Big Data.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, training these models requires large, diverse, and well-labeled datasets [94].”
From A Review of Passenger Counting in Public Transport Concepts with Solution Proposal Based on Image Processing and Machine Learning (2024) · cites this paper as [94]
In the citing paper
“it is also shifting from a single domain (e.g., domain expertise, or expert systems) to a cross-disciplinary approach through collaboration”
From Challenges and Future Directions of Big Data and Artificial Intelligence in Education (2020) · cites this paper as L’heureux et al., 2017
Citations
Cites
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750 · cited 1×
“However, at the moment, they support a limited number of algorithms compared to the R language [73], MATLAB [74], or Weka [75].”
MethodRepresentation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Ensemble methods in machine learning
Dietterich, T. G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45014-9_1 · Cited by 8,408
(2011) · Cited by 5,203
Multiple comparisons among means
Dunn, O. J. (1961) · Journal of the American Statistical Association · doi:10.1080/01621459.1961.10482090 · Cited by 5,006
The Hadoop Distributed File System
Shvachko, K., Kuang, H., Radia, S., & Chansler, R. (2010) · 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST) · doi:10.1109/msst.2010.5496972 · Cited by 4,834
Han, S., Mao, H., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1510.00149 · Cited by 4,662
(2010) · Cited by 4,411
Beyond the hype: Big data concepts, methods, and analytics
Gandomi, A., & Haider, M. (2015) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2014.10.007 · Cited by 4,226
A Review of Image Denoising Algorithms, with a New One
Buades, A., Coll, B., & Morel, J. M. (2005) · Multiscale Modeling & Simulation · doi:10.1137/040616024 · Cited by 4,083
A survey on concept drift adaptation
Gama, J., Žliobaitė, I., Bifet, A., Pechenizkiy, M., & Bouchachia, A. (2014) · ACM Computing Surveys · doi:10.1145/2523813 · Cited by 3,735
Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing
Zaharia, M., Chowdhury, M., Das, T., Dave, A., Ma, J. H., McCauley, M., Franklin, M. J. M., Shenker, S. J., & Stoica, I. G. (2012) · Cited by 3,622
Pregel: a system for large-scale graph processing
Malewicz, G., Austern, M. H., Bik, A. J. C., Dehnert, J. C., Horn, I., Leiser, N., & Czajkowski, G. (2010) · Proceedings of the 2010 ACM SIGMOD International Conference on Management of data · doi:10.1145/1807167.1807184 · Cited by 3,515
A few useful things to know about machine learning
Domingos, P. (2012) · Communications of the ACM · doi:10.1145/2347736.2347755 · Cited by 3,326 · cited 3×
“Variance describes the consistency of a learner’s ability to predict random things, whereas bias describes the ability of a learner to learn the wrong thing [37].”
BackgroundInfluentialThe class imbalance problem: A systematic study1
Japkowicz, N., & Stephen, S. (2002) · Intelligent Data Analysis · doi:10.3233/ida-2002-6504 · Cited by 3,295
Data-intensive applications, challenges, techniques and technologies: A survey on Big Data
Philip Chen, C. L., & Zhang, C.-Y. (2014) · Information Sciences · doi:10.1016/j.ins.2014.01.015 · Cited by 3,047
Big data analytics in healthcare: promise and potential
Raghupathi, W., & Raghupathi, V. (2014) · Health Information Science and Systems · doi:10.1186/2047-2501-2-3 · Cited by 3,034
MapReduce: Simplified Data Processing on Large Cluster
Senior Software Developer, A. U., & Dayalan, M. (2018) · International Journal of Research and Engineering · doi:10.21276/ijre.2018.5.5.4 · Cited by 2,948
On the mean accuracy of statistical pattern recognizers
Hughes, G. (1968) · IEEE Transactions on Information Theory · doi:10.1109/tit.1968.1054102 · Cited by 2,859
Deep learning applications and challenges in big data analytics
Najafabadi, M. M., Villanustre, F., Khoshgoftaar, T. M., Seliya, N., Wald, R., & Muharemagic, E. (2015) · Journal of Big Data · doi:10.1186/s40537-014-0007-7 · Cited by 2,594
Wu, X., Zhu, X., Wu, G.-Q., & Ding, W. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2013.109 · Cited by 2,410
Probabilistic machine learning and artificial intelligence
Ghahramani, Z. (2015) · Nature · doi:10.1038/nature14541 · Cited by 1,995
Salakhutdinov, R., & Hinton, G. E. (2009) · International Conference on Artificial Intelligence and Statistics · Cited by 1,890
Big data: a revolution that will transform how we live, work, and think
Armstrong, K. (2014) · Information, Communication & Society · doi:10.1080/1369118x.2014.923482 · Cited by 1,629
Challenges of Big Data analysis
Fan, J., Han, F., & Liu, H. (2014) · National Science Review · doi:10.1093/nsr/nwt032 · Cited by 1,482
Pegasos: primal estimated sub-gradient solver for SVM
Shalev-Shwartz, S., Singer, Y., Srebro, N., & Cotter, A. (2011) · Mathematical Programming · doi:10.1007/s10107-010-0420-4 · Cited by 1,477
The elements of statistical learning: Data mining, inference, and prediction
Franklin, J. (2005) · The Mathematical Intelligencer · doi:10.1007/bf02985802 · Cited by 1,400 · cited 1×
“Regularization refers to techniques that aim to improve generalization and reduce overfitting; examples of regularization techniques include early stopping, Lasso, and Ridge [46].”
Random projection in dimensionality reduction: applications to image and text data
Bingham, E., & Mannila, H. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502546 · Cited by 1,274
Big data deep learning: Challenges and perspectives
Chen, X.-W., & Lin, X. (2014) · IEEE Access · doi:10.1109/access.2014.2325029 · Cited by 1,255
(1998) · Springer eBooks · doi:10.1007/978-1-4615-5529-2 · Cited by 1,235
Map-Reduce for Machine Learning on Multicore
Chu, C.-T., Kim, S. K., Lin, Y.-A., Yu, Y., Bradski, G., Ng, A. Y., & Olukotun, K. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0040 · Cited by 1,229
Challenges and opportunities with big data
Labrinidis, A., & Jagadish, H. V. (2012) · Proceedings of the VLDB Endowment · doi:10.14778/2367502.2367572 · Cited by 1,070
Leskovec, J., Rajaraman, A., & Ullman, J. D. (2014) · Cambridge University Press eBooks · doi:10.1017/cbo9781139924801 · Cited by 1,069
Big data and its technical challenges.
Jagadish, H. V., Gehrke, J., Labrinidis, A., Papakonstantinou, Y., Patel, J. M., Ramakrishnan, R., & Shahabi, C. (2014) · Communications of the ACM · doi:10.1145/2611567 · Cited by 1,048
The Quantified Self: Fundamental Disruption in Big Data Science and Biological Discovery
Swan, M. (2013) · Big Data · doi:10.1089/big.2012.0002 · Cited by 931
The problem of concept drift: definitions and related work
Tsymbal, A. (2004) · Cited by 929
Core Vector Machines: Fast SVM Training on Very Large Data Sets
Tsang, I. W.-H., Kwok, J. T.-Y., & Cheung, P.-M. (2005) · doi:10.5555/1046920.1058114 · Cited by 928
S4: Distributed Stream Computing Platform
Neumeyer, L., Robbins, B., Nair, A., & Kesari, A. (2010) · 2010 IEEE International Conference on Data Mining Workshops · doi:10.1109/icdmw.2010.172 · Cited by 900
A survey of machine learning for big data processing
Qiu, J., Wu, Q., Ding, G., Xu, Y., & Feng, S. (2016) · EURASIP Journal on Advances in Signal Processing · doi:10.1186/s13634-016-0355-x · Cited by 894
Processing flows of information: From data stream to complex event processing
Cugola, G., & Margara, A. (2012) · ACM Computing Surveys · doi:10.1145/2187671.2187677 · Cited by 833
Twister: a runtime for iterative MapReduce
Ekanayake, J., Li, H., Zhang, B., Gunarathne, T., Bae, S.-H., Qiu, J., & Fox, G. (2010) · Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing · doi:10.1145/1851476.1851593 · Cited by 777
HaLoop: efficient iterative data processing on large clusters
Bu, Y., Howe, B., Balazinska, M., & Ernst, M. D. (2010) · Proceedings of the VLDB Endowment · doi:10.14778/1920841.1920881 · Cited by 693
Mining big data: current status, and forecast to the future
Fan, W., & Bifet, A. (2013) · ACM SIGKDD Explorations Newsletter · doi:10.1145/2481244.2481246 · Cited by 677
Efficient Machine Learning for Big Data: A Review
Al-Jarrah, O. Y., Yoo, P. D., Muhaidat, S., Karagiannidis, G. K., & Taha, K. (2015) · Big Data Research · doi:10.1016/j.bdr.2015.04.001 · Cited by 647
Bottou, L., & Vapnik, V. (1992) · Neural Computation · doi:10.1162/neco.1992.4.6.888 · Cited by 542
Addressing big data issues in Scientific Data Infrastructure
Demchenko, Y., Grosso, P., de Laat, C., & Membrey, P. (2013) · 2013 International Conference on Collaboration Technologies and Systems (CTS) · doi:10.1109/cts.2013.6567203 · Cited by 491
Machine Learning Paradigms for Speech Recognition: An Overview
Deng, L., & Li, X. (2013) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2013.2244083 · Cited by 456
Methodologies for Cross-Domain Data Fusion: An Overview
Zheng, Y. (2015) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2015.2465959 · Cited by 454
A survey on platforms for big data analytics
Singh, D., & Reddy, C. K. (2015) · Journal of Big Data · doi:10.1186/s40537-014-0008-6 · Cited by 433
Incremental learning for ν-Support Vector Regression
Gu, B., Sheng, V. S., Wang, Z., Ho, D., Osman, S., & Li, S. (2015) · Neural Networks · doi:10.1016/j.neunet.2015.03.013 · Cited by 424
Fusion of Support Vector Machines for Classification of Multisensor Data
Waske, B., & Benediktsson, J. A. (2007) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2007.898446 · Cited by 393
Petuum: A New Platform for Distributed Machine Learning on Big Data
Xing, E. P., Ho, Q., Dai, W., Kim, J. K., Wei, J., Lee, S., Zheng, X., Xie, P., Kumar, A., & Yu, Y. (2015) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2015.2472014 · Cited by 388
The Deluge of Spurious Correlations in Big Data
Calude, C. S., & Longo, G. (2017) · Foundations of Science · doi:10.1007/s10699-016-9489-4 · Cited by 385
Suthaharan, S. (2014) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/2627534.2627557 · Cited by 319
Data management in cloud environments: NoSQL and NewSQL data stores
Grolinger, K., Higashino, W. A., Tiwari, A., & Capretz, M. A. (2013) · Journal of Cloud Computing: Advances, Systems and Applications · doi:10.1186/2192-113x-2-22 · Cited by 318
Self-citation(2013) · Cited by 290
Seven V's of Big Data understanding Big Data to extract value
Khan, M. A.-U.-D., Uddin, M. F., & Gupta, N. (2014) · Proceedings of the 2014 Zone 1 Conference of the American Society for Engineering Education · doi:10.1109/aseezone1.2014.6820689 · Cited by 290
Electric Load Forecasting Based on Locally Weighted Support Vector Regression
Elattar, E. E., Goulermas, J., & Wu, Q. H. (2010) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2010.2040176 · Cited by 266
Data Provenance: Some Basic Issues
Buneman, P., Khanna, S., & Tan, W.-C. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-44450-5_6 · Cited by 242
A comparative assessment of classification methods
Kiang, M. Y. (2003) · Decision Support Systems · doi:10.1016/s0167-9236(02)00110-0 · Cited by 237
Instance Selection and Construction for Data Mining
(2001) · Springer eBooks · doi:10.1007/978-1-4757-3359-4 · Cited by 216
(2010) · IGI Global eBooks · doi:10.4018/978-1-60566-766-9 · Cited by 204
The anatomy of big data computing
Kune, R., Konugurthi, P. K., Agarwal, A., Chillarige, R. R., & Buyya, R. (2016) · Software: Practice and Experience · doi:10.1002/spe.2374 · Cited by 195
A Unifeid Bias-Variance Decomposition and its Applications
Domingos, P. (2000) · International Conference on Machine Learning · Cited by 167
Energy Forecasting for Event Venues: Big Data and Prediction Accuracy
Grolinger, K., L’Heureux, A., Capretz, M. A. M., & Seewald, L. (2016) · Energy and Buildings · doi:10.1016/j.enbuild.2015.12.010 · Cited by 164
Self-citationChallenges for MapReduce in Big Data
Grolinger, K., Hayes, M., Higashino, W. A., L’Heureux, A., Allison, D. S., & Capretz, M. A. M. (2014) · IEEE World Congress on Services (SERVICES) · doi:10.1109/services.2014.41 · Cited by 160
Self-citationTopic Modeling using Topics from Many Domains, Lifelong Learning and Big Data
Chen, Z., & Liu, B. (2014) · International Conference on Machine Learning · Cited by 156
Ensemble of subset online sequential extreme learning machine for class imbalance and concept drift
Mirza, B., Lin, Z., & Liu, N. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.03.075 · Cited by 155
SAMOA: scalable advanced massive online analysis
Morales, G. D. F., & Bifet, A. (2015) · Cited by 148
Ohlhorst, F. (2012) · Wiley eBooks · doi:10.1002/9781119205005 · Cited by 134
Lipovetsky, S. (2022) · Technometrics · doi:10.1080/00401706.2021.2020521 · Cited by 126
Le, Q. V. (2015) · Cited by 110
Big data provenance: Challenges, state of the art and opportunities
Wang, J., Crawl, D. L., Purawat, S., Nguyen, M., & Altıntaş, İ. (2015) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2015.7364047 · Cited by 100
Lovelace, R., Birkin, M. H., Cross, P., & Clarke, M. (2015) · Geographical Analysis · doi:10.1111/gean.12081 · Cited by 72
RAMP: a system for capturing and tracing provenance in MapReduce workflows
Park, H.-J., Ikeda, R., & Widom, J. (2011) · Proceedings of the VLDB Endowment · doi:10.14778/3402755.3402768 · Cited by 71
Learning classifiers when the training data is not IID
Dündar, M., Krishnapuram, B., Bi, J., & Rao, R. B. (2007) · Cited by 70
SocialHelix: visual analysis of sentiment divergence in social media
Cao, N., Lu, L., Lin, Y., Wang, F., & Wen, Z. (2014) · Journal of Visualization · doi:10.1007/s12650-014-0246-x · Cited by 68
A review on real time data stream classification and adapting to various concept drift scenarios
Dongre, P. B., & Malik, L. (2014) · IEEE International Advance Computing Conference · doi:10.1109/iadcc.2014.6779381 · Cited by 65
Comparative study between incremental and ensemble learning on data streams: Case study
Zang, W., Zhang, P., Zhou, C. D., & Guo, L. (2014) · Journal Of Big Data · doi:10.1186/2196-1115-1-5 · Cited by 64
Gruber, S., Logan, R. W., Jarrín, I., Monge, S., & Hernán, M. A. (2015) · Statistics in Medicine · doi:10.1002/sim.6322 · Cited by 64
Ghoting, A., Kambadur, P., Pednault, E., & Kannan, R. (2011) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2020408.2020464 · Cited by 61
Grolinger, K., Capretz, M. A. M., & Seewald, L. (2016) · IEEE International Congress on Big Data (BigData Congress) · doi:10.1109/bigdatacongress.2016.27 · Cited by 61
Self-citationA Scalable High Throughput Firewall in FPGA
Jedhe, G., Ramamoorthy, A., & Varghese, K. (2008) · IEEE International Symposium on Field-Programmable Custom Computing Machines (FCCM) · doi:10.1109/fccm.2008.31 · Cited by 58
Geng, X., & Smith‐Miles, K. (2009) · Encyclopedia of Biometrics · doi:10.1007/978-0-387-73003-5_304 · Cited by 45
Unexpected challenges in large scale machine learning
Parker, C. (2012) · International Workshop on Big Data, Streams and Heterogeneous Source Mining: Algorithms, Systems, Programming Models and Applications (BigMine) · doi:10.1145/2351316.2351317 · Cited by 37
Deep learning in partially-labeled data streams
Read, J., Pérez‐Cruz, F., & Bifet, A. (2015) · ACM Symposium on Applied Computing · doi:10.1145/2695664.2695871 · Cited by 36
DeepQA Jeopardy! Gamification: A Machine-Learning Perspective
Baughman, A. K., Chuang, W. T., Dixon, K. R., Benz, Z., & Basilico, J. (2014) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2013.2285651 · Cited by 31
Hinton, G. E. (2014) · Springer eBooks · doi:10.1007/978-1-4899-7502-7_67-1 · Cited by 25
A Brief Primer on Probability DistributionsPreprint
Pfeifer, P. E. (2008) · SSRN Electronic Journal · doi:10.2139/ssrn.1283434 · Cited by 23
Random Local SVMs for Classifying Large Datasets
Do, T., & Poulet, F. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-26135-5_1 · Cited by 23
A Survey of Data Stream Processing Tools
Gorawski, M., Gorawska, A., & Pasterak, K. (2014) · Springer eBooks · doi:10.1007/978-3-319-09465-6_31 · Cited by 21
Transfer learning algorithms for autonomous reconfiguration of wearable systems
Saeedi, R., Ghasemzadeh, H. G., & Gebremedhin, A. H. (2016) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2016.7840648 · Cited by 20
Local Learning vs. Global Learning: An Introduction to Maxi-Min Margin Machine
Huang, K., Yang, H., King, I., & Lyu, M. R.-T. (2005) · Studies in fuzziness and soft computing · doi:10.1007/10984697_5 · Cited by 19
An Effective Integrated Method for Learning Big Imbalanced Data
Ghanavati, M., Wong, R. K., Chen, F., Wang, Y., & Perng, C.-S. (2014) · IEEE International Congress on Big Data (BigData Congress) · doi:10.1109/bigdata.congress.2014.102 · Cited by 18
Hone: "Scaling down" Hadoop on shared-memory systems
Kumar, K. A., Gluck, J., Deshpande, A., & Lin, J. (2013) · Proceedings of the VLDB Endowment · doi:10.14778/2536274.2536314 · Cited by 18
Big Data Open Source Platforms
de Almeida, P. D. C., & Bernardino, J. (2015) · IEEE International Congress on Big Data (BigData Congress) · doi:10.1109/bigdatacongress.2015.45 · Cited by 16
Lifelong aspect extraction from big data: knowledge engineering
Khan, M., Durrani, M. Y., Khalid, S., & Aziz, F. (2016) · Complex Adaptive Systems Modeling · doi:10.1186/s40294-016-0018-7 · Cited by 16
Narasimhan, R., & Bhuvaneshwari, T. (2014) · Cited by 16
Big-Data Streaming Applications Scheduling with Online Learning and Concept Drift Detection
Kanoun, K., & van der Schaar, M. (2015) · Design, Automation, and Test in Europe · doi:10.7873/date.2015.0786 · Cited by 13
Bayesian Network Structure Learning from Big Data: A Reservoir Sampling Based Ensemble Method
Tang, Y., Xu, Z., & Zhuang, Y. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-32055-7_18 · Cited by 10
HadoopPerceptron: a Toolkit for Distributed Perceptron Training and Prediction with MapReduce
Gesmundo, A., & Tomeh, N. (2012) · Cited by 6
Dimensional scalability of supervised and unsupervised concept drift detection: An empirical study
Lavaire, J. D. D., Singh, A., Yousef, M., Singh, S., & Yue, X. (2015) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2015.7364009 · Cited by 6
Transfer learning over big data
Yang, L., Chu, Y., Zhang, J., Xia, L., Wang, Z., & Tan, K. (2015) · International Conference on Digital Information Management · doi:10.1109/icdim.2015.7381887 · Cited by 6
Barga, R., Fontama, V., & Tok, W. H. (2015) · Apress eBooks · doi:10.1007/978-1-4842-1200-4_14 · Cited by 5
A Comparative Study of Ensemble Active Learning
Alabdulrahman, R. (2014) · uO Research (University of Ottawa) · doi:10.20381/ruor-6709 · Cited by 3
Contextual Model-Based Collaborative Filtering for Recommender Systems
Bachmann, D. (2017) · Scholarship@Western (Western University) · Cited by 2
Research works printed but not linked: 20
- goodfellow, 2016, Deep Learning
- marz, 2014, Apache Storm
- rouse, 2011, Machine Learning Definition
- 2015, R A Language and Environment for Statistical Computing, 1
- 2014, IBM Watson Ecosystem Program
- wu, 2016, Google’s neural machine translation system Bridging the gap between human and machine translation
- 2016, Machine Learning American
- 2016, Google Cloud Machine Learning
- 2016, Matlab
- 2013, Billion Devices Will Wirelessly Connect to the Internet of Everything in 2020
- krikorian, 2010, Twitter by the Numbers Twitter
- 2016, H20
- 2016, Apache Mahout
- abadi, 2016, TensorFlow Large-Scale Machine Learning on Heterogeneous Systems
- langford, 2007, Vowpal wabbit online learning project
- rouse, 2009, Predictive Analytics Definition
- sukumar, 2014, Machine learning in the big data era: Are we there yet?, Proc 20th ACM SIGKDD Conf Knowl Discovery Data Mining Workshop Data Sci Social Good (KDD), 1
- 2016, GPU Applications Transforming Computational Research and Engineering
- torrey, 2010, Handbook of Research on Machine Learning Applications and Trends
- 2016, Apache Giraph
Cited by
Machine Learning: New Ideas and Tools in Environmental Science and Engineering
Zhong, S., Zhang, K., Bagheri, M., Burken, J. G., Gu, A., Li, B., Ma, X., Marrone, B. L., Ren, Z. J., Schrier, J., et al. (2021) · Environmental Science & Technology · doi:10.1021/acs.est.1c01339 · Cited by 945
Forecasting: theory and practice
Petropoulos, F., Apiletti, D., Assimakopoulos, V., Babai, M. Z., Barrow, D. K., Ben Taieb, S., Bergmeir, C., Bessa, R. J., Bijak, J., Boylan, J. E., et al. (2022) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2021.11.001 · Cited by 921
Modeling and forecasting building energy consumption: A review of data-driven techniques
Bourdeau, M., Zhai, X. Q., Nefzaoui, E., Guo, X., & Chatellier, P. (2019) · Sustainable Cities and Society · doi:10.1016/j.scs.2019.101533 · Cited by 792
Age of Information: A New Concept, Metric, and Tool
Kosta, A., Παππάς, Ν., & Angelakis, V. (2017) · Foundations and Trends® in Networking · doi:10.1561/1300000060 · Cited by 782
Challenges and Future Directions of Big Data and Artificial Intelligence in Education
Luan, H., Geczy, P., Lai, H., Gobert, J., Yang, S. J. H., Ogata, H., Baltes, J., Guerra, R., Li, P., & Tsai, C.-C. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.580820 · Cited by 667
Metadata
- Authors
- L'Heureux, A., Grolinger, K., Elyamany, H. F., & Capretz, M. A. M.
- Affiliations
- Western University (CA)
- Suez Canal University (EG)
- Venue
- IEEE Access
- Published
- 2017
- Volume
- 5
- Pages
- 7776-7797
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2609731728
- Cited by
- 1,023
- References
- 109
- Citations by year
- 2026: 50 · 2025: 175 · 2024: 128 · 2023: 145 · 2022: 130 · 2021: 138 · 2020: 105 · 2019: 88 · 2018: 53 · 2017: 11
- FWCI
- 112.99
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- NSERC CRD at Western University (477530-14)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Big Data Technologies and Applications
- Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Keywords
- big data challenges, volume, velocity, varieties, honesty, scalable learning, data-driven decision making, research gaps
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.