The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Efficient Machine Learning for Big Data: A Review
Open accessAbstract
With the emerging technologies and all associated devices, it is predicted that massive amount of data will be created in the next few years - in fact, as much as 90% of current data were created in the last couple of years - a trend that will continue for the foreseeable future. Sustainable computing studies the process by which computer engineer/scientist designs computers and associated subsystems efficiently and effectively with minimal impact on the environment. However, current intelligent machine-learning systems are performance driven - the focus is on the predictive/classification accuracy, based on known properties learned from the training samples. For instance, most machine-learning-based nonparametric models are known to require high computational cost in order to find the global optima. With the learning task in a large dataset, the number of hidden nodes within the network will therefore increase significantly, which eventually leads to an exponential rise in computational complexity. This paper thus reviews the theoretical and experimental data-modeling literature, in large-scale data-intensive fields, relating to: (1) model efficiency, including computational requirements in learning, and data-intensive areas' structure and design, and introduces (2) new algorithmic approaches with the least memory requirements and processing to minimize computational cost, while maintaining/improving its predictive/classification accuracy and stability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
(2012) · Cited by 9,062
Wolpert, D. H. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80023-1 · Cited by 7,951
Vector Quantization and Signal Compression
Gersho, A., & Gray, R. M. (1992) · Springer eBooks · doi:10.1007/978-1-4615-3626-0 · Cited by 7,003
Data-intensive applications, challenges, techniques and technologies: A survey on Big Data
Philip Chen, C. L., & Zhang, C.-Y. (2014) · Information Sciences · doi:10.1016/j.ins.2014.01.015 · Cited by 3,047
Traffic Flow Prediction With Big Data: A Deep Learning Approach
Lv, Y., Duan, Y., Kang, W., Li, Z., & Wang, F.-Y. (2014) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2014.2345663 · Cited by 3,000
Popular Ensemble Methods: An Empirical Study
Opitz, D., & Maclin, R. (1999) · Journal of Artificial Intelligence Research · doi:10.1613/jair.614 · Cited by 2,953
Ensemble based systems in decision making
Polikar, R. (2006) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2006.1688199 · Cited by 2,938
Dryad: distributed data-parallel programs from sequential building blocks
Isard, M., Budiu, M., Yu, Y., Birrell, A., & Fetterly, D. (2007) · Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007 · doi:10.1145/1272996.1273005 · Cited by 2,432
Training linear SVMs in linear time
Joachims, T. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150429 · Cited by 1,920
2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
(2001) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition CVPR 2001 CVPR-01 · doi:10.1109/cvpr.2001.990916 · Cited by 1,876
Building high-level features using large scale unsupervised learning
Le, Q. V. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639343 · Cited by 1,695
Big data deep learning: Challenges and perspectives
Chen, X.-W., & Lin, X. (2014) · IEEE Access · doi:10.1109/access.2014.2325029 · Cited by 1,255
SVM-KNN: Discriminative Nearest Neighbor Classification for Visual Category Recognition
Zhang, H., Berg, A. C., Maire, M., & Malik, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.301 · Cited by 1,114
On optimization methods for deep learning
Ngiam, J., Coates, A., Lahiri, A., Prochnow, B., Le, Q. V., & Ng, A. Y. (2011) · International Conference on Machine Learning · Cited by 1,076
Proceedings of Interspeech 2013
Lu, L., Ghoshal, A. K., & Renals, S. J. (2013) · Proceedings - International Symposium on Computer Architecture/Proceedings · Cited by 1,003
A tutorial survey of architectures, algorithms, and applications for deep learning
Deng, L. (2014) · APSIPA Transactions on Signal and Information Processing · doi:10.1017/atsip.2013.9 · Cited by 725
Bottou, L., & Vapnik, V. (1992) · Neural Computation · doi:10.1162/neco.1992.4.6.888 · Cited by 542
A Review of Ensemble Methods in Bioinformatics
Yang, P., Hwa Yang, Y., B. Zhou, B., & Y. Zomaya, A. (2010) · Current Bioinformatics · doi:10.2174/157489310794072508 · Cited by 503
The Data Deluge: An e‐Science Perspective
Hey, T., & Trefethen, A. (2003) · Grid Computing · doi:10.1002/0470867167.ch36 · Cited by 495
for the Dark Energy Survey Collaboration: Fermilab, U. O. I. A. U.-C., & Flaugher, B. (2005) · International Journal of Modern Physics A · doi:10.1142/s0217751x05025917 · Cited by 389
Piccolo: building fast, distributed programs with partitioned tables
Power, R., & Li, J. (2010) · doi:10.5555/1924943.1924964 · Cited by 252
Advances in intelligent data analysis
Hand, D. J., Fisher, D. H., & Berthold, M. R. (2000) · Intelligent Data Analysis · doi:10.3233/ida-2000-4201 · Cited by 222
2015 IEEE International Conference on Big Data (Big Data)
(2015) · doi:10.1109/bigdata36572.2015 · Cited by 175
Margony, B. (1999) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.1999.0316 · Cited by 157
Deep convex net: a scalable architecture for speech pattern classification
Deng, L., & Yu, D. (2011) · Interspeech (USB) · doi:10.21437/interspeech.2011-607 · Cited by 152
2014 IEEE International Conference on Data Mining Workshop
(2014) · doi:10.1109/icdmw34473.2014 · Cited by 126
Local prediction of non-linear time series using support vector regression
Lau, K. W., & Wu, Q. (2007) · Pattern Recognition · doi:10.1016/j.patcog.2007.08.013 · Cited by 111
Efficient Algorithm for Localized Support Vector Machine
Cheng, H., Tan, P., & Jin, R. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.116 · Cited by 98
Large-Scale Deep Belief Nets With MapReduce
Zhang, K., & Chen, X. (2014) · IEEE Access · doi:10.1109/access.2014.2319813 · Cited by 60
A scalable machine learning online service for big data real-time analysis
Baldominos, A., Albacete, E., Sáez, Y., & Isasi, P. (2014) · IEEE Symposium on Computational Intelligence in Big Data (CIBD) · doi:10.1109/cibd.2014.7011537 · Cited by 59
Local Machine Learning Models for Spatial Data Analysis
Gilardi, N., & Samy Bengio, A. (2000) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 50
Big Data Stream Learning with SAMOA
Bifet, A., & Morales, G. D. F. (2014) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2014.24 · Cited by 45
Yoo, P. D., Sikder, A. R., Taheri, J., Zhou, B. B., & Zomaya, A. Y. (2008) · IEEE Transactions on NanoBioscience · doi:10.1109/tnb.2008.2000747 · Cited by 33
Self-citationBig data machine learning and graph analytics: Current state and future challenges
Huang, H. H., & Liu, H. (2014) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2014.7004471 · Cited by 29
Towards Big Data Bayesian Network Learning - An Ensemble Learning Based Approach
Tang, Y., Wang, Y., Cooper, K., & Li, L. (2014) · IEEE International Congress on Big Data (BigData Congress) · doi:10.1109/bigdata.congress.2014.58 · Cited by 27
Yoo, P. D., Ho, Y. S., Zhou, B. B., & Zomaya, A. Y. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-272 · Cited by 27
Self-citationData mining approaches for life cycle assessment
Sundaravaradan, N., Marwah, M., Shah, A. J., & Ramakrishnan, N. (2011) · IEEE International Symposium on Sustainable Systems and Technology · doi:10.1109/issst.2011.5936863 · Cited by 21
Using Data Mining to Help Design Sustainable Products
Marwah, M., Shah, A. J., Bash, C. E., Patel, C. D., & Ramakrishnan, N. (2011) · Computer · doi:10.1109/mc.2011.257 · Cited by 18
McPherson, A. M., Born, A. J., Sutherland, W. J., Emerson, J., Little, B., Jeffers, P. F., Stewart, M., Murray, J., & Ward, K. (2006) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.671352 · Cited by 14
Discovering Life Cycle Assessment Trees from Impact Factor Databases
Sundaravaradan, N., Patnaik, D., Ramakrishnan, N., Marwah, M., & Shah, A. J. (2011) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v25i1.7805 · Cited by 12
An Energy-Efficient Kernel Framework for Large-Scale Data Modeling and Classification
Yoo, P. D., Ng, J., & Zomaya, A. Y. (2011) · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · doi:10.1109/ipdps.2011.178 · Cited by 5
Self-citation
Cited by
Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372873 · Cited by 2,245
“With the increased access to artificial intelligence (AI) development tools and Internet-sourced datasets, corporations, nonprofits and governments are deploying AI systems at an unprecedented pace, often in massive-scale production systems impacting millions if not billions of users [1].”
BackgroundMachine learning with big data: challenges and approaches.
L'Heureux, A., Grolinger, K., Elyamany, H. F., & Capretz, M. A. M. (2017) · IEEE Access · doi:10.1109/access.2017.2696365 · Cited by 1,023
Machine Learning: New Ideas and Tools in Environmental Science and Engineering
Zhong, S., Zhang, K., Bagheri, M., Burken, J. G., Gu, A., Li, B., Ma, X., Marrone, B. L., Ren, Z. J., Schrier, J., et al. (2021) · Environmental Science & Technology · doi:10.1021/acs.est.1c01339 · Cited by 945
Deep Learning for Time Series Forecasting: A Survey
Torres, J. F., Hadjout, D., Sebaa, A., Martínez-Álvarez, F., & Troncoso, A. (2021) · Big Data · doi:10.1089/big.2020.0159 · Cited by 818
Sharma, R., Kamble, S. S., Gunasekaran, A., Kumar, V., & Kumar, A. (2020) · Computers & Operations Research · doi:10.1016/j.cor.2020.104926 · Cited by 766
Metadata
- Authors
- Al-Jarrah, O. Y., Yoo, P. D., Muhaidat, S., Karagiannidis, G. K., & Taha, K.
- Venue
- Big Data Research
- Publisher
- Elsevier BV
- Published
- 2015-09
- Volume
- 2
- Issue
- 3
- Pages
- 87-93
- ISSN
- 2214-5796 (ISSN-L)
- OpenAlex
- W2072750586
- Cited by
- 647
- References
- 47
- FWCI
- 39.73
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.