The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Efficient Machine Learning for Big Data: A Review
Open accessAbstract
With the emerging technologies and all associated devices, it is predicted that massive amount of data will be created in the next few years - in fact, as much as 90% of current data were created in the last couple of years - a trend that will continue for the foreseeable future. Sustainable computing studies the process by which computer engineer/scientist designs computers and associated subsystems efficiently and effectively with minimal impact on the environment. However, current intelligent machine-learning systems are performance driven - the focus is on the predictive/classification accuracy, based on known properties learned from the training samples. For instance, most machine-learning-based nonparametric models are known to require high computational cost in order to find the global optima. With the learning task in a large dataset, the number of hidden nodes within the network will therefore increase significantly, which eventually leads to an exponential rise in computational complexity. This paper thus reviews the theoretical and experimental data-modeling literature, in large-scale data-intensive fields, relating to: (1) model efficiency, including computational requirements in learning, and data-intensive areas' structure and design, and introduces (2) new algorithmic approaches with the least memory requirements and processing to minimize computational cost, while maintaining/improving its predictive/classification accuracy and stability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
(2012) · Cited by 9,062
Wolpert, D. H. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80023-1 · Cited by 7,951
Vector Quantization and Signal Compression
Gersho, A., & Gray, R. M. (1992) · Springer eBooks · doi:10.1007/978-1-4615-3626-0 · Cited by 7,003
Data-intensive applications, challenges, techniques and technologies: A survey on Big Data
Philip Chen, C. L., & Zhang, C.-Y. (2014) · Information Sciences · doi:10.1016/j.ins.2014.01.015 · Cited by 3,047
Traffic Flow Prediction With Big Data: A Deep Learning Approach
Lv, Y., Duan, Y., Kang, W., Li, Z., & Wang, F.-Y. (2014) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2014.2345663 · Cited by 3,000
Popular Ensemble Methods: An Empirical Study
Opitz, D., & Maclin, R. (1999) · Journal of Artificial Intelligence Research · doi:10.1613/jair.614 · Cited by 2,953 · cited 2×
“Recent data-modeling research has shown that ensemble methods have gained much popularity as they often perform better than individual models [28,29].”
BackgroundMethodEnsemble based systems in decision making
Polikar, R. (2006) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2006.1688199 · Cited by 2,938
Cited by
Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372873 · Cited by 2,245
“With the increased access to artificial intelligence (AI) development tools and Internet-sourced datasets, corporations, nonprofits and governments are deploying AI systems at an unprecedented pace, often in massive-scale production systems impacting millions if not billions of users [1].”
BackgroundMachine learning with big data: challenges and approaches.
L'Heureux, A., Grolinger, K., Elyamany, H. F., & Capretz, M. A. M. (2017) · IEEE Access · doi:10.1109/access.2017.2696365 · Cited by 1,023
Machine Learning: New Ideas and Tools in Environmental Science and Engineering
Zhong, S., Zhang, K., Bagheri, M., Burken, J. G., Gu, A., Li, B., Ma, X., Marrone, B. L., Ren, Z. J., Schrier, J., et al. (2021) · Environmental Science & Technology · doi:10.1021/acs.est.1c01339 · Cited by 945
Deep Learning for Time Series Forecasting: A Survey
Torres, J. F., Hadjout, D., Sebaa, A., Martínez-Álvarez, F., & Troncoso, A. (2021) · Big Data · doi:10.1089/big.2020.0159 · Cited by 818
Sharma, R., Kamble, S. S., Gunasekaran, A., Kumar, V., & Kumar, A. (2020) · Computers & Operations Research · doi:10.1016/j.cor.2020.104926 · Cited by 766
Machine Learning from Theory to Algorithms: An Overview
Alzubi, J., Nayyar, A., & Kumar, A. (2018) · Journal of Physics: Conference Series · doi:10.1088/1742-6596/1142/1/012012 · Cited by 766
State of the Art of Machine Learning Models in Energy Systems, a Systematic Review
Mosavi, A., Salimi, M., Faizollahzadeh Ardabili, S., Rabczuk, T., Shamshirband, S., & Varkonyi-Koczy, A. R. (2019) · Energies · doi:10.3390/en12071301 · Cited by 578
Cowls, J., Tsamados, A., Taddeo, M., & Floridi, L. (2023) · AI & SOCIETY · doi:10.1007/s00146-021-01294-x · Cited by 552
“In the short term, the training phase is computationally more demanding and energy intensive (Al-Jarrah et al. 2015).”
BackgroundCowls, J., Tsamados, A., Taddeo, M., & Floridi, L. (2021) · doi:10.2139/ssrn.3804983 · Cited by 552
Artificial intelligence applications in supply chain management
Pournader, M., Ghaderi, H., Hassanzadegan, A., & Fahimnia, B. (2021) · International Journal of Production Economics · doi:10.1016/j.ijpe.2021.108250 · Cited by 519
Real-time big data processing for anomaly detection: A survey
Ariyaluran Habeeb, R. A., Nasaruddin, F., Gani, A., Targio Hashem, I. A., Ahmed, E., & Imran, M. (2019) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2018.08.006 · Cited by 487
A review of deep learning with special emphasis on architectures, applications and recent trends
Sengupta, S., Basak, S., Saikia, P., Paul, S., Tsalavoutis, V., Atiah, F., Ravi, V., & Peters, A. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.105596 · Cited by 454
Intelligent welding system technologies: State-of-the-art review and perspectives
Wang, B., Hu, S. J., Sun, L., & Freiheit, T. (2020) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2020.06.020 · Cited by 425
A Survey on Security Threats and Defensive Techniques of Machine Learning: A Data Driven View
Liu, Q., Li, P., Zhao, W., Cai, W., Yu, S., & Leung, V. C. M. (2018) · IEEE Access · doi:10.1109/access.2018.2805680 · Cited by 421
Recent applications of big data analytics in railway transportation systems: A survey
Ghofrani, F., He, Q., Goverde, R. M. P., & Liu, X. (2018) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2018.03.010 · Cited by 320
Big data with cloud computing: Discussions and challenges
Sandhu, A. K. (2022) · Big Data Mining and Analytics · doi:10.26599/bdma.2021.9020016 · Cited by 280
Implications of big data analytics in developing healthcare frameworks – A review
Palanisamy, V., & Thirunavukarasu, R. (2019) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2017.12.007 · Cited by 259
Big data issues in smart grid – A review
Tu, C., He, X., Shuai, Z., & Jiang, F. (2017) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2017.05.134 · Cited by 256
Boukerche, A., Tao, Y., & Sun, P. (2020) · Computer Networks · doi:10.1016/j.comnet.2020.107484 · Cited by 215
Vivekanandan, T., & Sriman Narayana Iyengar, N. C. (2017) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2017.09.011 · Cited by 185
Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P. (2020) · arXiv · doi:10.48550/arxiv.2001.00973 · Cited by 179
Digital Twin of City: Concept Overview
Ivanov, S., Nikolskaya, K., Radchenko, G., Sokolinsky, L., & Zymbler, M. (2020) · 2020 Global Smart Industry Conference (GloSIC) · doi:10.1109/glosic50886.2020.9267879 · Cited by 138
A bibliographic study on big data: concepts, trends and challenges
Mishra, D., Luo, Z., Jiang, S., Papadopoulos, T., & Dubey, R. (2017) · Business Process Management Journal · doi:10.1108/bpmj-10-2015-0149 · Cited by 84
Metadata
- Authors
- Al-Jarrah, O. Y., Yoo, P. D., Muhaidat, S., Karagiannidis, G. K., & Taha, K.
- Venue
- Big Data Research
- Publisher
- Elsevier BV
- Published
- 2015-09
- Volume
- 2
- Issue
- 3
- Pages
- 87-93
- ISSN
- 2214-5796 (ISSN-L)
- OpenAlex
- W2072750586
- Cited by
- 647
- References
- 47
- FWCI
- 39.73
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.