The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
Big Data technologies: A survey
Open accessAbstract
Developing Big Data applications has become increasingly important in the last few years. In fact, several organizations from different sectors depend increasingly on knowledge extracted from huge volumes of data. However, in Big Data context, traditional data techniques and platforms are less efficient. They show a slow responsiveness and lack of scalability, performance and accuracy. To face the complex Big Data challenges, much work has been carried out. As a result, various types of distributions and technologies have been developed. This paper is a review that survey recent technologies developed for Big Data. It aims to help to select and adopt the right combination of different Big Data technologies according to their technological needs and specific applications’ requirements. It provides not only a global view of main Big Data technologies but also comparisons according to different system layers such as Data Storage Layer, Data Processing Layer, Data Querying Layer, Data Access Layer and Management Layer. It categorizes and discusses main technologies features, advantages, limits and usages.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Beyond the hype: Big data concepts, methods, and analytics
Gandomi, A., & Haider, M. (2015) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2014.10.007 · Cited by 4,226
Big Data : The Management Revolution
マカフィー, ア., ブリニョルフソン, エ., & 有賀, 裕. (2013) · Harvard business review · Cited by 3,549
Data-intensive applications, challenges, techniques and technologies: A survey on Big Data
Philip Chen, C. L., & Zhang, C.-Y. (2014) · Information Sciences · doi:10.1016/j.ins.2014.01.015 · Cited by 3,047
Chen, M., Mao, S., & Liu, Y. (2014) · Mobile Networks and Applications · doi:10.1007/s11036-013-0489-0 · Cited by 2,913
White, T. (2009) · Cited by 2,800
Deep learning applications and challenges in big data analytics
Najafabadi, M. M., Villanustre, F., Khoshgoftaar, T. M., Seliya, N., Wald, R., & Muharemagic, E. (2015) · Journal of Big Data · doi:10.1186/s40537-014-0007-7 · Cited by 2,594
Wu, X., Zhu, X., Wu, G.-Q., & Ding, W. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2013.109 · Cited by 2,410
Integration of Cloud computing and Internet of Things: A survey
Botta, A., de Donato, W., Persico, V., & Pescapé, A. (2016) · Future Generation Computer Systems · doi:10.1016/j.future.2015.09.021 · Cited by 2,388
Keulen, D. S. (2014) · Cited by 1,677
Understanding Big Data: Analytics for Enterprise Class Hadoop and Streaming Data
Zikopoulos, P., & Eaton, C. (2011) · Cited by 1,455
2013 IEEE International Conference on Big Data
(2013) · doi:10.1109/bigdata21311.2013 · Cited by 1,390
Deep Learning for Medical Image Processing: Overview, Challenges and the Future
Razzak, M. I., Naz, S., & Zaib, A. (2018) · Lecture Notes in Computational Vision and Biomechanics · doi:10.1007/978-3-319-65981-7_12 · Cited by 1,248
A survey of machine learning for big data processing
Qiu, J., Wu, Q., Ding, G., Xu, Y., & Feng, S. (2016) · EURASIP Journal on Advances in Signal Processing · doi:10.1186/s13634-016-0355-x · Cited by 894
Multiclass Imbalance Problems: Analysis and Potential Solutions
Wang, S., & Yao, X. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2012.2187280 · Cited by 567
Big Data: Survey, Technologies, Opportunities, and Challenges
Khan, N., Yaqoob, I., Hashem, I. A. T., Inayat, Z., Mahmoud Ali, W. K., Alam, M., Shiraz, M., & Gani, A. (2014) · The Scientific World Journal · doi:10.1155/2014/712826 · Cited by 547 · cited 2×
“The challenge in Big Data is how to manage the complexity of Big Data nature (velocity, volume and variety) (Khan et al., 2014) and process it in a distributed environment with a mix of applications.”
Big data: Dimensions, evolution, impacts, and challenges
Lee, I. (2017) · Business Horizons · doi:10.1016/j.bushor.2017.01.004 · Cited by 546
Big Data Application in Biomedical Research and Health Care: A Literature Review
Luo, J., Wu, M., Gopukumar, D., & Zhao, Y. (2016) · Biomedical Informatics Insights · doi:10.4137/bii.s31559 · Cited by 522
A survey of open source tools for machine learning with big data in the Hadoop ecosystem
Landset, S., Khoshgoftaar, T. M., Richter, A. N., & Hasanin, T. (2015) · Journal of Big Data · doi:10.1186/s40537-015-0032-1 · Cited by 432
George, L. (2011) · Cited by 382
On the use of MapReduce for imbalanced big data using Random Forest
del Río, S., López, V., Benítez, J. M., & Herrera, F. (2014) · Information Sciences · doi:10.1016/j.ins.2014.03.043 · Cited by 328
Understandable Big Data: A survey
Kacfah Emani, C., Cullot, N., & Nicolle, C. (2015) · Computer Science Review · doi:10.1016/j.cosrev.2015.05.002 · Cited by 299
Towards felicitous decision making: An overview on challenges and trends of Big Data
Wang, H., Xu, Z., Fujita, H., & Liu, S. (2016) · Information Sciences · doi:10.1016/j.ins.2016.07.007 · Cited by 268
Computational intelligence for heart disease diagnosis: A medical knowledge driven approach
Nahar, J., Imam, T., Tickle, K. S., & Chen, Y.-P. P. (2013) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.07.032 · Cited by 266
New Horizons for a Data-Driven Economy
(2016) · Springer eBooks · doi:10.1007/978-3-319-21569-3 · Cited by 253
A Survey on Big Data Analytics: Challenges, Open Research Issues and Tools
P., D., & Ahmed, K. (2016) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2016.070267 · Cited by 244
Jaql: a scripting language for large scale semistructured data analysis
Beyer, K. S., Ercegovac, V., Gemulla, R., Balmin, A., Eltabakh, M., Kanne, C.-C., Ozcan, F., & Shekita, E. J. (2011) · Proceedings of the VLDB Endowment · doi:10.14778/3402755.3402761 · Cited by 218
Zhou, L. (2013) · Knowledge-Based Systems · doi:10.1016/j.knosys.2012.12.007 · Cited by 215
A look at challenges and opportunities of Big Data analytics in healthcare
Nambiar, R. O., Bhardwaj, R., Sethi, A., et al. (2013) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2013.6691753 · Cited by 212
Li, G. (2015) · Information Technology & Tourism · doi:10.1007/s40558-015-0027-y · Cited by 208
The anatomy of big data computing
Kune, R., Konugurthi, P. K., Agarwal, A., Chillarige, R. R., & Buyya, R. (2016) · Software: Practice and Experience · doi:10.1002/spe.2374 · Cited by 195
Yu, H., Ni, J., & Zhao, J. (2013) · Neurocomputing · doi:10.1016/j.neucom.2012.08.018 · Cited by 188
Big data and analytics in healthcare: Introduction to the special section
Kankanhalli, A., Hahn, J., Tan, S. S.-L., & Gao, G. (2016) · Information Systems Frontiers · doi:10.1007/s10796-016-9641-2 · Cited by 180
Hurwitz, J., Nugent, A., Halper, F., & Kaufman, M. (2013) · Cited by 178
Big data for development: applications and techniques
Ali, A., Qadir, J., Rasool, R. U., Sathiaseelan, A., Zwitter, A., & Crowcroft, J. (2016) · Big Data Analytics · doi:10.1186/s41044-016-0002-4 · Cited by 173
Sun, J., Fujita, H., Chen, P., & Li, H. (2017) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.12.019 · Cited by 173
Data Warehousing in the Age of Big Data
(2013) · Elsevier eBooks · doi:10.1016/c2012-0-02737-8 · Cited by 166
Interactive granular computing
Skowron, A., Jankowski, A., & Dutta, S. (2016) · Granular Computing · doi:10.1007/s41066-015-0002-1 · Cited by 162
Big data storage technologies: a survey
Siddiqa, A., Karim, A., & Gani, A. (2017) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.1500441 · Cited by 162
Zhang, J., Li, T., Ruan, D., et al. (2012) · International Journal of Approximate Reasoning · doi:10.1016/j.ijar.2012.01.001 · Cited by 158
Instantly decodable network coding for real-time device-to-device communications
Douik, A., Sorour, S., Al-Naffouri, T. Y., & Alouini, M. (2016) · EURASIP Journal on Advances in Signal Processing · doi:10.1186/s13634-015-0293-z · Cited by 156
Wang, H., Xu, Z., & Witold Pedrycz, C. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.11.008 · Cited by 149
Big Data: Understanding How Data Powers Big Business
Schmarzo, B. (2013) · Cited by 128
Big Data Analytics Strategies for the Smart Grid
Stimmel, C. L. (2014) · Auerbach Publications eBooks · doi:10.1201/b17228 · Cited by 106
Fang, H., Zhang, Z., Wang, C. J., Daneshmand, M., Wang, C., & Wang, H. (2015) · IEEE Network · doi:10.1109/mnet.2015.7293298 · Cited by 106
Rajaraman, V. (2016) · Resonance · doi:10.1007/s12045-016-0376-7 · Cited by 96
Furht, B., & Villanustre, F. (2016) · Springer eBooks · doi:10.1007/978-3-319-44550-2_1 · Cited by 95
Chukwa: a system for reliable large-scale log collection
Rabkin, A., & Katz, R. H. (2010) · Cited by 86
Salleh, K. A., & Janczewski, L. J. (2016) · Procedia Computer Science · doi:10.1016/j.procs.2016.09.119 · Cited by 75
Zhou, L., Wang, Q., & Fujita, H. (2016) · Information Fusion · doi:10.1016/j.inffus.2016.11.009 · Cited by 75
Big Data and Cloud Computing: A Survey of the State-of-the-Art and Research Challenges
Skourletopoulos, G., Mavromoustakis, C. X., Mastorakis, G. N., Batalla, J. M., Dobre, C., Panagiotakis, S., & Pallis, E. (2016) · Studies in big data · doi:10.1007/978-3-319-45145-9_2 · Cited by 67
Dynamic variable precision rough set approach for probabilistic set-valued information systems
Huang, Y., Li, T., Luo, C., Fujita, H., & Horng, S. (2017) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.02.002 · Cited by 67
The design of polynomial function-based neural network predictors for detection of software defects
Park, B., Oh, S., & Witold Pedrycz, C. (2011) · Information Sciences · doi:10.1016/j.ins.2011.01.026 · Cited by 66
Comparative study between incremental and ensemble learning on data streams: Case study
Zang, W., Zhang, P., Zhou, C. D., & Guo, L. (2014) · Journal Of Big Data · doi:10.1186/2196-1115-1-5 · Cited by 64
Advances in Mobile Cloud Computing and Big Data in the 5G Era
Mavromoustakis, C. X., Mastorakis, G., & Dobre, C. (2016) · Studies in big data · doi:10.1007/978-3-319-45145-9 · Cited by 59
An overview of big data opportunities, applications and tools
Benjelloun, F.-Z., Lahcen, A. A., & Belfkih, S. (2015) · International Conference on Intelligent Systems and Computer Vision (ISCV) · doi:10.1109/isacv.2015.7105553 · Cited by 57
Self-citationBig Data Concepts, Theories, and Applications
Yu, S., & Guo, S. (2016) · Springer eBooks · doi:10.1007/978-3-319-27763-9 · Cited by 56
Lyko, K., Nitzschke, M., & Ngomo, A.-C. N. (2016) · Springer eBooks · doi:10.1007/978-3-319-21569-3_4 · Cited by 52
Comparative Study of Big Data Computing and Storage Tools: A Review
Prasad, B. R., & Agarwal, S. (2016) · International Journal of Database Theory and Application · doi:10.14257/ijdta.2016.9.1.05 · Cited by 48
Martino, B. D., Aversa, R., Cretella, G., Espósito, A., & Kołodziej, J. (2014) · International Journal of Big Data Intelligence · doi:10.1504/ijbdi.2014.063840 · Cited by 46
Zhou, L., & Fujita, H. (2017) · Information Sciences · doi:10.1016/j.ins.2017.02.059 · Cited by 35
Efficient updating of probabilistic approximations with incremental objects
Luo, C., Li, T., Chen, H., Fujita, H., & Zhang, Y. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.06.025 · Cited by 34
A survey of data visualization tools for analyzing large volume of data in big data platform
Raghav, R. S., Pothula, S., Vengattaraman, T., & Ponnurangam, D. (2016) · International Conference on Communication and Electronics Systems (ICCES) · doi:10.1109/cesys.2016.7889976 · Cited by 32
Mazumder, S. (2016) · Springer eBooks · doi:10.1007/978-3-319-27763-9_2 · Cited by 30
Tsai, C., Lai, C., Chao, H., & Vasilakos, A. V. (2016) · Springer eBooks · doi:10.1007/978-3-319-44550-2_2 · Cited by 28
A Survey of Big Data Processing in Perspective of Hadoop and Mapreduce
Usha, D. (2014) · Cited by 19
Benjelloun, F.-Z., & Lahcen, A. A. (2015) · Advances in information security, privacy, and ethics book series · doi:10.4018/978-1-4666-8387-7.ch014 · Cited by 17
Self-citationGeneral-Purpose Big Data Processing Systems
Sakr, S. (2016) · SpringerBriefs in computer science · doi:10.1007/978-3-319-38776-5_2 · Cited by 6
Azarmi, B. (2015) · Apress eBooks · doi:10.1007/978-1-4842-1326-1_1 · Cited by 5
A Study of Tools, Techniques, and Trends for Big Data Analytics
Shireesha, R., & Bhutada, S. (2016) · Cited by 5
Large-Scale Stream Processing Systems
Sakr, S. (2016) · SpringerBriefs in computer science · doi:10.1007/978-3-319-38776-5_5 · Cited by 2
Cited by
Digital twin: values, challenges and enablers from a modeling perspective
Rasheed, A., San, O., & Kvamsdal, T. (2020) · IEEE Access · doi:10.1109/access.2020.2970143 · Cited by 1,952
A Survey of Machine and Deep Learning Methods for Internet of Things (IoT) Security
Al-Garadi, M. A., Mohamed, A., Al-Ali, A. K., Du, X., Ali, I., & Guizani, M. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2988293 · Cited by 1,392
A survey on blockchain for big data: Approaches, opportunities, and future directions
Deepa, N., Pham, Q.-V., Nguyen, D. C., Bhattacharya, S., Prabadevi, B., Gadekallu, T. R., Maddikunta, P. K. R., Fang, F., & Pathirana, P. N. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.01.017 · Cited by 558
A survey towards an integration of big data analytics to big insights for value-creation
Saggi, M. K., & Jain, S. (2018) · Information Processing & Management · doi:10.1016/j.ipm.2018.01.010 · Cited by 494
IoT and artificial intelligence implementations for remote healthcare monitoring systems: A survey
Alshamrani, M. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2021.06.005 · Cited by 364
Metadata
- Authors
- Oussous, A., Benjelloun, F.-Z., Ait Lahcen, A., & Belfkih, S.
- Venue
- Journal of King Saud University - Computer and Information Sciences
- Published
- 2018-10
- Volume
- 30
- Issue
- 4
- Pages
- 431-448
- ISSN
- 1319-1578 (ISSN-L)
- OpenAlex
- W2625392185
- Cited by
- 980
- References
- 70
- FWCI
- 136.12
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.