The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Big Data Processing in Cloud Computing Environments
Abstract
With the rapid growth of emerging applications like social network analysis, semantic Web analysis and bioinformatics network analysis, a variety of data to be processed continues to witness a quick increase. Effective management and analysis of large-scale data poses an interesting but critical challenge. Recently, big data has attracted a lot of attention from academia, industry as well as government. This paper introduces several big data processing technics from system and application aspects. First, from the view of cloud data management and big data processing mechanisms, we present the key issues of big data processing, including cloud computing platform, cloud architecture, cloud database and data storage scheme. Following the Map Reduce parallel processing framework, we then introduce Map Reduce optimization strategies and applications reported in the literature. Finally, we discuss the open issues and challenges, and deeply explore the research directions in the future on big data processing in cloud computing environments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
MapReduce: simplified data processing on large clusters
Dean, J., & Ghemawat, S. (2008) · Communications of the ACM · doi:10.1145/1327452.1327492 · Cited by 18,476
Ghemawat, S., Gobioff, H., & Leung, S.-T. (2003) · ACM SIGOPS Operating Systems Review · doi:10.1145/1165389.945450 · Cited by 4,984
Pregel: a system for large-scale graph processing
Malewicz, G., Austern, M. H., Bik, A. J. C., Dehnert, J. C., Horn, I., Leiser, N., & Czajkowski, G. (2010) · Proceedings of the 2010 ACM SIGMOD International Conference on Management of data · doi:10.1145/1807167.1807184 · Cited by 3,515
(2007) · doi:10.1145/1294261.1294281 · Cited by 3,447
The Eucalyptus Open-Source Cloud-Computing System
Nurmi, D., Wolski, R., Grzegorczyk, C., Obertelli, G., Soman, S., Youseff, L., & Zagorodnov, D. (2009) · 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid · doi:10.1109/ccgrid.2009.93 · Cited by 1,782
Evaluating MapReduce for Multi-core and Multiprocessor Systems
Ranger, C., Raghuraman, R., Penmetsa, A., Bradski, G., & Kozyrakis, C. (2007) · 2007 IEEE 13th International Symposium on High Performance Computer Architecture · doi:10.1109/hpca.2007.346181 · Cited by 966
PNUTS: Yahoo!'s hosted data serving platform
Cooper, B. F., Ramakrishnan, R., Srivastava, U., Silberstein, A., Bohannon, P., Jacobsen, H.-A., Puz, N., Weaver, D., & Yerneni, R. (2008) · Proceedings of the VLDB Endowment · doi:10.14778/1454159.1454167 · Cited by 958
HadoopDB: an architectural hybrid of MapReduce and DBMS technologies for analytical workloads
Abouzeid, A., Bajda-Pawlikowski, K., Abadi, D., Silberschatz, A., & Rasin, A. (2009) · Proceedings of the VLDB Endowment · doi:10.14778/1687627.1687731 · Cited by 857
Twister: a runtime for iterative MapReduce
Ekanayake, J., Li, H., Zhang, B., Gunarathne, T., Bae, S.-H., Qiu, J., & Fox, G. (2010) · Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing · doi:10.1145/1851476.1851593 · Cited by 777
Mars: a MapReduce framework on graphics processors
He, B., Fang, W., Luo, Q., Govindaraju, N. K., & Wang, T. (2008) · Proceedings of the 17th international conference on Parallel architectures and compilation techniques · doi:10.1145/1454115.1454152 · Cited by 715
Map-reduce-merge: simplified relational data processing on large clusters
Yang, H.-C., Dasdan, A., Hsiao, R.-L., & Parker, D. S. (2007) · Proceedings of the 2007 ACM SIGMOD international conference on Management of data · doi:10.1145/1247480.1247602 · Cited by 715
HaLoop: efficient iterative data processing on large clusters
Bu, Y., Howe, B., Balazinska, M., & Ernst, M. D. (2010) · Proceedings of the VLDB Endowment · doi:10.14778/1920841.1920881 · Cited by 693
Condie, T., Conway, N., Alvaro, P., Hellerstein, J. M., Elmeleegy, K., & Sears, R. (2010) · doi:10.5555/1855711.1855732 · Cited by 673
MapReduce and parallel DBMSs: friends or foes?
Stonebraker, M., Abadi, D., DeWitt, D. J., Madden, S., Paulson, E., Pavlo, A., & Rasin, A. (2010) · Communications of the ACM · doi:10.1145/1629175.1629197 · Cited by 430
A Survey of Large Scale Data Management Approaches in Cloud Environments
Sakr, S., Liu, A., Batista, D. M., & Alomari, M. (2011) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2011.032211.00087 · Cited by 424
The performance of MapReduce: an in-depth study
Jiang, D., Ooi, B. C., Shi, L., & Wu, S. (2010) · Proceedings of the VLDB Endowment · doi:10.14778/1920841.1920903 · Cited by 392
Hadoop++: making a yellow elephant run like a cheetah (without it even noticing)
Dittrich, J., Quiané-Ruiz, J.-A., Jindal, A., Kargin, Y., Setty, V., & Schad, J. (2010) · Proceedings of the VLDB Endowment · doi:10.14778/1920841.1920908 · Cited by 364
Efficient parallel kNN joins for large data in MapReduce
Zhang, C., Li, F., & Jestes, J. (2012) · Proceedings of the 15th International Conference on Extending Database Technology · doi:10.1145/2247596.2247602 · Cited by 250
MRShare: sharing across multiple queries in MapReduce
Nykiel, T., Potamias, M., Mishra, C., Kollios, G., & Koudas, N. (2010) · Proceedings of the VLDB Endowment · doi:10.14778/1920841.1920906 · Cited by 229
MAP-JOIN-REDUCE: Toward Scalable and Efficient Data Analysis on Large Clusters
Jiang, D., Tung, A. K. H., & Chen, G. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2010.248 · Cited by 171
Ricardo: integrating R and Hadoop
Das, S., Sismanis, Y., Beyer, K. S., Gemulla, R., Haas, P. J., & McPherson, J. (2010) · Proceedings of the 2010 ACM SIGMOD International Conference on Management of data · doi:10.1145/1807167.1807275 · Cited by 164
Online aggregation and continuous query support in MapReduce
Condie, T., Conway, N., Alvaro, P., Hellerstein, J. M., Gerth, J. A., Talbot, J., Elmeleegy, K., & Sears, R. (2010) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/1807167.1807295 · Cited by 149
Chukwa: a system for reliable large-scale log collection
Rabkin, A., & Katz, R. H. (2010) · Cited by 86
RankReduce - processing K-Nearest Neighbor queries on top of MapReduce
Stupar, A., Michel, S., & Schenkel, R. (2010) · Cited by 86
ES2: A cloud data storage system for supporting both OLTP and OLAP
Cao, Y. H., Chen, C., Guo, F., Jiang, D., Lin, Y.-T., Ooi, B. C., Vo, H. T., Wu, S., & Xu, Q. (2011) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2011.5767881 · Cited by 86
Ad-hoc data processing in the cloud
Logothetis, D., & Yocum, K. (2008) · Proceedings of the VLDB Endowment · doi:10.14778/1454159.1454204 · Cited by 70
Cited by
The rise of big data on cloud computing: Review and open research issues
Hashem, I. A. T., Yaqoob, I., Anuar, N. B., Mokhtar, S., Gani, A., & Ullah Khan, S. (2015) · Information Systems · doi:10.1016/j.is.2014.07.006 · Cited by 2,656
Applications of big data to smart cities
Al Nuaimi, E., Al Neyadi, H., Mohamed, N., & Al-Jaroodi, J. (2015) · Journal of Internet Services and Applications · doi:10.1186/s13174-015-0041-5 · Cited by 960
Big Data and cloud computing: innovation opportunities and challenges
Yang, C., Huang, Q., Li, Z., Liu, K., & Hu, F. (2017) · International Journal of Digital Earth · doi:10.1080/17538947.2016.1239771 · Cited by 838
Bibri, S. E. (2018) · Sustainable Cities and Society · doi:10.1016/j.scs.2017.12.034 · Cited by 799
Internet of Things (IoT) and the Energy Sector
Hossein Motlagh, N., Mohammadrezaei, M., Hunt, J., & Zakeri, B. (2020) · Energies · doi:10.3390/en13020494 · Cited by 772
Metadata
- Authors
- Ji, C., Li, Y., Qiu, W., Awada, U., & Li, K.
- Venue
- 2012 12th International Symposium on Pervasive Systems, Algorithms and Networks
- Publisher
- IEEE
- Published
- 2012-12
- Pages
- 17-23
- OpenAlex
- W2532324861
- Cited by
- 302
- References
- 26
- FWCI
- 17.18
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.