The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
BigDataBench: A big data benchmark suite from internet services
Open accessAbstract
As architecture, systems, and data management communities pay greater attention to innovative big data systems and architecture, the pressure of benchmarking and evaluating these systems rises. However, the complexity, diversity, frequently changed workloads, and rapid evolution of big data systems raise great challenges in big data benchmarking. Considering the broad use of big data systems, for the sake of fairness, big data benchmarks must include diversity of data and workloads, which is the prerequisite for evaluating big data systems and architecture. Most of the state-of-the-art big data benchmarking efforts target evaluating specific types of applications or system software stacks, and hence they are not qualified for serving the purposes mentioned above. This paper presents our joint research efforts on this issue with several industrial partners. Our big data benchmark suite-BigDataBench not only covers broad application scenarios, but also includes diverse and representative data sets. Currently, we choose 19 big data benchmarks from dimensions of application scenarios, operations/ algorithms, data types, data sources, software stacks, and application types, and they are comprehensive for fairly measuring and evaluating big data systems and architecture. BigDataBench is publicly available from the project home page http://prof.ict.ac.cn/BigDataBench. Also, we comprehensively characterize 19 big data workloads included in BigDataBench with varying data inputs. On a typical state-of-practice processor, Intel Xeon E5645, we have the following observations: First, in comparison with the traditional benchmarks: including PARSEC, HPCC, and SPECCPU, big data applications have very low operation intensity, which measures the ratio of the total number of instructions divided by the total byte number of memory accesses; Second, the volume of data input has non-negligible impact on micro-architecture characteristics, which may impose challenges for simulation-based big data architecture research; Last but not least, corroborating the observations in CloudSuite and DCBench (which use smaller data inputs), we find that the numbers of L1 instruction cache (L1I) misses per 1000 instructions (in short, MPKI) of the big data applications are higher than in the traditional benchmarks; also, we find that L3 caches are effective for the big data applications, corroborating the observation in DCBench.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Benchmarking cloud serving systems with YCSB
Cooper, B. F., Silberstein, A., Tam, E., Ramakrishnan, R., & Sears, R. (2010) · Proceedings of the 1st ACM symposium on Cloud computing · doi:10.1145/1807128.1807152 · Cited by 3,716
Williams, S., Waterman, A., & Patterson, D. A. (2009) · Communications of the ACM · doi:10.1145/1498765.1498785 · Cited by 2,798
The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines
Barroso, L. A., & Hölzle, U. (2009) · Synthesis lectures on computer architecture · doi:10.2200/s00193ed1v01y200905cac006 · Cited by 1,714
A comparison of approaches to large-scale data analysis
Pavlo, A., Paulson, E., Rasin, A., Abadi, D. J., DeWitt, D. J., Madden, S., & Stonebraker, M. (2009) · Proceedings of the 2009 ACM SIGMOD International Conference on Management of data · doi:10.1145/1559845.1559865 · Cited by 1,071
The HiBench benchmark suite: Characterization of the MapReduce-based data analysis
Huang, S., Huang, J., Dai, J., Xie, T., & Huang, B. (2010) · 2010 IEEE 26th International Conference on Data Engineering Workshops (ICDEW 2010) · doi:10.1109/icdew.2010.5452747 · Cited by 713
BigBench: towards an industry standard benchmark for big data analytics
Ghazal, A., Rabl, T., Hu, M., Raab, F., Poess, M., Crolotte, A., & Jacobsen, H.-A. (2013) · Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data · doi:10.1145/2463676.2463712 · Cited by 343
LinkBench: a database benchmark based on the Facebook social graph
Armstrong, T. G., Ponnekanti, V., Borthakur, D., & Callaghan, M. (2013) · Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data · doi:10.1145/2463676.2465296 · Cited by 313
Engle, C., Lupher, A., Xin, R., Zaharia, M., Franklin, M. J. M., Shenker, S. J., & Stoica, I. G. (2012) · Proceedings - ACM-SIGMOD International Conference on Management of Data · doi:10.1145/2213836.2213934 · Cited by 128
Characterizing data analysis workloads in data centers
Jia, Z., Wang, L., Zhan, J., Zhang, L., & Luo, C. (2013) · IEEE International Symposium on Workload Characterization · doi:10.1109/iiswc.2013.6704671 · Cited by 121
Self-citationCloudRank-D: benchmarking and ranking cloud computing systems for data processing applications
Luo, C., Zhan, J., Jia, Z., Wang, L., Lü, G., Zhang, L., Xu, C., & Sun, N. (2012) · Frontiers of Computer Science · doi:10.1007/s11704-012-2118-7 · Cited by 88
Self-citation
Cited by
Gan, Y., Zhang, Y., Cheng, D., Shetty, A., Rathi, P., Katarki, N., Bruno, A., Hu, J., Ritchken, B., Jackson, B., et al. (2019) · Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3297858.3304013 · Cited by 665
Self-citationStatistical Characterization of Business-Critical Workloads Hosted in Cloud Datacenters
Shen, S., Van Beek, V., & Iosup, A. (2015) · 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing · doi:10.1109/ccgrid.2015.60 · Cited by 286
DSPBench: A suite of benchmark applications for distributed data stream processing systems
Bordin, M. V., Griebler, D., Mencagli, G., Geyer, C. F. R., & Fernandes, L. G. L. (2020) · IEEE Access · doi:10.1109/access.2020.3043948 · Cited by 63
CAVBench: A Benchmark Suite for Connected and Autonomous Vehicles
Wang, Y., Liu, S., Wu, X., & Shi, W. (2018) · 2018 IEEE/ACM Symposium on Edge Computing (SEC) · doi:10.1109/sec.2018.00010 · Cited by 63
Maximum sustainable throughput evaluation using an adaptive method for stream processing platforms
Chu, Z., Yu, J., & Hamdull, A. (2020) · IEEE Access · doi:10.1109/access.2020.2976738 · Cited by 10
Metadata
- Authors
- Wang, L., Zhan, J., Luo, C., Zhu, Y., Yang, Q., He, Y., Gao, W., Jia, Z., Shi, Y., Zhang, S., Zheng, C., Lu, G., Zhan, K., Li, X., & Qiu, B.
- Venue
- 2014 IEEE 20th International Symposium on High Performance Computer Architecture (HPCA)
- Publisher
- IEEE
- Published
- 2014-02
- Pages
- 488-499
- ISSN
- 1530-0897 (ISSN-L)
- OpenAlex
- W2150478767
- Cited by
- 422
- References
- 10
- FWCI
- 41.03
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: BigDataBench: A big data benchmark suite from internet services. https://app.cochat.ai/papers/10.1109/hpca.2014.6835958
- The paper
- Wang, L., Zhan, J., Luo, C., Zhu, Y., Yang, Q., He, Y., Gao, W., Jia, Z., Shi, Y., Zhang, S., Zheng, C., Lu, G., Zhan, K., Li, X., & Qiu, B. (2014). BigDataBench: A big data benchmark suite from internet services. 2014 IEEE 20th International Symposium on High Performance Computer Architecture (HPCA). https://doi.org/10.1109/hpca.2014.6835958
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.