The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
BlinkDB: queries with bounded errors and bounded response times on very large data
Abstract
In this paper, we present BlinkDB, a massively parallel, approximate query engine for running interactive SQL queries on large volumes of data. BlinkDB allows users to trade-off query accuracy for response time, enabling interactive queries over massive data by running queries on data samples and presenting results annotated with meaningful error bars. To achieve this, BlinkDB uses two key ideas: (1) an adaptive optimization framework that builds and maintains a set of multi-dimensional stratified samples from original data over time, and (2) a dynamic sample selection strategy that selects an appropriately sized sample based on a query's accuracy or response time requirements. We evaluate BlinkDB against the well-known TPC-H benchmarks and a real-world analytic workload derived from Conviva Inc., a company that manages video distribution over the Internet. Our experiments on a 100 node cluster show that BlinkDB can answer queries on up to 17 TBs of data in less than 2 seconds (over 200 x faster than Hive), within an error of 2-10%.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing
Zaharia, M., Chowdhury, M., Das, T., Dave, A., Ma, J. H., McCauley, M., Franklin, M. J. M., Shenker, S. J., & Stoica, I. G. (2012) · Cited by 3,622
Self-citationImproving MapReduce performance in heterogeneous environments
Zaharia, M., Konwinski, A., Joseph, A. D., Katz, R. H., & Stoica, I. G. (2008) · doi:10.5555/1855741.1855744 · Cited by 1,588
Self-citationHive: a warehousing solution over a map-reduce framework
Thusoo, A., Sarma, J. S., Jain, N., Shao, Z., Chakka, P., Anthony, S., Liu, H., Wyckoff, P., & Murthy, R. (2009) · Proceedings of the VLDB Endowment · doi:10.14778/1687553.1687609 · Cited by 1,556
Hellerstein, J. M., Haas, P. J., & Wang, H. J. (1997) · Proceedings - ACM-SIGMOD International Conference on Management of Data · doi:10.1145/253260.253291 · Cited by 902
Condie, T., Conway, N., Alvaro, P., Hellerstein, J. M., Elmeleegy, K., & Sears, R. (2010) · doi:10.5555/1855711.1855732 · Cited by 673
Reining in the outliers in map-reduce clusters using Mantri
Ananthanarayanan, G., Kandula, S., Greenberg, A. G., Stoica, I. G., Lu, Y., Saha, B., & Harris, E. F. (2010) · Operating Systems Design and Implementation · doi:10.5555/1924943.1924962 · Cited by 636
Self-citationSynopses for Massive Data: Samples, Histograms, Wavelets, Sketches
Cormode, G., Garofalakis, M., Haas, P. J., & Jermaine, C. (2011) · Foundations and Trends in Databases · doi:10.1561/1900000004 · Cited by 468
A comparison of join algorithms for log processing in MaPreduce
Blanas, S., Patel, J. M., Ercegovac, V., Rao, J., Shekita, E. J., & Tian, Y. (2010) · Proceedings of the 2010 ACM SIGMOD International Conference on Management of data · doi:10.1145/1807167.1807273 · Cited by 414
(2000) · Technometrics · doi:10.1080/00401706.2000.10486038 · Cited by 412
Ripple joins for online aggregation
Haas, P. J., & Hellerstein, J. M. (1999) · ACM SIGMOD Record · doi:10.1145/304181.304208 · Cited by 369
Lohr, S. L. (2019) · UCLA - Biblioteca de Ciencias y Tecnologia Felix Morales Bueno · Cited by 350
Re-optimizing data-parallel computing
Agarwal, S., Kandula, S., Bruno, N., Wu, M.-C., Stoica, I. G., & Zhou, J. (2012) · Cited by 174
Self-citationApproximate Query Processing: Taming the TeraBytes
Garofalakis, M., & Gibbon, P. B. (2001) · Very Large Data Bases · Cited by 174
Shark: fast data analysis using coarse-grained distributed memory
Engle, C., Lupher, A., Xin, R., Zaharia, M., Franklin, M. J. M., Shenker, S. J., & Stoica, I. G. (2012) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/2213836.2213934 · Cited by 143
Self-citationScalable approximate query processing with the DBO engine
Jermaine, C., Arumugam, S., Pol, A., & Dobra, A. (2007) · Proceedings - ACM-SIGMOD International Conference on Management of Data · doi:10.1145/1247480.1247560 · Cited by 82
Data management projects at Google
Hsieh, W. C.-Y., Madhavan, J., & Pike, R. (2006) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/1142473.1142566 · Cited by 48
Informix under CONTROL: Online Query Processing
Hellerstein, J. M., Avnur, R., & Raman, V. (2000) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009835310546 · Cited by 45
Synopses for Massive Data: Samples, Histograms, Wavelets, Sketches
Cormode, G. (2011) · doi:10.1561/9781601985170 · Cited by 29
Cited by
A survey on platforms for big data analytics
Singh, D., & Reddy, C. K. (2015) · Journal of Big Data · doi:10.1186/s40537-014-0008-6 · Cited by 433
Big data analytics on Apache Spark
Salloum, S., Dautov, R., Chen, X., Peng, P. X., & Huang, J. Z. (2016) · International Journal of Data Science and Analytics · doi:10.1007/s41060-016-0027-9 · Cited by 428
(2017) · Networked Systems Design and Implementation · Cited by 329
The Effects of Interactive Latency on Exploratory Visual Analysis
Liu, Z., & Heer, J. (2014) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2014.2346452 · Cited by 326
imMens: Real‐time Visual Querying of Big Data
Liu, Z., Jiang, B., & Heer, J. (2013) · Computer Graphics Forum · doi:10.1111/cgf.12129 · Cited by 308
Metadata
- Authors
- Agarwal, S., Mozafari, B., Panda, A., Milner, H., Madden, S., & Stoica, I.
- Venue
- Proceedings of the 8th ACM European Conference on Computer Systems
- Publisher
- ACM
- Published
- 2013-04-15
- Pages
- 29-42
- OpenAlex
- W2071989194
- Cited by
- 694
- References
- 18
- FWCI
- 52.84
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.