The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
StreamCloud: An Elastic and Scalable Data Streaming System
Open accessAbstract
Many applications in several domains such as telecommunications, network security, large-scale sensor networks, require online processing of continuous data flows. They produce very high loads that requires aggregating the processing capacity of many nodes. Current Stream Processing Engines do not scale with the input load due to single-node bottlenecks. Additionally, they are based on static configurations that lead to either under or overprovisioning. In this paper, we present StreamCloud, a scalable and elastic stream processing engine for processing large data stream volumes. StreamCloud uses a novel parallelization technique that splits queries into subqueries that are allocated to independent sets of nodes in a way that minimizes the distribution overhead. Its elastic protocols exhibit low intrusiveness, enabling effective adjustment of resources to the incoming load. Elasticity is combined with dynamic load balancing to minimize the computational resources used. The paper presents the system design, implementation, and a thorough evaluation of the scalability and elasticity of the fully implemented system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Principles of Distributed Database Systems
Özsu, M. T., & Valduriez, P. (2020) · Springer eBooks · doi:10.1007/978-3-030-26253-2 · Cited by 2,345
Self-citationAurora: a new model and architecture for data stream management
Abadi, D. J., Carney, D., �etintemel, U., Cherniack, M., Convey, C., Lee, S., Stonebraker, M., Tatbul, N., & Zdonik, S. (2003) · The VLDB Journal The International Journal on Very Large Data Bases · doi:10.1007/s00778-003-0095-z · Cited by 1,495
The design of the borealis stream processing engine
Abadi, D. J., Ahmad, Y., Bałazińska, M., Cherniack, M., Hwang, J.-H., Lindner, W., Maskey, A. S., Rasin, A., Ryvkina, E., Tatbul, N., et al. (2005) · Cited by 1,255
TelegraphCQ: Continuous Dataflow Processing for an Uncertain World.
Chandrasekaran, S., Cooper, O., Deshpande, A., Franklin, M. J. M., Hellerstein, J. M., Hong, W., Krishnamurthy, S., Madden, S. R., Raman, V., Reiss, F. R., et al. (2003) · Conference on Innovative Data Systems Research · Cited by 947
S4: Distributed Stream Computing Platform
Neumeyer, L., Robbins, B., Nair, A., & Kesari, A. (2010) · 2010 IEEE International Conference on Data Mining Workshops · doi:10.1109/icdmw.2010.172 · Cited by 900
TelegraphCQ: continuous dataflow processing
Chandrasekaran, S., Cooper, O., Deshpande, A., Franklin, M. J., Hellerstein, J. M., Hong, W., Krishnamurthy, S., Madden, S. R., Reiss, F., & Shah, M. A. (2003) · Proceedings of the 2003 ACM SIGMOD international conference on Management of data · doi:10.1145/872757.872857 · Cited by 744
The 8 requirements of real-time stream processing
Stonebraker, M., Çetintemel, U., & Zdonik, S. (2005) · ACM SIGMOD Record · doi:10.1145/1107499.1107504 · Cited by 640
Scalable Distributed Stream Processing
Cherniack, M., Balakrishnan, H., Bałazińska, M., Carney, D., Xing, Y., & Zdonik, S. (2003) · Cited by 496
Principles of Distributed Database Systems, Third Edition
ÖZSU, M. T., & Valduriez, P. (2011) · Springer eBooks · doi:10.1007/978-1-4419-8834-8 · Cited by 369
Self-citationEncapsulation of parallelism in the Volcano query processing system
Graefe, G. (1990) · Proceedings of the 1990 ACM SIGMOD international conference on Management of data · doi:10.1145/93597.98720 · Cited by 340
Dynamic Load Distribution in the Borealis Stream Processor
Xing, Y., Zdonik, S., & Hwang, J.-H. (2005) · 21st International Conference on Data Engineering (ICDE'05) · doi:10.1109/icde.2005.53 · Cited by 228
Staying FIT: Efficient Load Shedding Techniques for Distributed Stream Processing
Tatbul, N. (2007) · Cited by 127
Autonomic Provisioning of Backend Databases in Dynamic Content Web Servers
Chen, J., Soundararajan, G., & Amza, C. (2006) · IEEE International Conference on Autonomic Computing (ICAC) · doi:10.1109/icac.2006.1662403 · Cited by 107
StreamCloud: A Large Scale Data Streaming System
Gulisano, V. M., Jimenez-Peris, R., Patiño-Martínez, M., & Valduriez, P. (2010) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2010.72 · Cited by 102
Self-citationA brief history of NTP time: memoirs of an Internet timekeeper
Mills, D. L. (2003) · ACM SIGCOMM Computer Communication Review · doi:10.1145/956981.956983 · Cited by 86
Encapsulation of parallelism in the Volcano query processing system
Graefe, G. (1990) · ACM SIGMOD Record · doi:10.1145/93605.98720 · Cited by 84
Cited by
Data-intensive applications, challenges, techniques and technologies: A survey on Big Data
Philip Chen, C. L., & Zhang, C.-Y. (2014) · Information Sciences · doi:10.1016/j.ins.2014.01.015 · Cited by 3,047
Assessing the impact of big data on firm innovation performance: Big data is not always better data
Ghasemaghaei, M., & Calic, G. (2020) · Journal of Business Research · doi:10.1016/j.jbusres.2019.09.062 · Cited by 539
Integrating scale out and fault tolerance in stream processing using operator state management
Castro Fernandez, R., Migliavacca, M., Kalyvianaki, E., & Pietzuch, P. (2013) · Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data · doi:10.1145/2463676.2465282 · Cited by 338
Does big data enhance firm innovation competency? The mediating role of data-driven insights
Ghasemaghaei, M., & Calic, G. (2019) · Journal of Business Research · doi:10.1016/j.jbusres.2019.07.006 · Cited by 331
Dias de Assunção, M., da Silva Veith, A., & Buyya, R. (2018) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2017.12.001 · Cited by 304
Metadata
- Authors
- Gulisano, V., Jimenez-Peris, R., Patino-Martinez, M., Soriente, C., & Valduriez, P.
- Venue
- IEEE Transactions on Parallel and Distributed Systems
- Published
- 2012-12
- Volume
- 23
- Issue
- 12
- Pages
- 2351-2365
- ISSN
- 1045-9219 (ISSN-L)
- OpenAlex
- W2017203676
- Cited by
- 324
- References
- 16
- FWCI
- 39.67
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.