The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Integrating scale out and fault tolerance in stream processing using operator state management
Abstract
As users of "big data" applications expect fresh results, we witness a new breed of stream processing systems (SPS) that are designed to scale to large numbers of cloud-hosted machines. Such systems face new challenges: (i) to benefit from the "pay-as-you-go" model of cloud computing, they must scale out on demand, acquiring additional virtual machines (VMs) and parallelising operators when the workload increases; (ii) failures are common with deployments on hundreds of VMs-systems must be fault-tolerant with fast recovery times, yet low per-machine overheads. An open question is how to achieve these two goals when stream queries include stateful operators, which must be scaled out and recovered without affecting query results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The cost of a cloud: research problems in data center networks
Greenberg, A., Hamilton, J., Maltz, D. A., & Patel, P. (2008) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1496091.1496103 · Cited by 1,621
The design of the borealis stream processing engine
Abadi, D. J., Ahmad, Y., Bałazińska, M., Cherniack, M., Hwang, J.-H., Lindner, W., Maskey, A. S., Rasin, A., Ryvkina, E., Tatbul, N., et al. (2005) · Cited by 1,255
S4: Distributed Stream Computing Platform
Neumeyer, L., Robbins, B., Nair, A., & Kesari, A. (2010) · 2010 IEEE International Conference on Data Mining Workshops · doi:10.1109/icdmw.2010.172 · Cited by 900
Understanding network failures in data centers: measurement, analysis, and implications
Gill, P., Jain, N., & Nagappan, N. (2011) · Proceedings of the ACM SIGCOMM 2011 conference · doi:10.1145/2018436.2018477 · Cited by 714
Big data and cloud computing: current state and future opportunities
Agrawal, D., Das, S., & El Abbadi, A. (2011) · Proceedings of the 14th International Conference on Extending Database Technology · doi:10.1145/1951365.1951432 · Cited by 552
Discretized streams: an efficient and fault-tolerant model for stream processing on large clusters
Zaharia, M., Das, T., Li, H., Shenker, S. J., & Stoica, I. G. (2012) · Cited by 425
A comparison of join algorithms for log processing in MaPreduce
Blanas, S., Patel, J. M., Ercegovac, V., Rao, J., Shekita, E. J., & Tian, Y. (2010) · Proceedings of the 2010 ACM SIGMOD International Conference on Management of data · doi:10.1145/1807167.1807273 · Cited by 414
Query Processing, Resource Management, and Approximation ina Data Stream Management System
Motwani, R., Widom, J., Arasu, A., et al. (2002) · Cited by 339
StreamCloud: An Elastic and Scalable Data Streaming System
Gulisano, V., Jimenez-Peris, R., Patino-Martinez, M., Soriente, C., & Valduriez, P. (2012) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2012.24 · Cited by 324
Arasu, A., Maskey, A. S., Cherniack, M., Ryvkina, E., Galvez, E., Stonebraker, M., Maier, D., & Tibbetts, R. (2004) · Proceedings 2004 VLDB Conference · doi:10.1016/b978-012088469-8.50044-9 · Cited by 322
Cited by
Discretized streams: fault-tolerant streaming computation at scale
Zaharia, M., Das, T., Li, H., Hunter, T., Shenker, S., & Stoica, I. (2013) · Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles · doi:10.1145/2517349.2522737 · Cited by 982
Dias de Assunção, M., da Silva Veith, A., & Buyya, R. (2018) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2017.12.001 · Cited by 304
State management in Apache Flink®: Consistent stateful distributed stream processing
Carbone, P., Ewen, S., Fóra, G., Haridi, S., Richter, S., & Tzoumas, K. (2017) · Proceedings of the VLDB Endowment · doi:10.14778/3137765.3137777 · Cited by 285
Samza: Stateful scalable stream processing at LinkedIn
Noghabi, S. A., Paramasivam, K., Pan, Y., Ramesh, N., Bringhurst, J., Gupta, I., & Campbell, R. H. (2017) · Proceedings of the VLDB Endowment · doi:10.14778/3137765.3137770 · Cited by 276
Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka
Wang, G., Chen, L., Dikshit, A., Gustafson, J., Chen, B., Sax, M. J., Roesler, J., Blee-Goldman, S., Cadonna, B., Mehta, A., et al. (2021) · Proceedings of the 2021 International Conference on Management of Data · doi:10.1145/3448016.3457556 · Cited by 74
Metadata
- Authors
- Castro Fernandez, R., Migliavacca, M., Kalyvianaki, E., & Pietzuch, P.
- Venue
- Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data
- Publisher
- ACM
- Published
- 2013-06-22
- Pages
- 725-736
- ISSN
- 0730-8078 (ISSN-L)
- OpenAlex
- W2152558130
- Cited by
- 338
- References
- 23
- FWCI
- 28.22
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Integrating scale out and fault tolerance in stream processing using operator state management. https://app.cochat.ai/papers/10.1145/2463676.2465282
- The paper
- Castro Fernandez, R., Migliavacca, M., Kalyvianaki, E., & Pietzuch, P. (2013). Integrating scale out and fault tolerance in stream processing using operator state management. Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data. https://doi.org/10.1145/2463676.2465282
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.