The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
RIoTBench: An IoT benchmark for distributed stream processing systems
Open accessAbstract
Summary: The Internet of Things (IoT) is an emerging technology paradigm where millions of sensors and actuators help monitor and manage physical, environmental, and human systems in real time. The inherent closed‐loop responsiveness and decision making of IoT applications make them ideal candidates for using low latency and scalable stream processing platforms. Distributed stream processing systems (DSPS) hosted in cloud data centers are becoming the vital engine for real‐time data processing and analytics in any IoT software architecture. But the efficacy and performance of contemporary DSPS have not been rigorously studied for IoT applications and data streams. Here, we propose RIoTBench, a real‐time IoT benchmark suite, along with performance metrics, to evaluate DSPS for streaming IoT applications. The benchmark includes 27 common IoT tasks classified across various functional categories and implemented as modular microbenchmarks. Further, we define four IoT application benchmarks composed from these tasks based on common patterns of data preprocessing, statistical summarization, and predictive analytics that are intrinsic to the closed‐loop IoT decision‐making life cycle. These are coupled with four stream workloads sourced from real IoT observations on smart cities and smart health, with peak streams rates that range from 500 to 10 000 messages/second from up to 3 million sensors. We validate the RIoTBench suite for the popular Apache Storm DSPS on the Microsoft Azure public cloud and present empirical observations. This suite can be used by DSPS researchers for performance analysis and resource scheduling, by IoT practitioners to evaluate DSPS platforms, and even reused within IoT solutions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A New Approach to Linear Filtering and Prediction Problems
Kalman, R. E. (1960) · Journal of Basic Engineering · doi:10.1115/1.3662552 · Cited by 31,751
Quinlan, J. R. (1986) · Machine Learning · doi:10.1007/bf00116251 · Cited by 21,439
Context Aware Computing for The Internet of Things: A Survey
Perera, C., Zaslavsky, A., Christen, P., & Georgakopoulos, D. (2014) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2013.042313.00197 · Cited by 2,861 · cited 1×
“The IoT stack for such domains is tightly integrated to serve specific needs, but typically operates on a closed-loop Observe Orient Decide Act (OODA) cycle [33], where sensors communicate time-series observations of the (physical or human) system to the Cloud for analysis, and the resulting analytics drives recommend…”
BackgroundmHealthDroid: A Novel Framework for Agile Development of Mobile Health Applications
Banos, O., Garcia, R., Holgado-Terriza, J. A., Damas, M., Pomares, H., Rojas, I., Saez, A., & Villalonga, C. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-13105-4_14 · Cited by 583
Cited by
AI-based fog and edge computing: A systematic review, taxonomy and future directions
Iftikhar, S., Gill, S. S., Song, C., Xu, M., Aslanpour, M. S., Toosi, A. N., Du, J., Wu, H., Ghosh, S., Chowdhury, D., et al. (2023) · Internet of Things · doi:10.1016/j.iot.2022.100674 · Cited by 260
Evaluation of distributed stream processing frameworks for IoT applications in Smart Cities
Nasiri, H., Nasehi, S., & Goudarzi, M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0215-2 · Cited by 117
Evaluation of stream processing frameworks
van Dongen, G., & Van den Poel, D. (2020) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.2978480 · Cited by 110
“Two of the most important performance indicators in stream processing systems are latency and throughput, which have been included in most previous benchmarks, e.g., [1], [3], [8], [9].”
BackgroundMethodInfluentialBenchmarking scalability of stream processing frameworks deployed as microservices in the cloud
Henning, S., & Hasselbring, W. (2024) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111879 · Cited by 85
DSPBench: A suite of benchmark applications for distributed data stream processing systems
Bordin, M. V., Griebler, D., Mencagli, G., Geyer, C. F. R., & Fernandes, L. G. L. (2020) · IEEE Access · doi:10.1109/access.2020.3043948 · Cited by 63
Metadata
- Authors
- Shukla, A., Chaturvedi, S., & Simmhan, Y.
- Venue
- Concurrency and Computation: Practice and Experience
- Publisher
- Wiley
- Published
- 2017-10-04
- Volume
- 29
- Issue
- 21
- ISSN
- 1532-0626 (ISSN-L)
- 1532-0634
- OpenAlex
- W2763018317
- Cited by
- 176
- References
- 4
- FWCI
- 11.37
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.