The DOI matches its Crossref record.
Load Balancing for MapReduce-based Entity Resolution
Abstract
The effectiveness and scalability of MapReduce-based implementations of complex data-intensive tasks depend on an even redistribution of data between map and reduce tasks. In the presence of skewed data, sophisticated redistribution approaches thus become necessary to achieve load balancing among all reduce tasks to be executed in parallel. For the complex problem of entity resolution, we propose and evaluate two approaches for such skew handling and load balancing. The approaches support blocking techniques to reduce the search space of entity resolution, utilize a preprocessing MapReduce job to analyze the data distribution, and distribute the entities of large blocks among multiple reduce tasks. The evaluation on a real cloud infrastructure shows the value and effectiveness of the proposed load balancing approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
IoT-Based Big Data Storage Systems in Cloud Computing: Perspectives and Challenges
Cai, H., Xu, B., Jiang, L., & Vasilakos, A. V. (2017) · IEEE Internet of Things Journal · doi:10.1109/jiot.2016.2619369 · Cited by 588
Dong, X. L., & Srivastava, D. (2015) · Synthesis Lectures on Data Management · doi:10.1007/978-3-031-01853-4 · Cited by 539
Load-balancing algorithms in cloud computing: A survey
Jafarnejad Ghomi, E., Masoud Rahmani, A., & Nasih Qader, N. (2017) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2017.04.007 · Cited by 425
A Survey of Load Balancing in Cloud Computing: Challenges and Algorithms
Nuaimi, K. A., Mohamed, N., Nuaimi, M. A., & Al-Jaroodi, J. (2012) · 2012 Second Symposium on Network Cloud Computing and Applications · doi:10.1109/ncca.2012.29 · Cited by 322
Metadata
- Authors
- Kolb, L., Thor, A., & Rahm, E.
- Venue
- 2012 IEEE 28th International Conference on Data Engineering
- Publisher
- IEEE
- Published
- 2012-04
- Pages
- 618-629
- ISSN
- 1084-4627 (ISSN-L)
- OpenAlex
- W2070162726
- Cited by
- 158
- References
- 0
- FWCI
- 14.91
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.