The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Dask: Parallel Computation with Blocked algorithms and Task Scheduling
Open accessAbstract
Dask enables parallel and out-of-core computation.We couple blocked algorithms with dynamic and memory aware task scheduling to achieve a parallel and out-of-core NumPy clone.We show how this extends the effective scale of modern hardware to larger datasets and discuss how these ideas can be more broadly applied to other parallel collections.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Leveraging the dask parallel computing library [21], xarray can optionally perform efficient parallel, out-of-core analysis on datasets that are too large to fit into memory.”
From xarray: N-D labeled Arrays and Datasets in Python (2017) · cites this paper as [21]
In the citing paper
“Out-of-core computation: xarray’s data structures can be backed by dask [21] instead of NumPy to support parallel and streaming computation on data that does not fit into memory, up to 100s of GB or TBs in size.”
From xarray: N-D labeled Arrays and Datasets in Python (2017) · cites this paper as [21]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Data Structures for Statistical Computing in Python
McKinney, W. (2010) · Proceedings of the Python in Science Conference · doi:10.25080/majora-92bf1922-00a · Cited by 11,032
The NumPy Array: A Structure for Efficient Numerical Computation
van der Walt, S., Colbert, S. C., & Varoquaux, G. (2011) · Computing in Science & Engineering · doi:10.1109/mcse.2011.37 · Cited by 9,381
(2010) · Cited by 4,411
Python for scientific computing
Oliphant, T. E. (2007) · Computing in Science & Engineering · doi:10.1109/mcse.2007.58 · Cited by 3,303
Dryad: distributed data-parallel programs from sequential building blocks
Isard, M., Budiu, M., Yu, Y., Birrell, A., & Fetterly, D. (2007) · Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007 · doi:10.1145/1272996.1273005 · Cited by 2,432
Theano: A CPU and GPU Math Compiler in Python
Bergstra, J., Breuleux, O., Bastien, F., Lamblin, P., Pascanu, R., Desjardins, G., Turian, J., Warde-Farley, D., & Bengio, Y. (2010) · Proceedings of the Python in Science Conference · doi:10.25080/majora-92bf1922-003 · Cited by 1,052
A class of parallel tiled linear algebra algorithms for multicore architectures
Buttari, A., Langou, J., Kurzak, J., & Dongarra, J. (2009) · Parallel Computing · doi:10.1016/j.parco.2008.10.002 · Cited by 529
Numerical linear algebra on emerging architectures: The PLASMA and MAGMA projects
Agullo, E., Demmel, J., Dongarra, J., Hadri, B., Kurzak, J., Langou, J., Ltaief, H., Luszczek, P., & Tomov, S. (2009) · Journal of Physics: Conference Series · doi:10.1088/1742-6596/180/1/012037 · Cited by 420
Elemental: A New Framework for Distributed Memory Dense Matrix Computations
Poulson, J., Marker, B., van de Geijn, R. A., Hammond, J. R., & Romero, N. A. (2013) · ACM Transactions on Mathematical Software · doi:10.1145/2427023.2427030 · Cited by 209
Abstractions for In-memory Distributed Computation
Power, R., & Power, C. R. (2014) · Cited by 1
Cited by
CellProfiler 4: improvements in speed, utility and usability
Stirling, D. R., Swain-Bowden, M. J., Lucas, A. M., Carpenter, A. E., Cimini, B. A., & Goodman, A. (2021) · BMC Bioinformatics · doi:10.1186/s12859-021-04344-9 · Cited by 2,070
MDAnalysis: A Python Package for the Rapid Analysis of Molecular Dynamics Simulations
Gowers, R., Linke, M., Barnoud, J., Reddy, T., Melo, M., Seyler, S., Domański, J., Dotson, D., Buchoux, S., Kenney, I., et al. (2016) · Proceedings of the Python in Science Conference · doi:10.25080/majora-629e541a-00e · Cited by 2,026
xarray: N-D labeled Arrays and Datasets in Python
Hoyer, S., & Hamman, J. (2017) · Journal of Open Research Software · doi:10.5334/jors.148 · Cited by 1,856
Time Series FeatuRe Extraction on basis of Scalable Hypothesis tests (tsfresh – A Python package)
Christ, M., Braun, N., Neuffer, J., & Kempa-Liehr, A. W. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.03.067 · Cited by 1,257
Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges
Bischl, B., Binder, M., Lang, M., Pielok, T., Richter, J., Coors, S., Thomas, J., Ullmann, T., Becker, M., Boulesteix, A., et al. (2023) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1484 · Cited by 930
Metadata
- Authors
- Rocklin, M.
- Venue
- Proceedings of the Python in Science Conference
- Publisher
- SciPy
- Published
- 2015
- Pages
- 126-132
- ISSN
- 2575-9752 (ISSN-L)
- OpenAlex
- W2527672088
- Cited by
- 801
- References
- 10
- FWCI
- 8.90
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.