The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Falkon: a Fast and Light-weight tasK executiON framework
Abstract
To enable the rapid execution of many tasks on compute clusters, we have developed Falkon, a Fast and Light-weight tasK executiON framework. Falkon integrates (1) multi-level scheduling to separate resource acquisition (via, e.g., requests to batch schedulers) from task dispatch, and (2) a streamlined dispatcher. Falkon's integration of multi-level scheduling and streamlined dispatchers delivers performance not provided by any other system. We describe Falkon architecture and implementation, and present performance results for both microbenchmarks and applications. Microbenchmarks show that Falkon throughput (487 tasks/sec) and scalability (to 54,000 executors and 2,000,000 tasks processed in just 112 minutes) are one to two orders of magnitude better than other systems used in production Grids. Large-scale astronomy and medical applications executed under Falkon by the Swift parallel programming system achieve up to 90% reduction in end-to-end run time, relative to versions that execute tasks via separate scheduler submissions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Equation of State Calculations by Fast Computing Machines
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. (1953) · The Journal of Chemical Physics · doi:10.1063/1.1699114 · Cited by 37,192
Monte Carlo sampling methods using Markov chains and their applications.
Hastings, W. K. (1970) · Biometrika · doi:10.1093/biomet/57.1.97 · Cited by 15,195
Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems
Rowstron, A., & Druschel, P. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-45518-3_18 · Cited by 7,276
The Anatomy of the Grid: Enabling Scalable Virtual Organizations
Foster, I., Kesselman, C., & Tuecke, S. (2001) · The International Journal of High Performance Computing Applications · doi:10.1177/109434200101500302 · Cited by 6,547
Self-citationA scalable content-addressable network
Ratnasamy, S., Francis, P., Handley, M., Karp, R., & Shenker, S. (2001) · Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications · doi:10.1145/383059.383072 · Cited by 6,372
(1992) · Lecture Notes in Computer Science · doi:10.1007/bfb0022433 · Cited by 3,955
Chord: a scalable peer-to-peer lookup protocol for internet applications
Stoica, I., Morris, R., Liben-Nowell, D., Karger, D. R., Kaashoek, M. F., Dabek, F., & Balakrishnan, H. (2003) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2002.808407 · Cited by 3,133
Distributed Systems: Principles and Paradigms
Tanenbaum, A. S., & van Steen, M. R. (2001) · Cited by 2,189
BOINC: A System for Public-Resource Computing and Storage
Anderson, D. P. (2005) · Fifth IEEE/ACM International Workshop on Grid Computing · doi:10.1109/grid.2004.14 · Cited by 1,924
Distributed computing in practice: the Condor experience
Thain, D., Tannenbaum, T., & Livny, M. (2005) · Concurrency and Computation: Practice and Experience · doi:10.1002/cpe.938 · Cited by 1,886
Globus Toolkit Version 4: Software for Service-Oriented Systems
Foster, I. (2005) · Lecture Notes in Computer Science · doi:10.1007/11577188_2 · Cited by 1,287
Self-citationFunctional Magnetic Resonance Imaging
(2014) · Encyclopedia of Criminal Justice Ethics · doi:10.4135/9781452274102.n135 · Cited by 1,225
Pegasus: A Framework for Mapping Complex Scientific Workflows onto Distributed Systems
Deelman, E., Singh, G., Su, M.-H., Blythe, J., Gil, Y., Kesselman, C., Mehta, G., Vahi, K., Berriman, G. B., Good, J., et al. (2005) · Scientific Programming · doi:10.1155/2005/128026 · Cited by 1,222
Department of Computer Science
(1993) · Journal of Computational and Applied Mathematics · doi:10.1016/0377-0427(93)90083-n · Cited by 1,210
Introduction to Distributed Algorithms
Tel, G. (2000) · Cambridge University Press eBooks · doi:10.1017/cbo9781139168724 · Cited by 859
Fastest Mixing Markov Chain on a Graph
Boyd, S., Diaconis, P., & Xiao, L. (2004) · SIAM Review · doi:10.1137/s0036144503423264 · Cited by 744
On the minimal synchronism needed for distributed consensus
Dolev, D., Dwork, C., & Stockmeyer, L. (1987) · Journal of the ACM · doi:10.1145/7531.7533 · Cited by 620
Chimera: a virtual data system for representing, querying, and automating data derivation
Foster, I., Vockler, J., Wilde, M., & Zhao, Y. (2002) · Proceedings 14th International Conference on Scientific and Statistical Database Management · doi:10.1109/ssdm.2002.1029704 · Cited by 605
Self-citationRandom walks in peer-to-peer networks
Gkantsidis, C., Mihail, M., & Saberi, A. (2004) · IEEE INFOCOM 2004 · doi:10.1109/infcom.2004.1354487 · Cited by 525
Thain, D., Tannenbaum, T., & Livny, M. (2003) · Grid Computing · doi:10.1002/0470867167.ch11 · Cited by 505
Average Case Analysis of Algorithms on Sequences
Szpankowski, W. (2001) · Wiley eBooks · doi:10.1002/9781118032770 · Cited by 482
Foster, I. T., Kesselman, C., & Tuecke, S. J. (2003) · Grid Computing · doi:10.1002/0470867167.ch6 · Cited by 477
Self-citationSun Grid Engine: towards creating a compute power grid
Gentzsch, W. (2002) · Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid · doi:10.1109/ccgrid.2001.923173 · Cited by 377
Swift: Fast, Reliable, Loosely Coupled Parallel Computation
Zhao, Y., Hategan, M., Clifford, B., Foster, I., von Laszewski, G., Nefedova, V., Raicu, I., Stef-Praun, T., & Wilde, M. (2007) · 2007 IEEE Congress on Services (Services 2007) · doi:10.1109/services.2007.63 · Cited by 352
Self-citationOceano-SLA based management of a computing utility
Appleby, K., Fakhouri, S., Fong, L., Goldszmidt, G., Kalantar, M., Krishnakumar, S., Pazel, D. P., Pershing, J., & Rochwerger, B. (2002) · 2001 IEEE/IFIP International Symposium on Integrated Network Management Proceedings. Integrated Network Management VII. Integrated Management Strategies for the New Millennium (Cat. No.01EX470) · doi:10.1109/inm.2001.918085 · Cited by 321
Montage: a grid-enabled engine for delivering custom science-grade mosaics on demand
Berriman, G. B., Deelman, E., Good, J. C., Jacob, J. C., Katz, D. S., Kesselman, C., Laity, A. C., Prince, T. A., Singh, G., & Su, M.-H. (2004) · SPIE Proceedings · doi:10.1117/12.550551 · Cited by 193
Estimating Aggregates on a Peer-to-Peer Network
Bawa, M., García-Molina, H., Gionis, A., et al. (2003) · Cited by 175
High-Performance Task Distribution for Volunteer Computing
Anderson, D. P., Korpela, E., & Walton, R. (2006) · First International Conference on e-Science and Grid Computing (e-Science'05) · doi:10.1109/e-science.2005.51 · Cited by 167
Catlett, C., Allcock, W. E., Andrews, P., Aydt, R. A., Bair, R. A., Balac, N., Banister, B. C., Barker, T., Bartelt, M., Beckman, P., et al. (2008) · IUScholarWorks (Indiana University) · Cited by 152
Self-citationEstimating network size from local information
Horowitz, K., & Malkhi, D. (2003) · Information Processing Letters · doi:10.1016/j.ipl.2003.08.011 · Cited by 67
AstroPortal: A Science Gateway for Large-scale Astronomy Data Analysis
Raicu, I., Foster, I. T., Szalay, A. S., & Turcu, G. (2006) · Cited by 44
Self-citation
Cited by
Cloud Computing and Grid Computing 360-Degree Compared
Foster, I., Zhao, Y., Raicu, I., & Lu, S. (2008) · 2008 Grid Computing Environments Workshop · doi:10.1109/gce.2008.4738445 · Cited by 2,912
Self-citationRemote sensing big data computing: Challenges and opportunities
Ma, Y., Wu, H., Wang, L., Huang, B., Ranjan, R., Zomaya, A., & Jie, W. (2015) · Future Generation Computer Systems · doi:10.1016/j.future.2014.10.029 · Cited by 676
Swift: Fast, Reliable, Loosely Coupled Parallel Computation
Zhao, Y., Hategan, M., Clifford, B., Foster, I., von Laszewski, G., Nefedova, V., Raicu, I., Stef-Praun, T., & Wilde, M. (2007) · 2007 IEEE Congress on Services (Services 2007) · doi:10.1109/services.2007.63 · Cited by 352
Self-citationExploiting Dynamic Resource Allocation for Efficient Parallel Data Processing in the Cloud
Warneke, D., & Kao, O. (2011) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2011.65 · Cited by 276
Metadata
- Authors
- Raicu, I., Zhao, Y., Dumitrescu, C., Foster, I., & Wilde, M.
- Venue
- Proceedings of the 2007 ACM/IEEE conference on Supercomputing
- Publisher
- ACM
- Published
- 2007-11-10
- Pages
- 1-12
- ISSN
- 1063-9535 (ISSN-L)
- OpenAlex
- W2123130398
- Cited by
- 299
- References
- 31
- FWCI
- 23.67
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.