The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Pegasus: A Framework for Mapping Complex Scientific Workflows onto Distributed Systems
Open accessAbstract
This paper describes the Pegasus framework that can be used to map complex scientific workflows onto distributed resources. Pegasus enables users to represent the workflows at an abstract level without needing to worry about the particulars of the target execution systems. The paper describes general issues in mapping applications and the functionality of Pegasus. We present the results of improving application performance through workflow restructuring which clusters multiple tasks in a workflow into single entities. A real‐life astronomy application is used as the basis for the study.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Grid 2: Blueprint for a New Computing Infrastructure
Foster, I. T., & Kesselman, C. (1998) · Cited by 7,637
Self-citationMPI: A Message-Passing Interface Standard
Forum, M. P. (1994) · Cited by 3,443
Grid information services for distributed resource sharing
Czajkowski, K., Fitzgerald, S., Foster, I. T., et al. (2002) · IEEE International Symposium on High Performance Distributed Computing (HPDC) · doi:10.1109/hpdc.2001.945188 · Cited by 1,556
The Grid 2: Blueprint for a New Computing Infrastructure
van Nieuwpoort, R. V. (2003) · Grid Computing · Cited by 1,466
Why and Where: A Characterization of Data Provenance
Buneman, P., Khanna, S., & Wang-Chiew, T. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-44503-x_20 · Cited by 1,334
The MPI Message Passing Interface Standard
Clarke, L., Glendinning, I., & Hempel, R. (1994) · Programming Environments for Massively Parallel Distributed Systems · doi:10.1007/978-3-0348-8534-8_21 · Cited by 1,295
A resource management architecture for metacomputing systems
Czajkowski, K., Foster, I., Karonis, N., Kesselman, C., Martin, S., Smith, W., & Tuecke, S. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0053981 · Cited by 782
Self-citationChimera: a virtual data system for representing, querying, and automating data derivation
Foster, I., Vockler, J., Wilde, M., & Zhao, Y. (2002) · Proceedings 14th International Conference on Scientific and Statistical Database Management · doi:10.1109/ssdm.2002.1029704 · Cited by 605
Welch, V., Siebenlist, F., Foster, I. T., et al. (2004) · doi:10.1109/hpdc.2003.1210015 · Cited by 505
Pegasus: Mapping Scientific Workflows onto the Grid
Deelman, E., Blythe, J., Gil, Y., Kesselman, C., Mehta, G., Patil, S., Su, M.-H., Vahi, K., & Livny, M. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-28642-4_2 · Cited by 485
Self-citation
Cited by
KBase: The United States Department of Energy Systems Biology Knowledgebase
(2018) · doi:10.1038/nbt.4163 · Cited by 1,624
Globus Toolkit Version 4: Software for Service-Oriented Systems
Foster, I. (2005) · Lecture Notes in Computer Science · doi:10.1007/11577188_2 · Cited by 1,287
Globus Toolkit Version 4: Software for Service-Oriented Systems
Foster, I. (2006) · Journal of Computer Science and Technology · doi:10.1007/s11390-006-0513-y · Cited by 908
Ten Simple Rules for Reproducible Computational Research
Sandve, G. K., Nekrutenko, A., Taylor, J., & Hovig, E. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003285 · Cited by 880
“Such executable descriptions [10] might come in the form of simple shell scripts or makefiles [15,16] at the command line, or in the form of stored workflows in a workflow management system [10,11,13,17,18].”
BackgroundPandey, S., Wu, L., Guru, S. M., & Buyya, R. (2010) · 2010 24th IEEE International Conference on Advanced Information Networking and Applications · doi:10.1109/aina.2010.31 · Cited by 880
Workflows and e-Science: An overview of workflow system features and capabilities
Deelman, E., Gannon, D., Shields, M., & Taylor, I. (2009) · Future Generation Computer Systems · doi:10.1016/j.future.2008.06.012 · Cited by 831
Self-citationCharacterizing and profiling scientific workflows
Juve, G., Chervenak, A., Deelman, E., Bharathi, S., Mehta, G., & Vahi, K. (2013) · Future Generation Computer Systems · doi:10.1016/j.future.2012.08.015 · Cited by 788
Self-citationList Scheduling Algorithm for Heterogeneous Systems by an Optimistic Cost Table
Arabnejad, H., & Barbosa, J. G. (2014) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2013.57 · Cited by 653
FireWorks: a dynamic workflow system designed for high‐throughput applications
Jain, A., Ong, S. P., Chen, W., Medasani, B., Qu, X., Kocher, M., Brafman, M., Petretto, G., Rignanese, G., Hautier, G., et al. (2015) · Concurrency and Computation: Practice and Experience · doi:10.1002/cpe.3505 · Cited by 547
Examining the Challenges of Scientific Workflows
Gil, Y., Deelman, E., Ellisman, M., Fahringer, T., Fox, G., Gannon, D., Goble, C., Livny, M., Moreau, L., & Myers, J. (2007) · Computer · doi:10.1109/mc.2007.421 · Cited by 518
Self-citationGW150914: First results from the search for binary black hole coalescence with Advanced LIGO
Abbott, B. P., Abbott, R., Abbott, T. D., Abernathy, M. R., Acernese, F., Ackley, K., Adams, C., Adams, T., Addesso, P., Adhikari, R. X., et al. (2016) · Physical Review D · doi:10.1103/physrevd.93.122003 · Cited by 496
Provenance and scientific workflows: challenges and opportunities
Davidson, S. B., & Freire, J. (2008) · Proceedings of the 2008 ACM SIGMOD international conference on Management of data · doi:10.1145/1376616.1376772 · Cited by 468
Ecoinformatics: supporting ecology as a data-intensive science
Michener, W. K., & Jones, M. B. (2012) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2011.11.016 · Cited by 441
The design and realisation of the Virtual Research Environment for social sharing of workflows
De Roure, D., Goble, C., & Stevens, R. (2009) · Future Generation Computer Systems · doi:10.1016/j.future.2008.06.010 · Cited by 432
(2007) · Springer eBooks · doi:10.1007/978-1-84628-757-2 · Cited by 423
Swift: A language for distributed parallel scripting
Wilde, M., Hategan, M., Wozniak, J. M., Clifford, B., Katz, D. S., & Foster, I. (2011) · Parallel Computing · doi:10.1016/j.parco.2011.05.005 · Cited by 402
Self-citationEvolutionary Multi-Objective Workflow Scheduling in Cloud
Zhu, Z., Zhang, G., Li, M., & Liu, X. (2016) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2015.2446459 · Cited by 401
On the Use of Cloud Computing for Scientific Workflows
Hoffa, C., Mehta, G., Freeman, T., Deelman, E., Keahey, K., Berriman, B., & Good, J. (2008) · 2008 IEEE Fourth International Conference on eScience · doi:10.1109/escience.2008.167 · Cited by 359
Self-citationSwift: Fast, Reliable, Loosely Coupled Parallel Computation
Zhao, Y., Hategan, M., Clifford, B., Foster, I., von Laszewski, G., Nefedova, V., Raicu, I., Stef-Praun, T., & Wilde, M. (2007) · 2007 IEEE Congress on Services (Services 2007) · doi:10.1109/services.2007.63 · Cited by 352
G-Hadoop: MapReduce across distributed data centers for data-intensive computing
Wang, L., Tao, J., Ranjan, R., Marten, H., Streit, A., Chen, J., & Chen, D. (2013) · Future Generation Computer Systems · doi:10.1016/j.future.2012.09.001 · Cited by 325
Web Service Composition: A Survey of Techniques and Tools
Lemos, A. L., Daniel, F., & Benatallah, B. (2016) · ACM Computing Surveys · doi:10.1145/2831270 · Cited by 320
The iPlant Collaborative: Cyberinfrastructure for Enabling Data to Discovery for the Life Sciences
Merchant, N., Lyons, E., Goff, S., Vaughn, M., Ware, D., Micklos, D., & Antin, P. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002342 · Cited by 307
A survey on provenance: What for? What form? What from?
Herschel, M., Diestelkämper, R., & Ben Lahmar, H. (2017) · The VLDB Journal · doi:10.1007/s00778-017-0486-1 · Cited by 300
Falkon: a Fast and Light-weight tasK executiON framework
Raicu, I., Zhao, Y., Dumitrescu, C., Foster, I., & Wilde, M. (2007) · Proceedings of the 2007 ACM/IEEE conference on Supercomputing · doi:10.1145/1362622.1362680 · Cited by 299
A Survey of Data-Intensive Scientific Workflow Management
Liu, J., Pacitti, E., Valduriez, P., & Mattoso, M. (2015) · Journal of Grid Computing · doi:10.1007/s10723-015-9329-8 · Cited by 297
A CyberGIS Framework for the Synthesis of Cyberinfrastructure, GIS, and Spatial Analysis
Wang, S. (2010) · Annals of the Association of American Geographers · doi:10.1080/00045601003791243 · Cited by 296
Exploiting Dynamic Resource Allocation for Efficient Parallel Data Processing in the Cloud
Warneke, D., & Kao, O. (2011) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2011.65 · Cited by 276
HCOC: a cost optimization algorithm for workflow scheduling in hybrid clouds
Bittencourt, L. F., & Madeira, E. R. M. (2011) · Journal of Internet Services and Applications · doi:10.1007/s13174-011-0032-0 · Cited by 268
Cost optimized provisioning of elastic resources for application workflows
Byun, E.-K., Kee, Y.-S., Kim, J.-S., & Maeng, S. (2011) · Future Generation Computer Systems · doi:10.1016/j.future.2011.05.001 · Cited by 263
Scientific workflow applications on Amazon EC2
Juve, G., Deelman, E., Vahi, K., Mehta, G., Berriman, B., Berman, B. P., & Maechling, P. (2009) · 2009 5th IEEE International Conference on E-Science Workshops · doi:10.1109/esciw.2009.5408002 · Cited by 255
Self-citationA systematic review of provenance systems
Pérez, B., Rubio, J., & Sáenz-Adán, C. (2018) · Knowledge and Information Systems · doi:10.1007/s10115-018-1164-3 · Cited by 66
gmxapi: A GROMACS-native Python interface for molecular dynamics with ensemble and plugin support
Irrgang, M. E., Davis, C., & Kasson, P. M. (2022) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1009835 · Cited by 25
Metadata
- Authors
- Deelman, E., Singh, G., Su, M.-H., Blythe, J., Gil, Y., Kesselman, C., Mehta, G., Vahi, K., Berriman, G. B., Good, J., Laity, A., Jacob, J. C., & Katz, D. S.
- Venue
- Scientific Programming
- Publisher
- Wiley
- Published
- 2005-01
- Volume
- 13
- Issue
- 3
- Pages
- 219-237
- ISSN
- 1058-9244 (ISSN-L)
- 1875-919X
- OpenAlex
- W2129666400
- Cited by
- 1,222
- References
- 15
- FWCI
- 59.36
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.