A Taxonomy of Workflow Management Systems for Grid Computing
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
With the advent of Grid and application technologies, scientists and engineers are building more and more complex applications to manage and process large data sets, and execute scientific experiments on distributed resources. Such application scenarios require means for composing and executing complex workflows. Therefore, many efforts have been made towards the development of workflow management systems for Grid computing. In this paper, we propose a taxonomy that characterizes and classifies various approaches for building and executing workflows on Grids. We also survey several representative Grid workflow systems developed by various projects world-wide to demonstrate the comprehensiveness of the taxonomy. The taxonomy not only highlights the design and engineering similarities and differences of state-of-the-art in Grid workflow systems, but also identifies the areas that need further research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Anatomy of the Grid: Enabling Scalable Virtual Organizations
Foster, I., Kesselman, C., & Tuecke, S. (2001) · The International Journal of High Performance Computing Applications · doi:10.1177/109434200101500302 · Cited by 6,547
van der Aalst, W. M. P., ter Hofstede, A. H. M., Kiepuszewski, B., & Barros, A. P. (2003) · Distributed and Parallel Databases · doi:10.1023/a:1022883727209 · Cited by 2,613
Generative communication in Linda
Gelernter, D. (1985) · ACM Transactions on Programming Languages and Systems · doi:10.1145/2363.2433 · Cited by 2,266
Condor-a hunter of idle workstations
Litzkow, M. J., Livny, M., & Mutka, M. W. (2003) · [1988] Proceedings. The 8th International Conference on Distributed · doi:10.1109/dcs.1988.12507 · Cited by 2,245
Petri, C. A. (1962) · Cited by 2,159
Scientific workflow management and the Kepler system
Ludäscher, B., Altıntaş, İ., Berkley, C., Higgins, D., Jaeger-Frank, E., Jones, M. B., Lee, E. A., Tao, J., & Zhao, Y. (2005) · Concurrency and Computation Practice and Experience · doi:10.1002/cpe.994 · Cited by 1,719
Taverna: a tool for the composition and enactment of bioinformatics workflows
Oinn, T., Addis, M., Ferris, J., Marvin, D., Senger, M., Greenwood, M., Carver, T., Glover, K., Pocock, M. R., Wipat, A., et al. (2004) · Bioinformatics · doi:10.1093/bioinformatics/bth361 · Cited by 1,602
Grid Computing: Making the Global Infrastructure a Reality
Berman, F., Fox, G., & Hey, T. (2003) · Cited by 1,586
Grid information services for distributed resource sharing
Czajkowski, K., Fitzgerald, S., Foster, I. T., et al. (2002) · IEEE International Symposium on High Performance Distributed Computing (HPDC) · doi:10.1109/hpdc.2001.945188 · Cited by 1,556
YAWL: yet another workflow language
van der Aalst, W. M. P., & ter Hofstede, A. H. M. (2004) · Information Systems · doi:10.1016/j.is.2004.02.002 · Cited by 1,442
Cited by
Pegasus, a workflow management system for science automation
Deelman, E., Vahi, K., Juve, G., Rynge, M., Callaghan, S., Maechling, P. J., Mayani, R., Chen, W., Ferreira da Silva, R., Livny, M., et al. (2015) · Future Generation Computer Systems · doi:10.1016/j.future.2014.10.008 · Cited by 861
“Scientific workflows [30, 68, 69, 70] often access large amounts of input data that needs to be made available to the individual jobs when they execute.”
BackgroundWorkflows and e-Science: An overview of workflow system features and capabilities
Deelman, E., Gannon, D., Shields, M., & Taylor, I. (2009) · Future Generation Computer Systems · doi:10.1016/j.future.2008.06.012 · Cited by 831
Characterizing and profiling scientific workflows
Juve, G., Chervenak, A., Deelman, E., Bharathi, S., Mehta, G., & Vahi, K. (2013) · Future Generation Computer Systems · doi:10.1016/j.future.2012.08.015 · Cited by 788
A taxonomy of scientific workflow systems for grid computing
Yu, J., & Buyya, R. (2005) · ACM SIGMOD Record · doi:10.1145/1084805.1084814 · Cited by 550
Self-citationGill, S. S., Tuli, S., Xu, M., Singh, I., Singh, K. V., Lindsay, D., Tuli, S., Smirnova, D., Singh, M., Jain, U., et al. (2019) · Internet of Things · doi:10.1016/j.iot.2019.100118 · Cited by 496
Cost-Based Scheduling of Scientific Workflow Application on Utility Grids
Yu, J., Buyya, R., & Tham, C. K. (2006) · First International Conference on e-Science and Grid Computing (e-Science'05) · doi:10.1109/e-science.2005.26 · Cited by 394
Self-citationWorkflow Scheduling Algorithms for Grid Computing
Yu, J., Buyya, R., & Ramamohanarao, K. (2008) · Studies in Computational Intelligence · doi:10.1007/978-3-540-69277-5_7 · Cited by 388
Self-citationComputational models and heuristic methods for Grid scheduling problems
Xhafa, F., & Abraham, A. (2010) · Future Generation Computer Systems · doi:10.1016/j.future.2009.11.005 · Cited by 351
A Survey of Data-Intensive Scientific Workflow Management
Liu, J., Pacitti, E., Valduriez, P., & Mattoso, M. (2015) · Journal of Grid Computing · doi:10.1007/s10723-015-9329-8 · Cited by 297
A market-oriented hierarchical scheduling strategy in cloud workflow systems
Wu, Z., Liu, X., Ni, Z., Yuan, D., & Yang, Y. (2013) · The Journal of Supercomputing · doi:10.1007/s11227-011-0578-4 · Cited by 259
A hybrid multi-objective Particle Swarm Optimization for scientific workflow scheduling
Verma, A., & Kaushal, S. (2017) · Parallel Computing · doi:10.1016/j.parco.2017.01.002 · Cited by 258
Scientific workflow applications on Amazon EC2
Juve, G., Deelman, E., Vahi, K., Mehta, G., Berriman, B., Berman, B. P., & Maechling, P. (2009) · 2009 5th IEEE International Conference on E-Science Workshops · doi:10.1109/esciw.2009.5408002 · Cited by 255
Modern computing: Vision and challenges
Gill, S. S., Wu, H., Patros, P., Ottaviani, C., Arora, P., Pujol, V. C., Haunschild, D., Parlikad, A. K., Cetinkaya, O., Lutfiyya, H., et al. (2024) · Telematics and Informatics Reports · doi:10.1016/j.teler.2024.100116 · Cited by 197
“To handle massive amounts of data (including dealing with transactions, customer data analysis, and censuses), a high-speed machine with large computing power is required [17].”
BackgroundSelf-citationPractical guide for managing large-scale human genome data in research
Tanjo, T., Kawai, Y., Tokunaga, K., Ogasawara, O., & Nagasaki, M. (2021) · Journal of Human Genetics · doi:10.1038/s10038-020-00862-1 · Cited by 62
Metadata
- Authors
- Yu, J., & Buyya, R.
- Venue
- Journal of Grid Computing
- Published
- 2005-09
- Volume
- 3
- Issue
- 3-4
- Pages
- 171-200
- ISSN
- 1570-7873 (ISSN-L)
- 1572-9184
- OpenAlex
- W2025577327
- Cited by
- 834
- References
- 36
- FWCI
- 82.62
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.