The DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index.
A taxonomy of Data Grids for distributed data sharing, management, and processing
Open accessAbstract
Data Grids have been adopted as the next generation platform by many scientific communities that need to share, access, transport, process, and manage large data collections distributed worldwide. They combine high-end computing technologies with high-performance networking and wide-area storage management techniques. In this article, we discuss the key concepts behind Data Grids and compare them with other data sharing and distribution paradigms such as content delivery networks, peer-to-peer networks, and distributed databases. We then provide comprehensive taxonomies that cover various aspects of architecture, data transportation, data replication and resource allocation, and scheduling. Finally, we map the proposed taxonomy to various Data Grid systems not only to validate the taxonomy but also to identify areas for future exploration.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Akyildiz, I. F., Su, W., Sankarasubramaniam, Y., & Cayirci, E. (2002) · IEEE Communications Magazine · doi:10.1109/mcom.2002.1024422 · Cited by 13,644
Chord: A scalable peer-to-peer lookup service for internet applications
Stoica, I., Morris, R., Karger, D., Kaashoek, M. F., & Balakrishnan, H. (2001) · Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications · doi:10.1145/383059.383071 · Cited by 9,623
COUNTERSPECULATION, AUCTIONS, AND COMPETITIVE SEALED TENDERS
Vickrey, W. (1961) · The Journal of Finance · doi:10.1111/j.1540-6261.1961.tb02789.x · Cited by 7,722
The Grid 2: Blueprint for a New Computing Infrastructure
Foster, I. T., & Kesselman, C. (1998) · Cited by 7,637
Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems
Rowstron, A., & Druschel, P. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-45518-3_18 · Cited by 7,276
The Anatomy of the Grid: Enabling Scalable Virtual Organizations
Foster, I., Kesselman, C., & Tuecke, S. (2001) · The International Journal of High Performance Computing Applications · doi:10.1177/109434200101500302 · Cited by 6,547
A scalable content-addressable network
Ratnasamy, S., Francis, P., Handley, M., Karp, R., & Shenker, S. (2001) · Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications · doi:10.1145/383059.383072 · Cited by 6,372
Role-based access control models
Sandhu, R. S., Coyne, E. J., Feinstein, H. L., & Youman, C. E. (1996) · Computer · doi:10.1109/2.485845 · Cited by 5,892
A Extensible Markup Language XML
(2009) · Foundations of Semantic Web Technologies · doi:10.1201/9781420090512-18 · Cited by 4,824
Chord: a scalable peer-to-peer lookup protocol for internet applications
Stoica, I., Morris, R., Liben-Nowell, D., Karger, D. R., Kaashoek, M. F., Dabek, F., & Balakrishnan, H. (2003) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2002.808407 · Cited by 3,133
Transaction Processing: Concepts and Techniques
Gray, J., & Reuter, A. (1992) · Cited by 3,000
Incentives Build Robustness in Bit-Torrent
Cohen, B. (2003) · Cited by 2,677
Federated database systems for managing distributed, heterogeneous, and autonomous databases
Sheth, A. P., & Larson, J. A. (1990) · ACM Computing Surveys · doi:10.1145/96602.96604 · Cited by 2,476
Principles of Distributed Database Systems
Özsu, M. T., & Valduriez, P. (2020) · Springer eBooks · doi:10.1007/978-3-030-26253-2 · Cited by 2,345
Freenet: A Distributed Anonymous Information Storage and Retrieval System
Clarke, I., Sandberg, O., Wiley, B., & Hong, T. W. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-44702-4_4 · Cited by 2,109
OceanStore: an architecture for global-scale persistent storage
Kubiatowicz, J., Bindel, D., Chen, Y., Czerwinski, S., Eaton, P., Geels, D., Gummadi, R., Rhea, S., Weatherspoon, H., Weimer, W., et al. (2000) · ACM SIGPLAN Notices · doi:10.1145/356989.357007 · Cited by 2,002
Grid services for distributed system integration
Foster, I., Kesselman, C., Nick, J. M., & Tuecke, S. (2002) · Computer · doi:10.1109/mc.2002.1009167 · Cited by 1,956
Andersen, D., Balakrishnan, H., Kaashoek, F., & Morris, R. (2001) · Proceedings of the eighteenth ACM symposium on Operating systems principles · doi:10.1145/502034.502048 · Cited by 1,868
Bray, T., Paoli, J., & Sperberg-McQueen, C. M. (1997) · World Wide Web · doi:10.5555/274784.273625 · Cited by 1,697
Grid Computing: Making the Global Infrastructure a Reality
Berman, F., Fox, G., & Hey, T. (2003) · Cited by 1,586
Grid information services for distributed resource sharing
Czajkowski, K., Fitzgerald, S., Foster, I. T., et al. (2002) · IEEE International Symposium on High Performance Distributed Computing (HPDC) · doi:10.1109/hpdc.2001.945188 · Cited by 1,556
Kerberos: an authentication service for computer networks
Neuman, B. C., & Ts'o, T. (1994) · IEEE Communications Magazine · doi:10.1109/35.312841 · Cited by 1,337
Internet X.509 Public Key Infrastructure Certificate and Certificate Revocation List (CRL) Profile
Housley, R., Polk, W., Ford, W., & Solo, D. (2002) · doi:10.17487/rfc3280 · Cited by 1,306
SETI@home: an experiment in public-resource computing
Anderson, D. P., Cobb, J., Korpela, E., Lebofsky, M., & Werthimer, D. (2002) · Communications of the ACM · doi:10.1145/581571.581573 · Cited by 1,302
Globus Toolkit Version 4: Software for Service-Oriented Systems
Foster, I. (2005) · Lecture Notes in Computer Science · doi:10.1007/11577188_2 · Cited by 1,287
Introduction: Service-oriented computing
Papazoglou, M. P., & Georgakopoulos, D. (2003) · Communications of the ACM · doi:10.1145/944217.944233 · Cited by 1,116
Chervenak, A., Foster, I. T., Kesselman, C., Salisbury, C., & Tuecke, S. J. (2000) · Journal of Network and Computer Applications · doi:10.1006/jnca.2000.0110 · Cited by 1,107
(2001) · Cited by 1,052
The dangers of replication and a solution
Gray, J., Helland, P., O'Neil, P., & Shasha, D. (1996) · Proceedings of the 1996 ACM SIGMOD international conference on Management of data - SIGMOD '96 · doi:10.1145/233269.233330 · Cited by 1,019
(2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-662-45391-9 · Cited by 1,001
A taxonomy and survey of grid resource management systems for distributed computing
Krauter, K., Buyya, R., & Maheswaran, M. (2001) · Software Practice and Experience · doi:10.1002/spe.432 · Cited by 939
Self-citationGlobus Toolkit Version 4: Software for Service-Oriented Systems
Foster, I. (2006) · Journal of Computer Science and Technology · doi:10.1007/s11390-006-0513-y · Cited by 908
OceanStore: an architecture for global-scale persistent storage
Kubiatowicz, J., Bindel, D., Chen, Y., Czerwinski, S., Eaton, P., Geels, D., Gummadi, R., Rhea, S., Weatherspoon, H., Weimer, W., et al. (2000) · Proceedings of the ninth international conference on Architectural support for programming languages and operating systems · doi:10.1145/378993.379239 · Cited by 869
Milojicic, D. S., Kalogeraki, V., Lukose, R. M., Nagaraja, K., Pruyne, J., Richard, B., Rollins, S., & Xu, Z. (2002) · Cited by 867
Dynamic Mapping of a Class of Independent Tasks onto Heterogeneous Computing Systems
Maheswaran, M., Ali, S., Siegel, H. J., Hensgen, D., & Freund, R. F. (1999) · Journal of Parallel and Distributed Computing · doi:10.1006/jpdc.1999.1581 · Cited by 819
The state of the art in distributed query processing
Kossmann, D. (2000) · ACM Computing Surveys · doi:10.1145/371578.371598 · Cited by 813
A resource management architecture for metacomputing systems
Czajkowski, K., Foster, I., Karonis, N., Kesselman, C., Martin, S., Smith, W., & Tuecke, S. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0053981 · Cited by 782
Distributed Databases: Principles and Systems
Ceri, S., & Pelagatti, G. (1984) · CERN Document Server (European Organization for Nuclear Research) · Cited by 713
Globally distributed content delivery
Dilley, J., Maggs, B., Parikh, J., Prokop, H., Sitaraman, R., & Weihl, B. (2002) · IEEE Internet Computing · doi:10.1109/mic.2002.1036038 · Cited by 691
Replication strategies in unstructured peer-to-peer networks
Cohen, E., & Shenker, S. J. (2002) · ACM SIGCOMM Conference (SIGCOMM) · doi:10.1145/633025.633043 · Cited by 683
Guided Self-Scheduling: A Practical Scheduling Scheme for Parallel Supercomputers
Polychronopoulos, C. D., & Kuck, D. J. (1987) · IEEE Transactions on Computers · doi:10.1109/tc.1987.5009495 · Cited by 607
Data management and transfer in high-performance computational grid environments
Allcock, B., Bester, J., Bresnahan, J., Chervenak, A., Foster, I. T., Kesselman, C., Meder, S., Nefedova, V., Quesnel, D., & Tuecke, S. J. (2002) · Parallel Computing · doi:10.1016/s0167-8191(02)00094-7 · Cited by 581
Postel, J., & Reynolds, J. (1985) · doi:10.17487/rfc0959 · Cited by 568
Heuristics for scheduling parameter sweep applications in grid environments
Casanova, H., Legrand, A., Zagorodnov, D., & Berman, F. (2002) · Heterogeneous Computing Workshop (HCW) · doi:10.1109/hcw.2000.843757 · Cited by 565
Improving data locality with loop transformations
McKinley, K. S., Carr, S., & Tseng, C.-W. (1996) · ACM Transactions on Programming Languages and Systems · doi:10.1145/233561.233564 · Cited by 551
The SDSC storage resource broker
Baru, C., Moore, R., Rajasekar, A., & Wan, M. (2010) · CASCON First Decade High Impact Papers on - CASCON '10 · doi:10.1145/1925805.1925816 · Cited by 550
An analysis of Internet content delivery systems
Saroiu, S., Gummadi, K. P., Dunn, R. J., Gribble, S. D., & Levy, H. M. (2002) · ACM SIGOPS Operating Systems Review · doi:10.1145/844128.844158 · Cited by 546
On Death, Taxes, and the Convergence of Peer-to-Peer and Grid Computing
Foster, I., & Iamnitchi, A. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-45172-3_11 · Cited by 504
Analysis of the SSL 3.0 protocol
Wagner, D. A., & Schneier, B. (1996) · Cited by 486
Decoupling computation and data scheduling in distributed data-intensive applications
Ranganathan, K. L., & Foster, I. T. (2003) · ACM International Symposium on High-Performance Parallel and Distributed Computing (HPDC) · doi:10.1109/hpdc.2002.1029935 · Cited by 455
Thomas, R. K., & Sandhu, R. S. (1998) · IFIP advances in information and communication technology · doi:10.1007/978-0-387-35285-5_10 · Cited by 434
Grid resource management: state of the art and future trends
Nabrzyski, J., Schopf, J. M., & Węglarz, J. (2004) · Cited by 419
Data Management in an International Data Grid Project
Hoschek, W., Jaen-Martinez, J., Samar, A., Heinz Stockinger, C., & Stockinger, K. (2000) · Lecture notes in computer science · doi:10.1007/3-540-44444-0_8 · Cited by 418
High performance parametric modeling with Nimrod/G: killer application for the global grid?
Abramson, D., Giddy, J., & Kotler, L. (2002) · Proceedings - IEEE International Parallel and Distributed Processing Symposium · doi:10.1109/ipdps.2000.846030 · Cited by 350
On the use and performance of content distribution networks
Krishnamurthy, B., Wills, C., & Zhang, Y. (2001) · Proceedings of the First ACM SIGCOMM Workshop on Internet Measurement - IMW '01 · doi:10.1145/505202.505224 · Cited by 305
Collaboratories: doing science on the Internet
Kouzes, R. T., Myers, J. D., & Wulf, W. A. (1996) · Computer · doi:10.1109/2.532044 · Cited by 295
Principles of distributed database systems (2nd ed.)
ÖZSU, M. T., & Valduriez, P. (1999) · Prentice-Hall, Inc eBooks · Cited by 264
The UK e-Science Core Programme and the Grid
Hey, T., & Trefethen, A. (2002) · Future Generation Computer Systems · doi:10.1016/s0167-739x(02)00082-1 · Cited by 259
Ishfaq Ahmad, D., Al‐Ayyoub, A., Avdelas, G. G., Avresky, D. R., Buyya, R., Cortés, T., de Sturler, E., Martino, B. D., Dickens, P. M., Drira, K., et al. (1999) · Cited by 249
Self-citationProceedings 20th International Conference on Data Engineering
(2004) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2004.1319968 · Cited by 224
Evaluation of an economy-based file replication strategy for a data grid
Bell, W. H., Cameron, D. G., Carvajal-Schiaffino, R., Millar, P., Stockinger, K., & Zini, F. (2003) · IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid) · doi:10.1109/ccgrid.2003.1199430 · Cited by 185
An economic paradigm for query processing and data migration in Mariposa
Stonebraker, M., Devine, R., Kornacker, M., Litwin, W., Pfeffer, A., Sah, A., & Staelin, C. (2002) · Proceedings of 3rd International Conference on Parallel and Distributed Information Systems · doi:10.1109/pdis.1994.331732 · Cited by 177
Szalay, A. S., & Gray, J. (2001) · Science · doi:10.1126/science.293.5537.2037 · Cited by 155
Davison, B. D. (2001) · IEEE Internet Computing · doi:10.1109/4236.939449 · Cited by 124
Workflow Management in Griphyn
Deelman, E., Blythe, J., Gil, Y., & Kesselman, C. (2004) · International series in management science/operations research/International series in operations research & management science · doi:10.1007/978-1-4615-0509-9_7 · Cited by 108
Chameleon: a resource scheduler in a data grid environment
Park, S., & Kim, J.-H. (2003) · doi:10.1109/ccgrid.2003.1199376 · Cited by 88
Matchmaking: An extensible framework for distributed resource management
Raman, R., Livny, M., & Solomon, M. (1999) · Cluster Computing · doi:10.1023/a:1019022624119 · Cited by 80
Laser interferometer gravitational-wave observatory
Raab, F. J. (2002) · doi:10.1109/leos.1993.379293 · Cited by 66
Doyle, J. F. (2001) · Ubiquity · doi:10.1145/377424.377427 · Cited by 44
Jagatheesan, A., & Rajasekar, A. (2003) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/872876.872878 · Cited by 26
A Scheduling Middleware for Data Intensive Applications on a Grid
Lee, M.-H., In, J., & Choi, E. (2006) · Lecture notes in computer science · doi:10.1007/11893011_134 · Cited by 14
Mattmann, C. A., Medvidović, N., RAMIREZ, P. M., & Jakobac, V. (2005) · Lecture notes in computer science · doi:10.1007/11424529_22 · Cited by 14
Cited by
A method for taxonomy development and its application in information systems
Nickerson, R. C., Varshney, U., & Muntermann, J. (2013) · European Journal of Information Systems · doi:10.1057/ejis.2012.26 · Cited by 1,143
Big Data computing and clouds: trends and future directions
Assunção, M. D., Calheiros, R. N., Bianchi, S., Netto, M. A. S., & Buyya, R. (2015) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2014.08.003 · Cited by 901
Self-citation(2010) · Springer eBooks · doi:10.1007/978-1-4419-6524-0 · Cited by 519
Distributed and cloud computing: from parallel processing to the Internet of things
(2012) · Choice Reviews Online · doi:10.5860/choice.49-5712 · Cited by 314
Metadata
- Authors
- Venugopal, S., Buyya, R., & Ramamohanarao, K.
- Venue
- ACM Computing Surveys
- Published
- 2006-06-29
- Volume
- 38
- Issue
- 1
- Pages
- 3
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W2007178619
- Cited by
- 351
- References
- 72
- FWCI
- 61.10
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.