Abstract
Grid technology, as a highly distributed computing environment, requires an optimized access to the data resources to increase data availability. In this paper, we propose a replication technique which is based on parallel transfers from multiple sites containing replicas of the desired file. From each site, we transport in parallel only a portion of the given data source, obtaining the whole file at the end of the process. We describe the work related to the data replication; then we discuss two algorithms for striped replication optimization that aims at the minimization of the time necessary for data transfer. Finally, we present the results of the striped replication mechanism achieved by the prototype implementation of the striped replication algorithm. We compare them with the results of the standard replication tools and show interesting performance improvement.
This work is supported by EU 6FP RI(III) project: Enabling Grids for E-sciencE (2004-2006) INFSO-RI-508833, EU 5FP IST RTD project: CROSSGRID Development of Grid Environment for Interactive Applications (2002-05) IST-2001-32243 and the Slovak Scientific Grant Agency within Research Project No. 2/3132/23.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Chervenak, A., Deelman, E., Foster, I., Guy, L., Hoschek, W., Iamnitchi, A., Kesselman, C., Kunszt, P., Ripeanu, M., Schwartzkopf, B., Stocking, H., Stockinger, K., Tierney, B.: Giggle: A Framework for Constructing Scalable Replica Location Services. In: Proceedings of SC 2002 Conference (November 2002)
The Globus Project, www.globus.org
EU Data Grid project, WP2, replication, RLS, http://edg-wp2.web.cern.ch/edg-wp2/replication/
EU Data Grid project, WP2, optimization, ROS, http://edg-wp2.web.cern.ch/edg-wp2/optimization/ros.html
Kunszt, P., Laure, E., Stockinger, H., Stockinger, K.: Advanced replica management with Reptor. In: 5th international conference on parallel processing and applied mathemetics (2003)
Commodity Grid Kits, http://www-unix.globus.org/cog/
Manohar, M., Chervenak, A., Clifford, B., Kesselmann, C.: A Replica Location Grid Service Implementation. In: GGF 10 Workshop (2004)
Foster, I., Kesselman, C.: Computational Grids. In: The Grid: Blueprint for a New Computing Infrastructure. Morgan-Kaufman, San Francisco (1999)
Cohen, B.: Incentives Build Robustness in BitTorrent, http://bittorrent.com
Sherwood, R., Braud, R., Bhattacharjee, B.: Slurpie: A Cooperative Bulk Data Transfer Protocol. In: Proceedings of IEEE INFOCOM (March 2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ciglan, M., Habala, O., Hluchy, L. (2005). Striped Replication from Multiple Sites in the Grid Environment. In: Sloot, P.M.A., Hoekstra, A.G., Priol, T., Reinefeld, A., Bubak, M. (eds) Advances in Grid Computing - EGC 2005. EGC 2005. Lecture Notes in Computer Science, vol 3470. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11508380_79
Download citation
DOI: https://doi.org/10.1007/11508380_79
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26918-2
Online ISBN: 978-3-540-32036-4
eBook Packages: Computer ScienceComputer Science (R0)