Abstract
Due to the high availability of the Internet, many large cross-organization collaboration projects, such as SourceForge, grid systems etc., have emerged. One of the fundamental requirements of these collaboration efforts is a storage system to store and exchange data. This storage system must be highly scalable and can efficiently aggregate the storage resources contributed by the participating organizations to deliver good performance for users. In this paper, we propose a storage system, Collaborative File Repository (CFR), for large scale collaboration projects. CFR uses peer-to-peer techniques to achieve scalability, efficiency, and ease of management. In CFR, storage nodes contributed by the participating organizations are partitioned according to geographical regions. Files stored in CFR are automatically replicated to all regions. Furthermore, popular files are duplicated to other storage nodes of the same region. By doing so, data transfers between users and storage nodes are confined within their regions and transfer efficiency is enhanced. Experiments show that our replication can achieve high efficiency with a small number of duplicates.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
China Grid, http://www.chinagrid.net
Dabek, F., et al.: Wide-area Cooperative Storage with CFS. In: Proceedings of 18th ACM Symposium on Operating Systems Principles, Oct. 2001, pp. 202–215 (2001)
FIPS 180-1, Secure Hash Standard. U.S. Department of Commerce/NIST, National Technical Information Service, Springfield, VA (Apr. 1995)
Gupta, I., et al.: Kelips: Building and Efficient and Stable P2P DHT through Increased Memory and Background Overhead. In: Kaashoek, M.F., Stoica, I. (eds.) IPTPS 2003. LNCS, vol. 2735, Springer, Heidelberg (2003)
grid.org, http://www.grid.org/home.htm
Hasan, R., et al.: A Survey of Peer-to-Peer Storage Techniques for Distributed File Systems. In: Proceedings of International Conference on Information Technology: Coding and Computing, vol. 2, Apr. 4-6, 2005, pp. 205–213 (2005)
Hsiao, H.C., King, C.T.: Modeling and Evaluating Peer-to-Peer Storage Architecture. In: Proceedings of International Parallel and Distributed Processing Symposium, Apr. 14-19, 2002, pp. 24–29 (2002)
Jin, H., Wang, C., Chen, H.: Boundary Chord: A Novel Peer-to-Peer Algorithm for Replica Location Mechanism in Grid Environment. In: Proceedings of the 8th International Symposium on Parallel Architectures, Algorithms, and Networks (ISPAN 2005), Las Vegas (Dec. 2005)
Kazaa. http://www.kazaa.com
Kubiatowicz, J., et al.: Oceanstore: An Architecture for Global-Scale Persistent Storage. In: Proceedings of 9th International Conference on Architectural Support for Programming Languages and Operating Systems (Nov. 2000)
Leibowitz, N., Ripeanu, M., Wierzbicki, A.: Deconstructing the Kazaa Network. In: Proceedings of 3rd IEEE Workshop on Internet Applications (Jun. 2003)
Lin, M.R.: CFR: A Peer-to-Peer Collaborative File Repository System. Master Thesis, National Tsing Hua University, Dept. of Computer Science, Taiwan (2006)
Mislove, A., Druschel, P.: Providing Administrative Control and Autonomy in Structured Peer-to-Peer Overlays. In: Proceedings of International Workshop on Peer-to-peer Systems (Feb. 2004)
Muthitacharoen, A., et al.: Ivy: A Read/Write Peer-to-Peer File System. In: Proceedings of International 5th USENIX Symposium on Operating Systems Design and Implementation (OSDI) (Dec. 2002)
Napster, http://www.napster.com
Rivest, R.: Message Digest Algorithm MD5. In: RFC 1321 (Apr. 1992)
Rowstron, A., Druschel, P.: Storage Management and Caching In PAST, a Large-Scale, Persistent Peer-to-Peer Storage Utility. In: Proceedings of 18th Symposium On Operating Systems Principles (SOSP ’01) (Oct. 2001)
Rowstron, A., Druschel, P.: Pastry: Scalable, Distributed Object Location and Routing for Large-Scale Peer-to-Peer Systems. In: Proceedings of 18th IFIP/ACM International Conference on Distributed Systems Platforms, Nov. 2001, pp. 329–350 (2001)
SourceForge.net, http://sourceforge.net
Stoica, I., et al.: Chord: A Scalable Peertopeer Lookup Service for Internet Applications. ACM SIGCOMM Computer Communication Review (Proceedings of conference on Applications, technologies, architectures, and protocols for computer communications SIGCOMM ’01) 31(4), 149–160 (2001)
Stoica, I., et al.: Chord: a scalable peer-to-peer lookup protocol for Internet applications. IEEE/ACM Transactions on Networking 11(1), 17–32 (2003)
Sagie, G., Wool, A.: A clustering approach for exploring the Internet structure. In: Proc. 23rd IEEE Convention of Electrical and Electronics Engineers in Israel (IEEEI) (Sep. 2004)
Taiwan UniGrid, http://www.unigrid.org.tw/
Xu, Z., Min, R., Hu, Y.: HIERAS: A DHT Based Hierarchical P2P Routing Algorithm. In: Proceedings of International Conference on Parallel Processing (Oct. 2003)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Lin, MR., Lu, SH., Ho, TH., Lin, P., Chung, YC. (2007). CFR: A Peer-to-Peer Collaborative File Repository System. In: Cérin, C., Li, KC. (eds) Advances in Grid and Pervasive Computing. GPC 2007. Lecture Notes in Computer Science, vol 4459. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72360-8_9
Download citation
DOI: https://doi.org/10.1007/978-3-540-72360-8_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-72359-2
Online ISBN: 978-3-540-72360-8
eBook Packages: Computer ScienceComputer Science (R0)