Skip to main content
SpringerLink
Log in

A taxonomy of peer-to-peer desktop grid paradigms

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Desktop grid systems and applications have generated significant impacts on science and engineering. The emerging convergence of grid and peer-to-peer (P2P) computing technologies further opens new opportunities for enabling P2P Desktop Grid systems. This paper presents a taxonomy for classifying P2P desktop grid implementation paradigms, aiming to summarize the state-of-the-art technologies and explore the current and potential solution space. To have a comprehensive taxonomy for P2P desktop grid paradigms, we investigate both computational and data grid systems. Moreover, to ease the understanding, the taxonomy is applied to selected case studies of P2P desktop grid systems. The taxonomy is expected to be used as a survey of the state-of-the-art, a design map, a guideline for novice researchers, a common vocabulary, or a design space for simulation and benchmark, and to be extended as the technologies rapidly evolve.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Cloud@Home. URL: http://clouds.gforge.inria.fr/pmwiki.php

  2. Gnutella. URL: http://www.gnutelliums.com

  3. JXTA (Juxtapose): an open source peer-to-peer protocol. URL: https://jxta.dev.java.net/

  4. Ontogrid. URL: http://www.ontogrid.net

  5. Status of OurGrid. URL: http://status.ourgrid.org/

  6. XtremWeb Project website. URL: http://www.xtremweb.net/

  7. Anderson, D.P.: Boinc: a system for public-resource computing and storage. In: Proceedings of the Fifth IEEE/ACM International Workshop on Grid Computing, pp. 4–10 (2004)

  8. Anderson, D.P., Cobb, J., Korpela, E., Lebofsky, M., Werthimer, D.: SETI@home: an experiment in public-resource computing. Commun. ACM 45(11), 56–61 (2002)

    Article  Google Scholar 

  9. Andrade, N., Brasileiro, F., Cirne, W., Mowbray, M.: Automatic grid assembly by promoting collaboration in peer-to-peer grids. J. Parallel Distrib. Comput. 67(8), 957–966 (2007)

    Article  MATH  Google Scholar 

  10. Ataollahi, I., Analoui, M.: Resource matchmaking algorithm using dynamic rough set in grid environment. CoRR, abs/0909.1397 (2009)

  11. Azab, A., Kholidy, H.: An adaptive decentralized scheduling mechanism for peer-to-peer desktop grids. In: ICCES ’08: Proceedings of the International Conference on Computer Engineering and Systems, pp. 364–371 (2008)

  12. Baker, M., Buyya, R., Laforenza, D.: Grids and grid technologies for wide-area distributed computing. Softw. Pract. Exp. 32(15), 1437–1466 (2002)

    Article  MATH  Google Scholar 

  13. Barbalace, D., Talia, D., Kelley, I., Taylor, I., Mastroianni, C.: A data sharing protocol for desktop grid projects. Technical Report TR-0165, CoreGRID Report (2008)

  14. Basu, S., Banerjee, S., Sharma, P., Lee, S.-J.: Nodewiz: peer-to-peer resource discovery for grids. In: CCGRID ’05: Proceedings of the Fifth IEEE International Symposium on Cluster Computing and the Grid, vol. 1, pp. 213–220 (2005)

  15. Briquet, C., Dalem, X., Jodogne, S., de Marneffe, P.-A.: Scheduling data-intensive bags of tasks in p2p grids with bittorrent-enabled data distribution. In: UPGRADE ’07: Proceedings of the Second Workshop on Use of P2P, GRID and Agents for the Development of Content Networks, pp. 39–48 (2007)

  16. Buyya, R., Giddy, J., Stockinger, H.: Economic models for resource management and scheduling. J. Concurrency Comput., Pract. Experience (CCPE), 1507–1542 (2002)

  17. Cao, J., Kwong, O.M.K., Wang, X., Cai, W.: A peer-to-peer approach to task scheduling in computation grid. Int. J. Grid Utility Comput. 1, 13–21 (2005)

    Article  Google Scholar 

  18. Cao, J., Liu, F.B.: P2PGrid: Integrating P2P networks into the grid environment. In: GCC ’05, 4th International Conference on Grid and Cooperative Computing, vol. 3795, pp. 871–883 (2005)

  19. Cappello, F., Djilali, S., Fedak, G., Herault, T., Magniette, F., Ni, V., Lodygensky, O.: Computing on large-scale distributed systems: XtremWeb architecture, programming models, security, tests and convergence with grid. Future Gener. Comput. Syst. 21(3), 417–437 (2005)

    Article  Google Scholar 

  20. Caromel, D., di Costanzo, A., Mathieu, C.: Peer-to-peer for computational grids: mixing clusters and desktop machines. Parallel Comput. J. Large Scale Grid 33(4–5), 275–288 (2007)

    Google Scholar 

  21. Chakravarti, Baumgartner, and Lauria. The organic grid: Self-organizing computation on a peer-to-peer network. IEEE Trans. Syst., Man, Cybern. 35 (2005)

  22. Chakravarti, A.J., Baumgartner, G., Lauria, M.: Application-specific scheduling for the organic grid. In: GRID ’04: Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing, pp. 146–155 (2004)

  23. Chapman, C., Musolesi, M., Emmerich, W., Mascolo, C.: Predictive resource scheduling in computational grids. In: IPDPS’07: IEEE International Parallel and Distributed Processing Symposium, pp. 1–10 (2007)

  24. Cheema, A.S., Muhammad, M., Gupta, I.: Peer-to-peer discovery of computational resources for grid applications. In: GRID ’05: Proceedings of the 6th IEEE/ACM International Workshop on Grid Computing, pp. 179–185 (2005)

  25. Chervenak, A., Foster, I., Kesselman, C., Salisbury, C., Tuecke, S.: The data grid: Towards an architecture for the distributed management and analysis of large scientific datasets. J. Netw. Comput. Appl. 23, 187–200 (2001)

    Article  Google Scholar 

  26. Chien, A.A., Calder, B., Elbert, S., Bhatia, K.: Entropia: architecture and performance of an enterprise desktop grid system. J. Parallel Distrib. Comput. 63(5), 597–610 (2003)

    Article  Google Scholar 

  27. Choi, S., Baik, M., Gil, J., Park, C., Jung, S., Hwang, C.: Group-based dynamic computational replication mechanism in peer-to-peer grid computing. In: CCGRID ’06: Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid, p. 7 (2006)

  28. Choi, S., Kim, H., Byun, E., Baik, M., Kim, S., Park, C., Hwang, C.: Characterizing and classifying desktop grid. In: CCGRID ’07: Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid, pp. 743–748 (2007)

  29. Chrabakh, W., Wolski, R.: GridSAT: a system for solving satisfiability problems using a computational grid. Parallel Comput. 32(9), 660–687 (2006)

    Article  MathSciNet  Google Scholar 

  30. Cirne, W., Brasileiro, F., Andrade, N., Costa, L., Andrade, A., Novaes, R., Mowbray, M.: Labs of the world, unite!!! J. Grid Comput. 4(3), 225–246 (2006)

    Article  MATH  Google Scholar 

  31. Corradi, A., Leonardi, L., Zambonelli, F.: Diffusive load-balancing policies for dynamic applications. IEEE Concurr. 7(1), 22–31 (1999)

    Article  Google Scholar 

  32. Costa, F., Silva, L., Kelley, I., Taylor, I.: Peer-to-peer techniques for data distribution in desktop grid computing platforms. In: Making Grids Work, pp. 377–391 (2008)

  33. Darlagiannis, V., Liebau, N., Heckmann, O., Mauthe, A., Steinmetz, R.: Caching indices for efficient lookup in structured overlay networks. Agents and Peer-to-Peer Computing, pp. 81–93 (2006)

  34. Djilali, S., Herault, T., Lodygensky, O., Morlier, T., Fedak, G., Cappello, F.: Rpc-v: Toward fault-tolerant rpc for internet connected desktop grids with volatile nodes. In: SC ’04: Proceedings of the 2004 ACM/IEEE Conference on Supercomputing, p. 39 (2004)

  35. Fedak, G., He, H., Cappello, F.: Bitdew: a programmable environment for large-scale data management and distribution. In: SC ’08: Proceedings of the 2008 ACM/IEEE Conference on Supercomputing, pp. 1–12 (2008)

  36. Foster, I., Iamnitchi, A.: On death, taxes, and the convergence of peer-to-peer and grid computing. In: IPTPS ’03: Proceedings of the 2nd International Workshop on Peer-to-Peer Systems (2003)

  37. Foster, I., Kesselman, C.: The Grid: Blueprint for a New Computing Infrastructure, 2nd edn. Morgan Kaufmann, San Mateo (2004)

    Google Scholar 

  38. Foster, I., Kesselman, C., Nick, J., Tuecke, S.: The physiology of the grid: An open grid services architecture for distributed systems integration. Open Grid Service Infrastructure WG, Global Grid Forum, June 22, 2002

  39. Foster, I.T.: Globus toolkit version 4: Software for service-oriented systems. J. Comput. Sci. Technol. 21(4), 513–520 (2006)

    Article  Google Scholar 

  40. Fukuda, M., Kashiwagi, K., Kobayashi, S.: Agentteamwork: Coordinating grid-computing jobs with mobile agents. Appl. Intell. 25(2), 181–198 (2006)

    Article  MATH  Google Scholar 

  41. Grosu, D., Das, A.: Auction-based resource allocation protocols in grids. In: Proceedings of the 16th International Conference on Parallel and Distributed Computing and Systems (2004)

  42. Gupta, R., Sekhri, V., Somani, A.K.: CompuP2P: An architecture for internet computing using peer-to-peer networks. IEEE Trans. Parallel Distrib. Syst. 17(11), 1306–1320 (2006)

    Article  Google Scholar 

  43. Iosup, A., Iosup, R., Epema, D.H.J., Maassen, J., Nieuwpoort, R.V.: Synthetic grid workloads with ibis, koala, and grenchmark. In: Proceedings of the CoreGRID Integrated Research in Grid Computing, pp. 271–283 (2005)

  44. Kaplan, A., Fox, G.C., von Laszewski, G.: Gridtorrent framework: A high-performance data transfer and data sharing framework for scientific computing. In: SC’07: GCE07 Workshop (2007)

  45. Kelley, I., Taylor, I.: Bridging the data management gap between service and desktop grids. Distributed and Parallel Systems, pp. 13–26 (2008)

  46. Kim, J.-S., Bhattacharjee, B., Keleher, P.J., Sussman, A.: Matching jobs to resources in distributed desktop grid environments. Technical report, UMIACS-TR-2006-15 (2006)

  47. Kim, J.-S., Keleher, P.J., Marsh, M.A., Bhattacharjee, B., Sussman, A.: Using content-addressable networks for load balancing in desktop grids. In: HPDC’07: Proceedings of the 16th International Symposium on High-Performance Distributed Computing, pp. 189–198 (2007)

  48. Kim, J.-S., Nam, B., Marsh, M., Keleher, P., Bhattacharjee, B.: Creating a robust desktop grid using peer-to-peer services. In: IPDPS’07: Proceedings of IEEE International Parallel and Distributed Processing Symposium, pp. 1–7 (2007)

  49. Kim, J.-S., Nam, B., Marsh, M., Keleher, P., Bhattacharjee, B., Sussman, A.: Integrating categorical resource types into a p2p desktop grid system. In: GRID ’08: Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing, pp. 284–291 (2008)

  50. Koh, M., Song, J., Peng, L., See, S.: Service registry discovery using gridsearch p2p framework. In: CCGRID ’06: Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid, p. 11 (2006)

  51. Kondo, D., Fedak, G., Cappello, F., Chien, A.A., Casanova, H.: Characterizing resource availability in enterprise desktop grids. Future Gener. Comput. Syst. 23(7), 888–903 (2007)

    Article  Google Scholar 

  52. Kondo, D., Taufer, M., Brooks, C., Casanova, H., Chien, A.: Characterizing and evaluating desktop grids: an empirical study. In: IPDPS’04: Proceedings of the 18th International Parallel and Distributed Processing Symposium, pp. 26–36 (2004)

  53. Krauter, K., Buyya, R., Maheswaran, M.: A taxonomy and survey of grid resource management systems for distributed computing. Softw. Pract. Exp. 32(2), 135–164 (2002)

    Article  MATH  Google Scholar 

  54. Lamehamedi, H., Shentu, Z., Szymanski, B., Deelman, E.: Simulation of dynamic data replication strategies in data grids. In: IPDPS ’03: Proceedings of the 17th International Symposium on Parallel and Distributed Processing, p. 100.2 (2003)

  55. Legout, A., Urvoy-Keller, G., Michiardi, P.: Understanding bittorrent: An experimental perspective. Technical report, HAL - CCSd - CNRS (2005)

  56. Li, Z., Parashar, M.: A computational infrastructure for grid-based asynchronous parallel applications. In: HPDC ’07: Proceedings of the 16th International Symposium on High-Performance Distributed Computing, pp. 229–230 (2007)

  57. Litzkow, M.J., Livny, M., Mutka, M.W.: Condor—A hunter of idle workstations. In: ICDCS ’88: 8th International Conference on Distributed Computing Systems, pp. 104–111 (1988)

  58. Luther, A., Buyya, R., Ranjan, R., Venugopal, S.: Alchemi: A .NET-based enterprise grid computing system. In: ICOMP’05: 6th International Conference on Internet Computing (2005)

  59. Mengotti, T.: GPU, a framework for distributed computing over gnutella, 2004. URL: http://gpu.sourceforge.net/gpu_p2p/index.html

  60. Miller, C., Butler, P., Shah, A., Butt, A.R.: Peerstripe: a p2p-based large-file storage for desktop grids. In: HPDC ’07: Proceedings of the 16th International Symposium on High Performance Distributed Computing, pp. 221–222 (2007)

  61. Milojicic, D.S., Kalogeraki, V., Lukose, R., Nagaraja, K., Pruyne, J., Richard, B., Rollins, S., Xu, Z.: Peer-to-peer computing. Technical Report HPL-2002-57R1, Hewlett Packard Laboratories (2003)

  62. Montresor, A.: Anthill: a framework for the design and analysis of peer-to-peer systems. In: Proceedings of the 4th European Research Seminar on Advances in Distributed Systems (2001)

  63. Montresor, A., Meling, H., Babaoglu, O.: Messor: Load-balancing through a swarm of autonomous agents. In: Proceedings of 1st Workshop on Agent and Peer-to-Peer Systems, pp. 125–137 (2002)

  64. Ni, L., Harwood, A., Stuckey, P.J.: Realizing the e-science desktop peer using a peer-to-peer distributed virtual machine middleware. In: MCG ’06: Proceedings of the 4th International Workshop on Middleware for Grid Computing, p. 3 (2006)

  65. Obermeyer, P., Hawkins, J.: Microsoft .NET remoting: A technical overview, 2001. URL: http://msdn.microsoft.com/en-us/library/ms973857.aspx

  66. Pham, T.V., Lau, L.M., Dew, P.M.: An adaptive approach to p2p resource discovery in distributed scientific research communities. In: CCGRID ’06: Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid, p. 12 (2006)

  67. Rahman, M.R.: A survey of incentive mechanisms in peer-to-peer systems. Technical report, CS-2009-22, University of Waterloo (2009)

  68. Rose, C.A.F.D., Ferreto, T., Calheiros, R.N., Cirne, W., Costa, L.B., Fireman, D.: Allocation strategies for utilization of space-shared resources in bag of tasks grids. Future Gener. Comput. Syst. 24(5), 331–341 (2008)

    Article  Google Scholar 

  69. Schulz, S., Blochinger, W.: An integrated approach for managing peer-to-peer desktop grid systems. In: CCGRID ’07: Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid, pp. 233–240 (2007)

  70. Schulz, S., Blochinger, W., Hannak, H.: Capability-aware information aggregation in peer-to-peer grids—methods, architecture, and implementation. J. Grid Comput. (2008)

  71. Schulz, S., Blochinger, W., Held, M., Dangelmayr, C.: Cohesion—a microkernel based desktop grid platform for irregular task-parallel applications. Future Gener. Comput. Syst. 24(5), 354–370 (2008)

    Article  Google Scholar 

  72. Song, S., Hwang, K., Zhou, R., Kwok, Y.-K.: Trusted P2P transactions with fuzzy reputation aggregation. IEEE Internet Comput. 9(6), 24–34 (2005)

    Article  Google Scholar 

  73. Tie-Yan, L., Zhi-Gang, Z., Si-Zhen, Y.: A-peer: an agent platform integrating peer-to-peer network. In: CCGrid ’03: Proceedings of the 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, pp. 614–617 (2003)

  74. Venugopal, S., Buyya, R., Ramamohanarao, K.: A taxonomy of data grids for distributed data sharing, management, and processing. ACM Comput. Surv. 38(1), 3 (2006)

    Article  Google Scholar 

  75. Wang, I.: P2PS (Peer-to-Peer Simplified). In: Proceedings of 13th Annual Mardi Gras Conference—Frontiers of Grid Applications and Technologies, pp. 54–59. Louisiana State University (2005)

  76. Wei, B., Fedak, G., Cappello, F.: Collaborative data distribution with bittorrent for computational desktop grids. In: ISPDC ’05: The 4th International Symposium on Parallel and Distributed Computing, pp. 250–257 (2005)

  77. Wolski, R., Plank, J.S., Brevik, J., Bryan, T.: G-commerce: Market formulations controlling resource allocation on the computational grid. In: Proceedings of the 15th International Parallel & Distributed Processing Symposium (IPDPS), pp. 46–53 (2001)

  78. Zhao, H., Li, X.: Efficient grid task-bundle allocation using bargaining based self-adaptive auction. In: IEEE International Symposium on Cluster Computing and the Grid (CCGrid 09), vol. 0, pp. 4–11 (2009)

  79. Zhao, H., Liu, X., Li, X.: Hypergraph-based task-bundle scheduling towards efficiency and fairness in heterogeneous distributed systems. In: the 24th International Parallel and Distributed Processing Symposium (IPDPS). Atlanta, USA (2010)

  80. Zhao, S., Lo, V., GauthierDickey, C.: Result verification and trust-based scheduling in peer-to-peer grids. In: IEEE Fifth International Conference on Peer-to-Peer Computing, pp. 31–38 (2005)

  81. Zhou, D., Lo, V.: Cluster computing on the fly: resource discovery in a cycle sharing peer-to-peer system. In: CCGRID ’04: Proceedings of the 2004 IEEE International Symposium on Cluster Computing and the Grid, pp. 66–73 (2004)

  82. Zhou, D., Lo, V.: Wavegrid: a scalable fast-turnaround heterogeneous peer-based desktop grid system. In: IPDPS ’06: 20th International Parallel and Distributed Processing Symposium (2006)

Download references

Author information

Authors and Affiliations

  1. Scalable Software Systems Laboratory, University of Florida, Gainesville, FL, 32611, USA

    Han Zhao, Xinxin Liu & Xiaolin Li

Authors
  1. Han Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xinxin Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiaolin Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiaolin Li.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zhao, H., Liu, X. & Li, X. A taxonomy of peer-to-peer desktop grid paradigms. Cluster Comput 14, 129–144 (2011). https://doi.org/10.1007/s10586-010-0138-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-010-0138-3

Keywords

Search

Navigation