Skip to main content

GRIDKIT: Pluggable Overlay Networks for Grid Computing

  • Conference paper
On the Move to Meaningful Internet Systems 2004: CoopIS, DOA, and ODBASE (OTM 2004)

Abstract

A ‘second generation’ approach to the provision of Grid middleware is now emerging which is built on service-oriented architecture and web services standards and technologies. However, advanced Grid applications have significant demands that are not addressed by present-day web services platforms. As one prime example, current platforms do not support the rich diversity of communication ‘interaction types’ that are demanded by advanced applications (e.g. publish-subscribe, media streaming, peer-to-peer interaction). In the paper we describe the Gridkit middleware which augments the basic service-oriented architecture to address this particular deficiency. We particularly focus on the communications infrastructure support required to support multiple interaction types in a unified, principled and extensible manner—which we present in terms of the novel concept of pluggable overlay networks.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Grimshaw, A., Ferrari, A., Knabe, F., Humphrey, M.: Legion: An Operating System for Wide-Area Computing. IEEE Computer 32(5), 29–37 (1999)

    Google Scholar 

  2. Foster, I., Kesselman, C., Tuecke, S.: The Anatomy of the Grid: Enabling Virtual Organizations. International Journal of Supercomputer Applications 15(3) (2001)

    Google Scholar 

  3. Centre for Sustainable Water Management, http://www.swm.lancs.ac.uk/

  4. Parlavantzas, N., Coulson, G., Blair, G.S.: An Extensible Binding Framework for Component-Based Middleware. In: Proc. EDOC 2003, Brisbane, Australia (September 2003)

    Google Scholar 

  5. Coulson, G., Grace, P., Blair, G.S., Mathy, L., Duce, D., Cooper, C., Yeung, W.K., Cai, W.: Towards a Component-based Middleware Framework for Configurable and Reconfigurable Grid Computing. In: Proc. Workshop on Emerging Technologies for Next Generation Grid (ETNGRID 2004), associated with 13th IEEE International Workshops on Enabling Technologies: Infrastructures for Collaborative Enterprises (WETICE 2004), Modena, Italy (June 2004)

    Google Scholar 

  6. El-Sayed, A., Roca, V., Mathy, L.: A Survey of Proposals for an Alternative Group Communication Service. IEEE Network 17(1), 46–51 (2003)

    Article  Google Scholar 

  7. Floyd, S., Jacobson, V., Liu, C., McCanne, S., Zhang, L.: A Reliable Multicast Framework for Light-weight Sessions and Application Level Framing. IEEE/ACM Transactions on Networking 5(6), 784–803 (1997)

    Article  Google Scholar 

  8. Czajkowski, K., Foster, I., Karonis, N., Carl Kesselman, C., Martin, S., Smith, W., Tuecke, S.: A Resource Management Architecture for Metacomputing Systems. In: Proc. Workshop on Job Scheduling Strategies for Parallel Processing, pp. 62–82. Springer, Heidelberg (1998) ISBN 3-540-64825-9

    Chapter  Google Scholar 

  9. Smith, P., Simpson, S., Hutchison, D.: Peer-to-Peer Networking for Discovering Programmable Resources. In: Proc. 4th Intl. Workshop on Networked Group Communication (NGC 2002), Boston, USA, October 23-25 (2002)

    Google Scholar 

  10. Pallickara, S., Fox, G.: NaradaBrokering: A Distributed Middleware Framework and Architecture for Enabling Durable Peer-to-Peer Grids. In: Endler, M., Schmidt, D.C. (eds.) Middleware 2003. LNCS, vol. 2672, Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  11. Parlavantzas, N., Blair, G.S., Coulson, G.: A Resource Adaptation Framework for Reflective Middleware. In: Endler, M., Schmidt, D.C. (eds.) Middleware 2003. LNCS, vol. 2672, Springer, Heidelberg (2003)

    Google Scholar 

  12. Coulson, G., Blair, G.S., Clark, M., Parlavantzas, N.: The Design of a Highly Configurable and Reconfigurable Middleware Platform. ACM Distributed Computing Journal 15(2), 109–126 (2002)

    Article  Google Scholar 

  13. Clark, M., Blair, G.S., Coulson, G., Parlavantzas, N.: An Efficient Component Model for the Construction of Adaptive Middleware. In: Guerraoui, R. (ed.) Middleware 2001. LNCS, vol. 2218, p. 160. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  14. Grace, P., Blair, G.S., Samuel, S.: ReMMoC: A Reflective Middleware to Support Mobile Client Interoperability. In: Meersman, R., Tari, Z., Schmidt, D.C. (eds.) CoopIS 2003, DOA 2003, and ODBASE 2003. LNCS, vol. 2888, pp. 1170–1187. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  15. Balakrishnan, H., Kaashoek, F., Karger, D., Morris, R., Stoica, I.: Looking Up Data in P2P Systems. CACM 46(2), 43–48 (2003)

    Google Scholar 

  16. Mathy, L., Roberto Canonico, R., Hutchison, D.: An Overlay Tree Building Control Protocol. In: Crowcroft, J., Hofmann, M. (eds.) NGC 2001. LNCS, vol. 2233, pp. 76–87. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  17. Gnutella Community. “Gnutella Protocol Specification v0.4”, dss.clip2.com/GnutellaProtocol04.pdf

  18. Stoica, I., Morris, R., Karger, D., Kaashoek, M.F., Balakarishnan, H.: Chord: A Scalable Peer-to-Peer Lookup Service for Internet Applications. In: Proc. ACM SIG-COMM, San Diego (2001)

    Google Scholar 

  19. Rowstron, A., Druschel, P.: Pastry: Scalable, Distributed Object Location and Routing for Large-scale Peer-to-Peer Systems. In: Guerraoui, R. (ed.) Middleware 2001. LNCS, vol. 2218, p. 329. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  20. Ratnasamy, S., Francis, P., Handley, M., Karp, R., Shenker, S.: A Scalable Content-Addressable Network. In: Proc. ACM SIGCOMM, San Diego (2001)

    Google Scholar 

  21. Zhao, B., Huang, L., Stribling, J., Rhea, S., Joseph, A., Kubiatowicz, J.: Tapestry: A Resilient Global-scale Overlay for Service Deployment. IEEE Journal on Selected Areas in Communications 22(1) (January 2004)

    Google Scholar 

  22. Castro, M., Druschel, P., Kermarrec, A.-M., Rowstron, A.: SCRIBE: A Large-Scale and Decentralised Application-Level Multicast Infrastructure. IEEE Journal on Selected Areas in Communications (JSAC) (Special issue on Network Support for Multicast Communications) (2002)

    Google Scholar 

  23. Castro, M., Costa, M., Rowstron, A.: Should we build Gnutella on a structured overlay? In: Proc. 2nd Workshop on Hot Topics in Networks, Cambridge, MA USA (November 2003)

    Google Scholar 

  24. Castro, M., Druschel, P., Kermarrec, A.-M., Nandi, A., Rowstron, A., Singh, A.: SplitStream: High-bandwidth Content Distribution in a Cooperative Environment. In: Kaashoek, M.F., Stoica, I. (eds.) IPTPS 2003. LNCS, vol. 2735, Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  25. Dabek, F., Zhao, B., Druschel, P., Kubiatowicz, J., Stoica, I.: Towards a Common API for Structured P2P Overlays. In: Kaashoek, M.F., Stoica, I. (eds.) IPTPS 2003. LNCS, vol. 2735, Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  26. Meier, R., Cahill, V.: STEAM: Event-Based Middleware for Wireless Ad Hoc Networks. In: Proc. of the International Workshop on Distributed Event-Based Systems (ICDCS/DEBS 2002), Vienna, Austria, pp. 639–644 (2002)

    Google Scholar 

  27. Hughes, D., Warren, I., Coulson, G.: AGnuS: The Altruistic Gnutella Server. In: Proc. 3rd International Conference on Peer-to-Peer Computing (P2P 2003), Linkoping, Sweden (2003)

    Google Scholar 

  28. Furmento, N., Mayer, A., McGough, S., Newhouse, S., Field, T., Darlington, J.: ICENI: Optimisation of Component Applications within a Grid Environment. Parallel Computing 28(12), 1753–1772 (2002)

    Article  MATH  Google Scholar 

  29. Kon, F., Roman, M., Liu, P., Mao, J., Yamane, T., Magalhaes, L., Campbell, R.: Monitoring, Security, and Dynamic Configuration with the dynamicTAO Reflective ORB. In: Coulson, G., Sventek, J. (eds.) Middleware 2000. LNCS, vol. 1795, p. 121. Springer, Heidelberg (2000)

    Chapter  Google Scholar 

  30. Roman, M., Kon, F., Campbell, R.: Reflective Middleware: From Your Desk to Your Hand. IEEE Distributed Systems Online 2(5) (August 2001)

    Google Scholar 

  31. Andersen, A., Blair, G., Goebel, V., Karlsen, R., Stabell-Kulø, T., Yu, W.: Arctic Beans: Configurable and Reconfigurable Enterprise Component Architectures. IEEE Distributed Systems Online 2(7) (2001)

    Google Scholar 

  32. Sadjadi, S., McKinley, P., Kasten, E.: Architecture and Operation of an Adaptable Communication Substrate. In: Proc. Ninth IEEE International Workshop on Future Trends of Distributed Computing Systems (FTDCS 2003), San Juan, Puerto Rico, May 2003, pp. 46–55 (2003)

    Google Scholar 

  33. Li, B., Guo, J., Wang, M.: iOverlays: A Lightweight Middleware Infrastructure for Overlay Application Implementations. In: Jacobsen, H.-A. (ed.) Middleware 2004. LNCS, vol. 3231, pp. 135–154. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  34. Rodriguez, A., Killian, C., Bhat, S., Kostic, D., Vahdat, A.: “MACEDON: Methodology for Automatically Creating, Evaluating and Designing Overlay Networks. In: Proc. USENIX/ACM Symp. on Networked Systems Design and Implementation, NSDI 2004 (2004)

    Google Scholar 

  35. Intanagonwiwat, C., Govindan, R.: Directed Diffusion: A Scalable and Robust Directed Diffusion: A Scalable and Robust Communication Paradigm for Sensor Communication Paradigm for Sensor Networks. In: Pro. 6th Annual ACM/IEEE International Conference on Mobile Computing and Networking, Mobicom 2000 (2000)

    Google Scholar 

  36. Culler, D.E., Hong, W.: Special Section on Wireless Sensor Networks. Communications of the ACM (June 2004)

    Google Scholar 

  37. Blair, G.S., Coulson, G., Blair, L., Duran-Limon, H., Grace, P., Moreira, R., Parlavantzas, N.: Reflection, Self-Awareness and Self-Healing in OpenORB. In: Proc. ACM Sigsoft Workshop on Self-Healing Systems (WOSS 2002) (November 2002)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Grace, P. et al. (2004). GRIDKIT: Pluggable Overlay Networks for Grid Computing. In: Meersman, R., Tari, Z. (eds) On the Move to Meaningful Internet Systems 2004: CoopIS, DOA, and ODBASE. OTM 2004. Lecture Notes in Computer Science, vol 3291. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30469-2_40

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-30469-2_40

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-23662-7

  • Online ISBN: 978-3-540-30469-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics