Abstract
Submission of multiple jobs in a distributed and heterogeneous environment is required by applications that rely on the “public-resource computing” paradigm. We present here a scientific scenario for the analysis of astronomical data, where some nodes are responsible for maintaining and advertising job description files and other so called worker nodes, are dispersed over the Grid to execute the jobs. Job assignment is performed through a mechanism that matches adverts, containing job descriptions, with job queries that are sent by available workers across the Grid exploiting an underlying super-peer topology. With an analogous mechanism, a worker locates the input data file needed to run a job and downloads it from a data center node. This paper presents a super-peer protocol for the submission of a very large number of jobs on a Grid environment. The super-peer architecture enables the replication of data files on multiple data centers, which helps reduce the processing load and speed up the application. A simulation analysis has been performed to evaluate the impact of application and network parameters on performance results.
Chapter PDF
Similar content being viewed by others
References
Anderson, D.: Public computing: Reconnecting people to science. In: Proc. of Conference on Shared Knowledge and the Web, Madrid, Spain, November, pp. 17–19 (2003)
Anderson, D.P.: BOINC: A System for Public-Resource Computing and Storage. In: 5th IEEE/ACM International Workshop on Grid Computing, November 2004, Pittsburgh, PA, pp. 365–372. ACM Press, New York (2004)
Anderson, D.P., Cobb, J., Korpela, E., Lebofsky, M., Werthimer, D.: SETI@home: An experiment in public resource computing. Communications of the ACM 45(11), 56–61 (2002)
Mastroianni, C., Talia, D., Verta, O.: A Super-Peer Model for Resource Discovery Services in Large-Scale Grids. Future Generation Computer Systems 21(8), 1235–1456 (2005)
Talia, D., Trunfio, P.: Towards a Synergy between P2P and Grids. IEEE Internet Computing 7(4), 94–96 (2003)
Yang, B., Garcia-Molina, H.: Designing a Super-Peer Network. In: 19th Int’l Conf. on Data Engineering, IEEE Computer Society Press, Los Alamitos (2003)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Cozza, P., Mastroianni, C., Talia, D., Taylor, I. (2007). A Super-Peer Model for Multiple Job Submission on a Grid. In: Lehner, W., Meyer, N., Streit, A., Stewart, C. (eds) Euro-Par 2006 Workshops: Parallel Processing. Euro-Par 2006. Lecture Notes in Computer Science, vol 4375. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72337-0_12
Download citation
DOI: https://doi.org/10.1007/978-3-540-72337-0_12
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-72226-7
Online ISBN: 978-3-540-72337-0
eBook Packages: Computer ScienceComputer Science (R0)