Abstract
Several emerging application areas require intelligent management of distributed data and tasks that encapsulate execution units for collection of processors or processor groups. This paper describes an integration of data and task parallelism to address the needs of such applications in context of the Global Array (GA) programming model. GA provides programming interfaces for managing shared arrays based on non-partitioned global address space programming model concepts. Compatibility with MPI enables the scientific programmer to benefit from performance and productivity advantages of these high level programming abstractions using standard programming languages and compilers.
Chapter PDF
Similar content being viewed by others
References
Nieplocha, J., Palmer, B., Tipparaju, V., Krishnan, M., Trease, H., Apra, E.: Advances, Applications and Performance of the Global Arrays Shared Memory Programming Toolkit. International Journal of High Performance Computing and Applications 20(2) (2006)
Bershad, B.N., Zekauskas, M.J., Sawdon, W.A.: Midway distributed shared memory system. In: 38th Annual IEEE Computer Society International Computer Conference – COMPCON SPRING 1993, February 22-26 1993, pp. 528–537. IEEE, Piscataway (1993)
Cox, A.L., Dwarkadas, S., Lu, H., Zwaenepoel, W.: Evaluating the performance of software distributed shared memory as a target for parallelizing compilers. In: 1997 11th International Parallel Processing Symposium, IPPS 1997, April 1-5 1997, pp. 474–482. IEEE, Los Alamitos (1997)
Blackford, L.S., Choi, J., Cleary, A., D’Azevedo, E., Demmel, J., Dhillon, I., Dongarra, J., Hammarling, S., Henry, G., Petitet, A., Stanley, K., Walker, D., Whaley, R.C.: ScaLAPACK: A Linear Algebra Library for Message-Passing Computers. In: Proceedings of Eighth SIAM Conference on Parallel Processing for Scientific Computing, Minneapolis, MN (1997)
Benson, S., McInnes, L., Moré, J., Sarich, J.: Toolkit for Advanced Optimization (TAO) User Manual. ANL/MCS-TM-242 (2004), http://www.mcs.anl.gov/tao
Benson, S., Krishnan, M., McInnes, L.C., Nieplocha, J., Sarich, J.: Using the GA and TAO toolkits for solving large-scale optimization problems on parallel computers. ACM Trans. Math. Softw. 33(2), 11 (2007)
Nieplocha, J., Tipparaju, V., Krishnan, M., Panda, D.: High Performance Remote Memory Access Communications: The ARMCI Approach. International Journal of High Performance Computing and Applications 20(2) (2006)
Chakrabarti, S., Demmel, J., Yelick, K.: Modeling the benefits of mixed data and task parallelism. In: Proceedings of the seventh annual ACM symposium on Parallel algorithms and architectures, June 24-26, 1995, pp. 74–83 (1995)
Krishnamoorthy, S., Nieplocha, J., Sadayappan, P.: Data and computation abstractions for dynamic and irregular computations. In: Bader, D.A., Parashar, M., Sridhar, V., Prasanna, V.K. (eds.) HiPC 2005. LNCS, vol. 3769. Springer, Heidelberg (2005)
Krishnamoorthy, S., Catalyurek, U., Nieplocha, J.: Hypergraph partitioning for automatic memory hierarchy management. In: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC 2006) (November 2006)
Dinan, J., Krishnamoorthy, S., Larkins, B., Nieplocha, J., Sadayappan, P.: Scioto: A framework for global-view task parallelism (under submission)
Bal, H.E., Haines, M.: Approaches for Integrating Task and Data Parallelism. IEEE Concurrency 6(3), 74–84 (1998)
Rauber, T., Rünger, G.: Library support for hierarchical multi-processor tasks. In: Proceedings of the 2002 ACM/IEEE conference on Supercomputing, November 16, 2002, pp. 1–10 (2002)
Kamiya, M., Hirata, S., Valiev, M.: Fast electron correlation methods for molecular clusters without basis set superposition errors. Journal of Chemical Physics 128(7), 74103 (2008)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nieplocha, J., Krishamoorthy, S., Valiev, M., Krishnan, M., Palmer, B., Sadayappan, P. (2008). Integrated Data and Task Management for Scientific Applications. In: Bubak, M., van Albada, G.D., Dongarra, J., Sloot, P.M.A. (eds) Computational Science – ICCS 2008. ICCS 2008. Lecture Notes in Computer Science, vol 5101. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-69384-0_6
Download citation
DOI: https://doi.org/10.1007/978-3-540-69384-0_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-69383-3
Online ISBN: 978-3-540-69384-0
eBook Packages: Computer ScienceComputer Science (R0)