Abstract
Communication overhead adversely affects the performance of multi-computers. In this work, we present evidence (through the analysis of several parallel benchmarks) that there exists communications locality, and that it is “structured”. We have used this in a number of heuristics that “predict” the target of subsequent communications. This technique, can be applied directly to reconfigurable interconnects (optical or conventional) to hide the communications latency by reconfiguring the interconnect concurrently to the computation.
This research was supported through grants from the Natural Sciences and Engineering Research Council of Canada.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
References
A. Afsahi and N. J. Dimopoulos, “Collective Communications on a Reconfigurable Optical Interconnect,” Proceedings of the International Conference on Principles of Distributed Systems, Dec., 1997, pp. 167–181.
A. Afsahi and N. J. Dimopoulos “Communications Latency Hidinng Techniques for a Reconfigurable Optical Interconnect: Benchmark Studies” Technical Report ECE-98-2, Department of Electrical and Computer Engineering, University of Victoria, June 1998.
D. H. Bailey, et al., “NAS Parallel Benchmark Result 3-94,” Proceedings of Scalable High-Performance Computing Conference, 1994, pp. 111–120
J. Circello, et al., “The Superscalar Architecture of the MC68060,” IEEE Micro, Volume 15, Number 2, April 1995, pp. 10–21
B. V. Dao, S. Yalamanchili, and J. Duato, “Architectural Support for Reducing Communication Overhead in Multiprocessor Interconnection Networks” Proceedings, Third International Symposium on High Performance Computer Architecture, 1997, pp. 343–352
J. J. Dongarra and T. Dunigan, “Message-Passing Performance of Various Computers,” Concurrency, Vol. 9, No. 10, Dec. 1997, pp. 915–926
T. V. Eicken, et al., “Active Messages: A Mechanism for Integrated Communication and Computation,” Proceedings of the 19th Annual International Symposium on Computer Architecture, May 1992, pp. 256–265
W. Gropp and E. Lusk, “User’s Guide for MPICH, a Portable Implementation of MPI,” Argonne National Laboratory, Mathematics and Computer Science Division, ANL/MCS-TM-ANL-96/6
J. Kim and D. J. Lilja, “Characterization of Communication Patterns in Message-Passing Parallel Scientific Application Programs, “Workshop on Communication, Architecture, and Applications for Network-based Parallel Computing, International Symposium on High Performance Computer Architecture, February 1998, pp. 202–216
D. G. de Lahaut and C. Germain, “Static Communications in Parallel Scientific Programs” Proceedings of PARLE’94, Parallel Architecture and Languages, Athen, Greece, July 1994
Message Passing Interface Forum: MPI: A Message-Passing Interface Standard. Version 1.1 (June 1995)
T. Mowry and A. Gupta, “Tolerating Latency Through Software-Controlled Prefetching in Shared-Memory Multiprocessors,” Journal of Parallel and Distributed Computing, 12(2), 1991, pp. 87–106
R. A. Nordin, et al., “A System Perspective on Digital Interconnection Technology,” IEEE Journal of Lightwave Technology, Vol. 10, June 1992, pp. 801–827
S. Pakin, M. Lauria, and A. Chien, “High Performance Messaging on Workstation: Illinois Fast Messages (FM) for Myrinet,” Proceedings of Supercomputing’95, Nov., 1995.
G. I. Yayla, P.J. Marchand and S.C. Esener, “Speed and Energy Analysis of Digital Interconnections: Comparison of On-chip, Off-chip and Free-Space Technologies” Applied Optics, Vol. 37, No. 2, Jan. 1988, pp. 205–227.
X. Yuan, R. Melhem, and R. Gupta, “Compiled Communication for All-Optical TDM Networks,” Proceeding’s of Supercomputing’96, 1996
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Afsahi, A., Dimopoulos, N.J. (1998). Communications latency hiding techniques for a reconfigurable optical interconnect: Benchmark studies. In: Kågström, B., Dongarra, J., Elmroth, E., Waśniewski, J. (eds) Applied Parallel Computing Large Scale Scientific and Industrial Problems. PARA 1998. Lecture Notes in Computer Science, vol 1541. Springer, Berlin, Heidelberg . https://doi.org/10.1007/BFb0095311
Download citation
DOI: https://doi.org/10.1007/BFb0095311
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-65414-8
Online ISBN: 978-3-540-49261-0
eBook Packages: Springer Book Archive