Skip to main content
SpringerLink
Log in

Evaluating the Impact of MPI Network Sharing on HPC Applications

  • Conference paper
  • First Online:
Parallel Computational Technologies (PCT 2023)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1868))

Included in the following conference series:

  • 212 Accesses

Abstract

In any modern supercomputer system, a so-called noise inevitably occurs. It can be defined as an external influence of the software and hardware environment leading to a change in the execution time or other properties of applications running on a supercomputer. Although the noise can noticeably affect the performance of HPC applications in some cases, neither the nature of its occurrence nor the degree of its influence have been investigated in detail. In this paper, we study how much a certain type of noise, caused by sharing of MPI network resources, can impact the performance of parallel programs. To do this, we conducted a series of experiments using synthetic noise on the Lomonosov-2 supercomputer to determine to what extent such noise can slow down the execution of widely used benchmarks and computing cores.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. OSU Micro-benchmarks. https://mvapich.cse.ohio-state.edu/benchmarks/

  2. Afzal, A., Hager, G., Wellein, G.: Propagation and decay of injected one-off delays on clusters: a case study. In: 2019 IEEE International Conference on Cluster Computing (CLUSTER), pp. 1–10. IEEE (2019). https://doi.org/10.1109/CLUSTER.2019.8890995

  3. Akkan, H., Lang, M., Liebrock, L.: Understanding and isolating the noise in the Linux kernel. Int. J. High Perform. Comput. Appl. 27(2), 136–146 (2013). https://doi.org/10.1177/1094342013477892

    Article  Google Scholar 

  4. Bailey, D., Harris, T., Saphir, W., Van Der Wijngaart, R., Woo, A., Yarrow, M.: The NAS parallel benchmarks 2.0. Technical report, Technical Report NAS-95-020, NASA Ames Research Center (1995)

    Google Scholar 

  5. Beckman, P., Iskra, K., Yoshii, K., Coghlan, S.: The influence of operating systems on the performance of collective operations at extreme scale. In: 2006 IEEE International Conference on Cluster Computing, pp. 1–12. IEEE (2006). https://doi.org/10.1109/CLUSTR.2006.311846

  6. De, P., Kothari, R., Mann, V.: Identifying sources of operating system jitter through fine-grained kernel instrumentation. In: Proceedings - IEEE International Conference on Cluster Computing, ICCC, pp. 331–340 (2007). https://doi.org/10.1109/CLUSTR.2007.4629247

  7. De, P., Mann, V., Mittal, U.: Handling OS jitter on multicore multithreaded systems. In: Proceedings of the 2009 IEEE International Parallel and Distributed Processing Symposium, IPDPS 2009, pp. 1–12. IEEE Computer Society (2009). https://doi.org/10.1109/IPDPS.2009.5161046

  8. Ferreira, K.B., Bridges, P., Brightwell, R.: Characterizing application sensitivity to OS interference using kernel-level noise injection. In: 2008 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2008 (2008). https://doi.org/10.1109/SC.2008.5219920

  9. Garg, R., De, P.: Impact of noise on scaling of collectives: an empirical evaluation. In: Robert, Y., Parashar, M., Badrinath, R., Prasanna, V.K. (eds.) HiPC 2006. LNCS, vol. 4297, pp. 460–471. Springer, Heidelberg (2006). https://doi.org/10.1007/11945918_45

    Chapter  Google Scholar 

  10. Hoefler, T., Schneider, T., Lumsdaine, A.: Characterizing the influence of system noise on large-scale applications by simulation. In: Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2010, pp. 1–11. IEEE (2010). https://doi.org/10.1109/SC.2010.12

  11. Jones, T.: Linux kernel co-scheduling for bulk synchronous parallel applications. In: Proceedings of the 1st International Workshop on Runtime and Operating Systems for Supercomputers, pp. 57–64 (2011). https://doi.org/10.1145/1988796.1988805

  12. Kim, J., Dally, W.J., Abts, D.: Flattened butterfly: a cost-efficient topology for high-radix networks. In: Proceedings - International Symposium on Computer Architecture, pp. 126–137 (2007). https://doi.org/10.1145/1250662.1250679

  13. León, E.A., Karlin, I., Moody, A.T.: System noise revisited: enabling application scalability and reproducibility with SMT. In: 2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS), pp. 596–607. IEEE (2016). https://doi.org/10.1109/IPDPS.2016.48

  14. Nikitenko, D.A., et al.: Influence of noisy environments on behavior of HPC applications. Lobachevskii J. Math. 42(7), 1560–1570 (2021). https://doi.org/10.1134/S1995080221070192

    Article  MATH  Google Scholar 

  15. Petrini, F., Kerbyson, D.J., Pakin, S.: The case of the missing supercomputer performance: achieving optimal performance on the 8,192 processors of ASCI Q. In: Proceedings of the 2003 ACM/IEEE Conference on Supercomputing, SC 2003, p. 55. IEEE (2003). https://doi.org/10.1145/1048935.1050204

  16. Shah, A., Müller, M., Wolf, F.: Estimating the impact of external interference on application performance. In: Aldinucci, M., Padovani, L., Torquati, M. (eds.) Euro-Par 2018. LNCS, vol. 11014, pp. 46–58. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-96983-1_4

    Chapter  Google Scholar 

  17. Shah, A., Wolf, F., Zhumatiy, S., Voevodin, V.: Capturing inter-application interference on clusters. In: Proceedings - IEEE International Conference on Cluster Computing, ICCC (2013). https://doi.org/10.1109/CLUSTER.2013.6702665

  18. Tsafrir, D., Etsion, Y., Feitelson, D.G., Kirkpatrick, S.: System noise, OS clock ticks, and fine-grained parallel applications. In: Proceedings of the 19th Annual International Conference on Supercomputing, pp. 303–312 (2005). https://doi.org/10.1145/1088149.1088190

  19. Vetter, J., Chambreau, C.: mpiP: lightweight, scalable MPI profiling (2005). http://gec.di.uminho.pt/Discip/MInf/cpd1415/PCP/MPI/mpiP_LightweightScalableMPIProfiling.pdf

  20. Voevodin, V., et al.: Supercomputer Lomonosov-2: large scale, deep monitoring and fine analytics for the user community. Supercomput. Front. Innov. 6(2) (2019). https://doi.org/10.14529/js190201

  21. Voevodin, V., Stefanov, K., Zhumatiy, S.: Overhead analysis for performance monitoring counters multiplexing. In: Voevodin, V., Sobolev, S., Yakobovskiy, M., Shagaliev, R. (eds.) RuSCDays 2022. LNCS, vol. 13708, pp. 461–474. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-22941-1_34

    Chapter  Google Scholar 

Download references

Acknowledgments

The reported study was funded by the Russian Foundation for Basic Research (project № 21-57-12011). The research was carried out on shared HPC resources at Lomonosov Moscow State University.

Author information

Authors and Affiliations

  1. Lomonosov Moscow State University, Moscow, Russian Federation

    Anna Khudoleeva, Konstantin Stefanov & Vadim Voevodin

Authors
  1. Anna Khudoleeva
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Konstantin Stefanov
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Vadim Voevodin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anna Khudoleeva .

Editor information

Editors and Affiliations

  1. South Ural State University, Chelyabinsk, Russia

    Leonid Sokolinsky

  2. South Ural State University, Chelyabinsk, Russia

    Mikhail Zymbler

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Khudoleeva, A., Stefanov, K., Voevodin, V. (2023). Evaluating the Impact of MPI Network Sharing on HPC Applications. In: Sokolinsky, L., Zymbler, M. (eds) Parallel Computational Technologies. PCT 2023. Communications in Computer and Information Science, vol 1868. Springer, Cham. https://doi.org/10.1007/978-3-031-38864-4_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-38864-4_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-38863-7

  • Online ISBN: 978-3-031-38864-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation