Lydia Y. Chen
ABSTRACT
Consolidation of multiple applications with diverse and changing resource requirements is common in multicore systems as hardware resources are abundant and opportunities for better system usage are plenty. Can we maximize resource usage in such a system while respecting individual application performance targets or is it an oxymoron to simultaneously meet such conflicting measures? In this work we provide a solution to the above difficult problem by constructing a queueing-theory based tool that we use to accurately predict application scalability on multicores and that can also provide the optimal consolidation suggestions to maximize system resource usage while meeting simultaneously application performance targets. The proposed methodology is light-weight and relies on capturing application resource demands using standard tools, via nonintrusive low-level measurements. We evaluate our approach on an IBM Power7 system using the DaCapo and SPECjvm benchmark suites where each benchmark exhibits different patterns of parallelism. From 900 different consolidations of application instances, our tool accurately predicts the average iteration time of allocated applications with an average error below 10%.
- D. Ansaloni, L. Y. Chen, E. Smirni, and W. Binder. Towards autonomic consolidation of heterogeneous workloads. In Workshop on Posters and Demos Track, Middleware, pages 12:1--12:2, 2011. Google Scholar
Digital Library
- D. Ansaloni, L. Y. Chen, E. Smirni, and W. Binder. Model-driven Consolidation of Java Workloads on Multicores. In Proceedings of DSN-PDS, 2012. Google ScholarDigital Library
- D. Ansaloni, L. Y. Chen, E. Smirni, A. Yokokawa, and W. Binder. Find Your Best Match: Predicting Performance of Consolidated Workloads. In ICPE 2012 Posters/Demos Track, ICPE, 2012. Google ScholarDigital Library
- P. Apparao, R. Iyer, X. Zhang, D. Newell, and T. Adelmeyer. Characterization & Analysis of a Server Consolidation Benchmark. In Proceedings of VEE, pages 21--30, 2008. Google ScholarDigital Library
- S. Blackburn, R. Garner, C. Hoffman, A. Khan, K. McKinley, R. Bentzur, A. Diwan, D. Feinberg, D. Frampton, S. Guyer, M. Hirzel, A. Hosking, M. Jump, H. Lee, J. Moss, A. Phansalkar, D. Stefanović, D. von Dincklage, and B. Wiedermann. The DaCapo Benchmarks: Java Benchmarking Development and Analysis. In Proceedings of OOPSLA, pages 169--190, 2006. Google ScholarDigital Library
- J. Chen, L. John, and D. Kaseridis. Modeling Program Resource Demand Using Inherent Program Characteristics. In Proceedings of SIGMETRICS, pages 1--12, 2011. Google ScholarDigital Library
- L. Y. Chen, A. Das, W. Qin, A. Sivasubramaniam, Q. Wang, R. Harper, and B. Morris. Consolidating Clients on Back-end Servers with Co-location and Frequency Control. SIGMETRICS Perform. Eval. Rev., 34:383--384, June 2006. Google ScholarDigital Library
- T. Dey, W. Wang, J. Davidson, and M. Soffa. Characterizing Multi-threaded Applications Based on Shared-resource Contention. In Proceedings of ISPASS, pages 76--86, 2011. Google ScholarDigital Library
- S. Govindan, J. Liu, A. Kansal, and A. Sivasubramaniam. Cuanta: Quantifying Effects of Shared On-chip Resource Interference for Consolidated Virtual Machines. In Proceedings of SOCC, 2011. Google ScholarDigital Library
- M. Hauswirth, P. Sweeney, A. Diwan, and M. Hind. Vertical Profiling: Understanding the Behavior of Object-oriented Applications. In Proceedings of OOPSLA, pages 251--269, 2004. Google ScholarDigital Library
- M. R. Hines, A. Gordon, M. Silva, D. da Silva, K. D. Ryu, and M. Ben-Yehuda. Applications Know Best: Performance-Driven Memory Overcommit With Ginkgo. Technical report, IBM, 2011.Google Scholar
- E. Ïpek, S. McKee, R. Caruana, B. de Supinski, and M. Schulz. Efficiently Exploring Architectural Design Spaces via Predictive Modeling. In Proceedings of ASPLOS, pages 195--206, 2006. Google ScholarDigital Library
- N. Jerger, D. Vantreaseand, and M. Lipast. An Evaluation of Server Consolidation Workloads for Multi-Core Designs. In Proceedings of IISWC, pages 47--56, 2007. Google ScholarDigital Library
- R. Knauerhase, P. Brett, B. Hohlt, T. Li, and S. Hahn. Using OS Observations to Improve Performance in Multicore Systems. IEEE Micro, 28:54--66, 2008. Google ScholarDigital Library
- Y. Koh, R. C. Knauerhase, P. Brett, M. Bowman, Z. Wen, and C. Pu. An Analysis of Performance Interference Effects in Virtual Environments. In Proceedings of ISPASS, pages 200--209, 2007.Google ScholarCross Ref
- B. Lee, J. Collins, H. Wang, and D. Brooks. CPR: Composable Performance Regression for Scalable Multiprocessor Models. In Proceedings of Micro, pages 270--281, 2008. Google ScholarDigital Library
- D. Menascé, V. Almeida, and L. Dowdy. Capacity Planning and Performance Modeling: From Mainframes to Client-Server Systems. Prentice Hall, 1994. Google ScholarDigital Library
- X. Meng, C. Isci, J. Kephart, L. Zhang, E. Bouillet, and D. Pendarakis. Efficient Resource Provisioning in Compute Clouds via VM Multiplexing. In Proceedings of ICAC, pages 11--20, 2010. Google ScholarDigital Library
- N. Mi, G. Casale, L. Cherkasova, and E. Smirni. Burstiness in Multi-tier Applications: Symptoms, Causes, and New Models. In Proceedings of Middleware, pages 265--286, 2008. Google ScholarDigital Library
- R. Nathuji, A. Kansal, and A. Ghaffarkhah. Q-clouds: Managing Performance Interference Effects for QoS-aware Clouds. In Proceedings of EuroSys, pages 237--250, 2010. Google ScholarDigital Library
- M. Reiser and S. S. Lavenberg. Mean-Value Analysis of Closed Multichain Queuing Networks. J. ACM, 27:313--322, 1980. Google ScholarDigital Library
- A. Sharifi, S. Srikantaiah, A. Mishra, M. Kandemir, and C. Das. METE: Meeting End-to-end QoS in Multicores Through System-wide Resource Management. In Proceedings of SIGMETRICS. Google ScholarDigital Library
- X. Song, H. Chen, R. Chen, Y. Wang, and B. Zang. A Case for Scaling Applications to Many-core with OS Clustering. In Proceedings of EuroSys, pages 61--76, 2011. Google ScholarDigital Library
- N. Tallent and J. Mellor-Crummey. Effective Performance Measurement and Analysis of Multithreaded Applications. SIGPLAN Not., 44:229--240, 2009. Google ScholarDigital Library
- B. Urgaonkar, G. Pacifici, P. S. M. Spreitzer, and A. Tantawi. An Analytical Model for Multi-tier Internet Services and its Applications. In Proceedings of SIGMETRICS, pages 291--302, 2005. Google ScholarDigital Library
- T. Wood, L. Cherkasova, K. Ozonat, and P. Shenoy. Profiling and Modeling Resource Usage of Virtualized Applications. In Proceedings of Middleware, pages 366--387, 2008. Google ScholarDigital Library
- T. Wood, P. Shenoy, A. Venkataramani, and M. Yousif. Sandpiper: Black-box and Gray-box Resource Management for Virtual Machines. Comput. Netw., 53:2923--2938, 2009. Google ScholarDigital Library
- S. Zhuravlev, S. Blagodurov, and A. Fedorova. Addressing Shared Resource Contention in Multicore Processors via Scheduling. In Proceedings of ASPLOS, pages 129--142, 2010. Google ScholarDigital Library
Index Terms
- Achieving application-centric performance targets via consolidation on multicores: myth or reality?
Recommendations
Model-driven consolidation of Java workloads on multicores
DSN '12: Proceedings of the 2012 42nd Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN)Optimal resource allocation and application consolidation on modern multicore systems that host multiple applications is not easy. Striking a balance among conflicting targets such as maximizing system throughput and system utilization while minimizing ...
Performance Analysis for Pareto-Optimal Green Consolidation Based on Virtual Machines Live Migration
Huge energy requirement of cloud data centers is prime concern. Dynamic Virtual Machine VM consolidation based on VM live migration to switched-off or put some of the under-loaded host Physical Machines PMs into a low power consumption mode can ...
What to expect when you are consolidating: effective prediction models of application performance on multicores
Consolidation of multiple applications with diverse and changing resource requirements is common in multicore systems as hardware resources are abundant. As opportunities for better system usage become ample, so are opportunities to degrade individual ...
Comments