survey

A Holistic View on Resource Management in Serverless Computing Environments: Taxonomy and Future Directions

Authors:
Anupama Mampage

The University of Melbourne, Australia

The University of Melbourne, Australia

0000-0002-8155-3584
View Profile

,
Shanika Karunasekera

The University of Melbourne, Australia

The University of Melbourne, Australia

0000-0001-7080-5064
View Profile

,
Rajkumar Buyya

The University of Melbourne, Australia

The University of Melbourne, Australia

0000-0001-9754-6496
View Profile

Authors Info & Claims

ACM Computing Surveys Volume 54 Issue 11sArticle No.: 222pp 1–36https://doi.org/10.1145/3510412

Published:09 September 2022Publication History

ACM Computing Surveys

Abstract

Serverless computing has emerged as an attractive deployment option for cloud applications in recent times. The unique features of this computing model include rapid auto-scaling, strong isolation, fine-grained billing options, and access to a massive service ecosystem, which autonomously handles resource management decisions. This model is increasingly being explored for deployments in geographically distributed edge and fog computing networks as well, due to these characteristics. Effective management of computing resources has always gained a lot of attention among researchers. The need to automate the entire process of resource provisioning, allocation, scheduling, monitoring, and scaling has resulted in the need for specialized focus on resource management under the serverless model. In this article, we identify the major aspects covering the broader concept of resource management in serverless environments and propose a taxonomy of elements that influence these aspects, encompassing characteristics of system design, workload attributes, and stakeholder expectations. We take a holistic view on serverless environments deployed across edge, fog, and cloud computing networks. We also analyse existing works discussing aspects of serverless resource management using this taxonomy. This article further identifies gaps in literature and highlights future research directions for improving capabilities of this computing model.

REFERENCES

[1] Agache Alexandru, Brooker Marc, Iordache Alexandra, Liguori Anthony, Neugebauer Rolf, Piwonka Phil, and Popa Diana-Maria. 2020. Firecracker: Lightweight virtualization for serverless applications. In Proceedings of the 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI’20). 419–434.Google Scholar
[2] Akhtar Nabeel, Raza Ali, Ishakian Vatche, and Matta Ibrahim. 2020. COSE: Configuring serverless functions using statistical learning. In Proceedings of the IEEE Conference on Computer Communications (INFOCOM’20). IEEE, 129–138.Google ScholarDigital Library
[3] Akkus Istemi Ekin, Chen Ruichuan, Rimac Ivica, Stein Manuel, Satzke Klaus, Beck Andre, Aditya Paarijaat, and Hilt Volker. 2018. SAND: Towards high-performance serverless computing. In Proceedings of the USENIX Annual Technical Conference. 923–935.Google Scholar
[4] Al-Ali Zaid, Goodarzy Sepideh, Hunter Ethan, Ha Sangtae, Han Richard, Keller Eric, and Rozner Eric. 2018. Making serverless computing more serverless. In Proceedings of the 11th International Conference on Cloud Computing (CLOUD’18). IEEE, 456–459.Google ScholarCross Ref
[5] Ali Ahsan, Pinciroli Riccardo, Yan Feng, and Smirni Evgenia. 2020. Batch: machine learning inference serving on serverless platforms with adaptive batching. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC’20). IEEE Computer Society, 972–986.Google ScholarCross Ref
[6] Arjona Aitor, López Pedro García, Sampé Josep, Slominski Aleksander, and Villard Lionel. 2021. Triggerflow: Trigger-based orchestration of serverless workflows. Future Gen. Comput. Syst. 124 (2021), 215–229.Google ScholarDigital Library
[7] Aske Austin and Zhao Xinghui. 2018. Supporting multi-provider serverless computing on the edge. In Proceedings of the 47th International Conference on Parallel Processing. 1–6.Google Scholar
[8] Aumala Gabriel, Boza Edwin, Ortiz-Avilés Luis, Totoy Gustavo, and Abad Cristina. 2019. Beyond load balancing: Package-aware scheduling for serverless platforms. In Proceedings of the 19th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID’19). IEEE, 282–291.Google ScholarCross Ref
[9] Azure Microsoft. 2021. Azure Functions documentation | Microsoft Docs. Retrieved from https://docs.microsoft.com/en-us/azure/azure-functions/.Google Scholar
[10] Azure Microsoft. 2021. Azure IoT Edge documentation | Microsoft Docs. Retrieved from https://docs.microsoft.com/en-us/azure/iot-edge/?view=iotedge-2018-06.Google Scholar
[11] Azure Microsoft. 2021. Deploy ML models to FPGAs—Azure Machine Learning | Microsoft Docs. Retrieved from https://docs.microsoft.com/en-us/azure/machine-learning/how-to-deploy-fpga-web-service.Google Scholar
[12] Azure Microsoft. 2021. Use GPUs on Azure Kubernetes Service (AKS) | Microsoft Docs. Retrieved from https://docs.microsoft.com/en-us/azure/aks/gpu-cluster.Google Scholar
[13] Baarzi Ataollah Fatahi, Kesidis George, Joe-Wong Carlee, and Shahrad Mohammad. 2021. On merits and viability of multi-cloud serverless. In Proceedings of the ACM Symposium on Cloud Computing. 600–608.Google ScholarDigital Library
[14] Bacis Marco, Brondolin Rolando, and Santambrogio Marco D.. 2020. BlastFunction: An FPGA-as-a-service system for accelerated serverless computing. In Proceedings of the Design, Automation & Test in Europe Conference & Exhibition (DATE’20). IEEE, 852–857.Google ScholarCross Ref
[15] Baldini Ioana, Castro Paul, Chang Kerry, Cheng Perry, Fink Stephen, Ishakian Vatche, Mitchell Nick, Muthusamy Vinod, Rabbah Rodric, Slominski Aleksander, and Suter Philippe. 2017. Serverless computing: Current trends and open problems. In Research Advances in Cloud Computing. Springer, 1–20.Google ScholarCross Ref
[16] Baresi Luciano and Mendonça Danilo Filgueira. 2019. Towards a serverless platform for edge computing. In Proceedings of the IEEE International Conference on Fog Computing (ICFC’19). IEEE, 1–10.Google ScholarCross Ref
[17] Baresi Luciano, Mendonça Danilo Filgueira, and Garriga Martin. 2017. Empowering low-latency applications through a serverless edge computing architecture. In Proceedings of the European Conference on Service-Oriented and Cloud Computing. Springer, 196–210.Google ScholarCross Ref
[18] Bermbach David, Karakaya Ahmet-Serdar, and Buchholz Simon. 2020. Using application knowledge to reduce cold starts in FaaS services. In Proceedings of the 35th Annual ACM Symposium on Applied Computing. 134–143.Google ScholarDigital Library
[19] Bermbach David, Maghsudi Setareh, Hasenburg Jonathan, and Pfandzelter Tobias. 2020. Towards auction-based function placement in serverless fog platforms. In Proceedings of the IEEE International Conference on Fog Computing (ICFC’20). IEEE, 25–31.Google ScholarCross Ref
[20] Bhasi Vivek M, Gunasekaran Jashwant Raj, Thinakaran Prashanth, Mishra Cyan Subhra, Kandemir Mahmut Taylan, and Das Chita. 2021. Kraken: Adaptive container provisioning for deploying dynamic DAGs in serverless platforms. In Proceedings of the ACM Symposium on Cloud Computing. 153–167.Google ScholarDigital Library
[21] Bhattacharjee Anirban, Chhokra Ajay Dev, Kang Zhuangwei, Sun Hongyang, Gokhale Aniruddha, and Karsai Gabor. 2019. Barista: Efficient and scalable serverless serving system for deep learning prediction services. In Proceedings of the IEEE International Conference on Cloud Engineering (IC2E’19). IEEE, 23–33.Google ScholarCross Ref
[22] Burckhardt Sebastian, Gillum Chris, Justo David, Kallas Konstantinos, McMahon Connor, and Meiklejohn Christopher S.. 2021. Durable functions: Semantics for stateful serverless. Proceedings of the ACM on Programming Languages 5, OOPSLA (2021), 1–27.Google ScholarDigital Library
[23] Carbone Paris, Katsifodimos Asterios, Ewen Stephan, Markl Volker, Haridi Seif, and Tzoumas Kostas. 2015. Apache flink: Stream and batch processing in a single engine. Bull. IEEE Comput. Soc. Tech. Committee Data Eng. 36, 4 (2015).Google Scholar
[24] Carreira Joao, Fonseca Pedro, Tumanov Alexey, Zhang Andrew, and Katz Randy. 2018. A case for serverless machine learning. In Proceedings of the Workshop on Systems for ML and Open Source Software at NeurIPS.Google Scholar
[25] Carreira Joao, Fonseca Pedro, Tumanov Alexey, Zhang Andrew, and Katz Randy. 2019. Cirrus: A serverless framework for end-to-end ml workflows. In Proceedings of the ACM Symposium on Cloud Computing. 13–24.Google ScholarDigital Library
[26] Carver Benjamin, Zhang Jingyuan, Wang Ao, and Cheng Yue. 2019. In search of a fast and efficient serverless dag engine. In Proceedings of the IEEE/ACM 4th International Parallel Data Systems Workshop (PDSW’19). IEEE, 1–10.Google ScholarCross Ref
[27] Cassel Gustavo André Setti, Rodrigues Vinicius Facco, Righi Rodrigo da Rosa, Bez Marta Rosecler, Nepomuceno Andressa Cruz, and Costa Cristiano André da. 2022. Serverless computing for Internet of Things: A systematic literature review. Future Gen. Comput. Syst. 128 (2022), 299–316.Google ScholarDigital Library
[28] Castro Paul, Ishakian Vatche, Muthusamy Vinod, and Slominski Aleksander. 2019. The rise of serverless computing. Commun. ACM 62, 12 (2019), 44–54.Google ScholarDigital Library
[29] Cheng Bin, Fuerst Jonathan, Solmaz Gurkan, and Sanada Takuya. 2019. Fog function: Serverless fog computing for data intensive iot services. In Proceedings of the IEEE International Conference on Services Computing (SCC’19). IEEE, 28–35.Google ScholarCross Ref
[30] Ciavotta Michele, Motterlini Davide, Savi Marco, and Tundo Alessandro. 2021. DFaaS: Decentralized function-as-a-service for federated edge computing. In IEEE 10th International Conference on Cloud Networking (CloudNet’21). IEEE, 1–4.Google Scholar
[31] Cicconetti Claudio, Conti Marco, and Passarella Andrea. 2021. On realizing stateful FaaS in serverless edge networks: State propagation. In Proceedings of the IEEE International Conference on Smart Computing (SMARTCOMP’21). IEEE, 89–96.Google ScholarCross Ref
[32] Cloud Google. 2021. Cloud Tpu | Cloud TPU | Google Cloud. Retrieved from https://cloud.google.com/tpu.Google Scholar
[33] Cloud Google. 2021. Edge TPU - Run Inference at the Edge | Google Cloud. Retrieved from https://cloud.google.com/edge-tpu.Google Scholar
[34] Cloud IBM. 2021. IBM Cloud Docs. Retrieved from https://cloud.ibm.com/docs/openwhisk?topic=openwhisk-pkg_composer.Google Scholar
[35] Copik Marcin, Kwasniewski Grzegorz, Besta Maciej, Podstawski Michal, and Hoefler Torsten. 2021. Sebs: A serverless benchmark suite for function-as-a-service computing. In Proceedings of the 22nd ACM International Middleware Conference.Google ScholarDigital Library
[36] Cordingly Robert, Shu Wen, and Lloyd Wes J.. 2020. Predicting performance and cost of serverless computing functions with SAAF. In Proceedings of the IEEE International Conference on Dependable, Autonomic and Secure Computing, International Conference on Pervasive Intelligence and Computing, International Conference on Cloud and Big Data Computing, International Conference on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech’20). IEEE, 640–649.Google Scholar
[37] Das Anirban, Imai Shigeru, Patterson Stacy, and Wittie Mike P.. 2020. Performance optimization for edge-cloud serverless platforms via dynamic task placement. In Proceedings of the 20th IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing (CCGRID’20). IEEE, 41–50.Google ScholarCross Ref
[38] Das Anirban, Leaf Andrew, Varela Carlos A., and Patterson Stacy. 2020. Skedulix: Hybrid cloud scheduling for cost-efficient execution of serverless applications. In Proceedings of the 13th IEEE International Conference on Cloud Computing (CLOUD’20). IEEE, 609–618.Google ScholarCross Ref
[39] Daw Nilanjan, Bellur Umesh, and Kulkarni Purushottam. 2020. Xanadu: Mitigating cascading cold starts in serverless function chain deployments. In Proceedings of the 21st International Middleware Conference. 356–370.Google ScholarDigital Library
[40] Palma Giuseppe De, Giallorenzo Saverio, Mauro Jacopo, and Zavattaro Gianluigi. 2020. Allocation priority policies for serverless function-execution scheduling optimisation. In Proceedings of the International Conference on Service-Oriented Computing. Springer, 416–430.Google ScholarDigital Library
[41] Docker. 2021. Runtime options with Memory, CPUs, and GPUs | Docker Documentation. Retrieved from https://docs.docker.com/config/containers/resource_constraints/.Google Scholar
[42] Duato José, Pena Antonio J., Silla Federico, Mayo Rafael, and Quintana-Ortí Enrique S.. 2010. rCUDA: Reducing the number of GPU-based accelerators in high performance clusters. In Proceedings of the International Conference on High Performance Computing & Simulation. IEEE, 224–231.Google ScholarCross Ref
[43] Eismann Simon, Grohmann Johannes, Eyk Erwin Van, Herbst Nikolas, and Kounev Samuel. 2020. Predicting the costs of serverless workflows. In Proceedings of the ACM/SPEC International Conference on Performance Engineering. 265–276.Google ScholarDigital Library
[44] Eismann Simon, Scheuner Joel, Eyk Erwin Van, Schwinger Maximilian, Grohmann Johannes, Herbst Nikolas, Abad Cristina, and Iosup Alexandru. 2021. The state of serverless applications: Collection, characterization, and community consensus. IEEE Trans. Softw. Eng. 01 (2021), 1–1.Google ScholarCross Ref
[45] Eismann Simon, Scheuner Joel, Eyk Erwin van, Schwinger Maximilian, Grohmann Johannes, Herbst Nikolas, Abad Cristina L., and Iosup Alexandru. 2020. A review of serverless use cases and their characteristics. Retrieved from https://arXiv:2008.11110.Google Scholar
[46] Elgamal Tarek. 2018. Costless: Optimizing cost of serverless computing through function fusion and placement. In Proceedings of the IEEE/ACM Symposium on Edge Computing (SEC’18). IEEE, 300–312.Google ScholarCross Ref
[47] Enes Jonatan, Expósito Roberto R., and Touriño Juan. 2020. Real-time resource scaling platform for big data workloads on serverless environments. Future Gen. Comput. Syst. 105 (2020), 361–379.Google ScholarDigital Library
[48] Fox Geoffrey C., Ishakian Vatche, Muthusamy Vinod, and Slominski Aleksander. 2017. Status of serverless computing and function-as-a-service (FaaS) in industry and research. Retrieved from https://arXiv:1708.08028.Google Scholar
[49] Functions Google Cloud. 2021. Cloud Functions | Google Cloud. Retrieved from https://cloud.google.com/functions/.Google Scholar
[50] Functions Google Cloud. 2021. Quotas | Cloud Functions Documentation | Google Cloud. Retrieved from https://cloud.google.com/functions/quotas.Google Scholar
[51] Gand Fabian, Fronza Ilenia, Ioini Nabil El, Barzegar Hamid R., and Pahl Claus. 2020. Serverless container cluster management for lightweight edge clouds. In Proceedings of the 10th International Conference on Cloud Computing and Services Science (CLOSER’20). 302–311.Google ScholarCross Ref
[52] García-López Pedro, Sánchez-Artigas Marc, Shillaker Simon, Pietzuch Peter, Breitgand David, Vernik Gil, Sutra Pierre, Tarrant Tristan, and Ferrer Ana Juan. 2019. ServerMix: Tradeoffs and challenges of serverless data analytics. Retrieved from https://arxiv.org/abs/1907.11465.Google Scholar
[53] Gias Alim Ul and Casale Giuliano. 2020. COCOA: Cold start aware capacity planning for function-as-a-service platforms. In Proceedings of the 28th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS’20). IEEE, 1–8.Google ScholarCross Ref
[54] Gill Sukhpal Singh. 2021. Quantum and blockchain-based Serverless edge computing: A vision, model, new trends, and future directions. Internet Technol. Lett. (2021), e275.Google Scholar
[55] Gill Sukhpal Singh, Kumar Adarsh, Singh Harvinder, Singh Manmeet, Kaur Kamalpreet, Usman Muhammad, and Buyya Rajkumar. 2020. Quantum computing: A taxonomy, systematic review and future directions. Softw. Pract. Exper. 52, 1 (2022), 66–114.Google Scholar
[56] Giménez-Alventosa Vicent, Moltó Germán, and Caballer Miguel. 2019. A framework and a performance assessment for serverless MapReduce on AWS Lambda. Future Gen. Comput. Syst. 97 (2019), 259–274.Google ScholarDigital Library
[57] Grambow Martin, Pfandzelter Tobias, Burchard Luk, Schubert Carsten, Zhao Max, and Bermbach David. 2021. BeFaaS: An application-centric benchmarking framework for FaaS platforms. In Proceedings of the 9th IEEE International Conference on Cloud Engineering.Google ScholarCross Ref
[58] Gunasekaran Jashwant Raj, Thinakaran Prashanth, Kandemir Mahmut Taylan, Urgaonkar Bhuvan, Kesidis George, and Das Chita. 2019. Spock: Exploiting serverless functions for SLO and cost aware resource procurement in public cloud. In Proceedings of the 12th IEEE International Conference on Cloud Computing (CLOUD’19). IEEE, 199–208.Google ScholarCross Ref
[59] Gunasekaran Jashwant Raj, Thinakaran Prashanth, Nachiappan Nachiappan C., Kandemir Mahmut Taylan, and Das Chita R.. 2020. Fifer: Tackling resource underutilization in the serverless era. In Proceedings of the 21st International Middleware Conference. 280–295.Google ScholarDigital Library
[60] Gupta Vipul, Phade Soham, Courtade Thomas, and Ramchandran Kannan. 2020. Utility-based resource allocation and pricing for serverless computing. Retrieved from https://arXiv:2008.07793.Google Scholar
[61] Hall Adam and Ramachandran Umakishore. 2019. An execution model for serverless functions at the edge. In Proceedings of the International Conference on Internet of Things Design and Implementation. 225–236.Google ScholarDigital Library
[62] Hellerstein Joseph M., Faleiro Jose, Gonzalez Joseph E., Schleier-Smith Johann, Sreekanti Vikram, Tumanov Alexey, and Wu Chenggang. 2019. Serverless computing: One step forward, two steps back. In Proceedings of the Conference on Innovative Data Systems Research.Google Scholar
[63] HoseinyFarahabady MohammadReza, Lee Young Choon, Zomaya Albert Y., and Tari Zahir. 2017. A QoS-aware resource allocation controller for function as a service (FaaS) platform. In Proceedings of the International Conference on Service-Oriented Computing. Springer, 241–255.Google ScholarDigital Library
[64] Hunhoff Erika, Irshad Shazal, Thurimella Vijay, Tariq Ali, and Rozner Eric. 2020. Proactive serverless function resource management. In Proceedings of the 6th International Workshop on Serverless Computing. 61–66.Google ScholarDigital Library
[65] Jia Zhipeng and Witchel Emmett. 2021. Boki: Stateful serverless computing with shared logs. In Proceedings of the ACM SIGOPS 28th Symposium on Operating Systems Principles CD-ROM. 691–707.Google ScholarDigital Library
[66] Jia Zhipeng and Witchel Emmett. 2021. Nightcore: Efficient and scalable serverless computing for latency-sensitive, interactive microservices. In Proceedings of the 26th ACM International Conference on Architectural Support for Programming Languages and Operating Systems. 152–166.Google ScholarDigital Library
[67] Jindal Anshul, Gerndt Michael, Chadha Mohak, Podolskiy Vladimir, and Chen Pengfei. 2021. Function delivery network: Extending serverless computing for heterogeneous platforms. Softw. Pract. Exper. 51, 9 (2021), 1936–1963.Google ScholarCross Ref
[68] Jonas Eric, Schleier-Smith Johann, Sreekanti Vikram, Tsai Chia-Che, Khandelwal Anurag, Pu Qifan, Shankar Vaishaal, Carreira Joao, Krauth Karl, Yadwadkar Neeraja, et al. 2019. Cloud programming simplified: A Berkeley view on serverless computing. https://www2.eecs.berkeley.edu/Pubs/TechRpts/2019/EECS-2019-3.pdf.Google Scholar
[69] Kaffes Kostis, Yadwadkar Neeraja J., and Kozyrakis Christos. 2019. Centralized core-granular scheduling for serverless functions. In Proceedings of the ACM Symposium on Cloud Computing. 158–164.Google ScholarDigital Library
[70] Kanso Ali and Youssef Alaa. 2017. Serverless: Beyond the cloud. In Proceedings of the 2nd International Workshop on Serverless Computing. 6–10.Google ScholarDigital Library
[71] Khandelwal Anurag, Kejariwal Arun, and Ramasamy Karthikeyan. 2020. Le Taureau: Deconstructing the serverless landscape and a look forward. In Proceedings of the ACM SIGMOD International Conference on Management of Data. 2641–2650.Google ScholarDigital Library
[72] Kim Jeongchul and Lee Kyungyong. 2019. Functionbench: A suite of workloads for serverless cloud function service. In Proceedings of the 12th IEEE International Conference on Cloud Computing (CLOUD’19). IEEE, 502–504.Google ScholarCross Ref
[73] Kim Youngbin and Lin Jimmy. 2018. Serverless data analytics with flint. In Proceedings of the IEEE 11th International Conference on Cloud Computing (CLOUD’18). IEEE, 451–455.Google ScholarCross Ref
[74] Kim Young Ki, HoseinyFarahabady M. Reza, Lee Young Choon, and Zomaya Albert Y.. 2020. Automated fine-grained CPU cap control in serverless computing platform. IEEE Trans. Parallel Distrib. Syst. 31, 10 (2020), 2289–2301.Google ScholarCross Ref
[75] Kritikos Kyriakos and Skrzypek Paweł. 2018. A review of serverless frameworks. In Proceedings of the IEEE/ACM International Conference on Utility and Cloud Computing Companion (UCC’18). IEEE, 161–168.Google ScholarCross Ref
[76] Kubeless. 2021. Kubeless. Retrieved from https://kubeless.io/.Google Scholar
[77] Kuhlenkamp Jörn, Werner Sebastian, Borges Maria C., Tal Karim El, and Tai Stefan. 2019. An evaluation of FaaS platforms as a foundation for serverless big data processing. In Proceedings of the 12th IEEE/ACM International Conference on Utility and Cloud Computing. 1–9.Google ScholarDigital Library
[78] Lee Hyungro, Satyam Kumar, and Fox Geoffrey. 2018. Evaluation of production serverless computing environments. In Proceedings of the 11th IEEE International Conference on Cloud Computing (CLOUD’18). IEEE, 442–450.Google ScholarCross Ref
[79] Lee Youngsoo and Choi Sunghee. [n.d.]. A greedy load balancing algorithm on serverless platforms maximizing locality. http://get.prev.kr/papers/FaaS-Locality.pdf.Google Scholar
[80] Li Zijun, Chen Quan, Xue Shuai, Ma Tao, Yang Yong, Song Zhuo, and Guo Minyi. 2020. Amoeba: QoS-awareness and reduced resource usage of microservices with serverless computing. In Proceedings of the IEEE International Parallel and Distributed Processing Symposium (IPDPS’20). IEEE, 399–408.Google ScholarCross Ref
[81] Lin Changyuan and Khazaei Hamzeh. 2020. Modeling and optimization of performance and cost of serverless applications. IEEE Trans. Parallel Distrib. Syst. 32, 3 (2020), 615–632.Google ScholarCross Ref
[82] Ling Wei, Ma Lin, Tian Chen, and Hu Ziang. 2019. Pigeon: A dynamic and efficient serverless and FaaS framework for private cloud. In Proceedings of the International Conference on Computational Science and Computational Intelligence (CSCI’19). IEEE, 1416–1421.Google ScholarCross Ref
[83] Liu Jinfeng, Mi Zeyu, Huang Zheng, Hua Zhichao, and Xia Yubin. 2020. Hcloud: A serverless platform for jointcloud computing. In Proceedings of the IEEE International Conference on Joint Cloud Computing. IEEE, 86–93.Google ScholarCross Ref
[84] Mahmoudi Nima and Khazaei Hamzeh. 2020. Performance modeling of serverless computing platforms. IEEE Trans. Cloud Comput. 01 (2020), 1–1.Google ScholarCross Ref
[85] Mahmoudi Nima and Khazaei Hamzeh. 2021. SimFaaS: A performance simulator for serverless computing platforms. Retrieved from https://arXiv:2102.08904.Google Scholar
[86] Mahmoudi Nima, Lin Changyuan, Khazaei Hamzeh, and Litoiu Marin. 2019. Optimizing serverless computing: Introducing an adaptive function placement algorithm. In Proceedings of the 29th Annual International Conference on Computer Science and Software Engineering. 203–213.Google Scholar
[87] Maissen Pascal, Felber Pascal, Kropf Peter, and Schiavoni Valerio. 2020. FaaSdom: A benchmark suite for serverless computing. In Proceedings of the 14th ACM International Conference on Distributed and Event-based Systems. 73–84.Google ScholarDigital Library
[88] Mampage Anupama, Karunasekera Shanika, and Buyya Rajkumar. 2021. Deadline-aware dynamic resource management in serverless computing environments. In Proceedings of the IEEE/ACM 21st International Symposium on Cluster, Cloud and Internet Computing (CCGrid’21). IEEE, 483–492.Google ScholarCross Ref
[89] Mohan Anup, Sane Harshad, Doshi Kshitij, Edupuganti Saikrishna, Nayak Naren, and Sukhomlinov Vadim. 2019. Agile cold starts for scalable serverless. In Proceedings of the 11th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud’19).Google ScholarDigital Library
[90] Müller Ingo, Marroquín Renato, and Alonso Gustavo. 2020. Lambada: Interactive data analytics on cold data using serverless cloud infrastructure. In Proceedings of the ACM SIGMOD International Conference on Management of Data. 115–130.Google ScholarDigital Library
[91] Naranjo Diana M., Risco Sebastián, Alfonso Carlos de, Pérez Alfonso, Blanquer Ignacio, and Moltó Germán. 2020. Accelerated serverless computing based on GPU virtualization. J. Parallel Distrib. Comput. 139 (2020), 32–42.Google ScholarDigital Library
[92] Nguyen Hai Duc, Yang Zhifei, and Chien Andrew A.. 2020. Motivating high performance serverless workloads. In Proceedings of the 1st Workshop on High Performance Serverless Computing. 25–32.Google ScholarDigital Library
[93] Oakes Edward, Yang Leon, Zhou Dennis, Houck Kevin, Harter Tyler, Arpaci-Dusseau Andrea, and Arpaci-Dusseau Remzi. 2018. SOCK: Rapid task provisioning with serverless-optimized containers. In Proceedings of the USENIX Annual Technical Conference. 57–70.Google Scholar
[94] OpenFaas. 2021. Home | OpenFaaS—Serverless Functions Made Simple. Retrieved from https://www.openfaas.com/.Google Scholar
[95] OpenWhisk Apache. 2021. Documentation. Retrieved from https://openwhisk.apache.org/documentation.html.Google Scholar
[96] Pemberton Nathan and Schleier-Smith Johann. 2019. The serverless data center: Hardware disaggregation meets serverless computing. In Proceedings of the 1st Workshop on Resource Disaggregation, Vol. 4.Google Scholar
[97] Pinto Duarte, Dias João Pedro, and Ferreira Hugo Sereno. 2018. Dynamic allocation of serverless functions in IoT environments. In Proceedings of the IEEE 16th International Conference on Embedded and Ubiquitous Computing (EUC’18). IEEE, 1–8.Google ScholarCross Ref
[98] Poth Alexander, Schubert Niklas, and Riel Andreas. 2020. Sustainability efficiency challenges of modern IT architectures–A quality model for serverless energy footprint. In Proceedings of the European Conference on Software Process Improvement. Springer, 289–301.Google ScholarCross Ref
[99] Prometheus. 2021. Overview | Prometheus. Retrieved from https://prometheus.io/docs/introduction/overview/.Google Scholar
[100] Rausch Thomas, Rashed Alexander, and Dustdar Schahram. 2021. Optimized container scheduling for data-intensive serverless edge computing. Future Gen. Comput. Syst. 114 (2021), 259–271.Google ScholarCross Ref
[101] Raza Ali, Matta Ibrahim, Akhtar Nabeel, Kalavri Vasiliki, and Isahagian Vatche. 2021. SoK: Function-as-a-service: From an application developer’s perspective. J. Syst. Res. 1, 1 (2021).Google Scholar
[102] Ringlein Burkhard, Abel François, Diamantopoulos Dionysios, Weiss Beat, Hagleitner Christoph, Reichenbach Marc, and Fey Dietmar. 2021. A case for function-as-a-service with disaggregated FPGAs. In Proceedings of the IEEE 14th International Conference on Cloud Computing (CLOUD’21). IEEE Computer Society.Google ScholarCross Ref
[103] Risco Sebastián and Moltó Germán. 2021. GPU-enabled serverless workflows for efficient multimedia processing. Appl. Sci. 11, 4 (2021), 1438.Google ScholarCross Ref
[104] Rossi Fabiana, Nardelli Matteo, and Cardellini Valeria. 2019. Horizontal and vertical scaling of container-based applications using reinforcement learning. In Proceedings of the 12th IEEE International Conference on Cloud Computing (CLOUD’19). IEEE, 329–338.Google ScholarCross Ref
[105] Sampé Josep, Vernik Gil, Sánchez-Artigas Marc, and García-López Pedro. 2018. Serverless data analytics in the IBM cloud. In Proceedings of the 19th International Middleware Conference Industry. 1–8.Google ScholarDigital Library
[106] Scheuner Joel and Leitner Philipp. 2020. Function-as-a-service performance evaluation: A multivocal literature review. J. Syst. Softw. 170 (2020), 110708.Google ScholarCross Ref
[107] Schleier-Smith Johann, Sreekanti Vikram, Khandelwal Anurag, Carreira Joao, Yadwadkar Neeraja J., Popa Raluca Ada, Gonzalez Joseph E., Stoica Ion, and Patterson David A.. 2021. What serverless computing is and should become: The next phase of cloud computing. Commun. ACM 64, 5 (2021), 76–84.Google ScholarDigital Library
[108] Schuler Lucia, Jamil Somaya, and Kühl Niklas. 2021. AI-based resource allocation: Reinforcement learning for adaptive auto-scaling in serverless environments. In Proceedings of the 21st International Symposium on Cluster, Cloud and Internet Computing (CCGrid’21). IEEE, 804–811.Google ScholarCross Ref
[109] Services Amazon Web. 2020. AWS Lambda—Developer Guide. Retrieved from https://docs.aws.amazon.com/lambda/latest/dg/lambda-dg.pdf.Google Scholar
[110] Services Amazon Web. 2021. Amazon Braket Quantum Computers—Amazon Web Services. Retrieved from https://aws.amazon.com/braket/quantum-computers/.Google Scholar
[111] Services Amazon Web. 2021. Amazon Elastic Inference - Amazon Web Services. Retrieved from https://aws.amazon.com/machine-learning/elastic-inference/.Google Scholar
[112] Services Amazon Web. 2021. AWS Inferentia—Amazon Web Services (AWS). Retrieved from https://aws.amazon.com/machine-learning/inferentia/.Google Scholar
[113] Services Amazon Web. 2021. AWS IoT Greengrass—Amazon Web Services. Retrieved from https://aws.amazon.com/greengrass/.Google Scholar
[114] Services Amazon Web. 2021. AWS Trainium—Amazon Web Services (AWS). Retrieved from https://aws.amazon.com/machine-learning/trainium/.Google Scholar
[115] Shafiei Hossein, Khonsari Ahmad, and Mousavi Payam. 2019. Serverless computing: A survey of opportunities, challenges and applications. Retrieved from https://arXiv:1911.01296.Google Scholar
[116] Shahrad Mohammad, Fonseca Rodrigo, Goiri Íñigo, Chaudhry Gohar, Batum Paul, Cooke Jason, Laureano Eduardo, Tresness Colby, Russinovich Mark, and Bianchini Ricardo. 2020. Serverless in the wild: Characterizing and optimizing the serverless workload at a large cloud provider. In Proceedings of the USENIX Annual Technical Conference. 205–218.Google Scholar
[117] Shankar Vaishaal, Krauth Karl, Vodrahalli Kailas, Pu Qifan, Recht Benjamin, Stoica Ion, Ragan-Kelley Jonathan, Jonas Eric, and Venkataraman Shivaram. 2020. Serverless linear algebra. In Proceedings of the 11th ACM Symposium on Cloud Computing. 281–295.Google ScholarDigital Library
[118] Shillaker Simon and Pietzuch Peter. 2020. Faasm: Lightweight isolation for efficient stateful serverless computing. In Proceedings of the USENIX Annual Technical Conference. 419–433.Google Scholar
[119] Silva Paulo, Fireman Daniel, and Pereira Thiago Emmanuel. 2020. Prebaking functions to warm the serverless cold start. In Proceedings of the 21st International Middleware Conference. 1–13.Google ScholarDigital Library
[120] Singhvi Arjun, Balasubramanian Arjun, Houck Kevin, Shaikh Mohammed Danish, Venkataraman Shivaram, and Akella Aditya. 2021. Atoll: A scalable low-latency serverless platform. In Proceedings of the ACM Symposium on Cloud Computing. 138–152.Google ScholarDigital Library
[121] Solaiman Khondokar and Adnan Muhammad Abdullah. 2020. WLEC: A not so cold architecture to mitigate cold start problem in serverless computing. In Proceedings of the IEEE International Conference on Cloud Engineering (IC2E’20). IEEE, 144–153.Google ScholarCross Ref
[122] Soltani Boubaker, Ghenai Afifa, and Zeghib Nadia. 2018. Towards distributed containerized serverless architecture in multi cloud environment. Procedia Comput. Sci. 134 (2018), 121–128.Google ScholarCross Ref
[123] Somma Gaetano, Ayimba Constantine, Casari Paolo, Romano Simon Pietro, and Mancuso Vincenzo. 2020. When less is more: Core-restricted container provisioning for serverless computing. In Proceedings of the IEEE Conference on Computer Communications Workshops (INFOCOM’20). IEEE, 1153–1159.Google ScholarCross Ref
[124] Sreekanti Vikram, Wu Chenggang, Chhatrapati Saurav, Gonzalez Joseph E., Hellerstein Joseph M, and Faleiro Jose M.. 2020. A fault-tolerance shim for serverless computing. In Proceedings of the 15th European Conference on Computer Systems. 1–15.Google ScholarDigital Library
[125] Stein Manuel. 2018. Adaptive Event Dispatching in Serverless Computing Infrastructures. Ph.D. Dissertation. Brunel University, London.Google Scholar
[126] Stein Manuel. 2018. The serverless scheduling problem and NOAH. Retrieved from https://arXiv:1809.06100.Google Scholar
[127] Suresh Amoghavarsha, Somashekar Gagan, Varadarajan Anandh, Kakarla Veerendra Ramesh, Upadhyay Hima, and Gandhi Anshul. 2020. ENSURE: Efficient scheduling and autonomous resource management in serverless environments. In Proceedings of the IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS’20). IEEE, 1–10.Google ScholarCross Ref
[128] Tariq Ali, Pahl Austin, Nimmagadda Sharat, Rozner Eric, and Lanka Siddharth. 2020. Sequoia: Enabling quality-of-service in serverless computing. In Proceedings of the 11th ACM Symposium on Cloud Computing. 311–327.Google ScholarDigital Library
[129] Turner Paul, Rao Bharata B., and Rao Nikhil. 2010. CPU bandwidth control for CFS. In Proceedings of the Linux Symposium. Citeseer, 245.Google Scholar
[130] Wang Huaimin, Shi Peichang, and Zhang Yiming. 2017. Jointcloud: A cross-cloud cooperation architecture for integrated internet service customization. In Proceedings of the IEEE 37th International Conference on Distributed Computing Systems (ICDCS’17). IEEE, 1846–1855.Google ScholarCross Ref
[131] Wang Liang, Li Mengyuan, Zhang Yinqian, Ristenpart Thomas, and Swift Michael. 2018. Peeking behind the curtains of serverless platforms. In Proceedings of the USENIX Annual Technical Conference. 133–146.Google Scholar
[132] Werner Sebastian, Kuhlenkamp Jörn, Klems Markus, Müller Johannes, and Tai Stefan. 2018. Serverless big data processing using matrix multiplication as example. In Proceedings of the IEEE International Conference on Big Data (BigData’18). IEEE, 358–365.Google ScholarCross Ref
[133] Xu Zhengjun, Zhang Haitao, Geng Xin, Wu Qiong, and Ma Huadong. 2019. Adaptive function launching acceleration in serverless computing platforms. In Proceedings of the 25th International Conference on Parallel and Distributed Systems (ICPADS’19). IEEE, 9–16.Google ScholarCross Ref
[134] Yu Hanfei, Wang Hao, Li Jian, and Park Seung-Jong. 2021. Harvesting idle resources in serverless computing via reinforcement learning. Retrieved from https://arXiv:2108.12717.Google Scholar
[135] Yu Tianyi, Liu Qingyuan, Du Dong, Xia Yubin, Zang Binyu, Lu Ziqian, Yang Pingchao, Qin Chenggang, and Chen Haibo. 2020. Characterizing serverless platforms with serverlessbench. In Proceedings of the 11th ACM Symposium on Cloud Computing. 30–44.Google ScholarDigital Library
[136] Yussupov Vladimir, Soldani Jacopo, Breitenbücher Uwe, Brogi Antonio, and Leymann Frank. 2021. FaaSten your decisions: A classification framework and technology review of function-as-a-Service platforms. J. Syst. Softw. 175 (2021), 110906.Google ScholarCross Ref
[137] Zaharia Matei, Xin Reynold S., Wendell Patrick, Das Tathagata, Armbrust Michael, Dave Ankur, Meng Xiangrui, Rosen Josh, Venkataraman Shivaram, Franklin Michael J. et al. 2016. Apache spark: A unified engine for big data processing. Commun. ACM 59, 11 (2016), 56–65.Google ScholarDigital Library
[138] Zhang Chengliang, Yu Minchen, Wang Wei, and Yan Feng. 2019. Mark: Exploiting cloud services for cost-effective, slo-aware machine learning inference serving. In Proceedings of the USENIX Annual Technical Conference. 1049–1062.Google Scholar
[139] Zhang Haoran, Cardoza Adney, Chen Peter Baile, Angel Sebastian, and Liu Vincent. 2020. Fault-tolerant and transactional stateful serverless workflows. In Proceedings of the 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI’20). 1187–1204.Google Scholar
[140] Zhang Hong, Tang Yupeng, Khandelwal Anurag, Chen Jingrong, and Stoica Ion. 2021. Caerus: NIMBLE task scheduling for serverless analytics. In Proceedings of the USENIX Conference on Networked Systems Design and Implementation (NSDI’21). 653–669.Google Scholar
[141] Zhang Michael, Krintz Chandra, and Wolski Rich. 2021. Edge-adaptable serverless acceleration for machine learning Internet of Things applications. Software: Practice and Experience. 51, 9 (2021), 1852–1867.Google Scholar

Index Terms

A Holistic View on Resource Management in Serverless Computing Environments: Taxonomy and Future Directions
1. Computer systems organization
  1. Architectures
    1. Distributed architectures
2. General and reference
  1. Document types
    1. Surveys and overviews

Recommendations

Recent advancements in resource allocation techniques for cloud computing environment: a systematic review

There are two actors in cloud computing environment cloud providers and cloud users. On one hand cloud providers hold enormous computing resources in the cloud large data centers that rent the resources out to the cloud users on a pay-per-use basis to ...
Read More
Supporting Multi-Provider Serverless Computing on the Edge
ICPP Workshops '18: Workshop Proceedings of the 47th International Conference on Parallel Processing

Serverless computing has recently emerged as a new execution model for cloud computing, in which service providers offer compute runtimes, also known as Function-as-a-Service (FaaS) platforms, allowing users to develop, execute and manage application ...
Read More
Cloud resource provisioning: survey, status and future research directions

Cloud resource provisioning is a challenging job that may be compromised due to unavailability of the expected resources. Quality of Service (QoS) requirements of workloads derives the provisioning of appropriate resources to cloud workloads. Discovery ...
Read More

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Published in
ACM Computing Surveys Volume 54, Issue 11s
January 2022
785 pages
ISSN:0360-0300
EISSN:1557-7341
DOI:10.1145/3551650
Editor:
Albert Zomaya
University of Sydney, Australia
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
- Published: 9 September 2022
- Online AM: 14 January 2022
- Accepted: 1 December 2021
- Revised: 1 November 2021
- Received: 1 May 2021
Published in csur Volume 54, Issue 11s

Permissions
Request permissions about this article.
Request Permissions

Check for updates
Author Tags
Serverless computing
resource management
workload characterization
performance prediction
application modelling
resource scheduling
resource scaling
Qualifiers
- survey
- Refereed
Conference
Funding Sources
Other Metrics
View Article Metrics

Article Metrics
- 9
  Total Citations
  View Citations
- 3,153
  Total Downloads
- Downloads (Last 12 months)1,028
- Downloads (Last 6 weeks)91
Other Metrics
View Author Metrics
Cited By
View all

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

View Full Text

HTML Format

View this article in HTML Format .

View HTML Format

A Holistic View on Resource Management in Serverless Computing Environments: Taxonomy and Future Directions

ACM Computing Surveys

Abstract

REFERENCES

Cited By

Index Terms

Recommendations

Recent advancements in resource allocation techniques for cloud computing environment: a systematic review

Supporting Multi-Provider Serverless Computing on the Edge

Cloud resource provisioning: survey, status and future research directions