Pekka Enberg
ABSTRACT
In serverless computing, minimizing database access latency is crucial, but databases predominantly reside in cloud environments, necessitating costly network round-trips. Embedding an in-process database library such as SQLite into the serverless runtime is the holy grail for low-latency database access. However, SQLite's architecture limits concurrency and multitenancy, which is essential for serverless providers, forcing us to rethink the architecture for integrating a database library. We propose changing the SQLite virtual machine to provide asynchronous bytecode instructions to avoid blocking in the library and decoupling the query and storage engines to facilitate database and serverless runtime co-design.
- Cloudflare. 2023. Workers. https://workers.cloudflare.com.Google Scholar
- Kevin P. Gaffney, Martin Prammer, Larry Brasfield, D. Richard Hipp, Dan Kennedy, and Jignesh M. Patel. 2022. SQLite: Past, Present, and Future. Proc. VLDB Endow. (2022).Google Scholar
- D. Richard Hipp. 2023. SQLite. https://www.sqlite.org/index.html.Google Scholar
- Ben Johnson. 2023. LiteFS. https://github.com/superfly/litefs.Google Scholar
- Eric Jonas, Johann Schleier-Smith, Vikram Sreekanti, Chia-Che Tsai, Anurag Khandelwal, Qifan Pu, Vaishaal Shankar, Joao Carreira, Karl Krauth, Neeraja Yadwadkar, Joseph E. Gonzalez, Raluca Ada Popa, Ion Stoica, and David A. Patterson. 2019. Cloud Programming Simplified: A Berkeley View on Serverless Computing. https://www2.eecs.berkeley.edu/Pubs/TechRpts/2019/EECS-2019--3.pdf.Google Scholar
- libSQL. 2023. libSQL. https://github.com/libsql/libsql.Google Scholar
- Gil Tene. 2023. HdrHistogram: A High Dynamic Range Histogram. http://hdrhistogram.org/.Google Scholar
- Kenton Varda. 2023. D1 storage engine. https://x.com/KentonVarda/status/1659551757796515846?s=20.Google Scholar
Index Terms
- Towards Database and Serverless Runtime Co-Design
Recommendations
Serverless Runtime / Database Co-Design With Asynchronous I/O
EdgeSys '24: Proceedings of the 7th International Workshop on Edge Systems, Analytics and NetworkingMinimizing database access latency is crucial in serverless edge computing for many applications, but databases are predominantly deployed in cloud environments, resulting in costly network round-trips. Embedding an in-process database library such as ...
Migrating a (large) science database to the cloud
HPDC '10: Proceedings of the 19th ACM International Symposium on High Performance Distributed ComputingWe report on attempts to put an existing scientific (astronomical) database -- the Sloan Digital Sky Survey (SDSS) science archive [1] - in the cloud. Based on our experience, it is either very frustrating or impossible at this time to migrate an ...
Towards Serverless as Commodity: a case of Knative
WOSC '19: Proceedings of the 5th International Workshop on Serverless ComputingServerless computing promises to evolve cloud computing architecture from VMs and containers-as-a-service (CaaS) to function-as-a-service (FaaS). This takes away complexities of managing and scaling underlying infrastructure and can result in simpler ...
Comments