CloudJIT: A Just-in-Time FaaS Optimizer (Work in Progress)
Function-as-a-Service has emerged as a trending paradigm that provides attractive solutions to execute fine-grained and short-lived workloads referred to as functions. Functions are typically developed in a managed language such as Java and execute atop a language runtime. However, traditional language runtimes such as the HotSpot JVM are designed for peak performance as considerable time is spent profiling and Just-in-Time compiling code. As a consequence, warmup time and memory footprint are impacted. We observe that FaaS workloads, which are short-lived, do not fit this profile.
We propose CloudJIT, a self-optimizing FaaS platform that takes advantage of Ahead-of-Time compilation to achieve reduced startup latency and instantaneous peak performance with a smaller memory footprint. While AOT compilation is an expensive operation, the platform automatically detects which functions will benefit from it the most, performs all prerequisite preparation procedures, and compiles selected functions into native binaries. Our preliminary analysis, based on a public FaaS invocations trace, shows that optimizing a small fraction of all functions positively affects a vast majority of all cold starts.
Sun 22 OctDisplayed time zone: Lisbon change
09:00 - 10:30 | |||
09:00 5mDay opening | Welcome from the Chairs MPLR | ||
09:05 55mKeynote | Is Wasm Becoming Garbage? (Keynote) MPLR DOI | ||
10:00 15mTalk | On the Applicability of Annotation-Based Source Code Modification in Kotlin (Work in Progress) MPLR DOI | ||
10:15 15mTalk | CloudJIT: A Just-in-Time FaaS Optimizer (Work in Progress) MPLR Serhii Ivanenko INESC-ID; IST-ULisboa, Rodrigo Bruno INESC-ID - IST-ULisboa, Jovan Stevanovic Oracle Labs, Luís Veiga INESC-ID; IST-ULisboa, Vojin Jovanovic Oracle Labs DOI |