Skip to Main content Skip to Navigation
Conference papers

OFC: an opportunistic caching system for FaaS platforms

Abstract : Cloud applications based on the "Functions as a Service" (FaaS) paradigm have become very popular. Yet, due to their stateless nature, they must frequently interact with an external data store, which limits their performance. To mitigate this issue, we introduce OFC, a transparent, vertically and horizontally elastic in-memory caching system for FaaS platforms, distributed over the worker nodes. OFC provides these benefits cost-effectively by exploiting two common sources of resource waste: (i) most cloud tenants overprovision the memory resources reserved for their functions because their footprint is non-trivially input-dependent and (ii) FaaS providers keep function sandboxes alive for several minutes to avoid cold starts. Using machine learning models adjusted for typical function input data categories (e.g., multimedia formats), OFC estimates the actual memory resources required by each function invocation and hoards the remaining capacity to feed the cache. We build our OFC prototype based on enhancements to the OpenWhisk FaaS platform, the Swift persistent object store, and the RAM-Cloud in-memory store. Using a diverse set of workloads, we show that OFC improves by up to 82 % and 60 % respectively the execution time of single-stage and pipelined functions.
Document type :
Conference papers
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03211416
Contributor : Renaud Lachaize Connect in order to contact the contributor
Submitted on : Wednesday, April 28, 2021 - 4:51:36 PM
Last modification on : Friday, November 26, 2021 - 3:34:26 AM
Long-term archiving on: : Thursday, July 29, 2021 - 7:05:37 PM

File

main.pdf
Files produced by the author(s)

Identifiers

Citation

Djob Mvondo, Mathieu Bacou, Kevin Nguetchouang, Stéphane Pouget, Josiane Kouam, et al.. OFC: an opportunistic caching system for FaaS platforms. EUROSYS 2021 - 16th European Conference on Computer Systems, Apr 2021, Edinburgh (online), United Kingdom. pp.228-244, ⟨10.1145/3447786.3456239⟩. ⟨hal-03211416⟩

Share

Metrics

Record views

320

Files downloads

1003