FaaSMem: Improving Memory Efficiency of Serverless Computing with Memory Pool Architecture

doi:10.1145/3620666.3651355

CUG-IR

	FaaSMem: Improving Memory Efficiency of Serverless Computing with Memory Pool Architecture
	Xu, Chuhao 1; Liu, Yiyu 1; Li, Zijun 1; Chen, Quan 1; Zhao, Han 1; Zeng, Deze 2; Peng, Qian 3; Wu, Xueqi 3; Zhao, Haifeng 3; Fu, Senbo 3; Guo, Minyi 1
	2024-04-27
会议录名称	International Conference on Architectural Support for Programming Languages and Operating Systems - ASPLOS
卷号	3
页码	331-348
原始文献类型	Conference article (CA)
摘要	In serverless computing, an idle container is not recycled directly, in order to mitigate time-consuming cold container startup. These idle containers still occupy the memory, exasperating the memory shortage of today’s data centers. By offloading their cold memory to remote memory pool could potentially resolve this problem. However, existing offloading policies either hurt the Quality of Service (QoS) or are too coarse-grained in serverless computing scenarios. We therefore propose FaaSMem, a dedicated memory offloading mechanism tailored for serverless computing with memory poor architecture. It is proposed based on our finding that the memory of a serverless container allocated in different s tages h as d ifferent us age pa tterns. Specifically, FaaSMem proposes Page Bucket (Pucket) to segregate the memory pages in different segments, and applies segment-wise offloading policies for them. FaaSMem also proposes a semi-warm period during keep-alive stage, to seek a sweet spot between the offloading effort and the remote access penalty. Experimental results show that FaaSMem reduces the average local memory footprint by 9.9% - 79.8% and improves the container deployment density to 108% - 218%, with negligible 95%-ile latency increase. © 2024 Copyright held by the owner/author(s).
关键词	Lakes Memory architecture Quality of service Datacenter Faas Memory efficiency Memory offloading Memory pool Memory pool architecture Memory shortage Quality-of-service Remote memory Serverless computing
DOI	10.1145/3620666.3651355
语种	英语
收录类别	EI
EI入藏号	20241916038443
出版者	Association for Computing Machinery
会议名称	29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, ASPLOS 2024
EI主题词	Containers
会议日期	April 27, 2024 - May 1, 2024
会议地点	San Diego, CA, United states
引用统计	被引频次[WOS]：-1 [WOS记录] [WOS相关记录]
文献类型	会议论文
条目标识符	http://ir.cug.edu.cn/handle/2XU834YA/360989
专题	中国地质大学（武汉）
作者单位	1.Shanghai Jiao Tong University, Shanghai, China 2.China University of Geosciences, Wuhan, China 3.Huawei Cloud, Shenzhen, China
推荐引用方式 GB/T 7714	Xu, Chuhao,Liu, Yiyu,Li, Zijun,et al. FaaSMem: Improving Memory Efficiency of Serverless Computing with Memory Pool Architecture[C]:Association for Computing Machinery,2024:331-348.