U2CMigration: User-Unaware Container Migration with Predictive Analysis of Memory Dirty Pages

  • Yong Peng
  • , Fei Xu*
  • , Zong Qing Wei
  • , Shuo Hao Lin
  • , Zhi Zhou
  • , Miao Zhang
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Container live migration serves as the cornerstone of maintaining containerized workloads in cloud and edge datacenters, particularly for stateful applications. However, the de facto memory pre-copy-based migration faces severe performance issues for containers with dynamically changing memory dirty pages. Existing research often overlooks such dynamic nature of memory pages of various workloads and their unpredictable relationship with system-level features, causing unwise stop-and-copy iterations of container migrations. This can prolong container migrations by tens of seconds, severely degrading application performance. To address these challenges, we introduce U2CMigration, a user-unaware container live migration strategy for containerized workloads. It employs a lightweight and autonomous two-phase prediction by analyzing container memory pages across various workloads. We utilize the data shift prediction for stable memory pages (phase-1). For unstable memory pages (phase-2), we develop an attention-based prediction that jointly considers the spatio-temporal characteristics of memory pages and system-level features. Guided by dirty page predictions, we further develop a container live migration strategy that judiciously decides the optimal stop-and-copy iteration with the minimum amount of memory dirty pages. We have implemented an open-source prototype of U2CMigration (https://doi.org/10.57760/sciencedb.32136) based on the CRIU (checkpoint/restore in userspace) project. Extensive prototype experiments demonstrate that U2CMigration reduces the container migration duration by 26.1%–47.9% and the downtime by 21.3%–32.6% compared with the state-of-the-art solutions.

Original languageEnglish
JournalJournal of Computer Science and Technology
DOIs
StateAccepted/In press - 2025

Keywords

  • container live migration
  • memory dirty page
  • prediction method
  • spatio-temporal characteristic
  • system-level feature

Fingerprint

Dive into the research topics of 'U2CMigration: User-Unaware Container Migration with Predictive Analysis of Memory Dirty Pages'. Together they form a unique fingerprint.

Cite this