Low overhead log replication for main memory database system

  • Jinwei Guo
  • , Chendong Zhang
  • , Peng Cai*
  • , Minqi Zhou
  • , Aoying Zhou
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

3 Scopus citations

Abstract

Log replication is the key component of high available database system. To guarantee data consistency and reliability, modern database systems often use Paxos protocol to replicate log in multiple database instance sites. Since the replicated logs need to contain some metadata such as committed log sequence number (LSN), this increases the overhead of storage and network. It has significantly negative impact on the throughput in the update intensive work load. In this paper, we present an implementation of log replication and database recovery, which adopts the idea of piggybacking, i.e. committed LSN is embedded in the commit logs. This practice not only retains virtues of Paxos replication, but also reduces disk and network IO effectively, which enhances performance and decreases recovery time. We implemented and evaluated our approach in a main memory database system (Oceanbase), and found that our method can offer 1.3x higher throughput than traditional log replication with synchronization mechanism.

Original languageEnglish
Title of host publicationWeb-Age Information Management - 17th International Conference, WAIM 2016, Proceedings
EditorsBin Cui, Xiang Lian, Dexi Liu, Nan Zhang, Jianliang Xu
PublisherSpringer Verlag
Pages159-170
Number of pages12
ISBN (Print)9783319399577
DOIs
StatePublished - 2016
Event17th International Conference on Web-Age Information Management, WAIM 2016 - Nanchang, China
Duration: 3 Jun 20165 Jun 2016

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9659
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference17th International Conference on Web-Age Information Management, WAIM 2016
Country/TerritoryChina
CityNanchang
Period3/06/165/06/16

Keywords

  • Database recovery
  • Log replication
  • OceanBase
  • Paxos

Fingerprint

Dive into the research topics of 'Low overhead log replication for main memory database system'. Together they form a unique fingerprint.

Cite this