Plover: Parallel In-memory database logging on scalable storage devices

Huan Zhou, Jinwei Guo, Ouya Pei, Weining Qian, Xuan Zhou, Aoying Zhou

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Despite the prevalence of multi-core processors and large main memories, most in-memory databases still universally adopt a centralized ARIES-logging with a single I/O channel, which can be a serious bottleneck. In this paper, we propose a parallel logging mechanism, named Plover for in-memory databases, which utilizes the partial order property of transactions’ dependencies and allows for concurrent logging in scalable storage devices. To further alleviate the performance overheads caused by log partitioning, we present a workload-aware log partitioning scheme to minimize the number of cross-partition transactions, while maintaining load balance. As such, Plover can scale well with the increasing number of storage devices and extensive experiments show that Plover with workload-aware partitioning can achieve 2× speedup over a centralized logging scheme and more than 42% over Plover with random partitioning.

Original languageEnglish
Title of host publicationWeb and Big Data - Second International Joint Conference, APWeb-WAIM 2018, Proceedings
EditorsYi Cai, Yoshiharu Ishikawa, Jianliang Xu
PublisherSpringer Verlag
Pages35-43
Number of pages9
ISBN (Print)9783319968926
DOIs
StatePublished - 2018
Event2nd Asia Pacific Web and Web-Age Information Management Joint Conference on Web and Big Data, APWeb-WAIM 2018 - Macau, China
Duration: 23 Jul 201825 Jul 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10988 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference2nd Asia Pacific Web and Web-Age Information Management Joint Conference on Web and Big Data, APWeb-WAIM 2018
Country/TerritoryChina
CityMacau
Period23/07/1825/07/18

Keywords

  • In-memory database
  • Parallel logging
  • Scalability

Fingerprint

Dive into the research topics of 'Plover: Parallel In-memory database logging on scalable storage devices'. Together they form a unique fingerprint.

Cite this