Precise data access on distributed log-structured merge-tree

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

Log-structured merge tree decomposes a large database into multiple parts: an in-writing part and several read-only ones. It achieves high write throughput as well as low read latency. However, read requests have to go through multiple structures to find the required data. In a distributed database system, different parts of the LSM-tree are stored distributedly. Data access issues extra network communications for a server in the query layer to pull entries from the underlying storage layer. This work proposes the precise data access strategy. A Bloom filter-based structure is designed to test whether an element exists in the in-writing part of the LSM-tree. A lease-based synchronization strategy is used to maintain consistent copies of the Bloom filter on remote query servers. Experiments show that the solution has 6 $$\times $$ throughput improvement over existing methods.

Original languageEnglish
Title of host publicationWeb and Big Data - 1st International Joint Conference, APWeb-WAIM 2017, Proceedings
EditorsChristian S. Jensen, Xiang Lian, Lei Chen, Cyrus Shahabi, Xiaochun Yang
PublisherSpringer Verlag
Pages210-218
Number of pages9
ISBN (Print)9783319635637
DOIs
StatePublished - 2017
Event1st Asia-Pacific Web and Web-Age Information Management Joint Conference on Web and Big Data, APWeb-WAIM 2017 - Beijing, China
Duration: 7 Jul 20179 Jul 2017

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10367 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference1st Asia-Pacific Web and Web-Age Information Management Joint Conference on Web and Big Data, APWeb-WAIM 2017
Country/TerritoryChina
CityBeijing
Period7/07/179/07/17

Keywords

  • Consistency
  • Data access
  • Distributed system

Fingerprint

Dive into the research topics of 'Precise data access on distributed log-structured merge-tree'. Together they form a unique fingerprint.

Cite this