Massive parallel join in NUMA architecture

Wei He, Minqi Zhou, Xueqing Gong, Xiaofeng He

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

Advance in hardware technology and growing demands for fast response of database application have led to active research in In-Memory Database (IMDB). Compared to traditional on-disk database, IMDB has advantages such as faster access to storage and simpler internal optimization algorithms. Because of the importance of join operation in database system, join algorithm is always a hot research topic and many join algorithms have been proposed for distributed database system. Nevertheless, due to the nature of memory access in Non-Uniform Memory Access (NUMA) architecture, most existing join algorithms for classic Symmetric Multi-Processing (SMP) architecture cannot be applied to NUMA architecture directly. In this work, we present the Distributed Bitmap Join algorithm designed exclusively for IMDB in NUMA architecture. This Distributed Bitmap Join algorithm aims at improving the overall performance for groups of queries, rather than just one single query, by utilizing bitmap to reduce the communication cost in NUMA architecture. The comparative experiments of Distributed Bitmap Join algorithm against no-partition hash join show that although no-partition hash join algorithm is faster than Distributed Bitmap Join in single query case, our algorithm outperforms it for a group of queries.

Original languageEnglish
Title of host publicationProceedings - 2013 IEEE International Congress on Big Data, BigData 2013
Pages219-226
Number of pages8
DOIs
StatePublished - 2013
Event2013 IEEE International Congress on Big Data, BigData 2013 - Santa Clara, CA, United States
Duration: 27 Jun 20132 Jul 2013

Publication series

NameProceedings - 2013 IEEE International Congress on Big Data, BigData 2013

Conference

Conference2013 IEEE International Congress on Big Data, BigData 2013
Country/TerritoryUnited States
CitySanta Clara, CA
Period27/06/132/07/13

Keywords

  • Database management system
  • In-memory database
  • Join algorithm
  • Non-Uniform Memory Access

Fingerprint

Dive into the research topics of 'Massive parallel join in NUMA architecture'. Together they form a unique fingerprint.

Cite this