TY - GEN
T1 - Incremental materialized view maintenance on distributed log-structured merge-tree
AU - Duan, Huichao
AU - Hu, Huiqi
AU - Qian, Weining
AU - Ma, Haixin
AU - Wang, Xiaoling
AU - Zhou, Aoying
N1 - Publisher Copyright:
© Springer International Publishing AG, part of Springer Nature 2018.
PY - 2018
Y1 - 2018
N2 - Modern database systems are in need of supporting highly scalable transactions of data updates and efficient queries over data simultaneously for the real-time applications. One solution to reach the demand is to implement query optimization techniques on the online transaction processing (OLTP) systems. The materialized view is considered as a panacea to improve query latency. However, it also involves a significant cost of maintenance which trades away transaction performance. In this paper, we develop materialized views on a distributed log-structured merge-tree (LSM-tree), which is a well-known structure adopted to improve data write performance. We examine the design space and conclude several design features for the implementation of view on LSM-tree. An asynchronous approach with two optimizations are proposed to decouple the view maintenance with transaction process. Under the asynchronous update, we also provide consistency query for views. Experiments on TPC-H benchmark show our method achieves better performance than straightforward methods on different workloads.
AB - Modern database systems are in need of supporting highly scalable transactions of data updates and efficient queries over data simultaneously for the real-time applications. One solution to reach the demand is to implement query optimization techniques on the online transaction processing (OLTP) systems. The materialized view is considered as a panacea to improve query latency. However, it also involves a significant cost of maintenance which trades away transaction performance. In this paper, we develop materialized views on a distributed log-structured merge-tree (LSM-tree), which is a well-known structure adopted to improve data write performance. We examine the design space and conclude several design features for the implementation of view on LSM-tree. An asynchronous approach with two optimizations are proposed to decouple the view maintenance with transaction process. Under the asynchronous update, we also provide consistency query for views. Experiments on TPC-H benchmark show our method achieves better performance than straightforward methods on different workloads.
UR - https://www.scopus.com/pages/publications/85048957914
U2 - 10.1007/978-3-319-91458-9_42
DO - 10.1007/978-3-319-91458-9_42
M3 - 会议稿件
AN - SCOPUS:85048957914
SN - 9783319914572
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 682
EP - 700
BT - Database Systems for Advanced Applications - 23rd International Conference, DASFAA 2018, Proceedings
A2 - Pei, Jian
A2 - Sadiq, Shazia
A2 - Li, Jianxin
A2 - Manolopoulos, Yannis
PB - Springer Verlag
T2 - 23rd International Conference on Database Systems for Advanced Applications, DASFAA 2018
Y2 - 21 May 2018 through 24 May 2018
ER -