Interactive transaction processing for in-memory database system

Tao Zhu; Donghui Wang; Huiqi Hu; Weining Qian; Xiaoling Wang; Aoying Zhou

doi:10.1007/978-3-319-91458-9_14

Interactive transaction processing for in-memory database system

Tao Zhu, Donghui Wang, Huiqi Hu^*, Weining Qian, Xiaoling Wang, Aoying Zhou

^*Corresponding author for this work

East China Normal University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

3 Scopus citations

Abstract

In-memory transaction processing has gained fast development in recent years. Previous works usually assume the one-shot transaction model, where transactions are run as stored procedures. Though many systems have shown impressive throughputs in handling one-shot transactions, it is hard for developers to debug and maintain stored procedures. According to a recent survey, most applications still prefer to operate the database using the JDBC/ODBC interface. Upon realizing this, the work targets on the problem of interactive transaction processing for in-memory database system. Our key contributions are: (1) we address several important design considerations for supporting interaction transaction processing; (2) a coroutine-based execution engine is proposed to handle different kinds of blocking efficiently and improve the CPU usage; (3) a lightweight and latch-free lock manager is designed to schedule transaction conflicts without introducing many overhead; (4) experiments on both the TPC-C and a micro benchmark show that our method achieves better performance than existing solutions.

Original language	English
Title of host publication	Database Systems for Advanced Applications - 23rd International Conference, DASFAA 2018, Proceedings
Editors	Jian Pei, Shazia Sadiq, Jianxin Li, Yannis Manolopoulos
Publisher	Springer Verlag
Pages	228-246
Number of pages	19
ISBN (Print)	9783319914572
DOIs	https://doi.org/10.1007/978-3-319-91458-9_14
State	Published - 2018
Event	23rd International Conference on Database Systems for Advanced Applications, DASFAA 2018 - Gold Coast, Australia Duration: 21 May 2018 → 24 May 2018

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	10828 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	23rd International Conference on Database Systems for Advanced Applications, DASFAA 2018
Country/Territory	Australia
City	Gold Coast
Period	21/05/18 → 24/05/18

Keywords

Concurrency control
Network interaction
Transaction

Access to Document

10.1007/978-3-319-91458-9_14

Cite this

Zhu, T., Wang, D., Hu, H., Qian, W., Wang, X., & Zhou, A. (2018). Interactive transaction processing for in-memory database system. In J. Pei, S. Sadiq, J. Li, & Y. Manolopoulos (Eds.), Database Systems for Advanced Applications - 23rd International Conference, DASFAA 2018, Proceedings (pp. 228-246). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10828 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-91458-9_14

Zhu, Tao ; Wang, Donghui ; Hu, Huiqi et al. / Interactive transaction processing for in-memory database system. Database Systems for Advanced Applications - 23rd International Conference, DASFAA 2018, Proceedings. editor / Jian Pei ; Shazia Sadiq ; Jianxin Li ; Yannis Manolopoulos. Springer Verlag, 2018. pp. 228-246 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{54942042141b419799aa2683ff1948a9,

title = "Interactive transaction processing for in-memory database system",

abstract = "In-memory transaction processing has gained fast development in recent years. Previous works usually assume the one-shot transaction model, where transactions are run as stored procedures. Though many systems have shown impressive throughputs in handling one-shot transactions, it is hard for developers to debug and maintain stored procedures. According to a recent survey, most applications still prefer to operate the database using the JDBC/ODBC interface. Upon realizing this, the work targets on the problem of interactive transaction processing for in-memory database system. Our key contributions are: (1) we address several important design considerations for supporting interaction transaction processing; (2) a coroutine-based execution engine is proposed to handle different kinds of blocking efficiently and improve the CPU usage; (3) a lightweight and latch-free lock manager is designed to schedule transaction conflicts without introducing many overhead; (4) experiments on both the TPC-C and a micro benchmark show that our method achieves better performance than existing solutions.",

keywords = "Concurrency control, Network interaction, Transaction",

author = "Tao Zhu and Donghui Wang and Huiqi Hu and Weining Qian and Xiaoling Wang and Aoying Zhou",

note = "Publisher Copyright: {\textcopyright} Springer International Publishing AG, part of Springer Nature 2018.; 23rd International Conference on Database Systems for Advanced Applications, DASFAA 2018 ; Conference date: 21-05-2018 Through 24-05-2018",

year = "2018",

doi = "10.1007/978-3-319-91458-9\_14",

language = "英语",

isbn = "9783319914572",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "228--246",

editor = "Jian Pei and Shazia Sadiq and Jianxin Li and Yannis Manolopoulos",

booktitle = "Database Systems for Advanced Applications - 23rd International Conference, DASFAA 2018, Proceedings",

address = "德国",

}

Zhu, T, Wang, D, Hu, H , Qian, W , Wang, X & Zhou, A 2018, Interactive transaction processing for in-memory database system. in J Pei, S Sadiq, J Li & Y Manolopoulos (eds), Database Systems for Advanced Applications - 23rd International Conference, DASFAA 2018, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 10828 LNCS, Springer Verlag, pp. 228-246, 23rd International Conference on Database Systems for Advanced Applications, DASFAA 2018, Gold Coast, Australia, 21/05/18. https://doi.org/10.1007/978-3-319-91458-9_14

Interactive transaction processing for in-memory database system. / Zhu, Tao; Wang, Donghui; Hu, Huiqi et al.
Database Systems for Advanced Applications - 23rd International Conference, DASFAA 2018, Proceedings. ed. / Jian Pei; Shazia Sadiq; Jianxin Li; Yannis Manolopoulos. Springer Verlag, 2018. p. 228-246 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10828 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Interactive transaction processing for in-memory database system

AU - Zhu, Tao

AU - Wang, Donghui

AU - Hu, Huiqi

AU - Qian, Weining

AU - Wang, Xiaoling

AU - Zhou, Aoying

N1 - Publisher Copyright: © Springer International Publishing AG, part of Springer Nature 2018.

PY - 2018

Y1 - 2018

N2 - In-memory transaction processing has gained fast development in recent years. Previous works usually assume the one-shot transaction model, where transactions are run as stored procedures. Though many systems have shown impressive throughputs in handling one-shot transactions, it is hard for developers to debug and maintain stored procedures. According to a recent survey, most applications still prefer to operate the database using the JDBC/ODBC interface. Upon realizing this, the work targets on the problem of interactive transaction processing for in-memory database system. Our key contributions are: (1) we address several important design considerations for supporting interaction transaction processing; (2) a coroutine-based execution engine is proposed to handle different kinds of blocking efficiently and improve the CPU usage; (3) a lightweight and latch-free lock manager is designed to schedule transaction conflicts without introducing many overhead; (4) experiments on both the TPC-C and a micro benchmark show that our method achieves better performance than existing solutions.

AB - In-memory transaction processing has gained fast development in recent years. Previous works usually assume the one-shot transaction model, where transactions are run as stored procedures. Though many systems have shown impressive throughputs in handling one-shot transactions, it is hard for developers to debug and maintain stored procedures. According to a recent survey, most applications still prefer to operate the database using the JDBC/ODBC interface. Upon realizing this, the work targets on the problem of interactive transaction processing for in-memory database system. Our key contributions are: (1) we address several important design considerations for supporting interaction transaction processing; (2) a coroutine-based execution engine is proposed to handle different kinds of blocking efficiently and improve the CPU usage; (3) a lightweight and latch-free lock manager is designed to schedule transaction conflicts without introducing many overhead; (4) experiments on both the TPC-C and a micro benchmark show that our method achieves better performance than existing solutions.

KW - Concurrency control

KW - Network interaction

KW - Transaction

UR - https://www.scopus.com/pages/publications/85048964873

U2 - 10.1007/978-3-319-91458-9_14

DO - 10.1007/978-3-319-91458-9_14

M3 - 会议稿件

AN - SCOPUS:85048964873

SN - 9783319914572

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 228

EP - 246

BT - Database Systems for Advanced Applications - 23rd International Conference, DASFAA 2018, Proceedings

A2 - Pei, Jian

A2 - Sadiq, Shazia

A2 - Li, Jianxin

A2 - Manolopoulos, Yannis

PB - Springer Verlag

T2 - 23rd International Conference on Database Systems for Advanced Applications, DASFAA 2018

Y2 - 21 May 2018 through 24 May 2018

ER -

Zhu T, Wang D, Hu H , Qian W , Wang X , Zhou A. Interactive transaction processing for in-memory database system. In Pei J, Sadiq S, Li J, Manolopoulos Y, editors, Database Systems for Advanced Applications - 23rd International Conference, DASFAA 2018, Proceedings. Springer Verlag. 2018. p. 228-246. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-319-91458-9_14

Interactive transaction processing for in-memory database system

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this