Touchstone+: Query Aware Database Generation for Match Operators

Hao Li; Qingshuai Wang; Zirui Hu; Xuhua Huang; Lyu Ni; Rong Zhang; Peng Cai; Xuan Zhou; Quanqing Xu

doi:10.1007/978-981-97-5552-3_18

Touchstone⁺: Query Aware Database Generation for Match Operators

Hao Li
, Qingshuai Wang
, Zirui Hu
, Xuhua Huang
, Lyu Ni^*
, Rong Zhang
, Peng Cai
, Xuan Zhou
, Quanqing Xu

^*Corresponding author for this work

School of Data Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Query-aware database generator (QAGen) expects to generate an application scenario based on the anonymized query plans as well as the cardinality constraints of all operators. It prefers to have the similar performance to the in-production real performance if applying the generated workload on the generated database. Touchstone is the first work achieving simulating the application with the first 16 queries in TPC-H. However, it is designed based on heuristic rules, and has a weak ability to guarantee the cardinality constraints from match operators, i.e., IN and LIKE, which are important operators for performance optimization. So in this paper, we propose Touchstone⁺ to solve the problem QAGen involving match operators by modeling constraints from IN and LIKE into a Constraint Programming (CP) problem. After solving the CP problem, it provides an initial data distribution satisfying cardinality constraints from all match operators for the iterative parameter search algorithm of Touchstone. Experiments have verified the effectiveness of our design and we also open code sources [12] for reproducing all results.

Original language	English
Title of host publication	Database Systems for Advanced Applications - 29th International Conference, DASFAA 2024, Proceedings
Editors	Makoto Onizuka, Jae-Gil Lee, Yongxin Tong, Chuan Xiao, Yoshiharu Ishikawa, Kejing Lu, Sihem Amer-Yahia, H.V. Jagadish
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	266-282
Number of pages	17
ISBN (Print)	9789819755516
DOIs	https://doi.org/10.1007/978-981-97-5552-3_18
State	Published - 2024
Event	29th International Conference on Database Systems for Advanced Applications, DASFAA 2024 - Gifu, Japan Duration: 2 Jul 2024 → 5 Jul 2024

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	14850 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	29th International Conference on Database Systems for Advanced Applications, DASFAA 2024
Country/Territory	Japan
City	Gifu
Period	2/07/24 → 5/07/24

Access to Document

10.1007/978-981-97-5552-3_18

Cite this

Li, H., Wang, Q., Hu, Z., Huang, X., Ni, L., Zhang, R., Cai, P., Zhou, X., & Xu, Q. (2024). Touchstone⁺: Query Aware Database Generation for Match Operators. In M. Onizuka, J.-G. Lee, Y. Tong, C. Xiao, Y. Ishikawa, K. Lu, S. Amer-Yahia, & H. V. Jagadish (Eds.), Database Systems for Advanced Applications - 29th International Conference, DASFAA 2024, Proceedings (pp. 266-282). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 14850 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-981-97-5552-3_18

Li, Hao ; Wang, Qingshuai ; Hu, Zirui et al. / Touchstone⁺ : Query Aware Database Generation for Match Operators. Database Systems for Advanced Applications - 29th International Conference, DASFAA 2024, Proceedings. editor / Makoto Onizuka ; Jae-Gil Lee ; Yongxin Tong ; Chuan Xiao ; Yoshiharu Ishikawa ; Kejing Lu ; Sihem Amer-Yahia ; H.V. Jagadish. Springer Science and Business Media Deutschland GmbH, 2024. pp. 266-282 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{9e6eca4873724e38930d62eb20fe0f48,

title = "Touchstone+: Query Aware Database Generation for Match Operators",

abstract = "Query-aware database generator (QAGen) expects to generate an application scenario based on the anonymized query plans as well as the cardinality constraints of all operators. It prefers to have the similar performance to the in-production real performance if applying the generated workload on the generated database. Touchstone is the first work achieving simulating the application with the first 16 queries in TPC-H. However, it is designed based on heuristic rules, and has a weak ability to guarantee the cardinality constraints from match operators, i.e., IN and LIKE, which are important operators for performance optimization. So in this paper, we propose Touchstone+ to solve the problem QAGen involving match operators by modeling constraints from IN and LIKE into a Constraint Programming (CP) problem. After solving the CP problem, it provides an initial data distribution satisfying cardinality constraints from all match operators for the iterative parameter search algorithm of Touchstone. Experiments have verified the effectiveness of our design and we also open code sources [12] for reproducing all results.",

author = "Hao Li and Qingshuai Wang and Zirui Hu and Xuhua Huang and Lyu Ni and Rong Zhang and Peng Cai and Xuan Zhou and Quanqing Xu",

note = "Publisher Copyright: {\textcopyright} The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2024.; 29th International Conference on Database Systems for Advanced Applications, DASFAA 2024 ; Conference date: 02-07-2024 Through 05-07-2024",

year = "2024",

doi = "10.1007/978-981-97-5552-3\_18",

language = "英语",

isbn = "9789819755516",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "266--282",

editor = "Makoto Onizuka and Jae-Gil Lee and Yongxin Tong and Chuan Xiao and Yoshiharu Ishikawa and Kejing Lu and Sihem Amer-Yahia and H.V. Jagadish",

booktitle = "Database Systems for Advanced Applications - 29th International Conference, DASFAA 2024, Proceedings",

address = "德国",

}

Li, H, Wang, Q, Hu, Z, Huang, X, Ni, L , Zhang, R , Cai, P , Zhou, X & Xu, Q 2024, Touchstone⁺: Query Aware Database Generation for Match Operators. in M Onizuka, J-G Lee, Y Tong, C Xiao, Y Ishikawa, K Lu, S Amer-Yahia & HV Jagadish (eds), Database Systems for Advanced Applications - 29th International Conference, DASFAA 2024, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 14850 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 266-282, 29th International Conference on Database Systems for Advanced Applications, DASFAA 2024, Gifu, Japan, 2/07/24. https://doi.org/10.1007/978-981-97-5552-3_18

Touchstone⁺: Query Aware Database Generation for Match Operators. / Li, Hao; Wang, Qingshuai; Hu, Zirui et al.
Database Systems for Advanced Applications - 29th International Conference, DASFAA 2024, Proceedings. ed. / Makoto Onizuka; Jae-Gil Lee; Yongxin Tong; Chuan Xiao; Yoshiharu Ishikawa; Kejing Lu; Sihem Amer-Yahia; H.V. Jagadish. Springer Science and Business Media Deutschland GmbH, 2024. p. 266-282 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 14850 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Touchstone+

T2 - 29th International Conference on Database Systems for Advanced Applications, DASFAA 2024

AU - Li, Hao

AU - Wang, Qingshuai

AU - Hu, Zirui

AU - Huang, Xuhua

AU - Ni, Lyu

AU - Zhang, Rong

AU - Cai, Peng

AU - Zhou, Xuan

AU - Xu, Quanqing

N1 - Publisher Copyright: © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2024.

PY - 2024

Y1 - 2024

N2 - Query-aware database generator (QAGen) expects to generate an application scenario based on the anonymized query plans as well as the cardinality constraints of all operators. It prefers to have the similar performance to the in-production real performance if applying the generated workload on the generated database. Touchstone is the first work achieving simulating the application with the first 16 queries in TPC-H. However, it is designed based on heuristic rules, and has a weak ability to guarantee the cardinality constraints from match operators, i.e., IN and LIKE, which are important operators for performance optimization. So in this paper, we propose Touchstone+ to solve the problem QAGen involving match operators by modeling constraints from IN and LIKE into a Constraint Programming (CP) problem. After solving the CP problem, it provides an initial data distribution satisfying cardinality constraints from all match operators for the iterative parameter search algorithm of Touchstone. Experiments have verified the effectiveness of our design and we also open code sources [12] for reproducing all results.

AB - Query-aware database generator (QAGen) expects to generate an application scenario based on the anonymized query plans as well as the cardinality constraints of all operators. It prefers to have the similar performance to the in-production real performance if applying the generated workload on the generated database. Touchstone is the first work achieving simulating the application with the first 16 queries in TPC-H. However, it is designed based on heuristic rules, and has a weak ability to guarantee the cardinality constraints from match operators, i.e., IN and LIKE, which are important operators for performance optimization. So in this paper, we propose Touchstone+ to solve the problem QAGen involving match operators by modeling constraints from IN and LIKE into a Constraint Programming (CP) problem. After solving the CP problem, it provides an initial data distribution satisfying cardinality constraints from all match operators for the iterative parameter search algorithm of Touchstone. Experiments have verified the effectiveness of our design and we also open code sources [12] for reproducing all results.

UR - https://www.scopus.com/pages/publications/85206394591

U2 - 10.1007/978-981-97-5552-3_18

DO - 10.1007/978-981-97-5552-3_18

M3 - 会议稿件

AN - SCOPUS:85206394591

SN - 9789819755516

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 266

EP - 282

BT - Database Systems for Advanced Applications - 29th International Conference, DASFAA 2024, Proceedings

A2 - Onizuka, Makoto

A2 - Lee, Jae-Gil

A2 - Tong, Yongxin

A2 - Xiao, Chuan

A2 - Ishikawa, Yoshiharu

A2 - Lu, Kejing

A2 - Amer-Yahia, Sihem

A2 - Jagadish, H.V.

PB - Springer Science and Business Media Deutschland GmbH

Y2 - 2 July 2024 through 5 July 2024

ER -

Li H, Wang Q, Hu Z, Huang X, Ni L , Zhang R et al. Touchstone⁺: Query Aware Database Generation for Match Operators. In Onizuka M, Lee JG, Tong Y, Xiao C, Ishikawa Y, Lu K, Amer-Yahia S, Jagadish HV, editors, Database Systems for Advanced Applications - 29th International Conference, DASFAA 2024, Proceedings. Springer Science and Business Media Deutschland GmbH. 2024. p. 266-282. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-981-97-5552-3_18