Loupe: A Visualization Tool for High-Level Execution Plans in SystemDS

  • Zhizhen Xu
  • , Zihao Chen
  • , Chen Xu*
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The declarative programming language in SystemDS simplifies users to implement machine learning algorithms. It is able to generate execution jobs on different data processing engines including MapReduce and Spark. The GUI in data processing engines typical visualizes the low-level execution process (e.g., RDD transformation in Spark). However, the low-level description in Spark GUI does not show the relationship between DML operations and RDD primitives. In this work, we propose Loupe, a tool to visualize high-level execution plans in SystemDS to ease users to understand the execution process. This paper introduces the design of the tool and demonstrates a visualization case.

Original languageEnglish
Title of host publicationDatabase Systems for Advanced Applications - 26th International Conference, DASFAA 2021, Proceedings
EditorsChristian S. Jensen, Ee-Peng Lim, De-Nian Yang, Wang-Chien Lee, Vincent S. Tseng, Vana Kalogeraki, Jen-Wei Huang, Chih-Ya Shen
PublisherSpringer Science and Business Media Deutschland GmbH
Pages627-630
Number of pages4
ISBN (Print)9783030731991
DOIs
StatePublished - 2021
Event26th International Conference on Database Systems for Advanced Applications, DASFAA 2021 - Taipei, Taiwan, Province of China
Duration: 11 Apr 202114 Apr 2021

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12683 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference26th International Conference on Database Systems for Advanced Applications, DASFAA 2021
Country/TerritoryTaiwan, Province of China
CityTaipei
Period11/04/2114/04/21

Keywords

  • Execution plan
  • SystemDS
  • Visualization

Fingerprint

Dive into the research topics of 'Loupe: A Visualization Tool for High-Level Execution Plans in SystemDS'. Together they form a unique fingerprint.

Cite this