Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework

Kaustubh Beedkar, Aurélien Bertrand, Haralampos Gavriilidis, Augusto Fonseca, Zoi Kaoudi, Mingxi Liu, Volker Markl, Juri Petersen, Fabio Porto, Víctor Ribeiro, Mads Sejer Pedersen, Lucas Tavares, Michalis Vargiamis, Chen Xu

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

Apache Wayang is an open-source framework, which provides a systematic and efficient solution for unifying data analytics over disparate data sources and via integrating multiple heterogeneous data systems. It achieves that by decoupling applications from the underlying systems. In addition, it provides an optimizer so that users do not have to specify the platforms on which their pipeline should run but the optimizer can determine the best way given a cost metric. In this demonstration, we showcase how the flexible architecture of Wayang enables seamless integration with multiple heterogeneous data systems and how the query optimizer can lead to better performance.

Original languageEnglish
Title of host publicationSIGMOD-Companion 2025 - Companion of the 2025 International Conference on Management of Data
EditorsAmol Deshpande, Ashraf Aboulnaga, Babak Salimi, Badrish Chandramouli, Bill Howe, Boon Thau Loo, Boris Glavic, Carlo Curino, Daisy Zhe Wang, Dan Suciu, Daniel Abadi, Divesh Srivastava, Eugene Wu, Faisal Nawab, Ihab Ilyas, Jeffrey Naughton, Jennie Rogers, Jignesh Patel, Joy Arulraj, Jun Yang, Karima Echihabi, Kenneth Ross, Khuzaima Daudjee, Laks Lakshmanan, Minos Garofalakis, Mirek Riedewald, Mohamed Mokbel, Mourad Ouzzani, Oliver Kennedy, Oliver Kennedy, Paolo Papotti, Peter Alvaro, Peter Bailis, Renee Miller, Senjuti Basu Roy, Sergey Melnik, Stratos Idreos, Sudeepa Roy, Theodoros Rekatsinas, Viktor Leis, Wenchao Zhou, Wolfgang Gatterbauer, Zack Ives
PublisherAssociation for Computing Machinery
Pages35-38
Number of pages4
ISBN (Electronic)9798400715648
DOIs
StatePublished - 22 Jun 2025
Event2025 ACM SIGMOD/PODS International Conference on Management of Data, SIGMOD-Companion 2025 - Berlin, Germany
Duration: 22 Jun 202527 Jun 2025

Publication series

NameProceedings of the ACM SIGMOD International Conference on Management of Data
ISSN (Print)0730-8078

Conference

Conference2025 ACM SIGMOD/PODS International Conference on Management of Data, SIGMOD-Companion 2025
Country/TerritoryGermany
CityBerlin
Period22/06/2527/06/25

Keywords

  • query optimization
  • unified analytics

Fingerprint

Dive into the research topics of 'Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework'. Together they form a unique fingerprint.

Cite this