跳到主要导航 跳到搜索 跳到主要内容

RedTAO: A Trillion-edge High-throughput Graph Store

  • Shihao Zhou
  • , Qi Mao*
  • , Yi Cheng
  • , Hongcheng Qi
  • , Yilun Huang
  • , Peng Cai*
  • , Jun Peng Zhu
  • *此作品的通讯作者
  • East China Normal University
  • Xiaohongshu

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

With the explosive growth of daily active users, the social graph data of Xiaohongshu has scaled to trillions of edges, imposing high pressure on our storage system. Current state-of-the-art systems struggle to address the issue, primarily due to: (1) Traditional relational databases as the back-end storage require frequent scaling, incurring high cost and stability risks. (2) Most graph databases focus on complex multi-hop queries. Redundant components in these systems make them difficult to take advantage when processing our workloads dominated by one-hop queries. (3) Using cache systems like Redis or Memcache often struggles to ensure consistency between the cache and storage. In this paper, we propose RedTAO, which has a scalable and efficient graph cache layer optimized for social scenarios. Over 90.7% of queries are served directly by the cache, enabling us to focus on scaling it as traffic increases. RedTAO employs cross-cloud, multi-active deployment, synchronizing replicas through the storage layer. The cache layer directly accesses local storage, avoiding costly cross-region requests. Additionally, the data transmission service (DTS) component asynchronously corrects cache data, ensuring cache consistency. RedTAO has been successfully deployed in Xiaohongshu, achieving a 1.8× throughput improvement and at least 21.3% reduction in resource usage compared to the previously used MySQL architecture.

源语言英语
主期刊名SIGMOD-Companion 2025 - Companion of the 2025 International Conference on Management of Data
编辑Amol Deshpande, Ashraf Aboulnaga, Babak Salimi, Badrish Chandramouli, Bill Howe, Boon Thau Loo, Boris Glavic, Carlo Curino, Daisy Zhe Wang, Dan Suciu, Daniel Abadi, Divesh Srivastava, Eugene Wu, Faisal Nawab, Ihab Ilyas, Jeffrey Naughton, Jennie Rogers, Jignesh Patel, Joy Arulraj, Jun Yang, Karima Echihabi, Kenneth Ross, Khuzaima Daudjee, Laks Lakshmanan, Minos Garofalakis, Mirek Riedewald, Mohamed Mokbel, Mourad Ouzzani, Oliver Kennedy, Oliver Kennedy, Paolo Papotti, Peter Alvaro, Peter Bailis, Renee Miller, Senjuti Basu Roy, Sergey Melnik, Stratos Idreos, Sudeepa Roy, Theodoros Rekatsinas, Viktor Leis, Wenchao Zhou, Wolfgang Gatterbauer, Zack Ives
出版商Association for Computing Machinery
716-728
页数13
ISBN(电子版)9798400715648
DOI
出版状态已出版 - 22 6月 2025
已对外发布
活动2025 ACM SIGMOD/PODS International Conference on Management of Data, SIGMOD-Companion 2025 - Berlin, 德国
期限: 22 6月 202527 6月 2025

出版系列

姓名Proceedings of the ACM SIGMOD International Conference on Management of Data
ISSN(印刷版)0730-8078

会议

会议2025 ACM SIGMOD/PODS International Conference on Management of Data, SIGMOD-Companion 2025
国家/地区德国
Berlin
时期22/06/2527/06/25

指纹

探究 'RedTAO: A Trillion-edge High-throughput Graph Store' 的科研主题。它们共同构成独一无二的指纹。

引用此