TY - GEN
T1 - RedTAO
T2 - 2025 ACM SIGMOD/PODS International Conference on Management of Data, SIGMOD-Companion 2025
AU - Zhou, Shihao
AU - Mao, Qi
AU - Cheng, Yi
AU - Qi, Hongcheng
AU - Huang, Yilun
AU - Cai, Peng
AU - Zhu, Jun Peng
N1 - Publisher Copyright:
© 2025 ACM.
PY - 2025/6/22
Y1 - 2025/6/22
N2 - With the explosive growth of daily active users, the social graph data of Xiaohongshu has scaled to trillions of edges, imposing high pressure on our storage system. Current state-of-the-art systems struggle to address the issue, primarily due to: (1) Traditional relational databases as the back-end storage require frequent scaling, incurring high cost and stability risks. (2) Most graph databases focus on complex multi-hop queries. Redundant components in these systems make them difficult to take advantage when processing our workloads dominated by one-hop queries. (3) Using cache systems like Redis or Memcache often struggles to ensure consistency between the cache and storage. In this paper, we propose RedTAO, which has a scalable and efficient graph cache layer optimized for social scenarios. Over 90.7% of queries are served directly by the cache, enabling us to focus on scaling it as traffic increases. RedTAO employs cross-cloud, multi-active deployment, synchronizing replicas through the storage layer. The cache layer directly accesses local storage, avoiding costly cross-region requests. Additionally, the data transmission service (DTS) component asynchronously corrects cache data, ensuring cache consistency. RedTAO has been successfully deployed in Xiaohongshu, achieving a 1.8× throughput improvement and at least 21.3% reduction in resource usage compared to the previously used MySQL architecture.
AB - With the explosive growth of daily active users, the social graph data of Xiaohongshu has scaled to trillions of edges, imposing high pressure on our storage system. Current state-of-the-art systems struggle to address the issue, primarily due to: (1) Traditional relational databases as the back-end storage require frequent scaling, incurring high cost and stability risks. (2) Most graph databases focus on complex multi-hop queries. Redundant components in these systems make them difficult to take advantage when processing our workloads dominated by one-hop queries. (3) Using cache systems like Redis or Memcache often struggles to ensure consistency between the cache and storage. In this paper, we propose RedTAO, which has a scalable and efficient graph cache layer optimized for social scenarios. Over 90.7% of queries are served directly by the cache, enabling us to focus on scaling it as traffic increases. RedTAO employs cross-cloud, multi-active deployment, synchronizing replicas through the storage layer. The cache layer directly accesses local storage, avoiding costly cross-region requests. Additionally, the data transmission service (DTS) component asynchronously corrects cache data, ensuring cache consistency. RedTAO has been successfully deployed in Xiaohongshu, achieving a 1.8× throughput improvement and at least 21.3% reduction in resource usage compared to the previously used MySQL architecture.
KW - database
KW - graph store
KW - social graph
UR - https://www.scopus.com/pages/publications/105010186425
U2 - 10.1145/3722212.3724449
DO - 10.1145/3722212.3724449
M3 - 会议稿件
AN - SCOPUS:105010186425
T3 - Proceedings of the ACM SIGMOD International Conference on Management of Data
SP - 716
EP - 728
BT - SIGMOD-Companion 2025 - Companion of the 2025 International Conference on Management of Data
A2 - Deshpande, Amol
A2 - Aboulnaga, Ashraf
A2 - Salimi, Babak
A2 - Chandramouli, Badrish
A2 - Howe, Bill
A2 - Loo, Boon Thau
A2 - Glavic, Boris
A2 - Curino, Carlo
A2 - Zhe Wang, Daisy
A2 - Suciu, Dan
A2 - Abadi, Daniel
A2 - Srivastava, Divesh
A2 - Wu, Eugene
A2 - Nawab, Faisal
A2 - Ilyas, Ihab
A2 - Naughton, Jeffrey
A2 - Rogers, Jennie
A2 - Patel, Jignesh
A2 - Arulraj, Joy
A2 - Yang, Jun
A2 - Echihabi, Karima
A2 - Ross, Kenneth
A2 - Daudjee, Khuzaima
A2 - Lakshmanan, Laks
A2 - Garofalakis, Minos
A2 - Riedewald, Mirek
A2 - Mokbel, Mohamed
A2 - Ouzzani, Mourad
A2 - Kennedy, Oliver
A2 - Kennedy, Oliver
A2 - Papotti, Paolo
A2 - Alvaro, Peter
A2 - Bailis, Peter
A2 - Miller, Renee
A2 - Roy, Senjuti Basu
A2 - Melnik, Sergey
A2 - Idreos, Stratos
A2 - Roy, Sudeepa
A2 - Rekatsinas, Theodoros
A2 - Leis, Viktor
A2 - Zhou, Wenchao
A2 - Gatterbauer, Wolfgang
A2 - Ives, Zack
PB - Association for Computing Machinery
Y2 - 22 June 2025 through 27 June 2025
ER -