Mariana: Exploring Native SkipList Index Design for Disaggregated Memory

  • Xing Wei*
  • , Ke Wang
  • , Yinjun Han
  • , Hao Jin
  • , Yaofeng Tu
  • , Huiqi Hu*
  • , Xuan Zhou
  • , Minghao Zhao
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Memory disaggregation has emerged as a promising architecture for improving resource efficiency by decoupling the computing and memory resources. But building efficient range indices in such an architecture faces three critical challenges: (1) coarse-grained concurrency control schemes for coordinating concurrent read/write operations with node splitting incur high contention under the skewed and write-intensive workloads; (2) existing data layouts fail to balance consistency verification and hardware acceleration via SIMD (Single Instruction Multiple Data); and (3) naive caching schemes struggle to adapt to rapidly changing access patterns. To address these challenges, we propose Mariana, a memory-disaggregated skiplist index that integrates three key innovations. First, it uses a fine-grained (i.e., entry-level) latch mechanism combined with dynamic node resizing to minimize the contention and splitting frequency. Second, it employs a tailored data layout for leaf node, which separates keys and values to enable SIMD acceleration while maintaining consistency checks with minimal write overhead. Third, it implements an adaptive caching strategy that tracks node popularity in real-time to optimize network bandwidth utilization during the index traversal. Experimental results show that Mariana achieves 1.7×1.7× higher throughput under write-intensive workloads and reduces the P90 latency by 23% under the read-intensive workloads, when comparing to the state-of-the-art indices on disaggregated memory.

Original languageEnglish
Pages (from-to)2137-2151
Number of pages15
JournalIEEE Transactions on Parallel and Distributed Systems
Volume36
Issue number10
DOIs
StatePublished - 2025

Keywords

  • Disaggregated memory
  • RDMA
  • concurrency control
  • range index

Fingerprint

Dive into the research topics of 'Mariana: Exploring Native SkipList Index Design for Disaggregated Memory'. Together they form a unique fingerprint.

Cite this