Exploring CXL Memory Disaggregation: Use Cases and System Benefits
By Jungmin Choi, Memory System Architect, SK hynix and Myoungseo (Matthew) Kim, Director, Systems and Computer Architect, SK hynix
In this session, we dive into powerful use cases for DCD (Dynamic Capacity Device) based memory pooling and sharing specified in CXL 3.1 that can reduce costs from a datacenter operations perspective. Each host connected to the memory pool can manage resources flexibly through dynamic memory allocation. We also address use cases for system benefits, such as optimal memory tiering and data placement that each host can achieve through telemetry including hotness tracking provided by the device. Regarding memory sharing, we analyze the characteristics of HPC/AI workloads and explore performance improvement through control and data path optimization between hosts. Specifically, we focus on distributed computing frameworks such as Spark and Ray, which suffer from heavy network traffic and memory duplication due to data object sharing. Through HW/SW system implementation and concrete performance studies, we provide insight into CXL memory pooling and sharing within a multi-host environment.
Related Videos
- Exploring the Advancement of Chiplet Technology and the Ecosystem
- Chiplet-Based Compressed LLC Cache & Memory Expansion
- Exploring the Advancement of Chiplet Technology and the Ecosystem
- Exploring the Latest in IO Chiplets with Alphawave Semi
Latest Videos
- With Moore’s Law Slowing Down—Chiplets Rebooting The Semiconductor Industry, BJ Han - Silicon Box
- Trends in 2025 Chiplet Design
- Custom Tool Development Strategies for Chiplet Reliability
- Imec Automotive Chiplet Forum 2025: Interview with Arm's John Kourentis
- Imec Automotive Chiplet Forum 2025: Interview with imec's Bart Plackle