Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Past Present and Future of CXL
Similar to Past Present and Future of CXL (20)
More from Memory Fabric Forum
More from Memory Fabric Forum (20)
Recently uploaded
Recently uploaded (20)
Past Present and Future of CXL
- 1. Charles Fan CEO and Co-founder MemVerge Past, Present, & Future of CXL™ and Big Memory Computing
- 2. CXL Past
- 3. • Herded over 200 members & adopters • Streamlined standards efforts • Completed 1.x, 2.x, and 3.x specs. • Ignited billions in investment Successes Led by CXL Consortium
- 4. 2022 CXL Market Revenue ($M) Memory-Processor Interface 2023 – Focus on CXL 2022 $1.7M $1M $.2M $1.7M CXL DRAM CXL Memory Expander Controller CXL Memory Expander (includes DRAM & Controller)
- 5. 2022: CXL Technologies Emerged Switches Processors Software DRAM Memory Expansion
- 6. Exiting 2022 Specifications Technologies 2019 2022 2023 2024 Concept Cars We Were Here
- 7. CXL Present
- 9. Project Emory CXL Memory Expansion 9
- 10. Optical CXL Demo CXL Mem. Achieves ~2.4x Higher Throughput than Disk OPT-66B model results Disk (NVMe) CXL Memory System Memory MemVerge 60:40 Policy DecodeThroughput (Tokens/s) 1.984 4.859 6.216 6.237 Decode Latency (s) 338.7 138.2 108.1 107.7
- 11. Project CXL Flight Simulator Open Source QEMU VMs 1 Model of Memory Expander Model of SK hynix Niagara Get Started Now
- 12. 0% 25% 50% 75% 100% 125% 150% 175% 200% 225% 250% 275% 300% 325% 350% 0% 1% 3% 5% 8% 10% 13% 15% 18% 20% Runtime vs Baseline % Data Spillage In-Memory Analytics Benchmark (CloudSuite 3), 40GB Dataset dram cxl swap-nvme Reclaimed over 200% performance with only 20% additional memory Project Endless Memory Elastic Memory with CXL Pooling 1
- 13. Project Gismo Global I/O-free Shared Memory Objects 13 MEMVERGE CONFIDENTIAL Shuffle Benchmark Baseline Ray Ray + Gismo Local Get 1GB object 0.4 sec 0.4 sec - CXL shared memory as fast as local memory Remote Get 1GB object 2.7 sec 0.4 sec - 675% faster Shuffle 50GB 4 nodes, each 4 cores, 128 GB object store 515 sec 185 sec - 280% faster
- 14. Exiting 2023 We Will Be Here Specifications Technologies 2019 2022 2023 2024 Concept Cars 2025 Products
- 15. CXL Future
- 16. Boom in Demand for AI and CXL Memory hungry models doubling every 3-4 months Source: OpenAI, The Economist
- 17. CXL Market Revenue Forecast 2022 $1.7M 2028 $15.8B 2026 $2.1B $143M $1.5B $112M $1.9B $1M $.2M $1.7M $741M $12.5B $583M $15B CXL DRAM CXL Memory Expander Controller CXL Memory Expander (includes DRAM & Controller) CXL Switch Memory-Processor Interface 2023 – Focus on CXL
- 18. DRAM Expander Market Forecast 22- 28 30% 70% 100% 87% 13% 25% 75% Breakdown by format Breakdown by use case Drives Add-in card Direct attached memory expansion Memory pooling 2022 $1.7M 2022 $1.7M 2028 $15B 2028 $15B “The CXL memory market is expected to take off with the rise of memory pooling” Memory-Processor Interface 2023 – Focus on CXL
- 19. CXL Disaggregates Memory Storage Disaggregation Memory Disaggregation Storage Area Network (SAN) Fabric-Attached Memory Advanced Storage Services Memory-as-a- Service Fiber Channel Storage Data Services CXL Memory Data Services
- 20. Creating a New Industry Focus “This change of paradigm could give birth to a new industry focused on CXL memory fabric software, systems and services.” - Yole
- 21. Memory-as-a-Service Community Linux OS Open Source & Distros Software Standards & Specifications Device & Fabric Management User Space Data Services Select Organizations Contributing
- 22. MemVerge Software for CXL K8S Schedulers xPU xPU xPU xPU System software Hardware Shared Memory OS/HV OS/HV OS/HV OS/HV App App App App … Global Memory Composer Memory Viewer Memory Machine Tiering/ Compression Snapshot/ Live Migration Sharing Provision Compose Schedule App Profiling Resource Monitoring App-Centric Data Services Multi-Cell Control Plane
- 23. Memory Viewer 23 Get it now Essential for selling, configuring, and troubleshooting CXL products. Available with your branding.
- 24. CXL Forum Activities Expanding to Accelerate Co-engineering & Co- marketing 24 Participate CXL Forum Events CXLforum.com CXL Forum Academy CXL Forum Blog Projects Directory Email Newsletter Social Media
- 25. www.cxlforum.com
- 27. Thank you!
Editor's Notes
- MemVerge policy: System memory 60%, CXL Memory 40%
- Enables applications to take advantage of CXL shared memory Gismo Library Links to the application on each node Provides object lifecycle APIs C/C++ support Gismo Manager Daemon that runs on one of the nodes in the cluster Manages object store access across nodes