In the CXL Forum Theater at SC23, MemVerge presented an overview of the past, present, and future of CXL

1. The Past, Present,
and Future of CXL
Charles Fan
CEO and Co-Founder
MemVerge

2. CXL Past

3. Successes Led by CXL Consortium
• Herded over 200 members & adopters
• Streamlined standards efforts
• Completed 1.x, 2.x, and 3.x specs.
• Ignited billions in investment

4. 2022 CXL Market Revenue ($M)
Memory-Processor Interface 2023 – Focus on CXL
2022
$1.7M
$1M
$.2M
$1.7M
CXL DRAM
CXL Memory Expander Controller
CXL Memory Expander
(includes DRAM & Controller)

5. 2022: CXL Technologies Emerged
Switches
Processors
Software
DRAM
Memory Expansion

6. Exiting 2022
Specifications
Technologies
2019 2022 2023 2024
Concept Cars
We
Were
Here

7. CXL
Present

8. Co-Engineering
Concept Cars

9. CXL Memory Expansion
9

10. Optical CXL Demo
CXL Mem. Achieves ~2.4x Higher Throughput than Disk
OPT-66B model
results
Disk
(NVMe)
CXL
Memory
System
Memory
MemVerge
60:40 Policy
DecodeThroughput
(Tokens/s)
1.984 4.859 6.216 6.237
Decode Latency (s) 338.7 138.2 108.1 107.7

11. Project CXL Flight Simulator
Open Source QEMU VMs
1
Model of
Memory Expander
Model of
SK hynix Niagara
Get Started
Now

12. 0%
25%
50%
75%
100%
125%
150%
175%
200%
225%
250%
275%
300%
325%
350%
0% 1% 3% 5% 8% 10% 13% 15% 18% 20%
Runtime
vs
Baseline
% Data Spillage
In-Memory Analytics Benchmark (CloudSuite 3), 40GB Dataset
dram cxl swap-nvme Reclaimed
over 200%
performance
with only 20%
additional
memory
Project Endless Memory
Elastic Memory with CXL Pooling
1

13. Project Gismo
Global I/O-free Shared Memory Objects
13
MEMVERGE CONFIDENTIAL
Shuffle Benchmark Baseline Ray Ray + Gismo
Local Get 1GB object 0.4 sec
0.4 sec - CXL shared memory
as fast as local memory
Remote Get 1GB object 2.7 sec 0.4 sec - 675% faster
Shuffle 50GB
4 nodes, each 4 cores,
128 GB object store
515 sec 185 sec - 280% faster

14. Exiting 2023
We
Will Be
Here
Specifications
Technologies
2019 2022 2023 2024
Concept Cars
2025
Products

15. CXL
Future

16. Boom in Demand for AI and CXL
Memory
hungry
models
doubling
every 3-4
months
Source: OpenAI,
The Economist

17. CXL Market Revenue Forecast
2022
$1.7M
2028
$15.8B
2026
$2.1B
$143M
$1.5B
$112M $1.9B
$1M
$.2M
$1.7M
$741M
$12.5B
$583M $15B
CXL DRAM
CXL Memory Expander Controller
CXL Memory Expander (includes DRAM & Controller)
CXL Switch
Memory-Processor Interface 2023 – Focus on CXL

18. DRAM Expander Market Forecast 22-28
30%
70%
100%
87%
13%
25%
75%
Breakdown by format
Breakdown by use case
Drives
Add-in card
Direct attached memory expansion
Memory pooling
2022
$1.7M
2022
$1.7M
2028
$15B
2028
$15B
“The CXL memory market is expected to take off with the rise of memory pooling”
Memory-Processor Interface 2023 – Focus on CXL

19. CXL Disaggregates Memory
Storage
Disaggregation
Memory
Disaggregation
Storage Area
Network (SAN)
Fabric-Attached
Memory
Advanced Storage
Services
Memory-as-a-
Service
Fiber Channel Storage Data Services
CXL Memory Data Services

20. Creating a New Industry Focus
“This change of paradigm could give birth to a new industry focused on CXL
memory fabric software, systems and services.” - Yole

21. Memory-as-a-Service Community
Linux OS Open Source & Distros
Software Standards & Specifications
Device & Fabric Management
User Space Data Services
Select Organizations Contributing

22. MemVerge Software for CXL
K8S Schedulers
xPU xPU
xPU xPU
System software
Hardware
Shared Memory
OS/HV OS/HV
OS/HV
OS/HV
App App
App App
…
Global Memory Composer Memory Viewer
Memory Machine
Tiering/
Compression
Snapshot/
Live Migration
Sharing
Provision Compose Schedule App
Profiling
Resource
Monitoring
App-Centric Data Services
Multi-Cell Control Plane

23. Memory Viewer
23
Get it now
Essential for selling, configuring, and troubleshooting CXL products.
Available with your branding.

24. CXL Forum Activities Expanding to Accelerate
Co-engineering & Co-marketing
24
Participate
CXL Forum Events
CXLforum.com
CXL Forum Academy
CXL Forum Blog
Projects
Directory
Email Newsletter
Social Media

25. www.cxlforum.com