Shalesh Thusoo of Marvell presents and overview of application problems and the Marvell portfolio of CXL technology designed to address the problems.

1. Transforming Cloud
Data Centers with CXL
Shalesh Thusoo
VP, CXL Product Development
July 2022

2. © 2022 Marvell. All rights reserved. 2
Cloud data center memory challenges
CXL is poised to address these issues
Bandwidth per core declining
Normalized
growth
rate
3.5
3
1.5
1
0.5
0
2
2.5
2012 2014 2016 2018 2020
CPU core count Memory channel BW per core
Source: Meta, OCP Summit Presentation Nov 2021
Degrades efficiency
No near-memory compute
DRAM DIMM
Limits performance
Increasing gap
Memory tied-down to xPUs
DRAM
DRAM
DPU
DRAM
DRAM
CPU
GPU
Cannot share

3. © 2022 Marvell. All rights reserved. 3
Cloud data center memory challenges
CXL accelerator
Bandwidth per core declining No near-memory compute
Memory tied-down to xPUs
CXL is poised to address these issues
CXL expander
CXL pooling
CXL expander
CXL pooling
CXL switch

4. © 2022 Marvell. All rights reserved. 4
CXL
Expander
CXL
Expander
Addressing memory expansion
 Scalable
 Pluggable
 Telemetry
 Improved thermals
 Mix-and-match DRAM
 Config flexibility
DRAM DIMM
 Limited scalability
 Not serviceable
 No telemetry
© 2022 Marvell. All rights reserved. 4
DIMM challenges CXL solution
CXL expander controller
CXL expander module
Standard form factors

5. © 2022 Marvell. All rights reserved. 5
CXL memory expanders improve performance
Same capacity with greater bandwidth and utilization
1DPC + CXL expanders
Today: 2 DIMMs per channel (2DPC)
xPU
128GB  256GB
1DPC same bandwidth as 2DPC
xPU
128GB
Use PCI express to open bandwidth
 256GB

6. © 2022 Marvell. All rights reserved. 6
Sharing memory with CXL
 Pool memory across multiple xPUs
 Rescue under-utilized DRAM
 Scale memory independent of xPUs
Direct
CXL memory pool
56 Core
xPU 0 xPU N
CXL
pooling
…
xPUs
CXL pooling
 Flexible to connect resources into fabric
 Scalable, serviceable
 Enables fully composable infrastructure
56 Core
xPU 0 xPU N
CXL
switch
…
Memory expanders Memory accelerators
xPUs
…
…
CXL
Expander
CXL
Accelerator
CXL switch
CXL
pooling

7. © 2022 Marvell. All rights reserved. 7
Accelerating with CXL
xPU
CXL
Accelerator
CXL accelerator
Compute engines
 Coherent, efficient
 Accelerate analytics, ML, search, etc.
 Improves efficiency and TCO
CXL I/O acceleration
 DPU/NIC, SSD, …
 Accelerate protocol processing
 Composable I/O devices
xPU

8. © 2022 Marvell. All rights reserved. 8
Bandwidth per core declining No near-memory compute
Memory tied-down to xPUs
CXL solves data center memory challenges
CXL is disrupting cloud data center architectures
More bandwidth per core
Optimize efficiency
xPU
Memory
Compute
Storage
Fully composable
Disaggregated memory
xPU
Ultimate performance
CXL
Accelerator
Near-memory computation

9. © 2022 Marvell. All rights reserved. 9
Comprehensive end-to-end CXL solutions
 Expanders
 Pooling
 Switch
 Accelerators
 Custom compute
 DPUs / SmartNICs
 Electro-optics
 Re-timers
 SSD controllers
Multi-billion $ opportunity
CXL opportunities
xPU 0 xPU N
…
Re-timer
DPU
CXL
Accelerator
CXL
Expander
CXL
Switch
…
↑ in the box
↓ out of box
Optics
CXL
Pooling
DPU
CXL
Expander
SSD
Cntrl

10. © 2022 Marvell. All rights reserved. 10
Summary
1 CXL is disrupting cloud data center architectures
2 Uniquely positioned to enable end-to-end CXL in data center
3 CXL is driving the next multi-billion-dollar opportunity
4 CXL memory pooling demo at FMS Marvell Booth #607

11. © 2022 Marvell. All rights reserved. 11
11
Memory pooling
demo chassis
Server
Intel Archer City
Sapphire Rapid Hosts
Intel Archer City
Sapphire Rapid Hosts
Memory Appliance
 Up to 6 Memory Devices
(3 installed)
 Up to 2 E3s Memory cards

12. Thank You