The insatiable desire for more capacity and faster datarate arising from the explosion in bandwidth-intense applications necessitates deployment of higher capacity WDM systems in both inside datacenter and metro datacenter interconnects systems. This demand for higher datarates is reflected by the numerous standardization and study groups commenced in the last couple of years. While the standardization scrutinizes the requirements for smooth migration for a datacenter interconnect with distances of upto 40km, the upgrade to high capacity DC metro access networks (beyond 40km), where no standardization exists, needs to address the economic viability together with greater space, power and bandwidth efficiency requirements. This presentation focuses on both of these areas and elucidates the current trends and evolving technologies to deal with the dynamically shifting landscape of DCI.
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
100G and Beyond DC Interconnect: Present and Future
1. 12-13 April 2016 | Data Center World | London
100G and Beyond DC Interconnect:
Present and Future
• Dr. Susmita Adhikari
• Phone: +49-6131-69851-225
• susmita.adhikari@hubersuhner.com
• www.hubersuhner.com | www.cubeoptics.com | blog.cubeoptics.com
DATA CENTRE
WORLD
2. Excellence in Connectivity Solutions 12-13 April 2016 | Data Center World | London
Global Data Center Traffic
73.1%
8.7% 18.2%
2019
Within Data
Center
Data Center-
to-Data Center
Data Center-
to-User
75.4%
6.8% 17.8%
2014
Source: Cisco Global Cloud Index 2015, 2014–2019
• Traffic between data centers is growing faster
• 100G data center optics is accelerating
100G and Beyond DC Interconnect: Present and Future
2
3. Part I
100G DC Interconnect
‘Present’
12-13 April 2016 | Data Center World | London
4. Excellence in Connectivity Solutions 12-13 April 2016 | Data Center World | London
IEEE 100GbE Standards
Non-Standard
Source:ADVAOpticalCopper
Multimode Single-Mode Single-Mode Single-Mode
Media Type MMF
Name 100GBASE-
SR10
100GBASE-
SR4
Standard IEEE 802.3ba IEEE 802.3bm
Electrical 10 x10Gb/s
CAUI 10
4 x 25Gb/s
CAUI 4
Reach 100m OM3/
150m OM4
70m OM3/
100m OM4
Fiber Count
(Tx/Rx)
10 4
Lanes 1
850nm
1
850nm
Gb/s per lane 10Gb/s 25Gb/s
Connector MPO/MTP MPO/MTP
Media Type MMF SMF
Name 100GBASE-
SR10
100GBASE-
SR4
100GBASE-
LR4
100GBASE-
ER4
Standard IEEE 802.3ba IEEE 802.3bm IEEE 802.3ba IEEE 802.3ba
Electrical 10 x10Gb/s
CAUI 10
4 x 25Gb/s
CAUI 4
10 x 10Gb/s
CAUI 10
10 x 10Gb/s
CAUI 10
Reach 100m OM3/
150m OM4
70m OM3/
100m OM4
10km 40km
Fiber Count
(Tx/Rx)
10 4 1 1
Lanes 1
850nm
1
850nm
4
1295.56nm
1300.05nm
1304.59nm
1309.14nm
4
1295.56nm
1300.05nm
1304.59nm
1309.14nm
Gb/s per lane 10Gb/s 25Gb/s 25Gb/s 25Gb/s
Connector MPO/MTP MPO/MTP LC LC
100G and Beyond DC Interconnect: Present and Future
4
5. Excellence in Connectivity Solutions 12-13 April 2016 | Data Center World | London
100GbE Form-Factor Evolution
• It is all about rack space, port density and power consumption
Source:Finisar
100G and Beyond DC Interconnect: Present and Future
5
6. Excellence in Connectivity Solutions 12-13 April 2016 | Data Center World | London
100GbE Form-Factor Evolution(2)
CFP CFP2 CFP4 QSFP28CFP CFP2 CFP4 QSFP28
Width 82mm 41.5mm 21.7mm 18.35mm
Power <24W <12W 9W 3.5W
Electrical 10 x10Gb/s
CAUI 10
10 x 10Gb/s
CAUI 10
4 x 25Gb/s
CAUI 4
4 x 25Gb/s
CAUI 4
4 x 25Gb/s
CAUI 4
Variants SR10, LR4, ER4 SR10, LR4, ER4 SR4, LR4, (CWDM4) SR4, LR4, (PSM4,CWDM4)
Medium MMF, SMF MMF, SMF MMF, SMF MMF, SMF
100G and Beyond DC Interconnect: Present and Future
6
7. Excellence in Connectivity Solutions
SWDM Alliance PSM4 MSA CWDM4 MSA CLR4 Alliance OpenOptics MSA
Form-Factor QSFP28 CFP4, QSFP28 CFP4, QSFP28 QSFP28 QSFP28
Media MMF SMF SMF SMF SMF
Reach 100m OM4 500m 2km 2km >2km
Fiber Count
(Tx/Rx)
1 4 1 1 1
Lanes 4
851nm,
881nm,
911nm,
941nm
1
1310nm
4
1271nm,
1291nm,
1311nm,
1331nm
4
1295nm,
1300nm
1304nm,
1309nm
4 (-32)
1504 to 1566
(200GHz spacing)
Gb/s per lane 25Gb/s 25Gb/s 25Gb/s 25Gb/s 25Gb/s
SWDM Alliance PSM4 MSA CWDM4 MSA CLR4 Alliance
Form-Factor QSFP28 CFP4, QSFP28 CFP4, QSFP28 QSFP28
Media MMF SMF SMF SMF
Reach 100m OM4 500m 2km 2km
Fiber Count
(Tx/Rx)
1 4 1 1
Lanes 4
851nm,
881nm,
911nm,
941nm
1
1310nm
4
1271nm,
1291nm,
1311nm,
1331nm
4
1295nm,
1300nm
1304nm,
1309nm
Gb/s per lane 25Gb/s 25Gb/s 25Gb/s 25Gb/s
12-13 April 2016 | Data Center World | London
100GbE Non-Standard MSAs
100G and Beyond DC Interconnect: Present and Future
7
SWDM Alliance PSM4 MSA
Form-Factor QSFP28 CFP4, QSFP28
Media MMF SMF
Reach 100m OM4 500m
Fiber Count
(Tx/Rx)
1 4
Lanes 4
851nm,
881nm,
911nm,
941nm
1
1310nm
Gb/s per lane 25Gb/s 25Gb/s
SWDM Alliance
Form-Factor QSFP28
Media MMF
Reach 100m OM4
Fiber Count
(Tx/Rx)
1
Lanes 4
851nm,
881nm,
911nm,
941nm
Gb/s per lane 25Gb/s
8. Excellence in Connectivity Solutions
• Market share by medium
12-13 April 2016 | Data Center World | London
2015 Market Analysis
100G and Beyond DC Interconnect: Present and Future
• 100G market share by type/reach
Courtesy 50G/NGOATH Ad Hoc March 2, 2016:
Preliminary February 2016 data from LightCounting
8
9. Excellence in Connectivity Solutions
• 100G Form-Factor
– QSFP28 quickly becoming dominant form-
factor similar to 40G QSFP+
– QSFP28 increases density and decreases
power and price per bit
– QSFP28 increases front-panel density by 2.5
fold compared to QSFP+
12-13 April 2016 | Data Center World | London
2015 Market Analysis
Preliminary February 2016 data from LightCounting
100G and Beyond DC Interconnect: Present and Future
9
Courtesy 50G/NGOATH Ad Hoc March 2, 2016:
Preliminary February 2016 data from LightCounting
10. Part II
100G and Beyond DC Interconnect
‘Future’
12-13 April 2016 | Data Center World | London
11. Excellence in Connectivity Solutions 12-13 April 2016 | Data Center World | London
Future Ethernet Speeds
100G and Beyond DC Interconnect: Present and Future
11
12. Excellence in Connectivity Solutions
Future Ethernet Speeds(2)
12-13 April 2016 | Data Center World | London
100G and Beyond DC Interconnect: Present and Future
12
13. Excellence in Connectivity Solutions 12-13 April 2016 | Data Center World | London
Future Spectrum of 200G and 400G Optics
Media MMF SMF
Name 200G
SR4
200G
SWDM
4
400G
SR16
400G
SR4.2
400G
SWDM
8
200G-
PSM4
200G
LR4/FR
4
400G
PSM4.
2
400G
LR8/FR
8
400G
PSM4/
DR4
400G
FR4
Reach 150m 100m 100m 100m 70m 500m 10km/
2km
500m 10km/
2km
500m 2km
Fiber
Count
(Tx/Rx)
4 1 16 4 1 4 1 4 1 4 1
Lambd
a
1 4 1 2 8 1 4 2 8 1 4
Gb/s
per
lane
50Gb/s 50Gb/s 25Gb/s 50Gb/s 50Gb/s 50Gb/s 50Gb/s 50Gb/s 50Gb/s 100Gb/s 100Gb/s
* Still in discussion/ standardization
100G and Beyond DC Interconnect: Present and Future
Media MMF
Name 200G
SR4
200G
SWDM
4
400G
SR16
400G
SR4.2
400G
SWDM
8
Reach 150m 100m 100m 100m 70m
Fiber
Count
(Tx/Rx)
4 1 16 4 1
Lambd
a
1 4 1 2 8
Gb/s
per
lane
50Gb/s 50Gb/s 25Gb/s 50Gb/s 50Gb/s
13
14. Excellence in Connectivity Solutions 12-13 April 2016 | Data Center World | London
Future Form-Factors
100G and Beyond DC Interconnect: Present and Future
14
15. Excellence in Connectivity Solutions
400GbE Form-Factors
12-13 April 2016 | Data Center World | London
CFP2-like
100G and Beyond DC Interconnect: Present and Future
15
CFP8 SR16 Demo at Ethernet Alliance Booth OFC2016
16. Part III
100G DC Interconnect
‘Metro’
12-13 April 2016 | Data Center World | London
17. Excellence in Connectivity Solutions
• In last 2 years,100G surged 10x but
majority is long haul deployments
(75% in 2014)
• In 2016, 50% of deployments will be
100G in metro regional and access
markets
12-13 April 2016 | Data Center World | London
100G Metro DCI- Reality Check
0%
20%
40%
60%
80%
100%
2012 2013 2014 2015 2016 2017 2018 2019
Ports(%)
Year
Long Haul (>600km)
Metro (<600km)
Metro Access (<100km)
Source:IHSInfonetics,April2015
100G and Beyond DC Interconnect: Present and Future
17
18. Excellence in Connectivity Solutions 12-13 April 2016 | Data Center World | London
100G Ethernet Metro Gap
Problem
100G and Beyond DC Interconnect: Present and Future
18
Metro-Cloud
Interconnect
Requirements
Reach
Capacity
Power
Flexibility
Cost per bit
19. Excellence in Connectivity Solutions
Non-Standard Metro DCI Optics
• Complex phase & amp
modulation, less sensitive to
CD & PMD, so wider reach
• 100Gb/s PM-DQPSK per
lambda
• Tunable
• Based on simpler PDs, reach
limited by CD & PMD
• 25Gb/s ODB per lambda
• 4 lambda per 100G used
• 50Ghz or 100Ghz ITU-T grid
• Tunable
Coherent CFP/ CFP2-ACO Direct Detect CFP DWDM
12-13 April 2016 | Data Center World | London
100G and Beyond DC Interconnect: Present and Future
19
20. Excellence in Connectivity Solutions 12-13 April 2016 | Data Center World | London 20
100G Direct Detect QSFP28 “ColorZ”
• Microsoft teaming with Inphi for worlds first 100G QSFP28 for metro DCI.
• Based on simpler PDs, reach limited by CD & PMD
• 50Gb/s PAM per lambda
• 2 lambda per 100G used
• DWDM 100Ghz ITU-T grid
• Connect data centers nearly 80km apart
• No need of active transponding in between
• Requires FEC on host board
• Tentative availability: 2017
100G and Beyond DC Interconnect: Present and Future
21. Excellence in Connectivity Solutions 12-13 April 2016 | Data Center World | London
Non-Standard Coherent vs. Direct Detect
100G in Metro
100G Coherent 100G Direct Detect
Power <32W <24W / <5W
Space CFP
CFP2-ACO (requires external
DSP)
CFP / QSFP28
Linerate per
lambda (10G)
100Gbps 25Gbps / 50Gbps
Cost per Bit
(10*10G = P)
4.8 X P 1.6 X P / TBD
Complexity Transponder required No Transponder required
P =
Transceivers
only
100G and Beyond DC Interconnect: Present and Future
21
22. Excellence in Connectivity Solutions
Future Outlook Metro DCI
• Metro access market is only going to
grow
• Not just about datacenter interconnect-
enterprise, IXs, financial institutes
• Direct Detect deployments supersede
coherent after 2018
• Coherent opted when spectral
efficiency required, otherwise DWDM
Direct Detect proves to be the optimal
solution
Source: IHS Infonetics, April 2015
12-13 April 2016 | Data Center World | London 22
100G and Beyond DC Interconnect: Present and Future
23. Excellence in Connectivity Solutions
• 100Gbps is quickly becoming de facto transmission speed
inside and outside Data Centers
• 100G switches moving towards higher port density with CFP2,
CFP4 and QSFP28 optics
• 200G and 400G Ethernet speed in development to meet the
continuous traffic demand
• It‘s a fragmented market
12-13 April 2016 | Data Center World | London
Conclusion
100G and Beyond DC Interconnect: Present and Future
23
24. • Dr. Susmita Adhikari
• Phone: +49-6131-69851-225
• susmita.adhikari@hubersuhner.com
• www.hubersuhner.com | www.cubeoptics.com | blog.cubeoptics.com
12-13 April 2016 | Data Center World | London
Thank you for your
attention.
25. Excellence in Connectivity Solutions 12-13 April 2016 | Data Center World | London
Passive 100G Transport
SNMP
1310
DCAC
• No conversion, transport transceivers are
plugged straight into terminal equipment
• Less active elements => higher reliability,
less latency
• Transceivers are managed by terminal
equipment (Switch, DSLAM, etc.)
PASSIVE
1310
• Conversion from client (“grey transceivers”)
to line (“colored transceivers”) signals by
transponder cards
• Since being “active” a chassis with power
and management (SNMP) is needed
• Flexible but complex
ACTIVE
100G and Beyond DC Interconnect: Present and Future
25