Data Center Architecture Trends
The Impact from SDN on the Physical Infrastructure
2
Agenda
• What is Software Defined Networking?
• Why is SDN important?
• Traditional 3-Tier Architecture vs Spine-Leaf
• Data Center Trends
• Forecasts Switch- and Server Ports
• Fiber Optic Transceiver costs
• Impact on the Physical Infrastructure
• ToR/EoR/MoR Designs
• Panduit Reference Architecture
• Panduit Integrated Data Center Infrastructure Stack
• Conclusion
3
The physical separation of the network control
plane from the forwarding plane, and where a
control plane controls several devices
Source : opennetworking.org
What is Software Defined Networking?
4
Why is SDN important?
Source : SDxCentral, Plexxi, and Lightspeed Venture Partners
Cisco’s SDN offering is called Application Centric Infrastructure (ACI)
Panduit is the only leading
infrastructure partner in Cisco’s ACI
Ecosystem
5
3-Tier Traditional Data Center Architecture : Logical
 Industry Standard for
decades
 Spanning Tree Fail
Over Mechanism
 High Latency
 Individual network
configured
components
 “North-South Traffic”
1Gbit/s
7k
5k
2k
10Gbit/s
6
 Transparent Interconnection
of Lots of Links (TRILL) or
Shortest Path Bridging (SPB)
 Spine-Leaf offers a lower
latency option for server to
server communications
 Offers more redundancy
 Requires higher density
connections between leaf
and spine switches
 Any to any concept
 “East-West Traffic”
2-Tier Data Center Reference Architecture : Logical
7
Data Center Architecture – Spine/Leaf
All Leaf Switches connected
to all Spine Switches
40Gbit/s
10Gbit/s
It all looks simple, however:
 2.5GBASE-T (2016)
 5GBASE-T (2016)
 SFF-8431 SFP-CU (2009)
 10GBASE-T (2005)
 10GBASE-SR (2002)
 25GBASE-T (2016)
 25GBASE-SR (2016)
 40GBASE-SR-BD (2013)
 40GBASE-SR4 (2010)
 40GBASE-CSR4 (2015)
 40GBASE-T (2016)
 50GBASE-SR (2019)
 100GBASE-SR10 (2010)
 100GBASE-SR4 (2015)
 100GBASE-PSM4 (?)
 200GBASE-SR4 (2019)
 400GBASE-SR16 (2017)
 400GBASE-PSM8 (?)
 Etc.
How can we futureproof all this?
8
Fiber Optic Transceiver Costs
Source: Lightcounting Market Research, IEEE 400GbE October 2013
High-Speed Links & Longer Reaches with Spine/Leaf Architecture
Signature Core™
Fiber Optic Cabling
is the only multimode
optical fiber
that extends Cisco
40GBASE-SR-BiDi
modules to 200m
and supports
40GBASE-CSR4
up to 550m
10
 Industry is moving to large centralized data centers
 Scale-Out computing with massive amounts of services and storage
 All nodes will be IP routers, single type of network element reduces cost
 Removes duplication of equipment and people
 Improved orchestration, path optimization, and analytics
 Designed to tolerate failures
 Permits bandwidth optimization and path control
 Reduced latency
 Permits rapid service delivery
 Improved efficiency (eliminates legacy Silos)
 Flat architectures, requires longer point-to-point optical connections
Data Center Trends
11
Source: IDC, March 2015 – The Need for Speed in the Datacenter
Ethernet Switch Ports
12
Source: BSRIA Global Data Centre 2014 End-User Survey, Jan 2015
Source: Speeds in Data Centers, EA TEF, Dell’Oro, Oct 2014
Source: Speeds in Data Centers, EA TEF, Dell’Oro, Oct 2014
Server Ports in the Data Center
13
Impact on the Physical Infrastructure?
The Physical Infrastructure needed to support Spine/Leaf is important to ensure performance and reliability:
• Connectivity - Properly designed 40GbE cabling for Spine to Leaf connections (fiber interface type, media type,
cable length, insertion loss)
• Pathways need adequate capacity for additional fiber cabling from (Spine to Leaf connections)
• Existing & new fiber cabling should be tested for 40GbE network speed
• Quality of fiber optic cable terminations may need to be addressed
• Sufficient fiber cable management at Spine and Leaf deployments
• Proper power and cooling at equipment deployment locations
14
Impact on the Physical Infrastructure?
• ToR Topology
• New data centers without any existing cabling or equipment
• Need for scalability and ease of adding cabinets
• Ease of migration from 10 Gbps networking toward 40Gbps
• High-density layouts using large numbers of 1U servers per cabinet
• Reduced cable congestion
• Modular, Pre-Configured Cabinets
• EoR/MoR Topology
• Existing EoR/MoR networks – currently the most common layout
• Compatibility with existing or slower networks
• Potential for frequent network MACs
• Centralized security and network management
• Sensitivity to down time and strong
BACKBONE AND HORIZONTAL CABLING
STRUCTURED FIBER CABLING TODAY - 10GBPS ETHERNET METHOD A
15
1
5
10
15
20
25
30
35
40
45
2
3
4
6
7
8
9
11
12
13
14
16
17
18
19
21
22
23
24
26
27
28
29
31
32
33
34
36
37
38
39
41
42
43
44
1
5
10
15
20
25
30
35
40
45
2
3
4
6
7
8
9
11
12
13
14
16
17
18
19
21
22
23
24
26
27
28
29
31
32
33
34
36
37
38
39
41
42
43
44
1
5
10
15
20
25
30
35
40
45
2
3
4
6
7
8
9
11
12
13
14
16
17
18
19
21
22
23
24
26
27
28
29
31
32
33
34
36
37
38
39
41
42
43
44
1
5
10
15
20
25
30
35
40
45
2
3
4
6
7
8
9
11
12
13
14
16
17
18
19
21
22
23
24
26
27
28
29
31
32
33
34
36
37
38
39
41
42
43
44
MODE
STACK
SPEED
DUPLX
STAT
MASTR
RPS
SYST
Catalyst 3750 SERIES
1 2 3 4 5 6 7 8 9 10 11 12
1X
2X
11X
12X
13 14 15 16 17 18 19 20 21 22 23 24
13X
14X
23X
24X
1 2 3 4
MODE
STACK
SPEED
DUPLX
STAT
MASTR
RPS
SYST
Catalyst 3750 SERIES
1 2 3 4 5 6 7 8 9 10 11 12
1X
2X
11X
12X
13 14 15 16 17 18 19 20 21 22 23 24
13X
14X
23X
24X
1 2 3 4
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
Server EDA
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
PSU FAN SUP FAB IOM
Cisco Nexus 7000 Series
1
5
10
15
20
25
30
35
40
45
2
3
4
6
7
8
9
11
12
13
14
16
17
18
19
21
22
23
24
26
27
28
29
31
32
33
34
36
37
38
39
41
42
43
44
1
5
10
15
20
25
30
35
40
45
2
3
4
6
7
8
9
11
12
13
14
16
17
18
19
21
22
23
24
26
27
28
29
31
32
33
34
36
37
38
39
41
42
43
44
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
MDA
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
Switch EDA
STATUS
IO
PERFORMANCE PORT
1357
4682
PERFORMANCE PORT
9111315
12141610
PERFORMANCE PORT
17192123
20222418
PERFORMANCE PORT
25272931
28303226
N7K-M132XP-12
SERIALPORT
CONSOLECOM1/AUX
STATU
S
IO
SYSTE
M
ACTIV
E
PWR
MGMT
N7K-SUP1
USB
DEVICEPORTHOSTPORTS
RESE
T
CMPSTATU
S
LINK
ACT
LINK
ACT
CMPMGMTETH
123456789101112131415161718192021222324252627282930313233343536373839404142434445464748
N7K-M148GT-111
2
11
12
13
14
23
24
25
26
35
36
37
38
47
48
STATUS
123456789101112131415161718192021222324252627282930313233343536373839404142434445464748
N7K-M148GT-111
2
11
12
13
14
23
24
25
26
35
36
37
38
47
48
STATUS
SERIALPORT
CONSOLECOM1/AUX
STATU
S
IO
SYSTE
M
ACTIV
E
PWR
MGMT
N7K-SUP1
USB
DEVICEPORTHOSTPORTS
RESE
T
CMPSTATU
S
LINK
ACT
LINK
ACT
CMPMGMTETH
STATUS
IO
PERFORMANCE PORT
1357
4682
PERFORMANCE PORT
9111315
12141610
PERFORMANCE PORT
17192123
20222418
PERFORMANCE PORT
25272931
28303226
N7K-M132XP-12
STATUS
IO
PERFORMANCE PORT
1357
4682
PERFORMANCE PORT
9111315
12141610
PERFORMANCE PORT
17192123
20222418
PERFORMANCE PORT
25272931
28303226
N7K-M132XP-12
STATUS
IO
PERFORMANCE PORT
1357
4682
PERFORMANCE PORT
9111315
12141610
PERFORMANCE PORT
17192123
20222418
PERFORMANCE PORT
25272931
28303226
N7K-M132XP-12
LC to LC
Patch Cord
MPO to MPO
Trunk Cable
Assembly
Method A
MPO to MPO
Assembly
Method A
LC to LC Patch
Cord
Detail A
Discrete SFQ
Cassettes
Discrete SFQ
Cassettes
Discrete SFQ
Cassettes
Discrete SFQ
Cassettes
Female – Key Up
To
Female – Key Down
Female – Key Up
to
Female – Key Down
10 G to 40 G Migration with Cisco
40G BiDi and legacy fiber:
Legacy OM3 = 100m
Legacy OM4 = 135m
Signature Core™ = 200m
BACKBONE AND HORIZONTAL CABLING
STRUCTURED FIBER CABLING TOMORROW – 40GBPS ETHERNET METHOD B
16
1
5
10
15
20
25
30
35
40
45
2
3
4
6
7
8
9
11
12
13
14
16
17
18
19
21
22
23
24
26
27
28
29
31
32
33
34
36
37
38
39
41
42
43
44
1
5
10
15
20
25
30
35
40
45
2
3
4
6
7
8
9
11
12
13
14
16
17
18
19
21
22
23
24
26
27
28
29
31
32
33
34
36
37
38
39
41
42
43
44
1
5
10
15
20
25
30
35
40
45
2
3
4
6
7
8
9
11
12
13
14
16
17
18
19
21
22
23
24
26
27
28
29
31
32
33
34
36
37
38
39
41
42
43
44
1
5
10
15
20
25
30
35
40
45
2
3
4
6
7
8
9
11
12
13
14
16
17
18
19
21
22
23
24
26
27
28
29
31
32
33
34
36
37
38
39
41
42
43
44
MODE
STACK
SPEED
DUPLX
STAT
MASTR
RPS
SYST
Catalyst 3750 SERIES
1 2 3 4 5 6 7 8 9 10 11 12
1X
2X
11X
12X
13 14 15 16 17 18 19 20 21 22 23 24
13X
14X
23X
24X
1 2 3 4
MODE
STACK
SPEED
DUPLX
STAT
MASTR
RPS
SYST
Catalyst 3750 SERIES
1 2 3 4 5 6 7 8 9 10 11 12
1X
2X
11X
12X
13 14 15 16 17 18 19 20 21 22 23 24
13X
14X
23X
24X
1 2 3 4
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
Server EDA
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
System p5
PSU FAN SUP FAB IOM
Cisco Nexus 7000 Series
1
5
10
15
20
25
30
35
40
45
2
3
4
6
7
8
9
11
12
13
14
16
17
18
19
21
22
23
24
26
27
28
29
31
32
33
34
36
37
38
39
41
42
43
44
1
5
10
15
20
25
30
35
40
45
2
3
4
6
7
8
9
11
12
13
14
16
17
18
19
21
22
23
24
26
27
28
29
31
32
33
34
36
37
38
39
41
42
43
44
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
MDA
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
1 2 3 4 5 6
25 26 27 28 29 30
7 8 9 10 11 12
31 32 33 34 35 36
13 14 15 16 17 18
37 38 39 40 41 42
19 20 21 22 23 24
43 44 45 46 47 48
Switch EDA
STATUS
IO
PERFORMANCE PORT
1357
4682
PERFORMANCE PORT
9111315
12141610
PERFORMANCE PORT
17192123
20222418
PERFORMANCE PORT
25272931
28303226
N7K-M132XP-12
SERIALPORT
CONSOLECOM1/AUX
STATU
S
IO
SYSTE
M
ACTIV
E
PWR
MGMT
N7K-SUP1
USB
DEVICEPORTHOSTPORTS
RESE
T
CMPSTATU
S
LINK
ACT
LINK
ACT
CMPMGMTETH
123456789101112131415161718192021222324252627282930313233343536373839404142434445464748
N7K-M148GT-111
2
11
12
13
14
23
24
25
26
35
36
37
38
47
48
STATUS
123456789101112131415161718192021222324252627282930313233343536373839404142434445464748
N7K-M148GT-111
2
11
12
13
14
23
24
25
26
35
36
37
38
47
48
STATUS
SERIALPORT
CONSOLECOM1/AUX
STATU
S
IO
SYSTE
M
ACTIV
E
PWR
MGMT
N7K-SUP1
USB
DEVICEPORTHOSTPORTS
RESE
T
CMPSTATU
S
LINK
ACT
LINK
ACT
CMPMGMTETH
STATUS
IO
PERFORMANCE PORT
1357
4682
PERFORMANCE PORT
9111315
12141610
PERFORMANCE PORT
17192123
20222418
PERFORMANCE PORT
25272931
28303226
N7K-M132XP-12
STATUS
IO
PERFORMANCE PORT
1357
4682
PERFORMANCE PORT
9111315
12141610
PERFORMANCE PORT
17192123
20222418
PERFORMANCE PORT
25272931
28303226
N7K-M132XP-12
STATUS
IO
PERFORMANCE PORT
1357
4682
PERFORMANCE PORT
9111315
12141610
PERFORMANCE PORT
17192123
20222418
PERFORMANCE PORT
25272931
28303226
N7K-M132XP-12
MPO to MPO
Trunk Cable
Assembly
MPO to MPO
Assembly
MPO to MPO
Patch Cord
4, 6, 8 MPO SFQ
Adapter Panel
4, 6, 8 MPO SFQ
Adapter Panel
4, 6, 8 MPO SFQ
Adapter Panel
4, 6, 8 MPO SFQ
Adapter Panel
MPO to MPO
Patch Cord
Male – Key Up
to
Male – Key Up
Male – Key Up
to
Male – Key Up
Female – Key Up
to
Female – Key Up
Female – Key Up
to
Female – Key Up
10 G to 40 G Migration
based on 40GBASE-SR4:
1. Gender change
Female to Male
2. Polarity change Key
Up/Key Down to Key
Up/Key Up
3. Remove Cassettes
4. Replace with FAPs
Always have the right cable
assembly on hand
PanMPO™
Spine
Switch “1”
Spine
Switch “2”
Patch
Panel
Spine
• Enables Dual Chassis and Patch Panel in Single
42RU High Cabinet
Key Considerations
• Cable Density
“B” Switch“A”
Switch
ToR Twins Redundant
• Enables Redundancy using a Top of Rack
Architecture.
• Key Considerations
• Cable Routing
EoR Leaf
• House 1 Een of Row Leaf in each
cabinet
Key Considerations
• 384 10G connections +
• 32 40G connections
Panduit’s Reference Design
Twins – Redundant
• Two cabinets
• 2 x 9396 Leaf Switches
• (24) 1 RU Servers per cab
• 96 Native 10G Ports
Rear view showing
Primary Path Cables
connected to “A” Switch
“B” Switch“A” Switch
Primary Path
Secondary
Path
Panduit’s Reference Design
“B” Switch
Trips – Redundant
• Three cabinets
• (16) 2 RU Servers per
cabinet
• 2 x 9396 Leaf Switches
• 96 Native 10G Ports
Blanking Panel
“A” Switch
Primary Path
Secondary
Path
Panduit’s Reference Design
20
Panduit’s Integrated Data Center Infrastructure
Spine Cabinet Design - Nexus 9508Leaf Cabinet Design - Nexus 93128 Highlights:
• Integrated Intelligent Cabinet
• Rack Gateway (power,
environmental sensors, physical
security, platform for Analytics)
• Cisco BiDi transceivers with Panduit
MPO, LC, or Signature Core cabling
• 10G Base-T Panduit Cat6a cable (SD-
UTP)
• High Density Patch Panels (line card
replication)
• High Density Cable Management
• Other configurations are being
developed
21
Panduit’s Integrated Data Center Infrastructure
DATACENTERSTACK
FACILITIES
INFRASTRUCTURE
INFORMATIONTECHNOLOGY
Building
MEP
Cabinets
Rack Power & Env.
Connectivity
Network
Storage
Compute
VM
OS
DB
Apps
DCIM Cooling
Optimization
DCIM Power
Management
DCIM Asset &
Connectivity
Copper
Connectivity
Fiber
Connectivity
Physical
Accessories
Cabling Mgmt. &
Pathways
Network and
Server Cabinets
Pre-Configured
Cabinets
Thermal
Containment
Rack Power
Distribution
DesignandOptimization
 Implementation and Support
Professional Services
Hyper
Converged
Converged
Infrastructure
(Panduit Vblock)
Panduit IDC Stack
Panduit Pre-Configured Cabinet
Panduit Rack & Stack Solutions
22
Landingpage Panduit Data Center Solutions
Landingpage Panduit - Cisco ACI Physial Infrastructure
Landingpage Cisco Systems - Panduit DC Partner
Panduit Reference Architecture for Cisco ACI
Cisco ACI White Paper - Panduit Reference Architecture
Panduit Signature™ Core Fiber
Landingpage PanMPO 10/40/100G Solution
Category 8 System - 25GBASE-T & 40GBASE-T
Direct Attach Copper Cable Assemblies - SFP+/QSFP+
Cisco ACI Compatibility Assessment Service
So where can I find all this great information?
23
Conclusion
• Market analysts expect massive SDN market grow in data centers
• Start engaging with brown- and greenfield data center owners
• Panduit and Cisco Accelerate Implementation of Next-Generation
Data Center Network Architecture:
• Extend the reach with Signature Core™ Fiber
• Futureproof data center investment with PanMPO™
• Panduit Category 8 solution for 10GBASE-T to 25/40GBASE-T
migration
• Panduit SFP+/QSFP+ solutions support server NIC grow to 10G &
40G
• Accelerate greenfield deployments with Pre-Configured Cabinet
Spine/Leaf solutions
• Re-sell Panduit ACI Assessment Service to guide customer from
Traditional to Spine/Leaf Architecture
• Take advantage of Panduit Integrated Data Center Stack solutions

Data Center Architecture Trends

  • 1.
    Data Center ArchitectureTrends The Impact from SDN on the Physical Infrastructure
  • 2.
    2 Agenda • What isSoftware Defined Networking? • Why is SDN important? • Traditional 3-Tier Architecture vs Spine-Leaf • Data Center Trends • Forecasts Switch- and Server Ports • Fiber Optic Transceiver costs • Impact on the Physical Infrastructure • ToR/EoR/MoR Designs • Panduit Reference Architecture • Panduit Integrated Data Center Infrastructure Stack • Conclusion
  • 3.
    3 The physical separationof the network control plane from the forwarding plane, and where a control plane controls several devices Source : opennetworking.org What is Software Defined Networking?
  • 4.
    4 Why is SDNimportant? Source : SDxCentral, Plexxi, and Lightspeed Venture Partners Cisco’s SDN offering is called Application Centric Infrastructure (ACI) Panduit is the only leading infrastructure partner in Cisco’s ACI Ecosystem
  • 5.
    5 3-Tier Traditional DataCenter Architecture : Logical  Industry Standard for decades  Spanning Tree Fail Over Mechanism  High Latency  Individual network configured components  “North-South Traffic” 1Gbit/s 7k 5k 2k 10Gbit/s
  • 6.
    6  Transparent Interconnection ofLots of Links (TRILL) or Shortest Path Bridging (SPB)  Spine-Leaf offers a lower latency option for server to server communications  Offers more redundancy  Requires higher density connections between leaf and spine switches  Any to any concept  “East-West Traffic” 2-Tier Data Center Reference Architecture : Logical
  • 7.
    7 Data Center Architecture– Spine/Leaf All Leaf Switches connected to all Spine Switches 40Gbit/s 10Gbit/s It all looks simple, however:  2.5GBASE-T (2016)  5GBASE-T (2016)  SFF-8431 SFP-CU (2009)  10GBASE-T (2005)  10GBASE-SR (2002)  25GBASE-T (2016)  25GBASE-SR (2016)  40GBASE-SR-BD (2013)  40GBASE-SR4 (2010)  40GBASE-CSR4 (2015)  40GBASE-T (2016)  50GBASE-SR (2019)  100GBASE-SR10 (2010)  100GBASE-SR4 (2015)  100GBASE-PSM4 (?)  200GBASE-SR4 (2019)  400GBASE-SR16 (2017)  400GBASE-PSM8 (?)  Etc. How can we futureproof all this?
  • 8.
  • 9.
    Source: Lightcounting MarketResearch, IEEE 400GbE October 2013 High-Speed Links & Longer Reaches with Spine/Leaf Architecture Signature Core™ Fiber Optic Cabling is the only multimode optical fiber that extends Cisco 40GBASE-SR-BiDi modules to 200m and supports 40GBASE-CSR4 up to 550m
  • 10.
    10  Industry ismoving to large centralized data centers  Scale-Out computing with massive amounts of services and storage  All nodes will be IP routers, single type of network element reduces cost  Removes duplication of equipment and people  Improved orchestration, path optimization, and analytics  Designed to tolerate failures  Permits bandwidth optimization and path control  Reduced latency  Permits rapid service delivery  Improved efficiency (eliminates legacy Silos)  Flat architectures, requires longer point-to-point optical connections Data Center Trends
  • 11.
    11 Source: IDC, March2015 – The Need for Speed in the Datacenter Ethernet Switch Ports
  • 12.
    12 Source: BSRIA GlobalData Centre 2014 End-User Survey, Jan 2015 Source: Speeds in Data Centers, EA TEF, Dell’Oro, Oct 2014 Source: Speeds in Data Centers, EA TEF, Dell’Oro, Oct 2014 Server Ports in the Data Center
  • 13.
    13 Impact on thePhysical Infrastructure? The Physical Infrastructure needed to support Spine/Leaf is important to ensure performance and reliability: • Connectivity - Properly designed 40GbE cabling for Spine to Leaf connections (fiber interface type, media type, cable length, insertion loss) • Pathways need adequate capacity for additional fiber cabling from (Spine to Leaf connections) • Existing & new fiber cabling should be tested for 40GbE network speed • Quality of fiber optic cable terminations may need to be addressed • Sufficient fiber cable management at Spine and Leaf deployments • Proper power and cooling at equipment deployment locations
  • 14.
    14 Impact on thePhysical Infrastructure? • ToR Topology • New data centers without any existing cabling or equipment • Need for scalability and ease of adding cabinets • Ease of migration from 10 Gbps networking toward 40Gbps • High-density layouts using large numbers of 1U servers per cabinet • Reduced cable congestion • Modular, Pre-Configured Cabinets • EoR/MoR Topology • Existing EoR/MoR networks – currently the most common layout • Compatibility with existing or slower networks • Potential for frequent network MACs • Centralized security and network management • Sensitivity to down time and strong
  • 15.
    BACKBONE AND HORIZONTALCABLING STRUCTURED FIBER CABLING TODAY - 10GBPS ETHERNET METHOD A 15 1 5 10 15 20 25 30 35 40 45 2 3 4 6 7 8 9 11 12 13 14 16 17 18 19 21 22 23 24 26 27 28 29 31 32 33 34 36 37 38 39 41 42 43 44 1 5 10 15 20 25 30 35 40 45 2 3 4 6 7 8 9 11 12 13 14 16 17 18 19 21 22 23 24 26 27 28 29 31 32 33 34 36 37 38 39 41 42 43 44 1 5 10 15 20 25 30 35 40 45 2 3 4 6 7 8 9 11 12 13 14 16 17 18 19 21 22 23 24 26 27 28 29 31 32 33 34 36 37 38 39 41 42 43 44 1 5 10 15 20 25 30 35 40 45 2 3 4 6 7 8 9 11 12 13 14 16 17 18 19 21 22 23 24 26 27 28 29 31 32 33 34 36 37 38 39 41 42 43 44 MODE STACK SPEED DUPLX STAT MASTR RPS SYST Catalyst 3750 SERIES 1 2 3 4 5 6 7 8 9 10 11 12 1X 2X 11X 12X 13 14 15 16 17 18 19 20 21 22 23 24 13X 14X 23X 24X 1 2 3 4 MODE STACK SPEED DUPLX STAT MASTR RPS SYST Catalyst 3750 SERIES 1 2 3 4 5 6 7 8 9 10 11 12 1X 2X 11X 12X 13 14 15 16 17 18 19 20 21 22 23 24 13X 14X 23X 24X 1 2 3 4 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 Server EDA System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 PSU FAN SUP FAB IOM Cisco Nexus 7000 Series 1 5 10 15 20 25 30 35 40 45 2 3 4 6 7 8 9 11 12 13 14 16 17 18 19 21 22 23 24 26 27 28 29 31 32 33 34 36 37 38 39 41 42 43 44 1 5 10 15 20 25 30 35 40 45 2 3 4 6 7 8 9 11 12 13 14 16 17 18 19 21 22 23 24 26 27 28 29 31 32 33 34 36 37 38 39 41 42 43 44 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 MDA 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 Switch EDA STATUS IO PERFORMANCE PORT 1357 4682 PERFORMANCE PORT 9111315 12141610 PERFORMANCE PORT 17192123 20222418 PERFORMANCE PORT 25272931 28303226 N7K-M132XP-12 SERIALPORT CONSOLECOM1/AUX STATU S IO SYSTE M ACTIV E PWR MGMT N7K-SUP1 USB DEVICEPORTHOSTPORTS RESE T CMPSTATU S LINK ACT LINK ACT CMPMGMTETH 123456789101112131415161718192021222324252627282930313233343536373839404142434445464748 N7K-M148GT-111 2 11 12 13 14 23 24 25 26 35 36 37 38 47 48 STATUS 123456789101112131415161718192021222324252627282930313233343536373839404142434445464748 N7K-M148GT-111 2 11 12 13 14 23 24 25 26 35 36 37 38 47 48 STATUS SERIALPORT CONSOLECOM1/AUX STATU S IO SYSTE M ACTIV E PWR MGMT N7K-SUP1 USB DEVICEPORTHOSTPORTS RESE T CMPSTATU S LINK ACT LINK ACT CMPMGMTETH STATUS IO PERFORMANCE PORT 1357 4682 PERFORMANCE PORT 9111315 12141610 PERFORMANCE PORT 17192123 20222418 PERFORMANCE PORT 25272931 28303226 N7K-M132XP-12 STATUS IO PERFORMANCE PORT 1357 4682 PERFORMANCE PORT 9111315 12141610 PERFORMANCE PORT 17192123 20222418 PERFORMANCE PORT 25272931 28303226 N7K-M132XP-12 STATUS IO PERFORMANCE PORT 1357 4682 PERFORMANCE PORT 9111315 12141610 PERFORMANCE PORT 17192123 20222418 PERFORMANCE PORT 25272931 28303226 N7K-M132XP-12 LC to LC Patch Cord MPO to MPO Trunk Cable Assembly Method A MPO to MPO Assembly Method A LC to LC Patch Cord Detail A Discrete SFQ Cassettes Discrete SFQ Cassettes Discrete SFQ Cassettes Discrete SFQ Cassettes Female – Key Up To Female – Key Down Female – Key Up to Female – Key Down 10 G to 40 G Migration with Cisco 40G BiDi and legacy fiber: Legacy OM3 = 100m Legacy OM4 = 135m Signature Core™ = 200m
  • 16.
    BACKBONE AND HORIZONTALCABLING STRUCTURED FIBER CABLING TOMORROW – 40GBPS ETHERNET METHOD B 16 1 5 10 15 20 25 30 35 40 45 2 3 4 6 7 8 9 11 12 13 14 16 17 18 19 21 22 23 24 26 27 28 29 31 32 33 34 36 37 38 39 41 42 43 44 1 5 10 15 20 25 30 35 40 45 2 3 4 6 7 8 9 11 12 13 14 16 17 18 19 21 22 23 24 26 27 28 29 31 32 33 34 36 37 38 39 41 42 43 44 1 5 10 15 20 25 30 35 40 45 2 3 4 6 7 8 9 11 12 13 14 16 17 18 19 21 22 23 24 26 27 28 29 31 32 33 34 36 37 38 39 41 42 43 44 1 5 10 15 20 25 30 35 40 45 2 3 4 6 7 8 9 11 12 13 14 16 17 18 19 21 22 23 24 26 27 28 29 31 32 33 34 36 37 38 39 41 42 43 44 MODE STACK SPEED DUPLX STAT MASTR RPS SYST Catalyst 3750 SERIES 1 2 3 4 5 6 7 8 9 10 11 12 1X 2X 11X 12X 13 14 15 16 17 18 19 20 21 22 23 24 13X 14X 23X 24X 1 2 3 4 MODE STACK SPEED DUPLX STAT MASTR RPS SYST Catalyst 3750 SERIES 1 2 3 4 5 6 7 8 9 10 11 12 1X 2X 11X 12X 13 14 15 16 17 18 19 20 21 22 23 24 13X 14X 23X 24X 1 2 3 4 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 Server EDA System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 System p5 PSU FAN SUP FAB IOM Cisco Nexus 7000 Series 1 5 10 15 20 25 30 35 40 45 2 3 4 6 7 8 9 11 12 13 14 16 17 18 19 21 22 23 24 26 27 28 29 31 32 33 34 36 37 38 39 41 42 43 44 1 5 10 15 20 25 30 35 40 45 2 3 4 6 7 8 9 11 12 13 14 16 17 18 19 21 22 23 24 26 27 28 29 31 32 33 34 36 37 38 39 41 42 43 44 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 MDA 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 1 2 3 4 5 6 25 26 27 28 29 30 7 8 9 10 11 12 31 32 33 34 35 36 13 14 15 16 17 18 37 38 39 40 41 42 19 20 21 22 23 24 43 44 45 46 47 48 Switch EDA STATUS IO PERFORMANCE PORT 1357 4682 PERFORMANCE PORT 9111315 12141610 PERFORMANCE PORT 17192123 20222418 PERFORMANCE PORT 25272931 28303226 N7K-M132XP-12 SERIALPORT CONSOLECOM1/AUX STATU S IO SYSTE M ACTIV E PWR MGMT N7K-SUP1 USB DEVICEPORTHOSTPORTS RESE T CMPSTATU S LINK ACT LINK ACT CMPMGMTETH 123456789101112131415161718192021222324252627282930313233343536373839404142434445464748 N7K-M148GT-111 2 11 12 13 14 23 24 25 26 35 36 37 38 47 48 STATUS 123456789101112131415161718192021222324252627282930313233343536373839404142434445464748 N7K-M148GT-111 2 11 12 13 14 23 24 25 26 35 36 37 38 47 48 STATUS SERIALPORT CONSOLECOM1/AUX STATU S IO SYSTE M ACTIV E PWR MGMT N7K-SUP1 USB DEVICEPORTHOSTPORTS RESE T CMPSTATU S LINK ACT LINK ACT CMPMGMTETH STATUS IO PERFORMANCE PORT 1357 4682 PERFORMANCE PORT 9111315 12141610 PERFORMANCE PORT 17192123 20222418 PERFORMANCE PORT 25272931 28303226 N7K-M132XP-12 STATUS IO PERFORMANCE PORT 1357 4682 PERFORMANCE PORT 9111315 12141610 PERFORMANCE PORT 17192123 20222418 PERFORMANCE PORT 25272931 28303226 N7K-M132XP-12 STATUS IO PERFORMANCE PORT 1357 4682 PERFORMANCE PORT 9111315 12141610 PERFORMANCE PORT 17192123 20222418 PERFORMANCE PORT 25272931 28303226 N7K-M132XP-12 MPO to MPO Trunk Cable Assembly MPO to MPO Assembly MPO to MPO Patch Cord 4, 6, 8 MPO SFQ Adapter Panel 4, 6, 8 MPO SFQ Adapter Panel 4, 6, 8 MPO SFQ Adapter Panel 4, 6, 8 MPO SFQ Adapter Panel MPO to MPO Patch Cord Male – Key Up to Male – Key Up Male – Key Up to Male – Key Up Female – Key Up to Female – Key Up Female – Key Up to Female – Key Up 10 G to 40 G Migration based on 40GBASE-SR4: 1. Gender change Female to Male 2. Polarity change Key Up/Key Down to Key Up/Key Up 3. Remove Cassettes 4. Replace with FAPs Always have the right cable assembly on hand PanMPO™
  • 17.
    Spine Switch “1” Spine Switch “2” Patch Panel Spine •Enables Dual Chassis and Patch Panel in Single 42RU High Cabinet Key Considerations • Cable Density “B” Switch“A” Switch ToR Twins Redundant • Enables Redundancy using a Top of Rack Architecture. • Key Considerations • Cable Routing EoR Leaf • House 1 Een of Row Leaf in each cabinet Key Considerations • 384 10G connections + • 32 40G connections Panduit’s Reference Design
  • 18.
    Twins – Redundant •Two cabinets • 2 x 9396 Leaf Switches • (24) 1 RU Servers per cab • 96 Native 10G Ports Rear view showing Primary Path Cables connected to “A” Switch “B” Switch“A” Switch Primary Path Secondary Path Panduit’s Reference Design
  • 19.
    “B” Switch Trips –Redundant • Three cabinets • (16) 2 RU Servers per cabinet • 2 x 9396 Leaf Switches • 96 Native 10G Ports Blanking Panel “A” Switch Primary Path Secondary Path Panduit’s Reference Design
  • 20.
    20 Panduit’s Integrated DataCenter Infrastructure Spine Cabinet Design - Nexus 9508Leaf Cabinet Design - Nexus 93128 Highlights: • Integrated Intelligent Cabinet • Rack Gateway (power, environmental sensors, physical security, platform for Analytics) • Cisco BiDi transceivers with Panduit MPO, LC, or Signature Core cabling • 10G Base-T Panduit Cat6a cable (SD- UTP) • High Density Patch Panels (line card replication) • High Density Cable Management • Other configurations are being developed
  • 21.
    21 Panduit’s Integrated DataCenter Infrastructure DATACENTERSTACK FACILITIES INFRASTRUCTURE INFORMATIONTECHNOLOGY Building MEP Cabinets Rack Power & Env. Connectivity Network Storage Compute VM OS DB Apps DCIM Cooling Optimization DCIM Power Management DCIM Asset & Connectivity Copper Connectivity Fiber Connectivity Physical Accessories Cabling Mgmt. & Pathways Network and Server Cabinets Pre-Configured Cabinets Thermal Containment Rack Power Distribution DesignandOptimization  Implementation and Support Professional Services Hyper Converged Converged Infrastructure (Panduit Vblock) Panduit IDC Stack Panduit Pre-Configured Cabinet Panduit Rack & Stack Solutions
  • 22.
    22 Landingpage Panduit DataCenter Solutions Landingpage Panduit - Cisco ACI Physial Infrastructure Landingpage Cisco Systems - Panduit DC Partner Panduit Reference Architecture for Cisco ACI Cisco ACI White Paper - Panduit Reference Architecture Panduit Signature™ Core Fiber Landingpage PanMPO 10/40/100G Solution Category 8 System - 25GBASE-T & 40GBASE-T Direct Attach Copper Cable Assemblies - SFP+/QSFP+ Cisco ACI Compatibility Assessment Service So where can I find all this great information?
  • 23.
    23 Conclusion • Market analystsexpect massive SDN market grow in data centers • Start engaging with brown- and greenfield data center owners • Panduit and Cisco Accelerate Implementation of Next-Generation Data Center Network Architecture: • Extend the reach with Signature Core™ Fiber • Futureproof data center investment with PanMPO™ • Panduit Category 8 solution for 10GBASE-T to 25/40GBASE-T migration • Panduit SFP+/QSFP+ solutions support server NIC grow to 10G & 40G • Accelerate greenfield deployments with Pre-Configured Cabinet Spine/Leaf solutions • Re-sell Panduit ACI Assessment Service to guide customer from Traditional to Spine/Leaf Architecture • Take advantage of Panduit Integrated Data Center Stack solutions