Cisco 資料中心產品及市場定位 Cisco Nexus 1000v / 5000 / 2000 / 7000產品概觀 N5K + UCS + VM 對於虛擬化網路管理的優勢-Network Interface Virtualization (VM-FEX)

1. Cisco Data Center Switch
(Nexus Series) 產品教育訓練
David Chou 周榮年
TEL:(02)2656-5766
E-mail:david.chou@zerone.com.tw
1

2. Agenda
 Cisco 資料中心產品及市場定位
 Cisco Nexus 1000v 產品概觀
 Cisco Nexus 5000 & 2000 產品概觀
 N5K + UCS + VM 對於虛擬化網路管理的優勢
- Network Interface Virtualization (VM-FEX)
 Cisco Nexus 7000 產品概觀
 資料中心網管軟體 - DCNM
 零壹解決方案體驗日
 Q & A , 注意事項
2

3. 資料中心所面臨的挑戰
3

4. 新世代資料中心的解決方案
4

5. Cisco Unified Fabric Switching Portfolio
SAN LAN LAN/SAN
Scalability
New!
Nexus 7000
MDS 9500 7009
Nexus 5000 Fab2 Module
New! F2 Module
MDS 9200 Nexus 2000
Nexus 1010
Nexus 3000
MDS 9100
Nexus 1000V
Cisco NX-OS: One OS from the Hypervisor to the Data Center Core
Convergence VM-Aware 10 GbE Fabric Cloud Mobility
Networking switching Extensibility
5

6. 或許現在您的客戶端網路架構是長這個樣子
- LAN & SAN各自獨立
Ethernet
Fibre Channel
Core
FC
L3
Aggregation
L2
Access
NIC HBA
6

7. 未來的架構會變成這個樣子
= Cisco Nexus + UCS
LAN SAN A SAN B
Ethernet FC
Nexus 5K &
7K
Data Center
Bridging
and FCoE
UCS Server
7

8. Nexus 1000V Switch
8

9. 伺服器虛擬化 – 網路管理上所產生的問題
Problems:
VMotion
• 無法從實體的網路連線看到虛擬機的
資料流.
• 無法觀察到虛擬交換器內的網路流
量 , 因此每個虛擬機的資料流無從
查起.
• 虛擬機跨越不同的伺服器進行遷移，
其Policy無法跟隨.
VLAN
101
VN-Link:
• 將網路的控制延伸至虛擬環境
• 管理上保有一致性
9

10. Cisco Nexus 1000V -
提供虛擬化環境第三方的虛擬交換器
Server 1 Server 2  Nexus 1000V 提供更進階的虛
擬網路交換能力
VM VM VM VM VM VM VM VM
#1 #2 #3 #4 #5 #6 #7 #8
 Access Control List
 L2 Security
VMware vSwitch
Nexus 1000V Nexus 1000V DVSNexus vSwitch
VMware 1000V  Spam Traffic
VMW ESX VMW ESX
 更能對於Vmotion給予彈性化
和連接的助益
10

11. Nexus 5K & 2K
Switch
11

12. N5K & N2K 位於架構上哪一個位置？
Ethernet
Fibre Channel
Core
Nexus 5K
FC
L3
Aggregation
L2 Nexus 5K
Nexus 5K
Access
Nexus 2K
NIC HBA
12

13. The New Nexus 5500 Platform
Product Hierarchy
Nexus 5548UP
48-Port 1RU Switch
Nexus 5548P US$ 25,600
48-Port 1RU Switch
Nexus 5010 US$ 25,600
28-Port 1RU Switch Q1CY11
US$ 23,300
Q4CY10
Q2CY10
Q1CY09
Q2CY08
Nexus 5596UP
96-Port 2RU Switch
US$ 36,800
Nexus 5020
56-Port 2RU Switch
US$ 34,500 N5K Second Generation
• Highly flexible 1/10G Line-rate switches
• Unified Port capability
• Layer-3 support
• Increased FEX scale (24 FEXs per 5K)
• Adapter-FEX/VM-FEX
• Cisco FabricPath
13
13

14. Cisco Nexus 5548UP / 5596UP
Scalability(可量性)
Increased FEX, MAC,
VLAN, Multicast Versatility(多樣性)
scalability
Layer 3 Routing
or Layer 2 Cisco
FabricPath ready
Performance(效能)
Highest density 10G
switch with wire-speed
performance and low Flexibility(高彈性)
latency
Unified Ports gives users
the flexibility to customize
different personalities for
each port 14

15. Unified Ports
更方便的去選擇網路埠型式的使用
Unified Port
Nexus 5548UP / 5596UP
Lossless Ethernet –
Native FC All ports are Unified capable iSCSI, NAS
FCoE,
32 x Fixed ports 1/10 GE or 1/2/4/8G FC Expansion Module
15

16. Nexus 5500 Expansion Modules
16 ports
1/10 GE
8 ports
1/10 GE
+
8 ports
1/2/4/8 G FC
16 ports
Unified
1/10 GE or 1/2/4/8 G
FC
16

17. N55-M160L3
N55-D160L3
Nexus 5548P
Nexus 5548UP
Nexus 5596UP
17

18. IT人員管理的考量
Campus and Data Center Networks
Distribution Si Si
Access Si Si
STP/HSRP
Access Servers NIC Teaming
龐大繁雜的網路備援環境 = 對網路管理的一大挑戰
網路故障所需要的恢復時間 = 企業的停工期間影響
網路資源的運用沒有效率 = 企業投資的浪費
大量增加的real-time網路應用 = 對網路穩定要求倍增 18

19. 跨交換器雙鏈路同時運作,頻寬不浪費
Virtual Port Channel – vPC
 跨機箱多鏈路捆綁，增加使用頻寬
 避免乙太網路環路(Spanning-tree loop)
 使網路架構更簡單
Virtual Port Channel
L2
Si Si
Physical Topology Logical Topology
Non-vPC vPC
19

20. Cisco FabricPath
- 支援L2多路徑拓樸 , 所有鏈路都可用
 最多提昇16倍的頻寬使用效能
 提高兩倍的網路使用能力 (No Spanning-Tree Issues)
 簡化IT維運，提高IT效率
Traditional Spanning Tree Based Network FabricPath Based Network
Blocked Links
Fully Non-Blocking
Oversubscription 16:1
2:1
Network Fabric
4
Pod
s
8:1
8 Access Switches
64 Access Switches
2, 048 Servers
2, 048 Servers
20

21. Fibre Channel over Ethernet (FCoE)
- 整合LAN & SAN的大功臣
FCoE
• Encapsulation of FC
Frames over Ethernet
• Enables FC to Run
on a Lossless Ethernet
CNA
CNA
LAN (Ethernet)
Ethernet
SAN (FCoE)
Fibre
Channel LAN SAN
Traffic
Byte 0 Byte 2229
Ethernet
Header
Header
Header
FCoE
CRC
EOF
FCS
FC Payload
FC
CNA = Converged Network Adapter 21

22. Unified Fabric Begins at Access
Unifying Server Access with Fibre Channel over
Ethernet
 FCoE allows FC SAN flows and
Traditional Network Unified Fabric at Access Layer
LAN flows to share a lossless
Ethernet link
LAN SAN A SAN B LAN SAN A SAN B
 Reduces adapter s, cables,
power at the access layer
 Combines LAN access
switches and SANFC
Ethernet
edge FC
Ethernet FC
switches
 Allows standardized I/O and
symmetric I/O services to
virtualized servers FC
Ethernet
Data Center
Bridging
 The next evolution of FC/SCSI and FCoE
allowing SAN access to the
economy of scale and
roadmap of Ethernet without
sacrificing capability 22

23. Nexus 2000 Fabric Extenders
– 需搭配N5K or N7K
N2248TP/N2248TP-E
48 Port 100/1000M Host Interfaces
4 x 10G Uplinks N2232PP
32 Port 1/10G FCoE Host
Interfaces
8 x 10G Uplinks
FET-10G
Cost Effective Fabric Extender
N2224TP Transceiver
24 Port 100/1000M Host Interfaces
2 x 10G Uplinks
N2232TM
32 Port 1/10GBASE-T Host Interfaces
N2148T 8 x 10G Uplinks (Module)
48 Port 1000M Host Interfaces
4 x 10G Uplinks
23

24. N2K Fabric Extended
提供Cabling線路彈性化 Core
Layer
 N5K 管理所有的N2K，如同SuperVisor
 N2K 就像是Line Card給SuperVisor(N5K)控管
 N2K提供100M, GE  10 GE  FCoE server access
VSS/vPC
Nexus
2000
Fabric Nexus
Extender
5000
Servers
Access
Layer
Rack-1 Rack-2 Rack-3 Rack-N 24
10/12/2012 Cisco Systems Confidential, Non-Disclosure Required

25. The New Nexus 5500 Platform
Product Hierarchy
Nexus 5548UP
48-Port 1RU Switch
Nexus 5548P US$ 25,600
48-Port 1RU Switch
Nexus 5010 US$ 25,600
28-Port 1RU Switch Q1CY11
US$ 23,300
Q4CY10
Q2CY10
Q1CY09
Q2CY08
Nexus 5596UP
96-Port 2RU Switch
US$ 36,800
Nexus 5020
56-Port 2RU Switch
US$ 34,500 N5K Second Generation
• Highly flexible 1/10G Line-rate switches
• Unified Port capability
• Layer-3 support
• Increased FEX scale (24 FEXs per 5K)
• Adapter-FEX/VM-FEX
• Cisco FabricPath
25
25

26. 虛擬化網路管理的優勢 –
Adapter FEX & VM
FEX
26

27. Adapter Offerings
Virtualization
127
10GbE/FCoE
Eth
PCIe x16
FC
0 1 2 3
• UCS P81E
Eth Eth
FC
• more vNICs can be use
• NIC Teaming done by HW
vNICs
CNA
10GbE/FCoE
PCIe Bus
FC
• Emulex and Qlogic
10GbE
• 2 Fibre Channel
• 2 Ethernet
• NIC Teaming through bonding driver
Ethernet or HBA
• Emulex / Qlogic (HBA)
• Broadcom Ethernet
• NIC Teaming through bonding driver
27
© 2009 Cisco Systems Inc. All rights reserved. UCS Technical Training – Overview

28. Cisco UCS Virtual Interface Card
UCS P81E Virtual Interface Card
 It supports NIC partitioning to the OS and 802.1BR to the switch
In A-FEX mode: support for up to 16 Eth vNIC and 2 FC vHBA
In VM-FEX mode: support for up to 96 vNics
28

29. UCS C-Series + Nexus5500
提供網路介面虛擬化
One Network
Parent Switch to Application—Single Point of Management
FEX Architecture Network
Manager
• Consolidates network management
• FEX managed as line card of parent switch IEEE 802.1BR*
Manage Network All the
Way to the OS FEX
Adapter-FEX Interface—Physical
• Consolidates multiple 1Gb interface into a and Virtual
single 10Gb interface IEEE 802.1BR* IEEE 802.1BR*
• Extends network into server
VM-FEX
• Consolidates virtual and physical network Hypervisor
Each VM gets a dedicated port on switch
Legacy Adapter-FEX VM-FEX
*IEEE 802.1BR pre-standard
29

30. 虛擬機網路資料流會怎麼跑?
VNIC VM VM VM VM VM VM VM VM
Hypervisor Hypervisor
Cisco VIC Cisco VIC
Server Server
VETH
Nexus 5500
Server Virtualization
30

31. Nexus 7K Switch
31

32. N7K 位於架構上哪一個位置？
Ethernet
Fibre Channel
Core Nexus 7K
FC
L3
Aggregation
L2
Nexus
7K
Access
NIC HBA
32

33. Cisco Nexus 7000 Series
Nexus 7009 Nexus 7010 Nexus 7018
Fabric Bandwidth 8.8 Tbps 9.9 Tbps 18.7 Tbps
Slots 7 I/O + 2 sup 8 I/O + 2 sup 16 I/O + 2 sup
Height 14 RU 21 RU 25 RU
Highest Fab 1
BW / Slot
Density 1G / 10G / 40G / 100GE Switching Platform in Industry
N/A 230 Gig / slot 230 Gig / slot
BW / Slot Fab 2 550 Gig / Slot 550 Gig / slot 550 Gig / slot
Application Data Center and Data Center Large Scale Data Center
Campus Core
33

34. Nexus 7000 Fabric Family
 Fabric 1 Only Supported on Nexus 7010 and 7018
 46 Gbps per slot per fabric
 Provides 230 Gbps per slot with 5 fabric modules
N7K-C7009-FAB-2
N7K-C7010-FAB-1
N7K-C7010-FAB-2 N7K-C7018-FAB-2
 Fabric 2 Supported all Nexus 7000 Series
N7K-C7018-FAB-1
 110 Gbps per fabric per slot
 Provides 550 Gbps per slot with 5 fabric 34

35. Fabric1 Module Capacity
Fabric Modules
Crossbar 1
46Gbps/slot Fabric
ASICs
2 x 23G channels per
I/O module slot
Crossbar 2
46Gbps/slot Fabric
1 x 23G channel per ASICs
supervisor slot
Crossbar 3
46Gbps/slot Fabric
ASICs
230Gbps
46Gbps
184Gbps
138Gbps
92Gbps
per slot bandwidth
Crossbar 4
46Gbps/slot Fabric
ASICs
Crossbar 5
46Gbps/slot Fabric
ASICs
Nexus 7018 35

36. Cisco FabricPath
- 支援L2多路徑拓樸 , 所有鏈路都可用
 最多提昇16倍的頻寬使用效能
 提高兩倍的網路使用能力 (No Spanning-Tree Issues)
 簡化IT維運，提高IT效率
Traditional Spanning Tree Based Network FabricPath Based Network
Blocked Links
Fully Non-Blocking
Oversubscription 16:1
2:1
Network Fabric
4
Pod
s
8:1
8 Access Switches
64 Access Switches
2, 048 Servers
2, 048 Servers
36

37. OTV(Overlay Transport Virtualization)
實現跨資料中心互聯的解決方案
- 解決Layer2互聯的需求
IP localization
L2 Domain Elasticity - Optimal Routing
- Route Portability
- Fabric Path
- LAN Extensions
OTV
OTV
Service
Localization
- Any service anywhere
Fabric
Consolidation
- Unified Fabric & I/O OTV
- Device Virtualization VN-link
- Segmentation OTV notifications
Storage Elasticity
- SAN Extensions
VM-awareness
- VN-link intelligence 37

38. 跨交換器雙鏈路同時運作,頻寬不浪費
Virtual Port Channel – vPC
 跨機箱多鏈路捆綁，增加使用頻寬
 避免乙太網路環路(Spanning-tree loop)
 使網路架構更簡單
Virtual Port Channel
L2
Si Si
Physical Topology Logical Topology
Non-vPC vPC
38

39. Nexus 7000的虛擬化架構功能
- 可虛擬化成多個資源獨立的交換器
VDC 2
VDC 1
Layer 2 Protocols Layer 3 Protocols
Layer 2 Protocols Layer 3 Protocols
VLAN UDLD OSPF GLBP
VLAN UDLD OSPF GLBP VDC 1 PVLAN CDP BGP HSRP
PVLAN CDP BGP HSRP STP 802.1X EIGRP IGMP
STP 802.1X EIGRP IGMP VDC 2 LACP CTS PIM SNMP
LACP CTS PIM SNMP … …
VDC 3
… …
VDC 4
Infrastructure
Kernel
VDC – Virtual Device Context
 Flexible separation/distribution of hardware resources and software components
 Complete data plane and control plane separation
 Complete software fault isolation
 Securely delineated administrative contexts
 Forwarding engine scalability with appropriate interface allocation
39

40. Supervisor Engine
 主要提供Control Plan & Management
Sup1 Sup2 Sup2E
CPU Dual-Core Xeon Quad-Core Xeon 2 x Quad-Core Xeon
Speed 1.66 Ghz 2.13 GHz 2.13 GHz
Memory 8G 12 GB 32 GB
NX-OS
4.0 or later 6.1 or later 6.1 or later
Release
VDCs 4 4+1 8+1
FEX 32 FEX/1536 Ports 32 FEX/1536 Ports 48 FEX/1536 Ports
40

41. Nexus 7000 M1 Modules
Services Rich Modules
―XL‖ Version ―XL‖ Version
Available Available
N7K-M132XP-12(L) 32-Port 10GE N7K-M148GT-11(L) 48-port 10/100/1000
SFP+ SR, LR, ER and ZR RJ-45 Copper
80 Gbps per slot 46 Gbps per slot
Fabric Extender Support, 802.1ae Link-Sec
4:1 over-sub or 1:1 line rate mode
LISP Support
―XL‖ Version
―XL‖ Capable Available
N7K-M108X2-12L 8-Port 10GE N7K-M148GS-11(L) 48-port 1GE SFP
X2 Optics – SR, LR, ZR. xWDM SX, LX, ZX, T and xWDM
80 Gbps per slot, 120 MPPS 46 Gbps per slot
Linerate @64byte IPv4
41
Cisco Confidential

42. Nexus 7000 M2 Modules
Next Generation Services Rich Modules
N7K-M224XP-23L 24-port 10GE N7K-M206FQ-23L 6-port 40 GE
10G SFP+ SR, LR, LRM, ER, ZR and DWDM 40G SR4, LR4 QSFP Optics
CX-1 Twinax Cable Support CR4 7 and 10m copper support
Non-Blocking 240 Gb/Slot QSFP to 4 x 10G SFP+ Octopus Cable
FEX Support Non Blocking 240 Gb/Slot
N7K-M202CF-22L 2-Port 100GE
100G CFP LR4, SR10
40G CFP SR4, LR4
Non-Blocking 200 Gb/Slot
42
Cisco Confidential

43. Nexus 7000 F-Series Modules
Higher Density 10G Scale
N7K-F248XP-25 48-port 1/10GE N7K-F248XT-25 48-port 1/10G-BASE-T
10G SFP+ SR, LR, LRM, ER, ZR and DWDM 10G-Base-T
10G CX1 Twinax Cable Support Cat 6/6a/7 Cabling
L3/L2 (Requires F2 VDC) L3/L2 (Requires F2 VDC)
Non-Blocking 480Gb/Slot Non-Blocking 480Gb/Slot
FEX, FCoE
N7K-F132XP-15 32-Port 1/10GE
10G SFP+ SR, LR, ER, LRM, ZR and DWDM
10G CX1 Twinax Cable Support
Layer 2 Only (Interop w/ M-Series)
230 Gb/Slot
FCoE
43
Cisco Confidential

44. Cisco Nexus 7000 系列
資料中心等級交換器
運作持續性
 零服務中斷設計(ISSU)
 靈活的系統運作
 獨立式管理介面架構
 富延展性背板結構設計
傳輸彈性
 具備40GbE/100GbE網路介面能力
 具備統合通道能力
基礎架構擴充性
 具可虛擬化架構設計
 15Tb+ 交換傳輸能力
 高效能實體與電力設計
44

45. Management Tool -
DCNM
45

46. DCNM Strategic Vision
Network
Compute
Customer Value
FCoE ITSM
Nexus Net Svcs
7000
MDS
9000
Eth
Integrated Data
FC Center
LAN SAN DCNM Management
(Converged)
Converged
DCNM Fabric Operations Mgmt
Manager
Storage Mgmt
Ethernet Mgmt
Yesterday Today Tomorrow 46

47. DCNM Packaging & Licensing
DCNM-SAN Free. Discovery,
Essentials Configuration,
Fault, Topology
DCNM-SAN DCNM-SAN $$. Dashboards, VM-aware
Advanced path, Perf trending, FCoE
• Fabric Manager  DCNM-SAN Essentials
• Fabric Manager Server  DCNM-SAN Advanced
DCNM (converged)
One SW package
DCNM-LAN Free. Nexus 7K – basic
Essentials Nexus 1/2/4/5K – All features
DCNM-LAN DCNM-LAN $$. Nexus 7K – All features
Advanced Nexus 1/2/4/5K – All features
47

48. 零壹解決方案體驗日
48

49. 49

50. Demo Topology
10G Production Recovery /Test/Dev
FC
1G
Site Recovery Site Recovery
vCenter Server vCenter Server
Manager Manager
VMware vSphere VMware vSphere
vPC
vPC vPC
SnapVault SnapMirror 50

51. Q & A , 注意事項
51

52. Q & A , 注意事項
 Virtual Interface Card (P81E)能否安裝在它牌伺服器上使用VM-FEX功能?
Ans： P81E可以裝在它牌伺服器，但其功能僅是傳統CNA Card，不能使
用VM-FEX功能.
 Adapter-FEX & VM-FEX功能僅能在Nexus 5500上使用，目前VM-FEX
License免費～
 Nexus5K & 7K若要整合SAN的環境，需要加買Storage License，
License是8埠為一組的計算方式
 一台N5K最多可以接多少台N2K?
Ans： L3 Mode  8台 ; L2 Mode  24台
 一台N7K最多可以接多少台N2K?
Ans： Sup1  32台 ; Sup2  32台 ; Sup2E  48台
52

53. Q & A , 注意事項
 N7K VDC功能 , 模組分配使用上的
限制.
M1-F1-F2 Mix
M1-F1 Mix VDC F2 Only
F2 Only VDC
Chassis VDC
53

54. Q & A , 注意事項
 N7K Line Card功能上的差異.
MPLS OTV LISP
Multicast
Features Set
Classic Layer 2 QoS Feature
Feature Set Set
FabricPath FCoE
Classic Layer 3 Virtual Device
Feature Set Context
Security
Features Set
Common
Advanced Features
Baseline Features
54

55. Q & A , 注意事項
 N7K 硬體效能比較表.
Nexus Nexus Nexus
7009 7010 7018
Forwarding
8.8 9.9* 18.7*
Capacity (Tbps)
Packets per Second
420 480 960
(Mpps)
10/100/1000
336 384 768
ports/system
GE SFP
336 384 768
ports/system
10 GE
ports/system** 336 384 768
* Based on Fab2s
** Based on LCs available at FCS 55

56. Q & A , 注意事項
Advanced
FM Federation
DCNM License比較表. Performance Manager
Multiple Session View/Open
Virtual Device Context Multiple Fabric View/Open
Advanced 802.1X Fabric Report Generation &
GLBP, Object Tracking, Key navigation
Chain
HSRP FCIP (separate license req’d)
Configuration Change DHCP Snooping Essentials DMM (separate license req’d)
DHCP Snooping SME (separate license req’d)
Control (archive, roll-back
Dynanic ARP Inspection
Configuration Change Dynamic ARP Inspection IOA (separate license req’d)
and differentiation) IP Source Guard
Control (archive, roll-back IP Source Guard Secure Erase (separate license
OS Image Management Port Security
Tunnel Interface
and differentiation) Port Security Essentials
req’d)
OS Image Management Tunnel Interface
Essentials Port / PortChannel
Discovery & Inventory
Virtual
Backup & Restore
PortChannel Discovery & Inventory Port / PortChannel RBAC
LACP L1 & L2 Topology Map Virtual
Discovery & Inventory GUI Java Desktop
VLAN 802.1q / Configuration Validation PortChannel
L1 & L2 Topology Map Unified Management
PVLAN Fault Management LACP
Configuration Validation (FCoE)
STP (MST, RPVST) Traffic Statistics Reports VLAN 802.1q /
Fault Management Fabric-wide configuration
ACL (Mac, IP, Backup & Restore PVLAN
Traffic Statistics Reports Fabric-wide visualization
VLAN) RBAC STP (MST, RPVST)
Backup & Restore & topology
Traffic Storm GUI Java Desktop ACL (Mac, IP,
RBAC Fabric Monitoring
Control Web Services & Java API VLAN)
GUI Java Desktop SMI-S/ Web Services API
AAA AAA
Web Services & Java API
Module
Tempeature
DCNM-SAN SPAN
DCNM-LAN Nexus 7K Hw Res Utilization DCNM-LAN Nexus 5K/2K Nexus 7K/5K/MDS
w/ TCAM statistics
SPAN
56

57. Q & A , 注意事項
Cisco Nexus 1000V Architecture
Server 1 Server 2 Server 3
VM VM VM VM VM VM VM VM VM VM VM VM
#1 #2 #3 #4 #5 #6 #7 #8 #9 #10 #11 #12
veth3 veth4 veth5 veth6 veth7 veth8 veth18 veth23 veth31 veth32 veth32 veth33
VEM
VMware vSwitch VMware vSwitch
VEM
Nexus 1000V DVS VMware vSwitch
VEM
eth1/1 eth1/2 eth2/1 eth2/2 eth3/1 eth3/2
VMW ESX VMW ESX VMW ESX
Virtual Supervisor Module
(VSM)
Virtual Ethernet Module (VEM)
 Virtual or Physical appliance
 Enables advanced networking running NX-OS (supports HA)
capability on the hypervisor
 Performs management,
 Provides each VM with dedicated monitoring, & configuration
―switch port‖
 Tight integration with VMware
 Collection of VEMs = 1 DVS Virtual Center
Nexus 1000V
Virtual Center 57
VSM

58. 58