SlideShare a Scribd company logo
1 of 171
CCIE Routing and Switching Written Exam
Version 5.0
Session Objectives
• Provide a refresh of QoS and Queuing Basics
• Understand the basic hardware architecture for the Nexus Platforms
• Provide a detailed understanding of QoS on Nexus platforms
• Examine real-world configuration examples
Session Non-Objectives
• Data Center QoS Methodology
• Nexus hardware architecture deep-dive
• Application Centric Infrastructure (ACI) QOS
Related Sessions
Session Id Session Name
BRKARC-3470 Cisco Nexus 7000/7700 Switch Architecture
BRKARC-3452 Cisco Nexus 5600 and 6000 Architecture
BRKDCT-1980 Advanced Analytics in Nexus Switches
BRKRST-2509 Mastering Data Center QoS
Agenda
• Introduction
• QoS and Queuing Basics
• QoS Implementation on Nexus
• Nexus 7000/7700 QoS
• Nexus 5600/6000 QoS
• Nexus 2000 QoS
• Real World Configuration Examples
• Conclusion
Introduction
http://www.testbells.com/400-101.html
http://www.testbells.com/400-101.html
Congestion Happens Everyday!
http://www.testbells.com/400-101.html
Why QoS in the Data Center?
10
Assign
Color to Traffic
Maximize
Throughput
Manage
Congestion
Maximize Throughput and Manage Congestion!
Agenda
• Introduction
• QoS and Queuing Basics
• QoS Implementation on Nexus
• Nexus 7000/7700 QoS
• Nexus 5600/6000 QoS
• Nexus 2000 QoS
• Real World Configuration Examples
• Conclusion
QoS and Queuing Basics
The QoS Toolset
13
Classification
Identify and
Split Traffic
into Different
Classes
Queuing &
Scheduling
Prioritize,
Protect and
Isolate Traffic
Based on
Markings
Marking
Mark Traffic
According to
Behavior and
Business
Policies
Policing
Discard
Misbehaving
Traffic to Maintain
Network Integrity
Shaping
Control
Bursts and
Conform
Traffic
22nd Anniversary
Traffic Management Tools
• Classification
• Traffic Categorization
• Marking
• Traffic Re-categorization
• Policing
• Limit misbehaving flows
Classification and Marking – Two sides of a coin
15
Mad Max (1979)
HTTPVoIP
email
Videop2p
App1
vmotion
mgmtlync
backup
Before:
Uncontrolled Bandwidth
VoIP/Lync
Email/HTTP
SAP
Backup
After:
Controlled Bandwidth
• Identify traffic
• DSCP
• CoS
• ACLs
• IP PREC
• Remap Traffic
• Like to Like (i.e CoS to CoS)
• Like to Unlike (i.e DSCP to COS)
• Needs mapping tables
• Also called Mutation
Policing – limit misbehaving traffic
16
Mad Max (1979)
• Single rate Two Color Policer
• Conform Action (permit)
• Exceed Action (drop)
Tokens
Burst
Limit
Conforming
Traffic
Excess Traffic
• Two rate Three Color Policer
• Conform Action (permit)
• Exceed Action (markdown)
• Violate Action (drop)
Congestion Management Tools
• Buffering
• Storing packets in memory
• Queuing
• Buffering packets according to traffic class
• Scheduling
• Order of transmission of buffered packets
• Shaping
• Smooth bursty traffic
Buffering – Why do we need it?
• Speed Mismatch
• Client to WAN to Server
18
• Many to One Conversations
• Client to Server
• Server to Storage
• Aggregation Points
1 GE
1 GE
1 GE
1 GE
10 GE10 GE
http://www.testbells.com/400-101.html
Scheduling – Who goes first
• Defines Order of transmission
• The Priority-Queue always serviced first
• Normal Queues serviced only after Priority Queue empty
• Different Scheduling algorithms for normal queues
19
http://www.testbells.com/400-101.html
Common Scheduling Algorithms
• Round Robin (RR)
• Simple and Easy to implement
• Starvation-free
• Weighted Round Robin (WRR)
• Serves n packets per non-empty
queue
• Assumes a mean packet size
• Deficit Weighted Round Robin
– Variable sized packets
– Uses a deficit counter
• Shaped Round Robin
– More even distributed ordering
– Weighted interleaving of flows
4 Class Queuing Model example
Class CoS Queues
Priority 5-7 PQ
No-Drop 3, 4 Q2
Better than Best-Effort 2 Q1
Best-Effort 0, 1 Default-Q
8 Class Queuing Model
Class DSCP Queues
Priority CS6 (CS7)
PQ
Platinum EF
Gold AF41 Q7
Silver CS4 Q6
No-Drop CoS3 Q5
Bronze AF21 Q4
Management
CS2 Q3
Scavenger AF11 Q2
Bulk Data CS1 Q1
Best-Effort 0 Default-Q
• Matches often a Campus QoS
concept
• No-Drop still with CoS3 (DSCP 24-
30 are “unusable”)
• Valid but most complex
Classification to Marking
implementation as per regards to
No-Drop
Congestion Avoidance Tools
• Tail Drop (TD)
• Drop packets at tail of the queue
• Single threshold per queue
• Weighted Random Early Drop (WRED)
• One or more thresholds per queue
• Threshold associated with DSCP or COS
Putting it all together!
24
Egress Port
PQ1
Q2
Q3
Q-Default
Scheduler
DWRR
Drop Threshold 4
Drop Threshold 3
Drop Threshold 2
Drop Threshold 1
Normal Queue
Packet is placed in the Egress
Queue according to CoS/DSCP
value.
1
Normal Queues have
Threshold and drop
packet accordingly
4
Priority Queue
always served first
2
Normal Queues
served after PQ is
empty according to
Scheduler
3
data
L2
CoS [3]
L3
DSCP [24]
COS Queue
5, 6, 7 PQ1
3, 4 Q3
2 Q2
0, 1 Q-Default
Congestion could result in…..
25
Head Line Blockingof
Head of Line Blocking
What is the Problem?
26
No Congestion
Red Cars
blocked!
Head of Line Blocking
Solution – Create Separate Lanes but…
27
Cars turned
back
Stadium
Full
Head of Line Blocking
Solution – Have an arbiter
28
Supermarket
Not Full
Stadium
Full
Head of Line Blocking
What is the Problem?
29
Ingress Module Egress Module
Ingress Module Egress Module
Ingress Module Egress Module
Crossbar
Fabric
buffer
Virtual Output Queues
Avoid Head of Line Blocking
30
Ingress Module Egress Module
Ingress Module Egress Module
Ingress Module Egress Module
Crossbar
Fabric
Ingress
VOQ
Virtual Output Queues
Avoid Head of Line Blocking
31
Ingress Module Egress Module
Ingress Module Egress Module
Ingress Module Egress Module
Crossbar
Fabric
Ingress
VOQ
buffer
Agenda
• Introduction
• QoS and Queuing Basics
• QoS Implementation on Nexus
• Nexus 7000/7700 QoS
• Nexus 5600/6000 QoS
• Nexus 2000 QoS
• Real World Configuration Examples
• Conclusion
QoS Implementation on Nexus
3 Block Construct
Nexus uses Modular QOS CLI (MQC)
34
What Traffic do we care about?
• DSCP
• CoS
• IPPREC
• ACLs
Class-Map
Where do I apply this policy?
• System Wide
• Vlan
• Interface (in/out)
• Port-channels
Service-Policy
What action do I take on these
classes?
• Policing
• Marking
• Scheduling
Policy-Map
New QoS Capabilities
Priority Flow Control (802.1Qbb)
• Enables Lossless Ethernet using per
COS pause
• During congestion, no-drop COS is
paused
• Primarily for FCoE (COS 3)
35
New QoS Capabilities
• DCBXP (802.1Qaz)
• LLDP with new TLV Values
• Negotiates capabilities (like PFC) with other
devices
• ECN (Explicit Congestion Notification)
• Congestion Notification without dropping
packets
• Uses two LSB bits in DiffServ field in IP header
36
DiffServ Field Values
0x00 – Non ECN Capable
0x10 – ECN Capable Transport (0)
0x01 – ECN Capable Transport (1)
0x11- Congestion Encountered
Network-QoS Policy
• Should be consistent across all switches in network
• Supported on F-cards on Nexus 7x00 and Nexus 5x00,6000,9000
• Applied on the system-qos target in admin (or default) vdc
• Configures the following
• Pause Behavior (PFC)
• MTU (per VL)
• Congestion Control (TD or WRED)
37
Nexus(config)# system qos
Nexus(config-sys-qos)# service-policy type network-
qos my_template
Three Different Types
38
Network-QoS
•Congestion-Control
•Pause / MTU per VL
QoS
•Marking
•Policing
•Mutation
Queuing
•Buffering
•Queuing
•Scheduling
Policy-map
QoS
•CoS
•DSCP
•PREC
•ACLs
Queuing
•CoS
•DSCP
Class-map Service-policy
QoS
•Interfaces
•Vlans
•Port-channel
•System-qos
Queuing
•Interfaces
•Port-channels
•System-qos
Network-QoS
•System-qos
Network-QoS
•CoS
•Protocol (fcoe)
VLAN based QoS Policy attachment
• VLAN based QoS Policy is
configured in VLAN Database
• No SVI (aka L3 VLAN Interface)
required
39
Nexus(config)# vlan configuration <vlan-id>
Nexus(config-vlan)# service-policy input myPolicy
Routed Port
Access Port
802.1q Trunk
Routed Port
Access Port
802.1q Trunk
VLAN
VLAN
QoS
Polcies
Service Policy
applied to the
VLAN Database
Interface based QoS Policy attachment
• Interface based QoS Policy takes
precedence over VLAN
• Can also be attached to port-
channel and applies to all member-
ports
• No Egress QoS policies on L2 ports!
40
Nexus(config)# interface ethernet 1/1
Nexus(config-if)# service-policy input myPolicy
Routed Port
Access Port
802.1q Trunk
Routed Port
Port-channel
QoS
Policies
Service policy
applied to the
switchport
Service Policy
applied to the
Switchport …
… or the
Routed Port
… or a port-
channel
Interface based Queuing Policy attachment
• Interface based QoS Policy takes
precedence over VLAN
• Interface based QoS Policy is
configured under the respective
Interface
• Queuing Policy can be attached to
port-channel also
41
Nexus(config)# interface ethernet 1/1
Nexus(config-if)# service-policy input myPolicy
Routed Port
Access Port
802.1q Trunk
Routed Port
QoS
Policies
Service policy
applied to the
switchport
Service Policy
applied to the
Switchport …
… or the
Routed Port
… or a port-
channel
Port-Channel
To Trust or Not To Trust?
• Data Centre architecture provides a new
set of trust boundaries
• Virtual Switch extends the trust
boundary into the Hypervisor
• Nexus Switches always trust CoS and
DSCP
42
Agenda
• Introduction
• QoS and Queuing Basics
• QoS Implementation on Nexus
• Nexus 7000/7700 QoS
• Nexus 5600/6000 QoS
• Nexus 2000 QoS
• Real World Configuration Examples
• Conclusion
Nexus 7000/7700 QoS
Nexus 7000 / 7700 I/O Module Families
M1 1G and 10G
M2 10G / 40G / 100G
F1 10G F2 10G
F2E 10G F3 40G
F2E 10G
F3 10G / 40G / 100G
12 X 10G MAC / LinkSec
Forwarding
Engine
VOQs
Fabric 2 ASIC
To Fabric Modules
Replication
Engine
Replication
Engine
Front Panel Ports
LC
CPU
EOBC
VOQs
1 2 3 4 5 6 7 8 9 10 11 12
12 X 10G MAC / LinkSec
Forwarding
Engine
VOQs
Replication
Engine
Replication
Engine
VOQs
242322212019181716151413
To Central Arbiters
Arbitration
Aggregator
…
M2 I/O Module Architecture
46
BRKARC-3470
Cisco Nexus 7000 / 7700 Switch Architecture
Ingress Module Egress ModuleCrossbar
Fabric
M2 I/O QoS Packet-Flow (10G)
47
Ingress VoQ-ASIC
1p3q1t
1 2 3 4 VOQ
Ingress port-ASIC
Ingress1 2 3 4 5 6 7 8
8q2t
Egress port-ASIC
Egress
1p7q4t
1 2 3 4 5 6 7 8
Egress VoQ-ASIC
Egress
FIFO
1
Arbiter
8
3
8
1
Forwarding
Engine
CoS to Queue-Mapping
>Policy Type “queuing”
(Scheduling, Buffering)
1
Default CoS-to-Queue map:
CoS [2] to Default-Q (8)
2
>Policy Type “qos”
(Mutation, Classification,
Marking, Policing)
3
VoQ gets assigned
based on Dest +
CoS value
4
Credit Grant for
Fabric Access
5
Traffic gets
forwarded over
Fabric
6
Return Credit
to Pool
8
Traffic gets
Received on
Egress VoQ
7
CoS to Queue-Mapping
>Policy Type “queuing”
(Scheduling, Buffering)
9
Default CoS-to-Queue map:
CoS [2] to Default-Q (8)
10
data
L2
CoS [2]
L3
DSCP [24]
data
L2
CoS [2]
L3
DSCP [24]
Ingress Module Egress ModuleCrossbar
Fabric
M2 I/O QoS Packet-Flow (40G/100G)
48
Ingress VoQ-ASIC
1p3q1t
1 2 3 4 VOQ
Ingress port-ASIC
Ingress1 2 3 4 5 6 7 8
8q2t
Egress port-ASIC
Egress
1p7q4t
1 2 3 4 5 6 7 8
Egress VoQ-ASIC
Egress
FIFO
1
Arbiter
8
3
8
1
Forwarding
Engine
CoS to Queue-Mapping
>Policy Type “queuing”
(Scheduling, Buffering)
1
Default CoS-to-Queue map:
CoS [2] to Default-Q (8)
2
>Policy Type “qos”
(Mutation, Classification,
Marking, Policing)
3
VQI gets assigned
based on 5-Tuple
flow information
41
Credit Grant for
Fabric Access
5
Traffic gets
forwarded over
Fabric
6
Return Credit
to Pool
8
Traffic gets
Received on
Egress VoQ
7
CoS to Queue-Mapping
>Policy Type “queuing”
(Scheduling, Buffering)
9
Default CoS-to-Queue map:
CoS [2] to Default-Q (8)
10
VoQ gets assigned
based on VQI + CoS
42
data
L2
CoS [2]
L3
DSCP [24]
data
L2
CoS [2]
L3
DSCP [24]
M2 I/O Module Buffering Capacity
M2 Module Ingress Queue Structure Ingress Port Buffer Ingress VOQ Buffer
24-port 10G
N7K-M224XP-23L
8q2t 5.2MB / port 4.5MB / port
6-port 40G
N7K-M206FQ-23L
8q2t 20.8MB / port 18MB / port
2-port 100G
N7K-M202CF-22L
8q2t 62.8MB / port 54MB / port
M2 Module VOQ Structure Egress VOQ Buffer
(Credited)
Egress VOQ Buffer
(Uncredited)
Egress Queue
Structure
Egress Port
Buffer
24-port 10G
N7K-M224XP-23L
1p4q 295KB / port 512KB / 6 ports 1p7q4t 5MB / port
6-port 40G
N7K-M206FQ-23L
1p4q 1.2MB / port 1MB / 3 ports 1p7q4t 20.7MB / port
2-port 100G
N7K-M202CF-22L
1p4q 3MB / port 1MB / port 1p7q4t 30.2MB / port
Ingress
Egress
8 X 10G
SoC 1
Nexus 7700 F3 48-Port 1G/10G Module Architecture
To Fabric Modules
FSA
CPU
EOBC To Central Arbiters
Arbitration
Aggregator
8 X 10G
SoC 2
8 X 10G
SoC 3
8 X 10G
SoC 4
8 X 10G
SoC 5
8 X 10G
SoC 6
55Gbps
6 X 110Gbps
Fabric ASIC Fabric ASIC
6 X 110Gbps
55Gbps
LC Inband
1G per SOC …x 6
1
Front Panel Ports (SFP/SFP+)
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
LinkSec-capable
to LC
CPU
Nexus 7000/ 7700 F2 48-Port 1G/10G Module
Architecture
51
4 X 10G
SoC
Front Panel Ports
To Fabric Modules
Fabric 2
2 4
LC
CPU
EOBC
To Central Arbiters
Arbitration
Aggregator …
4 X 10G
SoC
6 8
4 X 10G
SoC
10 12
4 X 10G
SoC
14 16
4 X 10G
SoC
18 20
4 X 10G
SoC
22 24
4 X 10G
SoC
26 28
4 X 10G
SoC
30 32
4 X 10G
SoC
34 36
4 X 10G
SoC
38 40
4 X 10G
SoC
42 44
4 X 10G
SoC
46 48
1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47
LinkSec-capable (F2E fiber only)
LinkSec-capable (F2E copper only)
2 X 40G
SoC 1
Nexus 7700 24-Port 40G Module Architecture
1
Front Panel Ports (QSFP+)
To Fabric Modules
FSA
CPU
EOBC To Central Arbiters
Arbitration
Aggregator
2 X 40G
SoC 2
2 X 40G
SoC 3
2 X 40G
SoC 4
2 X 40G
SoC 5
2 X 40G
SoC 6
2 X 40G
SoC 7
2 X 40G
SoC 8
2 X 40G
SoC 9
2 X 40G
SoC 10
2 X 40G
SoC 11
2 X 40G
SoC 12
55Gbps
6 X 110Gbps
Fabric ASIC Fabric ASIC
6 X 110Gbps
55Gbps
LC Inband
2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
1G switch
6 x 1G
1G per SOC…
…x 12
Nexus 7700 12-Port 100G Module Architecture
Front Panel Ports (CPAK)
To Fabric Modules To Central Arbiters
Arbitration
Aggregator
1 X 100G
SoC 2
2
1 X 100G
SoC 3
3
1 X 100G
SoC 4
4
1 X 100G
SoC 5
5
1 X 100G
SoC 6
6
1 X 100G
SoC 7
1 X 100G
SoC 8
1 X 100G
SoC 9
1 X 100G
SoC 10
1 X 100G
SoC 11
55Gbps
6 X 110Gbps
Fabric ASIC Fabric ASIC
6 X 110Gbps
7 8 9 10 11
55Gbps
1 X 100G
SoC 12
12
1 X 100G
SoC 1
1
FSA
CPU
EOBC
LC Inband
1G switch
6 x 1G
1G per SOC…
…x 12
Decision Engine
Ingress Parser
F3 SoC
Virtual
Queuing
Ingress
Buffer
Port Logic
Egress Buffer
F3 SoC Architecture
Egress Parser
Layer 2 Lookups
Layer 3 Lookups
Classification
Marking / Policing
Front Panel Ports
8x10G
2x40G
1x100G
To Central
Arbiter
To Local
Fabric
From Local
Fabric
Egress SOCIngress SOC
Ingress Buffer
F3 10G Buffering Model
FABRIC
Egress Buffer
VQI 8
10G Port 1
10G Port 8
DWRR
SP
10G Port 1
10G Port 8
8 priority
levels
1.5MB
4 ingress queues
per port
Virtual Queuing
8K VOQs
(1K Dest + 8 priority levels)
Ingress Buffer – Manages congestion toward
egress destinations
Buffering / queuing
INGRESS QUEUING POLICIES
Egress Scheduling
Central Arbiter
Virtual Queuing / Egress Buffer – Receives
frames from fabric; Schedules frame transmission
Scheduling
EGRESS QUEUING POLICIES
…
VQI 1
DWRR
SP
…
1.5MB
Egress SOCIngress SOC
Ingress Buffer
F3 40G Buffering Model
FABRIC
Egress Buffer
VQI 1
VQI 2
40G Port 1
40G Port 2
DWRR
SP
DWRR
SP
40G Port 1
40G Port 2
8 priority
levels4 ingress queues
per port
Virtual Queuing
8K VOQs
(1K VQIs + 8 priority levels)
Ingress Buffer – Manages congestion toward
egress destinations (VQIs)
Buffering / queuing
INGRESS QUEUING POLICIES
Egress Scheduling
Central Arbiter
Virtual Queuing / Egress Buffer – Receives
frames from fabric; Schedules frame transmission
Scheduling
EGRESS QUEUING POLICIES
6MB
6MB
Egress SOCIngress SOC
Ingress Buffer
F3 100G Buffering Model
FABRIC
Egress Buffer
VQI 1 100G Port 1
DWRR
SP
100G Port 1
8 priority
levels
12MB
4 ingress queues
per port
Virtual Queuing
8K VOQs
(1K VQIs + 8 priority levels)
Ingress Buffer – Manages congestion toward
egress destinations (VQIs)
Buffering / queuing
INGRESS QUEUING POLICIES
Egress Scheduling
Central Arbiter
Virtual Queuing / Egress Buffer – Receives
frames from fabric; Schedules frame transmission
Scheduling
EGRESS QUEUING POLICIES
Decision Engine
Ingress Parser
CL TCAM
F2E/F3 SoC
Port Logic
Virtual
Queuing
Ingress
Buffer
Layer 2 Lookups
Layer 3 Lookups
Classification
Marking / Policing
F2E/ F3 SoC
Port Logic
Egress Buffer
Module 2
e2/1
Fabric ASIC
Fabric Module 1
Fabric ASIC
Supervisor Engine
Central Arbiter
Module 1
e1/1
Fabric Module 2
Fabric ASIC
Fabric Module 3
Fabric ASIC
Fabric Module 4
Fabric ASIC
Fabric Module 5
Fabric ASIC
Fabric ASIC
e1/1
e2/1
e2/1
DWRRSP
F2E/F3 QoS Packet Walk
PKT HDR
HDRPKT
Req
Credit
Credit
PKT HDR
Receive packet
from wire
Ingress packet
parsing
Packet headers
sent to DE
Payload queued in
port buffer based on
COS / DSCP
Buffer credit
granted
Check
VQ drop
thresholds
All L2 + L3 lookups /
Ingress + egress QoS classification /
Ingress + egress marking and policing
CL TCAM contains
QoS classification
rules
Final lookup result:
destination + priority
Transmit
to fabric
Receive
from fabric
Schedule
and transmit
on wire
Buffer on egress
based on dest+ priority
Queue packet
descriptor in VOQ
(dest + priority)
Return buffer credit
(dest + priority)
Request buffer
credit for dest +
priority
Ingress Queuing – Logical View
59
CoS 0-4
(Q-Default)
CoS 5-7
(Q1)
8e Template
CoS 3
(Q4)
CoS 5-7
(Q1)
7e Template
CoS 0,1
(Q-Default)
CoS 2,4
(Q3)
CoS 0-2
(Q-Default)
CoS 5-7
(Q1)
6e Template
CoS 4
(Q3)
CoS 3
(Q4)
CoS 0
(Q-Default)
CoS 5-7
(Q1)
4e Template
CoS 4
(Q3)
CoS 1-3
(Q4)
High (Pause)
Threshold
Low (Resume)
Threshold
8e-4q4q Template
CoS 3-4
(Q3)
CoS 5-7
(Q1)
CoS 2
(Q4)
CoS 0-1
(Q-Default)
Egress Queuing – Logical View
60
EgressPort
Q2
PQ1
Q3
Q-Def
default-4q-7e-out-policy
Q-Def.
(0,1)
PQ1
(5,6,7)
Q3
(2,4)
Q2
(3)
DWRR
Priority
DWRR
50% 50%
EgressPort
PQ2(H)
PQ3(L)
PQ1
Q-Def
default-4q-6e-out-policy
Q-Def.
(0-2)
PQ3
(3)
PQ1
(5,6,7)
PQ2.
(4)
DWRR
PrioPrio
DWRR
100%
EgressPort
PQ1(H)
Q-Def
PQ2(L)
Q3
default-4q-4e-out-policy
Q3
(1,2,3)
Q-Def.
(0)
PQ2
(4)
PQ1
(5,6,7)
DWRR DWRR
PrioPrio
DWRR
100% 100%
red indicates no-drop
EgressPort
PQ1
Q2
Q3
Q-Def
DWRR
default-4q-8e-out-policy
Q-Def.
(0,1)
Q2
(3,4)
Q3
(2)
PQ1
(5,6,7)
Priority
33%33%33%
EgressPort
PQ1
Q2
Q3
Q-Def
DWRR
default-4q4q-8e-out-policy
Q-Def.
(0,1)
Q2
(3,4)
Q3
(2)
PQ1
(5,6,7)
Priority
33%33%33%
F I/O Module Buffering Capacity
Module Total VOQ Buffer
Per Module
Ingress Queue Structure Ingress VOQ Buffer
48-port 10G F2E
N77-F248XP-23E
72MB 4q1t 1.5MB / port
F3 48-port 10G
N77-F348XP-23
72MB 4q1t 1.5MB / port
F3 24-port 40G
N77-F324FQ-25
144MB 4q1t 6MB / port
F3 12-port 100G
N77-F312CK-26
144MB 4q1t 12MB / port
Module Egress VOQ Structure Egress VOQ Buffer (Credited) Egress VOQ Buffer (Uncredited)
48-port 10G F2E
N77-F248XP-23E
1p7q1t 295KB / port 256KB / 4 ports
F3 48-port 10G
N77-F348XP-23
1p7q1t 295KB / port 512KB / 8 ports
F3 24-port 40G
N77-F324FQ-25
1p7q1t 1.1MB / port 512KB / 2 ports
F3 12-port 100G
N77-F312CK-26
1p7q1t 2.2MB / port 512KB / 1 port
Ingress
Egress
N7k# show policy-map type queuing | beg default 4q-8e
policy-map type queuing default-4q-8e-in-policy
class type queuing 2q4t-8e-in-q1
queue-limit percent 10
bandwidth percent 50
class type queuing 2q4t-8e-in-q-default
queue-limit percent 90
bandwidth percent 50
policy-map type queuing default-4q-8e-out-policy
class type queuing 1p3q1t-8e-out-pq1
priority level 1
class type queuing 1p3q1t-8e-out-q2
bandwidth remaining percent 33
class type queuing 1p3q1t-8e-out-q3
bandwidth remaining percent 33
class type queuing 1p3q1t-8e-out-q-default
bandwidth remaining percent 33
Network-QoS and Default Queuing (global)
• default-nq-8e-policy is default
network-qos policy and attached
to system qos in Admin-/Default-
VDC
• The system queuing policy applied
by default can be overridden on a
per port basis.
62
Note: show policy-map system does display similar output
2 ingress queues
with buffer ratio
1:9 and DWRR
wieights 1:1
4 egress queues
with one priority
queue and DWRR
wieights 1:1:1
CoS or DSCP to Queue Mapping
• Default CoS to Queue Mapping for Nexus 7000/7700 (F- and M-Series I/O
Module)
• Ingress: CoS to Queue
• Egress: CoS to Queue
• DSCP to Queue Mapping for Nexus 7000/7700 (F- and M-Series I/O Module)
• Ingress: DSCP to Queue
• Egress: CoS to Queue
• Global Configuration (Admin/Default VDC) required to enable DSCP to Queue
Mapping:
63
N7k(config)# hardware qos dscp-to-queue ingress module type {all | f-series | m-series}
Changing the Default Trust
64
802.1q Trunk /
Access Port
Ingress
Queues
Egress
Queues
routed/bridged
CoS
CoS
q-1
q-n
Note: CoS is used for egress
queue selection, even if the
egress interface does NOT
carry CoS in the frame
q-default
Set CoS 0
(will only set CoS to 0) data
L2
CoS [0]
L3
DSCP [24]
Set DSCP 0
(will set DSCP + CoS to 0)
L3
DSCP [0]
data
L2
CoS [0]
L3
DSCP [0]
data
L2
CoS [2]
L3
DSCP [24]
802.1q Trunk
Changing The Default Trust (M-Series I/O Module)
• You can make an interface untrusted (CoS & DSCP)
• CoS for bridged traffic
• DSCP for routed traffic
• You need two Policies
• A "type queuing" policy
to set the CoS to 0
• A "type qos" policy
to set the DSCP to 0
 Set DSCP will set the CoS
value for Bridged traffic as well.
65
policy-map type queuing Reset-CoS
class type queuing 8q2t-in-q-default
set cos 0
bandwidth percent 100
queue-limit percent 100
!
policy-map type qos Reset-DSCP
class class-default
set dscp 0
!
! Tie to an interface:
interface Ethernet1/1
service-policy type queuing input Reset-CoS
service-policy type qos input Reset-DSCP
Changing The Default Trust (F-Series I/O Module)
66
qos copy policy-map type queuing default-4q-8e-in-policy prefix UNTRUSTED-
!
policy-map type queuing untrusted-4q-8e-in
class type queuing 2q4t-8e-in-q1
queue-limit percent 1
class type queuing 2q4t-8e-in-q-default
queue-limit percent 99
set cos 0
!
policy-map type qos UNTRUSTED
class class-default
set dscp 0
!
! Tie to an interface:
interface Ethernet1/1
service-policy type queuing input untrusted-4q-8e-in
service-policy type qos input UNTRUSTED
Nexus 7000 QoS Golden Rules
• QoS is enabled by default and cannot be disabled
• CoS and DSCP are TRUSTED by default
• Default Queuing and QoS policies are applied to all physical interfaces across
all VDCs
• For bridged traffic, CoS is preserved, DSCP is unmodified
• For routed traffic, DSCP is copied to CoS (first 3 bits)
• Ex: DSCP 40 (b101000) becomes CoS 5 (b101)
Agenda
• Introduction
• QoS and Queuing Basics
• QoS Implementation on Nexus
• Nexus 7000/7700 QoS
• Nexus 5600/6000 QoS
• Nexus 2000 QoS
• Real World Configuration Examples
• Conclusion
Nexus 5600/6000 QoS
Cisco Nexus 5600/6000 Overview
70
High Performance High Scalability Feature-Rich Visibility and Analytics
• Line rate L2 and L3
• 1-us port-to-port
latency
• 25-MB buffer per port
ASIC
• 10 GE and true 40 GE
• Up to 224,000 MAC
• Up to 128,000 ARP
• L2 and L3 features
• vPC and FabricPath
• FC and FCOE
• VXLAN Bridging and
Routing
• Line-rate SPAN
• Sampled NetFlow
• Micro-burst monitoring
• Latency monitoring
Egress
VOQ buffer
Ingress
VOQ buffer
Ingress Module Egress Module
Ingress Module
Ingress Module
Crossbar
Fabric
Ingress Buffering Model
Nexus 5600/6000 compared to Nexus 7000 F-Series I/O Module
71
Ingress VOQ buffer – Manages congestion toward egress destinations
Egress VOQ buffer – Receives frames from fabric; also buffers multi-destination frames
Egress
VOQ buffer
Ingress
VOQ buffer
Nexus 7000
F-Series I/O Module
Key Concepts – Common Points
• Nexus 5000/6000 & Nexus 7000 F-Series I/O Modules share the Ingress Buffer
Model
• Ingress buffering and queuing occur at VOQ of each ingress port
• Egress scheduling enforced by egress port
• No Egress QOS Policies
Nexus 7000 compared to Nexus 5000/6000 QoS
72
Cisco Nexus 5600/6000 QoS Features
• Traffic classification
‒ DSCP, CoS, IP Precedence and ACL
• Packet marking
‒ DSCP, CoS, and ECN
• Strict Priority Queuing and DWRR
‒ Priority Flow Control
‒ DCBX 802.1Qaz
• Ingress policing (No egress policing)
‒ 4096 policers per ASIC
• Flexible buffer management
Unified Ports
Nexus 5672UP Architecture Overview
UPC 1
24xSFP+
Fabric
6xQSFP+ CPU
Supervisor
UPC-0UPC 2 UPC 3 UPC 4 UPC 5 UPC 6
24xSFP+
Slot 1 Slot 2
UPC 1
24x
SFP+
Fabric
2x
QSFP+
CPU
Supervisor
Nexus 56128PQ Internal Architecture
UPC 2 UPC 3 UPC 4 UPC 5 UPC 6
24x
SFP+
2x
QSFP+
* Changing the port
speed on UPC5 will
reload the system.
Expansion Slot 2 Expansion Slot 3
Slot 1
Packet Buffering
• 25MB packet buffer is shared by every three 40 GE ports or twelve 10 GE ports.
• Buffer is 16MB at ingress and 9MB at egress.
• Unicast packet can be buffered at both ingress and egress.
448
Gbps
224
Gbps
Ingress
UPC
Egress UPC
UnicastVOQMulticastVOQ
Unified
Crossbar
Fabric
16MB 9MB
Nexus 5600 QoS Packet Walk
Crossbar
Fabric
MAC Traffic
Classification
Ingress
Cos/DSCP
Marking
Forwarding
VoQs
(8 per egress port)
Egress Queues
Trust CoS/DSCP and
Match on COS/DSCP/ACL
Make a forwarding decision
If Buffer Usage Crosses Threshold:
• Tail drop for drop class
• Assert Pause for no-drop COS
Strict Priority +
DWRR Scheduling
MAC
Ingress UPC
Ingress
Policing
WRED/ECN
Marking
Egress
Scheduling
Egress UPC
Per-class
Buffer Usage
Monitoring
Ingress Buffer
Egress Buffer
Flexible Buffer Management
Ingress Buffer
• Shared buffer is good for burst
absorption.
• Dedicated buffer is good for predictable
performance for each port.
• On by default, no configuration needed
• Long-distance FCoE, video editing (i.e.,
AVID), Big Data, and distributed storage
Port 1
Dedicated
Port 2
Dedicated
Port 3
Dedicated
Shared Packet Buffer
SPAN Control
UPC Ingress Buffer (16MB)
WRED/ ECN Configuration
• ECN parameters are configurable only at system level.
• ECN is enabled by default along with WRED
• Packet Threshold below minimum – Transmit
• Packet Threshold between minimum and maximum – Mark ECN bits
• Packet Threshold above maximum – Drop
switch(config)# hardware random-detect min-thresh 10g 10g-min-threshold 40g 40g-min-
threshold max-thresh 10g 10g-max-threshold 40g 40g-max-threshold ecn qos-group qos-
group-number
Nexus 5600/6000 QoS Configuration Model
• Uses QOS-Groups to tie together QoS, Queuing
and Network-QoS policies
• QoS-Group has no direct relation with CoS value
• QoS-Groups defined (set) in policy-map type
qos.
• QoS-groups referenced (match) in policy type
queuing and policy-map type network-
qos
Putting it all together
class-map type qos class_foo
match cos 3-4
policy-map type qos pm1
class type qos class_foo
set qos-group 1
police cir 20 mbytes conform transmit violate drop
class type qos class-default
set qos-group 0
interface ethernet 1/1
service-policy type qos input pm1
class-map type queuing class-foo
match qos-group 1
policy-map type queuing policy-foo
class type queuing class-foo
bandwidth percent 20
class type queuing class-default
bandwidth percent 80
interface ethernet 1/3
service-policy type queuing input policy-foo
Create class-map
type qos and
match on
cos/dscp/acls
Create policy-map
type qos and set
qos-group and/or
add policing rule
Attach policy-map
type qos as input to
an interface
Attach policy-map
queuing to
interface
Create policy-map
type queuing and
create actions
Create class-map
type queuing and
match on qos-
group
Buffering and Scheduling Considerations
• Buffering is achieved via policy-map type network-qos where queue-
limit can be configured
• Scheduling is configured with policy-map type queuing where priority
& bandwidth for DWRR is defined
• Queuing Policy can be attached in both direction, ingress and egress
• Egress controls how the traffic is leaving the Switch
• Ingress controls how a attached DCBX capable Device is sending
• Queuing will be configured with policy-map type queuing and does NOT
interfere with policy-map type qos
82
N5k# show interface ethernet 1/1 capabilities | i Model|QOS
Model: N5K-C5672UP-SUP
QOS scheduling: rx-(6q1t),tx-(1p6q0t)
Buffering Capacity
Traffic Type Ingress Queue Structure 10 GE Port 40 GE Port
Control traffic (per port) 6q1t 64 KB 67 KB
Span Traffic (per Port)
6q1t
38.4 KB 154 KB
Class Default (per Port)
6q1t
100 KB 100 KB
Shared Buffer
6q1t
13.2 MB 14.7 MB
Traffic Type Egress Queue
Structure
10 GE Port 40 GE Port
Unicast
1p5q0t
363 KB
650 KB with 10GB Fabric Mode
635 KB with 40GB Fabric Mode
Multicast
1p5q0t
4.3MB 6.6 MB
Ingress
Egress
Nexus 5600/6000 QoS Golden Rules
• ECN/WRED is enabled by default and cannot be disabled
• CoS and DSCP are TRUSTED by default
• Use QoS-Groups to tie policies together
• No Egress QOS policies
Agenda
• Introduction
• QoS and Queuing Basics
• QoS Implementation on Nexus
• Nexus 7000/7700 QoS
• Nexus 5600/6000 QoS
• Nexus 2000 QoS
• Real World Configuration Examples
• Conclusion
Nexus 2000 QoS
FEX Overview
• Scalable and Extensible Fabric
• Single point of management
• Homogeneous and consistent policies
Cisco Nexus 2000 QoS Features
• Traffic classification
‒ DSCP, CoS
‒ ACL classification (FEX offload) –only on 5600/6000
• Strict Priority Queuing and DWRR
‒ Priority Flow Control
• Queue-limit Carving
Nexus Parent
FEX QoS Policies
• Support for ingress port-based QoS policies on FEX HIF ports
• Support for ingress/egress VLAN-based QoS policies on FEX VLANs
• FEX QoS policies applied at ingress module of parent switch
• No support for remarking, policing policies
FEX
Module
/Port
Module
/Port
FEX
Ingress port-
based QoS
policy
Ingress/egress
VLAN-based QoS
policy
Ingress FEX Egress FEX
Ingress Module Egress Module
Nexus Parent
FEX Module Module FEX
Ingress queue /
egress schedule
based on COS 0
Ingress FEX
(FEX 101)
Egress FEXIngress Module Egress Module
FabricPKT DSCP 0 COS 0
Ingress queue at
input port based on
COS 0
Egress schedule
based on COS 0
Ingress queue /
egress schedule
based on COS 0
1Q trunk
FEX QoS Packet Flow Example (CoS2Q)
Nexus Parent
FEX QoS Packet Flow Example (DSCP2Q)
FEX Module Module FEX
Ingress queue /
egress schedule
based on DSCP 0
Ingress FEX
(FEX 101)
Egress FEXIngress Module Egress Module
Fabric
Ingress queue at
input port based on
DSCP 0
Egress schedule
based on COS 0
Ingress queue /
egress schedule
based on DSCP 0
PKT DSCP 0 COS 0
Ingress QoS policy:
policy-map type qos marker
class ClassA
set dscp cs3
!
interface ethernet 101/1/1
service-policy type qos input marker
Nexus 7000
FEX QoS Packet Flow Example (With Ingress Marking Policy and DSCP-
to-Queue)
FEX Module Module FEX
Ingress queue /
egress schedule
based on DSCP 0
Ingress FEX
(FEX 101)
Egress FEXIngress Module Egress Module
FabricPKT DSCP 0 COS 0 PKT DSCP CS3 COS 3
Ingress queue at
input port based on
DSCP 0
Classify and remark to
DSCP CS3/COS 3 at
ingress Decision Engine
Egress schedule
based on COS 3
Ingress queue /
egress schedule
based on DSCP CS3
Ingress QoS policy:
policy-map type qos marker
class ClassA
set dscp cs3
!
interface ethernet 101/1/1
service-policy type qos input marker
Nexus 7000
FEX QoS Packet Flow Example (With Ingress Marking Policy and DSCP-
to-Queue)
FEX Module Module FEX
Ingress queue /
egress schedule
based on DSCP 0
Ingress FEX
(FEX 101)
Egress FEXIngress Module Egress Module
FabricPKT DSCP 0 COS 0 PKT DSCP CS3 COS 3
Ingress queue at
input port based on
DSCP 0
Classify and remark to
DSCP CS3/COS 3 at
ingress Decision Engine
Egress schedule
based on COS 3
Ingress queue /
egress schedule
based on DSCP CS3
FEX Policy Offload (Nexus 5600/6000 only)
• TCAM resources on a FEX to perform ACL-based classification
• The feature is disabled by default
• By default, a FEX classifies packets on CoS value
• Both system level and interface level policies are offloaded to the FEX
switch# configure terminal
fex chassis_ID
hardware card-type qos-policy-offload
FEX Queuing Policies
• FEX queuing driven implicitly by parent switch queuing configuration
• Network QoS template drives:
• Number of queues
• MTU
• Ingress queuing class-maps drive:
• BOTH ingress and egress COS/DSCP-to-queue mapping
• On Nexus 7000 with FEX + M-Series parent modules, network-qos and F-series
ingress queuing class-maps still drive FEX queuing configuration
DSCP-to-Queue on FEX
• Enabling DSCP-to-queue on parent switch enables DSCP-to-queue on FEX
• Currently active DSCP mappings pushed to FEX when enabled
• DSCP-to-queue only active in the HIF→NIF direction
• NIF→HIF direction always uses COS-to-queue mapping, based on COS transmitted by
parent switch to FEX
FEX Queue-Limit
• Provides FEX queue-limit configuration option
• Manages buffer thresholds on FEX based on platform capabilities
• Default has queue-limit disabled
• Configuration applied per-VDC (on Nexus 7000/7700)
• Different FEX models have different capabilities
Nexus 2000 QoS Golden Rules
• FEX QOS classification on COS or DSCP unless FEX offload enabled
• FEX queuing driven implicitly by parent switch queuing configuration
• No support for per-queue shaping, policing or marking
• Drop thresholds are tail-drop only, no WRED support
Agenda
• Introduction
• QoS and Queuing Basics
• QoS Implementation on Nexus
• Nexus 7000/7700 QoS
• Nexus 5600/6000 QoS
• Nexus 2000 QoS
• Real World Configuration Examples
• Conclusion
Real World Configuration
Examples
What do we want to achieve?
Company Foobar’s Business Goals
101
• Make sure no disruption in network services
• Put control traffic in priority queue
• Video/voice hosting also an business objective
• Put voice traffic in priority queue
• Dedicated bandwidth to video traffic
• Flexibility in moving applications across servers
• Dedicated bandwidth to vmotion/mobility
• Everything else best-effort
Translating to the language of QoS
102
Application CoS
Queuing
(Scheduling)
Queue-Limit
(Buffer)
Character
Best Effort 0, 1
BW remaining
50%
60%
High Volume /
Less Important
vMotion / Live
Migration
2
BW remaining
20%
10%
Medium Volume /
Important
Multimedia 3, 4
BW remaining
30%
20%
Medium Volume
Very Important
Strict Priority 5
Priority Queue 10%
Low Volume /
Important /
Delay Sensitive
Network Control 6,7
Low Volume /
Very important
Topology
103
vpc peer-link
vpc peer-link vpc peer-link vpc peer-link
Core
Nexus 7000
Nexus 5000 Nexus 5000 Nexus 5000Nexus 5000 Nexus 5000Nexus 5000
Nexus 2000
Nexus 7000
Nexus 2000 Nexus 2000 Nexus 2000Nexus 2000Nexus 2000
M2 cards facing
core and F2/F3
cards facing
access
VPC from
access to
aggregation
Host VPC,
Straight-through
FEX
Enhanced VPC
(evPC)
Straight-through
FEX, No VPC
Classification, Marking & Trust on Nexus 5000/7000
104
vpc peer-link
vpc peer-link vpc peer-link vpc peer-link
Between the
different Tiers,
all ports are
TRUSTED
Mark Traffic from
Core
(policy-map type qos)
or just TRUST
(default)
Core
Mark Traffic
from Servers
(policy-map
type qos)
or just TRUST
(default)
Classification & Marking: Nexus 7000
ip access-list ACL_QOS_LOWPRIO
10 permit …
ip access-list ACL_QOS_VMOTION
10 permit …
ip access-list ACL_QOS_MULTIMEDIA
10 permit …
ip access-list ACL_QOS_SCRICTPRIO
10 permit …
!
class-map type qos match-any CM_QOS_LOWPRIO_COS1
match access-group name ACL_QOS_LOWPRIO
!
class-map type qos match-any CM_QOS_VMOTION_COS2
match access-group name ACL_QOS_VMOTION
!
class-map type qos match-any CM_QOS_MULTIMEDIA_COS4
match access-group name ACL_QOS_MULTIMEDIA
!
class-map type qos match-any CM_QOS_STRICTPRIO_COS5
match access-group name ACL_QOS_STRICTPRIO
policy-map type qos PM_QOS_MARK_COS_IN
class CM_QOS_STRICTPRIO_COS5
set cos 5
class CM_QOS_MULTIMEDIA_COS4
set cos 4
class CM_QOS_VMOTION_COS2
set cos 2
class CM_QOS_LOWPRIO_COS1
set cos 1
!
interface Ethernet1/1
service-policy type qos input PM_QOS_MARK_COS_IN
!
vlan configuration 100
service-policy input PM_QOS_MARK_COS_IN
105
Classification & Marking: Nexus 5600/6000 (1)
ip access-list ACL_QOS_LOWPRIO
10 permit …
ip access-list ACL_QOS_VMOTION
10 permit …
ip access-list ACL_QOS_MULTIMEDIA
10 permit …
!
class-map type qos match-any CM_QOS_LOWPRIO_COS1
match access-group name ACL_QOS_LOWPRIO
!
class-map type qos match-any CM_QOS_VMOTION_COS2
match access-group name ACL_QOS_VMOTION
!
class-map type qos match-any CM_QOS_MULTIMEDIA_COS4
match access-group name ACL_QOS_MULTIMEDIA
!
class-map type qos match-any CM_QOS_STRICTPRIO_COS5
match cos 5
policy-map type qos PM_QOS_MARK_COS_IN
class CM_QOS_STRICTPRIO_COS5
set qos-group 5
class CM_QOS_MULTIMEDIA_COS4
set qos-group 4
class CM_QOS_VMOTION_COS2
set qos-group 3
class CM_QOS_LOWPRIO_COS1
set qos-group 2
!
system qos
service-policy type qos input PM_QOS_MARK_COS_IN
106
QoS-Group # is mapping between Slide 1 & Slide 2
Classification & Marking: Nexus 5500/6000 (2)
class-map type network-qos CM_N-QOS_MATCH_QG2_COS1
match qos-group 2
class-map type network-qos CM_N-QOS_MATCH_QG3_COS2
match qos-group 3
class-map type network-qos CM_N-QOS_MATCH_QG4_COS4
match qos-group 4
class-map type network-qos CM_N-QOS_MATCH_QG5_COS5
match qos-group 5
policy-map type network-qos PM_N-QOS_SYSTEM
class type network-qos CM_N-QOS_MATCH_QG2_COS1
set cos 1
class type network-qos CM_N-QOS_MATCH_QG3_COS2
set cos 2
class type network-qos CM_N-QOS_MATCH_QG4_COS4
set cos 4
class type network-qos CM_N-QOS_MATCH_QG5_COS5
set cos 5
queue-limit 20480 bytes
!
system qos
service-policy type network-qos PM_N-QOS_SYSTEM
107
QoS-Group # is mapping between Slide 1 & Slide 2
Classification & Marking (Nexus 2000)
108
vpc peer-link
vpc peer-link vpc peer-link vpc peer-link
Traffic
Classification
based on ACL
happens here!
Core
Traffic
Classification
based on CoS
happens here!
Queuing (M2-cards)
109
vpc peer-link
vpc peer-link vpc peer-link vpc peer-link
Modify CoS to
Queue mapping
in Admin-
/Default-VDC
Assign a egress policy-
map to each interface
with priority, bandwidth
and queue-limit to alter
default queuing policy
Assign ingress
policy-map to each
interface with
bandwidth and
queue-limit
Core
CoS to Queue Mapping – M2 I/O Module
Example
110
Application CoS
Queuing
(Scheduling)
Queue-Limit
(Buffer)
Queue
(8q2t / 1p7q4t)
Character
Best Effort 0, 1
BW remaining
50%
60%
8q2t-in-q-default /
1p7q4t-out-q-default
High Volume /
Less Important
vMotion / Live
Migration
2
BW remaining
20%
10%
8q2t-in-q6 /
1p7q4t-out-q6
Medium Volume /
Important
Multimedia 3, 4
BW remaining
30%
20%
8q2t-in-q2 /
1p7q4t-out-q2
Medium Volume
Very Important
Strict Priority 5
Priority Queue 10%
8q2t-in-q1 /
1p7q4t-out-pq1
Low Volume /
Important /
Delay Sensitive
Network Control 6,7
Low Volume /
Very important
CoS to Queue Mapping (on M2 cards)
Exmple (Admin- / Default-VDC)
111
Core
class-map type queuing match-any 8q2t-in-q1
match cos 5-7
class-map type queuing match-any 8q2t-in-q2
match cos 3-4
class-map type queuing match-any 8q2t-in-q6
match cos 2
class-map type queuing match-any 8q2t-in-q-default
match cos 0-1
!
class-map type queuing match-any 1p7q4t-out-pq1
match cos 5-7
class-map type queuing match-any 1p7q4t-out-q2
match cos 3-4
class-map type queuing match-any 1p7q4t-out-q6
match cos 2
class-map type queuing match-any 1p7q4t-out-q-default
match cos 0-1
Admin-
VDC
Admin-
VDC
Changes apply to ALL ports of specified type in ALL VDCs
Changes are traffic disruptive for ports of specified type
Ingress Queuing Configuration on M2 cards
Example (Payload-VDC)
112
Corepolicy-map type queuing PM_QUEUE_10G-40G-100G_IN
class type queuing 8q2t-in-q1
queue-limit 10
bandwidth remaining percent 10
class type queuing 8q2t-in-q2
queue-limit 20
bandwidth remaining percent 30
class type queuing 8q2t-in-q6
queue-limit 10
bandwidth remaining percent 10
class type queuing 8q2t-in-q-default
queue-limit percent 50
bandwidth percent 50
!
interface Ethernet1/1
service-policy type queuing input PM_QUEUE_10G-40G-100G_IN
All Policy-Map and Service-Policy are done in relevant Payload-VDC and
only affect the interface to which they get applied
Egress Queuing Configuration on M2 cards
Example (Payload-VDC)
113
Corepolicy-map type queuing PM_QUEUE_10G-40G-100G_OUT
class type queuing 1p7q4t-out-pq1
priority level 1
queue-limit percent 10
class type queuing 1p7q4t-out-q2
queue-limit percent 20
bandwidth remaining percent 30
class type queuing 1p7q4t-out-q6
queue-limit percent 10
bandwidth remaining percent 20
class type queuing 1p7q4t-out-q-default
queue-limit percent 50
bandwidth remaining percent 40
!
interface Ethernet1/1
service-policy type queuing output PM_QUEUE_10G-40G-100G_OUT
All Policy-Map and Service-Policy are done in relevant Payload-VDC and
only affect the interface to which they get applied
Network-QoS Configuration on F2/F3-Series
114
vpc peer-link
vpc peer-link vpc peer-link vpc peer-link
Use the network-
qos policy for 8e-
4q4q i.e 4 ingress
queues
Core
Network-QoS Configuration –F2/F3 cards
Example (Admin- / Default-VDC)
115
Core
system qos
service-policy type network-qos default-nq-8e-4q4q-policy
policy-map type network-qos default-nq-8e-4q4q-policy template 8e-4q4q
class type network-qos c-nq-8e-4q4q
match cos 0-7
congestion-control tail-drop
mtu 1500
Admin-
VDC
Admin-
VDC
Changes apply to ALL ports of specified type in ALL VDCs
Changes are traffic disruptive for ports of specified type
Queuing (F2/F3 cards)
116
vpc peer-link
vpc peer-link vpc peer-link vpc peer-link
Modify CoS to Queue
mapping in Admin-
/Default-VDC
Assign a ingress policy-map
for buffer allocation, no ingress
scheduling
Core
Assign a egress policy-map
to each interface with
priority, bandwidth and
queue-limit to alter default
queuing policy
CoS to Queue Mapping – F2/F3 I/O Module
Example
117
Application CoS
Queuing
(Scheduling)-
egress
Queue-Limit
(Buffer)-ingress
Queue
(Ingress/Egress)
Character
Best Effort
0,1 BW remaining
50%
50%
4q1t-8e-4q4q-in-q-default /
1p3q1t-8e-4q4q-out-q-default
High Volume /
Less Important
vMotion / Live
Migration
2
BW remaining
20%
10%
4q1t-8e-4q4q-in-q4 /
1p3q1t-8e-4q4q-out-q3
Medium Volume /
Important
Multimedia 3, 4
BW remaining
30%
30%
4q1t-8e-4q4q-in-q3 /
1p3q1t-8e-4q4q-out-q2
Medium Volume
Very Important
Strict Priority 5
Priority Queue 10%
4q1t-8e-4q4q-in-q1 /
1p3q1t-8e-4q4q-out-pq1
Low Volume /
Important /
Delay Sensitive
Network Control 6/7
Low Volume /
Very important
CoS to Queue Configuration –F2/F3 slides
Example (Admin- / Default-VDC)
118
Core
class-map type queuing match-any 4q1t-8e-4q4q-in-q1
match cos 5-7
class-map type queuing match-any 4q1t-8e-4q4q-in-q-default
match cos 0-1
class-map type queuing match-any 4q1t-8e-4q4q-in-q3
match cos 3-4
class-map type queuing match-any 4q1t-8e-4q4q-in-q4
match cos 2
class-map type queuing match-any 1p3q1t-8e-4q4q-out-pq1
match cos 5-7
class-map type queuing match-any 1p3q1t-8e-4q4q-out-q2
match cos 3-4
class-map type queuing match-any 1p3q1t-8e-4q4q-out-q3
match cos 2
class-map type queuing match-any 1p3q1t-8e-4q4q-out-q-default
match cos 0-1
Admin-
VDC
Admin-
VDC
Changes apply to ALL ports of specified type in ALL VDCs
Changes are traffic disruptive for ports of specified type
Ingress Queuing Configuration for F2/F3 cards
Example (Payload-VDC)
119
Coreqos copy policy-map type queuing default-8e-4q4q-in-policy prefix
Custom-
policy-map type queuing Custom-8e-4q4q-in
class type queuing 4q1t-8e-4q4q-in-q1
queue-limit percent 10
bandwidth percent 25
class type queuing 4q1t-8e-4q4q-in-q-default
queue-limit percent 50
bandwidth percent 25
class type queuing 4q1t-8e-4q4q-in-q3
queue-limit percent 30
bandwidth percent 25
class type queuing 4q1t-8e-4q4q-in-q4
queue-limit percent 10
bandwidth percent 25
interface Ethernet1/1
service-policy type queuing input Custom-8e-4q4q-in
All Policy-Map and Service-Policy are done in relevant Payload-VDC and
only affect the interface to which they get applied
Egress Queuing Configuration for F2/F3 cards
Example (Payload-VDC)
120
Core
qos copy policy-map type queuing default-8e-4q4q-out-policy prefix
Custom-
policy-map type queuing Custom-8e-4q4q-out
class type queuing 1p3q1t-8e-4q4q-out-pq1
priority level 1
class type queuing 1p3q1t-8e-4q4q-out-q2
bandwidth remaining percent 30
class type queuing 1p3q1t-8e-4q4q-out-q3
bandwidth remaining percent 20
class type queuing 1p3q1t-8e-4q4q-out-q-default
bandwidth remaining percent 50
!
interface Ethernet1/1
service-policy type queuing output Custom-8e-4q4q-out
All Policy-Map and Service-Policy are done in relevant Payload-VDC and
only affect the interface to which they get applied
CoS to Queue Mapping - Nexus 5600/6000
Example
121
Application CoS
Queuing
(Scheduling)
Queue-Limit
(Buffer)
Queue
(6q1t / 1p6q0t)
Character
Best Effort 0,1
BW percent
40%
remaining
(226kByte)
qos-group 0 (default)
High Volume /
Less Important
vMotion / Live
Migration
2,3
BW percent
20%
41kByte qos-group 3
Medium Volume /
Important
Multimedia 4
BW percent
30%
41kByte qos-group 4
Medium Volume
Very Important
Strict Priority 5
BW percent
10%
20kByte
(min)
qos-group5 / priority
Low Volume /
Important /
Delay Sensitive
Network Control 6,7
Low Volume /
Very important
Egress Queuing Configuration: Nexus5600
Example
122
Coreclass-map type queuing CM_Q_MATCH_QG3_COS2
match qos-group 3
class-map type queuing CM_Q_MATCH_QG4_COS4
match qos-group 4
class-map type queuing CM_Q_MATCH_QG5_COS5
match qos-group 5
!
policy-map type queuing PM_QUEUING_SYSTEM_OUT
class type queuing CM_Q_MATCH_QG3_COS2
bandwidth percent 20
class type queuing CM_Q_MATCH_QG4_COS4
bandwidth percent 30
class type queuing CM_Q_MATCH_QG5_COS5
priority
bandwidth percent 10
class type queuing class-default
bandwidth percent 40
Queue-Limit (Buffer) Configuration
Example
123
Corepolicy-map type network-qos PM_N-QOS_SYSTEM
class type network-qos CM_N-QOS_MATCH_QG3_COS2
set cos 2
queue-limit 40960 bytes
class type network-qos CM_N-QOS_MATCH_QG4_COS4
set cos 4
queue-limit 40960 bytes
class type network-qos CM_N-QOS_MATCH_QG5_COS5
set cos 5
queue-limit 20480 bytes
class type network-qos class-default
system qos
service-policy type network-qos PM_N-QOS_SYSTEM
Queuing: Nexus 2000
124
vpc peer-link
vpc peer-link vpc peer-link vpc peer-link
Queuing on NIF
controlled by Fabric
Interface INPUT policy
Core
Queuing on NIF (multiple
no-drop queues) only
available with CoS based
marking on HIF
Queuing Configuration (Nexus 2000)
Example
125
Coreclass-map type queuing CM_Q_MATCH_QG3_COS2
match qos-group 3
class-map type queuing CM_Q_MATCH_QG4_COS4
match qos-group 4
class-map type queuing CM_Q_MATCH_QG5_COS5
match qos-group 5
!
policy-map type queuing PM_QUEUING_SYSTEM_N2K
class type queuing CM_Q_MATCH_QG3_COS2
bandwidth percent 20
class type queuing CM_Q_MATCH_QG4_COS4
bandwidth percent 30
class type queuing CM_Q_MATCH_QG5_COS5
priority
bandwidth percent 10
class type queuing class-default
bandwidth percent 40
Amount of Queues depend on FEX (Nexus 2000) Model
Agenda
• Introduction
• QoS and Queuing Basics
• QoS Implementation on Nexus
• Nexus 7000/7700 QoS
• Nexus 5600/6000 QoS
• Nexus 2000 QoS
• Real World Configuration Examples
• Conclusion
Conclusion
Why QoS in the Data Center?
128
Assign
Color to Traffic
Maximize
Throughput
Manage
Congestion
Maximize Throughput and Manage Congestion!
Nexus 9000 QoS
Nexus 9000 Overview
• Modular and fixed chassis
• Optimized for high density 40G/100G
• Standalone and ACI Mode
• Merchant+ Strategy
• Mix of Merchant and Custom Silicon
Egress
VOQ buffer
Ingress
VOQ buffer
Ingress Module Egress Module
Ingress Module
Ingress Module
Crossbar
Fabric
Buffering Model
Nexus 9000 compared to Nexus 7000/Nexus 5000
132
No VOQ concept – only egress shared buffers
Uses both merchant silicon and custom silicon buffers
Egress buffer
Nexus 7000
F-Series I/O Module
Cisco Nexus 9000 QoS Features
• Traffic classification
‒ DSCP, CoS, and ACL
• Packet marking
‒ DSCP, CoS, and ECN
• Strict Priority Queuing and DWRR
‒ DCBX 802.1Qaz
• Ingress policing only
• WRED, TD and ECN
• Shared buffer capability
• Buffer boost
Queuing on Nexus 9500 Switch Line Cards
Queuing on N9K-X9600 Series Line Cards
Traffic
Classification
Ingress
Cos/DSCP
Marking
Trust CoS/DSCP
L2/L3/L4 info with ACL
Ingress
Policing
Fabric
Module
Egress Port Queues
multicast
span
unicast
MTU
checking
NFE
Ingress Line Card
Egress Line Card
multicast
CPU
span
unicast
multicast
CPU
span
unicast
control
System QoS
System QoS
Queuing & Scheduling on Nexus 9500 Line Cards
Queuing on N9K-X9500 Series Line Cards
Traffic
Classification
Ingress
Cos/DSCP
Marking
Trust CoS/DSCP
L2/L3/L4 info with ACL
Ingress
Policing
Fabric
Module
Unicast EoQs
(4 per egr port)
Egress Port Queues
Unicast
from EoQs
multicast
Span
unicast
MTU
checking
NFE
OOBFC signaling
ALE
Ingress Line Card
Egress Line Card
multicast
Control
Span
unicast
multicas
t
CPU
span
unicast
multicast
CPU
span
unicast
Non-hair-
pinned local
unicast traffic
System QoS
System QoS
Buffer Boost on x9500 cards
 Line cards with ALEs can leverage the
additional buffer on ALE for NFE local traffic.
 When buffer boost is enabled, NFE local traffic
on the port is sent to ALE for additional buffer
space.
 When buffer boost is disabled, NFE local traffic
to the port remains local
 Buffer boost is enabled by default and can be
disabled on a per-port basis.
North Star
4:1 Mux
North Star
NFE NFE
Network Interface
1/10GE
ALE
10 MB Buffer shared by all Ports
NFE
10 MB
Buffer
10 MB
Buffer
1/10GE 1/10GE 1/10GE
Network Interface
40GE
20 MB
Buffer
ALE
10 MB Buffer shared by all Ports
NFE
10 MB
Buffer
10 MB
Buffer
40GE 40GE 40GE
Fabric Modules
20 MB
Buffer
Buffer Boost
enabled port
Buffer Boost
disabled port
FEX QoS Configuration
Examples
policy-map type qos fex-qos
class fex-qos-class-1
set dscp 10
class fex-qos-class-2
set dscp 18
class fex-qos-class-3
set dscp 26
!
interface Ethernet101/1/1
service-policy type qos input fex-qos
Fex QoS Policy Configuration Example
Marking policy
Policy applied on ingress of FEX HIF
 Applying 8e-4q4q template to enable 4 ingress/egress queues on FEX with COS to queue
mapping (also enables 4 ingress queues on F-series modules, if present)
system qos
service-policy type network-qos default-nq-8e-4q4q-policy
 FEX output (“show queuing interface”):
Queuing:
queue qos-group cos priority bandwidth mtu
--------+------------+--------------+---------+---------+----
ctrl-hi n/a 7 PRI 0 2400
ctrl-lo n/a 7 PRI 0 2400
2 0 0 1 WRR 30 1600
3 1 2 WRR 30 1600
4 2 5 6 WRR 10 1600
5 3 3 4 WRR 30 1600
Nexus 7000 Network-QoS Configuration Example #1
Default 8e-4q4q template applied to
“system qos” target
8e4q4q configuration (4 data traffic queues)
 Applying custom 8e-4q4q-based template with new MTU
policy-map type network-qos custom-nq-8e-4q4q template 8e-4q4q
class type network-qos c-nq-8e-4q4q
congestion-control tail-drop
mtu 9216
system qos
service-policy type network-qos custom-nq-8e-4q4q
 FEX output (“show queuing interface”) after MTU change:
Queuing:
queue qos-group cos priority bandwidth mtu
--------+------------+--------------+---------+---------+----
ctrl-hi n/a 7 PRI 0 2400
ctrl-lo n/a 7 PRI 0 2400
2 0 0 1 WRR 30 9280
3 1 2 WRR 30 9280
4 2 5 6 WRR 10 9280
5 3 3 4 WRR 30 9280
Nexus 7000 Network-QoS Configuration Example #2
Custom network-qos policy
with new MTU
Custom template applied to
“system qos” target
MTU increased on data traffic queues
 Changing CoS- or DSCP-to-queue mappings in parent switch F-type ingress
queuing class-maps modifies mappings on FEX
 Queuing class-maps modified only in default/admin VDC (apply to entire
system)
class-map type queuing match-any 4q1t-8e-4q4q-in-q1
match cos 1-3
match dscp 8-31
class-map type queuing match-any 4q1t-8e-4q4q-in-q-default
match cos 0
match dscp 0-7
class-map type queuing match-any 4q1t-8e-4q4q-in-q3
match cos 4-5
match dscp 32-47
class-map type queuing match-any 4q1t-8e-4q4q-in-q4
match cos 6-7
match dscp 48-63
Modifying CoS- or DSCP-to-Queue Mappings
Queuing:
queue qos-group cos priority bandwidth mtu
--------+------------+--------------+---------+---------+----
ctrl-hi n/a 7 PRI 0 2400
ctrl-lo n/a 7 PRI 0 2400
2 0 0 WRR 30 1600
3 1 6 WRR 30 1600
4 2 1 2 3 WRR 10 1600
5 3 4 5 WRR 30 1600
<…>
queue DSCPs
----- -----
02 0-7,
04 8-31,
03 48-63,
05 32-47,
Non-default F-series
ingress queuing
class-maps (COS and
DSCP match statements
modified)
FEX queue mappings
reflect changes
 Example #1 – N2K-C2248TP-1GE
fex 101
hardware N2248T queue-limit 50000
 Example #2 – N2K-C2232TM-E-10GE
fex 102
hardware N2232TM-E queue-limit 50000
 FEX output (“show queuing interface”) before:
Queue limit: Disabled
 FEX output (“show queuing interface”) after (configured queue-limit rounded to nearest hardware
supported value):
Queue limit: 51200 bytes
Enabling FEX Queue Limits
F3 Queuing Configuration
Examples
Modifying Queuing and Scheduling Behaviour on F3
Modules
I want to… Steps to follow
…remap COS/DSCP values from one
queue to another queue without activating
additional queues
1. Modify the type queuing class-map(s) for the desired queue(s)
…change queuing behavior without
changing COS-or DSCP-to-queue mapping
1. Define new type queuing policy-map (you cannot modify the default
policies)
2. Modify class-map parameters
3. Apply new policy-map to interfaces
…activate additional queues and remap
COS/DSCP values
1. Define new type queuing policy-map
2. Modify COS-to-queue mapping for target port type
3. Apply new policy-map to interfaces
…shape the SP queue 1. (Optional) Clone the default egress queuing policy
2. Shape the SP queue in the new (cloned) policy
3. Apply the new queuing policy to the target interfaces
Modifying Queuing Behavior
Remap Some COS/DSCP Values from One Queue to Another Queue without
Activating Additional Queues
Important: changing COS- or DSCP-to-queue mapping takes effect immediately and is disruptive to
all ports
Modify “type queuing” class-map(s) for desired
queue(s)
Remap COS- or DSCP-to-queue mapping for given queue(s)
Modifying Queuing Behavior
Remap Some COS/DSCP Values from One Queue to Another Queue without
Activating Additional Queues
Example: remap COS 4 and DSCP 32-39 to ingress queue “q1”:
n77# show class-map type queuing 8q2t-in-q1
Type queuing class-maps
========================
class-map type queuing match-any 8q2t-in-q1
Description: Classifier for ingress queue 1 of type 8q2t
match cos 5-7
match dscp 40-63
n77# configure terminal
Enter configuration commands, one per line. End with CNTL/Z.
n77(config)# ! Modify ingress queue q1
n77(config)# class-map type queuing match-any 8q2t-in-q1
n77(config-cmap-que)# ! Change COS- and DSCP-to-queue mapping for this queue
n77(config-cmap-que)# match cos 4
n77(config-cmap-que)# match dscp 32-39
n77(config-cmap-que)# show class-map type queuing 8q2t-in-q1
Type queuing class-maps
========================
class-map type queuing match-any 8q2t-in-q1
Description: Classifier for ingress queue 1 of type 8q2t
match cos 4-7
match dscp 32-63
n77(config-cmap-que)#
Show current
mapping
Show new
mapping
Configure new
mapping
Modifying Queuing Behavior
Changing Default Queuing Behavior without Changing COS- or DSCP-to-
Queue
Define new “type queuing” policy-map for port
type
Create new policy
Modify class-map parameters
Define behavior of each queue
Important: applying new queuing policy takes effect immediately and is disruptive to any ports to
which the policy is applied
Apply “type queuing” service-policy to
interface(s)
Apply new queuing policy to interface(s)
Modifying Queuing Behavior
Changing Default Queuing Behavior without Changing COS- or DSCP-to-
Queue
Example: Resize ingress queues without modifying COS- or DSCP-to-queue mapping
n77# configure terminal
Enter configuration commands, one per line. End with CNTL/Z.
n77(config)# ! Define new "type queuing" policy
n77(config)# policy-map type queuing new-f3-ingress
n77(config-pmap-que)# ! Define behavior for F3 ingress q-default
n77(config-pmap-que)# class type queuing 8e-4q8q-in-q-default
n77(config-pmap-c-que)# ! Resize this queue
n77(config-pmap-c-que)# queue-limit percent 74
n77(config-pmap-c-que)# ! Define behavior for F3 ingress queue 1
n77(config-pmap-c-que)# class type queuing 8e-4q8q-in-q1
n77(config-pmap-c-que)# ! Resize this queue
n77(config-pmap-c-que)# queue-limit percent 24
n77(config-pmap-c-que)# ! Policy must include all queues (even inactive)
n77(config-pmap-c-que)# class type queuing 8e-4q8q-in-q3
n77(config-pmap-c-que)# ! Must give at least 1% to inactive queues
n77(config-pmap-c-que)# queue-limit percent 1
n77(config-pmap-c-que)# class type queuing 8e-4q8q-in-q4
n77(config-pmap-c-que)# queue-limit percent 1
n77(config-pmap-c-que)# interface e 2/1-48
n77(config-if-range)# ! Apply the new policy to F3 interfaces
n77(config-if-range)# service-policy type queuing input new-f3-ingress
n77(config-if-range)#
Create new
queuing policy
Modify class-map
parameters (resize queues)
Apply policy to
interface(s)
Modifying Queuing Behavior
Activate Additional Queues and Remap COS/DSCP Values
Important: changing COS/DSCP-to-queue mapping and takes effect immediately and is disruptive to all ports;
applying new queuing policy takes effect immediately and is disruptive to any ports to which the policy is applied
Define new “type queuing” policy-map for port
type
Create new policy
Modify class-map parameters
Define behavior of each queue
Apply “type queuing” service-policy to
interface(s)
Apply new queuing policy to interface(s)
Modify “type queuing” class-map(s) for desired
queue(s)
Remap COS- or DSCP-to-queue mapping to additional queue(s)
Example: Enable one additional ingress queue and map COS/DSCP values to all active queues
n77# configure terminal
Enter configuration commands, one per line. End with CNTL/Z.
n77(config)# ! Modify ingress queue q3
n77(config)# class-map type queuing match-any 8q2t-in-q3
n77(config-cmap-que)# ! Map COS and DSCP values to this queue
n77(config-cmap-que)# match cos 3-4
n77(config-cmap-que)# match dscp 24-39
n77(config-cmap-que)# ! Define new "type queuing" policy
n77(config-cmap-que)# policy-map type queuing new-f3-ingress
n77(config-pmap-que)# ! Define behavior for F3 ingress q-default
n77(config-pmap-que)# class type queuing 8e-4q8q-in-q-default
n77(config-pmap-c-que)# ! Resize this queue
n77(config-pmap-c-que)# queue-limit percent 60
n77(config-pmap-c-que)# ! Define behavior for F3 ingress queue 1
n77(config-pmap-c-que)# class type queuing 8e-4q8q-in-q1
n77(config-pmap-c-que)# ! Resize this queue
n77(config-pmap-c-que)# queue-limit percent 25
n77(config-pmap-c-que)# ! Define behavior for F3 ingress queue 3
n77(config-pmap-c-que)# class type queuing 8e-4q8q-in-q3
n77(config-pmap-c-que)# ! Resize this queue
n77(config-pmap-c-que)# queue-limit percent 14
n77(config-pmap-c-que)# ! Policy must include all queues (even inactive)
n77(config-pmap-c-que)# class type queuing 8e-4q8q-in-q4
n77(config-pmap-c-que)# queue-limit percent 1
n77(config-pmap-c-que)# int e 2/1-48
n77(config-if-range)# ! Apply the new policy to F3 interfaces
n77(config-if-range)# service-policy type queuing input new-f3-ingress
Modifying Queuing Behavior
Activate Additional Queues and Remap COS/DSCP Values
Map COS/DSCP values to
inactive queue
Modify class-map
parameters (resize queues)
Apply policy to
interface(s)
Create new
queuing policy
Important!
• If you change the COS- or DSCP-to-queue mapping for a port type, make sure all ports of that type in
all VDCs have a queuing policy applied that defines behavior for all queues with COS/DSCP values
mapped
• For example, if you do THIS…
n77(config)# class-map type queuing match-any 8e-4q8q-in-q-default
n77(config-cmap-que)# match cos 0-1
n77(config-cmap-que)# match dscp 0-15
n77(config-cmap-que)# class-map type queuing match-any 8e-4q8q-in-q4
n77(config-cmap-que)# match cos 2-4
n77(config-cmap-que)# match dscp 16-39
n77(config-cmap-que)# class-map type queuing match-any 8e-4q8q-in-q3
n77(config-cmap-que)# match cos 6-7
n77(config-cmap-que)# match dscp 48-63
n77(config-cmap-que)# class-map type queuing match-any 8e-4q8q-in-q1
n77(config-cmap-que)# match cos 5
n77(config-cmap-que)# match dscp 40-47
Changes the default COS/
DSCP-to-queue mapping
Important!
• … then make sure you do THIS…
n77(config)# policy-map type queuing new-f3-ingress
n77(config-pmap-que)# class type queuing 8e-4q8q-in-q-default
n77(config-pmap-c-que)# queue-limit percent 50
n77(config-pmap-c-que)# class type queuing 8e-4q8q-in-q1
n77(config-pmap-c-que)# queue-limit percent 20
n77(config-pmap-c-que)# class type queuing 8e-4q8q-in-q3
n77(config-pmap-c-que)# queue-limit percent 20
n77(config-pmap-c-que)# class type queuing 8e-4q8q-in-q4
n77(config-pmap-c-que)# queue-limit percent 10
n77(config-pmap-c-que)#
Defines a new queuing policy that defines
behavior of all queues that COS/DSCP
values have been mapped to
Important!
• … and then do THIS:
n77(config)# int e 2/1-48
n77(config-if-range)# service-policy type queuing input new-f3-ingress
n77(config-if-range)#
• If you DON’T, traffic arriving on ports with default policy (i.e., without all queues activated
that have COS/DSCP values mapped) will suffer – packet drops, poor performance, etc.
• Of course, you can have different non-default policies on different sets of interfaces, but all
interfaces in the system must use some policy that defines all activated queues!
Maps the new policy to ALL interfaces in the
system (do this on ALL ports in EVERY VDC!!)
Modifying Queuing Behavior
Shape the SP Queue
(Optional) Clone a default egress “type
queuing” policy-map
Create a copy of a default egress queuing policy
Shape SP queue in new (cloned) “type
queuing” policy
Limit SP queue bandwidth consumption
Apply new “type queuing” policy to target
interface(s)
Apply new queuing policy to interfaces
Important: applying new queuing policy takes effect immediately and is disruptive to any
ports to which the policy is applied
Modifying Queuing Behavior
Shape the SP Queue
Example: Shape the SP queue to 2Gbps on a 10G interface, using a queuing policy cloned from the default “8e4q4q” egress
queuing policy
n77# ! Clone the 8E egress queuing policy
n77# qos copy policy-map type queuing default-8e-4q8q-out-policy prefix new-
n77# conf
Enter configuration commands, one per line. End with CNTL/Z.
n77(config)# ! Modify new queuing policy
n77(config)# policy-map type queuing new-8e-4q8q-out
n77(config-pmap-que)# ! Modify egress queue q1
n77(config-pmap-que)# class type queuing 8e-4q8q-out-q1
n77(config-pmap-c-que)# ! Make this queue strict priority
n77(config-pmap-c-que)# priority level 1
n77(config-pmap-c-que)# ! Shape the queue to 20% (2G on 10G port)
n77(config-pmap-c-que)# shape percent 20
n77(config-pmap-c-que)# int e 2/1-48
n77(config-if-range)# ! Apply the new policy to target interfaces
n77(config-if-range)# service-policy type queuing output new-8e-4q8q-out
n77(config-if-range)#
n77#
Clone the default egress
queuing policy
Modify the cloned policy
Make q1 Strict Priority and
shape to 20% (2G)
Apply new policy to target
interfaces
Participate in the “My Favorite Speaker” Contest
• Promote your favorite speaker through Twitter and you could win $200 of Cisco
Press products (@CiscoPress)
• Send a tweet and include
• Your favorite speaker’s Twitter handle <Speaker—enter your Twitter handle here>
• Two hashtags: #CLUS #MyFavoriteSpeaker
• You can submit an entry for more than one of your “favorite” speakers
• Don’t forget to follow @CiscoLive and @CiscoPress
• View the official rules at http://bit.ly/CLUSwin
Promote Your Favorite Speaker and You Could Be a Winner
Complete Your Online Session Evaluation
Don’t forget: Cisco Live sessions will be available
for viewing on-demand after the event at
CiscoLive.com/Online
• Give us your feedback to be
entered into a Daily Survey
Drawing. A daily winner
will receive a $750 Amazon
gift card.
• Complete your session surveys
though the Cisco Live mobile
app or your computer on
Cisco Live Connect.
Continue Your Education
• Demos in the Cisco campus
• Walk-in Self-Paced Labs
• Table Topics
• Meet the Engineer 1:1 meetings
• Related sessions
Thank you
Internet of Things (IoT) Cisco Education Offerings
Course Description Cisco Certification
NEW! CCNA Industrial An associate level instructor led training course designed to prepare you
for the CCNA Industrial certification
CCNA® Industrial
Managing Industrial Networks with
Cisco Networking Technologies (IMINS)
This curriculum addresses foundational skills needed to manage and
administer networked industrial control systems. It provides plant
administrators, control system engineers and traditional network engineers
with an understanding of the networking technologies needed in today's
connected plants and enterprises
Cisco Industrial
Networking Specialist
Control Systems Fundamentals
for Industrial Networking (ICINS)
For IT and Network Engineers, covers basic concepts in Industrial Control
systems including an introduction to automation industry verticals,
automation environment and an overview of industrial control networks
Networking Fundamentals
for Industrial Control Systems (INICS)
For Industrial Engineers and Control System Technicians, covers basic IP
and networking concepts, and introductory overview of Automation
industry Protocols.
For more details, please visit: http://learningnetwork.cisco.com
Questions? Visit the Learning@Cisco Booth or contact ask-edu-pm-dcv@cisco.com
Business Transformation Cisco Education Offerings
Course Description Cisco Certification
For IT and Network Professionals:
Building Business Specialist Skills • Builds non-technical skills key to ensure business impact and influence.
Topics include: business analysis, finance, technology adoption and
effective communications.
• Bridges IT and business impacts of mature and emerging solutions
including cloud plus Internet of Everything
Cisco Enterprise IT
Business Specialist
For Technology Sellers:
Applying Cisco Specialized Business Value
Analysis Skills
Builds skills to discover and address technology needs using a business-
focused, consultative sales approach
Cisco Business Value Specialist
Executing Advanced Cisco Business Value
Analysis and Design Techniques
Enables customer transformation through business architecture and
solution selling expertise
Cisco Certified Business
Value Practitioner
Performing Cisco Business-Focused
Transformative Architecture Engagements
Provides skills and an approach to build a strategic roadmap of IT
initiatives, aligned to business priorities
Cisco Transformative
Architecture Specialist
For more details, please visit: http://learningnetwork.cisco.com
Questions? Visit the Learning@Cisco Booth or contact ask-edu-pm-dcv@cisco.com
Security Cisco Education Offerings
Course Description Cisco Certification
Implementing Cisco IOS Network Security (IINS)
Implementing Cisco Edge Network Security Solutions
(SENSS)
Implementing Cisco Threat Control Solutions (SITCS)
Implementing Cisco Secure Access Solutions (SISAS)
Implementing Cisco Secure Mobility Solutions
(SIMOS)
Focuses on the design, implementation, and monitoring of a comprehensive
security policy, using Cisco IOS security features
Configure Cisco perimeter edge security solutions utilizing Cisco Switches, Cisco
Routers, and Cisco Adaptive Security Appliance (ASA) Firewalls
Deploy Cisco’s Next Generation Firewall (NGFW) as well as Web Security, Email
Security and Cloud Web Security
Deploy Cisco’s Identity Services Engine and 802.1X secure network access
Protect data traversing a public or shared infrastructure such as the Internet by
implementing and maintaining Cisco VPN solutions
CCNA® Security
Securing Cisco Networks with Threat Detection and
Analysis (SCYBER)
Designed for professional security analysts, the course covers essential areas of
competency including event monitoring, security event/alarm/traffic analysis, and
incident response
Cisco Cybersecurity Specialist
Network Security Product and Solutions Training For official product training on Cisco’s latest security products, including Adaptive
Security Appliances, NGIPS, Advanced Malware Protection, Identity Services
Engine, Email and Web Security Appliances see
www.cisco.com/go/securitytraining
For more details, please visit: http://learningnetwork.cisco.com
Questions? Visit the Learning@Cisco Booth or contact ask-edu-pm-dcv@cisco.com
R&S Related Cisco Education Offerings
Course Description Cisco Certification
CCIE R&S Advanced Workshops (CIERS-1 &
CIERS-2) plus
Self Assessments, Workbooks & Labs
Expert level trainings including: instructor led workshops, self
assessments, practice labs and CCIE Lab Builder to prepare candidates
for the CCIE R&S practical exam.
CCIE® Routing & Switching
• Implementing Cisco IP Routing v2.0
• Implementing Cisco IP Switched
Networks V2.0
• Troubleshooting and Maintaining
Cisco IP Networks v2.0
Professional level instructor led trainings to prepare candidates for the
CCNP R&S exams (ROUTE, SWITCH and TSHOOT). Also available in
self study eLearning formats with Cisco Learning Labs.
CCNP® Routing & Switching
Interconnecting Cisco Networking Devices:
Part 2 (or combined)
Configure, implement and troubleshoot local and wide-area IPv4 and IPv6
networks. Also available in self study eLearning format with Cisco Learning
Lab.
CCNA® Routing & Switching
Interconnecting Cisco Networking Devices:
Part 1
Installation, configuration, and basic support of a branch network. Also
available in self study eLearning format with Cisco Learning Lab.
CCENT® Routing & Switching
For more details, please visit: http://learningnetwork.cisco.com
Questions? Visit the Learning@Cisco Booth or contact ask-edu-pm-dcv@cisco.com
Wireless Cisco Education Offerings
Course Description Cisco Certification
• Conducting Cisco Unified Wireless Site Survey
• Implementing Cisco Unified Wireless Voice
Networks
• Implementing Cisco Unified Wireless Mobility
Services
• Implementing Cisco Unified Wireless Security
Services
Professional level instructor led trainings to prepare candidates to conduct
site surveys, implement, configure and support APs and controllers in
converged Enterprise networks. Focused on 802.11 and related
technologies to deploy voice networks, mobility services, and wireless
security.
CCNP® Wireless
Implementing Cisco Unified Wireless Network
Essential
Prepares candidates to design, install, configure, monitor and conduct
basic troubleshooting tasks of a Cisco WLAN in Enterprise installations.
CCNA® Wireless
For more details, please visit: http://learningnetwork.cisco.com
Questions? Visit the Learning@Cisco Booth or contact ask-edu-pm-dcv@cisco.com
Design Cisco Education Offerings
Course Description Cisco Certification
Designing Cisco Network Service Architectures
(ARCH)
Provides learner with the ability to perform conceptual, intermediate, and
detailed design of a network infrastructure that supports desired capacity,
performance, availability required for converged Enterprise network
services and applications.
CCDP® (Design Professional)
Designing for Cisco Internetwork Solutions
(DESGN)
Instructor led training focused on fundamental design methodologies used
to determine requirements for network performance, security, voice, and
wireless solutions. Prepares candidates for the CCDA certification exam.
CCDA® (Design Associate)
For more details, please visit: http://learningnetwork.cisco.com
Questions? Visit the Learning@Cisco Booth or contact ask-edu-pm-dcv@cisco.com
Service Provider Cisco Education Offerings
Course Description Cisco Certification
Deploying Cisco Service Provider Network Routing
(SPROUTE) & Advanced (SPADVROUTE)
Implementing Cisco Service Provider Next-Generation
Core Network Services (SPCORE)
Edge Network Services (SPEDGE)
SPROUTE covers the implementation of routing protocols (OSPF, IS-IS, BGP),
route manipulations, and HA routing features; SPADVROUTE covers advanced
routing topics in BGP, multicast services including PIM-SM, and IPv6;
SPCORE covers network services, including MPLS-LDP, MPLS traffic engineering,
QoS mechanisms, and transport technologies;
SPEDGE covers network services, including MPLS Layer 3 VPNs, Layer 2 VPNs,
and Carrier Ethernet services; all within SP IP NGN environments.
CCNP Service Provider®
Building Cisco Service Provider Next-Generation
Networks, Part 1&2 (SPNGN1), (SPNGN2)
The two courses introduce networking technologies and solutions, including OSI
and TCP/IP models, IPv4/v6, switching, routing, transport types, security, network
management, and Cisco OS (IOS and IOS XR).
CCNA Service Provider®
Implementing Cisco Service Provider Mobility UMTS
Networks (SPUMTS);
Implementing Cisco Service Provider Mobility CDMA
Networks (SPCDMA);
Implementing Cisco Service Provider Mobility LTE
Networks (SPLTE)
The three courses (SPUMTS, SPCDMA, SPLTE) cover knowledge and skills
required to understand products, technologies, and architectures that are found in
Universal Mobile Telecommunications Systems (UMTS) and Code Division Multiple
Access (CDMA) packet core networks, plus their migration to Long-Term Evolution
(LTE) Evolved Packet Systems (EPS), including Evolved Packet Core (EPC) and
Radio Access Networks (RANs).
Cisco Service Provider Mobility
CDMA to LTE Specialist;
Cisco Service Provider Mobility UMTS
to LTE Specialist
Implementing and Maintaining Cisco Technologies
Using IOS XR (IMTXR)
Service Provider/Enterprise engineers to implement, verification-test, and optimize
core/edge technologies in a Cisco IOS XR environment.
Cisco IOS XR Specialist
For more details, please visit: http://learningnetwork.cisco.com
Questions? Visit the Learning@Cisco Booth or contact ask-edu-pm-dcv@cisco.com
Collaboration Cisco Education Offerings
Course Description Cisco Certification
CCIE Collaboration Advanced Workshop (CIEC) Gain expert-level skills to integrate, configure, and troubleshoot complex
collaboration networks
CCIE® Collaboration
Implementing Cisco Collaboration Applications
(CAPPS)
Understand how to implement the full suite of Cisco collaboration
applications including Jabber, Cisco Unified IM and Presence, and Cisco
Unity Connection.
CCNP® Collaboration
Implementing Cisco IP Telephony and Video
Part 1 (CIPTV1)
Implementing Cisco IP Telephony and Video
Part 2 (CIPTV2)
Troubleshooting Cisco IP Telephony and Video
(CTCOLLAB)
Learn how to implement Cisco Unified Communications Manager, CUBE,
and audio and videoconferences in a single-site voice and video network.
Obtain the skills to implement Cisco Unified Communications Manager in a
modern, multisite collaboration environment.
Troubleshoot complex integrated voice and video infrastructures
CCNP® Collaboration
Implementing Cisco Collaboration Devices
(CICD)
Implementing Cisco Video Network Devices
(CIVND)
Acquire a basic understanding of collaboration technologies like Cisco Call
Manager and Cisco Unified Communications Manager.
Learn how to evaluate requirements for video deployments, and implement
Cisco Collaboration endpoints in converged Cisco infrastructures.
CCNA® Collaboration
For more details, please visit: http://learningnetwork.cisco.com
Questions? Visit the Learning@Cisco Booth or contact ask-edu-pm-dcv@cisco.com
Data Center / Virtualization Cisco Education Offerings
Course Description Cisco Certification
Cisco Data Center CCIE Unified Fabric
Workshop (DCXUF);
Cisco Data Center CCIE Unified Computing
Workshop (DCXUC)
Prepare for your CCIE Data Center practical exam with hands on lab
exercises running on a dedicated comprehensive topology
CCIE® Data Center
Implementing Cisco Data Center Unified Fabric
(DCUFI);
Implementing Cisco Data Center Unified
Computing (DCUCI)
Obtain the skills to deploy complex virtualized Data Center Fabric and
Computing environments with Nexus and Cisco UCS.
CCNP® Data Center
Introducing Cisco Data Center Networking
(DCICN); Introducing Cisco Data Center
Technologies (DCICT)
Learn basic data center technologies and how to build a data center
infrastructure.
CCNA® Data Center
Product Training Portfolio: DCAC9k, DCINX9k,
DCMDS, DCUCS, DCNX1K, DCNX5K, DCNX7K
Get a deep understanding of the Cisco data center product line including
the Cisco Nexus9K in ACI and NexusOS modes
For more details, please visit: http://learningnetwork.cisco.com
Questions? Visit the Learning@Cisco Booth or contact ask-edu-pm-dcv@cisco.com
Network Programmability Cisco Education Offerings
Course Description Cisco Certification
Integrating Business Applications with Network
Programmability (NIPBA);
Integrating Business Applications with Network
Programmability for Cisco ACI (NPIBAACI)
Learn networking concepts, and how to deploy and troubleshoot
programmable network architectures with these self-paced courses.
Cisco Business Application
Engineer Specialist Certification
Developing with Cisco Network Programmability
(NPDEV);
Developing with Cisco Network Programmability
for Cisco ACI (NPDEVACI)
Learn how to build applications for network environments and effectively
bridge the gap between IT professionals and software developers.
Cisco Network Programmability
Developer Specialist Certification
Designing with Cisco Network Programmability
(NPDES);
Designing with Cisco Network Programmability
for Cisco ACI (NPDESACI)
Learn how to expand your skill set from traditional IT infrastructure to
application integration through programmability.
Cisco Network Programmability
Design Specialist Certification
Implementing Cisco Network Programmability
(NPENG);
Implementing Cisco Network Programmability
for Cisco ACI (NPENGACI)
Learn how to implement and troubleshoot open IT infrastructure
technologies.
Cisco Network Programmability
Engineer Specialist Certification
For more details, please visit: http://learningnetwork.cisco.com
Questions? Visit the Learning@Cisco Booth or contact ask-edu-pm-dcv@cisco.com
Cloud Cisco Education Offerings
Course Description Cisco Certification
Designing the FlexPod Solution (FPDESIGN);
Implementing and Administering the FlexPod
Solution (FPIMPADM)
Learn how to design, implement and administer FlexPod solutions FlexPod Design Specialist;
FlexPod Implementation &
Administration Specialist
UCS Director (UCSDF) Learn how to manage physical and virtual infrastructure using
orchestration and automation functions of UCS Director.
Cisco Prime Service Catalog Learn how to deliver data center, workplace, and application services in an
on-demand, automated, and repeatable method.
Cisco Intercloud Fabric Learn how to implement end-to-end hybrid clouds with Intercloud Fabric
for Business and Intercloud Fabric for Providers.
Cisco Intelligent Automation for Cloud Learn how to implement and manage cloud deployments with Cisco
Intelligent Automation for Cloud
For more details, please visit: http://learningnetwork.cisco.com
Questions? Visit the Learning@Cisco Booth or contact ask-edu-pm-dcv@cisco.com

More Related Content

What's hot

The latest cisco nexus 9000 innovations
The latest cisco nexus 9000 innovationsThe latest cisco nexus 9000 innovations
The latest cisco nexus 9000 innovationsIT Tech
 
Cisco data center switch nexus series training presentation by zerone
Cisco data center switch nexus series training presentation by zeroneCisco data center switch nexus series training presentation by zerone
Cisco data center switch nexus series training presentation by zerone零壹科技股份有限公司
 
Cisco Nexus Family Platform Overview
Cisco Nexus Family Platform OverviewCisco Nexus Family Platform Overview
Cisco Nexus Family Platform OverviewCybera Inc.
 
Cisco data center support
Cisco data center supportCisco data center support
Cisco data center supportKrunal Shah
 
Cisco Live! :: Introduction to IOS XR for Enterprises and Service Providers
Cisco Live! :: Introduction to IOS XR for Enterprises and Service ProvidersCisco Live! :: Introduction to IOS XR for Enterprises and Service Providers
Cisco Live! :: Introduction to IOS XR for Enterprises and Service ProvidersBruno Teixeira
 
Cisco 900 Series Integrated Services Routers Datasheet
Cisco 900 Series Integrated Services Routers DatasheetCisco 900 Series Integrated Services Routers Datasheet
Cisco 900 Series Integrated Services Routers Datasheet美兰 曾
 
Cisco EuroMPI'13 vendor session presentation
Cisco EuroMPI'13 vendor session presentationCisco EuroMPI'13 vendor session presentation
Cisco EuroMPI'13 vendor session presentationJeff Squyres
 
VDC by NETWORKERS HOME
VDC by NETWORKERS HOMEVDC by NETWORKERS HOME
VDC by NETWORKERS HOMEnetworkershome
 
Differences of the Cisco Operating Systems
Differences of the Cisco Operating SystemsDifferences of the Cisco Operating Systems
Differences of the Cisco Operating Systems美兰 曾
 
PLNOG16: Obsługa 100M pps na platformie PC , Przemysław Frasunek, Paweł Mała...
PLNOG16: Obsługa 100M pps na platformie PC, Przemysław Frasunek, Paweł Mała...PLNOG16: Obsługa 100M pps na platformie PC, Przemysław Frasunek, Paweł Mała...
PLNOG16: Obsługa 100M pps na platformie PC , Przemysław Frasunek, Paweł Mała...PROIDEA
 
2014/09/02 Cisco UCS HPC @ ANL
2014/09/02 Cisco UCS HPC @ ANL2014/09/02 Cisco UCS HPC @ ANL
2014/09/02 Cisco UCS HPC @ ANLdgoodell
 
Развитие решений по коммутации в корпоративных сетях Cisco
Развитие решений по коммутации в корпоративных сетях CiscoРазвитие решений по коммутации в корпоративных сетях Cisco
Развитие решений по коммутации в корпоративных сетях CiscoCisco Russia
 
Решения конвергентного доступа Cisco. Обновление продуктовой линейки коммутат...
Решения конвергентного доступа Cisco. Обновление продуктовой линейки коммутат...Решения конвергентного доступа Cisco. Обновление продуктовой линейки коммутат...
Решения конвергентного доступа Cisco. Обновление продуктовой линейки коммутат...Cisco Russia
 
Juniper Networks: Virtual Chassis High Availability
Juniper Networks: Virtual Chassis High AvailabilityJuniper Networks: Virtual Chassis High Availability
Juniper Networks: Virtual Chassis High AvailabilityJuniper Networks
 

What's hot (20)

The latest cisco nexus 9000 innovations
The latest cisco nexus 9000 innovationsThe latest cisco nexus 9000 innovations
The latest cisco nexus 9000 innovations
 
Cisco data center switch nexus series training presentation by zerone
Cisco data center switch nexus series training presentation by zeroneCisco data center switch nexus series training presentation by zerone
Cisco data center switch nexus series training presentation by zerone
 
Cisco Nexus Family Platform Overview
Cisco Nexus Family Platform OverviewCisco Nexus Family Platform Overview
Cisco Nexus Family Platform Overview
 
Cisco data center support
Cisco data center supportCisco data center support
Cisco data center support
 
Cisco data center training for ibm
Cisco data center training for ibmCisco data center training for ibm
Cisco data center training for ibm
 
Cisco Live! :: Introduction to IOS XR for Enterprises and Service Providers
Cisco Live! :: Introduction to IOS XR for Enterprises and Service ProvidersCisco Live! :: Introduction to IOS XR for Enterprises and Service Providers
Cisco Live! :: Introduction to IOS XR for Enterprises and Service Providers
 
Технологии ЦОД. Virtual Chassis Fabric
Технологии ЦОД. Virtual Chassis FabricТехнологии ЦОД. Virtual Chassis Fabric
Технологии ЦОД. Virtual Chassis Fabric
 
Cisco 900 Series Integrated Services Routers Datasheet
Cisco 900 Series Integrated Services Routers DatasheetCisco 900 Series Integrated Services Routers Datasheet
Cisco 900 Series Integrated Services Routers Datasheet
 
Cisco EuroMPI'13 vendor session presentation
Cisco EuroMPI'13 vendor session presentationCisco EuroMPI'13 vendor session presentation
Cisco EuroMPI'13 vendor session presentation
 
VDC by NETWORKERS HOME
VDC by NETWORKERS HOMEVDC by NETWORKERS HOME
VDC by NETWORKERS HOME
 
Differences of the Cisco Operating Systems
Differences of the Cisco Operating SystemsDifferences of the Cisco Operating Systems
Differences of the Cisco Operating Systems
 
PLNOG16: Obsługa 100M pps na platformie PC , Przemysław Frasunek, Paweł Mała...
PLNOG16: Obsługa 100M pps na platformie PC, Przemysław Frasunek, Paweł Mała...PLNOG16: Obsługa 100M pps na platformie PC, Przemysław Frasunek, Paweł Mała...
PLNOG16: Obsługa 100M pps na platformie PC , Przemysław Frasunek, Paweł Mała...
 
Campus
CampusCampus
Campus
 
2014/09/02 Cisco UCS HPC @ ANL
2014/09/02 Cisco UCS HPC @ ANL2014/09/02 Cisco UCS HPC @ ANL
2014/09/02 Cisco UCS HPC @ ANL
 
Развитие решений по коммутации в корпоративных сетях Cisco
Развитие решений по коммутации в корпоративных сетях CiscoРазвитие решений по коммутации в корпоративных сетях Cisco
Развитие решений по коммутации в корпоративных сетях Cisco
 
Новый функционал JunOS для маршрутизаторов
Новый функционал JunOS для маршрутизаторовНовый функционал JunOS для маршрутизаторов
Новый функционал JunOS для маршрутизаторов
 
Juniper for Enterprise
Juniper for EnterpriseJuniper for Enterprise
Juniper for Enterprise
 
Решения конвергентного доступа Cisco. Обновление продуктовой линейки коммутат...
Решения конвергентного доступа Cisco. Обновление продуктовой линейки коммутат...Решения конвергентного доступа Cisco. Обновление продуктовой линейки коммутат...
Решения конвергентного доступа Cisco. Обновление продуктовой линейки коммутат...
 
Новые коммутаторы QFX10000. Технология JunOS Fusion
Новые коммутаторы QFX10000. Технология JunOS FusionНовые коммутаторы QFX10000. Технология JunOS Fusion
Новые коммутаторы QFX10000. Технология JunOS Fusion
 
Juniper Networks: Virtual Chassis High Availability
Juniper Networks: Virtual Chassis High AvailabilityJuniper Networks: Virtual Chassis High Availability
Juniper Networks: Virtual Chassis High Availability
 

Similar to CCIE Routing and Switching Written Exam Version 5.0 Nexus QoS Deep Dive

Similar to CCIE Routing and Switching Written Exam Version 5.0 Nexus QoS Deep Dive (20)

Chapter07
Chapter07Chapter07
Chapter07
 
Advanced networking - scheduling and QoS part 1
Advanced networking - scheduling and QoS part 1Advanced networking - scheduling and QoS part 1
Advanced networking - scheduling and QoS part 1
 
QoS
QoSQoS
QoS
 
Chapter11
Chapter11Chapter11
Chapter11
 
Presentacion qos-
Presentacion qos-Presentacion qos-
Presentacion qos-
 
Presentacion qos-
Presentacion qos-Presentacion qos-
Presentacion qos-
 
Presentacion qos-
Presentacion qos-Presentacion qos-
Presentacion qos-
 
Advanced networking scheduling and QoS part 2
Advanced networking scheduling and QoS part 2Advanced networking scheduling and QoS part 2
Advanced networking scheduling and QoS part 2
 
Quality of service
Quality of serviceQuality of service
Quality of service
 
QoS In The Enterprise
QoS In The EnterpriseQoS In The Enterprise
QoS In The Enterprise
 
Performance Analysis of Creido Enhanced Chord Overlay Protocol for Wireless S...
Performance Analysis of Creido Enhanced Chord Overlay Protocol for Wireless S...Performance Analysis of Creido Enhanced Chord Overlay Protocol for Wireless S...
Performance Analysis of Creido Enhanced Chord Overlay Protocol for Wireless S...
 
Vsat day-2008-comtech
Vsat day-2008-comtechVsat day-2008-comtech
Vsat day-2008-comtech
 
Chapter13
Chapter13Chapter13
Chapter13
 
Qo s rsvp......
Qo s rsvp......Qo s rsvp......
Qo s rsvp......
 
Presentacion QoS.pptx
Presentacion QoS.pptxPresentacion QoS.pptx
Presentacion QoS.pptx
 
Protocol and Interfaces - IPv4, IPv6, X.25 Protocol, X.75 Protocol
Protocol and Interfaces - IPv4, IPv6, X.25 Protocol, X.75 ProtocolProtocol and Interfaces - IPv4, IPv6, X.25 Protocol, X.75 Protocol
Protocol and Interfaces - IPv4, IPv6, X.25 Protocol, X.75 Protocol
 
Protocols and Interfaces - IPv4, IPv6, X.25, X.75
Protocols and Interfaces - IPv4, IPv6, X.25, X.75Protocols and Interfaces - IPv4, IPv6, X.25, X.75
Protocols and Interfaces - IPv4, IPv6, X.25, X.75
 
Mpls te
Mpls teMpls te
Mpls te
 
Chapter14ccna
Chapter14ccnaChapter14ccna
Chapter14ccna
 
Neutron qos overview
Neutron qos overviewNeutron qos overview
Neutron qos overview
 

Recently uploaded

Hierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementHierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementmkooblal
 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxthorishapillay1
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxmanuelaromero2013
 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17Celine George
 
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxiammrhaywood
 
Presiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsPresiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsanshu789521
 
Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Celine George
 
Solving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxSolving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxOH TEIK BIN
 
भारत-रोम व्यापार.pptx, Indo-Roman Trade,
भारत-रोम व्यापार.pptx, Indo-Roman Trade,भारत-रोम व्यापार.pptx, Indo-Roman Trade,
भारत-रोम व्यापार.pptx, Indo-Roman Trade,Virag Sontakke
 
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdfEnzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdfSumit Tiwari
 
Pharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdfPharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdfMahmoud M. Sallam
 
Meghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media ComponentMeghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media ComponentInMediaRes1
 
Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...jaredbarbolino94
 
Employee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxEmployee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxNirmalaLoungPoorunde1
 
Final demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptxFinal demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptxAvyJaneVismanos
 
Roles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceRoles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceSamikshaHamane
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentInMediaRes1
 
Crayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon ACrayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon AUnboundStockton
 

Recently uploaded (20)

Hierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementHierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of management
 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptx
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptx
 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17
 
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
 
Presiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsPresiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha elections
 
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
 
Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17
 
Solving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxSolving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptx
 
भारत-रोम व्यापार.pptx, Indo-Roman Trade,
भारत-रोम व्यापार.pptx, Indo-Roman Trade,भारत-रोम व्यापार.pptx, Indo-Roman Trade,
भारत-रोम व्यापार.pptx, Indo-Roman Trade,
 
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdfEnzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
 
Pharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdfPharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdf
 
Meghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media ComponentMeghan Sutherland In Media Res Media Component
Meghan Sutherland In Media Res Media Component
 
Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...
 
Employee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxEmployee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptx
 
Final demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptxFinal demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptx
 
Roles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceRoles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in Pharmacovigilance
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media Component
 
Crayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon ACrayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon A
 
ESSENTIAL of (CS/IT/IS) class 06 (database)
ESSENTIAL of (CS/IT/IS) class 06 (database)ESSENTIAL of (CS/IT/IS) class 06 (database)
ESSENTIAL of (CS/IT/IS) class 06 (database)
 

CCIE Routing and Switching Written Exam Version 5.0 Nexus QoS Deep Dive

  • 1. CCIE Routing and Switching Written Exam Version 5.0
  • 2. Session Objectives • Provide a refresh of QoS and Queuing Basics • Understand the basic hardware architecture for the Nexus Platforms • Provide a detailed understanding of QoS on Nexus platforms • Examine real-world configuration examples
  • 3. Session Non-Objectives • Data Center QoS Methodology • Nexus hardware architecture deep-dive • Application Centric Infrastructure (ACI) QOS
  • 4. Related Sessions Session Id Session Name BRKARC-3470 Cisco Nexus 7000/7700 Switch Architecture BRKARC-3452 Cisco Nexus 5600 and 6000 Architecture BRKDCT-1980 Advanced Analytics in Nexus Switches BRKRST-2509 Mastering Data Center QoS
  • 5. Agenda • Introduction • QoS and Queuing Basics • QoS Implementation on Nexus • Nexus 7000/7700 QoS • Nexus 5600/6000 QoS • Nexus 2000 QoS • Real World Configuration Examples • Conclusion
  • 10. Why QoS in the Data Center? 10 Assign Color to Traffic Maximize Throughput Manage Congestion Maximize Throughput and Manage Congestion!
  • 11. Agenda • Introduction • QoS and Queuing Basics • QoS Implementation on Nexus • Nexus 7000/7700 QoS • Nexus 5600/6000 QoS • Nexus 2000 QoS • Real World Configuration Examples • Conclusion
  • 12. QoS and Queuing Basics
  • 13. The QoS Toolset 13 Classification Identify and Split Traffic into Different Classes Queuing & Scheduling Prioritize, Protect and Isolate Traffic Based on Markings Marking Mark Traffic According to Behavior and Business Policies Policing Discard Misbehaving Traffic to Maintain Network Integrity Shaping Control Bursts and Conform Traffic 22nd Anniversary
  • 14. Traffic Management Tools • Classification • Traffic Categorization • Marking • Traffic Re-categorization • Policing • Limit misbehaving flows
  • 15. Classification and Marking – Two sides of a coin 15 Mad Max (1979) HTTPVoIP email Videop2p App1 vmotion mgmtlync backup Before: Uncontrolled Bandwidth VoIP/Lync Email/HTTP SAP Backup After: Controlled Bandwidth • Identify traffic • DSCP • CoS • ACLs • IP PREC • Remap Traffic • Like to Like (i.e CoS to CoS) • Like to Unlike (i.e DSCP to COS) • Needs mapping tables • Also called Mutation
  • 16. Policing – limit misbehaving traffic 16 Mad Max (1979) • Single rate Two Color Policer • Conform Action (permit) • Exceed Action (drop) Tokens Burst Limit Conforming Traffic Excess Traffic • Two rate Three Color Policer • Conform Action (permit) • Exceed Action (markdown) • Violate Action (drop)
  • 17. Congestion Management Tools • Buffering • Storing packets in memory • Queuing • Buffering packets according to traffic class • Scheduling • Order of transmission of buffered packets • Shaping • Smooth bursty traffic
  • 18. Buffering – Why do we need it? • Speed Mismatch • Client to WAN to Server 18 • Many to One Conversations • Client to Server • Server to Storage • Aggregation Points 1 GE 1 GE 1 GE 1 GE 10 GE10 GE http://www.testbells.com/400-101.html
  • 19. Scheduling – Who goes first • Defines Order of transmission • The Priority-Queue always serviced first • Normal Queues serviced only after Priority Queue empty • Different Scheduling algorithms for normal queues 19 http://www.testbells.com/400-101.html
  • 20. Common Scheduling Algorithms • Round Robin (RR) • Simple and Easy to implement • Starvation-free • Weighted Round Robin (WRR) • Serves n packets per non-empty queue • Assumes a mean packet size • Deficit Weighted Round Robin – Variable sized packets – Uses a deficit counter • Shaped Round Robin – More even distributed ordering – Weighted interleaving of flows
  • 21. 4 Class Queuing Model example Class CoS Queues Priority 5-7 PQ No-Drop 3, 4 Q2 Better than Best-Effort 2 Q1 Best-Effort 0, 1 Default-Q
  • 22. 8 Class Queuing Model Class DSCP Queues Priority CS6 (CS7) PQ Platinum EF Gold AF41 Q7 Silver CS4 Q6 No-Drop CoS3 Q5 Bronze AF21 Q4 Management CS2 Q3 Scavenger AF11 Q2 Bulk Data CS1 Q1 Best-Effort 0 Default-Q • Matches often a Campus QoS concept • No-Drop still with CoS3 (DSCP 24- 30 are “unusable”) • Valid but most complex Classification to Marking implementation as per regards to No-Drop
  • 23. Congestion Avoidance Tools • Tail Drop (TD) • Drop packets at tail of the queue • Single threshold per queue • Weighted Random Early Drop (WRED) • One or more thresholds per queue • Threshold associated with DSCP or COS
  • 24. Putting it all together! 24 Egress Port PQ1 Q2 Q3 Q-Default Scheduler DWRR Drop Threshold 4 Drop Threshold 3 Drop Threshold 2 Drop Threshold 1 Normal Queue Packet is placed in the Egress Queue according to CoS/DSCP value. 1 Normal Queues have Threshold and drop packet accordingly 4 Priority Queue always served first 2 Normal Queues served after PQ is empty according to Scheduler 3 data L2 CoS [3] L3 DSCP [24] COS Queue 5, 6, 7 PQ1 3, 4 Q3 2 Q2 0, 1 Q-Default
  • 25. Congestion could result in….. 25 Head Line Blockingof
  • 26. Head of Line Blocking What is the Problem? 26 No Congestion Red Cars blocked!
  • 27. Head of Line Blocking Solution – Create Separate Lanes but… 27 Cars turned back Stadium Full
  • 28. Head of Line Blocking Solution – Have an arbiter 28 Supermarket Not Full Stadium Full
  • 29. Head of Line Blocking What is the Problem? 29 Ingress Module Egress Module Ingress Module Egress Module Ingress Module Egress Module Crossbar Fabric buffer
  • 30. Virtual Output Queues Avoid Head of Line Blocking 30 Ingress Module Egress Module Ingress Module Egress Module Ingress Module Egress Module Crossbar Fabric Ingress VOQ
  • 31. Virtual Output Queues Avoid Head of Line Blocking 31 Ingress Module Egress Module Ingress Module Egress Module Ingress Module Egress Module Crossbar Fabric Ingress VOQ buffer
  • 32. Agenda • Introduction • QoS and Queuing Basics • QoS Implementation on Nexus • Nexus 7000/7700 QoS • Nexus 5600/6000 QoS • Nexus 2000 QoS • Real World Configuration Examples • Conclusion
  • 34. 3 Block Construct Nexus uses Modular QOS CLI (MQC) 34 What Traffic do we care about? • DSCP • CoS • IPPREC • ACLs Class-Map Where do I apply this policy? • System Wide • Vlan • Interface (in/out) • Port-channels Service-Policy What action do I take on these classes? • Policing • Marking • Scheduling Policy-Map
  • 35. New QoS Capabilities Priority Flow Control (802.1Qbb) • Enables Lossless Ethernet using per COS pause • During congestion, no-drop COS is paused • Primarily for FCoE (COS 3) 35
  • 36. New QoS Capabilities • DCBXP (802.1Qaz) • LLDP with new TLV Values • Negotiates capabilities (like PFC) with other devices • ECN (Explicit Congestion Notification) • Congestion Notification without dropping packets • Uses two LSB bits in DiffServ field in IP header 36 DiffServ Field Values 0x00 – Non ECN Capable 0x10 – ECN Capable Transport (0) 0x01 – ECN Capable Transport (1) 0x11- Congestion Encountered
  • 37. Network-QoS Policy • Should be consistent across all switches in network • Supported on F-cards on Nexus 7x00 and Nexus 5x00,6000,9000 • Applied on the system-qos target in admin (or default) vdc • Configures the following • Pause Behavior (PFC) • MTU (per VL) • Congestion Control (TD or WRED) 37 Nexus(config)# system qos Nexus(config-sys-qos)# service-policy type network- qos my_template
  • 38. Three Different Types 38 Network-QoS •Congestion-Control •Pause / MTU per VL QoS •Marking •Policing •Mutation Queuing •Buffering •Queuing •Scheduling Policy-map QoS •CoS •DSCP •PREC •ACLs Queuing •CoS •DSCP Class-map Service-policy QoS •Interfaces •Vlans •Port-channel •System-qos Queuing •Interfaces •Port-channels •System-qos Network-QoS •System-qos Network-QoS •CoS •Protocol (fcoe)
  • 39. VLAN based QoS Policy attachment • VLAN based QoS Policy is configured in VLAN Database • No SVI (aka L3 VLAN Interface) required 39 Nexus(config)# vlan configuration <vlan-id> Nexus(config-vlan)# service-policy input myPolicy Routed Port Access Port 802.1q Trunk Routed Port Access Port 802.1q Trunk VLAN VLAN QoS Polcies Service Policy applied to the VLAN Database
  • 40. Interface based QoS Policy attachment • Interface based QoS Policy takes precedence over VLAN • Can also be attached to port- channel and applies to all member- ports • No Egress QoS policies on L2 ports! 40 Nexus(config)# interface ethernet 1/1 Nexus(config-if)# service-policy input myPolicy Routed Port Access Port 802.1q Trunk Routed Port Port-channel QoS Policies Service policy applied to the switchport Service Policy applied to the Switchport … … or the Routed Port … or a port- channel
  • 41. Interface based Queuing Policy attachment • Interface based QoS Policy takes precedence over VLAN • Interface based QoS Policy is configured under the respective Interface • Queuing Policy can be attached to port-channel also 41 Nexus(config)# interface ethernet 1/1 Nexus(config-if)# service-policy input myPolicy Routed Port Access Port 802.1q Trunk Routed Port QoS Policies Service policy applied to the switchport Service Policy applied to the Switchport … … or the Routed Port … or a port- channel Port-Channel
  • 42. To Trust or Not To Trust? • Data Centre architecture provides a new set of trust boundaries • Virtual Switch extends the trust boundary into the Hypervisor • Nexus Switches always trust CoS and DSCP 42
  • 43. Agenda • Introduction • QoS and Queuing Basics • QoS Implementation on Nexus • Nexus 7000/7700 QoS • Nexus 5600/6000 QoS • Nexus 2000 QoS • Real World Configuration Examples • Conclusion
  • 45. Nexus 7000 / 7700 I/O Module Families M1 1G and 10G M2 10G / 40G / 100G F1 10G F2 10G F2E 10G F3 40G F2E 10G F3 10G / 40G / 100G
  • 46. 12 X 10G MAC / LinkSec Forwarding Engine VOQs Fabric 2 ASIC To Fabric Modules Replication Engine Replication Engine Front Panel Ports LC CPU EOBC VOQs 1 2 3 4 5 6 7 8 9 10 11 12 12 X 10G MAC / LinkSec Forwarding Engine VOQs Replication Engine Replication Engine VOQs 242322212019181716151413 To Central Arbiters Arbitration Aggregator … M2 I/O Module Architecture 46 BRKARC-3470 Cisco Nexus 7000 / 7700 Switch Architecture
  • 47. Ingress Module Egress ModuleCrossbar Fabric M2 I/O QoS Packet-Flow (10G) 47 Ingress VoQ-ASIC 1p3q1t 1 2 3 4 VOQ Ingress port-ASIC Ingress1 2 3 4 5 6 7 8 8q2t Egress port-ASIC Egress 1p7q4t 1 2 3 4 5 6 7 8 Egress VoQ-ASIC Egress FIFO 1 Arbiter 8 3 8 1 Forwarding Engine CoS to Queue-Mapping >Policy Type “queuing” (Scheduling, Buffering) 1 Default CoS-to-Queue map: CoS [2] to Default-Q (8) 2 >Policy Type “qos” (Mutation, Classification, Marking, Policing) 3 VoQ gets assigned based on Dest + CoS value 4 Credit Grant for Fabric Access 5 Traffic gets forwarded over Fabric 6 Return Credit to Pool 8 Traffic gets Received on Egress VoQ 7 CoS to Queue-Mapping >Policy Type “queuing” (Scheduling, Buffering) 9 Default CoS-to-Queue map: CoS [2] to Default-Q (8) 10 data L2 CoS [2] L3 DSCP [24] data L2 CoS [2] L3 DSCP [24]
  • 48. Ingress Module Egress ModuleCrossbar Fabric M2 I/O QoS Packet-Flow (40G/100G) 48 Ingress VoQ-ASIC 1p3q1t 1 2 3 4 VOQ Ingress port-ASIC Ingress1 2 3 4 5 6 7 8 8q2t Egress port-ASIC Egress 1p7q4t 1 2 3 4 5 6 7 8 Egress VoQ-ASIC Egress FIFO 1 Arbiter 8 3 8 1 Forwarding Engine CoS to Queue-Mapping >Policy Type “queuing” (Scheduling, Buffering) 1 Default CoS-to-Queue map: CoS [2] to Default-Q (8) 2 >Policy Type “qos” (Mutation, Classification, Marking, Policing) 3 VQI gets assigned based on 5-Tuple flow information 41 Credit Grant for Fabric Access 5 Traffic gets forwarded over Fabric 6 Return Credit to Pool 8 Traffic gets Received on Egress VoQ 7 CoS to Queue-Mapping >Policy Type “queuing” (Scheduling, Buffering) 9 Default CoS-to-Queue map: CoS [2] to Default-Q (8) 10 VoQ gets assigned based on VQI + CoS 42 data L2 CoS [2] L3 DSCP [24] data L2 CoS [2] L3 DSCP [24]
  • 49. M2 I/O Module Buffering Capacity M2 Module Ingress Queue Structure Ingress Port Buffer Ingress VOQ Buffer 24-port 10G N7K-M224XP-23L 8q2t 5.2MB / port 4.5MB / port 6-port 40G N7K-M206FQ-23L 8q2t 20.8MB / port 18MB / port 2-port 100G N7K-M202CF-22L 8q2t 62.8MB / port 54MB / port M2 Module VOQ Structure Egress VOQ Buffer (Credited) Egress VOQ Buffer (Uncredited) Egress Queue Structure Egress Port Buffer 24-port 10G N7K-M224XP-23L 1p4q 295KB / port 512KB / 6 ports 1p7q4t 5MB / port 6-port 40G N7K-M206FQ-23L 1p4q 1.2MB / port 1MB / 3 ports 1p7q4t 20.7MB / port 2-port 100G N7K-M202CF-22L 1p4q 3MB / port 1MB / port 1p7q4t 30.2MB / port Ingress Egress
  • 50. 8 X 10G SoC 1 Nexus 7700 F3 48-Port 1G/10G Module Architecture To Fabric Modules FSA CPU EOBC To Central Arbiters Arbitration Aggregator 8 X 10G SoC 2 8 X 10G SoC 3 8 X 10G SoC 4 8 X 10G SoC 5 8 X 10G SoC 6 55Gbps 6 X 110Gbps Fabric ASIC Fabric ASIC 6 X 110Gbps 55Gbps LC Inband 1G per SOC …x 6 1 Front Panel Ports (SFP/SFP+) 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 LinkSec-capable to LC CPU
  • 51. Nexus 7000/ 7700 F2 48-Port 1G/10G Module Architecture 51 4 X 10G SoC Front Panel Ports To Fabric Modules Fabric 2 2 4 LC CPU EOBC To Central Arbiters Arbitration Aggregator … 4 X 10G SoC 6 8 4 X 10G SoC 10 12 4 X 10G SoC 14 16 4 X 10G SoC 18 20 4 X 10G SoC 22 24 4 X 10G SoC 26 28 4 X 10G SoC 30 32 4 X 10G SoC 34 36 4 X 10G SoC 38 40 4 X 10G SoC 42 44 4 X 10G SoC 46 48 1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 LinkSec-capable (F2E fiber only) LinkSec-capable (F2E copper only)
  • 52. 2 X 40G SoC 1 Nexus 7700 24-Port 40G Module Architecture 1 Front Panel Ports (QSFP+) To Fabric Modules FSA CPU EOBC To Central Arbiters Arbitration Aggregator 2 X 40G SoC 2 2 X 40G SoC 3 2 X 40G SoC 4 2 X 40G SoC 5 2 X 40G SoC 6 2 X 40G SoC 7 2 X 40G SoC 8 2 X 40G SoC 9 2 X 40G SoC 10 2 X 40G SoC 11 2 X 40G SoC 12 55Gbps 6 X 110Gbps Fabric ASIC Fabric ASIC 6 X 110Gbps 55Gbps LC Inband 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 1G switch 6 x 1G 1G per SOC… …x 12
  • 53. Nexus 7700 12-Port 100G Module Architecture Front Panel Ports (CPAK) To Fabric Modules To Central Arbiters Arbitration Aggregator 1 X 100G SoC 2 2 1 X 100G SoC 3 3 1 X 100G SoC 4 4 1 X 100G SoC 5 5 1 X 100G SoC 6 6 1 X 100G SoC 7 1 X 100G SoC 8 1 X 100G SoC 9 1 X 100G SoC 10 1 X 100G SoC 11 55Gbps 6 X 110Gbps Fabric ASIC Fabric ASIC 6 X 110Gbps 7 8 9 10 11 55Gbps 1 X 100G SoC 12 12 1 X 100G SoC 1 1 FSA CPU EOBC LC Inband 1G switch 6 x 1G 1G per SOC… …x 12
  • 54. Decision Engine Ingress Parser F3 SoC Virtual Queuing Ingress Buffer Port Logic Egress Buffer F3 SoC Architecture Egress Parser Layer 2 Lookups Layer 3 Lookups Classification Marking / Policing Front Panel Ports 8x10G 2x40G 1x100G To Central Arbiter To Local Fabric From Local Fabric
  • 55. Egress SOCIngress SOC Ingress Buffer F3 10G Buffering Model FABRIC Egress Buffer VQI 8 10G Port 1 10G Port 8 DWRR SP 10G Port 1 10G Port 8 8 priority levels 1.5MB 4 ingress queues per port Virtual Queuing 8K VOQs (1K Dest + 8 priority levels) Ingress Buffer – Manages congestion toward egress destinations Buffering / queuing INGRESS QUEUING POLICIES Egress Scheduling Central Arbiter Virtual Queuing / Egress Buffer – Receives frames from fabric; Schedules frame transmission Scheduling EGRESS QUEUING POLICIES … VQI 1 DWRR SP … 1.5MB
  • 56. Egress SOCIngress SOC Ingress Buffer F3 40G Buffering Model FABRIC Egress Buffer VQI 1 VQI 2 40G Port 1 40G Port 2 DWRR SP DWRR SP 40G Port 1 40G Port 2 8 priority levels4 ingress queues per port Virtual Queuing 8K VOQs (1K VQIs + 8 priority levels) Ingress Buffer – Manages congestion toward egress destinations (VQIs) Buffering / queuing INGRESS QUEUING POLICIES Egress Scheduling Central Arbiter Virtual Queuing / Egress Buffer – Receives frames from fabric; Schedules frame transmission Scheduling EGRESS QUEUING POLICIES 6MB 6MB
  • 57. Egress SOCIngress SOC Ingress Buffer F3 100G Buffering Model FABRIC Egress Buffer VQI 1 100G Port 1 DWRR SP 100G Port 1 8 priority levels 12MB 4 ingress queues per port Virtual Queuing 8K VOQs (1K VQIs + 8 priority levels) Ingress Buffer – Manages congestion toward egress destinations (VQIs) Buffering / queuing INGRESS QUEUING POLICIES Egress Scheduling Central Arbiter Virtual Queuing / Egress Buffer – Receives frames from fabric; Schedules frame transmission Scheduling EGRESS QUEUING POLICIES
  • 58. Decision Engine Ingress Parser CL TCAM F2E/F3 SoC Port Logic Virtual Queuing Ingress Buffer Layer 2 Lookups Layer 3 Lookups Classification Marking / Policing F2E/ F3 SoC Port Logic Egress Buffer Module 2 e2/1 Fabric ASIC Fabric Module 1 Fabric ASIC Supervisor Engine Central Arbiter Module 1 e1/1 Fabric Module 2 Fabric ASIC Fabric Module 3 Fabric ASIC Fabric Module 4 Fabric ASIC Fabric Module 5 Fabric ASIC Fabric ASIC e1/1 e2/1 e2/1 DWRRSP F2E/F3 QoS Packet Walk PKT HDR HDRPKT Req Credit Credit PKT HDR Receive packet from wire Ingress packet parsing Packet headers sent to DE Payload queued in port buffer based on COS / DSCP Buffer credit granted Check VQ drop thresholds All L2 + L3 lookups / Ingress + egress QoS classification / Ingress + egress marking and policing CL TCAM contains QoS classification rules Final lookup result: destination + priority Transmit to fabric Receive from fabric Schedule and transmit on wire Buffer on egress based on dest+ priority Queue packet descriptor in VOQ (dest + priority) Return buffer credit (dest + priority) Request buffer credit for dest + priority
  • 59. Ingress Queuing – Logical View 59 CoS 0-4 (Q-Default) CoS 5-7 (Q1) 8e Template CoS 3 (Q4) CoS 5-7 (Q1) 7e Template CoS 0,1 (Q-Default) CoS 2,4 (Q3) CoS 0-2 (Q-Default) CoS 5-7 (Q1) 6e Template CoS 4 (Q3) CoS 3 (Q4) CoS 0 (Q-Default) CoS 5-7 (Q1) 4e Template CoS 4 (Q3) CoS 1-3 (Q4) High (Pause) Threshold Low (Resume) Threshold 8e-4q4q Template CoS 3-4 (Q3) CoS 5-7 (Q1) CoS 2 (Q4) CoS 0-1 (Q-Default)
  • 60. Egress Queuing – Logical View 60 EgressPort Q2 PQ1 Q3 Q-Def default-4q-7e-out-policy Q-Def. (0,1) PQ1 (5,6,7) Q3 (2,4) Q2 (3) DWRR Priority DWRR 50% 50% EgressPort PQ2(H) PQ3(L) PQ1 Q-Def default-4q-6e-out-policy Q-Def. (0-2) PQ3 (3) PQ1 (5,6,7) PQ2. (4) DWRR PrioPrio DWRR 100% EgressPort PQ1(H) Q-Def PQ2(L) Q3 default-4q-4e-out-policy Q3 (1,2,3) Q-Def. (0) PQ2 (4) PQ1 (5,6,7) DWRR DWRR PrioPrio DWRR 100% 100% red indicates no-drop EgressPort PQ1 Q2 Q3 Q-Def DWRR default-4q-8e-out-policy Q-Def. (0,1) Q2 (3,4) Q3 (2) PQ1 (5,6,7) Priority 33%33%33% EgressPort PQ1 Q2 Q3 Q-Def DWRR default-4q4q-8e-out-policy Q-Def. (0,1) Q2 (3,4) Q3 (2) PQ1 (5,6,7) Priority 33%33%33%
  • 61. F I/O Module Buffering Capacity Module Total VOQ Buffer Per Module Ingress Queue Structure Ingress VOQ Buffer 48-port 10G F2E N77-F248XP-23E 72MB 4q1t 1.5MB / port F3 48-port 10G N77-F348XP-23 72MB 4q1t 1.5MB / port F3 24-port 40G N77-F324FQ-25 144MB 4q1t 6MB / port F3 12-port 100G N77-F312CK-26 144MB 4q1t 12MB / port Module Egress VOQ Structure Egress VOQ Buffer (Credited) Egress VOQ Buffer (Uncredited) 48-port 10G F2E N77-F248XP-23E 1p7q1t 295KB / port 256KB / 4 ports F3 48-port 10G N77-F348XP-23 1p7q1t 295KB / port 512KB / 8 ports F3 24-port 40G N77-F324FQ-25 1p7q1t 1.1MB / port 512KB / 2 ports F3 12-port 100G N77-F312CK-26 1p7q1t 2.2MB / port 512KB / 1 port Ingress Egress
  • 62. N7k# show policy-map type queuing | beg default 4q-8e policy-map type queuing default-4q-8e-in-policy class type queuing 2q4t-8e-in-q1 queue-limit percent 10 bandwidth percent 50 class type queuing 2q4t-8e-in-q-default queue-limit percent 90 bandwidth percent 50 policy-map type queuing default-4q-8e-out-policy class type queuing 1p3q1t-8e-out-pq1 priority level 1 class type queuing 1p3q1t-8e-out-q2 bandwidth remaining percent 33 class type queuing 1p3q1t-8e-out-q3 bandwidth remaining percent 33 class type queuing 1p3q1t-8e-out-q-default bandwidth remaining percent 33 Network-QoS and Default Queuing (global) • default-nq-8e-policy is default network-qos policy and attached to system qos in Admin-/Default- VDC • The system queuing policy applied by default can be overridden on a per port basis. 62 Note: show policy-map system does display similar output 2 ingress queues with buffer ratio 1:9 and DWRR wieights 1:1 4 egress queues with one priority queue and DWRR wieights 1:1:1
  • 63. CoS or DSCP to Queue Mapping • Default CoS to Queue Mapping for Nexus 7000/7700 (F- and M-Series I/O Module) • Ingress: CoS to Queue • Egress: CoS to Queue • DSCP to Queue Mapping for Nexus 7000/7700 (F- and M-Series I/O Module) • Ingress: DSCP to Queue • Egress: CoS to Queue • Global Configuration (Admin/Default VDC) required to enable DSCP to Queue Mapping: 63 N7k(config)# hardware qos dscp-to-queue ingress module type {all | f-series | m-series}
  • 64. Changing the Default Trust 64 802.1q Trunk / Access Port Ingress Queues Egress Queues routed/bridged CoS CoS q-1 q-n Note: CoS is used for egress queue selection, even if the egress interface does NOT carry CoS in the frame q-default Set CoS 0 (will only set CoS to 0) data L2 CoS [0] L3 DSCP [24] Set DSCP 0 (will set DSCP + CoS to 0) L3 DSCP [0] data L2 CoS [0] L3 DSCP [0] data L2 CoS [2] L3 DSCP [24] 802.1q Trunk
  • 65. Changing The Default Trust (M-Series I/O Module) • You can make an interface untrusted (CoS & DSCP) • CoS for bridged traffic • DSCP for routed traffic • You need two Policies • A "type queuing" policy to set the CoS to 0 • A "type qos" policy to set the DSCP to 0  Set DSCP will set the CoS value for Bridged traffic as well. 65 policy-map type queuing Reset-CoS class type queuing 8q2t-in-q-default set cos 0 bandwidth percent 100 queue-limit percent 100 ! policy-map type qos Reset-DSCP class class-default set dscp 0 ! ! Tie to an interface: interface Ethernet1/1 service-policy type queuing input Reset-CoS service-policy type qos input Reset-DSCP
  • 66. Changing The Default Trust (F-Series I/O Module) 66 qos copy policy-map type queuing default-4q-8e-in-policy prefix UNTRUSTED- ! policy-map type queuing untrusted-4q-8e-in class type queuing 2q4t-8e-in-q1 queue-limit percent 1 class type queuing 2q4t-8e-in-q-default queue-limit percent 99 set cos 0 ! policy-map type qos UNTRUSTED class class-default set dscp 0 ! ! Tie to an interface: interface Ethernet1/1 service-policy type queuing input untrusted-4q-8e-in service-policy type qos input UNTRUSTED
  • 67. Nexus 7000 QoS Golden Rules • QoS is enabled by default and cannot be disabled • CoS and DSCP are TRUSTED by default • Default Queuing and QoS policies are applied to all physical interfaces across all VDCs • For bridged traffic, CoS is preserved, DSCP is unmodified • For routed traffic, DSCP is copied to CoS (first 3 bits) • Ex: DSCP 40 (b101000) becomes CoS 5 (b101)
  • 68. Agenda • Introduction • QoS and Queuing Basics • QoS Implementation on Nexus • Nexus 7000/7700 QoS • Nexus 5600/6000 QoS • Nexus 2000 QoS • Real World Configuration Examples • Conclusion
  • 70. Cisco Nexus 5600/6000 Overview 70 High Performance High Scalability Feature-Rich Visibility and Analytics • Line rate L2 and L3 • 1-us port-to-port latency • 25-MB buffer per port ASIC • 10 GE and true 40 GE • Up to 224,000 MAC • Up to 128,000 ARP • L2 and L3 features • vPC and FabricPath • FC and FCOE • VXLAN Bridging and Routing • Line-rate SPAN • Sampled NetFlow • Micro-burst monitoring • Latency monitoring
  • 71. Egress VOQ buffer Ingress VOQ buffer Ingress Module Egress Module Ingress Module Ingress Module Crossbar Fabric Ingress Buffering Model Nexus 5600/6000 compared to Nexus 7000 F-Series I/O Module 71 Ingress VOQ buffer – Manages congestion toward egress destinations Egress VOQ buffer – Receives frames from fabric; also buffers multi-destination frames Egress VOQ buffer Ingress VOQ buffer Nexus 7000 F-Series I/O Module
  • 72. Key Concepts – Common Points • Nexus 5000/6000 & Nexus 7000 F-Series I/O Modules share the Ingress Buffer Model • Ingress buffering and queuing occur at VOQ of each ingress port • Egress scheduling enforced by egress port • No Egress QOS Policies Nexus 7000 compared to Nexus 5000/6000 QoS 72
  • 73. Cisco Nexus 5600/6000 QoS Features • Traffic classification ‒ DSCP, CoS, IP Precedence and ACL • Packet marking ‒ DSCP, CoS, and ECN • Strict Priority Queuing and DWRR ‒ Priority Flow Control ‒ DCBX 802.1Qaz • Ingress policing (No egress policing) ‒ 4096 policers per ASIC • Flexible buffer management
  • 74. Unified Ports Nexus 5672UP Architecture Overview UPC 1 24xSFP+ Fabric 6xQSFP+ CPU Supervisor UPC-0UPC 2 UPC 3 UPC 4 UPC 5 UPC 6 24xSFP+ Slot 1 Slot 2
  • 75. UPC 1 24x SFP+ Fabric 2x QSFP+ CPU Supervisor Nexus 56128PQ Internal Architecture UPC 2 UPC 3 UPC 4 UPC 5 UPC 6 24x SFP+ 2x QSFP+ * Changing the port speed on UPC5 will reload the system. Expansion Slot 2 Expansion Slot 3 Slot 1
  • 76. Packet Buffering • 25MB packet buffer is shared by every three 40 GE ports or twelve 10 GE ports. • Buffer is 16MB at ingress and 9MB at egress. • Unicast packet can be buffered at both ingress and egress. 448 Gbps 224 Gbps Ingress UPC Egress UPC UnicastVOQMulticastVOQ Unified Crossbar Fabric 16MB 9MB
  • 77. Nexus 5600 QoS Packet Walk Crossbar Fabric MAC Traffic Classification Ingress Cos/DSCP Marking Forwarding VoQs (8 per egress port) Egress Queues Trust CoS/DSCP and Match on COS/DSCP/ACL Make a forwarding decision If Buffer Usage Crosses Threshold: • Tail drop for drop class • Assert Pause for no-drop COS Strict Priority + DWRR Scheduling MAC Ingress UPC Ingress Policing WRED/ECN Marking Egress Scheduling Egress UPC Per-class Buffer Usage Monitoring Ingress Buffer Egress Buffer
  • 78. Flexible Buffer Management Ingress Buffer • Shared buffer is good for burst absorption. • Dedicated buffer is good for predictable performance for each port. • On by default, no configuration needed • Long-distance FCoE, video editing (i.e., AVID), Big Data, and distributed storage Port 1 Dedicated Port 2 Dedicated Port 3 Dedicated Shared Packet Buffer SPAN Control UPC Ingress Buffer (16MB)
  • 79. WRED/ ECN Configuration • ECN parameters are configurable only at system level. • ECN is enabled by default along with WRED • Packet Threshold below minimum – Transmit • Packet Threshold between minimum and maximum – Mark ECN bits • Packet Threshold above maximum – Drop switch(config)# hardware random-detect min-thresh 10g 10g-min-threshold 40g 40g-min- threshold max-thresh 10g 10g-max-threshold 40g 40g-max-threshold ecn qos-group qos- group-number
  • 80. Nexus 5600/6000 QoS Configuration Model • Uses QOS-Groups to tie together QoS, Queuing and Network-QoS policies • QoS-Group has no direct relation with CoS value • QoS-Groups defined (set) in policy-map type qos. • QoS-groups referenced (match) in policy type queuing and policy-map type network- qos
  • 81. Putting it all together class-map type qos class_foo match cos 3-4 policy-map type qos pm1 class type qos class_foo set qos-group 1 police cir 20 mbytes conform transmit violate drop class type qos class-default set qos-group 0 interface ethernet 1/1 service-policy type qos input pm1 class-map type queuing class-foo match qos-group 1 policy-map type queuing policy-foo class type queuing class-foo bandwidth percent 20 class type queuing class-default bandwidth percent 80 interface ethernet 1/3 service-policy type queuing input policy-foo Create class-map type qos and match on cos/dscp/acls Create policy-map type qos and set qos-group and/or add policing rule Attach policy-map type qos as input to an interface Attach policy-map queuing to interface Create policy-map type queuing and create actions Create class-map type queuing and match on qos- group
  • 82. Buffering and Scheduling Considerations • Buffering is achieved via policy-map type network-qos where queue- limit can be configured • Scheduling is configured with policy-map type queuing where priority & bandwidth for DWRR is defined • Queuing Policy can be attached in both direction, ingress and egress • Egress controls how the traffic is leaving the Switch • Ingress controls how a attached DCBX capable Device is sending • Queuing will be configured with policy-map type queuing and does NOT interfere with policy-map type qos 82 N5k# show interface ethernet 1/1 capabilities | i Model|QOS Model: N5K-C5672UP-SUP QOS scheduling: rx-(6q1t),tx-(1p6q0t)
  • 83. Buffering Capacity Traffic Type Ingress Queue Structure 10 GE Port 40 GE Port Control traffic (per port) 6q1t 64 KB 67 KB Span Traffic (per Port) 6q1t 38.4 KB 154 KB Class Default (per Port) 6q1t 100 KB 100 KB Shared Buffer 6q1t 13.2 MB 14.7 MB Traffic Type Egress Queue Structure 10 GE Port 40 GE Port Unicast 1p5q0t 363 KB 650 KB with 10GB Fabric Mode 635 KB with 40GB Fabric Mode Multicast 1p5q0t 4.3MB 6.6 MB Ingress Egress
  • 84. Nexus 5600/6000 QoS Golden Rules • ECN/WRED is enabled by default and cannot be disabled • CoS and DSCP are TRUSTED by default • Use QoS-Groups to tie policies together • No Egress QOS policies
  • 85. Agenda • Introduction • QoS and Queuing Basics • QoS Implementation on Nexus • Nexus 7000/7700 QoS • Nexus 5600/6000 QoS • Nexus 2000 QoS • Real World Configuration Examples • Conclusion
  • 87. FEX Overview • Scalable and Extensible Fabric • Single point of management • Homogeneous and consistent policies
  • 88. Cisco Nexus 2000 QoS Features • Traffic classification ‒ DSCP, CoS ‒ ACL classification (FEX offload) –only on 5600/6000 • Strict Priority Queuing and DWRR ‒ Priority Flow Control • Queue-limit Carving
  • 89. Nexus Parent FEX QoS Policies • Support for ingress port-based QoS policies on FEX HIF ports • Support for ingress/egress VLAN-based QoS policies on FEX VLANs • FEX QoS policies applied at ingress module of parent switch • No support for remarking, policing policies FEX Module /Port Module /Port FEX Ingress port- based QoS policy Ingress/egress VLAN-based QoS policy Ingress FEX Egress FEX Ingress Module Egress Module
  • 90. Nexus Parent FEX Module Module FEX Ingress queue / egress schedule based on COS 0 Ingress FEX (FEX 101) Egress FEXIngress Module Egress Module FabricPKT DSCP 0 COS 0 Ingress queue at input port based on COS 0 Egress schedule based on COS 0 Ingress queue / egress schedule based on COS 0 1Q trunk FEX QoS Packet Flow Example (CoS2Q)
  • 91. Nexus Parent FEX QoS Packet Flow Example (DSCP2Q) FEX Module Module FEX Ingress queue / egress schedule based on DSCP 0 Ingress FEX (FEX 101) Egress FEXIngress Module Egress Module Fabric Ingress queue at input port based on DSCP 0 Egress schedule based on COS 0 Ingress queue / egress schedule based on DSCP 0 PKT DSCP 0 COS 0
  • 92. Ingress QoS policy: policy-map type qos marker class ClassA set dscp cs3 ! interface ethernet 101/1/1 service-policy type qos input marker Nexus 7000 FEX QoS Packet Flow Example (With Ingress Marking Policy and DSCP- to-Queue) FEX Module Module FEX Ingress queue / egress schedule based on DSCP 0 Ingress FEX (FEX 101) Egress FEXIngress Module Egress Module FabricPKT DSCP 0 COS 0 PKT DSCP CS3 COS 3 Ingress queue at input port based on DSCP 0 Classify and remark to DSCP CS3/COS 3 at ingress Decision Engine Egress schedule based on COS 3 Ingress queue / egress schedule based on DSCP CS3
  • 93. Ingress QoS policy: policy-map type qos marker class ClassA set dscp cs3 ! interface ethernet 101/1/1 service-policy type qos input marker Nexus 7000 FEX QoS Packet Flow Example (With Ingress Marking Policy and DSCP- to-Queue) FEX Module Module FEX Ingress queue / egress schedule based on DSCP 0 Ingress FEX (FEX 101) Egress FEXIngress Module Egress Module FabricPKT DSCP 0 COS 0 PKT DSCP CS3 COS 3 Ingress queue at input port based on DSCP 0 Classify and remark to DSCP CS3/COS 3 at ingress Decision Engine Egress schedule based on COS 3 Ingress queue / egress schedule based on DSCP CS3
  • 94. FEX Policy Offload (Nexus 5600/6000 only) • TCAM resources on a FEX to perform ACL-based classification • The feature is disabled by default • By default, a FEX classifies packets on CoS value • Both system level and interface level policies are offloaded to the FEX switch# configure terminal fex chassis_ID hardware card-type qos-policy-offload
  • 95. FEX Queuing Policies • FEX queuing driven implicitly by parent switch queuing configuration • Network QoS template drives: • Number of queues • MTU • Ingress queuing class-maps drive: • BOTH ingress and egress COS/DSCP-to-queue mapping • On Nexus 7000 with FEX + M-Series parent modules, network-qos and F-series ingress queuing class-maps still drive FEX queuing configuration
  • 96. DSCP-to-Queue on FEX • Enabling DSCP-to-queue on parent switch enables DSCP-to-queue on FEX • Currently active DSCP mappings pushed to FEX when enabled • DSCP-to-queue only active in the HIF→NIF direction • NIF→HIF direction always uses COS-to-queue mapping, based on COS transmitted by parent switch to FEX
  • 97. FEX Queue-Limit • Provides FEX queue-limit configuration option • Manages buffer thresholds on FEX based on platform capabilities • Default has queue-limit disabled • Configuration applied per-VDC (on Nexus 7000/7700) • Different FEX models have different capabilities
  • 98. Nexus 2000 QoS Golden Rules • FEX QOS classification on COS or DSCP unless FEX offload enabled • FEX queuing driven implicitly by parent switch queuing configuration • No support for per-queue shaping, policing or marking • Drop thresholds are tail-drop only, no WRED support
  • 99. Agenda • Introduction • QoS and Queuing Basics • QoS Implementation on Nexus • Nexus 7000/7700 QoS • Nexus 5600/6000 QoS • Nexus 2000 QoS • Real World Configuration Examples • Conclusion
  • 101. What do we want to achieve? Company Foobar’s Business Goals 101 • Make sure no disruption in network services • Put control traffic in priority queue • Video/voice hosting also an business objective • Put voice traffic in priority queue • Dedicated bandwidth to video traffic • Flexibility in moving applications across servers • Dedicated bandwidth to vmotion/mobility • Everything else best-effort
  • 102. Translating to the language of QoS 102 Application CoS Queuing (Scheduling) Queue-Limit (Buffer) Character Best Effort 0, 1 BW remaining 50% 60% High Volume / Less Important vMotion / Live Migration 2 BW remaining 20% 10% Medium Volume / Important Multimedia 3, 4 BW remaining 30% 20% Medium Volume Very Important Strict Priority 5 Priority Queue 10% Low Volume / Important / Delay Sensitive Network Control 6,7 Low Volume / Very important
  • 103. Topology 103 vpc peer-link vpc peer-link vpc peer-link vpc peer-link Core Nexus 7000 Nexus 5000 Nexus 5000 Nexus 5000Nexus 5000 Nexus 5000Nexus 5000 Nexus 2000 Nexus 7000 Nexus 2000 Nexus 2000 Nexus 2000Nexus 2000Nexus 2000 M2 cards facing core and F2/F3 cards facing access VPC from access to aggregation Host VPC, Straight-through FEX Enhanced VPC (evPC) Straight-through FEX, No VPC
  • 104. Classification, Marking & Trust on Nexus 5000/7000 104 vpc peer-link vpc peer-link vpc peer-link vpc peer-link Between the different Tiers, all ports are TRUSTED Mark Traffic from Core (policy-map type qos) or just TRUST (default) Core Mark Traffic from Servers (policy-map type qos) or just TRUST (default)
  • 105. Classification & Marking: Nexus 7000 ip access-list ACL_QOS_LOWPRIO 10 permit … ip access-list ACL_QOS_VMOTION 10 permit … ip access-list ACL_QOS_MULTIMEDIA 10 permit … ip access-list ACL_QOS_SCRICTPRIO 10 permit … ! class-map type qos match-any CM_QOS_LOWPRIO_COS1 match access-group name ACL_QOS_LOWPRIO ! class-map type qos match-any CM_QOS_VMOTION_COS2 match access-group name ACL_QOS_VMOTION ! class-map type qos match-any CM_QOS_MULTIMEDIA_COS4 match access-group name ACL_QOS_MULTIMEDIA ! class-map type qos match-any CM_QOS_STRICTPRIO_COS5 match access-group name ACL_QOS_STRICTPRIO policy-map type qos PM_QOS_MARK_COS_IN class CM_QOS_STRICTPRIO_COS5 set cos 5 class CM_QOS_MULTIMEDIA_COS4 set cos 4 class CM_QOS_VMOTION_COS2 set cos 2 class CM_QOS_LOWPRIO_COS1 set cos 1 ! interface Ethernet1/1 service-policy type qos input PM_QOS_MARK_COS_IN ! vlan configuration 100 service-policy input PM_QOS_MARK_COS_IN 105
  • 106. Classification & Marking: Nexus 5600/6000 (1) ip access-list ACL_QOS_LOWPRIO 10 permit … ip access-list ACL_QOS_VMOTION 10 permit … ip access-list ACL_QOS_MULTIMEDIA 10 permit … ! class-map type qos match-any CM_QOS_LOWPRIO_COS1 match access-group name ACL_QOS_LOWPRIO ! class-map type qos match-any CM_QOS_VMOTION_COS2 match access-group name ACL_QOS_VMOTION ! class-map type qos match-any CM_QOS_MULTIMEDIA_COS4 match access-group name ACL_QOS_MULTIMEDIA ! class-map type qos match-any CM_QOS_STRICTPRIO_COS5 match cos 5 policy-map type qos PM_QOS_MARK_COS_IN class CM_QOS_STRICTPRIO_COS5 set qos-group 5 class CM_QOS_MULTIMEDIA_COS4 set qos-group 4 class CM_QOS_VMOTION_COS2 set qos-group 3 class CM_QOS_LOWPRIO_COS1 set qos-group 2 ! system qos service-policy type qos input PM_QOS_MARK_COS_IN 106 QoS-Group # is mapping between Slide 1 & Slide 2
  • 107. Classification & Marking: Nexus 5500/6000 (2) class-map type network-qos CM_N-QOS_MATCH_QG2_COS1 match qos-group 2 class-map type network-qos CM_N-QOS_MATCH_QG3_COS2 match qos-group 3 class-map type network-qos CM_N-QOS_MATCH_QG4_COS4 match qos-group 4 class-map type network-qos CM_N-QOS_MATCH_QG5_COS5 match qos-group 5 policy-map type network-qos PM_N-QOS_SYSTEM class type network-qos CM_N-QOS_MATCH_QG2_COS1 set cos 1 class type network-qos CM_N-QOS_MATCH_QG3_COS2 set cos 2 class type network-qos CM_N-QOS_MATCH_QG4_COS4 set cos 4 class type network-qos CM_N-QOS_MATCH_QG5_COS5 set cos 5 queue-limit 20480 bytes ! system qos service-policy type network-qos PM_N-QOS_SYSTEM 107 QoS-Group # is mapping between Slide 1 & Slide 2
  • 108. Classification & Marking (Nexus 2000) 108 vpc peer-link vpc peer-link vpc peer-link vpc peer-link Traffic Classification based on ACL happens here! Core Traffic Classification based on CoS happens here!
  • 109. Queuing (M2-cards) 109 vpc peer-link vpc peer-link vpc peer-link vpc peer-link Modify CoS to Queue mapping in Admin- /Default-VDC Assign a egress policy- map to each interface with priority, bandwidth and queue-limit to alter default queuing policy Assign ingress policy-map to each interface with bandwidth and queue-limit Core
  • 110. CoS to Queue Mapping – M2 I/O Module Example 110 Application CoS Queuing (Scheduling) Queue-Limit (Buffer) Queue (8q2t / 1p7q4t) Character Best Effort 0, 1 BW remaining 50% 60% 8q2t-in-q-default / 1p7q4t-out-q-default High Volume / Less Important vMotion / Live Migration 2 BW remaining 20% 10% 8q2t-in-q6 / 1p7q4t-out-q6 Medium Volume / Important Multimedia 3, 4 BW remaining 30% 20% 8q2t-in-q2 / 1p7q4t-out-q2 Medium Volume Very Important Strict Priority 5 Priority Queue 10% 8q2t-in-q1 / 1p7q4t-out-pq1 Low Volume / Important / Delay Sensitive Network Control 6,7 Low Volume / Very important
  • 111. CoS to Queue Mapping (on M2 cards) Exmple (Admin- / Default-VDC) 111 Core class-map type queuing match-any 8q2t-in-q1 match cos 5-7 class-map type queuing match-any 8q2t-in-q2 match cos 3-4 class-map type queuing match-any 8q2t-in-q6 match cos 2 class-map type queuing match-any 8q2t-in-q-default match cos 0-1 ! class-map type queuing match-any 1p7q4t-out-pq1 match cos 5-7 class-map type queuing match-any 1p7q4t-out-q2 match cos 3-4 class-map type queuing match-any 1p7q4t-out-q6 match cos 2 class-map type queuing match-any 1p7q4t-out-q-default match cos 0-1 Admin- VDC Admin- VDC Changes apply to ALL ports of specified type in ALL VDCs Changes are traffic disruptive for ports of specified type
  • 112. Ingress Queuing Configuration on M2 cards Example (Payload-VDC) 112 Corepolicy-map type queuing PM_QUEUE_10G-40G-100G_IN class type queuing 8q2t-in-q1 queue-limit 10 bandwidth remaining percent 10 class type queuing 8q2t-in-q2 queue-limit 20 bandwidth remaining percent 30 class type queuing 8q2t-in-q6 queue-limit 10 bandwidth remaining percent 10 class type queuing 8q2t-in-q-default queue-limit percent 50 bandwidth percent 50 ! interface Ethernet1/1 service-policy type queuing input PM_QUEUE_10G-40G-100G_IN All Policy-Map and Service-Policy are done in relevant Payload-VDC and only affect the interface to which they get applied
  • 113. Egress Queuing Configuration on M2 cards Example (Payload-VDC) 113 Corepolicy-map type queuing PM_QUEUE_10G-40G-100G_OUT class type queuing 1p7q4t-out-pq1 priority level 1 queue-limit percent 10 class type queuing 1p7q4t-out-q2 queue-limit percent 20 bandwidth remaining percent 30 class type queuing 1p7q4t-out-q6 queue-limit percent 10 bandwidth remaining percent 20 class type queuing 1p7q4t-out-q-default queue-limit percent 50 bandwidth remaining percent 40 ! interface Ethernet1/1 service-policy type queuing output PM_QUEUE_10G-40G-100G_OUT All Policy-Map and Service-Policy are done in relevant Payload-VDC and only affect the interface to which they get applied
  • 114. Network-QoS Configuration on F2/F3-Series 114 vpc peer-link vpc peer-link vpc peer-link vpc peer-link Use the network- qos policy for 8e- 4q4q i.e 4 ingress queues Core
  • 115. Network-QoS Configuration –F2/F3 cards Example (Admin- / Default-VDC) 115 Core system qos service-policy type network-qos default-nq-8e-4q4q-policy policy-map type network-qos default-nq-8e-4q4q-policy template 8e-4q4q class type network-qos c-nq-8e-4q4q match cos 0-7 congestion-control tail-drop mtu 1500 Admin- VDC Admin- VDC Changes apply to ALL ports of specified type in ALL VDCs Changes are traffic disruptive for ports of specified type
  • 116. Queuing (F2/F3 cards) 116 vpc peer-link vpc peer-link vpc peer-link vpc peer-link Modify CoS to Queue mapping in Admin- /Default-VDC Assign a ingress policy-map for buffer allocation, no ingress scheduling Core Assign a egress policy-map to each interface with priority, bandwidth and queue-limit to alter default queuing policy
  • 117. CoS to Queue Mapping – F2/F3 I/O Module Example 117 Application CoS Queuing (Scheduling)- egress Queue-Limit (Buffer)-ingress Queue (Ingress/Egress) Character Best Effort 0,1 BW remaining 50% 50% 4q1t-8e-4q4q-in-q-default / 1p3q1t-8e-4q4q-out-q-default High Volume / Less Important vMotion / Live Migration 2 BW remaining 20% 10% 4q1t-8e-4q4q-in-q4 / 1p3q1t-8e-4q4q-out-q3 Medium Volume / Important Multimedia 3, 4 BW remaining 30% 30% 4q1t-8e-4q4q-in-q3 / 1p3q1t-8e-4q4q-out-q2 Medium Volume Very Important Strict Priority 5 Priority Queue 10% 4q1t-8e-4q4q-in-q1 / 1p3q1t-8e-4q4q-out-pq1 Low Volume / Important / Delay Sensitive Network Control 6/7 Low Volume / Very important
  • 118. CoS to Queue Configuration –F2/F3 slides Example (Admin- / Default-VDC) 118 Core class-map type queuing match-any 4q1t-8e-4q4q-in-q1 match cos 5-7 class-map type queuing match-any 4q1t-8e-4q4q-in-q-default match cos 0-1 class-map type queuing match-any 4q1t-8e-4q4q-in-q3 match cos 3-4 class-map type queuing match-any 4q1t-8e-4q4q-in-q4 match cos 2 class-map type queuing match-any 1p3q1t-8e-4q4q-out-pq1 match cos 5-7 class-map type queuing match-any 1p3q1t-8e-4q4q-out-q2 match cos 3-4 class-map type queuing match-any 1p3q1t-8e-4q4q-out-q3 match cos 2 class-map type queuing match-any 1p3q1t-8e-4q4q-out-q-default match cos 0-1 Admin- VDC Admin- VDC Changes apply to ALL ports of specified type in ALL VDCs Changes are traffic disruptive for ports of specified type
  • 119. Ingress Queuing Configuration for F2/F3 cards Example (Payload-VDC) 119 Coreqos copy policy-map type queuing default-8e-4q4q-in-policy prefix Custom- policy-map type queuing Custom-8e-4q4q-in class type queuing 4q1t-8e-4q4q-in-q1 queue-limit percent 10 bandwidth percent 25 class type queuing 4q1t-8e-4q4q-in-q-default queue-limit percent 50 bandwidth percent 25 class type queuing 4q1t-8e-4q4q-in-q3 queue-limit percent 30 bandwidth percent 25 class type queuing 4q1t-8e-4q4q-in-q4 queue-limit percent 10 bandwidth percent 25 interface Ethernet1/1 service-policy type queuing input Custom-8e-4q4q-in All Policy-Map and Service-Policy are done in relevant Payload-VDC and only affect the interface to which they get applied
  • 120. Egress Queuing Configuration for F2/F3 cards Example (Payload-VDC) 120 Core qos copy policy-map type queuing default-8e-4q4q-out-policy prefix Custom- policy-map type queuing Custom-8e-4q4q-out class type queuing 1p3q1t-8e-4q4q-out-pq1 priority level 1 class type queuing 1p3q1t-8e-4q4q-out-q2 bandwidth remaining percent 30 class type queuing 1p3q1t-8e-4q4q-out-q3 bandwidth remaining percent 20 class type queuing 1p3q1t-8e-4q4q-out-q-default bandwidth remaining percent 50 ! interface Ethernet1/1 service-policy type queuing output Custom-8e-4q4q-out All Policy-Map and Service-Policy are done in relevant Payload-VDC and only affect the interface to which they get applied
  • 121. CoS to Queue Mapping - Nexus 5600/6000 Example 121 Application CoS Queuing (Scheduling) Queue-Limit (Buffer) Queue (6q1t / 1p6q0t) Character Best Effort 0,1 BW percent 40% remaining (226kByte) qos-group 0 (default) High Volume / Less Important vMotion / Live Migration 2,3 BW percent 20% 41kByte qos-group 3 Medium Volume / Important Multimedia 4 BW percent 30% 41kByte qos-group 4 Medium Volume Very Important Strict Priority 5 BW percent 10% 20kByte (min) qos-group5 / priority Low Volume / Important / Delay Sensitive Network Control 6,7 Low Volume / Very important
  • 122. Egress Queuing Configuration: Nexus5600 Example 122 Coreclass-map type queuing CM_Q_MATCH_QG3_COS2 match qos-group 3 class-map type queuing CM_Q_MATCH_QG4_COS4 match qos-group 4 class-map type queuing CM_Q_MATCH_QG5_COS5 match qos-group 5 ! policy-map type queuing PM_QUEUING_SYSTEM_OUT class type queuing CM_Q_MATCH_QG3_COS2 bandwidth percent 20 class type queuing CM_Q_MATCH_QG4_COS4 bandwidth percent 30 class type queuing CM_Q_MATCH_QG5_COS5 priority bandwidth percent 10 class type queuing class-default bandwidth percent 40
  • 123. Queue-Limit (Buffer) Configuration Example 123 Corepolicy-map type network-qos PM_N-QOS_SYSTEM class type network-qos CM_N-QOS_MATCH_QG3_COS2 set cos 2 queue-limit 40960 bytes class type network-qos CM_N-QOS_MATCH_QG4_COS4 set cos 4 queue-limit 40960 bytes class type network-qos CM_N-QOS_MATCH_QG5_COS5 set cos 5 queue-limit 20480 bytes class type network-qos class-default system qos service-policy type network-qos PM_N-QOS_SYSTEM
  • 124. Queuing: Nexus 2000 124 vpc peer-link vpc peer-link vpc peer-link vpc peer-link Queuing on NIF controlled by Fabric Interface INPUT policy Core Queuing on NIF (multiple no-drop queues) only available with CoS based marking on HIF
  • 125. Queuing Configuration (Nexus 2000) Example 125 Coreclass-map type queuing CM_Q_MATCH_QG3_COS2 match qos-group 3 class-map type queuing CM_Q_MATCH_QG4_COS4 match qos-group 4 class-map type queuing CM_Q_MATCH_QG5_COS5 match qos-group 5 ! policy-map type queuing PM_QUEUING_SYSTEM_N2K class type queuing CM_Q_MATCH_QG3_COS2 bandwidth percent 20 class type queuing CM_Q_MATCH_QG4_COS4 bandwidth percent 30 class type queuing CM_Q_MATCH_QG5_COS5 priority bandwidth percent 10 class type queuing class-default bandwidth percent 40 Amount of Queues depend on FEX (Nexus 2000) Model
  • 126. Agenda • Introduction • QoS and Queuing Basics • QoS Implementation on Nexus • Nexus 7000/7700 QoS • Nexus 5600/6000 QoS • Nexus 2000 QoS • Real World Configuration Examples • Conclusion
  • 128. Why QoS in the Data Center? 128 Assign Color to Traffic Maximize Throughput Manage Congestion
  • 129. Maximize Throughput and Manage Congestion!
  • 131. Nexus 9000 Overview • Modular and fixed chassis • Optimized for high density 40G/100G • Standalone and ACI Mode • Merchant+ Strategy • Mix of Merchant and Custom Silicon
  • 132. Egress VOQ buffer Ingress VOQ buffer Ingress Module Egress Module Ingress Module Ingress Module Crossbar Fabric Buffering Model Nexus 9000 compared to Nexus 7000/Nexus 5000 132 No VOQ concept – only egress shared buffers Uses both merchant silicon and custom silicon buffers Egress buffer Nexus 7000 F-Series I/O Module
  • 133. Cisco Nexus 9000 QoS Features • Traffic classification ‒ DSCP, CoS, and ACL • Packet marking ‒ DSCP, CoS, and ECN • Strict Priority Queuing and DWRR ‒ DCBX 802.1Qaz • Ingress policing only • WRED, TD and ECN • Shared buffer capability • Buffer boost
  • 134. Queuing on Nexus 9500 Switch Line Cards Queuing on N9K-X9600 Series Line Cards Traffic Classification Ingress Cos/DSCP Marking Trust CoS/DSCP L2/L3/L4 info with ACL Ingress Policing Fabric Module Egress Port Queues multicast span unicast MTU checking NFE Ingress Line Card Egress Line Card multicast CPU span unicast multicast CPU span unicast control System QoS System QoS
  • 135. Queuing & Scheduling on Nexus 9500 Line Cards Queuing on N9K-X9500 Series Line Cards Traffic Classification Ingress Cos/DSCP Marking Trust CoS/DSCP L2/L3/L4 info with ACL Ingress Policing Fabric Module Unicast EoQs (4 per egr port) Egress Port Queues Unicast from EoQs multicast Span unicast MTU checking NFE OOBFC signaling ALE Ingress Line Card Egress Line Card multicast Control Span unicast multicas t CPU span unicast multicast CPU span unicast Non-hair- pinned local unicast traffic System QoS System QoS
  • 136. Buffer Boost on x9500 cards  Line cards with ALEs can leverage the additional buffer on ALE for NFE local traffic.  When buffer boost is enabled, NFE local traffic on the port is sent to ALE for additional buffer space.  When buffer boost is disabled, NFE local traffic to the port remains local  Buffer boost is enabled by default and can be disabled on a per-port basis. North Star 4:1 Mux North Star NFE NFE Network Interface 1/10GE ALE 10 MB Buffer shared by all Ports NFE 10 MB Buffer 10 MB Buffer 1/10GE 1/10GE 1/10GE Network Interface 40GE 20 MB Buffer ALE 10 MB Buffer shared by all Ports NFE 10 MB Buffer 10 MB Buffer 40GE 40GE 40GE Fabric Modules 20 MB Buffer Buffer Boost enabled port Buffer Boost disabled port
  • 138. policy-map type qos fex-qos class fex-qos-class-1 set dscp 10 class fex-qos-class-2 set dscp 18 class fex-qos-class-3 set dscp 26 ! interface Ethernet101/1/1 service-policy type qos input fex-qos Fex QoS Policy Configuration Example Marking policy Policy applied on ingress of FEX HIF
  • 139.  Applying 8e-4q4q template to enable 4 ingress/egress queues on FEX with COS to queue mapping (also enables 4 ingress queues on F-series modules, if present) system qos service-policy type network-qos default-nq-8e-4q4q-policy  FEX output (“show queuing interface”): Queuing: queue qos-group cos priority bandwidth mtu --------+------------+--------------+---------+---------+---- ctrl-hi n/a 7 PRI 0 2400 ctrl-lo n/a 7 PRI 0 2400 2 0 0 1 WRR 30 1600 3 1 2 WRR 30 1600 4 2 5 6 WRR 10 1600 5 3 3 4 WRR 30 1600 Nexus 7000 Network-QoS Configuration Example #1 Default 8e-4q4q template applied to “system qos” target 8e4q4q configuration (4 data traffic queues)
  • 140.  Applying custom 8e-4q4q-based template with new MTU policy-map type network-qos custom-nq-8e-4q4q template 8e-4q4q class type network-qos c-nq-8e-4q4q congestion-control tail-drop mtu 9216 system qos service-policy type network-qos custom-nq-8e-4q4q  FEX output (“show queuing interface”) after MTU change: Queuing: queue qos-group cos priority bandwidth mtu --------+------------+--------------+---------+---------+---- ctrl-hi n/a 7 PRI 0 2400 ctrl-lo n/a 7 PRI 0 2400 2 0 0 1 WRR 30 9280 3 1 2 WRR 30 9280 4 2 5 6 WRR 10 9280 5 3 3 4 WRR 30 9280 Nexus 7000 Network-QoS Configuration Example #2 Custom network-qos policy with new MTU Custom template applied to “system qos” target MTU increased on data traffic queues
  • 141.  Changing CoS- or DSCP-to-queue mappings in parent switch F-type ingress queuing class-maps modifies mappings on FEX  Queuing class-maps modified only in default/admin VDC (apply to entire system) class-map type queuing match-any 4q1t-8e-4q4q-in-q1 match cos 1-3 match dscp 8-31 class-map type queuing match-any 4q1t-8e-4q4q-in-q-default match cos 0 match dscp 0-7 class-map type queuing match-any 4q1t-8e-4q4q-in-q3 match cos 4-5 match dscp 32-47 class-map type queuing match-any 4q1t-8e-4q4q-in-q4 match cos 6-7 match dscp 48-63 Modifying CoS- or DSCP-to-Queue Mappings Queuing: queue qos-group cos priority bandwidth mtu --------+------------+--------------+---------+---------+---- ctrl-hi n/a 7 PRI 0 2400 ctrl-lo n/a 7 PRI 0 2400 2 0 0 WRR 30 1600 3 1 6 WRR 30 1600 4 2 1 2 3 WRR 10 1600 5 3 4 5 WRR 30 1600 <…> queue DSCPs ----- ----- 02 0-7, 04 8-31, 03 48-63, 05 32-47, Non-default F-series ingress queuing class-maps (COS and DSCP match statements modified) FEX queue mappings reflect changes
  • 142.  Example #1 – N2K-C2248TP-1GE fex 101 hardware N2248T queue-limit 50000  Example #2 – N2K-C2232TM-E-10GE fex 102 hardware N2232TM-E queue-limit 50000  FEX output (“show queuing interface”) before: Queue limit: Disabled  FEX output (“show queuing interface”) after (configured queue-limit rounded to nearest hardware supported value): Queue limit: 51200 bytes Enabling FEX Queue Limits
  • 144. Modifying Queuing and Scheduling Behaviour on F3 Modules I want to… Steps to follow …remap COS/DSCP values from one queue to another queue without activating additional queues 1. Modify the type queuing class-map(s) for the desired queue(s) …change queuing behavior without changing COS-or DSCP-to-queue mapping 1. Define new type queuing policy-map (you cannot modify the default policies) 2. Modify class-map parameters 3. Apply new policy-map to interfaces …activate additional queues and remap COS/DSCP values 1. Define new type queuing policy-map 2. Modify COS-to-queue mapping for target port type 3. Apply new policy-map to interfaces …shape the SP queue 1. (Optional) Clone the default egress queuing policy 2. Shape the SP queue in the new (cloned) policy 3. Apply the new queuing policy to the target interfaces
  • 145. Modifying Queuing Behavior Remap Some COS/DSCP Values from One Queue to Another Queue without Activating Additional Queues Important: changing COS- or DSCP-to-queue mapping takes effect immediately and is disruptive to all ports Modify “type queuing” class-map(s) for desired queue(s) Remap COS- or DSCP-to-queue mapping for given queue(s)
  • 146. Modifying Queuing Behavior Remap Some COS/DSCP Values from One Queue to Another Queue without Activating Additional Queues Example: remap COS 4 and DSCP 32-39 to ingress queue “q1”: n77# show class-map type queuing 8q2t-in-q1 Type queuing class-maps ======================== class-map type queuing match-any 8q2t-in-q1 Description: Classifier for ingress queue 1 of type 8q2t match cos 5-7 match dscp 40-63 n77# configure terminal Enter configuration commands, one per line. End with CNTL/Z. n77(config)# ! Modify ingress queue q1 n77(config)# class-map type queuing match-any 8q2t-in-q1 n77(config-cmap-que)# ! Change COS- and DSCP-to-queue mapping for this queue n77(config-cmap-que)# match cos 4 n77(config-cmap-que)# match dscp 32-39 n77(config-cmap-que)# show class-map type queuing 8q2t-in-q1 Type queuing class-maps ======================== class-map type queuing match-any 8q2t-in-q1 Description: Classifier for ingress queue 1 of type 8q2t match cos 4-7 match dscp 32-63 n77(config-cmap-que)# Show current mapping Show new mapping Configure new mapping
  • 147. Modifying Queuing Behavior Changing Default Queuing Behavior without Changing COS- or DSCP-to- Queue Define new “type queuing” policy-map for port type Create new policy Modify class-map parameters Define behavior of each queue Important: applying new queuing policy takes effect immediately and is disruptive to any ports to which the policy is applied Apply “type queuing” service-policy to interface(s) Apply new queuing policy to interface(s)
  • 148. Modifying Queuing Behavior Changing Default Queuing Behavior without Changing COS- or DSCP-to- Queue Example: Resize ingress queues without modifying COS- or DSCP-to-queue mapping n77# configure terminal Enter configuration commands, one per line. End with CNTL/Z. n77(config)# ! Define new "type queuing" policy n77(config)# policy-map type queuing new-f3-ingress n77(config-pmap-que)# ! Define behavior for F3 ingress q-default n77(config-pmap-que)# class type queuing 8e-4q8q-in-q-default n77(config-pmap-c-que)# ! Resize this queue n77(config-pmap-c-que)# queue-limit percent 74 n77(config-pmap-c-que)# ! Define behavior for F3 ingress queue 1 n77(config-pmap-c-que)# class type queuing 8e-4q8q-in-q1 n77(config-pmap-c-que)# ! Resize this queue n77(config-pmap-c-que)# queue-limit percent 24 n77(config-pmap-c-que)# ! Policy must include all queues (even inactive) n77(config-pmap-c-que)# class type queuing 8e-4q8q-in-q3 n77(config-pmap-c-que)# ! Must give at least 1% to inactive queues n77(config-pmap-c-que)# queue-limit percent 1 n77(config-pmap-c-que)# class type queuing 8e-4q8q-in-q4 n77(config-pmap-c-que)# queue-limit percent 1 n77(config-pmap-c-que)# interface e 2/1-48 n77(config-if-range)# ! Apply the new policy to F3 interfaces n77(config-if-range)# service-policy type queuing input new-f3-ingress n77(config-if-range)# Create new queuing policy Modify class-map parameters (resize queues) Apply policy to interface(s)
  • 149. Modifying Queuing Behavior Activate Additional Queues and Remap COS/DSCP Values Important: changing COS/DSCP-to-queue mapping and takes effect immediately and is disruptive to all ports; applying new queuing policy takes effect immediately and is disruptive to any ports to which the policy is applied Define new “type queuing” policy-map for port type Create new policy Modify class-map parameters Define behavior of each queue Apply “type queuing” service-policy to interface(s) Apply new queuing policy to interface(s) Modify “type queuing” class-map(s) for desired queue(s) Remap COS- or DSCP-to-queue mapping to additional queue(s)
  • 150. Example: Enable one additional ingress queue and map COS/DSCP values to all active queues n77# configure terminal Enter configuration commands, one per line. End with CNTL/Z. n77(config)# ! Modify ingress queue q3 n77(config)# class-map type queuing match-any 8q2t-in-q3 n77(config-cmap-que)# ! Map COS and DSCP values to this queue n77(config-cmap-que)# match cos 3-4 n77(config-cmap-que)# match dscp 24-39 n77(config-cmap-que)# ! Define new "type queuing" policy n77(config-cmap-que)# policy-map type queuing new-f3-ingress n77(config-pmap-que)# ! Define behavior for F3 ingress q-default n77(config-pmap-que)# class type queuing 8e-4q8q-in-q-default n77(config-pmap-c-que)# ! Resize this queue n77(config-pmap-c-que)# queue-limit percent 60 n77(config-pmap-c-que)# ! Define behavior for F3 ingress queue 1 n77(config-pmap-c-que)# class type queuing 8e-4q8q-in-q1 n77(config-pmap-c-que)# ! Resize this queue n77(config-pmap-c-que)# queue-limit percent 25 n77(config-pmap-c-que)# ! Define behavior for F3 ingress queue 3 n77(config-pmap-c-que)# class type queuing 8e-4q8q-in-q3 n77(config-pmap-c-que)# ! Resize this queue n77(config-pmap-c-que)# queue-limit percent 14 n77(config-pmap-c-que)# ! Policy must include all queues (even inactive) n77(config-pmap-c-que)# class type queuing 8e-4q8q-in-q4 n77(config-pmap-c-que)# queue-limit percent 1 n77(config-pmap-c-que)# int e 2/1-48 n77(config-if-range)# ! Apply the new policy to F3 interfaces n77(config-if-range)# service-policy type queuing input new-f3-ingress Modifying Queuing Behavior Activate Additional Queues and Remap COS/DSCP Values Map COS/DSCP values to inactive queue Modify class-map parameters (resize queues) Apply policy to interface(s) Create new queuing policy
  • 151. Important! • If you change the COS- or DSCP-to-queue mapping for a port type, make sure all ports of that type in all VDCs have a queuing policy applied that defines behavior for all queues with COS/DSCP values mapped • For example, if you do THIS… n77(config)# class-map type queuing match-any 8e-4q8q-in-q-default n77(config-cmap-que)# match cos 0-1 n77(config-cmap-que)# match dscp 0-15 n77(config-cmap-que)# class-map type queuing match-any 8e-4q8q-in-q4 n77(config-cmap-que)# match cos 2-4 n77(config-cmap-que)# match dscp 16-39 n77(config-cmap-que)# class-map type queuing match-any 8e-4q8q-in-q3 n77(config-cmap-que)# match cos 6-7 n77(config-cmap-que)# match dscp 48-63 n77(config-cmap-que)# class-map type queuing match-any 8e-4q8q-in-q1 n77(config-cmap-que)# match cos 5 n77(config-cmap-que)# match dscp 40-47 Changes the default COS/ DSCP-to-queue mapping
  • 152. Important! • … then make sure you do THIS… n77(config)# policy-map type queuing new-f3-ingress n77(config-pmap-que)# class type queuing 8e-4q8q-in-q-default n77(config-pmap-c-que)# queue-limit percent 50 n77(config-pmap-c-que)# class type queuing 8e-4q8q-in-q1 n77(config-pmap-c-que)# queue-limit percent 20 n77(config-pmap-c-que)# class type queuing 8e-4q8q-in-q3 n77(config-pmap-c-que)# queue-limit percent 20 n77(config-pmap-c-que)# class type queuing 8e-4q8q-in-q4 n77(config-pmap-c-que)# queue-limit percent 10 n77(config-pmap-c-que)# Defines a new queuing policy that defines behavior of all queues that COS/DSCP values have been mapped to
  • 153. Important! • … and then do THIS: n77(config)# int e 2/1-48 n77(config-if-range)# service-policy type queuing input new-f3-ingress n77(config-if-range)# • If you DON’T, traffic arriving on ports with default policy (i.e., without all queues activated that have COS/DSCP values mapped) will suffer – packet drops, poor performance, etc. • Of course, you can have different non-default policies on different sets of interfaces, but all interfaces in the system must use some policy that defines all activated queues! Maps the new policy to ALL interfaces in the system (do this on ALL ports in EVERY VDC!!)
  • 154. Modifying Queuing Behavior Shape the SP Queue (Optional) Clone a default egress “type queuing” policy-map Create a copy of a default egress queuing policy Shape SP queue in new (cloned) “type queuing” policy Limit SP queue bandwidth consumption Apply new “type queuing” policy to target interface(s) Apply new queuing policy to interfaces Important: applying new queuing policy takes effect immediately and is disruptive to any ports to which the policy is applied
  • 155. Modifying Queuing Behavior Shape the SP Queue Example: Shape the SP queue to 2Gbps on a 10G interface, using a queuing policy cloned from the default “8e4q4q” egress queuing policy n77# ! Clone the 8E egress queuing policy n77# qos copy policy-map type queuing default-8e-4q8q-out-policy prefix new- n77# conf Enter configuration commands, one per line. End with CNTL/Z. n77(config)# ! Modify new queuing policy n77(config)# policy-map type queuing new-8e-4q8q-out n77(config-pmap-que)# ! Modify egress queue q1 n77(config-pmap-que)# class type queuing 8e-4q8q-out-q1 n77(config-pmap-c-que)# ! Make this queue strict priority n77(config-pmap-c-que)# priority level 1 n77(config-pmap-c-que)# ! Shape the queue to 20% (2G on 10G port) n77(config-pmap-c-que)# shape percent 20 n77(config-pmap-c-que)# int e 2/1-48 n77(config-if-range)# ! Apply the new policy to target interfaces n77(config-if-range)# service-policy type queuing output new-8e-4q8q-out n77(config-if-range)# n77# Clone the default egress queuing policy Modify the cloned policy Make q1 Strict Priority and shape to 20% (2G) Apply new policy to target interfaces
  • 156. Participate in the “My Favorite Speaker” Contest • Promote your favorite speaker through Twitter and you could win $200 of Cisco Press products (@CiscoPress) • Send a tweet and include • Your favorite speaker’s Twitter handle <Speaker—enter your Twitter handle here> • Two hashtags: #CLUS #MyFavoriteSpeaker • You can submit an entry for more than one of your “favorite” speakers • Don’t forget to follow @CiscoLive and @CiscoPress • View the official rules at http://bit.ly/CLUSwin Promote Your Favorite Speaker and You Could Be a Winner
  • 157. Complete Your Online Session Evaluation Don’t forget: Cisco Live sessions will be available for viewing on-demand after the event at CiscoLive.com/Online • Give us your feedback to be entered into a Daily Survey Drawing. A daily winner will receive a $750 Amazon gift card. • Complete your session surveys though the Cisco Live mobile app or your computer on Cisco Live Connect.
  • 158. Continue Your Education • Demos in the Cisco campus • Walk-in Self-Paced Labs • Table Topics • Meet the Engineer 1:1 meetings • Related sessions
  • 160.
  • 161. Internet of Things (IoT) Cisco Education Offerings Course Description Cisco Certification NEW! CCNA Industrial An associate level instructor led training course designed to prepare you for the CCNA Industrial certification CCNA® Industrial Managing Industrial Networks with Cisco Networking Technologies (IMINS) This curriculum addresses foundational skills needed to manage and administer networked industrial control systems. It provides plant administrators, control system engineers and traditional network engineers with an understanding of the networking technologies needed in today's connected plants and enterprises Cisco Industrial Networking Specialist Control Systems Fundamentals for Industrial Networking (ICINS) For IT and Network Engineers, covers basic concepts in Industrial Control systems including an introduction to automation industry verticals, automation environment and an overview of industrial control networks Networking Fundamentals for Industrial Control Systems (INICS) For Industrial Engineers and Control System Technicians, covers basic IP and networking concepts, and introductory overview of Automation industry Protocols. For more details, please visit: http://learningnetwork.cisco.com Questions? Visit the Learning@Cisco Booth or contact ask-edu-pm-dcv@cisco.com
  • 162. Business Transformation Cisco Education Offerings Course Description Cisco Certification For IT and Network Professionals: Building Business Specialist Skills • Builds non-technical skills key to ensure business impact and influence. Topics include: business analysis, finance, technology adoption and effective communications. • Bridges IT and business impacts of mature and emerging solutions including cloud plus Internet of Everything Cisco Enterprise IT Business Specialist For Technology Sellers: Applying Cisco Specialized Business Value Analysis Skills Builds skills to discover and address technology needs using a business- focused, consultative sales approach Cisco Business Value Specialist Executing Advanced Cisco Business Value Analysis and Design Techniques Enables customer transformation through business architecture and solution selling expertise Cisco Certified Business Value Practitioner Performing Cisco Business-Focused Transformative Architecture Engagements Provides skills and an approach to build a strategic roadmap of IT initiatives, aligned to business priorities Cisco Transformative Architecture Specialist For more details, please visit: http://learningnetwork.cisco.com Questions? Visit the Learning@Cisco Booth or contact ask-edu-pm-dcv@cisco.com
  • 163. Security Cisco Education Offerings Course Description Cisco Certification Implementing Cisco IOS Network Security (IINS) Implementing Cisco Edge Network Security Solutions (SENSS) Implementing Cisco Threat Control Solutions (SITCS) Implementing Cisco Secure Access Solutions (SISAS) Implementing Cisco Secure Mobility Solutions (SIMOS) Focuses on the design, implementation, and monitoring of a comprehensive security policy, using Cisco IOS security features Configure Cisco perimeter edge security solutions utilizing Cisco Switches, Cisco Routers, and Cisco Adaptive Security Appliance (ASA) Firewalls Deploy Cisco’s Next Generation Firewall (NGFW) as well as Web Security, Email Security and Cloud Web Security Deploy Cisco’s Identity Services Engine and 802.1X secure network access Protect data traversing a public or shared infrastructure such as the Internet by implementing and maintaining Cisco VPN solutions CCNA® Security Securing Cisco Networks with Threat Detection and Analysis (SCYBER) Designed for professional security analysts, the course covers essential areas of competency including event monitoring, security event/alarm/traffic analysis, and incident response Cisco Cybersecurity Specialist Network Security Product and Solutions Training For official product training on Cisco’s latest security products, including Adaptive Security Appliances, NGIPS, Advanced Malware Protection, Identity Services Engine, Email and Web Security Appliances see www.cisco.com/go/securitytraining For more details, please visit: http://learningnetwork.cisco.com Questions? Visit the Learning@Cisco Booth or contact ask-edu-pm-dcv@cisco.com
  • 164. R&S Related Cisco Education Offerings Course Description Cisco Certification CCIE R&S Advanced Workshops (CIERS-1 & CIERS-2) plus Self Assessments, Workbooks & Labs Expert level trainings including: instructor led workshops, self assessments, practice labs and CCIE Lab Builder to prepare candidates for the CCIE R&S practical exam. CCIE® Routing & Switching • Implementing Cisco IP Routing v2.0 • Implementing Cisco IP Switched Networks V2.0 • Troubleshooting and Maintaining Cisco IP Networks v2.0 Professional level instructor led trainings to prepare candidates for the CCNP R&S exams (ROUTE, SWITCH and TSHOOT). Also available in self study eLearning formats with Cisco Learning Labs. CCNP® Routing & Switching Interconnecting Cisco Networking Devices: Part 2 (or combined) Configure, implement and troubleshoot local and wide-area IPv4 and IPv6 networks. Also available in self study eLearning format with Cisco Learning Lab. CCNA® Routing & Switching Interconnecting Cisco Networking Devices: Part 1 Installation, configuration, and basic support of a branch network. Also available in self study eLearning format with Cisco Learning Lab. CCENT® Routing & Switching For more details, please visit: http://learningnetwork.cisco.com Questions? Visit the Learning@Cisco Booth or contact ask-edu-pm-dcv@cisco.com
  • 165. Wireless Cisco Education Offerings Course Description Cisco Certification • Conducting Cisco Unified Wireless Site Survey • Implementing Cisco Unified Wireless Voice Networks • Implementing Cisco Unified Wireless Mobility Services • Implementing Cisco Unified Wireless Security Services Professional level instructor led trainings to prepare candidates to conduct site surveys, implement, configure and support APs and controllers in converged Enterprise networks. Focused on 802.11 and related technologies to deploy voice networks, mobility services, and wireless security. CCNP® Wireless Implementing Cisco Unified Wireless Network Essential Prepares candidates to design, install, configure, monitor and conduct basic troubleshooting tasks of a Cisco WLAN in Enterprise installations. CCNA® Wireless For more details, please visit: http://learningnetwork.cisco.com Questions? Visit the Learning@Cisco Booth or contact ask-edu-pm-dcv@cisco.com
  • 166. Design Cisco Education Offerings Course Description Cisco Certification Designing Cisco Network Service Architectures (ARCH) Provides learner with the ability to perform conceptual, intermediate, and detailed design of a network infrastructure that supports desired capacity, performance, availability required for converged Enterprise network services and applications. CCDP® (Design Professional) Designing for Cisco Internetwork Solutions (DESGN) Instructor led training focused on fundamental design methodologies used to determine requirements for network performance, security, voice, and wireless solutions. Prepares candidates for the CCDA certification exam. CCDA® (Design Associate) For more details, please visit: http://learningnetwork.cisco.com Questions? Visit the Learning@Cisco Booth or contact ask-edu-pm-dcv@cisco.com
  • 167. Service Provider Cisco Education Offerings Course Description Cisco Certification Deploying Cisco Service Provider Network Routing (SPROUTE) & Advanced (SPADVROUTE) Implementing Cisco Service Provider Next-Generation Core Network Services (SPCORE) Edge Network Services (SPEDGE) SPROUTE covers the implementation of routing protocols (OSPF, IS-IS, BGP), route manipulations, and HA routing features; SPADVROUTE covers advanced routing topics in BGP, multicast services including PIM-SM, and IPv6; SPCORE covers network services, including MPLS-LDP, MPLS traffic engineering, QoS mechanisms, and transport technologies; SPEDGE covers network services, including MPLS Layer 3 VPNs, Layer 2 VPNs, and Carrier Ethernet services; all within SP IP NGN environments. CCNP Service Provider® Building Cisco Service Provider Next-Generation Networks, Part 1&2 (SPNGN1), (SPNGN2) The two courses introduce networking technologies and solutions, including OSI and TCP/IP models, IPv4/v6, switching, routing, transport types, security, network management, and Cisco OS (IOS and IOS XR). CCNA Service Provider® Implementing Cisco Service Provider Mobility UMTS Networks (SPUMTS); Implementing Cisco Service Provider Mobility CDMA Networks (SPCDMA); Implementing Cisco Service Provider Mobility LTE Networks (SPLTE) The three courses (SPUMTS, SPCDMA, SPLTE) cover knowledge and skills required to understand products, technologies, and architectures that are found in Universal Mobile Telecommunications Systems (UMTS) and Code Division Multiple Access (CDMA) packet core networks, plus their migration to Long-Term Evolution (LTE) Evolved Packet Systems (EPS), including Evolved Packet Core (EPC) and Radio Access Networks (RANs). Cisco Service Provider Mobility CDMA to LTE Specialist; Cisco Service Provider Mobility UMTS to LTE Specialist Implementing and Maintaining Cisco Technologies Using IOS XR (IMTXR) Service Provider/Enterprise engineers to implement, verification-test, and optimize core/edge technologies in a Cisco IOS XR environment. Cisco IOS XR Specialist For more details, please visit: http://learningnetwork.cisco.com Questions? Visit the Learning@Cisco Booth or contact ask-edu-pm-dcv@cisco.com
  • 168. Collaboration Cisco Education Offerings Course Description Cisco Certification CCIE Collaboration Advanced Workshop (CIEC) Gain expert-level skills to integrate, configure, and troubleshoot complex collaboration networks CCIE® Collaboration Implementing Cisco Collaboration Applications (CAPPS) Understand how to implement the full suite of Cisco collaboration applications including Jabber, Cisco Unified IM and Presence, and Cisco Unity Connection. CCNP® Collaboration Implementing Cisco IP Telephony and Video Part 1 (CIPTV1) Implementing Cisco IP Telephony and Video Part 2 (CIPTV2) Troubleshooting Cisco IP Telephony and Video (CTCOLLAB) Learn how to implement Cisco Unified Communications Manager, CUBE, and audio and videoconferences in a single-site voice and video network. Obtain the skills to implement Cisco Unified Communications Manager in a modern, multisite collaboration environment. Troubleshoot complex integrated voice and video infrastructures CCNP® Collaboration Implementing Cisco Collaboration Devices (CICD) Implementing Cisco Video Network Devices (CIVND) Acquire a basic understanding of collaboration technologies like Cisco Call Manager and Cisco Unified Communications Manager. Learn how to evaluate requirements for video deployments, and implement Cisco Collaboration endpoints in converged Cisco infrastructures. CCNA® Collaboration For more details, please visit: http://learningnetwork.cisco.com Questions? Visit the Learning@Cisco Booth or contact ask-edu-pm-dcv@cisco.com
  • 169. Data Center / Virtualization Cisco Education Offerings Course Description Cisco Certification Cisco Data Center CCIE Unified Fabric Workshop (DCXUF); Cisco Data Center CCIE Unified Computing Workshop (DCXUC) Prepare for your CCIE Data Center practical exam with hands on lab exercises running on a dedicated comprehensive topology CCIE® Data Center Implementing Cisco Data Center Unified Fabric (DCUFI); Implementing Cisco Data Center Unified Computing (DCUCI) Obtain the skills to deploy complex virtualized Data Center Fabric and Computing environments with Nexus and Cisco UCS. CCNP® Data Center Introducing Cisco Data Center Networking (DCICN); Introducing Cisco Data Center Technologies (DCICT) Learn basic data center technologies and how to build a data center infrastructure. CCNA® Data Center Product Training Portfolio: DCAC9k, DCINX9k, DCMDS, DCUCS, DCNX1K, DCNX5K, DCNX7K Get a deep understanding of the Cisco data center product line including the Cisco Nexus9K in ACI and NexusOS modes For more details, please visit: http://learningnetwork.cisco.com Questions? Visit the Learning@Cisco Booth or contact ask-edu-pm-dcv@cisco.com
  • 170. Network Programmability Cisco Education Offerings Course Description Cisco Certification Integrating Business Applications with Network Programmability (NIPBA); Integrating Business Applications with Network Programmability for Cisco ACI (NPIBAACI) Learn networking concepts, and how to deploy and troubleshoot programmable network architectures with these self-paced courses. Cisco Business Application Engineer Specialist Certification Developing with Cisco Network Programmability (NPDEV); Developing with Cisco Network Programmability for Cisco ACI (NPDEVACI) Learn how to build applications for network environments and effectively bridge the gap between IT professionals and software developers. Cisco Network Programmability Developer Specialist Certification Designing with Cisco Network Programmability (NPDES); Designing with Cisco Network Programmability for Cisco ACI (NPDESACI) Learn how to expand your skill set from traditional IT infrastructure to application integration through programmability. Cisco Network Programmability Design Specialist Certification Implementing Cisco Network Programmability (NPENG); Implementing Cisco Network Programmability for Cisco ACI (NPENGACI) Learn how to implement and troubleshoot open IT infrastructure technologies. Cisco Network Programmability Engineer Specialist Certification For more details, please visit: http://learningnetwork.cisco.com Questions? Visit the Learning@Cisco Booth or contact ask-edu-pm-dcv@cisco.com
  • 171. Cloud Cisco Education Offerings Course Description Cisco Certification Designing the FlexPod Solution (FPDESIGN); Implementing and Administering the FlexPod Solution (FPIMPADM) Learn how to design, implement and administer FlexPod solutions FlexPod Design Specialist; FlexPod Implementation & Administration Specialist UCS Director (UCSDF) Learn how to manage physical and virtual infrastructure using orchestration and automation functions of UCS Director. Cisco Prime Service Catalog Learn how to deliver data center, workplace, and application services in an on-demand, automated, and repeatable method. Cisco Intercloud Fabric Learn how to implement end-to-end hybrid clouds with Intercloud Fabric for Business and Intercloud Fabric for Providers. Cisco Intelligent Automation for Cloud Learn how to implement and manage cloud deployments with Cisco Intelligent Automation for Cloud For more details, please visit: http://learningnetwork.cisco.com Questions? Visit the Learning@Cisco Booth or contact ask-edu-pm-dcv@cisco.com