SlideShare a Scribd company logo
1 of 286
Download to read offline
Americas Headquarters
Cisco Systems, Inc.
170 West Tasman Drive
San Jose, CA 95134-1706
USA
http://www.cisco.com
Tel: 408 526-4000
800 553-NETS (6387)
Fax: 408 527-0883
Cisco IOS XR Troubleshooting Guide for
the Cisco ASR 9000 Aggregation Services
Router
Cisco IOS XR Software, Release 4.0
April, 2011
Text Part Number: OL-23591-02
THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL
STATEMENTS, INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT
WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS.
THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT
SHIPPED WITH THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE
OR LIMITED WARRANTY, CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY.
The Cisco implementation of TCP header compression is an adaptation of a program developed by the University of California, Berkeley (UCB) as part of UCB’s public
domain version of the UNIX operating system. All rights reserved. Copyright © 1981, Regents of the University of California.
NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED “AS IS” WITH
ALL FAULTS. CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT
LIMITATION, THOSE OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF
DEALING, USAGE, OR TRADE PRACTICE.
IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING,
WITHOUT LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO
OR ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
Cisco and the Cisco Logo are trademarks of Cisco Systems, Inc. and/or its affiliates in the U.S. and other countries. A listing of Cisco's trademarks can be found at
www.cisco.com/go/trademarks. Third party trademarks mentioned are the property of their respective owners. The use of the word partner does not imply a partnership
relationship between Cisco and any other company. (1005R)
Any Internet Protocol (IP) addresses and phone numbers used in this document are not intended to be actual addresses and phone numbers. Any examples, command display
output, network topology diagrams, and other figures included in the document are shown for illustrative purposes only. Any use of actual IP addresses or phone numbers in
illustrative content is unintentional and coincidental.
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
© 2010 Cisco Systems, Inc. All rights reserved.
iii
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
C O N T E N T S
Preface xi
Changes to This Document xi
Obtaining Documentation and Submitting a Service Request xii
C H A P T E R 1 General Troubleshooting Procedures 1-1
Prerequisite Documentation for Troubleshooting 1-1
Verifying and Troubleshooting CLI Access 1-2
General CLI Access Information 1-2
User Access Privileges 1-2
Cisco-support Task ID 1-3
CLI Access Through a Console Port 1-3
CLI Access Through a Terminal Server 1-3
CLI Access Through the Management Ethernet Interface 1-4
Validating and Troubleshooting Installation of the Cisco IOS XR Software Package 1-7
Verifying the Software Version 1-8
Validating the Installation 1-10
Validating and Troubleshooting Cisco IOS XR Software Configuration 1-16
Local and Global Configurations 1-16
Collecting Configuration Information 1-19
Verifying the Running Configuration 1-20
Using the show configuration failed Command 1-24
Verifying the System 1-26
Troubleshooting the Backplane Ethernet Control System 1-41
Basic Cisco IOS XR Verification and Troubleshooting Commands 1-46
man Command 1-46
describe Command 1-49
show platform Command 1-49
top Command 1-50
show context Command 1-50
show users Command 1-52
show history Command 1-52
show configuration Command 1-53
Displaying ASIC Errors 1-54
Using Trace Commands 1-56
Contents
iv
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
MIB Location 1-57
Gathering Information Before You Call Cisco TAC 1-58
Gathering Information about Crashes and Core Dumps 1-58
Capturing Logs 1-58
Using Debug Commands 1-59
Using Diagnostic Commands 1-59
Commands Used to Display Process and Thread Details 1-59
C H A P T E R 2 Verifying and Troubleshooting Interface Status 2-61
Verifying and Troubleshooting Gigabit Ethernet Interfaces 2-61
Verifying and Troubleshooting Pluggable Optical Line Card Interfaces 2-68
C H A P T E R 3 Troubleshooting Interface Connectivity 3-75
Troubleshooting Ping and ARP Connectivity 3-75
Troubleshooting Bidirectional Forwarding Detection 3-81
Using show and debug Commands 3-82
BFD Sessions in Down State 3-83
BFD Sessions Flap 3-83
BFD Sessions Down on Neighboring Router 3-85
BFD Sessions Are Not Created on the LC 3-85
Troubleshooting Ethernet CFM 3-85
Using show and debug Commands 3-87
MEPs Are Not Created 3-88
MIPs Are Not Created 3-88
No CCMs are Received at the MEP or Peer MEPs Are Not Seen 3-89
Peer MEP Defects and Mismatches Are Seen 3-90
Remote Defect Indication Received 3-91
Peer MEP Times Out But No Alarm Or Action Occurs 3-92
No Debugs or Counters for Higher-Level Packets at a MEP or MIP 3-92
Dropped CFM PDUs 3-92
CFM ping Or traceroute Returns a “not found” Error 3-93
AIS Messages Are Not Sent 3-93
C H A P T E R 4 Troubleshooting Packet Forwarding 4-95
Understanding IPv4 CEF 4-95
Troubleshooting IPv4 CEF 4-96
Troubleshooting Adjacency Information 4-101
Troubleshooting Transient Traffic Drop 4-106
Contents
v
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Troubleshooting Packet Drop in the Fabric 4-109
Troubleshooting Control Plane Information 4-109
C H A P T E R 5 Troubleshooting Bundles and Load Balancing 5-115
Troubleshooting Routing and CEF Issues Related to Bundles and Load Balancing 5-115
Verifying Routing Table Entries for Parallel Links 5-115
Verifying the CEF Database and Measuring Flows 5-117
Troubleshooting Problems with Link Bundles 5-118
Bundle Does Not Come Up 5-118
Bundle Member Not Distributing 5-119
Bundle Not Using MAC-Address From Backplane 5-119
Layer 3 Data Traffic Not Flowing 5-120
Ping Failed over Bundle 5-120
Layer 3 Packets Not Synching Over Bundle 5-121
Layer 2 Traffic Not Flowing 5-121
Bundle Statistics 5-122
Troubleshooting Layer 2 Bundles and Load Balancing 5-122
Verifying the Bundle Status, IGP Route, and CEF Database 5-122
Viewing the Expected Paths and Measuring the Flows 5-123
Troubleshooting Layer 3 Bundles and Load Balancing 5-124
C H A P T E R 6 Troubleshooting Layer 3 Connectivity 6-125
Using show and debug Commands 6-125
Traffic Loss 6-128
Packets Are Punted and Switched in Software 6-129
Traceroute Fails 6-130
Adding Routes Fails 6-131
Continuous Tracebacks 6-133
fib_mgr Does Not Come Up During LC Reload or After Multiple Process Restarts 6-134
CEF Entries Out of Sync 6-135
fib_mgr Crashes 6-136
Tracebacks Appearing 6-136
Traffic Loss Because of Changing encap on a Subinterface 6-137
Traffic Loss during RSP Failover 6-138
Troubleshooting Virtual Router Redundancy Protocol 6-138
Using show and debug Commands 6-139
VRRP Fails to Reach Active State 6-140
Contents
vi
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Tracked Interface Failing, Router State Not Changed 6-140
VRRP State Flapping 6-140
More Than One VRRP Router Active 6-141
VRRP Active Router Not Forwarding Traffic 6-141
Traffic Loss or Unexpected VRRP State After Interface shut/no shut 6-142
Additional Information On Routing Configuration Commands 6-142
C H A P T E R 7 Troubleshooting Router Switch Fabric and Data Path 7-143
Understanding Switch Fabric Architecture 7-143
Getting Started with Fabric Troubleshooting 7-145
Troubleshooting Packet Drops 7-146
Displaying Traffic Status in Line Cards and RSP Cards 7-147
Locating Packet Drops by Examining Counters 7-148
Locating Drops of Punted Packets 7-155
Packet Drop from LC to LC 7-157
Packet Drop Between RSP and LC 7-158
Packet Drop After Certain Actions 7-160
Packet Drop After a Redundancy Switchover 7-161
Packet Drop with Unknown Reason 7-163
Troubleshooting RSP and LC Crashes 7-165
Active RSP Is Crashing 7-165
Standby RSP Is Crashing 7-166
LC Is Crashing 7-167
Troubleshooting Complete Loss of Traffic 7-168
No Traffic from LC to LC 7-169
No Traffic Between RSP and LC 7-170
Gathering Fabric Information Before Calling TAC 7-172
C H A P T E R 8 Troubleshooting MPLS Services 8-173
Verifying MPLS PIE Activation and MPLS Configuration 8-173
Troubleshooting Connectivity Over MPLS 8-174
Using show and debug Commands 8-174
IP Packets Not Forwarded to LSP 8-175
IP Packets Not Forwarded to MPLS TE Tunnel 8-176
MPLS Packets Not Forwarded to MPLS TE Tunnel 8-176
MPLS TE Tunnels Do Not Come Up 8-176
FRR-Protected Tunnel Goes Down After Triggering FRR 8-177
MPLS TE FRR Database Not Built 8-178
Contents
vii
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
MPLS FRR Switch Time Debugging 8-178
C H A P T E R 9 Troubleshooting L2VPN and Ethernet Services 9-181
Troubleshooting VLAN Traffic and L2 TCAM Classification 9-181
Understanding Problems with VLAN Traffic and L2 TCAM Classification 9-182
Verifying the Configuration Is Correct 9-182
Verifying Interfaces, Subinterfaces, and Packet Forwarding 9-183
Troubleshooting Multipoint Layer 2 Services 9-190
Basic Bridging: Example 9-190
Verifying MAC Address Updates 9-192
Troubleshooting Multipoint Layer 2 Bridging Services (VPLS) 9-195
Troubleshooting Bridge Domains That Use BGP-AD 9-201
Troubleshooting Point-to-Point Layer 2 Services 9-206
Example of Point-To-Point Layer 2 Deployment 9-206
Using show and debug Commands 9-210
AC Is Down 9-211
Pseudowire Is Down 9-212
VPWS Not Forwarding Traffic from AC to Pseudowire 9-212
Pseudowire Up but Ping Fails 9-213
Traffic Loss 9-213
Traffic Loss During RSP Fail Over 9-213
Preferred Path Not Working 9-214
Troubleshooting Specific Outage Scenarios In Layer 2 Services 9-214
Using show and debug Commands 9-215
L2VPN Discovery Not Working 9-217
AC Is Down 9-218
Pseudowire Is Down 9-219
VPLS Not Forwarding Flooding Traffic 9-220
VPLS Not Forwarding Flooding Traffic from AC to Pseudowire 9-224
VPLS Not Forwarding Flooding Traffic from Pseudowire to AC 9-224
VPLS Not Forwarding Unicast Traffic from AC to AC 9-225
VPLS Not Forwarding Unicast Traffic from AC to Pseudowire 9-225
VPLS Not Forwarding Flooding Traffic from Pseudowire to AC 9-225
Pseudowire Up but Ping Fails 9-226
Traffic Loss 9-226
Pseudowire Flap Causing Traffic Loss 9-226
Traffic Loss During RSP Fail Over 9-227
Preferred Path Not Working 9-227
Troubleshooting Dynamic Host Configuration Protocol Snooping 9-227
Contents
viii
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Show Commands 9-228
Trace Commands 9-228
Syslog Commands 9-228
Tech-support Commands 9-229
Action Commands 9-229
L2VPN Commands 9-229
L2Snoop Commands 9-229
Interface Controller Commands 9-230
Troubleshooting Multiple Spanning Tree 9-230
Using show and debug Commands 9-230
MSTP Incorrectly or Inconsistently Formed 9-230
MSTP Correctly Formed, but Traffic Flooding 9-231
Packet Forwarding Does Not Match MSTP State 9-231
MSTAG Access Network Does Not Recognize MSTAG Node as Root 9-231
Traffic Not Switching Through MSTAG Node(s) 9-232
Additional References—Command Reference and Configuration Guides 9-232
C H A P T E R 10 Troubleshooting Quality of Service and Access Control Lists 10-233
Using show and debug Commands 10-234
Service-Policy Configuration Is Rejected 10-235
Packets are Incorrectly Classified 10-235
Packets in Wrong Queue 10-236
Packets Incorrectly Marked 10-236
Packets Incorrectly Policed 10-237
Shaping Incorrect 10-237
Weighted Random Early Detection Incorrect 10-237
Bandwidth Not Guaranteed 10-238
Bandwidth Ratio Not Working 10-238
Non-zero Queue(conform) and Queue(exceed) Counters In show policy-map Commands 10-239
Unable to Modify or Delete policy-map or class-map 10-240
Unable to Modify or Delete class-map ACL 10-240
Unable to Delete service-policy 10-240
After QoS EA Restarts, show policy-map interface Fails 10-240
After QoS EA Restarts, service-policy config Fails 10-241
show policy-map interface Output Error 10-241
Bundle Members Not Configured with service-policy 10-241
Troubleshooting Access Control Lists 10-241
Contents
ix
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Using show and debug Commands 10-242
ACL Messages Not Appearing 10-243
Fragmented Packets Being Accepted 10-243
Egress Counter Incorrect or Not Working 10-244
ACL Interface Bind Rejected 10-244
Single ACE Using Many TCAMs 10-244
ACL Using Varying TCAM Space 10-245
ACL Logs Not Working for Ethernet Services 10-245
Ethernet Services ACL Bind on Interface Rejected 10-245
Changing ACL Exhausts TCAM 10-245
Cannot Delete ACL 10-246
DF Bit Not Supported 10-246
Max ACL Limit Reached 10-246
Unsupported Combinations in ACL 10-246
No Statistics Counters 10-246
TCAMs Out of Resources 10-246
C H A P T E R 11 Troubleshooting Multicast Services 11-247
Troubleshooting IGMP Snooping (Layer 2 Multicast) 11-247
Using show Commands 11-247
Using the debug, trace, and show tech-support Commands 11-249
Troubleshooting Missing Routes and Forwarding Errors 11-250
Troubleshooting Native Multicast Routing (Layer 3) 11-256
Using show and debug Commands 11-256
Multicast PIE Installation Fails 11-262
Multicast CLI Unavailable Although PIE Is Installed 11-263
“This command not authorized” Error Message 11-263
Dynamic IGMP Failure 11-263
Traffic Fails on Some Interfaces 11-267
Traffic Fails on Some Interfaces—MGID 11-268
Throughput Loss at Receiver Interfaces 11-268
Reverse Path Forwarding IP Address Problems 11-268
I N D E X
Contents
x
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
xi
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Preface
This guide describes how to troubleshooting a router using the Cisco IOS XR software.
This preface contains the following sections:
• Changes to This Document, page xi
• Obtaining Documentation and Submitting a Service Request, page xii
Changes to This Document
Table 1 lists the technical changes made to this document since it was first printed.
Table 1 Changes to This Document
Revision Date Change Summary
OL-23591-02 April, 2011 Added details for the following topics:
• Chapter 1, “General Troubleshooting Procedures”—Added
information on prerequisite documentation for troubleshooting,
Cisco-support task ID, show tech-support command, displaying
ASIC errors, gathering logs and system information. Modified the
information on diagnostics.
• Divided interface troubleshooting into two separate
chapters—Chapter 2, “Verifying and Troubleshooting Interface
Status”and Chapter 3, “Troubleshooting Interface Connectivity.”
• Chapter 3, “Troubleshooting Interface Connectivity”—Added
information on connectivity fault management (CFM).
• Chapter 6, “Troubleshooting Layer 3 Connectivity”—Added
information on CEF and interface accounting.
• Chapter 7, “Troubleshooting Router Switch Fabric and Data
Path”—Added information on NP counters.
• Chapter 8, “Troubleshooting MPLS Services”—Corrected syntax of
several commands.
continued ...
xii
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Preface
Obtaining Documentation and Submitting a Service Request
For information on obtaining documentation, submitting a service request, and gathering additional
information, see the monthly What’s New in Cisco Product Documentation, which also lists all new and
revised Cisco technical documentation, at:
http://www.cisco.com/en/US/docs/general/whatsnew/whatsnew.html
Subscribe to the What’s New in Cisco Product Documentation as a Really Simple Syndication (RSS) feed
and set content to be delivered directly to your desktop using a reader application. The RSS feeds are a free
service and Cisco currently supports RSS version 2.0.
OL-23591-02 April, 2011 ... continued
• Chapter 9, “Troubleshooting L2VPN and Ethernet
Services”—Enhanced information about VLAN verification,
included sample VLAN and PW configurations, added a section on
Verifying MAC Address Updates, enhanced information about
multipoint Layer 2 services (VPLS), moved information on DHCP
snooping to this chapter, enhanced information on MST access
gateways (MSTAGs). Reorganized the chapter for ease of use.
• Chapter 10, “Troubleshooting Quality of Service and Access
Control Lists”—Added information on queue conform and queue
exceed counters displayed by the policy-map command.
• Chapter 11, “Troubleshooting Multicast Services”—Reorganized
this chapter to highlight IGMP snooping (Layer 2 MC) and native
MC (Layer 3), and added information to each of these sections.
OL-23591-01 November
2010
(Initial release of this document as a multichapter book.) The content was
reorganized for usability and updated to reflect Release 3.9 and 4.0
features.
OL-20794-01 December
2009
Initial release of this document as a single module.
Table 1 Changes to This Document (continued)
Revision Date Change Summary
C H A P T E R
1-1
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
1
General Troubleshooting Procedures
This chapter describes general troubleshooting techniques you can use to troubleshoot the
Cisco ASR 9000 Aggregation Series Router. It includes the following sections:
• Prerequisite Documentation for Troubleshooting, page 1-1
• Verifying and Troubleshooting CLI Access, page 1-2
• Validating and Troubleshooting Installation of the Cisco IOS XR Software Package, page 1-7
• Validating and Troubleshooting Cisco IOS XR Software Configuration, page 1-16
• Verifying the System, page 1-26
• Troubleshooting the Backplane Ethernet Control System, page 1-41
• Basic Cisco IOS XR Verification and Troubleshooting Commands, page 1-46
• Displaying ASIC Errors, page 1-54
• Using Trace Commands, page 1-56
• MIB Location, page 1-57
• Gathering Information Before You Call Cisco TAC, page 1-58
Prerequisite Documentation for Troubleshooting
As a starting point for troubleshooting, we strongly recommend that you have a system of maintaining
and accessing detailed information about your network and ASR 9000 router. This should include:
• Current documentation about the system, including chassis numbers, serial numbers, installed cards,
and location of chassis details.
• Diagrams illustrating the connectivity of the router control plane Ethernet network.
• Detailed documentation about the network, including the following:
– Up-to-date internetwork map that outlines the physical location of all the devices on the network
and how they are connected, as well as a logical map of interfaces, network addresses, network
numbers, subnetworks, and so on
– List of all network protocols implemented in your network; and for each of the protocols
implemented, a list of the network numbers, subnetworks, zones, areas, and so on that are
associated with them
– All points of contact to external networks
– Routing protocol for each external network connection
1-2
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Verifying and Troubleshooting CLI Access
– Established baseline for your network, that is, the normal network behavior and performance at
different times of the day so that you can compare any problems with a baseline
– Name of the device that is the spanning tree root bridge for the system control plane Ethernet
network
• Captured output of all commands
Verifying and Troubleshooting CLI Access
Ensure that the system has been booted. If the system has not booted, see Cisco IOS XR Getting Started
Guide for the Cisco ASR 9000 Aggregation Services Router for information on booting a router running
Cisco IOS XR software. The following CLI access troubleshooting information is provided:
• General CLI Access Information, page 1-2
• User Access Privileges, page 1-2
• Cisco-support Task ID, page 1-3
• CLI Access Through a Console Port, page 1-3
• CLI Access Through a Terminal Server, page 1-3
• CLI Access Through the Management Ethernet Interface, page 1-4
General CLI Access Information
The following CLI access information applies to a console port, terminal server, and management
Ethernet interface connections.
Once the terminal emulation software is started and you press Enter, a router prompt should appear. If
no prompt appears, verify the physical connection to the console port and press Enter again. If the
prompt still does not appear, contact Cisco Technical Support. See the “Obtaining Documentation and
Submitting a Service Request” section on page xii for Cisco Technical Support contact information.
If a prompt appears, indicating that the CLI is accessible, but your login username and password are
invalid, you are prevented from accessing the router. Verify that you have the correct username and
password. If you have the correct username and password, but are locked out of the router, you may need
to perform password recovery to access the system again. See Cisco ASR 9000 Aggregation Services
Router ROM Monitor Guide for password recovery procedures.
User Access Privileges
When you log on to the router, use a username that is associated with a valid user group that has the
authorization to execute the required commands. If you suspect user group assignment is preventing you
from using a command, contact your AAA administrator for assistance.
See Cisco ASR 9000 Aggregation Services Router System Security Command Reference and
Cisco ASR 9000 Aggregation Services Router System Security Configuration Guide for information on
users, usernames, and user groups.
1-3
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Verifying and Troubleshooting CLI Access
Cisco-support Task ID
Many of the troubleshooting commands can be performed only by users who are assigned to a user group
that includes the cisco-support task ID. Users without the cisco-support task ID receive a “This
command is not authorized” response if they attempt to use those commands. The cisco-support
commands are normally reserved for use by Cisco Technical Support personnel, because there is some
risk that they may cause performance or other issues.
Caution These Cisco support commands are normally reserved for use by Cisco Technical Support personnel
only. There is some risk that they may cause performance or other issues that impact products without
proper usage, and we highly recommend that you contact Cisco Technical Support prior to using any of
these commands. See the “Obtaining Documentation and Submitting a Service Request” section on
page xii for information on contacting Cisco TAC.
CLI Access Through a Console Port
The first time a router is started, you must use a direct connection to the console port to connect to the
router and enter the initial configuration. See Cisco ASR 9000 Aggregation Services Router Router
Getting Started Guide for information on connecting to the router through a console port. When you use
a direct connection to the Console port, CLI commands are entered at a terminal or at a computer running
terminal emulation software. A direct Console port connection is useful for entering initial
configurations and performing some debugging tasks.
CLI Access Through a Terminal Server
A terminal server connection provides a way to access the Console port from a remote location. A
terminal server connection is used when you need to perform tasks that require Console port access from
a remote location.
Connecting to a router through a terminal server is similar to directly connecting through the Console
port. For both connection types, the physical connection takes place through the Console port. The
difference is that the terminal server connects directly to the Console port, and you must use a Telnet
session to establish communications through the terminal server to the router.
If you are unable to access the CLI through a terminal server, perform the following procedure.
Step 1 Disable flow control (XON/XOFF) on the Terminal Server.
Step 2 Disable local echo mode on the Terminal Server.
Step 3 Verify the router name configured using the hostname command.
Step 4 Check whether the port address is configured correctly.
Step 5 Verify whether the address (interface) used for the reverse Telnet is up/up. The output of the show
interfaces brief command provides this information. Cisco recommends you to use loopbacks because
they are always up.
Step 6 Ensure that you have the correct type of cabling. For example, you must not use a crossover cable to
extend the length.
Step 7 Establish a Telnet connection to the IP address port to test direct connectivity. You must Telnet from both
an external device and the terminal server. For example, telnet 172.21.1.1 2003.
1-4
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Verifying and Troubleshooting CLI Access
Step 8 Ensure that you have the transport input telnet command under the line for the target device. The target
device is the device that is connected to the terminal server.
Step 9 Use a PC/dumb terminal to connect directly to the console of the target router. The target router is the
device connected to the terminal server. This step helps you identify the presence of a port issue.
Step 10 If you are disconnected, check timeouts. You can remove or adjust timeouts.
Note If you encounter authentication failures, remember that the terminal server performs the first
authentication (if configured), while the device to which you try to connect performs the second
authentication (if configured). Verify whether AAA is configured correctly on both the terminal server
and the connecting device.
Step 11 Contact Cisco Technical Support. See the “Obtaining Documentation and Submitting a Service Request”
section on page xii for Cisco Technical Support contact information.
CLI Access Through the Management Ethernet Interface
The Management Ethernet interface allows you to manage the router using a network connection. Before
you can use the Management Ethernet interface, the interface must be configured. See
Cisco ASR 9000 Aggregation Services Router Router Getting Started Guide for information on
configuring the interface.
Once configured, the network connection takes place between client software on a workstation computer
and a server process within the router. The type of client software you use depends on the server process
you use. See Cisco ASR 9000 Aggregation Services Router Router Getting Started Guide for
information on the client and server services supported by the Cisco IOS XR software.
If you are unable to access the CLI through a management Ethernet interface, perform the following
procedure.
SUMMARY STEPS
1. show interface MgmtEth interface-instance
2. show arp MgmtEth interface-instance
3. show ipv4 interface type instance
4. ping
5. Contact Cisco Technical Support if the problem is not resolved
1-5
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Verifying and Troubleshooting CLI Access
DETAILED STEPS
Command or Action Purpose
Step 1 show interfaces MgmtEth interface-instance
Example:
RP/0/RSP0/CPU0:router# show interfaces MgmtEth
0/RSP0/CPU0/0
Displays statistics for all interfaces configured on the
router.
Check the following:
• MgmtEth interface is up
• Line protocol (state of the Layer 2 line protocol) is up
• Number of input and output errors
If an interface is administratively down, use the no
shutdown command to enable the interface.
If an interface is down (operationally down), input or output
errors are not within an acceptable range, the management
Ethernet interface is not enabled when the no shutdown
command is used, or the line protocol is down, see
Chapter 2, “Verifying and Troubleshooting Interface
Status,” for detailed information on troubleshooting
interfaces.
If the interface is up and the input and output errors are
within an acceptable range, proceed to Step 2.
Step 2 show arp MgmtEth interface-instance
Example:
RP/0/RSP0/CPU0:router# show arp MgmtEth
0/RSP0/CPU0/0
Displays the Address Resolution Protocol (ARP) table for
the management Ethernet interface.
Ensure that the expected ARP entries exist for the
management Ethernet interface.
If the expected ARP entries exist, proceed to Step 3.
If the expected ARP entries do not exist, verify the physical
layer Ethernet interface connectivity. Use the show arp
trace command to display the ARP entries in the buffer. See
the Chapter 2, “Verifying and Troubleshooting Interface
Status,” for more information on troubleshooting interfaces.
Step 3 show ipv4 interface type instance
Example:
RP/0/RSP0/CPU0:router# show ipv4 interface
MgmtEth 0/RSP0/CPU0/0
Displays the usability status of interfaces configured for
IPv4.
If the interface is in the expected state, proceed to Step 4.
If the status of the interface is not as expected, see
Chapter 2, “Verifying and Troubleshooting Interface
Status,” for more information on troubleshooting interfaces.
1-6
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Verifying and Troubleshooting CLI Access
Examples
The output from the show interfaces MgmtEth command displays the status of the management
Ethernet interface. In the following example, the management Ethernet interface is up, and there are 20
input errors and 8 output errors.
RP/0/RSP0/CPU0:router# show interface MgmtEth 0/RSP0/CPU0/0
Tue Sep 14 14:21:07.496 DST
MgmtEth0/RSP0/CPU0/0 is up, line protocol is up
Interface state transitions: 1
Hardware is Management Ethernet, address is 001b.53ff.4a62 (bia 001b.53ff.4a62)
Description: Connected to Lab LAN
Internet address is 172.29.52.137/24
MTU 1514 bytes, BW 100000 Kbit (Max: 100000 Kbit)
reliability 73/255, txload 0/255, rxload 0/255
Encapsulation ARPA,
Half-duplex, 100Mb/s, THD, link type is autonegotiation
output flow control is off, input flow control is off
loopback not set,
ARP type ARPA, ARP timeout 04:00:00
Last input 00:00:00, output 00:00:00
Last clearing of "show interface" counters never
5 minute input rate 2000 bits/sec, 3 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
373082 packets input, 51028824 bytes, 239105 total input drops
62028 drops for unrecognized upper-level protocol
Received 2601 broadcast packets, 194653 multicast packets
10 runts, 0 giants, 0 throttles, 0 parity
20 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
45232 packets output, 3042775 bytes, 0 total output drops
Output 24 broadcast packets, 0 multicast packets
8 output errors, 0 underruns, 0 applique, 0 resets
0 output buffer failures, 0 output buffers swapped out
1 carrier transitions
The output from the show arp MgmtEth 0/RSP0/CPU0/0 command displays the ARP table for the
management Ethernet interface. Use the output from this command to verify that there are dynamic ARP
addresses in the table and that ARP is functioning over the interface. The output shows that ARP is
functioning over the management Ethernet interface 0/RSP0/CPU0/0.
RP/0/RSP0/CPU0:router# show arp MgmtEth 0/RSP0/CPU0/0
Tue Sep 14 14:24:03.962 DST
-------------------------------------------------------------------------------
0/RSP0/CPU0
-------------------------------------------------------------------------------
Address Age Hardware Addr State Type Interface
Step 4 ping
Example:
RP/0/RSP0/CPU0:router# ping
Checks host reachability and network connectivity on the IP
network.
Note Enter a specific IP address or follow the prompts to
send the ping message to the target address.
If no problems are detected, proceed to Step 5.
Step 5 Contact Cisco Technical Support. If the problem is not resolved, contact Cisco Technical
Support. For Cisco Technical Support contact information,
see the “Obtaining Documentation and Submitting a
Service Request” section on page xii.
Command or Action Purpose
1-7
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Validating and Troubleshooting Installation of the Cisco IOS XR Software Package
172.29.52.1 01:44:00 0000.0c07.ac01 Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.13 01:16:59 0010.79e9.6038 Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.21 01:40:25 0022.0d5a.a6c4 Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.27 02:18:16 0012.7fd6.ba08 Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.28 02:05:29 0012.7fd6.ba09 Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.32 01:42:16 0022.0d26.3bc5 Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.36 02:39:34 0026.527c.5341 Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.46 01:36:50 0012.7fd6.b9aa Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.47 01:36:39 0012.7fd6.b9ab Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.60 01:35:20 0003.a099.8000 Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.69 00:00:00 001b.7852.4bd1 Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.70 01:23:38 0011.93ef.e8e6 Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.71 02:00:47 0011.93ef.e8fe Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.75 01:44:59 5a59.0000.0202 Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.76 01:41:10 0011.93ef.e8ea Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.81 00:15:35 001a.6c40.d89c Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.83 00:21:05 001a.6c40.d89c Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.127 01:43:38 0013.c4cb.a200 Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.134 01:15:53 001f.6c26.7fc0 Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.135 01:01:46 001f.6c25.c480 Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.136 00:43:39 0022.5560.8840 Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.137 - 001b.53ff.4a62 Interface ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.138 - 001b.53ff.4a62 Interface ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.161 01:32:12 0019.aaa3.3d48 Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.171 00:16:12 001c.5838.5b28 Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.172 00:17:47 001c.5838.5b29 Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.173 01:57:04 0015.c75f.09f8 Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.180 01:26:50 0015.c75f.0800 Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.217 01:16:21 0019.aaa3.b5ff Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.226 01:28:32 0010.f60e.8400 Dynamic ARPA MgmtEth0/RSP0/CPU0/0
172.29.52.243 01:48:25 001e.79c1.e0c1 Dynamic ARPA MgmtEth0/RSP0/CPU0/0
The ping command checks to see if the neighbor is reachable.
RP/0/RSP0/CPU0:router# ping 172.16.52.28 count 10
Tue Sep 14 14:36:52.441 DST
Type escape sequence to abort.
Sending 10, 100-byte ICMP Echos to 172.16.52.28, timeout is 2 seconds:
!!!!!!!!!!
Success rate is 100 percent (10/10), round-trip min/avg/max = 1/1/2 ms
Validating and Troubleshooting Installation of the Cisco IOS XR
Software Package
The Cisco IOS XR software is divided into software packages allowing you to select which features run
on your router. Each package contains the components to perform a specific set of router functions, such
as routing, security, or Modular Services Card (MSC) support. Bundles are groups of packages that can
be downloaded as a set. For example, the Unicast Routing Core Bundle provides six packages for use on
every router.
This section provides information on how to validate and troubleshoot the Cisco IOS XR software
package installation. The following sections are provided:
• Verifying the Software Version, page 1-8
• Validating the Installation, page 1-10
1-8
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Validating and Troubleshooting Installation of the Cisco IOS XR Software Package
Verifying the Software Version
To verify the Cisco IOS XR software version, perform the following procedure.
SUMMARY STEPS
1. show version
2. show install
DETAILED STEPS
The following example shows that the Cisco IOS XR software and active packages are version 4.0.0.
RP/0/RSP0/CPU0:router# show version
Cisco IOS XR Software, Version 4.0.0
Copyright (c) 2010 by cisco Systems, Inc.
ROM: System Bootstrap, Version 1.04(20100216:021454) [ASR9K ROMMON],
router uptime is 1 day, 18 hours, 34 minutes
System image file is "bootflash:disk0/asr9k-os-mbi-4.0.0/mbiasr9k-rp.vm"
cisco ASR9K Series (MPC8641D) processor with 4194304K bytes of memory.
MPC8641D processor at 1333MHz, Revision 2.2
2 Management Ethernet
Command or Action Purpose
Step 1 show version
Example:
RP/0/RSP0/CPU0:router# show version
Displays a variety of system information, including
hardware and software version, router uptime, boot settings
(configuration register), and active software.
Determine if all expected packages are installed and the
current software versions are the expected versions.
If the expected packages are not installed or are not the
expected version, install the correct package. See
Cisco ASR 9000 Aggregation Series Router Getting Started
Guide for information on installing and upgrading
Cisco IOS XR software packages.
Step 2 show install
Example:
RP/0/RSP0/CPU0:router# show install
Displays a list of all installed and active packages on each
node.
Determine if the expected packages are installed on each
node.
If the software or active package versions are not as
expected for a node, the package is not compatible with the
node for which it is being activated, or the package being
activated is not compatible with the current active software
set, install the correct software or package on the node. See
Cisco ASR 9000 Aggregation Series Router Getting Started
Guide for information on installing and upgrading
Cisco IOS XR software packages.
1-9
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Validating and Troubleshooting Installation of the Cisco IOS XR Software Package
12 DWDM controller(s)
12 TenGigE
40 GigabitEthernet
2 SONET/SDH
2 Packet over SONET/SDH
219k bytes of non-volatile configuration memory.
975M bytes of compact flash card.
33994M bytes of hard disk.
1605616k bytes of disk0: (Sector size 512 bytes).
1605616k bytes of disk1: (Sector size 512 bytes).
Configuration register on node 0/RSP0/CPU0 is 0x0
Boot device on node 0/RSP0/CPU0 is disk0:
Package active on node 0/RSP0/CPU0:
asr9k-optics-supp, V 4.0.0[DT_IMAGE], Cisco Systems, at disk0:asr9k-optics-supp-4.0.0
Built on Wed Sep 8 16:17:30 DST 2010
By sjc5-gf-021 in /auto/ioxbuild8/production/4.0.0.DT_IMAGE/asr9k/workspace for pie
asr9k-fwding, V 4.0.0[DT_IMAGE], Cisco Systems, at disk0:asr9k-fwding-4.0.0
Built on Wed Sep 8 16:12:40 DST 2010
By sjc5-gf-021 in /auto/ioxbuild8/production/4.0.0.DT_IMAGE/asr9k/workspace for pie
asr9k-cpp, V 4.0.0[DT_IMAGE], Cisco Systems, at disk0:asr9k-cpp-4.0.0
Built on Wed Sep 8 16:13:28 DST 2010
By sjc5-gf-021 in /auto/ioxbuild8/production/4.0.0.DT_IMAGE/asr9k/workspace for pie
asr9K-doc-supp, V 4.0.0[DT_IMAGE], Cisco Systems, at disk0:asr9K-doc-supp-4.0.0
Built on Wed Sep 8 16:16:57 DST 2010
By sjc5-gf-021 in /auto/ioxbuild8/production/4.0.0.DT_IMAGE/asr9k/workspace for pie
asr9k-scfclient, V 4.0.0[DT_IMAGE], Cisco Systems, at disk0:asr9k-scfclient-4.0.0
Built on Wed Sep 8 16:13:26 DST 2010
--More--
.
.
.
The following example shows that the Cisco IOS XR software and active packages are version 4.0.0. If
there is an expected package missing or an active package is not an expected package, install and activate
the missing package or upgrade the unexpected package to the appropriate package. See
Cisco ASR 9000 Aggregation Services Router Router Getting Started Guide for details on installing,
activating, and upgrading software packages.
RP/0/RSP0/CPU0:router# show install
Node 0/RSP0/CPU0 [RP] [SDR: Owner]
Boot Device: disk0:
Boot Image: /disk0/asr9k-os-mbi-4.0.0/mbiasr9k-rp.vm
Active Packages:
disk0:asr9k-mini-p-4.0.0
disk0:asr9k-optic-4.0.0
disk0:asr9k-doc-p-4.0.0
disk0:asr9k-k9sec-p-4.0.0
disk0:asr9k-video-p-4.0.0
disk0:asr9k-mpls-p-4.0.0
disk0:asr9k-mgbl-p-4.0.0
disk0:asr9k-mcast-p-4.0.0
Node 0/1/CPU0 [LC] [SDR: Owner]
Boot Device: mem:
Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm
Active Packages:
disk0:asr9k-mini-p-4.0.0
1-10
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Validating and Troubleshooting Installation of the Cisco IOS XR Software Package
disk0:asr9k-optic-4.0.0
disk0:asr9k-video-p-4.0.0
disk0:asr9k-mpls-p-4.0.0
disk0:asr9k-mcast-p-4.0.0
Node 0/2/CPU0 [LC] [SDR: Owner]
Boot Device: mem:
Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm
Active Packages:
disk0:asr9k-mini-p-4.0.0
disk0:asr9k-optic-4.0.0
disk0:asr9k-video-p-4.0.0
disk0:asr9k-mpls-p-4.0.0
disk0:asr9k-mcast-p-4.0.0
Node 0/4/CPU0 [LC] [SDR: Owner]
Boot Device: mem:
Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm
Active Packages:
disk0:asr9k-mini-p-4.0.0
disk0:asr9k-optic-4.0.0
disk0:asr9k-video-p-4.0.0
disk0:asr9k-mpls-p-4.0.0
disk0:asr9k-mcast-p-4.0.0
Node 0/6/CPU0 [LC] [SDR: Owner]
Boot Device: mem:
Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm
Active Packages:
disk0:asr9k-mini-p-4.0.0
disk0:asr9k-optic-4.0.0
disk0:asr9k-video-p-4.0.0
disk0:asr9k-mpls-p-4.0.0
disk0:asr9k-mcast-p-4.0.0
Validating the Installation
Validate the Cisco IOS XR software package installation to ensure the packages were installed correctly.
The following commands are used to validate the currently installed software packages:
• install verify Command, page 1-10
• show install active Command, page 1-12
• show install committed Command, page 1-14
install verify Command
Use the install verify command to verify the consistency of a previously installed software set with the
package file from which it originated.
This command can be used as a debugging tool to verify the validity of the files that constitute the
packages to determine if there are any corrupted files. The command is also used to check that the install
infrastructure is up and running and to determine if all files are expected. If there are corrupted files, see
Cisco ASR 9000 Aggregation Services Router Router Getting Started Guide for information on
deactivating and removing software packages and adding and activating software packages.
1-11
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Validating and Troubleshooting Installation of the Cisco IOS XR Software Package
Note The install verify command can take up to two minutes per package to process.
Note The install verify command ignores secure domain router (SDR) boundaries and performs the operation
in global scope.
The following example shows the output of the install verify command. The output is used to verify the
consistency of a previously installed software set with the package file from which it originated.
RP/0/RSP0/CPU0:router(admin)# install verify
Sat Sep 25 08:18:14.077 DST
Install operation 3 '(admin) install verify packages' started by user_A
'dwolman-r' via CLI at 08:18:14 DST Sat Sep 25 2010.
The install operation will continue asynchronously.
RP/0/RSP0/CPU0:router(admin)#Info: This operation can take up to 2 minutes per package
being verified.
Info: Please be patient.
Info: 0/0/CPU0 [LC] [SDR: Owner]
Info: meta-data: [SUCCESS] Verification Successful.
Info: /install/asr9k-optics-supp-4.0.0: [SUCCESS] Verification
Info: Successful.
Info: /install/asr9k-fwding-4.0.0: [SUCCESS] Verification
Info: Successful.
Info: /install/asr9k-cpp-4.0.0: [SUCCESS] Verification Successful.
Info: /install/asr9k-scfclient-4.0.0: [SUCCESS] Verification
Info: Successful.
Info: /install/iosxr-video-adv-4.0.0: [SUCCESS] Verification
Info: Successful.
Info: /install/iosxr-mpls-4.0.0: [SUCCESS] Verification Successful.
Info: /install/iosxr-mcast-4.0.0: [SUCCESS] Verification
Info: Successful.
Info: /install/iosxr-routing-4.0.0: [SUCCESS] Verification
Info: Successful.
Info: /install/iosxr-infra-4.0.0: [SUCCESS] Verification
Info: Successful.
Info: /install/iosxr-fwding-4.0.0: [SUCCESS] Verification
Info: Successful.
Info: /install/iosxr-diags-4.0.0: [SUCCESS] Verification
Info: Successful.
Info: /install/asr9k-adv-video-supp-4.0.0: [SUCCESS] Verification
Info: Successful.
Info: /install/asr9k-diags-supp-4.0.0: [SUCCESS] Verification
Info: Successful.
Info: /install/asr9k-mcast-supp-4.0.0: [SUCCESS] Verification
Info: Successful.
Info: /install/asr9k-base-4.0.0: [SUCCESS] Verification Successful.
Info: 0/6/CPU0 [LC] [SDR: Owner]
Info: meta-data: [SUCCESS] Verification Successful.
Info: /install/asr9k-optics-supp-4.0.0: [SUCCESS] Verification
Info: Successful.
Info: /install/asr9k-fwding-4.0.0: [SUCCESS] Verification
Info: Successful.
Info: /install/asr9k-cpp-4.0.0: [SUCCESS] Verification Successful.
Info: /install/asr9k-scfclient-4.0.0: [SUCCESS] Verification
Info: Successful.
Info: /install/iosxr-video-adv-4.0.0: [SUCCESS] Verification
Info: Successful.
Info: /install/iosxr-mpls-4.0.0: [SUCCESS] Verification Successful.
Info: /install/iosxr-mcast-4.0.0: [SUCCESS] Verification
1-12
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Validating and Troubleshooting Installation of the Cisco IOS XR Software Package
Info: Successful.
Info: /install/iosxr-routing-4.0.0: [SUCCESS] Verification
Info: Successful.
Info: /install/iosxr-infra-4.0.0: [SUCCESS] Verification
Info: Successful.
Info: /install/iosxr-fwding-4.0.0: [SUCCESS] Verification
Info: Successful.
Info: /install/iosxr-diags-4.0.0: [SUCCESS] Verification
Info: Successful.
Info: /install/asr9k-adv-video-supp-4.0.0: [SUCCESS] Verification
Info: Successful.
Info: /install/asr9k-diags-supp-4.0.0: [SUCCESS] Verification
Info: Successful.
Info: /install/asr9k-mcast-supp-4.0.0: [SUCCESS] Verification
Info: Successful.
Info: /install/asr9k-base-4.0.0: [SUCCESS] Verification Successful.
Info: 0/5/CPU0 [LC] [SDR: Owner]
.
.
.
Info: Verification Summary:
Info: 0/0/CPU0: SUCCESSFUL. No anomalies found.
Info: 0/6/CPU0: SUCCESSFUL. No anomalies found.
Info: 0/5/CPU0: SUCCESSFUL. No anomalies found.
Info: 0/7/CPU0: SUCCESSFUL. No anomalies found.
Info: 0/1/CPU0: SUCCESSFUL. No anomalies found.
Info: 0/4/CPU0: SUCCESSFUL. No anomalies found.
Info: 0/2/CPU0: SUCCESSFUL. No anomalies found.
Info: 0/RSP0/CPU0: SUCCESSFUL. No anomalies found.
Info: The system needs no repair.
Install operation 3 completed successfully at 08:19:48 DST Sat Sep 25 2010.
show install active Command
Use the show install active command to display active software packages. Verify that the command
output matches the output of the show install committed command. If the output does not match, when
you reload the router, the software displayed in the show install committed command output is the
software that will be loaded. For example, the following output shows two different software package
versions, one is the active version and the other is the committed version, so when the router reloads, the
3.9.1 version will be loaded even though 4.0.0 is the currently active version on 0/RSP0/CPU0.
RP/0/RSP0/CPU0:router(admin)# show install active location 0/RSP0/cpu0
Node 0/RSP0/CPU0 [RP] [SDR: Owner]
Boot Device: disk0:
Boot Image: /disk0/asr9k-os-mbi-4.0.0/mbiasr9k-rp.vm << 4.0.0 is active, not committed
Active Packages:
disk0:asr9k-mini-p-4.0.0
disk0:asr9k-optic-4.0.0
disk0:asr9k-doc-p-4.0.0
disk0:asr9k-k9sec-p-4.0.0
disk0:asr9k-video-p-4.0.0
disk0:asr9k-mpls-p-4.0.0
disk0:asr9k-mgbl-p-4.0.0
disk0:asr9k-mcast-p-4.0.0
RP/0/RSP0/CPU0:router(admin)# show install committed location 0/RSP0/cpu0
Node 0/RSP0/CPU0 [RP] [SDR: Owner]
Boot Device: disk0:
Boot Image: /disk0/asr9k-os-mbi-3.9.1/mbiasr9k-rp.vm<< 3.9.1 is committed
1-13
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Validating and Troubleshooting Installation of the Cisco IOS XR Software Package
Committed Packages:
disk0:asr9k-mini-p-3.9.1
disk0:asr9k-optic-3.9.1
disk0:asr9k-doc-p-3.9.1
disk0:asr9k-k9sec-p-3.9.1
disk0:asr9k-video-p-3.9.1
disk0:asr9k-mpls-p-3.9.1
disk0:asr9k-mgbl-p-3.9.1
disk0:asr9k-mcast-p-3.9.1
If the expected active software packages are not displayed, install the packages (if required) and activate
the packages. See Cisco ASR 9000 Aggregation Services Router Router Getting Started Guide for
information on installing and activating Cisco IOS XR software packages. The following example
output shows the active packages for all cards in a router. The output displays the disk on which each
package is located.
RP/0/RSP0/CPU0:router# show install active
Node 0/RSP0/CPU0 [RP] [SDR: Owner]
Boot Device: disk0:
Boot Image: /disk0/asr9k-os-mbi-4.0.0/mbiasr9k-rp.vm
Active Packages:
disk0:asr9k-mini-p-4.0.0
disk0:asr9k-optic-4.0.0
disk0:asr9k-doc-p-4.0.0
disk0:asr9k-k9sec-p-4.0.0
disk0:asr9k-video-p-4.0.0
disk0:asr9k-mpls-p-4.0.0
disk0:asr9k-mgbl-p-4.0.0
disk0:asr9k-mcast-p-4.0.0
Node 0/0/CPU0 [LC] [SDR: Owner]
Boot Device: mem:
Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm
Active Packages:
disk0:asr9k-mini-p-4.0.0
disk0:asr9k-optic-4.0.0
disk0:asr9k-video-p-4.0.0
disk0:asr9k-mpls-p-4.0.0
disk0:asr9k-mcast-p-4.0.0
Node 0/1/CPU0 [LC] [SDR: Owner]
Boot Device: mem:
Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm
Active Packages:
disk0:asr9k-mini-p-4.0.0
disk0:asr9k-optic-4.0.0
disk0:asr9k-video-p-4.0.0
disk0:asr9k-mpls-p-4.0.0
disk0:asr9k-mcast-p-4.0.0
Node 0/2/CPU0 [LC] [SDR: Owner]
Boot Device: mem:
Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm
Active Packages:
disk0:asr9k-mini-p-4.0.0
disk0:asr9k-optic-4.0.0
disk0:asr9k-video-p-4.0.0
disk0:asr9k-mpls-p-4.0.0
disk0:asr9k-mcast-p-4.0.0
Node 0/4/CPU0 [LC] [SDR: Owner]
Boot Device: mem:
1-14
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Validating and Troubleshooting Installation of the Cisco IOS XR Software Package
Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm
Active Packages:
disk0:asr9k-mini-p-4.0.0
disk0:asr9k-optic-4.0.0
disk0:asr9k-video-p-4.0.0
disk0:asr9k-mpls-p-4.0.0
disk0:asr9k-mcast-p-4.0.0
Node 0/5/CPU0 [LC] [SDR: Owner]
Boot Device: mem:
Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm
Active Packages:
disk0:asr9k-mini-p-4.0.0
disk0:asr9k-optic-4.0.0
disk0:asr9k-video-p-4.0.0
disk0:asr9k-mpls-p-4.0.0
disk0:asr9k-mcast-p-4.0.0
Node 0/6/CPU0 [LC] [SDR: Owner]
Boot Device: mem:
Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm
Active Packages:
disk0:asr9k-mini-p-4.0.0
disk0:asr9k-optic-4.0.0
disk0:asr9k-video-p-4.0.0
disk0:asr9k-mpls-p-4.0.0
disk0:asr9k-mcast-p-4.0.0
Node 0/7/CPU0 [LC] [SDR: Owner]
Boot Device: mem:
Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm
Active Packages:
disk0:asr9k-mini-p-4.0.0
disk0:asr9k-optic-4.0.0
disk0:asr9k-video-p-4.0.0
disk0:asr9k-mpls-p-4.0.0
The output shows the name of the disk on which the packages are located. In the above example, the
active packages for each node are on disk0, and for all nodes, the composite package asr9k-os-mbi-4.0.0
is active. Additional packages shown are optional packages that have been activated after the initial
loading of the Cisco ASR 9000 Aggregation Series Router Unicast Routing Core Bundle.
show install committed Command
Use the show install committed command to display committed software packages. The committed
software packages are the software packages that will be booted on a router reload.
Committed packages are the packages that are persistent across router reloads. If you install and activate
a package, it remains active until the next router reload. If you commit a package set, all packages in that
set remain active across router reloads until the package set is replaced with another committed package
set. The show install committed command is useful to ensure software is installed and committed after
a router reload. If the expected software is not installed and committed, see
Cisco ASR 9000 Aggregation Services Router Getting Started Guide for information on installing and
committing Cisco IOS XR software packages.
The following command output shows the committed software packages on all cards in the router. The
output displays the disk on which each package is located.
RP/0/RSP0/CPU0:router# show install committed
Node 0/RSP0/CPU0 [RP] [SDR: Owner]
1-15
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Validating and Troubleshooting Installation of the Cisco IOS XR Software Package
Boot Device: disk0:
Boot Image: /disk0/asr9k-os-mbi-4.0.0/mbiasr9k-rp.vm
Committed Packages:
disk0:asr9k-mini-p-4.0.0
disk0:asr9k-optic-4.0.0
disk0:asr9k-doc-p-4.0.0
disk0:asr9k-k9sec-p-4.0.0
disk0:asr9k-video-p-4.0.0
disk0:asr9k-mpls-p-4.0.0
disk0:asr9k-mgbl-p-4.0.0
disk0:asr9k-mcast-p-4.0.0
Node 0/0/CPU0 [LC] [SDR: Owner]
Boot Device: mem:
Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm
Committed Packages:
disk0:asr9k-mini-p-4.0.0
disk0:asr9k-optic-4.0.0
disk0:asr9k-video-p-4.0.0
disk0:asr9k-mpls-p-4.0.0
disk0:asr9k-mcast-p-4.0.0
Node 0/1/CPU0 [LC] [SDR: Owner]
Boot Device: mem:
Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm
Committed Packages:
disk0:asr9k-mini-p-4.0.0
disk0:asr9k-optic-4.0.0
disk0:asr9k-video-p-4.0.0
disk0:asr9k-mpls-p-4.0.0
disk0:asr9k-mcast-p-4.0.0
Node 0/2/CPU0 [LC] [SDR: Owner]
Boot Device: mem:
Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm
Committed Packages:
disk0:asr9k-mini-p-4.0.0
disk0:asr9k-optic-4.0.0
disk0:asr9k-video-p-4.0.0
disk0:asr9k-mpls-p-4.0.0
disk0:asr9k-mcast-p-4.0.0
Node 0/4/CPU0 [LC] [SDR: Owner]
Boot Device: mem:
Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm
Committed Packages:
disk0:asr9k-mini-p-4.0.0
disk0:asr9k-optic-4.0.0
disk0:asr9k-video-p-4.0.0
disk0:asr9k-mpls-p-4.0.0
disk0:asr9k-mcast-p-4.0.0
Node 0/5/CPU0 [LC] [SDR: Owner]
Boot Device: mem:
Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm
Committed Packages:
disk0:asr9k-mini-p-4.0.0
disk0:asr9k-optic-4.0.0
disk0:asr9k-video-p-4.0.0
disk0:asr9k-mpls-p-4.0.0
disk0:asr9k-mcast-p-4.0.0
Node 0/6/CPU0 [LC] [SDR: Owner]
Boot Device: mem:
1-16
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Validating and Troubleshooting Cisco IOS XR Software Configuration
Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm
Committed Packages:
disk0:asr9k-mini-p-4.0.0
disk0:asr9k-optic-4.0.0
disk0:asr9k-video-p-4.0.0
disk0:asr9k-mpls-p-4.0.0
disk0:asr9k-mcast-p-4.0.0
Node 0/7/CPU0 [LC] [SDR: Owner]
Boot Device: mem:
Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm
Committed Packages:
disk0:asr9k-mini-p-4.0.0
disk0:asr9k-optic-4.0.0
disk0:asr9k-video-p-4.0.0
disk0:asr9k-mpls-p-4.0.0
disk0:asr9k-mcast-p-4.0.0
The output shows the name of the disk on which the packages are located. In the above example, the
committed packages for each node are on disk0, and for all nodes, the composite package
asr9k-os-mbi-4.0.0 is committed. Additional packages shown are optional packages that have been
committed after the initial loading of the Cisco ASR 9000 Aggregation Series Router Unicast Routing
Core Bundle.
Validating and Troubleshooting Cisco IOS XR Software
Configuration
Validating the Cisco IOS XR software configuration includes collecting configuration information on
the router to determine configuration changes and verifying the current running configuration. When a
configuration fails during a commit, the failed configuration can be viewed to help determine why the
configuration was not committed.
The following sections are provided:
• Local and Global Configurations, page 1-16
• Collecting Configuration Information, page 1-19
• Verifying the Running Configuration, page 1-20
• Using the show configuration failed Command, page 1-24
Local and Global Configurations
To troubleshoot configurations, you need to determine whether the problem is in the local configuration
or the shared (global) configuration.
• The local configuration is specific to the individual LC or RP to which it belongs. Every LC and RP
has a data store containing the local data for that node, including configuration and operational data
for the local interfaces. An example of a local configuration is the port designations on a particular
LC.
• The shared (global) configuration applies to the entire router, and is shared with all of the LCs and
RPs. An example of a shared configuration is the routing protocol parameters.
To view the local configuration, use the show running-config interface * command. The output
displays all the configured interfaces on the node.
1-17
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Validating and Troubleshooting Cisco IOS XR Software Configuration
RP/0/RSP0/CPU0:router# show running-config interface *
interface Bundle-Ether16
description Connect to router-S Port-Ch 16
mtu 9216
bundle maximum-active links 1
!
interface Bundle-Ether16.160 l2transport
description Connect to router-S Port-Ch 16 Service Instance 160
encapsulation dot1q 160
!
.
.
.
!
interface Loopback0
ipv4 address 10.144.144.144 255.255.255.255
!
interface tunnel-ip10
!
interface tunnel-te44190
description Primary GE Tunnel from router-S to router-T
ipv4 unnumbered Loopback0
priority 0 0
autoroute announce
signalled-bandwidth 100000
destination 10.19.19.19
fast-reroute
record-route
path-option 1 explicit name Primary_GE_Path_to_router-T ospf 100 area 0
!
.
.
.
interface MgmtEth0/RSP0/CPU0/0
description Connected to LAN
ipv4 address 172.29.52.137 255.255.255.0
!
interface MgmtEth0/RSP0/CPU0/1
shutdown
!
interface GigabitEthernet0/0/0/0
shutdown
!
interface GigabitEthernet0/0/0/1
shutdown
!
interface GigabitEthernet0/0/0/2
shutdown
!
.
.
.
interface TenGigE0/7/0/1
shutdown
!
interface TenGigE0/7/0/2
shutdown
!
interface TenGigE0/7/0/3
shutdown
!
interface POS0/2/0/0
description Connected to PE_router-2 POS 0/2/0/0
1-18
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Validating and Troubleshooting Cisco IOS XR Software Configuration
!
interface POS0/2/0/1
description Connected to PE_router-3 POS 0/2/0/1
!
controller SONET0/2/0/0
clock source internal
!
controller SONET0/2/0/1
clock source internal
!
Use the show sysdb trace commands to display the contents of the system database after a configuration
change. The trace information includes a history of any changes to the running configuration. You can
specify either a local node or the shared plane.
The following example output shows the contents of the local database, that is, for a specific location
(node):
RP/0/RSP0/CPU0:router# show sysdb trace verification location 0/5/cpu0 reverse
.
.
.
Timestamp nid reqid jid tid reg_hndl connid action
path
432 wrapping entries (8192 possible, 158 filtered, 590 total)
Sep 23 04:35:39.969 0/RSP0/CPU0 8168 354 1 94 4483 apply
reply '--'
Sep 23 04:35:39.960 0/RSP0/CPU0 8168 354 1 94 4505 Apply
called 'cfg/if/act/tunnel-ip10/v'
Sep 23 04:35:39.960 0/RSP0/CPU0 8168 354 1 94 4505 verify
reply: accept '--'
Sep 23 04:35:39.685 0/RSP0/CPU0 8168 354 1 94 4505 Verify
called 'cfg/if/act/tunnel-ip10/v'
Sep 23 04:35:39.678 0/RSP0/CPU0 0 354 1 94 4505
register 'cfg/if/act/tunnel-ip[0-9]*/mtu/tunnel-ip'
Sep 23 04:35:39.678 0/RSP0/CPU0 0 354 1 94 4505
register 'cfg/if/act/tunnel-ip[0-9]*/im/bw'
Sep 23 04:35:39.678 0/RSP0/CPU0 0 354 1 94 4505
register 'cfg/if/act/tunnel-ip[0-9]*/tunl_gre/keepalive'
Sep 23 04:35:39.678 0/RSP0/CPU0 0 354 1 94 4505
register 'cfg/if/act/tunnel-ip[0-9]*/tunl_gre/dfbit_disable'
Sep 23 04:35:39.678 0/RSP0/CPU0 0 354 1 94 4505
register 'cfg/if/act/tunnel-ip[0-9]*/tunl_gre/ttl'
Sep 23 04:35:39.678 0/RSP0/CPU0 0 354 1 94 4505
register 'cfg/if/act/tunnel-ip[0-9]*/tunl_gre/tos'
Sep 23 04:35:39.678 0/RSP0/CPU0 0 354 1 94 4505
register 'cfg/if/act/tunnel-ip[0-9]*/tunl_gre/mode'
.
.
.
The following example output shows the contents of the shared database, that is, the configuration data
that is shared with all LC and RP in the router:
RP/0/RSP0/CPU0:router# show sysdb trace verification shared-plane reverse
Config Shared Server
====================
Timestamp nid reqid jid tid reg_hndl connid action
path
2259 wrapping entries (4096 possible, 0 filtered, 2259 total)
1-19
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Validating and Troubleshooting Cisco IOS XR Software Configuration
Sep 23 19:34:40.202 0/3/CPU0 0 241 8 384 1430
unregister 'from-'
Sep 23 19:34:40.197 0/3/CPU0 0 241 15 385 1434
unregister 'from-'
Sep 23 19:34:40.196 0/3/CPU0 0 163 1 386 1440
unregister 'from-'
Sep 23 19:14:45.076 0/3/CPU0 0 163 1 386 1440
register 'cfg/gl/ipv4/cef/hardware/forwarding/update/synchronous'
Sep 23 19:14:41.679 0/3/CPU0 0 241 15 385 1434
register 'cfg/gl/dbgtrace/node/831/'
Sep 23 19:14:41.593 0/3/CPU0 0 241 8 384 1430
register 'cfg/gl/dbgtrace/node/831/'
Sep 23 19:12:36.472 0/3/CPU0 0 241 8 381 1375
unregister 'from-'
Sep 23 19:12:36.471 0/3/CPU0 0 241 15 382 1378
unregister 'from-'
Sep 23 19:12:36.470 0/3/CPU0 0 163 1 383 1383
unregister 'from-'
Sep 23 19:07:56.914 0/3/CPU0 0 163 1 383 1383
register 'cfg/gl/ipv4/cef/hardware/forwarding/update/synchronous'
.
.
.
The show processes location node-id | include sysdb command displays all active database processes
for a specified node.
RP/0/RSP0/CPU0:router# show process location 0/1/CPU0 | include sysdb
Thu Nov 4 14:06:30.191 DST
279 1 0 56K 10 Sigwaitinfo 739:28:22:0145 0:00:00:0057 sysdb_svr_local
279 2 1 56K 10 Receive 0:00:00:0779 0:00:02:0459 sysdb_svr_local
279 3 1 56K 10 Receive 0:03:34:0474 0:00:03:0285 sysdb_svr_local
279 4 1 56K 10 Receive 0:05:03:0006 0:00:02:0368 sysdb_svr_local
277 1 0 64K 10 Sigwaitinfo 739:28:21:0305 0:00:00:0046 sysdb_mc
277 2 0 64K 10 Receive 739:28:21:0274 0:00:00:0003 sysdb_mc
277 3 1 64K 10 Receive 166:59:14:0698 0:00:00:0038 sysdb_mc
277 4 1 64K 10 Receive 0:01:49:0941 0:00:00:0106 sysdb_mc
277 6 1 64K 10 Receive 739:15:22:0734 0:00:00:0058 sysdb_mc
See Chapter 1, “General Troubleshooting Procedures” for additional information on troubleshooting
processes.
Collecting Configuration Information
Collecting configuration information allows you to determine if changes to the system have occurred. It
also allows you to determine if these changes could impact the system. The following commands allow
you to determine if there was an unknown commit, if there was a commit that overwrote a previous
configuration, or there are configuration changes that should be removed from the running configuration.
• show configuration commit changes {[since] commit-id | last number-of-commits} [diff]—the
command output displays changes made to the running configuration by previous configuration
commits.
RP/0/RSP0/CPU0:router# show configuration commit changes since 1000000319
Wed May 17 09:30:27.877 UTC
Building configuration...
no logging console
no domain ipv4 host ce1
no domain ipv4 host ce2
domain ipv4 host ce6 172.29.52.73
domain ipv4 host ce7 172.29.52.78
1-20
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Validating and Troubleshooting Cisco IOS XR Software Configuration
no domain ipv4 host pe1
no domain ipv4 host pe2
domain ipv4 host pe6 172.29.52.128
domain ipv4 host pe7 172.29.52.182
interface GigabitEthernet0/1/5/1
no negotiation
!
end
• show configuration commit list [number-of-commits] [detail]—the command output displays a list
of the commit IDs (up to 100) available for rollback.
RP/0/RSP0/CPU0:router# show configuration commit list
Wed May 17 09:31:21.727 UTC
SNo. Label/ID User Line Client Time Stamp
~~~~ ~~~~~~~~ ~~~~ ~~~~ ~~~~~~ ~~~~~~~~~~
1 1000000324 userA vty0 CLI 16:50:33 UTC Wed May 10 2006
2 1000000323 userA vty0 CLI 16:49:51 UTC Wed May 10 2006
3 1000000322 userB vty0 CLI 16:48:05 UTC Wed May 10 2006
4 1000000321 userC vty2 CLI 19:11:26 UTC Wed May 03 2006
5 1000000320 userA vty2 CLI 19:10:45 UTC Wed May 03 2006
6 1000000319 userB vty2 CLI 18:03:01 UTC Wed May 03 2006
7 1000000318 userB vty2 CLI 18:02:43 UTC Wed May 03 2006
8 1000000317 userB vty2 CLI 18:02:38 UTC Wed May 03 2006
9 1000000316 userC vty2 CLI 17:59:16 UTC Wed May 03 2006
10 1000000315 userC vty2 CLI 17:46:38 UTC Wed May 03 2006
11 1000000314 userA vty2 CLI 15:40:04 UTC Wed May 03 2006
12 1000000313 userA vty2 CLI 13:05:09 UTC Wed May 03 2006
13 1000000312 userD con0_RSP0_C CLI 13:49:31 UTC Mon May 01 2006
• commit confirmed minutes (executed from config mode)—This command commits the
configuration on a trial basis for a minimum of 30 seconds and a maximum of 300 seconds (5
minutes). During the trial configuration period, enter commit to confirm the configuration. If
commit is not entered, then the system will revert to the previous configuration when the trial time
period expires.
Verifying the Running Configuration
To verify the running configuration, perform the following procedure.
SUMMARY STEPS
1. configure
2. show running-config
3. describe hostname hostname
4. end
5. show sysdb trace verification shared-plane | include path
6. show sysdb trace verification location node-id
7. show cfgmgr trace
8. show configuration history commit
9. show configuration commit changes {last | since | commit-id}
1-21
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Validating and Troubleshooting Cisco IOS XR Software Configuration
10. show config failed startup
11. cfs check
DETAILED STEPS
Command or Action Purpose
Step 1 configure
Example:
RP/0/RSP0/CPU0:router# configure
Enters global configuration mode.
Step 2 show running-config
Example:
RP/0/RSP0/CPU0:router(config)# show
running-config
Displays the contents of the running configuration.
Verify that the running configuration is as expected.
Step 3 describe hostname hostname
Example:
RP/0/RSP0/CPU0:router(config)# describe
hostname router_A
Determines the path.
Step 4 end
Example:
RP/0/RSP0/CPU0:router(config)# end
Saves configuration changes.
• When you issue the end command, the system prompts
you to commit changes:
Uncommitted changes found, commit them before
exiting(yes/no/cancel)?
[cancel]:
– Entering yes saves configuration changes to the
running configuration file, exits the configuration
session, and returns the router to EXEC mode.
– Entering no exits the configuration session and
returns the router to EXEC mode without
committing the configuration changes.
– Entering cancel leaves the router in the current
configuration session without exiting or
committing the configuration changes.
1-22
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Validating and Troubleshooting Cisco IOS XR Software Configuration
Examples
The following example shows the output of the show running-config command:
RP/0/RSP0/CPU0:router# show running-config
Building configuration...
!! IOS XR Configuration 4.0.1.10I
!! Last configuration change at Thu Sep 23 04:35:38 2010 by user_A
!
hostname router
.
Step 5 show sysdb trace verification shared-plane |
include path
Example:
RP/0/RSP0/CPU0:router# show sysdb trace
verification shared-plane | include
gl/a/hostname
Displays details of recent verification sysDB transactions
and changes on the shared plane allowing you to verify
whether the configuration was verified correctly.
Specifying the path filters the data to display only the
sysDB path for the router.
Verify that changes to the SysDB were verified and
accepted.
Step 6 show sysdb trace verification location node-id
Example:
RP/0/RSP0/CPU0:router# show sysdb trace
verification location 0/3/CPU0
Displays details of recent verification sysDB transactions
and changes on local plane configurations.
Verify that changes to the SysDB were verified and
accepted.
Step 7 show cfgmgr trace
Example:
RP/0/RSP0/CPU0:router# show cfgmgr trace
Displays cfgmgr trace information.
Step 8 show configuration history commit
Example:
RP/0/RSP0/CPU0:router# show configuration
history commit
Displays a list of historical changes to the configuration.
Verify that the timeline of changes is as expected.
Step 9 show configuration commit changes {last | since
| commit-id}
Example:
RP/0/RSP0/CPU0:router# show configuration
commit changes last 15
Displays detailed committed configuration history
information.
Verify that the history information is as expected.
Step 10 show configuration failed startup
Example:
RP/0/RSP0/CPU0:router# show configuration
failed startup
Displays information on any configurations that failed
during startup.
Step 11 cfs check
Example:
RP/0/RSP0/CPU0:router# cfs check
Checks the current configuration to see if there are any
missing configurations.
Command or Action Purpose
1-23
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Validating and Troubleshooting Cisco IOS XR Software Configuration
.
.
logging suppress duplicates
telnet vrf default ipv4 server max-servers 100
domain name cisco.com
domain lookup disable
taskgroup default
!
.
.
.
interface preconfigure GigabitEthernet0/3/0/7
shutdown
!
interface preconfigure GigabitEthernet0/3/0/8
shutdown
!
interface preconfigure GigabitEthernet0/3/0/9
shutdown
!
interface preconfigure GigabitEthernet0/3/0/10
shutdown
!
.
.
.
The output is used to determine if the configuration is as expected.
In the following example, the path to SysDB where the configuration is stored in the database is
displayed.
RP/0/RSP0/CPU0:router(config)# describe hostname router
Package:
iosxr-infra
iosxr-infra V4.0.0 IOS-XR Infra Package Definition
Vendor : Cisco Systems
Desc : IOS-XR Infra Package Definition
Build : Built on Wed Sep 8 16:07:48 DST 2010
Source : By sc-g-01 in /auto/ioxbuild8/production/4.0.0/asr9k/workspace for pie
Card(s): RP, NP24-4x10GE, NP24-40x1GE, NP40-40x1GE, NP40-4x10GE, NP40-8x10GE,
NP40-2_20_COMBO, NP80-8x10GE, NP80-16x10GE, A9K-SIP-700, A9K-SIP-500
Restart information:
Default:
parallel impacted processes restart
Size Compressed/Uncompressed: 38MB/85MB (44%)
Component:
shellutil V[ci-401/7] Common shell utility applications
User needs ALL of the following taskids:
host-services (READ) or root-lr (READ WRITE)
It will take the following actions:
Create/Set the configuration item:
Path: gl/a/hostname
Value: router
1-24
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Validating and Troubleshooting Cisco IOS XR Software Configuration
Using the show configuration failed Command
Use the show configuration failed command to browse a failed configuration. The configuration can be
classified as failed during startup or during a configuration commit.
• Startup Failed Configuration, page 1-24
• Commit Configuration Failed, page 1-25
Startup Failed Configuration
A configuration can be classified as failed during startup for three reasons:
• Syntax errors
Syntax errors are generated by the parser and usually indicate that there is an incompatibility with
the CLI commands. Correct the syntax errors and reapply the configuration. A syntax error can be
an invalid CLI entry or a CLI syntax change. See the “Obtaining Documentation and Submitting a
Service Request” section on page xii in the Preface for information on obtaining
Cisco IOS XR software CLI documentation.
• Semantic errors
Semantic errors are generated by the backend components when the configuration is being restored
by the configuration manager during startup of the router. Semantic errors include logical problems
(invalid logic).
• Apply errors
Apply errors are generated when a configuration has been successfully verified and accepted as part
of running configuration but the backend component is not able to update its operational state. The
configuration shows both as the running configuration (since it was correctly verified) and as a failed
configuration because of the backend operational error. To find the component apply owner, use the
describe on the CLI that failed to be applied.
Note You may browse startup failed configurations for up to the previous four router reloads.
Use the show configuration failed startup command and the load configuration failed startup
command to browse and reapply any failed configuration. The load configuration failed startup
command can be used in configuration mode to load the failed startup configuration into the target
configuration session, then the configuration can be modified and committed. See
Cisco ASR 9000 Aggregation Services Router Router Getting Started Guide for information on
committing a configuration.
RP/0/RSP0/CPU0:router# show configuration failed startup
!! CONFIGURATION FAILED DUE TO SYNTAX/AUTHORIZATION ERRORS
telnet vrf default ipv4
server max-servers 5 interface POS0/7/0/3 router static
address-family ipv4 unicast
0.0.0.0/0 172.18.189.1
!! CONFIGURATION FAILED DUE TO SEMANTIC ERRORS
router bgp 217
!!% Process did not respond to sysmgr !
RP/0/RSP0/CPU0:router#
RP/0/RSP0/CPU0:router# config
1-25
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Validating and Troubleshooting Cisco IOS XR Software Configuration
RP/0/RSP0/CPU0:router(config)# load config failed startup noerror
Loading. 263 bytes parsed in 1 sec (259)bytes/sec
RP/0/RSP0/CPU0:mike3(config-bgp)#show configuration
Building configuration...
telnet vrf default ipv4 server max-servers 5 router static
address-family ipv4 unicast
0.0.0.0/0 172.18.189.1
!
!
router bgp 217
!
end
The failed configuration is loaded into the target configuration, minus the errors that caused the startup
configuration to fail.
RP/0/RSP0/CPU0:router(config-bgp)# commit
Use the show configuration failed command to display failed items in the last configuration commit,
including reasons for the error.
In any mode, the configuration failures from the most recent commit operation are displayed.
The show configuration failed command can be used in EXEC mode and configuration mode. The
command is used in EXEC mode when the configuration does not load during startup. The command is
used in configuration mode to display information when a commit fails.
The following example shows the show configuration failed command.
RP/0/RSP0/CPU0:router(config)# interface pos 0/6/0/4
RP/0/RSP0/CPU0:router(config-if)# no vrf
RP/0/RSP0/CPU0:router(config-if)# commit
% Failed to commit one or more configuration items during an atomic operation, no changes
have been made. Please use 'show configuration failed' to view the errors
RP/0/RSP0/CPU0:router(config-if)# exit
RP/0/RSP0/CPU0:router(config)# show configuration failed
Wed May 2 13:14:08.426 EST EDT
!! CONFIGURATION FAILED DUE TO SEMANTIC ERRORS interface POS0/6/0/4 no vrf !!
% The interface's numbered and unnumbered IPv4/IPv6 addresses must be removed prior to
changing or deleting the VRF !
Note The show configuration failed command in configuration mode only exists as long as the configuration
session is active. Once you exit configuration mode, the command cannot be used to display the failed
configuration.
Commit Configuration Failed
The following example shows an invalid task ID configuration that fails to commit. The show
configuration failed command provides information on why the configuration failed.
RP/0/RSP0/CPU0:router(config)# taskgroup isis
RP/0/RSP0/CPU0:router(config-tg)# commit
% Failed to commit one or more configuration items during an atomic operation, s
RP/0/RSP0/CPU0:router(config-tg)# show configuration failed
1-26
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Verifying the System
!! CONFIGURATION FAILED DUE TO SEMANTIC ERRORS
taskgroup isis
!!% Usergroup/Taskgroup names cannot be taskid names
!
If a configuration commit fails, do not exit configuration mode (return to EXEC mode) as you will not
be able to view the failed configuration.
RP/0/RSP0/CPU0:router# configure
RP/0/RSP0/CPU0:router(config)# taskgroup bgp
RP/0/RSP0/CPU0:router(config-tg)# end
Uncommitted changes found, commit them before exiting(yes/no/cancel)? [cancel]:y
% Failed to commit one or more configuration items during an atomic operation, s
RP/0/RSP0/CPU0:router(config)# exit
Uncommitted changes found, commit them before exiting(yes/no/cancel)? [cancel]:n
RP/0/RSP0/CPU0:router# show configuration failed
RP/0/RSP0/CPU0:router#
Verifying the System
To verify the general status and state of a router using Cisco IOS XR software, perform the following
procedure.
SUMMARY STEPS
1. admin
2. show platform [node-id]
3. show version
4. show running-config
5. show logging
6. show environment
7. show context
8. exit
9. show context
10. show memory summary detail location all
11. show memory heap summary {job-id | all}
12. top processes
13. show running-config
14. show system verify start
show system verify report
15. show {ipv4 | ipv6} interface brief
1-27
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Verifying the System
DETAILED STEPS
Command or Action Purpose
Step 1 admin
Example:
RP/0/RSP0/CPU0:router# admin
Enters administration mode.
Step 2 show platform [node-id]
Example:
RP/0/RSP0/CPU0:router(admin)# show platform
Displays information about the status of cards and modules
installed in the router.
• Some cards support a CPU module and service
processor (SP) module. Other cards support only a
single module.
• A card module is also called a node. When all nodes are
working properly, the status of each node displayed in
the State column is IOS-XR RUN.
• If you run the command without a node-id (show
platform as shown in the example), the output will
include all nodes in the system.
• Type the show platform node-id command to display
information for a specific node. Replace node-id with a
node name from the show platform command Node
column.
Step 3 show version
Example:
RP/0/RSP0/CPU0:router(admin)# show version
Displays information about the router, including image
names, uptime, and other system information.
Verify that the expected software version and images are
installed.
Step 4 show running-config
Example:
RP/0/RSP0/CPU0:router(admin)# show
running-config
Displays all of the nondefault commands currently running,
including hardware module power status, secure domain
router (SDR) configuration, and fabric configuration. The
output also displays the users defined in administration
mode with root-system access.
Verify that the serial numbers for the nodes in the current
running configuration are what you expected. The expected
rack numbers and serial numbers should be listed in the
current system documentation. See the “Prerequisite
Documentation for Troubleshooting” section on page 1-1.
Also verify that the hardware module power status is as
expected and the SDR and fabric configurations are as
expected.
Step 5 show logging
Example:
RP/0/RSP0/CPU0:router(admin)# show logging
Displays all syslog messages stored in the buffer. The
command output displays the device operation history from
a system perspective.
Analyze the logged events and their order of happening.
Check for anything out of the ordinary such as errors,
tracebacks, or crashes. Also check for any Severity 1 or
Severity 2 errors.
1-28
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Verifying the System
Step 6 show environment
Example:
RP/0/RSP0/CPU0:router(admin)# show environment
Displays environmental monitor parameters for the system.
Verify that the parameters are as expected.
Step 7 show context
Example:
RP/0/RSP0/CPU0:router(admin)# show context
Displays core dump context information on fabric cards,
alarm modules, fan controllers, and service processors
(system-owned cards). See the “show context Command”
section on page 1-50 for more information on the show
context command output.
Step 8 exit
Example:
RP/0/RSP0/CPU0:router(admin)# exit
Exits administration mode.
Step 9 show context
Example:
RP/0/RSP0/CPU0:router# show context
Displays core dump context information on CPUs
responsible for routing and Cisco Express Forwarding
(CEF). See the “show context Command” section on
page 1-50 for more information on the show context
command output.
Step 10 show memory summary detail location all
Example:
RP/0/RSP0/CPU0:router# show memory summary
detail location all
Displays information about the memory available on the
router after the system image decompresses and loads.
Verify that the expected memory is available or installed.
Ensure that all memory regions have adequate free space
available.
Step 11 show memory heap summary {job-id | all}
Example:
RP/0/RSP0/CPU0:router# show memory heap
summary all
Displays a summary of the information about the heap
space. The output displays each process and the amount of
memory allocated for each process.
Note The job-id is the output of the show processes
command.
Verify if there are any processes using a large amount of
memory.
Step 12 top processes
Example:
RP/0/RSP0/CPU0:router# top processes
Press q to exit the command.
Provides a live update of process resource consumption.
Press ‘M’ to sort by memory usage.
Verify that the resource consumption is as expected.
Step 13 show running-config
Example:
RP/0/RSP0/CPU0:router# show running-config
Displays the contents of the currently running
configuration.
Verify that the contents of the current running configuration
are what you expected.
Command or Action Purpose
1-29
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Verifying the System
Examples
The output from the show platform command indicates that all expected nodes are in the run state. If
all nodes in the system are active, the cards should be in the IOS XR RUN and the SPAs should be in the
OK state. The example output shows that all expected nodes are in the run state.
RP/0/RSP0/CPU0:router(admin)# show platform
Node Type State Config State
-----------------------------------------------------------------------------
0/RSP0/CPU0 A9K-RSP-4G(Active) IOS XR RUN PWR,NSHUT,MON
0/FT0/SP FAN TRAY READY
0/FT1/SP FAN TRAY READY
0/1/CPU0 A9K-40GE-B IOS XR RUN PWR,NSHUT,MON
0/2/CPU0 A9K-SIP-700 IOS XR RUN PWR,NSHUT,MON
0/2/0 SPA-2XOC48POS/RPR OK PWR,NSHUT,MON
0/3/CPU0 A9K-2T20GE-B IN-RESET PWR,NSHUT,MON
0/4/CPU0 A9K-8T/4-B IOS XR RUN PWR,NSHUT,MON
0/6/CPU0 A9K-4T-B IOS XR RUN PWR,NSHUT,MON
0/PM0/SP A9K-3KW-AC READY PWR,NSHUT,MON
0/PM1/SP A9K-3KW-AC READY PWR,NSHUT,MON
0/PM2/SP A9K-3KW-AC READY PWR,NSHUT,MON
The output from the show version command indicates the version of software being run on the nodes
and from which location (disk or network). Check that the expected software version and images are
installed. The example output shows that the Cisco IOS XR software version is 4.0.0 and that the
installed pie versions are also 4.0.0.
RP/0/RSP0/CPU0:router(admin)# show version
Cisco IOS XR Software, Version 4.0.0[Default]
Copyright (c) 2010 by Cisco Systems, Inc.
ROM: System Bootstrap, Version 1.04(20100216:021454) [ASR9K ROMMON],
Step 14 show system verify start
show system verify report
Example:
RP/0/RSP0/CPU0:router# show system verify
start
RP/0/RSP0/CPU0:router# show system verify
report
A two-step command that produces system reports.
• show system verify start—Starts the system verify
process (creates the initial baseline file)
• show system verify report—Generates a report for the
system verification process (report of the current
status)
The output of the show system verify report command
provides a comparison of the system at the time of the show
system verify start snapshot and the show system verify
report snapshot. The output provides a sanity check of the
system provided the show system verify start system
snapshot was taken when the system was healthy or before
an event.
Verify that the system parameters are as expected.
Step 15 show (ipv4 | ipv6} interface brief
Example:
RP/0/RSP0/CPU0:router# show ipv4 interface
brief
Displays the usability status of interfaces.
Verify that all expected interfaces are listed, that they have
the correct assigned address, and that they are in the
expected states.
Command or Action Purpose
1-30
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Verifying the System
router uptime is 1 day, 15 hours, 53 minutes
System image file is "bootflash:disk0/asr9k-os-mbi-4.0.0/mbiasr9k-rp.vm"
cisco ASR9K Series (MPC8641D) processor with 4194304K bytes of memory.
MPC8641D processor at 1333MHz, Revision 2.2
2 Management Ethernet
12 DWDM controller(s)
12 TenGigE
40 GigabitEthernet
2 SONET/SDH
2 Packet over SONET/SDH
219k bytes of non-volatile configuration memory.
975M bytes of compact flash card.
33994M bytes of hard disk.
1605616k bytes of disk0: (Sector size 512 bytes).
1605616k bytes of disk1: (Sector size 512 bytes).
Configuration register on node 0/RSP0/CPU0 is 0x102
Boot device on node 0/RSP0/CPU0 is disk0:
Package active on node 0/RSP0/CPU0:
asr9k-optics-supp, V 4.0.0[DT_IMAGE], Cisco Systems, at disk0:asr9k-optics-supp-4.0.0
Built on Wed Sep 8 16:17:30 DST 2010
By sjc5-gf-021 in /auto/ioxbuild8/production/4.0.0.DT_IMAGE/asr9k/workspace for pie
asr9k-fwding, V 4.0.0[DT_IMAGE], Cisco Systems, at disk0:asr9k-fwding-4.0.0
Built on Wed Sep 8 16:12:40 DST 2010
By sjc5-gf-021 in /auto/ioxbuild8/production/4.0.0.DT_IMAGE/asr9k/workspace for pie
asr9k-cpp, V 4.0.0[DT_IMAGE], Cisco Systems, at disk0:asr9k-cpp-4.0.0
Built on Wed Sep 8 16:13:28 DST 2010
By sjc5-gf-021 in /auto/ioxbuild8/production/4.0.0.DT_IMAGE/asr9k/workspace for pie
asr9K-doc-supp, V 4.0.0[DT_IMAGE], Cisco Systems, at disk0:asr9K-doc-supp-4.0.0
Built on Wed Sep 8 16:16:57 DST 2010
By sjc5-gf-021 in /auto/ioxbuild8/production/4.0.0.DT_IMAGE/asr9k/workspace for pie
asr9k-scfclient, V 4.0.0[DT_IMAGE], Cisco Systems, at disk0:asr9k-scfclient-4.0.0
Built on Wed Sep 8 16:13:26 DST 2010
By sjc5-gf-021 in /auto/ioxbuild8/production/4.0.0.DT_IMAGE/asr9k/workspace for pie
iosxr-security, V 4.0.0[DT_IMAGE], Cisco Systems, at disk0:iosxr-security-4.0.0
Built on Wed Sep 8 16:16:48 DST 2010
By sjc5-gf-021 in /auto/ioxbuild8/production/4.0.0.DT_IMAGE/asr9k/workspace for pie
--More--
The output from the show running-config command displays the current running configuration, that is,
all of the nondefault commands currently active. Verify that the contents of the current running
configuration are as expected.
Tip The output of this command in exec mode is different from the output in admin mode. You should run
the command from each of these modes to locate all of the configuration information.
RP/0/RSP0/CPU0:router# show running-config
Building configuration...
!! Last configuration change at 18:56:31 UTC Tue Feb 28 2006 by user_A
!
hostname router
clock timezone PST 8.
1-31
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Verifying the System
logging console informational
telnet vrf default ipv4 server max-servers 100
domain name cisco.com
domain lookup disable
taskgroup default
!
taskgroup igpadmin
task write rib
task write isis
task write ospf
!
taskgroup routeadmin
task write bgp
inherit taskgroup igpadmin
!
usergroup default
taskgroup default
!
usergroup igp_admin
taskgroup igpadmin
!
usergroup route_admin
taskgroup routeadmin
!
tacacs-server host 172.29.52.69 port 49
key 7 060506324F41
aaa group server tacacs+ DOC_LAB_TACACS+
server 172.29.52.69
server 172.29.52.68
!
aaa authorization exec LAB_AAA group DOC_LAB_TACACS+ local
aaa authorization exec CONSOLE_AAA group DOC_LAB_TACACS+ none
aaa authorization commands LAB_AAA group DOC_LAB_TACACS+ none
aaa authorization commands CONSOLE_AAA group DOC_LAB_TACACS+ none
aaa authentication login default group DOC_LAB_TACACS+ local
aaa authentication login CONSOLE_AAA group DOC_LAB_TACACS+ local
aaa default-taskgroup default
explicit-path name Primary_GE_Path_to_P19
index 1 next-address strict ipv4 unicast 10.114.4.44
index 2 next-address strict ipv4 unicast 10.114.4.11
index 3 next-address strict ipv4 unicast 10.119.4.11
index 4 next-address strict ipv4 unicast 10.119.4.19
index 5 next-address strict ipv4 unicast 10.19.19.19
!
line console
accounting exec CONSOLE_AAA
accounting commands CONSOLE_AAA
authorization exec CONSOLE_AAA
authorization commands CONSOLE_AAA
login authentication CONSOLE_AAA
exec-timeout 600 0
session-timeout 600
!
line default
exec-timeout 600 0
session-timeout 600
!
.
.
.
interface preconfigure GigabitEthernet0/3/0/18
shutdown
1-32
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Verifying the System
!
interface preconfigure GigabitEthernet0/3/0/19
shutdown
!
interface preconfigure TenGigE0/3/0/0
shutdown
!
interface preconfigure TenGigE0/3/0/1
shutdown
!
router static
address-family ipv4 unicast
0.0.0.0/0 172.29.52.1 200
!
!
router isis 100
is-type level-2-only
net 49.0001.0000.0000.0044.00
nsf cisco
address-family ipv4 unicast
metric-style wide
mpls traffic-eng level-2-only
mpls traffic-eng router-id Loopback0
!
interface Loopback0
passive
address-family ipv4 unicast
!
!
interface TenGigE0/4/0/0
bfd minimum-interval 50
bfd multiplier 3
bfd fast-detect ipv4
address-family ipv4 unicast
!
!
!
router ospf 100
nsr
router-id 10.144.144.144
bfd minimum-interval 50
bfd multiplier 3
mpls ldp sync
nsf cisco
area 0
mpls ldp sync-igp-shortcuts
mpls traffic-eng
interface Loopback0
passive enable
!
.
.
.
http server
ssh server vrf default
igmp snooping profile default
system-ip-address 10.144.144.144
minimum-version 2
internal-querier
tcn query solicit
ttl-check disable
router-alert-check disable
!
igmp snooping profile mrouter
1-33
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Verifying the System
router-guard
mrouter
!
router pim
address-family ipv4
mofrr mofrr-acl
rp-address 10.11.11.11
rp-address 10.144.144.144 bidir-acl bidir
spt-threshold infinity
!
!
end
RP/0/RSP0/CPU0:router# admin
Wed Oct 27 14:52:07.000 DST
RP/0/RSP0/CPU0:router(admin)# show running-config
Wed Oct 27 14:52:12.766 DST
Building configuration...
!! IOS XR Admin Configuration 4.0.0
username doclabuser-c
group root-system
group cisco-support
secret 5 $1$RJVQ$6w7saUHgk16v5HXRWEp6m/
!
username doclabuser-r
group root-system
secret 5 $1$.uOF$O9N0aRRk.V1qe250IavLw1
!
alias cr copy run disk0a:/usr/base_config_admin
alias sa show alias
alias sc show config commit list
alias sd show diag
alias si show install req
alias sl show led
alias sp show platform
alias sr show run
alias sv show version
alias nda no debug all
end
The output from the show logging command displays the contents of the logging buffer. The output
displays details on syslog historical events. Analyze the logged events and the order in which they
happened. Check for anything out of the ordinary such as errors, tracebacks, or crashes. Also check for
any Severity 1 or Severity 2 errors.
RP/0/RSP0/CPU0:router(admin)# show logging
Syslog logging: enabled (0 messages dropped, 0 flushes, 0 overruns)
Console logging: level informational, 693 messages logged
Monitor logging: level debugging, 0 messages logged
Trap logging: level informational, 0 messages logged
Buffer logging: level debugging, 4467 messages logged
Log Buffer (307200 bytes):
LC/0/3/CPU0:Sep 13 23:58:03.272 : pfm_node_lc[230]: %PLATFORM-NP-0-NP_INIT_FAILURE :
Set|prm_server[110670]|Network Processor Unit(0x1007000)|Persistent Initialization
Failure.
1-34
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Verifying the System
LC/0/3/CPU0:Sep 13 23:58:03.276 : pfm_node_lc[230]: %PLATFORM-PFM-0-CARD_RESET_REQ :
pfm_dev_sm_perform_recovery_action, Card reset requested by: Process ID: 110670
(prm_server), Fault Sev: 0, Target node: 0/3/CPU0, CompId: 0x1f, Device Handle: 0x1007000,
CondID: 1027, Fault Reason: Persistent Initialization Failure.
LC/0/3/CPU0:Sep 13 23:58:03.276 : syslog_dev[85]: pfm_node_lc[230]: Request Graceful
Reboot via Sysmgr: Reason: pfm_dev_sm_perform_recovery_action, Card reset requested by:
Process ID: 110670 (prm_server), Fault Sev: 0, Target node: 0/3/CPU0, CompId: 0x1f, Device
Handle: 0x1007000, CondID: 1027, Fault Reason: Persistent Initialization Failure.
LC/0/3/CPU0:Sep 13 23:58:03.277 : sysmgr[87]: %OS-SYSMGR-2-REBOOT : reboot required,
process (pfm_node_lc) reason (pfm_dev_sm_perform_recovery_action, Card reset requested by:
Process ID: 110670 (prm_server), Fault Sev: 0, Target node: 0/3/CPU0, CompId: 0x1f, Device
Handle: 0x1007000, CondID: 1027, Fault Reason: Persistent Initialization Failure. )
LC/0/3/CPU0:Sep 13 23:58:03.467 : sysmgr[87]: %OS-SYSMGR-3-ERROR :
sysmgr_shutdown_cleanup_handler: shutdown script execution timed-out! Node will reset
LC/0/3/CPU0:Sep 13 23:58:03.467 : sysmgr[87]: %OS-SYSMGR-7-DEBUG :
sysmgr_shutdown_cleanup_handler: shutdown script execution timed-out! Node will reset
LC/0/3/CPU0:Sep 13 23:58:03.468 : sysmgr[87]: %OS-SYSMGR-3-ERROR :
sysmgr_shutdown_cleanup_handler: shutdown triggered by (pfm_node_lc) did not complete in
45 seconds, shutting down
RP/0/RSP0/CPU0:Sep 13 23:58:16.859 : shelfmgr[299]:
%PLATFORM-SHELFMGR-0-MAX_RESET_BRINGDOWN : Can not boot node 0/3/CPU0 A9K-2T20GE-B due to
multiple resets, putting it IN_RESET state. The probable cause is an unexpected event on
the node or a failure in communication with the node. Please refer to the Cisco ASR 9000
System Error Message Reference Guide for further information if needed.
--More--
The output from the show environment command displays environmental monitor parameters for the
system. Verify that the environment parameters are as expected. Environment parameter anomalies are
logged in the syslog, so if an environment parameter displayed in the show environment command
output is not as expected, check the syslog using the show logging command. The syslog provides details
on any logged problems.
RP/0/RSP0/CPU0:router(admin)# show environment
Wed Sep 15 09:48:27.178 DST
Temperature Information
---------------------------------------------
R/S/I Modules Sensor (deg C)
0/1/*
host Inlet0 36.4
host Hotspot0 46.7
0/2/*
spa0 InletTemp 35.5
spa0 Hotspot 35.5
host Inlet0 34.5
host Hotspot0 61.0
0/3/*
host Inlet0 31.1
host Hotspot0 32.5
0/RSP0/*
host Inlet0 31.3
host Hotspot0 42.0
0/4/*
1-35
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Verifying the System
host Inlet0 34.9
host Hotspot0 45.2
0/6/*
host Inlet0 38.0
host Hotspot0 48.9
0/FT0/*
host Inlet0 31.9
host Hotspot0 33.5
0/FT1/*
host Inlet0 32.3
host Hotspot0 35.3
Voltage Information
---------------------------------------------
R/S/I Modules Sensor (mV) Margin
0/1/*
host IBV 10592 n/a
host 5.0V 4925 n/a
host VP3P3_CAN 3289 n/a
host 3.3V 3302 n/a
host 2.5V 2516 n/a
host 1.8VB 1812 n/a
host 1.2VB 1193 n/a
host 1.8VA 1806 n/a
host 0.9VB 886 n/a
host 1.2V_LDO_BRG0 1193 n/a
host 1.2V_LDO_BRG1 1195 n/a
host 1.8VC 1811 n/a
host 1.5VB 1505 n/a
host 1.5VA 1503 n/a
host 1.1V(1.05V_CPU) 1053 n/a
host 0.75VA 752 n/a
host 0.75VB_0.75VC 754 n/a
host 1.1VB 1103 n/a
host 1.2V_TCAM0 1003 n/a
host 1.2V_TCAM1 1000 n/a
host 1.0V_Bridge_LDO 999 n/a
host 1.0VB 1042 n/a
host 0.75VD_and_0.75VE 752 n/a
host 1.2V_TCAM2 1006 n/a
host 1.2V_TCAM3 1002 n/a
host 1.5VC 1504 n/a
host 1.8VD 1804 n/a
host 1.1VC 1100 n/a
host ZARLINK_3.3V 3272 n/a
host ZARLINK_1.8V 1807 n/a
host 1.2V_DB 1195 n/a
host 3.3V_DB 3318 n/a
host 2.5V_DB 2535 n/a
host 1.5V_DB 1509 n/a
.
.
.
LED Information
1-36
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Verifying the System
---------------------------------------------
R/S/I Modules LED Status
0/RSP0/*
host Critical-Alarm Off
host Major-Alarm Off
host Minor-Alarm Off
host ACO Off
host Fail Off
Fan Information
---------------------------------------------
Fan speed (rpm):
FAN0 FAN1 FAN2 FAN3 FAN4 FAN5 FAN6 FAN7 FAN8 FAN9
FAN10 FAN11
0/FT0/*
3510 3480 3510 3570 3540 3510 3510 3480 3540 3540
3480 3480
0/FT1/*
3510 3510 3510 3540 3480 3510 3390 3510 3510 3540
3450 3480
Power Supply Information
---------------------------------------------
R/S/I Modules Capacity Status
(W)
0/PM0/*
host PM 3000 Ok
0/PM1/*
host PM 3000 Ok
0/PM2/*
host PM 3000 Ok
R/S/I Power Draw Voltage Current
(W) (V) (A)
0/PM0/* 622.9 53.7 11.6
0/PM1/* 774.7 53.8 14.4
0/PM2/* 0.0 54.1 0.0
--------------
Total: 1397.6
Power Shelves Type: AC
Total Power Capacity: 9000W
Usable Power Capacity: 9000W
Supply Failure Protected Capacity: 6000W
Feed Failure Protected Capacity: 3000W
Worst Case Power Used: 3170W
Slot Max Watts
---- ---------
0/1/CPU0 350
0/2/CPU0 450
0/RSP0/CPU0 235
0/RSP1/CPU0 235 (default)
0/4/CPU0 350
0/6/CPU0 350
0/FT0/SP 600
1-37
Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router
OL-23591-02
Chapter 1 General Troubleshooting Procedures
Verifying the System
0/FT1/SP 600
Worst Case Power Available: 5830W
Supply Protected Capacity Available: 2830W
Feed Protected Capacity Available: Not Protected
The output from the show context command displays core dump context information. See the “show
context Command” section on page 1-50 for more information on the show context command output.
RP/0/RSP0/CPU0:router# show context
node: node0_1_CPU0
------------------------------------------------------------------
Crashed pid = 61524 (pkg/bin/tcam_mgr)
Crashed tid = 1
Crash time: Wed Apr 05, 2006: 18:27:26
Core for process at harddisk:/dumper/first.tcam_mgr.abort.node0_1_CPU0.ppc.Z
Stack Trace
#0 0xfc1d3fa0
#1 0xfc1c6340
#2 0xfc1c5364
#3 0xfc1c542c
#4 0x48210930
#5 0x482110b8
#6 0x48212ba4
#7 0x48203dd8
#8 0x4820c61c
#9 0xfc1557ec
#10 0xfc15573c
#11 0xfc152fb8
#12 0x4820d140
Registers info
r0 r1 r2 r3
R0 00000000 481ff7b0 4824a55c 00000000
r4 r5 r6 r7
R4 0000f054 00000001 00000006 00000000
r8 r9 r10 r11
R8 00000000 fc220000 481fffc0 00000000
r12 r13 r14 r15
R12 4823be90 4824a4a0 48230000 00000000
r16 r17 r18 r19
R16 00000048 00000001 00000019 48256520
r20 r21 r22 r23
R20 00000000 00000000 00000003 00000045
r24 r25 r26 r27
R24 00000003 00000000 00000003 4825dc34
r28 r29 r30 r31
R28 00000006 0000f054 48254064 481ff810
cnt lr msr pc
R32 00000000 fc1c6340 0000d932 fc1d3fa0
cnd xer
R36 28004024 00000008
DLL Info
DLL path Text addr. Text size Data addr. Data size Version
/hfr-os-3.3.90/lib/libinfra.dll 0xfc142000 0x00034200 0xfc1343b8 0x00000bbc
0
/lib/libc.dll 0xfc1a8000 0x00079dd8 0xfc222000 0x00002000 0
Crash Package Infomation
Package: hfr-mgbl, Source: By edde-bld1 in /vws/aga/production/3.3.90.1I/hfr/wor
kspace for c2.95.3-p8
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook
As rbook

More Related Content

What's hot

4.4.1.2 packet tracer configure ip ac ls to mitigate attacks-instructor
4.4.1.2 packet tracer   configure ip ac ls to mitigate attacks-instructor4.4.1.2 packet tracer   configure ip ac ls to mitigate attacks-instructor
4.4.1.2 packet tracer configure ip ac ls to mitigate attacks-instructorSalem Trabelsi
 
4.4.1.3 packet tracer configuring a zone-based policy firewall (zpf) instru...
4.4.1.3 packet tracer   configuring a zone-based policy firewall (zpf) instru...4.4.1.3 packet tracer   configuring a zone-based policy firewall (zpf) instru...
4.4.1.3 packet tracer configuring a zone-based policy firewall (zpf) instru...Salem Trabelsi
 
Configure Cisco Routers for Syslog, NTP, and SSH Operations
Configure Cisco Routers for Syslog, NTP, and SSH Operations Configure Cisco Routers for Syslog, NTP, and SSH Operations
Configure Cisco Routers for Syslog, NTP, and SSH Operations Kelson Silva
 
5.5.1.2 packet tracer configure ios intrusion prevention system (ips) using...
5.5.1.2 packet tracer   configure ios intrusion prevention system (ips) using...5.5.1.2 packet tracer   configure ios intrusion prevention system (ips) using...
5.5.1.2 packet tracer configure ios intrusion prevention system (ips) using...Salem Trabelsi
 
6.5.1.2 packet tracer layer 2 security instructor
6.5.1.2 packet tracer   layer 2 security instructor6.5.1.2 packet tracer   layer 2 security instructor
6.5.1.2 packet tracer layer 2 security instructorSalem Trabelsi
 
400-351 Exam-CCIE Wireless
400-351 Exam-CCIE Wireless  400-351 Exam-CCIE Wireless
400-351 Exam-CCIE Wireless Isabella789
 
2.5.1.2 packet tracer configure cisco routers for syslog, ntp, and ssh oper...
2.5.1.2 packet tracer   configure cisco routers for syslog, ntp, and ssh oper...2.5.1.2 packet tracer   configure cisco routers for syslog, ntp, and ssh oper...
2.5.1.2 packet tracer configure cisco routers for syslog, ntp, and ssh oper...Salem Trabelsi
 
Network topology by essay corp uk
Network topology by essay corp ukNetwork topology by essay corp uk
Network topology by essay corp ukJohnsmith5188
 
Ccna 2 rse practice skills assessment
Ccna 2 rse practice skills assessmentCcna 2 rse practice skills assessment
Ccna 2 rse practice skills assessmentfriv4schoolgames
 
Ccna 1 chapter 11 v4.0 answers 2011
Ccna 1 chapter 11 v4.0 answers 2011Ccna 1 chapter 11 v4.0 answers 2011
Ccna 1 chapter 11 v4.0 answers 2011Dân Chơi
 
Troubleshooting Firewalls (2012 San Diego)
Troubleshooting Firewalls (2012 San Diego)Troubleshooting Firewalls (2012 San Diego)
Troubleshooting Firewalls (2012 San Diego)Cisco Security
 
Deploy Failover/High Availability in ASA Firewall
Deploy Failover/High Availability in ASA FirewallDeploy Failover/High Availability in ASA Firewall
Deploy Failover/High Availability in ASA FirewallKHNOG
 
Cisco CCNA- NAT Configuration
Cisco CCNA- NAT ConfigurationCisco CCNA- NAT Configuration
Cisco CCNA- NAT ConfigurationHamed Moghaddam
 
CCNA Exploration 2 - Chapter 9
CCNA Exploration 2 - Chapter 9CCNA Exploration 2 - Chapter 9
CCNA Exploration 2 - Chapter 9Irsandi Hasan
 

What's hot (20)

4.4.1.2 packet tracer configure ip ac ls to mitigate attacks-instructor
4.4.1.2 packet tracer   configure ip ac ls to mitigate attacks-instructor4.4.1.2 packet tracer   configure ip ac ls to mitigate attacks-instructor
4.4.1.2 packet tracer configure ip ac ls to mitigate attacks-instructor
 
4.4.1.3 packet tracer configuring a zone-based policy firewall (zpf) instru...
4.4.1.3 packet tracer   configuring a zone-based policy firewall (zpf) instru...4.4.1.3 packet tracer   configuring a zone-based policy firewall (zpf) instru...
4.4.1.3 packet tracer configuring a zone-based policy firewall (zpf) instru...
 
Configure Cisco Routers for Syslog, NTP, and SSH Operations
Configure Cisco Routers for Syslog, NTP, and SSH Operations Configure Cisco Routers for Syslog, NTP, and SSH Operations
Configure Cisco Routers for Syslog, NTP, and SSH Operations
 
5.5.1.2 packet tracer configure ios intrusion prevention system (ips) using...
5.5.1.2 packet tracer   configure ios intrusion prevention system (ips) using...5.5.1.2 packet tracer   configure ios intrusion prevention system (ips) using...
5.5.1.2 packet tracer configure ios intrusion prevention system (ips) using...
 
6.5.1.2 packet tracer layer 2 security instructor
6.5.1.2 packet tracer   layer 2 security instructor6.5.1.2 packet tracer   layer 2 security instructor
6.5.1.2 packet tracer layer 2 security instructor
 
400-351 Exam-CCIE Wireless
400-351 Exam-CCIE Wireless  400-351 Exam-CCIE Wireless
400-351 Exam-CCIE Wireless
 
2.5.1.2 packet tracer configure cisco routers for syslog, ntp, and ssh oper...
2.5.1.2 packet tracer   configure cisco routers for syslog, ntp, and ssh oper...2.5.1.2 packet tracer   configure cisco routers for syslog, ntp, and ssh oper...
2.5.1.2 packet tracer configure cisco routers for syslog, ntp, and ssh oper...
 
Vpn
VpnVpn
Vpn
 
BACIK CISCO SKILLS
BACIK CISCO SKILLSBACIK CISCO SKILLS
BACIK CISCO SKILLS
 
ArubaOS 6.3.x Quick Start Guide
ArubaOS 6.3.x Quick Start GuideArubaOS 6.3.x Quick Start Guide
ArubaOS 6.3.x Quick Start Guide
 
Network topology by essay corp uk
Network topology by essay corp ukNetwork topology by essay corp uk
Network topology by essay corp uk
 
Ccna2 project
Ccna2 projectCcna2 project
Ccna2 project
 
Ata basicconfig
Ata basicconfigAta basicconfig
Ata basicconfig
 
Ccna 2 rse practice skills assessment
Ccna 2 rse practice skills assessmentCcna 2 rse practice skills assessment
Ccna 2 rse practice skills assessment
 
Basic BGP Configuration
Basic BGP ConfigurationBasic BGP Configuration
Basic BGP Configuration
 
Ccna 1 chapter 11 v4.0 answers 2011
Ccna 1 chapter 11 v4.0 answers 2011Ccna 1 chapter 11 v4.0 answers 2011
Ccna 1 chapter 11 v4.0 answers 2011
 
Troubleshooting Firewalls (2012 San Diego)
Troubleshooting Firewalls (2012 San Diego)Troubleshooting Firewalls (2012 San Diego)
Troubleshooting Firewalls (2012 San Diego)
 
Deploy Failover/High Availability in ASA Firewall
Deploy Failover/High Availability in ASA FirewallDeploy Failover/High Availability in ASA Firewall
Deploy Failover/High Availability in ASA Firewall
 
Cisco CCNA- NAT Configuration
Cisco CCNA- NAT ConfigurationCisco CCNA- NAT Configuration
Cisco CCNA- NAT Configuration
 
CCNA Exploration 2 - Chapter 9
CCNA Exploration 2 - Chapter 9CCNA Exploration 2 - Chapter 9
CCNA Exploration 2 - Chapter 9
 

Viewers also liked

FIO Schematic Final Draft
FIO Schematic Final DraftFIO Schematic Final Draft
FIO Schematic Final DraftAnthony Pipia
 
Digital CV NO WORK EXP PG
Digital CV NO WORK EXP PGDigital CV NO WORK EXP PG
Digital CV NO WORK EXP PGJunior Stewart
 
[Nuria solsona] la_quimica_de_la_cocina(book_zz.org)
[Nuria solsona] la_quimica_de_la_cocina(book_zz.org)[Nuria solsona] la_quimica_de_la_cocina(book_zz.org)
[Nuria solsona] la_quimica_de_la_cocina(book_zz.org)ligiaas
 
Síntesis creativa la naturaleza del aprendizaje
Síntesis creativa la naturaleza del aprendizajeSíntesis creativa la naturaleza del aprendizaje
Síntesis creativa la naturaleza del aprendizajeSra de Paisano
 

Viewers also liked (9)

FIO Schematic Final Draft
FIO Schematic Final DraftFIO Schematic Final Draft
FIO Schematic Final Draft
 
Network security
Network security Network security
Network security
 
Práctica
PrácticaPráctica
Práctica
 
John Pinkelman Resume
John Pinkelman ResumeJohn Pinkelman Resume
John Pinkelman Resume
 
Digital CV NO WORK EXP PG
Digital CV NO WORK EXP PGDigital CV NO WORK EXP PG
Digital CV NO WORK EXP PG
 
Портфоліо
ПортфоліоПортфоліо
Портфоліо
 
Linha do tempo
Linha do tempoLinha do tempo
Linha do tempo
 
[Nuria solsona] la_quimica_de_la_cocina(book_zz.org)
[Nuria solsona] la_quimica_de_la_cocina(book_zz.org)[Nuria solsona] la_quimica_de_la_cocina(book_zz.org)
[Nuria solsona] la_quimica_de_la_cocina(book_zz.org)
 
Síntesis creativa la naturaleza del aprendizaje
Síntesis creativa la naturaleza del aprendizajeSíntesis creativa la naturaleza del aprendizaje
Síntesis creativa la naturaleza del aprendizaje
 

Similar to As rbook

Cisco 2960 Switch Configuration
Cisco 2960 Switch ConfigurationCisco 2960 Switch Configuration
Cisco 2960 Switch Configurationkabisurya
 
Manual cisco 2950
Manual cisco 2950Manual cisco 2950
Manual cisco 2950liviuisr
 
Cisco 6500 config
Cisco 6500 configCisco 6500 config
Cisco 6500 configglmalpica
 
Cisco San switch troublehooting Guide
Cisco San switch troublehooting GuideCisco San switch troublehooting Guide
Cisco San switch troublehooting GuideDayal Ghosh
 
Cisco ios xr mpls configuration guide for the cisco crs router,
Cisco ios xr mpls configuration guide for the cisco crs router,Cisco ios xr mpls configuration guide for the cisco crs router,
Cisco ios xr mpls configuration guide for the cisco crs router,Pablo Guillen
 
Cisco acs configuration guide
Cisco acs configuration guideCisco acs configuration guide
Cisco acs configuration guideRichardsCCNA
 
Esa 8 0-user_guide
Esa 8 0-user_guideEsa 8 0-user_guide
Esa 8 0-user_guide1jemoeder
 
CISCO ACS 5.6 Migration Guide
CISCO ACS 5.6 Migration GuideCISCO ACS 5.6 Migration Guide
CISCO ACS 5.6 Migration GuidePCCW GLOBAL
 
Business Ready Teleworker Design Guide
Business Ready Teleworker Design GuideBusiness Ready Teleworker Design Guide
Business Ready Teleworker Design GuideJoel W. King
 
Interconnecting_Cisco_Networking_Devices.pdf
Interconnecting_Cisco_Networking_Devices.pdfInterconnecting_Cisco_Networking_Devices.pdf
Interconnecting_Cisco_Networking_Devices.pdfDaginni78
 
Cisco system message guide
Cisco system message guideCisco system message guide
Cisco system message guideCONNECT Tunisia
 
Voice over wireless lan 4.1 design guide
Voice over wireless lan 4.1 design guideVoice over wireless lan 4.1 design guide
Voice over wireless lan 4.1 design guideAhmad Irfan
 
Cisco ios software configuration guide for cisco aironet access points cisco ...
Cisco ios software configuration guide for cisco aironet access points cisco ...Cisco ios software configuration guide for cisco aironet access points cisco ...
Cisco ios software configuration guide for cisco aironet access points cisco ...Ahmad Irfan
 
Manual linksys router_rv082
Manual linksys router_rv082Manual linksys router_rv082
Manual linksys router_rv082Edgar Cañizalez
 
Important cisco-chow-commands
Important cisco-chow-commandsImportant cisco-chow-commands
Important cisco-chow-commandsssusere31b5c
 
Asr 9k rommon config
Asr 9k rommon configAsr 9k rommon config
Asr 9k rommon configofahim
 

Similar to As rbook (20)

Cisco 2960 Switch Configuration
Cisco 2960 Switch ConfigurationCisco 2960 Switch Configuration
Cisco 2960 Switch Configuration
 
Manual cisco 2950
Manual cisco 2950Manual cisco 2950
Manual cisco 2950
 
Cisco 6500 config
Cisco 6500 configCisco 6500 config
Cisco 6500 config
 
Aironet
AironetAironet
Aironet
 
Cisco San switch troublehooting Guide
Cisco San switch troublehooting GuideCisco San switch troublehooting Guide
Cisco San switch troublehooting Guide
 
Cisco ios xr mpls configuration guide for the cisco crs router,
Cisco ios xr mpls configuration guide for the cisco crs router,Cisco ios xr mpls configuration guide for the cisco crs router,
Cisco ios xr mpls configuration guide for the cisco crs router,
 
Cisco acs configuration guide
Cisco acs configuration guideCisco acs configuration guide
Cisco acs configuration guide
 
Esa 8 0-user_guide
Esa 8 0-user_guideEsa 8 0-user_guide
Esa 8 0-user_guide
 
CISCO ACS 5.6 Migration Guide
CISCO ACS 5.6 Migration GuideCISCO ACS 5.6 Migration Guide
CISCO ACS 5.6 Migration Guide
 
Business Ready Teleworker Design Guide
Business Ready Teleworker Design GuideBusiness Ready Teleworker Design Guide
Business Ready Teleworker Design Guide
 
Interconnecting_Cisco_Networking_Devices.pdf
Interconnecting_Cisco_Networking_Devices.pdfInterconnecting_Cisco_Networking_Devices.pdf
Interconnecting_Cisco_Networking_Devices.pdf
 
Cisco system message guide
Cisco system message guideCisco system message guide
Cisco system message guide
 
Voice over wireless lan 4.1 design guide
Voice over wireless lan 4.1 design guideVoice over wireless lan 4.1 design guide
Voice over wireless lan 4.1 design guide
 
Cisco ios software configuration guide for cisco aironet access points cisco ...
Cisco ios software configuration guide for cisco aironet access points cisco ...Cisco ios software configuration guide for cisco aironet access points cisco ...
Cisco ios software configuration guide for cisco aironet access points cisco ...
 
Manual linksys router_rv082
Manual linksys router_rv082Manual linksys router_rv082
Manual linksys router_rv082
 
Important cisco-chow-commands
Important cisco-chow-commandsImportant cisco-chow-commands
Important cisco-chow-commands
 
Access point
Access pointAccess point
Access point
 
Asa packet-flow-00
Asa packet-flow-00Asa packet-flow-00
Asa packet-flow-00
 
Xb30330.xb30350 management guide
Xb30330.xb30350 management guideXb30330.xb30350 management guide
Xb30330.xb30350 management guide
 
Asr 9k rommon config
Asr 9k rommon configAsr 9k rommon config
Asr 9k rommon config
 

Recently uploaded

Call Girls Service Nashik Vaishnavi 7001305949 Independent Escort Service Nashik
Call Girls Service Nashik Vaishnavi 7001305949 Independent Escort Service NashikCall Girls Service Nashik Vaishnavi 7001305949 Independent Escort Service Nashik
Call Girls Service Nashik Vaishnavi 7001305949 Independent Escort Service NashikCall Girls in Nagpur High Profile
 
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLSMANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLSSIVASHANKAR N
 
The Most Attractive Pune Call Girls Budhwar Peth 8250192130 Will You Miss Thi...
The Most Attractive Pune Call Girls Budhwar Peth 8250192130 Will You Miss Thi...The Most Attractive Pune Call Girls Budhwar Peth 8250192130 Will You Miss Thi...
The Most Attractive Pune Call Girls Budhwar Peth 8250192130 Will You Miss Thi...ranjana rawat
 
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...Christo Ananth
 
Microscopic Analysis of Ceramic Materials.pptx
Microscopic Analysis of Ceramic Materials.pptxMicroscopic Analysis of Ceramic Materials.pptx
Microscopic Analysis of Ceramic Materials.pptxpurnimasatapathy1234
 
Introduction to Multiple Access Protocol.pptx
Introduction to Multiple Access Protocol.pptxIntroduction to Multiple Access Protocol.pptx
Introduction to Multiple Access Protocol.pptxupamatechverse
 
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...roncy bisnoi
 
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur High Profile
 
HARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICS
HARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICSHARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICS
HARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICSRajkumarAkumalla
 
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...ranjana rawat
 
Extrusion Processes and Their Limitations
Extrusion Processes and Their LimitationsExtrusion Processes and Their Limitations
Extrusion Processes and Their Limitations120cr0395
 
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escortsranjana rawat
 
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...ranjana rawat
 
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICS
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICSAPPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICS
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICSKurinjimalarL3
 
High Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur Escortsranjana rawat
 
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur High Profile
 
Coefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptxCoefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptxAsutosh Ranjan
 
Processing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxProcessing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxpranjaldaimarysona
 
Software Development Life Cycle By Team Orange (Dept. of Pharmacy)
Software Development Life Cycle By  Team Orange (Dept. of Pharmacy)Software Development Life Cycle By  Team Orange (Dept. of Pharmacy)
Software Development Life Cycle By Team Orange (Dept. of Pharmacy)Suman Mia
 

Recently uploaded (20)

Call Girls Service Nashik Vaishnavi 7001305949 Independent Escort Service Nashik
Call Girls Service Nashik Vaishnavi 7001305949 Independent Escort Service NashikCall Girls Service Nashik Vaishnavi 7001305949 Independent Escort Service Nashik
Call Girls Service Nashik Vaishnavi 7001305949 Independent Escort Service Nashik
 
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLSMANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
 
The Most Attractive Pune Call Girls Budhwar Peth 8250192130 Will You Miss Thi...
The Most Attractive Pune Call Girls Budhwar Peth 8250192130 Will You Miss Thi...The Most Attractive Pune Call Girls Budhwar Peth 8250192130 Will You Miss Thi...
The Most Attractive Pune Call Girls Budhwar Peth 8250192130 Will You Miss Thi...
 
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...
 
Microscopic Analysis of Ceramic Materials.pptx
Microscopic Analysis of Ceramic Materials.pptxMicroscopic Analysis of Ceramic Materials.pptx
Microscopic Analysis of Ceramic Materials.pptx
 
Introduction to Multiple Access Protocol.pptx
Introduction to Multiple Access Protocol.pptxIntroduction to Multiple Access Protocol.pptx
Introduction to Multiple Access Protocol.pptx
 
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
 
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
 
HARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICS
HARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICSHARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICS
HARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICS
 
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
 
Extrusion Processes and Their Limitations
Extrusion Processes and Their LimitationsExtrusion Processes and Their Limitations
Extrusion Processes and Their Limitations
 
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
 
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
 
Water Industry Process Automation & Control Monthly - April 2024
Water Industry Process Automation & Control Monthly - April 2024Water Industry Process Automation & Control Monthly - April 2024
Water Industry Process Automation & Control Monthly - April 2024
 
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICS
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICSAPPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICS
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICS
 
High Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur Escorts
 
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
 
Coefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptxCoefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptx
 
Processing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxProcessing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptx
 
Software Development Life Cycle By Team Orange (Dept. of Pharmacy)
Software Development Life Cycle By  Team Orange (Dept. of Pharmacy)Software Development Life Cycle By  Team Orange (Dept. of Pharmacy)
Software Development Life Cycle By Team Orange (Dept. of Pharmacy)
 

As rbook

  • 1. Americas Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com Tel: 408 526-4000 800 553-NETS (6387) Fax: 408 527-0883 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router Cisco IOS XR Software, Release 4.0 April, 2011 Text Part Number: OL-23591-02
  • 2. THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL STATEMENTS, INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS. THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT SHIPPED WITH THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED WARRANTY, CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY. The Cisco implementation of TCP header compression is an adaptation of a program developed by the University of California, Berkeley (UCB) as part of UCB’s public domain version of the UNIX operating system. All rights reserved. Copyright © 1981, Regents of the University of California. NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED “AS IS” WITH ALL FAULTS. CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT LIMITATION, THOSE OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEALING, USAGE, OR TRADE PRACTICE. IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING, WITHOUT LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO OR ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. Cisco and the Cisco Logo are trademarks of Cisco Systems, Inc. and/or its affiliates in the U.S. and other countries. A listing of Cisco's trademarks can be found at www.cisco.com/go/trademarks. Third party trademarks mentioned are the property of their respective owners. The use of the word partner does not imply a partnership relationship between Cisco and any other company. (1005R) Any Internet Protocol (IP) addresses and phone numbers used in this document are not intended to be actual addresses and phone numbers. Any examples, command display output, network topology diagrams, and other figures included in the document are shown for illustrative purposes only. Any use of actual IP addresses or phone numbers in illustrative content is unintentional and coincidental. Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router © 2010 Cisco Systems, Inc. All rights reserved.
  • 3. iii Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 C O N T E N T S Preface xi Changes to This Document xi Obtaining Documentation and Submitting a Service Request xii C H A P T E R 1 General Troubleshooting Procedures 1-1 Prerequisite Documentation for Troubleshooting 1-1 Verifying and Troubleshooting CLI Access 1-2 General CLI Access Information 1-2 User Access Privileges 1-2 Cisco-support Task ID 1-3 CLI Access Through a Console Port 1-3 CLI Access Through a Terminal Server 1-3 CLI Access Through the Management Ethernet Interface 1-4 Validating and Troubleshooting Installation of the Cisco IOS XR Software Package 1-7 Verifying the Software Version 1-8 Validating the Installation 1-10 Validating and Troubleshooting Cisco IOS XR Software Configuration 1-16 Local and Global Configurations 1-16 Collecting Configuration Information 1-19 Verifying the Running Configuration 1-20 Using the show configuration failed Command 1-24 Verifying the System 1-26 Troubleshooting the Backplane Ethernet Control System 1-41 Basic Cisco IOS XR Verification and Troubleshooting Commands 1-46 man Command 1-46 describe Command 1-49 show platform Command 1-49 top Command 1-50 show context Command 1-50 show users Command 1-52 show history Command 1-52 show configuration Command 1-53 Displaying ASIC Errors 1-54 Using Trace Commands 1-56
  • 4. Contents iv Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 MIB Location 1-57 Gathering Information Before You Call Cisco TAC 1-58 Gathering Information about Crashes and Core Dumps 1-58 Capturing Logs 1-58 Using Debug Commands 1-59 Using Diagnostic Commands 1-59 Commands Used to Display Process and Thread Details 1-59 C H A P T E R 2 Verifying and Troubleshooting Interface Status 2-61 Verifying and Troubleshooting Gigabit Ethernet Interfaces 2-61 Verifying and Troubleshooting Pluggable Optical Line Card Interfaces 2-68 C H A P T E R 3 Troubleshooting Interface Connectivity 3-75 Troubleshooting Ping and ARP Connectivity 3-75 Troubleshooting Bidirectional Forwarding Detection 3-81 Using show and debug Commands 3-82 BFD Sessions in Down State 3-83 BFD Sessions Flap 3-83 BFD Sessions Down on Neighboring Router 3-85 BFD Sessions Are Not Created on the LC 3-85 Troubleshooting Ethernet CFM 3-85 Using show and debug Commands 3-87 MEPs Are Not Created 3-88 MIPs Are Not Created 3-88 No CCMs are Received at the MEP or Peer MEPs Are Not Seen 3-89 Peer MEP Defects and Mismatches Are Seen 3-90 Remote Defect Indication Received 3-91 Peer MEP Times Out But No Alarm Or Action Occurs 3-92 No Debugs or Counters for Higher-Level Packets at a MEP or MIP 3-92 Dropped CFM PDUs 3-92 CFM ping Or traceroute Returns a “not found” Error 3-93 AIS Messages Are Not Sent 3-93 C H A P T E R 4 Troubleshooting Packet Forwarding 4-95 Understanding IPv4 CEF 4-95 Troubleshooting IPv4 CEF 4-96 Troubleshooting Adjacency Information 4-101 Troubleshooting Transient Traffic Drop 4-106
  • 5. Contents v Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Troubleshooting Packet Drop in the Fabric 4-109 Troubleshooting Control Plane Information 4-109 C H A P T E R 5 Troubleshooting Bundles and Load Balancing 5-115 Troubleshooting Routing and CEF Issues Related to Bundles and Load Balancing 5-115 Verifying Routing Table Entries for Parallel Links 5-115 Verifying the CEF Database and Measuring Flows 5-117 Troubleshooting Problems with Link Bundles 5-118 Bundle Does Not Come Up 5-118 Bundle Member Not Distributing 5-119 Bundle Not Using MAC-Address From Backplane 5-119 Layer 3 Data Traffic Not Flowing 5-120 Ping Failed over Bundle 5-120 Layer 3 Packets Not Synching Over Bundle 5-121 Layer 2 Traffic Not Flowing 5-121 Bundle Statistics 5-122 Troubleshooting Layer 2 Bundles and Load Balancing 5-122 Verifying the Bundle Status, IGP Route, and CEF Database 5-122 Viewing the Expected Paths and Measuring the Flows 5-123 Troubleshooting Layer 3 Bundles and Load Balancing 5-124 C H A P T E R 6 Troubleshooting Layer 3 Connectivity 6-125 Using show and debug Commands 6-125 Traffic Loss 6-128 Packets Are Punted and Switched in Software 6-129 Traceroute Fails 6-130 Adding Routes Fails 6-131 Continuous Tracebacks 6-133 fib_mgr Does Not Come Up During LC Reload or After Multiple Process Restarts 6-134 CEF Entries Out of Sync 6-135 fib_mgr Crashes 6-136 Tracebacks Appearing 6-136 Traffic Loss Because of Changing encap on a Subinterface 6-137 Traffic Loss during RSP Failover 6-138 Troubleshooting Virtual Router Redundancy Protocol 6-138 Using show and debug Commands 6-139 VRRP Fails to Reach Active State 6-140
  • 6. Contents vi Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Tracked Interface Failing, Router State Not Changed 6-140 VRRP State Flapping 6-140 More Than One VRRP Router Active 6-141 VRRP Active Router Not Forwarding Traffic 6-141 Traffic Loss or Unexpected VRRP State After Interface shut/no shut 6-142 Additional Information On Routing Configuration Commands 6-142 C H A P T E R 7 Troubleshooting Router Switch Fabric and Data Path 7-143 Understanding Switch Fabric Architecture 7-143 Getting Started with Fabric Troubleshooting 7-145 Troubleshooting Packet Drops 7-146 Displaying Traffic Status in Line Cards and RSP Cards 7-147 Locating Packet Drops by Examining Counters 7-148 Locating Drops of Punted Packets 7-155 Packet Drop from LC to LC 7-157 Packet Drop Between RSP and LC 7-158 Packet Drop After Certain Actions 7-160 Packet Drop After a Redundancy Switchover 7-161 Packet Drop with Unknown Reason 7-163 Troubleshooting RSP and LC Crashes 7-165 Active RSP Is Crashing 7-165 Standby RSP Is Crashing 7-166 LC Is Crashing 7-167 Troubleshooting Complete Loss of Traffic 7-168 No Traffic from LC to LC 7-169 No Traffic Between RSP and LC 7-170 Gathering Fabric Information Before Calling TAC 7-172 C H A P T E R 8 Troubleshooting MPLS Services 8-173 Verifying MPLS PIE Activation and MPLS Configuration 8-173 Troubleshooting Connectivity Over MPLS 8-174 Using show and debug Commands 8-174 IP Packets Not Forwarded to LSP 8-175 IP Packets Not Forwarded to MPLS TE Tunnel 8-176 MPLS Packets Not Forwarded to MPLS TE Tunnel 8-176 MPLS TE Tunnels Do Not Come Up 8-176 FRR-Protected Tunnel Goes Down After Triggering FRR 8-177 MPLS TE FRR Database Not Built 8-178
  • 7. Contents vii Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 MPLS FRR Switch Time Debugging 8-178 C H A P T E R 9 Troubleshooting L2VPN and Ethernet Services 9-181 Troubleshooting VLAN Traffic and L2 TCAM Classification 9-181 Understanding Problems with VLAN Traffic and L2 TCAM Classification 9-182 Verifying the Configuration Is Correct 9-182 Verifying Interfaces, Subinterfaces, and Packet Forwarding 9-183 Troubleshooting Multipoint Layer 2 Services 9-190 Basic Bridging: Example 9-190 Verifying MAC Address Updates 9-192 Troubleshooting Multipoint Layer 2 Bridging Services (VPLS) 9-195 Troubleshooting Bridge Domains That Use BGP-AD 9-201 Troubleshooting Point-to-Point Layer 2 Services 9-206 Example of Point-To-Point Layer 2 Deployment 9-206 Using show and debug Commands 9-210 AC Is Down 9-211 Pseudowire Is Down 9-212 VPWS Not Forwarding Traffic from AC to Pseudowire 9-212 Pseudowire Up but Ping Fails 9-213 Traffic Loss 9-213 Traffic Loss During RSP Fail Over 9-213 Preferred Path Not Working 9-214 Troubleshooting Specific Outage Scenarios In Layer 2 Services 9-214 Using show and debug Commands 9-215 L2VPN Discovery Not Working 9-217 AC Is Down 9-218 Pseudowire Is Down 9-219 VPLS Not Forwarding Flooding Traffic 9-220 VPLS Not Forwarding Flooding Traffic from AC to Pseudowire 9-224 VPLS Not Forwarding Flooding Traffic from Pseudowire to AC 9-224 VPLS Not Forwarding Unicast Traffic from AC to AC 9-225 VPLS Not Forwarding Unicast Traffic from AC to Pseudowire 9-225 VPLS Not Forwarding Flooding Traffic from Pseudowire to AC 9-225 Pseudowire Up but Ping Fails 9-226 Traffic Loss 9-226 Pseudowire Flap Causing Traffic Loss 9-226 Traffic Loss During RSP Fail Over 9-227 Preferred Path Not Working 9-227 Troubleshooting Dynamic Host Configuration Protocol Snooping 9-227
  • 8. Contents viii Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Show Commands 9-228 Trace Commands 9-228 Syslog Commands 9-228 Tech-support Commands 9-229 Action Commands 9-229 L2VPN Commands 9-229 L2Snoop Commands 9-229 Interface Controller Commands 9-230 Troubleshooting Multiple Spanning Tree 9-230 Using show and debug Commands 9-230 MSTP Incorrectly or Inconsistently Formed 9-230 MSTP Correctly Formed, but Traffic Flooding 9-231 Packet Forwarding Does Not Match MSTP State 9-231 MSTAG Access Network Does Not Recognize MSTAG Node as Root 9-231 Traffic Not Switching Through MSTAG Node(s) 9-232 Additional References—Command Reference and Configuration Guides 9-232 C H A P T E R 10 Troubleshooting Quality of Service and Access Control Lists 10-233 Using show and debug Commands 10-234 Service-Policy Configuration Is Rejected 10-235 Packets are Incorrectly Classified 10-235 Packets in Wrong Queue 10-236 Packets Incorrectly Marked 10-236 Packets Incorrectly Policed 10-237 Shaping Incorrect 10-237 Weighted Random Early Detection Incorrect 10-237 Bandwidth Not Guaranteed 10-238 Bandwidth Ratio Not Working 10-238 Non-zero Queue(conform) and Queue(exceed) Counters In show policy-map Commands 10-239 Unable to Modify or Delete policy-map or class-map 10-240 Unable to Modify or Delete class-map ACL 10-240 Unable to Delete service-policy 10-240 After QoS EA Restarts, show policy-map interface Fails 10-240 After QoS EA Restarts, service-policy config Fails 10-241 show policy-map interface Output Error 10-241 Bundle Members Not Configured with service-policy 10-241 Troubleshooting Access Control Lists 10-241
  • 9. Contents ix Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Using show and debug Commands 10-242 ACL Messages Not Appearing 10-243 Fragmented Packets Being Accepted 10-243 Egress Counter Incorrect or Not Working 10-244 ACL Interface Bind Rejected 10-244 Single ACE Using Many TCAMs 10-244 ACL Using Varying TCAM Space 10-245 ACL Logs Not Working for Ethernet Services 10-245 Ethernet Services ACL Bind on Interface Rejected 10-245 Changing ACL Exhausts TCAM 10-245 Cannot Delete ACL 10-246 DF Bit Not Supported 10-246 Max ACL Limit Reached 10-246 Unsupported Combinations in ACL 10-246 No Statistics Counters 10-246 TCAMs Out of Resources 10-246 C H A P T E R 11 Troubleshooting Multicast Services 11-247 Troubleshooting IGMP Snooping (Layer 2 Multicast) 11-247 Using show Commands 11-247 Using the debug, trace, and show tech-support Commands 11-249 Troubleshooting Missing Routes and Forwarding Errors 11-250 Troubleshooting Native Multicast Routing (Layer 3) 11-256 Using show and debug Commands 11-256 Multicast PIE Installation Fails 11-262 Multicast CLI Unavailable Although PIE Is Installed 11-263 “This command not authorized” Error Message 11-263 Dynamic IGMP Failure 11-263 Traffic Fails on Some Interfaces 11-267 Traffic Fails on Some Interfaces—MGID 11-268 Throughput Loss at Receiver Interfaces 11-268 Reverse Path Forwarding IP Address Problems 11-268 I N D E X
  • 10. Contents x Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02
  • 11. xi Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Preface This guide describes how to troubleshooting a router using the Cisco IOS XR software. This preface contains the following sections: • Changes to This Document, page xi • Obtaining Documentation and Submitting a Service Request, page xii Changes to This Document Table 1 lists the technical changes made to this document since it was first printed. Table 1 Changes to This Document Revision Date Change Summary OL-23591-02 April, 2011 Added details for the following topics: • Chapter 1, “General Troubleshooting Procedures”—Added information on prerequisite documentation for troubleshooting, Cisco-support task ID, show tech-support command, displaying ASIC errors, gathering logs and system information. Modified the information on diagnostics. • Divided interface troubleshooting into two separate chapters—Chapter 2, “Verifying and Troubleshooting Interface Status”and Chapter 3, “Troubleshooting Interface Connectivity.” • Chapter 3, “Troubleshooting Interface Connectivity”—Added information on connectivity fault management (CFM). • Chapter 6, “Troubleshooting Layer 3 Connectivity”—Added information on CEF and interface accounting. • Chapter 7, “Troubleshooting Router Switch Fabric and Data Path”—Added information on NP counters. • Chapter 8, “Troubleshooting MPLS Services”—Corrected syntax of several commands. continued ...
  • 12. xii Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Preface Obtaining Documentation and Submitting a Service Request For information on obtaining documentation, submitting a service request, and gathering additional information, see the monthly What’s New in Cisco Product Documentation, which also lists all new and revised Cisco technical documentation, at: http://www.cisco.com/en/US/docs/general/whatsnew/whatsnew.html Subscribe to the What’s New in Cisco Product Documentation as a Really Simple Syndication (RSS) feed and set content to be delivered directly to your desktop using a reader application. The RSS feeds are a free service and Cisco currently supports RSS version 2.0. OL-23591-02 April, 2011 ... continued • Chapter 9, “Troubleshooting L2VPN and Ethernet Services”—Enhanced information about VLAN verification, included sample VLAN and PW configurations, added a section on Verifying MAC Address Updates, enhanced information about multipoint Layer 2 services (VPLS), moved information on DHCP snooping to this chapter, enhanced information on MST access gateways (MSTAGs). Reorganized the chapter for ease of use. • Chapter 10, “Troubleshooting Quality of Service and Access Control Lists”—Added information on queue conform and queue exceed counters displayed by the policy-map command. • Chapter 11, “Troubleshooting Multicast Services”—Reorganized this chapter to highlight IGMP snooping (Layer 2 MC) and native MC (Layer 3), and added information to each of these sections. OL-23591-01 November 2010 (Initial release of this document as a multichapter book.) The content was reorganized for usability and updated to reflect Release 3.9 and 4.0 features. OL-20794-01 December 2009 Initial release of this document as a single module. Table 1 Changes to This Document (continued) Revision Date Change Summary
  • 13. C H A P T E R 1-1 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 1 General Troubleshooting Procedures This chapter describes general troubleshooting techniques you can use to troubleshoot the Cisco ASR 9000 Aggregation Series Router. It includes the following sections: • Prerequisite Documentation for Troubleshooting, page 1-1 • Verifying and Troubleshooting CLI Access, page 1-2 • Validating and Troubleshooting Installation of the Cisco IOS XR Software Package, page 1-7 • Validating and Troubleshooting Cisco IOS XR Software Configuration, page 1-16 • Verifying the System, page 1-26 • Troubleshooting the Backplane Ethernet Control System, page 1-41 • Basic Cisco IOS XR Verification and Troubleshooting Commands, page 1-46 • Displaying ASIC Errors, page 1-54 • Using Trace Commands, page 1-56 • MIB Location, page 1-57 • Gathering Information Before You Call Cisco TAC, page 1-58 Prerequisite Documentation for Troubleshooting As a starting point for troubleshooting, we strongly recommend that you have a system of maintaining and accessing detailed information about your network and ASR 9000 router. This should include: • Current documentation about the system, including chassis numbers, serial numbers, installed cards, and location of chassis details. • Diagrams illustrating the connectivity of the router control plane Ethernet network. • Detailed documentation about the network, including the following: – Up-to-date internetwork map that outlines the physical location of all the devices on the network and how they are connected, as well as a logical map of interfaces, network addresses, network numbers, subnetworks, and so on – List of all network protocols implemented in your network; and for each of the protocols implemented, a list of the network numbers, subnetworks, zones, areas, and so on that are associated with them – All points of contact to external networks – Routing protocol for each external network connection
  • 14. 1-2 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Verifying and Troubleshooting CLI Access – Established baseline for your network, that is, the normal network behavior and performance at different times of the day so that you can compare any problems with a baseline – Name of the device that is the spanning tree root bridge for the system control plane Ethernet network • Captured output of all commands Verifying and Troubleshooting CLI Access Ensure that the system has been booted. If the system has not booted, see Cisco IOS XR Getting Started Guide for the Cisco ASR 9000 Aggregation Services Router for information on booting a router running Cisco IOS XR software. The following CLI access troubleshooting information is provided: • General CLI Access Information, page 1-2 • User Access Privileges, page 1-2 • Cisco-support Task ID, page 1-3 • CLI Access Through a Console Port, page 1-3 • CLI Access Through a Terminal Server, page 1-3 • CLI Access Through the Management Ethernet Interface, page 1-4 General CLI Access Information The following CLI access information applies to a console port, terminal server, and management Ethernet interface connections. Once the terminal emulation software is started and you press Enter, a router prompt should appear. If no prompt appears, verify the physical connection to the console port and press Enter again. If the prompt still does not appear, contact Cisco Technical Support. See the “Obtaining Documentation and Submitting a Service Request” section on page xii for Cisco Technical Support contact information. If a prompt appears, indicating that the CLI is accessible, but your login username and password are invalid, you are prevented from accessing the router. Verify that you have the correct username and password. If you have the correct username and password, but are locked out of the router, you may need to perform password recovery to access the system again. See Cisco ASR 9000 Aggregation Services Router ROM Monitor Guide for password recovery procedures. User Access Privileges When you log on to the router, use a username that is associated with a valid user group that has the authorization to execute the required commands. If you suspect user group assignment is preventing you from using a command, contact your AAA administrator for assistance. See Cisco ASR 9000 Aggregation Services Router System Security Command Reference and Cisco ASR 9000 Aggregation Services Router System Security Configuration Guide for information on users, usernames, and user groups.
  • 15. 1-3 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Verifying and Troubleshooting CLI Access Cisco-support Task ID Many of the troubleshooting commands can be performed only by users who are assigned to a user group that includes the cisco-support task ID. Users without the cisco-support task ID receive a “This command is not authorized” response if they attempt to use those commands. The cisco-support commands are normally reserved for use by Cisco Technical Support personnel, because there is some risk that they may cause performance or other issues. Caution These Cisco support commands are normally reserved for use by Cisco Technical Support personnel only. There is some risk that they may cause performance or other issues that impact products without proper usage, and we highly recommend that you contact Cisco Technical Support prior to using any of these commands. See the “Obtaining Documentation and Submitting a Service Request” section on page xii for information on contacting Cisco TAC. CLI Access Through a Console Port The first time a router is started, you must use a direct connection to the console port to connect to the router and enter the initial configuration. See Cisco ASR 9000 Aggregation Services Router Router Getting Started Guide for information on connecting to the router through a console port. When you use a direct connection to the Console port, CLI commands are entered at a terminal or at a computer running terminal emulation software. A direct Console port connection is useful for entering initial configurations and performing some debugging tasks. CLI Access Through a Terminal Server A terminal server connection provides a way to access the Console port from a remote location. A terminal server connection is used when you need to perform tasks that require Console port access from a remote location. Connecting to a router through a terminal server is similar to directly connecting through the Console port. For both connection types, the physical connection takes place through the Console port. The difference is that the terminal server connects directly to the Console port, and you must use a Telnet session to establish communications through the terminal server to the router. If you are unable to access the CLI through a terminal server, perform the following procedure. Step 1 Disable flow control (XON/XOFF) on the Terminal Server. Step 2 Disable local echo mode on the Terminal Server. Step 3 Verify the router name configured using the hostname command. Step 4 Check whether the port address is configured correctly. Step 5 Verify whether the address (interface) used for the reverse Telnet is up/up. The output of the show interfaces brief command provides this information. Cisco recommends you to use loopbacks because they are always up. Step 6 Ensure that you have the correct type of cabling. For example, you must not use a crossover cable to extend the length. Step 7 Establish a Telnet connection to the IP address port to test direct connectivity. You must Telnet from both an external device and the terminal server. For example, telnet 172.21.1.1 2003.
  • 16. 1-4 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Verifying and Troubleshooting CLI Access Step 8 Ensure that you have the transport input telnet command under the line for the target device. The target device is the device that is connected to the terminal server. Step 9 Use a PC/dumb terminal to connect directly to the console of the target router. The target router is the device connected to the terminal server. This step helps you identify the presence of a port issue. Step 10 If you are disconnected, check timeouts. You can remove or adjust timeouts. Note If you encounter authentication failures, remember that the terminal server performs the first authentication (if configured), while the device to which you try to connect performs the second authentication (if configured). Verify whether AAA is configured correctly on both the terminal server and the connecting device. Step 11 Contact Cisco Technical Support. See the “Obtaining Documentation and Submitting a Service Request” section on page xii for Cisco Technical Support contact information. CLI Access Through the Management Ethernet Interface The Management Ethernet interface allows you to manage the router using a network connection. Before you can use the Management Ethernet interface, the interface must be configured. See Cisco ASR 9000 Aggregation Services Router Router Getting Started Guide for information on configuring the interface. Once configured, the network connection takes place between client software on a workstation computer and a server process within the router. The type of client software you use depends on the server process you use. See Cisco ASR 9000 Aggregation Services Router Router Getting Started Guide for information on the client and server services supported by the Cisco IOS XR software. If you are unable to access the CLI through a management Ethernet interface, perform the following procedure. SUMMARY STEPS 1. show interface MgmtEth interface-instance 2. show arp MgmtEth interface-instance 3. show ipv4 interface type instance 4. ping 5. Contact Cisco Technical Support if the problem is not resolved
  • 17. 1-5 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Verifying and Troubleshooting CLI Access DETAILED STEPS Command or Action Purpose Step 1 show interfaces MgmtEth interface-instance Example: RP/0/RSP0/CPU0:router# show interfaces MgmtEth 0/RSP0/CPU0/0 Displays statistics for all interfaces configured on the router. Check the following: • MgmtEth interface is up • Line protocol (state of the Layer 2 line protocol) is up • Number of input and output errors If an interface is administratively down, use the no shutdown command to enable the interface. If an interface is down (operationally down), input or output errors are not within an acceptable range, the management Ethernet interface is not enabled when the no shutdown command is used, or the line protocol is down, see Chapter 2, “Verifying and Troubleshooting Interface Status,” for detailed information on troubleshooting interfaces. If the interface is up and the input and output errors are within an acceptable range, proceed to Step 2. Step 2 show arp MgmtEth interface-instance Example: RP/0/RSP0/CPU0:router# show arp MgmtEth 0/RSP0/CPU0/0 Displays the Address Resolution Protocol (ARP) table for the management Ethernet interface. Ensure that the expected ARP entries exist for the management Ethernet interface. If the expected ARP entries exist, proceed to Step 3. If the expected ARP entries do not exist, verify the physical layer Ethernet interface connectivity. Use the show arp trace command to display the ARP entries in the buffer. See the Chapter 2, “Verifying and Troubleshooting Interface Status,” for more information on troubleshooting interfaces. Step 3 show ipv4 interface type instance Example: RP/0/RSP0/CPU0:router# show ipv4 interface MgmtEth 0/RSP0/CPU0/0 Displays the usability status of interfaces configured for IPv4. If the interface is in the expected state, proceed to Step 4. If the status of the interface is not as expected, see Chapter 2, “Verifying and Troubleshooting Interface Status,” for more information on troubleshooting interfaces.
  • 18. 1-6 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Verifying and Troubleshooting CLI Access Examples The output from the show interfaces MgmtEth command displays the status of the management Ethernet interface. In the following example, the management Ethernet interface is up, and there are 20 input errors and 8 output errors. RP/0/RSP0/CPU0:router# show interface MgmtEth 0/RSP0/CPU0/0 Tue Sep 14 14:21:07.496 DST MgmtEth0/RSP0/CPU0/0 is up, line protocol is up Interface state transitions: 1 Hardware is Management Ethernet, address is 001b.53ff.4a62 (bia 001b.53ff.4a62) Description: Connected to Lab LAN Internet address is 172.29.52.137/24 MTU 1514 bytes, BW 100000 Kbit (Max: 100000 Kbit) reliability 73/255, txload 0/255, rxload 0/255 Encapsulation ARPA, Half-duplex, 100Mb/s, THD, link type is autonegotiation output flow control is off, input flow control is off loopback not set, ARP type ARPA, ARP timeout 04:00:00 Last input 00:00:00, output 00:00:00 Last clearing of "show interface" counters never 5 minute input rate 2000 bits/sec, 3 packets/sec 5 minute output rate 0 bits/sec, 0 packets/sec 373082 packets input, 51028824 bytes, 239105 total input drops 62028 drops for unrecognized upper-level protocol Received 2601 broadcast packets, 194653 multicast packets 10 runts, 0 giants, 0 throttles, 0 parity 20 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort 45232 packets output, 3042775 bytes, 0 total output drops Output 24 broadcast packets, 0 multicast packets 8 output errors, 0 underruns, 0 applique, 0 resets 0 output buffer failures, 0 output buffers swapped out 1 carrier transitions The output from the show arp MgmtEth 0/RSP0/CPU0/0 command displays the ARP table for the management Ethernet interface. Use the output from this command to verify that there are dynamic ARP addresses in the table and that ARP is functioning over the interface. The output shows that ARP is functioning over the management Ethernet interface 0/RSP0/CPU0/0. RP/0/RSP0/CPU0:router# show arp MgmtEth 0/RSP0/CPU0/0 Tue Sep 14 14:24:03.962 DST ------------------------------------------------------------------------------- 0/RSP0/CPU0 ------------------------------------------------------------------------------- Address Age Hardware Addr State Type Interface Step 4 ping Example: RP/0/RSP0/CPU0:router# ping Checks host reachability and network connectivity on the IP network. Note Enter a specific IP address or follow the prompts to send the ping message to the target address. If no problems are detected, proceed to Step 5. Step 5 Contact Cisco Technical Support. If the problem is not resolved, contact Cisco Technical Support. For Cisco Technical Support contact information, see the “Obtaining Documentation and Submitting a Service Request” section on page xii. Command or Action Purpose
  • 19. 1-7 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Validating and Troubleshooting Installation of the Cisco IOS XR Software Package 172.29.52.1 01:44:00 0000.0c07.ac01 Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.13 01:16:59 0010.79e9.6038 Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.21 01:40:25 0022.0d5a.a6c4 Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.27 02:18:16 0012.7fd6.ba08 Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.28 02:05:29 0012.7fd6.ba09 Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.32 01:42:16 0022.0d26.3bc5 Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.36 02:39:34 0026.527c.5341 Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.46 01:36:50 0012.7fd6.b9aa Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.47 01:36:39 0012.7fd6.b9ab Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.60 01:35:20 0003.a099.8000 Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.69 00:00:00 001b.7852.4bd1 Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.70 01:23:38 0011.93ef.e8e6 Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.71 02:00:47 0011.93ef.e8fe Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.75 01:44:59 5a59.0000.0202 Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.76 01:41:10 0011.93ef.e8ea Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.81 00:15:35 001a.6c40.d89c Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.83 00:21:05 001a.6c40.d89c Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.127 01:43:38 0013.c4cb.a200 Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.134 01:15:53 001f.6c26.7fc0 Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.135 01:01:46 001f.6c25.c480 Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.136 00:43:39 0022.5560.8840 Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.137 - 001b.53ff.4a62 Interface ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.138 - 001b.53ff.4a62 Interface ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.161 01:32:12 0019.aaa3.3d48 Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.171 00:16:12 001c.5838.5b28 Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.172 00:17:47 001c.5838.5b29 Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.173 01:57:04 0015.c75f.09f8 Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.180 01:26:50 0015.c75f.0800 Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.217 01:16:21 0019.aaa3.b5ff Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.226 01:28:32 0010.f60e.8400 Dynamic ARPA MgmtEth0/RSP0/CPU0/0 172.29.52.243 01:48:25 001e.79c1.e0c1 Dynamic ARPA MgmtEth0/RSP0/CPU0/0 The ping command checks to see if the neighbor is reachable. RP/0/RSP0/CPU0:router# ping 172.16.52.28 count 10 Tue Sep 14 14:36:52.441 DST Type escape sequence to abort. Sending 10, 100-byte ICMP Echos to 172.16.52.28, timeout is 2 seconds: !!!!!!!!!! Success rate is 100 percent (10/10), round-trip min/avg/max = 1/1/2 ms Validating and Troubleshooting Installation of the Cisco IOS XR Software Package The Cisco IOS XR software is divided into software packages allowing you to select which features run on your router. Each package contains the components to perform a specific set of router functions, such as routing, security, or Modular Services Card (MSC) support. Bundles are groups of packages that can be downloaded as a set. For example, the Unicast Routing Core Bundle provides six packages for use on every router. This section provides information on how to validate and troubleshoot the Cisco IOS XR software package installation. The following sections are provided: • Verifying the Software Version, page 1-8 • Validating the Installation, page 1-10
  • 20. 1-8 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Validating and Troubleshooting Installation of the Cisco IOS XR Software Package Verifying the Software Version To verify the Cisco IOS XR software version, perform the following procedure. SUMMARY STEPS 1. show version 2. show install DETAILED STEPS The following example shows that the Cisco IOS XR software and active packages are version 4.0.0. RP/0/RSP0/CPU0:router# show version Cisco IOS XR Software, Version 4.0.0 Copyright (c) 2010 by cisco Systems, Inc. ROM: System Bootstrap, Version 1.04(20100216:021454) [ASR9K ROMMON], router uptime is 1 day, 18 hours, 34 minutes System image file is "bootflash:disk0/asr9k-os-mbi-4.0.0/mbiasr9k-rp.vm" cisco ASR9K Series (MPC8641D) processor with 4194304K bytes of memory. MPC8641D processor at 1333MHz, Revision 2.2 2 Management Ethernet Command or Action Purpose Step 1 show version Example: RP/0/RSP0/CPU0:router# show version Displays a variety of system information, including hardware and software version, router uptime, boot settings (configuration register), and active software. Determine if all expected packages are installed and the current software versions are the expected versions. If the expected packages are not installed or are not the expected version, install the correct package. See Cisco ASR 9000 Aggregation Series Router Getting Started Guide for information on installing and upgrading Cisco IOS XR software packages. Step 2 show install Example: RP/0/RSP0/CPU0:router# show install Displays a list of all installed and active packages on each node. Determine if the expected packages are installed on each node. If the software or active package versions are not as expected for a node, the package is not compatible with the node for which it is being activated, or the package being activated is not compatible with the current active software set, install the correct software or package on the node. See Cisco ASR 9000 Aggregation Series Router Getting Started Guide for information on installing and upgrading Cisco IOS XR software packages.
  • 21. 1-9 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Validating and Troubleshooting Installation of the Cisco IOS XR Software Package 12 DWDM controller(s) 12 TenGigE 40 GigabitEthernet 2 SONET/SDH 2 Packet over SONET/SDH 219k bytes of non-volatile configuration memory. 975M bytes of compact flash card. 33994M bytes of hard disk. 1605616k bytes of disk0: (Sector size 512 bytes). 1605616k bytes of disk1: (Sector size 512 bytes). Configuration register on node 0/RSP0/CPU0 is 0x0 Boot device on node 0/RSP0/CPU0 is disk0: Package active on node 0/RSP0/CPU0: asr9k-optics-supp, V 4.0.0[DT_IMAGE], Cisco Systems, at disk0:asr9k-optics-supp-4.0.0 Built on Wed Sep 8 16:17:30 DST 2010 By sjc5-gf-021 in /auto/ioxbuild8/production/4.0.0.DT_IMAGE/asr9k/workspace for pie asr9k-fwding, V 4.0.0[DT_IMAGE], Cisco Systems, at disk0:asr9k-fwding-4.0.0 Built on Wed Sep 8 16:12:40 DST 2010 By sjc5-gf-021 in /auto/ioxbuild8/production/4.0.0.DT_IMAGE/asr9k/workspace for pie asr9k-cpp, V 4.0.0[DT_IMAGE], Cisco Systems, at disk0:asr9k-cpp-4.0.0 Built on Wed Sep 8 16:13:28 DST 2010 By sjc5-gf-021 in /auto/ioxbuild8/production/4.0.0.DT_IMAGE/asr9k/workspace for pie asr9K-doc-supp, V 4.0.0[DT_IMAGE], Cisco Systems, at disk0:asr9K-doc-supp-4.0.0 Built on Wed Sep 8 16:16:57 DST 2010 By sjc5-gf-021 in /auto/ioxbuild8/production/4.0.0.DT_IMAGE/asr9k/workspace for pie asr9k-scfclient, V 4.0.0[DT_IMAGE], Cisco Systems, at disk0:asr9k-scfclient-4.0.0 Built on Wed Sep 8 16:13:26 DST 2010 --More-- . . . The following example shows that the Cisco IOS XR software and active packages are version 4.0.0. If there is an expected package missing or an active package is not an expected package, install and activate the missing package or upgrade the unexpected package to the appropriate package. See Cisco ASR 9000 Aggregation Services Router Router Getting Started Guide for details on installing, activating, and upgrading software packages. RP/0/RSP0/CPU0:router# show install Node 0/RSP0/CPU0 [RP] [SDR: Owner] Boot Device: disk0: Boot Image: /disk0/asr9k-os-mbi-4.0.0/mbiasr9k-rp.vm Active Packages: disk0:asr9k-mini-p-4.0.0 disk0:asr9k-optic-4.0.0 disk0:asr9k-doc-p-4.0.0 disk0:asr9k-k9sec-p-4.0.0 disk0:asr9k-video-p-4.0.0 disk0:asr9k-mpls-p-4.0.0 disk0:asr9k-mgbl-p-4.0.0 disk0:asr9k-mcast-p-4.0.0 Node 0/1/CPU0 [LC] [SDR: Owner] Boot Device: mem: Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm Active Packages: disk0:asr9k-mini-p-4.0.0
  • 22. 1-10 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Validating and Troubleshooting Installation of the Cisco IOS XR Software Package disk0:asr9k-optic-4.0.0 disk0:asr9k-video-p-4.0.0 disk0:asr9k-mpls-p-4.0.0 disk0:asr9k-mcast-p-4.0.0 Node 0/2/CPU0 [LC] [SDR: Owner] Boot Device: mem: Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm Active Packages: disk0:asr9k-mini-p-4.0.0 disk0:asr9k-optic-4.0.0 disk0:asr9k-video-p-4.0.0 disk0:asr9k-mpls-p-4.0.0 disk0:asr9k-mcast-p-4.0.0 Node 0/4/CPU0 [LC] [SDR: Owner] Boot Device: mem: Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm Active Packages: disk0:asr9k-mini-p-4.0.0 disk0:asr9k-optic-4.0.0 disk0:asr9k-video-p-4.0.0 disk0:asr9k-mpls-p-4.0.0 disk0:asr9k-mcast-p-4.0.0 Node 0/6/CPU0 [LC] [SDR: Owner] Boot Device: mem: Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm Active Packages: disk0:asr9k-mini-p-4.0.0 disk0:asr9k-optic-4.0.0 disk0:asr9k-video-p-4.0.0 disk0:asr9k-mpls-p-4.0.0 disk0:asr9k-mcast-p-4.0.0 Validating the Installation Validate the Cisco IOS XR software package installation to ensure the packages were installed correctly. The following commands are used to validate the currently installed software packages: • install verify Command, page 1-10 • show install active Command, page 1-12 • show install committed Command, page 1-14 install verify Command Use the install verify command to verify the consistency of a previously installed software set with the package file from which it originated. This command can be used as a debugging tool to verify the validity of the files that constitute the packages to determine if there are any corrupted files. The command is also used to check that the install infrastructure is up and running and to determine if all files are expected. If there are corrupted files, see Cisco ASR 9000 Aggregation Services Router Router Getting Started Guide for information on deactivating and removing software packages and adding and activating software packages.
  • 23. 1-11 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Validating and Troubleshooting Installation of the Cisco IOS XR Software Package Note The install verify command can take up to two minutes per package to process. Note The install verify command ignores secure domain router (SDR) boundaries and performs the operation in global scope. The following example shows the output of the install verify command. The output is used to verify the consistency of a previously installed software set with the package file from which it originated. RP/0/RSP0/CPU0:router(admin)# install verify Sat Sep 25 08:18:14.077 DST Install operation 3 '(admin) install verify packages' started by user_A 'dwolman-r' via CLI at 08:18:14 DST Sat Sep 25 2010. The install operation will continue asynchronously. RP/0/RSP0/CPU0:router(admin)#Info: This operation can take up to 2 minutes per package being verified. Info: Please be patient. Info: 0/0/CPU0 [LC] [SDR: Owner] Info: meta-data: [SUCCESS] Verification Successful. Info: /install/asr9k-optics-supp-4.0.0: [SUCCESS] Verification Info: Successful. Info: /install/asr9k-fwding-4.0.0: [SUCCESS] Verification Info: Successful. Info: /install/asr9k-cpp-4.0.0: [SUCCESS] Verification Successful. Info: /install/asr9k-scfclient-4.0.0: [SUCCESS] Verification Info: Successful. Info: /install/iosxr-video-adv-4.0.0: [SUCCESS] Verification Info: Successful. Info: /install/iosxr-mpls-4.0.0: [SUCCESS] Verification Successful. Info: /install/iosxr-mcast-4.0.0: [SUCCESS] Verification Info: Successful. Info: /install/iosxr-routing-4.0.0: [SUCCESS] Verification Info: Successful. Info: /install/iosxr-infra-4.0.0: [SUCCESS] Verification Info: Successful. Info: /install/iosxr-fwding-4.0.0: [SUCCESS] Verification Info: Successful. Info: /install/iosxr-diags-4.0.0: [SUCCESS] Verification Info: Successful. Info: /install/asr9k-adv-video-supp-4.0.0: [SUCCESS] Verification Info: Successful. Info: /install/asr9k-diags-supp-4.0.0: [SUCCESS] Verification Info: Successful. Info: /install/asr9k-mcast-supp-4.0.0: [SUCCESS] Verification Info: Successful. Info: /install/asr9k-base-4.0.0: [SUCCESS] Verification Successful. Info: 0/6/CPU0 [LC] [SDR: Owner] Info: meta-data: [SUCCESS] Verification Successful. Info: /install/asr9k-optics-supp-4.0.0: [SUCCESS] Verification Info: Successful. Info: /install/asr9k-fwding-4.0.0: [SUCCESS] Verification Info: Successful. Info: /install/asr9k-cpp-4.0.0: [SUCCESS] Verification Successful. Info: /install/asr9k-scfclient-4.0.0: [SUCCESS] Verification Info: Successful. Info: /install/iosxr-video-adv-4.0.0: [SUCCESS] Verification Info: Successful. Info: /install/iosxr-mpls-4.0.0: [SUCCESS] Verification Successful. Info: /install/iosxr-mcast-4.0.0: [SUCCESS] Verification
  • 24. 1-12 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Validating and Troubleshooting Installation of the Cisco IOS XR Software Package Info: Successful. Info: /install/iosxr-routing-4.0.0: [SUCCESS] Verification Info: Successful. Info: /install/iosxr-infra-4.0.0: [SUCCESS] Verification Info: Successful. Info: /install/iosxr-fwding-4.0.0: [SUCCESS] Verification Info: Successful. Info: /install/iosxr-diags-4.0.0: [SUCCESS] Verification Info: Successful. Info: /install/asr9k-adv-video-supp-4.0.0: [SUCCESS] Verification Info: Successful. Info: /install/asr9k-diags-supp-4.0.0: [SUCCESS] Verification Info: Successful. Info: /install/asr9k-mcast-supp-4.0.0: [SUCCESS] Verification Info: Successful. Info: /install/asr9k-base-4.0.0: [SUCCESS] Verification Successful. Info: 0/5/CPU0 [LC] [SDR: Owner] . . . Info: Verification Summary: Info: 0/0/CPU0: SUCCESSFUL. No anomalies found. Info: 0/6/CPU0: SUCCESSFUL. No anomalies found. Info: 0/5/CPU0: SUCCESSFUL. No anomalies found. Info: 0/7/CPU0: SUCCESSFUL. No anomalies found. Info: 0/1/CPU0: SUCCESSFUL. No anomalies found. Info: 0/4/CPU0: SUCCESSFUL. No anomalies found. Info: 0/2/CPU0: SUCCESSFUL. No anomalies found. Info: 0/RSP0/CPU0: SUCCESSFUL. No anomalies found. Info: The system needs no repair. Install operation 3 completed successfully at 08:19:48 DST Sat Sep 25 2010. show install active Command Use the show install active command to display active software packages. Verify that the command output matches the output of the show install committed command. If the output does not match, when you reload the router, the software displayed in the show install committed command output is the software that will be loaded. For example, the following output shows two different software package versions, one is the active version and the other is the committed version, so when the router reloads, the 3.9.1 version will be loaded even though 4.0.0 is the currently active version on 0/RSP0/CPU0. RP/0/RSP0/CPU0:router(admin)# show install active location 0/RSP0/cpu0 Node 0/RSP0/CPU0 [RP] [SDR: Owner] Boot Device: disk0: Boot Image: /disk0/asr9k-os-mbi-4.0.0/mbiasr9k-rp.vm << 4.0.0 is active, not committed Active Packages: disk0:asr9k-mini-p-4.0.0 disk0:asr9k-optic-4.0.0 disk0:asr9k-doc-p-4.0.0 disk0:asr9k-k9sec-p-4.0.0 disk0:asr9k-video-p-4.0.0 disk0:asr9k-mpls-p-4.0.0 disk0:asr9k-mgbl-p-4.0.0 disk0:asr9k-mcast-p-4.0.0 RP/0/RSP0/CPU0:router(admin)# show install committed location 0/RSP0/cpu0 Node 0/RSP0/CPU0 [RP] [SDR: Owner] Boot Device: disk0: Boot Image: /disk0/asr9k-os-mbi-3.9.1/mbiasr9k-rp.vm<< 3.9.1 is committed
  • 25. 1-13 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Validating and Troubleshooting Installation of the Cisco IOS XR Software Package Committed Packages: disk0:asr9k-mini-p-3.9.1 disk0:asr9k-optic-3.9.1 disk0:asr9k-doc-p-3.9.1 disk0:asr9k-k9sec-p-3.9.1 disk0:asr9k-video-p-3.9.1 disk0:asr9k-mpls-p-3.9.1 disk0:asr9k-mgbl-p-3.9.1 disk0:asr9k-mcast-p-3.9.1 If the expected active software packages are not displayed, install the packages (if required) and activate the packages. See Cisco ASR 9000 Aggregation Services Router Router Getting Started Guide for information on installing and activating Cisco IOS XR software packages. The following example output shows the active packages for all cards in a router. The output displays the disk on which each package is located. RP/0/RSP0/CPU0:router# show install active Node 0/RSP0/CPU0 [RP] [SDR: Owner] Boot Device: disk0: Boot Image: /disk0/asr9k-os-mbi-4.0.0/mbiasr9k-rp.vm Active Packages: disk0:asr9k-mini-p-4.0.0 disk0:asr9k-optic-4.0.0 disk0:asr9k-doc-p-4.0.0 disk0:asr9k-k9sec-p-4.0.0 disk0:asr9k-video-p-4.0.0 disk0:asr9k-mpls-p-4.0.0 disk0:asr9k-mgbl-p-4.0.0 disk0:asr9k-mcast-p-4.0.0 Node 0/0/CPU0 [LC] [SDR: Owner] Boot Device: mem: Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm Active Packages: disk0:asr9k-mini-p-4.0.0 disk0:asr9k-optic-4.0.0 disk0:asr9k-video-p-4.0.0 disk0:asr9k-mpls-p-4.0.0 disk0:asr9k-mcast-p-4.0.0 Node 0/1/CPU0 [LC] [SDR: Owner] Boot Device: mem: Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm Active Packages: disk0:asr9k-mini-p-4.0.0 disk0:asr9k-optic-4.0.0 disk0:asr9k-video-p-4.0.0 disk0:asr9k-mpls-p-4.0.0 disk0:asr9k-mcast-p-4.0.0 Node 0/2/CPU0 [LC] [SDR: Owner] Boot Device: mem: Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm Active Packages: disk0:asr9k-mini-p-4.0.0 disk0:asr9k-optic-4.0.0 disk0:asr9k-video-p-4.0.0 disk0:asr9k-mpls-p-4.0.0 disk0:asr9k-mcast-p-4.0.0 Node 0/4/CPU0 [LC] [SDR: Owner] Boot Device: mem:
  • 26. 1-14 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Validating and Troubleshooting Installation of the Cisco IOS XR Software Package Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm Active Packages: disk0:asr9k-mini-p-4.0.0 disk0:asr9k-optic-4.0.0 disk0:asr9k-video-p-4.0.0 disk0:asr9k-mpls-p-4.0.0 disk0:asr9k-mcast-p-4.0.0 Node 0/5/CPU0 [LC] [SDR: Owner] Boot Device: mem: Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm Active Packages: disk0:asr9k-mini-p-4.0.0 disk0:asr9k-optic-4.0.0 disk0:asr9k-video-p-4.0.0 disk0:asr9k-mpls-p-4.0.0 disk0:asr9k-mcast-p-4.0.0 Node 0/6/CPU0 [LC] [SDR: Owner] Boot Device: mem: Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm Active Packages: disk0:asr9k-mini-p-4.0.0 disk0:asr9k-optic-4.0.0 disk0:asr9k-video-p-4.0.0 disk0:asr9k-mpls-p-4.0.0 disk0:asr9k-mcast-p-4.0.0 Node 0/7/CPU0 [LC] [SDR: Owner] Boot Device: mem: Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm Active Packages: disk0:asr9k-mini-p-4.0.0 disk0:asr9k-optic-4.0.0 disk0:asr9k-video-p-4.0.0 disk0:asr9k-mpls-p-4.0.0 The output shows the name of the disk on which the packages are located. In the above example, the active packages for each node are on disk0, and for all nodes, the composite package asr9k-os-mbi-4.0.0 is active. Additional packages shown are optional packages that have been activated after the initial loading of the Cisco ASR 9000 Aggregation Series Router Unicast Routing Core Bundle. show install committed Command Use the show install committed command to display committed software packages. The committed software packages are the software packages that will be booted on a router reload. Committed packages are the packages that are persistent across router reloads. If you install and activate a package, it remains active until the next router reload. If you commit a package set, all packages in that set remain active across router reloads until the package set is replaced with another committed package set. The show install committed command is useful to ensure software is installed and committed after a router reload. If the expected software is not installed and committed, see Cisco ASR 9000 Aggregation Services Router Getting Started Guide for information on installing and committing Cisco IOS XR software packages. The following command output shows the committed software packages on all cards in the router. The output displays the disk on which each package is located. RP/0/RSP0/CPU0:router# show install committed Node 0/RSP0/CPU0 [RP] [SDR: Owner]
  • 27. 1-15 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Validating and Troubleshooting Installation of the Cisco IOS XR Software Package Boot Device: disk0: Boot Image: /disk0/asr9k-os-mbi-4.0.0/mbiasr9k-rp.vm Committed Packages: disk0:asr9k-mini-p-4.0.0 disk0:asr9k-optic-4.0.0 disk0:asr9k-doc-p-4.0.0 disk0:asr9k-k9sec-p-4.0.0 disk0:asr9k-video-p-4.0.0 disk0:asr9k-mpls-p-4.0.0 disk0:asr9k-mgbl-p-4.0.0 disk0:asr9k-mcast-p-4.0.0 Node 0/0/CPU0 [LC] [SDR: Owner] Boot Device: mem: Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm Committed Packages: disk0:asr9k-mini-p-4.0.0 disk0:asr9k-optic-4.0.0 disk0:asr9k-video-p-4.0.0 disk0:asr9k-mpls-p-4.0.0 disk0:asr9k-mcast-p-4.0.0 Node 0/1/CPU0 [LC] [SDR: Owner] Boot Device: mem: Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm Committed Packages: disk0:asr9k-mini-p-4.0.0 disk0:asr9k-optic-4.0.0 disk0:asr9k-video-p-4.0.0 disk0:asr9k-mpls-p-4.0.0 disk0:asr9k-mcast-p-4.0.0 Node 0/2/CPU0 [LC] [SDR: Owner] Boot Device: mem: Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm Committed Packages: disk0:asr9k-mini-p-4.0.0 disk0:asr9k-optic-4.0.0 disk0:asr9k-video-p-4.0.0 disk0:asr9k-mpls-p-4.0.0 disk0:asr9k-mcast-p-4.0.0 Node 0/4/CPU0 [LC] [SDR: Owner] Boot Device: mem: Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm Committed Packages: disk0:asr9k-mini-p-4.0.0 disk0:asr9k-optic-4.0.0 disk0:asr9k-video-p-4.0.0 disk0:asr9k-mpls-p-4.0.0 disk0:asr9k-mcast-p-4.0.0 Node 0/5/CPU0 [LC] [SDR: Owner] Boot Device: mem: Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm Committed Packages: disk0:asr9k-mini-p-4.0.0 disk0:asr9k-optic-4.0.0 disk0:asr9k-video-p-4.0.0 disk0:asr9k-mpls-p-4.0.0 disk0:asr9k-mcast-p-4.0.0 Node 0/6/CPU0 [LC] [SDR: Owner] Boot Device: mem:
  • 28. 1-16 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Validating and Troubleshooting Cisco IOS XR Software Configuration Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm Committed Packages: disk0:asr9k-mini-p-4.0.0 disk0:asr9k-optic-4.0.0 disk0:asr9k-video-p-4.0.0 disk0:asr9k-mpls-p-4.0.0 disk0:asr9k-mcast-p-4.0.0 Node 0/7/CPU0 [LC] [SDR: Owner] Boot Device: mem: Boot Image: /disk0/asr9k-os-mbi-4.0.0/lc/mbiasr9k-lc.vm Committed Packages: disk0:asr9k-mini-p-4.0.0 disk0:asr9k-optic-4.0.0 disk0:asr9k-video-p-4.0.0 disk0:asr9k-mpls-p-4.0.0 disk0:asr9k-mcast-p-4.0.0 The output shows the name of the disk on which the packages are located. In the above example, the committed packages for each node are on disk0, and for all nodes, the composite package asr9k-os-mbi-4.0.0 is committed. Additional packages shown are optional packages that have been committed after the initial loading of the Cisco ASR 9000 Aggregation Series Router Unicast Routing Core Bundle. Validating and Troubleshooting Cisco IOS XR Software Configuration Validating the Cisco IOS XR software configuration includes collecting configuration information on the router to determine configuration changes and verifying the current running configuration. When a configuration fails during a commit, the failed configuration can be viewed to help determine why the configuration was not committed. The following sections are provided: • Local and Global Configurations, page 1-16 • Collecting Configuration Information, page 1-19 • Verifying the Running Configuration, page 1-20 • Using the show configuration failed Command, page 1-24 Local and Global Configurations To troubleshoot configurations, you need to determine whether the problem is in the local configuration or the shared (global) configuration. • The local configuration is specific to the individual LC or RP to which it belongs. Every LC and RP has a data store containing the local data for that node, including configuration and operational data for the local interfaces. An example of a local configuration is the port designations on a particular LC. • The shared (global) configuration applies to the entire router, and is shared with all of the LCs and RPs. An example of a shared configuration is the routing protocol parameters. To view the local configuration, use the show running-config interface * command. The output displays all the configured interfaces on the node.
  • 29. 1-17 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Validating and Troubleshooting Cisco IOS XR Software Configuration RP/0/RSP0/CPU0:router# show running-config interface * interface Bundle-Ether16 description Connect to router-S Port-Ch 16 mtu 9216 bundle maximum-active links 1 ! interface Bundle-Ether16.160 l2transport description Connect to router-S Port-Ch 16 Service Instance 160 encapsulation dot1q 160 ! . . . ! interface Loopback0 ipv4 address 10.144.144.144 255.255.255.255 ! interface tunnel-ip10 ! interface tunnel-te44190 description Primary GE Tunnel from router-S to router-T ipv4 unnumbered Loopback0 priority 0 0 autoroute announce signalled-bandwidth 100000 destination 10.19.19.19 fast-reroute record-route path-option 1 explicit name Primary_GE_Path_to_router-T ospf 100 area 0 ! . . . interface MgmtEth0/RSP0/CPU0/0 description Connected to LAN ipv4 address 172.29.52.137 255.255.255.0 ! interface MgmtEth0/RSP0/CPU0/1 shutdown ! interface GigabitEthernet0/0/0/0 shutdown ! interface GigabitEthernet0/0/0/1 shutdown ! interface GigabitEthernet0/0/0/2 shutdown ! . . . interface TenGigE0/7/0/1 shutdown ! interface TenGigE0/7/0/2 shutdown ! interface TenGigE0/7/0/3 shutdown ! interface POS0/2/0/0 description Connected to PE_router-2 POS 0/2/0/0
  • 30. 1-18 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Validating and Troubleshooting Cisco IOS XR Software Configuration ! interface POS0/2/0/1 description Connected to PE_router-3 POS 0/2/0/1 ! controller SONET0/2/0/0 clock source internal ! controller SONET0/2/0/1 clock source internal ! Use the show sysdb trace commands to display the contents of the system database after a configuration change. The trace information includes a history of any changes to the running configuration. You can specify either a local node or the shared plane. The following example output shows the contents of the local database, that is, for a specific location (node): RP/0/RSP0/CPU0:router# show sysdb trace verification location 0/5/cpu0 reverse . . . Timestamp nid reqid jid tid reg_hndl connid action path 432 wrapping entries (8192 possible, 158 filtered, 590 total) Sep 23 04:35:39.969 0/RSP0/CPU0 8168 354 1 94 4483 apply reply '--' Sep 23 04:35:39.960 0/RSP0/CPU0 8168 354 1 94 4505 Apply called 'cfg/if/act/tunnel-ip10/v' Sep 23 04:35:39.960 0/RSP0/CPU0 8168 354 1 94 4505 verify reply: accept '--' Sep 23 04:35:39.685 0/RSP0/CPU0 8168 354 1 94 4505 Verify called 'cfg/if/act/tunnel-ip10/v' Sep 23 04:35:39.678 0/RSP0/CPU0 0 354 1 94 4505 register 'cfg/if/act/tunnel-ip[0-9]*/mtu/tunnel-ip' Sep 23 04:35:39.678 0/RSP0/CPU0 0 354 1 94 4505 register 'cfg/if/act/tunnel-ip[0-9]*/im/bw' Sep 23 04:35:39.678 0/RSP0/CPU0 0 354 1 94 4505 register 'cfg/if/act/tunnel-ip[0-9]*/tunl_gre/keepalive' Sep 23 04:35:39.678 0/RSP0/CPU0 0 354 1 94 4505 register 'cfg/if/act/tunnel-ip[0-9]*/tunl_gre/dfbit_disable' Sep 23 04:35:39.678 0/RSP0/CPU0 0 354 1 94 4505 register 'cfg/if/act/tunnel-ip[0-9]*/tunl_gre/ttl' Sep 23 04:35:39.678 0/RSP0/CPU0 0 354 1 94 4505 register 'cfg/if/act/tunnel-ip[0-9]*/tunl_gre/tos' Sep 23 04:35:39.678 0/RSP0/CPU0 0 354 1 94 4505 register 'cfg/if/act/tunnel-ip[0-9]*/tunl_gre/mode' . . . The following example output shows the contents of the shared database, that is, the configuration data that is shared with all LC and RP in the router: RP/0/RSP0/CPU0:router# show sysdb trace verification shared-plane reverse Config Shared Server ==================== Timestamp nid reqid jid tid reg_hndl connid action path 2259 wrapping entries (4096 possible, 0 filtered, 2259 total)
  • 31. 1-19 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Validating and Troubleshooting Cisco IOS XR Software Configuration Sep 23 19:34:40.202 0/3/CPU0 0 241 8 384 1430 unregister 'from-' Sep 23 19:34:40.197 0/3/CPU0 0 241 15 385 1434 unregister 'from-' Sep 23 19:34:40.196 0/3/CPU0 0 163 1 386 1440 unregister 'from-' Sep 23 19:14:45.076 0/3/CPU0 0 163 1 386 1440 register 'cfg/gl/ipv4/cef/hardware/forwarding/update/synchronous' Sep 23 19:14:41.679 0/3/CPU0 0 241 15 385 1434 register 'cfg/gl/dbgtrace/node/831/' Sep 23 19:14:41.593 0/3/CPU0 0 241 8 384 1430 register 'cfg/gl/dbgtrace/node/831/' Sep 23 19:12:36.472 0/3/CPU0 0 241 8 381 1375 unregister 'from-' Sep 23 19:12:36.471 0/3/CPU0 0 241 15 382 1378 unregister 'from-' Sep 23 19:12:36.470 0/3/CPU0 0 163 1 383 1383 unregister 'from-' Sep 23 19:07:56.914 0/3/CPU0 0 163 1 383 1383 register 'cfg/gl/ipv4/cef/hardware/forwarding/update/synchronous' . . . The show processes location node-id | include sysdb command displays all active database processes for a specified node. RP/0/RSP0/CPU0:router# show process location 0/1/CPU0 | include sysdb Thu Nov 4 14:06:30.191 DST 279 1 0 56K 10 Sigwaitinfo 739:28:22:0145 0:00:00:0057 sysdb_svr_local 279 2 1 56K 10 Receive 0:00:00:0779 0:00:02:0459 sysdb_svr_local 279 3 1 56K 10 Receive 0:03:34:0474 0:00:03:0285 sysdb_svr_local 279 4 1 56K 10 Receive 0:05:03:0006 0:00:02:0368 sysdb_svr_local 277 1 0 64K 10 Sigwaitinfo 739:28:21:0305 0:00:00:0046 sysdb_mc 277 2 0 64K 10 Receive 739:28:21:0274 0:00:00:0003 sysdb_mc 277 3 1 64K 10 Receive 166:59:14:0698 0:00:00:0038 sysdb_mc 277 4 1 64K 10 Receive 0:01:49:0941 0:00:00:0106 sysdb_mc 277 6 1 64K 10 Receive 739:15:22:0734 0:00:00:0058 sysdb_mc See Chapter 1, “General Troubleshooting Procedures” for additional information on troubleshooting processes. Collecting Configuration Information Collecting configuration information allows you to determine if changes to the system have occurred. It also allows you to determine if these changes could impact the system. The following commands allow you to determine if there was an unknown commit, if there was a commit that overwrote a previous configuration, or there are configuration changes that should be removed from the running configuration. • show configuration commit changes {[since] commit-id | last number-of-commits} [diff]—the command output displays changes made to the running configuration by previous configuration commits. RP/0/RSP0/CPU0:router# show configuration commit changes since 1000000319 Wed May 17 09:30:27.877 UTC Building configuration... no logging console no domain ipv4 host ce1 no domain ipv4 host ce2 domain ipv4 host ce6 172.29.52.73 domain ipv4 host ce7 172.29.52.78
  • 32. 1-20 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Validating and Troubleshooting Cisco IOS XR Software Configuration no domain ipv4 host pe1 no domain ipv4 host pe2 domain ipv4 host pe6 172.29.52.128 domain ipv4 host pe7 172.29.52.182 interface GigabitEthernet0/1/5/1 no negotiation ! end • show configuration commit list [number-of-commits] [detail]—the command output displays a list of the commit IDs (up to 100) available for rollback. RP/0/RSP0/CPU0:router# show configuration commit list Wed May 17 09:31:21.727 UTC SNo. Label/ID User Line Client Time Stamp ~~~~ ~~~~~~~~ ~~~~ ~~~~ ~~~~~~ ~~~~~~~~~~ 1 1000000324 userA vty0 CLI 16:50:33 UTC Wed May 10 2006 2 1000000323 userA vty0 CLI 16:49:51 UTC Wed May 10 2006 3 1000000322 userB vty0 CLI 16:48:05 UTC Wed May 10 2006 4 1000000321 userC vty2 CLI 19:11:26 UTC Wed May 03 2006 5 1000000320 userA vty2 CLI 19:10:45 UTC Wed May 03 2006 6 1000000319 userB vty2 CLI 18:03:01 UTC Wed May 03 2006 7 1000000318 userB vty2 CLI 18:02:43 UTC Wed May 03 2006 8 1000000317 userB vty2 CLI 18:02:38 UTC Wed May 03 2006 9 1000000316 userC vty2 CLI 17:59:16 UTC Wed May 03 2006 10 1000000315 userC vty2 CLI 17:46:38 UTC Wed May 03 2006 11 1000000314 userA vty2 CLI 15:40:04 UTC Wed May 03 2006 12 1000000313 userA vty2 CLI 13:05:09 UTC Wed May 03 2006 13 1000000312 userD con0_RSP0_C CLI 13:49:31 UTC Mon May 01 2006 • commit confirmed minutes (executed from config mode)—This command commits the configuration on a trial basis for a minimum of 30 seconds and a maximum of 300 seconds (5 minutes). During the trial configuration period, enter commit to confirm the configuration. If commit is not entered, then the system will revert to the previous configuration when the trial time period expires. Verifying the Running Configuration To verify the running configuration, perform the following procedure. SUMMARY STEPS 1. configure 2. show running-config 3. describe hostname hostname 4. end 5. show sysdb trace verification shared-plane | include path 6. show sysdb trace verification location node-id 7. show cfgmgr trace 8. show configuration history commit 9. show configuration commit changes {last | since | commit-id}
  • 33. 1-21 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Validating and Troubleshooting Cisco IOS XR Software Configuration 10. show config failed startup 11. cfs check DETAILED STEPS Command or Action Purpose Step 1 configure Example: RP/0/RSP0/CPU0:router# configure Enters global configuration mode. Step 2 show running-config Example: RP/0/RSP0/CPU0:router(config)# show running-config Displays the contents of the running configuration. Verify that the running configuration is as expected. Step 3 describe hostname hostname Example: RP/0/RSP0/CPU0:router(config)# describe hostname router_A Determines the path. Step 4 end Example: RP/0/RSP0/CPU0:router(config)# end Saves configuration changes. • When you issue the end command, the system prompts you to commit changes: Uncommitted changes found, commit them before exiting(yes/no/cancel)? [cancel]: – Entering yes saves configuration changes to the running configuration file, exits the configuration session, and returns the router to EXEC mode. – Entering no exits the configuration session and returns the router to EXEC mode without committing the configuration changes. – Entering cancel leaves the router in the current configuration session without exiting or committing the configuration changes.
  • 34. 1-22 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Validating and Troubleshooting Cisco IOS XR Software Configuration Examples The following example shows the output of the show running-config command: RP/0/RSP0/CPU0:router# show running-config Building configuration... !! IOS XR Configuration 4.0.1.10I !! Last configuration change at Thu Sep 23 04:35:38 2010 by user_A ! hostname router . Step 5 show sysdb trace verification shared-plane | include path Example: RP/0/RSP0/CPU0:router# show sysdb trace verification shared-plane | include gl/a/hostname Displays details of recent verification sysDB transactions and changes on the shared plane allowing you to verify whether the configuration was verified correctly. Specifying the path filters the data to display only the sysDB path for the router. Verify that changes to the SysDB were verified and accepted. Step 6 show sysdb trace verification location node-id Example: RP/0/RSP0/CPU0:router# show sysdb trace verification location 0/3/CPU0 Displays details of recent verification sysDB transactions and changes on local plane configurations. Verify that changes to the SysDB were verified and accepted. Step 7 show cfgmgr trace Example: RP/0/RSP0/CPU0:router# show cfgmgr trace Displays cfgmgr trace information. Step 8 show configuration history commit Example: RP/0/RSP0/CPU0:router# show configuration history commit Displays a list of historical changes to the configuration. Verify that the timeline of changes is as expected. Step 9 show configuration commit changes {last | since | commit-id} Example: RP/0/RSP0/CPU0:router# show configuration commit changes last 15 Displays detailed committed configuration history information. Verify that the history information is as expected. Step 10 show configuration failed startup Example: RP/0/RSP0/CPU0:router# show configuration failed startup Displays information on any configurations that failed during startup. Step 11 cfs check Example: RP/0/RSP0/CPU0:router# cfs check Checks the current configuration to see if there are any missing configurations. Command or Action Purpose
  • 35. 1-23 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Validating and Troubleshooting Cisco IOS XR Software Configuration . . logging suppress duplicates telnet vrf default ipv4 server max-servers 100 domain name cisco.com domain lookup disable taskgroup default ! . . . interface preconfigure GigabitEthernet0/3/0/7 shutdown ! interface preconfigure GigabitEthernet0/3/0/8 shutdown ! interface preconfigure GigabitEthernet0/3/0/9 shutdown ! interface preconfigure GigabitEthernet0/3/0/10 shutdown ! . . . The output is used to determine if the configuration is as expected. In the following example, the path to SysDB where the configuration is stored in the database is displayed. RP/0/RSP0/CPU0:router(config)# describe hostname router Package: iosxr-infra iosxr-infra V4.0.0 IOS-XR Infra Package Definition Vendor : Cisco Systems Desc : IOS-XR Infra Package Definition Build : Built on Wed Sep 8 16:07:48 DST 2010 Source : By sc-g-01 in /auto/ioxbuild8/production/4.0.0/asr9k/workspace for pie Card(s): RP, NP24-4x10GE, NP24-40x1GE, NP40-40x1GE, NP40-4x10GE, NP40-8x10GE, NP40-2_20_COMBO, NP80-8x10GE, NP80-16x10GE, A9K-SIP-700, A9K-SIP-500 Restart information: Default: parallel impacted processes restart Size Compressed/Uncompressed: 38MB/85MB (44%) Component: shellutil V[ci-401/7] Common shell utility applications User needs ALL of the following taskids: host-services (READ) or root-lr (READ WRITE) It will take the following actions: Create/Set the configuration item: Path: gl/a/hostname Value: router
  • 36. 1-24 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Validating and Troubleshooting Cisco IOS XR Software Configuration Using the show configuration failed Command Use the show configuration failed command to browse a failed configuration. The configuration can be classified as failed during startup or during a configuration commit. • Startup Failed Configuration, page 1-24 • Commit Configuration Failed, page 1-25 Startup Failed Configuration A configuration can be classified as failed during startup for three reasons: • Syntax errors Syntax errors are generated by the parser and usually indicate that there is an incompatibility with the CLI commands. Correct the syntax errors and reapply the configuration. A syntax error can be an invalid CLI entry or a CLI syntax change. See the “Obtaining Documentation and Submitting a Service Request” section on page xii in the Preface for information on obtaining Cisco IOS XR software CLI documentation. • Semantic errors Semantic errors are generated by the backend components when the configuration is being restored by the configuration manager during startup of the router. Semantic errors include logical problems (invalid logic). • Apply errors Apply errors are generated when a configuration has been successfully verified and accepted as part of running configuration but the backend component is not able to update its operational state. The configuration shows both as the running configuration (since it was correctly verified) and as a failed configuration because of the backend operational error. To find the component apply owner, use the describe on the CLI that failed to be applied. Note You may browse startup failed configurations for up to the previous four router reloads. Use the show configuration failed startup command and the load configuration failed startup command to browse and reapply any failed configuration. The load configuration failed startup command can be used in configuration mode to load the failed startup configuration into the target configuration session, then the configuration can be modified and committed. See Cisco ASR 9000 Aggregation Services Router Router Getting Started Guide for information on committing a configuration. RP/0/RSP0/CPU0:router# show configuration failed startup !! CONFIGURATION FAILED DUE TO SYNTAX/AUTHORIZATION ERRORS telnet vrf default ipv4 server max-servers 5 interface POS0/7/0/3 router static address-family ipv4 unicast 0.0.0.0/0 172.18.189.1 !! CONFIGURATION FAILED DUE TO SEMANTIC ERRORS router bgp 217 !!% Process did not respond to sysmgr ! RP/0/RSP0/CPU0:router# RP/0/RSP0/CPU0:router# config
  • 37. 1-25 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Validating and Troubleshooting Cisco IOS XR Software Configuration RP/0/RSP0/CPU0:router(config)# load config failed startup noerror Loading. 263 bytes parsed in 1 sec (259)bytes/sec RP/0/RSP0/CPU0:mike3(config-bgp)#show configuration Building configuration... telnet vrf default ipv4 server max-servers 5 router static address-family ipv4 unicast 0.0.0.0/0 172.18.189.1 ! ! router bgp 217 ! end The failed configuration is loaded into the target configuration, minus the errors that caused the startup configuration to fail. RP/0/RSP0/CPU0:router(config-bgp)# commit Use the show configuration failed command to display failed items in the last configuration commit, including reasons for the error. In any mode, the configuration failures from the most recent commit operation are displayed. The show configuration failed command can be used in EXEC mode and configuration mode. The command is used in EXEC mode when the configuration does not load during startup. The command is used in configuration mode to display information when a commit fails. The following example shows the show configuration failed command. RP/0/RSP0/CPU0:router(config)# interface pos 0/6/0/4 RP/0/RSP0/CPU0:router(config-if)# no vrf RP/0/RSP0/CPU0:router(config-if)# commit % Failed to commit one or more configuration items during an atomic operation, no changes have been made. Please use 'show configuration failed' to view the errors RP/0/RSP0/CPU0:router(config-if)# exit RP/0/RSP0/CPU0:router(config)# show configuration failed Wed May 2 13:14:08.426 EST EDT !! CONFIGURATION FAILED DUE TO SEMANTIC ERRORS interface POS0/6/0/4 no vrf !! % The interface's numbered and unnumbered IPv4/IPv6 addresses must be removed prior to changing or deleting the VRF ! Note The show configuration failed command in configuration mode only exists as long as the configuration session is active. Once you exit configuration mode, the command cannot be used to display the failed configuration. Commit Configuration Failed The following example shows an invalid task ID configuration that fails to commit. The show configuration failed command provides information on why the configuration failed. RP/0/RSP0/CPU0:router(config)# taskgroup isis RP/0/RSP0/CPU0:router(config-tg)# commit % Failed to commit one or more configuration items during an atomic operation, s RP/0/RSP0/CPU0:router(config-tg)# show configuration failed
  • 38. 1-26 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Verifying the System !! CONFIGURATION FAILED DUE TO SEMANTIC ERRORS taskgroup isis !!% Usergroup/Taskgroup names cannot be taskid names ! If a configuration commit fails, do not exit configuration mode (return to EXEC mode) as you will not be able to view the failed configuration. RP/0/RSP0/CPU0:router# configure RP/0/RSP0/CPU0:router(config)# taskgroup bgp RP/0/RSP0/CPU0:router(config-tg)# end Uncommitted changes found, commit them before exiting(yes/no/cancel)? [cancel]:y % Failed to commit one or more configuration items during an atomic operation, s RP/0/RSP0/CPU0:router(config)# exit Uncommitted changes found, commit them before exiting(yes/no/cancel)? [cancel]:n RP/0/RSP0/CPU0:router# show configuration failed RP/0/RSP0/CPU0:router# Verifying the System To verify the general status and state of a router using Cisco IOS XR software, perform the following procedure. SUMMARY STEPS 1. admin 2. show platform [node-id] 3. show version 4. show running-config 5. show logging 6. show environment 7. show context 8. exit 9. show context 10. show memory summary detail location all 11. show memory heap summary {job-id | all} 12. top processes 13. show running-config 14. show system verify start show system verify report 15. show {ipv4 | ipv6} interface brief
  • 39. 1-27 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Verifying the System DETAILED STEPS Command or Action Purpose Step 1 admin Example: RP/0/RSP0/CPU0:router# admin Enters administration mode. Step 2 show platform [node-id] Example: RP/0/RSP0/CPU0:router(admin)# show platform Displays information about the status of cards and modules installed in the router. • Some cards support a CPU module and service processor (SP) module. Other cards support only a single module. • A card module is also called a node. When all nodes are working properly, the status of each node displayed in the State column is IOS-XR RUN. • If you run the command without a node-id (show platform as shown in the example), the output will include all nodes in the system. • Type the show platform node-id command to display information for a specific node. Replace node-id with a node name from the show platform command Node column. Step 3 show version Example: RP/0/RSP0/CPU0:router(admin)# show version Displays information about the router, including image names, uptime, and other system information. Verify that the expected software version and images are installed. Step 4 show running-config Example: RP/0/RSP0/CPU0:router(admin)# show running-config Displays all of the nondefault commands currently running, including hardware module power status, secure domain router (SDR) configuration, and fabric configuration. The output also displays the users defined in administration mode with root-system access. Verify that the serial numbers for the nodes in the current running configuration are what you expected. The expected rack numbers and serial numbers should be listed in the current system documentation. See the “Prerequisite Documentation for Troubleshooting” section on page 1-1. Also verify that the hardware module power status is as expected and the SDR and fabric configurations are as expected. Step 5 show logging Example: RP/0/RSP0/CPU0:router(admin)# show logging Displays all syslog messages stored in the buffer. The command output displays the device operation history from a system perspective. Analyze the logged events and their order of happening. Check for anything out of the ordinary such as errors, tracebacks, or crashes. Also check for any Severity 1 or Severity 2 errors.
  • 40. 1-28 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Verifying the System Step 6 show environment Example: RP/0/RSP0/CPU0:router(admin)# show environment Displays environmental monitor parameters for the system. Verify that the parameters are as expected. Step 7 show context Example: RP/0/RSP0/CPU0:router(admin)# show context Displays core dump context information on fabric cards, alarm modules, fan controllers, and service processors (system-owned cards). See the “show context Command” section on page 1-50 for more information on the show context command output. Step 8 exit Example: RP/0/RSP0/CPU0:router(admin)# exit Exits administration mode. Step 9 show context Example: RP/0/RSP0/CPU0:router# show context Displays core dump context information on CPUs responsible for routing and Cisco Express Forwarding (CEF). See the “show context Command” section on page 1-50 for more information on the show context command output. Step 10 show memory summary detail location all Example: RP/0/RSP0/CPU0:router# show memory summary detail location all Displays information about the memory available on the router after the system image decompresses and loads. Verify that the expected memory is available or installed. Ensure that all memory regions have adequate free space available. Step 11 show memory heap summary {job-id | all} Example: RP/0/RSP0/CPU0:router# show memory heap summary all Displays a summary of the information about the heap space. The output displays each process and the amount of memory allocated for each process. Note The job-id is the output of the show processes command. Verify if there are any processes using a large amount of memory. Step 12 top processes Example: RP/0/RSP0/CPU0:router# top processes Press q to exit the command. Provides a live update of process resource consumption. Press ‘M’ to sort by memory usage. Verify that the resource consumption is as expected. Step 13 show running-config Example: RP/0/RSP0/CPU0:router# show running-config Displays the contents of the currently running configuration. Verify that the contents of the current running configuration are what you expected. Command or Action Purpose
  • 41. 1-29 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Verifying the System Examples The output from the show platform command indicates that all expected nodes are in the run state. If all nodes in the system are active, the cards should be in the IOS XR RUN and the SPAs should be in the OK state. The example output shows that all expected nodes are in the run state. RP/0/RSP0/CPU0:router(admin)# show platform Node Type State Config State ----------------------------------------------------------------------------- 0/RSP0/CPU0 A9K-RSP-4G(Active) IOS XR RUN PWR,NSHUT,MON 0/FT0/SP FAN TRAY READY 0/FT1/SP FAN TRAY READY 0/1/CPU0 A9K-40GE-B IOS XR RUN PWR,NSHUT,MON 0/2/CPU0 A9K-SIP-700 IOS XR RUN PWR,NSHUT,MON 0/2/0 SPA-2XOC48POS/RPR OK PWR,NSHUT,MON 0/3/CPU0 A9K-2T20GE-B IN-RESET PWR,NSHUT,MON 0/4/CPU0 A9K-8T/4-B IOS XR RUN PWR,NSHUT,MON 0/6/CPU0 A9K-4T-B IOS XR RUN PWR,NSHUT,MON 0/PM0/SP A9K-3KW-AC READY PWR,NSHUT,MON 0/PM1/SP A9K-3KW-AC READY PWR,NSHUT,MON 0/PM2/SP A9K-3KW-AC READY PWR,NSHUT,MON The output from the show version command indicates the version of software being run on the nodes and from which location (disk or network). Check that the expected software version and images are installed. The example output shows that the Cisco IOS XR software version is 4.0.0 and that the installed pie versions are also 4.0.0. RP/0/RSP0/CPU0:router(admin)# show version Cisco IOS XR Software, Version 4.0.0[Default] Copyright (c) 2010 by Cisco Systems, Inc. ROM: System Bootstrap, Version 1.04(20100216:021454) [ASR9K ROMMON], Step 14 show system verify start show system verify report Example: RP/0/RSP0/CPU0:router# show system verify start RP/0/RSP0/CPU0:router# show system verify report A two-step command that produces system reports. • show system verify start—Starts the system verify process (creates the initial baseline file) • show system verify report—Generates a report for the system verification process (report of the current status) The output of the show system verify report command provides a comparison of the system at the time of the show system verify start snapshot and the show system verify report snapshot. The output provides a sanity check of the system provided the show system verify start system snapshot was taken when the system was healthy or before an event. Verify that the system parameters are as expected. Step 15 show (ipv4 | ipv6} interface brief Example: RP/0/RSP0/CPU0:router# show ipv4 interface brief Displays the usability status of interfaces. Verify that all expected interfaces are listed, that they have the correct assigned address, and that they are in the expected states. Command or Action Purpose
  • 42. 1-30 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Verifying the System router uptime is 1 day, 15 hours, 53 minutes System image file is "bootflash:disk0/asr9k-os-mbi-4.0.0/mbiasr9k-rp.vm" cisco ASR9K Series (MPC8641D) processor with 4194304K bytes of memory. MPC8641D processor at 1333MHz, Revision 2.2 2 Management Ethernet 12 DWDM controller(s) 12 TenGigE 40 GigabitEthernet 2 SONET/SDH 2 Packet over SONET/SDH 219k bytes of non-volatile configuration memory. 975M bytes of compact flash card. 33994M bytes of hard disk. 1605616k bytes of disk0: (Sector size 512 bytes). 1605616k bytes of disk1: (Sector size 512 bytes). Configuration register on node 0/RSP0/CPU0 is 0x102 Boot device on node 0/RSP0/CPU0 is disk0: Package active on node 0/RSP0/CPU0: asr9k-optics-supp, V 4.0.0[DT_IMAGE], Cisco Systems, at disk0:asr9k-optics-supp-4.0.0 Built on Wed Sep 8 16:17:30 DST 2010 By sjc5-gf-021 in /auto/ioxbuild8/production/4.0.0.DT_IMAGE/asr9k/workspace for pie asr9k-fwding, V 4.0.0[DT_IMAGE], Cisco Systems, at disk0:asr9k-fwding-4.0.0 Built on Wed Sep 8 16:12:40 DST 2010 By sjc5-gf-021 in /auto/ioxbuild8/production/4.0.0.DT_IMAGE/asr9k/workspace for pie asr9k-cpp, V 4.0.0[DT_IMAGE], Cisco Systems, at disk0:asr9k-cpp-4.0.0 Built on Wed Sep 8 16:13:28 DST 2010 By sjc5-gf-021 in /auto/ioxbuild8/production/4.0.0.DT_IMAGE/asr9k/workspace for pie asr9K-doc-supp, V 4.0.0[DT_IMAGE], Cisco Systems, at disk0:asr9K-doc-supp-4.0.0 Built on Wed Sep 8 16:16:57 DST 2010 By sjc5-gf-021 in /auto/ioxbuild8/production/4.0.0.DT_IMAGE/asr9k/workspace for pie asr9k-scfclient, V 4.0.0[DT_IMAGE], Cisco Systems, at disk0:asr9k-scfclient-4.0.0 Built on Wed Sep 8 16:13:26 DST 2010 By sjc5-gf-021 in /auto/ioxbuild8/production/4.0.0.DT_IMAGE/asr9k/workspace for pie iosxr-security, V 4.0.0[DT_IMAGE], Cisco Systems, at disk0:iosxr-security-4.0.0 Built on Wed Sep 8 16:16:48 DST 2010 By sjc5-gf-021 in /auto/ioxbuild8/production/4.0.0.DT_IMAGE/asr9k/workspace for pie --More-- The output from the show running-config command displays the current running configuration, that is, all of the nondefault commands currently active. Verify that the contents of the current running configuration are as expected. Tip The output of this command in exec mode is different from the output in admin mode. You should run the command from each of these modes to locate all of the configuration information. RP/0/RSP0/CPU0:router# show running-config Building configuration... !! Last configuration change at 18:56:31 UTC Tue Feb 28 2006 by user_A ! hostname router clock timezone PST 8.
  • 43. 1-31 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Verifying the System logging console informational telnet vrf default ipv4 server max-servers 100 domain name cisco.com domain lookup disable taskgroup default ! taskgroup igpadmin task write rib task write isis task write ospf ! taskgroup routeadmin task write bgp inherit taskgroup igpadmin ! usergroup default taskgroup default ! usergroup igp_admin taskgroup igpadmin ! usergroup route_admin taskgroup routeadmin ! tacacs-server host 172.29.52.69 port 49 key 7 060506324F41 aaa group server tacacs+ DOC_LAB_TACACS+ server 172.29.52.69 server 172.29.52.68 ! aaa authorization exec LAB_AAA group DOC_LAB_TACACS+ local aaa authorization exec CONSOLE_AAA group DOC_LAB_TACACS+ none aaa authorization commands LAB_AAA group DOC_LAB_TACACS+ none aaa authorization commands CONSOLE_AAA group DOC_LAB_TACACS+ none aaa authentication login default group DOC_LAB_TACACS+ local aaa authentication login CONSOLE_AAA group DOC_LAB_TACACS+ local aaa default-taskgroup default explicit-path name Primary_GE_Path_to_P19 index 1 next-address strict ipv4 unicast 10.114.4.44 index 2 next-address strict ipv4 unicast 10.114.4.11 index 3 next-address strict ipv4 unicast 10.119.4.11 index 4 next-address strict ipv4 unicast 10.119.4.19 index 5 next-address strict ipv4 unicast 10.19.19.19 ! line console accounting exec CONSOLE_AAA accounting commands CONSOLE_AAA authorization exec CONSOLE_AAA authorization commands CONSOLE_AAA login authentication CONSOLE_AAA exec-timeout 600 0 session-timeout 600 ! line default exec-timeout 600 0 session-timeout 600 ! . . . interface preconfigure GigabitEthernet0/3/0/18 shutdown
  • 44. 1-32 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Verifying the System ! interface preconfigure GigabitEthernet0/3/0/19 shutdown ! interface preconfigure TenGigE0/3/0/0 shutdown ! interface preconfigure TenGigE0/3/0/1 shutdown ! router static address-family ipv4 unicast 0.0.0.0/0 172.29.52.1 200 ! ! router isis 100 is-type level-2-only net 49.0001.0000.0000.0044.00 nsf cisco address-family ipv4 unicast metric-style wide mpls traffic-eng level-2-only mpls traffic-eng router-id Loopback0 ! interface Loopback0 passive address-family ipv4 unicast ! ! interface TenGigE0/4/0/0 bfd minimum-interval 50 bfd multiplier 3 bfd fast-detect ipv4 address-family ipv4 unicast ! ! ! router ospf 100 nsr router-id 10.144.144.144 bfd minimum-interval 50 bfd multiplier 3 mpls ldp sync nsf cisco area 0 mpls ldp sync-igp-shortcuts mpls traffic-eng interface Loopback0 passive enable ! . . . http server ssh server vrf default igmp snooping profile default system-ip-address 10.144.144.144 minimum-version 2 internal-querier tcn query solicit ttl-check disable router-alert-check disable ! igmp snooping profile mrouter
  • 45. 1-33 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Verifying the System router-guard mrouter ! router pim address-family ipv4 mofrr mofrr-acl rp-address 10.11.11.11 rp-address 10.144.144.144 bidir-acl bidir spt-threshold infinity ! ! end RP/0/RSP0/CPU0:router# admin Wed Oct 27 14:52:07.000 DST RP/0/RSP0/CPU0:router(admin)# show running-config Wed Oct 27 14:52:12.766 DST Building configuration... !! IOS XR Admin Configuration 4.0.0 username doclabuser-c group root-system group cisco-support secret 5 $1$RJVQ$6w7saUHgk16v5HXRWEp6m/ ! username doclabuser-r group root-system secret 5 $1$.uOF$O9N0aRRk.V1qe250IavLw1 ! alias cr copy run disk0a:/usr/base_config_admin alias sa show alias alias sc show config commit list alias sd show diag alias si show install req alias sl show led alias sp show platform alias sr show run alias sv show version alias nda no debug all end The output from the show logging command displays the contents of the logging buffer. The output displays details on syslog historical events. Analyze the logged events and the order in which they happened. Check for anything out of the ordinary such as errors, tracebacks, or crashes. Also check for any Severity 1 or Severity 2 errors. RP/0/RSP0/CPU0:router(admin)# show logging Syslog logging: enabled (0 messages dropped, 0 flushes, 0 overruns) Console logging: level informational, 693 messages logged Monitor logging: level debugging, 0 messages logged Trap logging: level informational, 0 messages logged Buffer logging: level debugging, 4467 messages logged Log Buffer (307200 bytes): LC/0/3/CPU0:Sep 13 23:58:03.272 : pfm_node_lc[230]: %PLATFORM-NP-0-NP_INIT_FAILURE : Set|prm_server[110670]|Network Processor Unit(0x1007000)|Persistent Initialization Failure.
  • 46. 1-34 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Verifying the System LC/0/3/CPU0:Sep 13 23:58:03.276 : pfm_node_lc[230]: %PLATFORM-PFM-0-CARD_RESET_REQ : pfm_dev_sm_perform_recovery_action, Card reset requested by: Process ID: 110670 (prm_server), Fault Sev: 0, Target node: 0/3/CPU0, CompId: 0x1f, Device Handle: 0x1007000, CondID: 1027, Fault Reason: Persistent Initialization Failure. LC/0/3/CPU0:Sep 13 23:58:03.276 : syslog_dev[85]: pfm_node_lc[230]: Request Graceful Reboot via Sysmgr: Reason: pfm_dev_sm_perform_recovery_action, Card reset requested by: Process ID: 110670 (prm_server), Fault Sev: 0, Target node: 0/3/CPU0, CompId: 0x1f, Device Handle: 0x1007000, CondID: 1027, Fault Reason: Persistent Initialization Failure. LC/0/3/CPU0:Sep 13 23:58:03.277 : sysmgr[87]: %OS-SYSMGR-2-REBOOT : reboot required, process (pfm_node_lc) reason (pfm_dev_sm_perform_recovery_action, Card reset requested by: Process ID: 110670 (prm_server), Fault Sev: 0, Target node: 0/3/CPU0, CompId: 0x1f, Device Handle: 0x1007000, CondID: 1027, Fault Reason: Persistent Initialization Failure. ) LC/0/3/CPU0:Sep 13 23:58:03.467 : sysmgr[87]: %OS-SYSMGR-3-ERROR : sysmgr_shutdown_cleanup_handler: shutdown script execution timed-out! Node will reset LC/0/3/CPU0:Sep 13 23:58:03.467 : sysmgr[87]: %OS-SYSMGR-7-DEBUG : sysmgr_shutdown_cleanup_handler: shutdown script execution timed-out! Node will reset LC/0/3/CPU0:Sep 13 23:58:03.468 : sysmgr[87]: %OS-SYSMGR-3-ERROR : sysmgr_shutdown_cleanup_handler: shutdown triggered by (pfm_node_lc) did not complete in 45 seconds, shutting down RP/0/RSP0/CPU0:Sep 13 23:58:16.859 : shelfmgr[299]: %PLATFORM-SHELFMGR-0-MAX_RESET_BRINGDOWN : Can not boot node 0/3/CPU0 A9K-2T20GE-B due to multiple resets, putting it IN_RESET state. The probable cause is an unexpected event on the node or a failure in communication with the node. Please refer to the Cisco ASR 9000 System Error Message Reference Guide for further information if needed. --More-- The output from the show environment command displays environmental monitor parameters for the system. Verify that the environment parameters are as expected. Environment parameter anomalies are logged in the syslog, so if an environment parameter displayed in the show environment command output is not as expected, check the syslog using the show logging command. The syslog provides details on any logged problems. RP/0/RSP0/CPU0:router(admin)# show environment Wed Sep 15 09:48:27.178 DST Temperature Information --------------------------------------------- R/S/I Modules Sensor (deg C) 0/1/* host Inlet0 36.4 host Hotspot0 46.7 0/2/* spa0 InletTemp 35.5 spa0 Hotspot 35.5 host Inlet0 34.5 host Hotspot0 61.0 0/3/* host Inlet0 31.1 host Hotspot0 32.5 0/RSP0/* host Inlet0 31.3 host Hotspot0 42.0 0/4/*
  • 47. 1-35 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Verifying the System host Inlet0 34.9 host Hotspot0 45.2 0/6/* host Inlet0 38.0 host Hotspot0 48.9 0/FT0/* host Inlet0 31.9 host Hotspot0 33.5 0/FT1/* host Inlet0 32.3 host Hotspot0 35.3 Voltage Information --------------------------------------------- R/S/I Modules Sensor (mV) Margin 0/1/* host IBV 10592 n/a host 5.0V 4925 n/a host VP3P3_CAN 3289 n/a host 3.3V 3302 n/a host 2.5V 2516 n/a host 1.8VB 1812 n/a host 1.2VB 1193 n/a host 1.8VA 1806 n/a host 0.9VB 886 n/a host 1.2V_LDO_BRG0 1193 n/a host 1.2V_LDO_BRG1 1195 n/a host 1.8VC 1811 n/a host 1.5VB 1505 n/a host 1.5VA 1503 n/a host 1.1V(1.05V_CPU) 1053 n/a host 0.75VA 752 n/a host 0.75VB_0.75VC 754 n/a host 1.1VB 1103 n/a host 1.2V_TCAM0 1003 n/a host 1.2V_TCAM1 1000 n/a host 1.0V_Bridge_LDO 999 n/a host 1.0VB 1042 n/a host 0.75VD_and_0.75VE 752 n/a host 1.2V_TCAM2 1006 n/a host 1.2V_TCAM3 1002 n/a host 1.5VC 1504 n/a host 1.8VD 1804 n/a host 1.1VC 1100 n/a host ZARLINK_3.3V 3272 n/a host ZARLINK_1.8V 1807 n/a host 1.2V_DB 1195 n/a host 3.3V_DB 3318 n/a host 2.5V_DB 2535 n/a host 1.5V_DB 1509 n/a . . . LED Information
  • 48. 1-36 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Verifying the System --------------------------------------------- R/S/I Modules LED Status 0/RSP0/* host Critical-Alarm Off host Major-Alarm Off host Minor-Alarm Off host ACO Off host Fail Off Fan Information --------------------------------------------- Fan speed (rpm): FAN0 FAN1 FAN2 FAN3 FAN4 FAN5 FAN6 FAN7 FAN8 FAN9 FAN10 FAN11 0/FT0/* 3510 3480 3510 3570 3540 3510 3510 3480 3540 3540 3480 3480 0/FT1/* 3510 3510 3510 3540 3480 3510 3390 3510 3510 3540 3450 3480 Power Supply Information --------------------------------------------- R/S/I Modules Capacity Status (W) 0/PM0/* host PM 3000 Ok 0/PM1/* host PM 3000 Ok 0/PM2/* host PM 3000 Ok R/S/I Power Draw Voltage Current (W) (V) (A) 0/PM0/* 622.9 53.7 11.6 0/PM1/* 774.7 53.8 14.4 0/PM2/* 0.0 54.1 0.0 -------------- Total: 1397.6 Power Shelves Type: AC Total Power Capacity: 9000W Usable Power Capacity: 9000W Supply Failure Protected Capacity: 6000W Feed Failure Protected Capacity: 3000W Worst Case Power Used: 3170W Slot Max Watts ---- --------- 0/1/CPU0 350 0/2/CPU0 450 0/RSP0/CPU0 235 0/RSP1/CPU0 235 (default) 0/4/CPU0 350 0/6/CPU0 350 0/FT0/SP 600
  • 49. 1-37 Cisco IOS XR Troubleshooting Guide for the Cisco ASR 9000 Aggregation Services Router OL-23591-02 Chapter 1 General Troubleshooting Procedures Verifying the System 0/FT1/SP 600 Worst Case Power Available: 5830W Supply Protected Capacity Available: 2830W Feed Protected Capacity Available: Not Protected The output from the show context command displays core dump context information. See the “show context Command” section on page 1-50 for more information on the show context command output. RP/0/RSP0/CPU0:router# show context node: node0_1_CPU0 ------------------------------------------------------------------ Crashed pid = 61524 (pkg/bin/tcam_mgr) Crashed tid = 1 Crash time: Wed Apr 05, 2006: 18:27:26 Core for process at harddisk:/dumper/first.tcam_mgr.abort.node0_1_CPU0.ppc.Z Stack Trace #0 0xfc1d3fa0 #1 0xfc1c6340 #2 0xfc1c5364 #3 0xfc1c542c #4 0x48210930 #5 0x482110b8 #6 0x48212ba4 #7 0x48203dd8 #8 0x4820c61c #9 0xfc1557ec #10 0xfc15573c #11 0xfc152fb8 #12 0x4820d140 Registers info r0 r1 r2 r3 R0 00000000 481ff7b0 4824a55c 00000000 r4 r5 r6 r7 R4 0000f054 00000001 00000006 00000000 r8 r9 r10 r11 R8 00000000 fc220000 481fffc0 00000000 r12 r13 r14 r15 R12 4823be90 4824a4a0 48230000 00000000 r16 r17 r18 r19 R16 00000048 00000001 00000019 48256520 r20 r21 r22 r23 R20 00000000 00000000 00000003 00000045 r24 r25 r26 r27 R24 00000003 00000000 00000003 4825dc34 r28 r29 r30 r31 R28 00000006 0000f054 48254064 481ff810 cnt lr msr pc R32 00000000 fc1c6340 0000d932 fc1d3fa0 cnd xer R36 28004024 00000008 DLL Info DLL path Text addr. Text size Data addr. Data size Version /hfr-os-3.3.90/lib/libinfra.dll 0xfc142000 0x00034200 0xfc1343b8 0x00000bbc 0 /lib/libc.dll 0xfc1a8000 0x00079dd8 0xfc222000 0x00002000 0 Crash Package Infomation Package: hfr-mgbl, Source: By edde-bld1 in /vws/aga/production/3.3.90.1I/hfr/wor kspace for c2.95.3-p8