Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Andrew Sandford
Senior Readiness Specialist, Worldwide Support Readiness EMEA
Citrix Support Secrets Webinar
Series
In-dep...
© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
netscaler.descr: NetScale...
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
50185 root 1 44 -52 814M ...
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
LB_RGB (192.168.47.3:80) ...
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
1) svc_blue (192.168.196....
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
1) Monitor Name: mon-http...
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute
Show commands
System show node
show info
show license
Vserver/Service sho...
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
2) Node ID: 1
IP: 192.168...
© 2014 Citrix | Confidential – Do Not Distribute
NetScaler Processes
Process Description Process Description
nsppe NetScal...
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
System
Entities
Protocols
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
> stat interface 1/1
Inte...
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
Non-authoritative entries...
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
Vserver hits 0 0
Requests...
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
NetScaler File System
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
View events
View console ...
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
nsconmsg Common Syntax
Ma...
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
Live CPU related stats
Ar...
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
1906 3910 PPE-0 'interfac...
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
VIP(127.0.0.2:53:DOWN:WEI...
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
ipConflictAddr = 192.168....
© 2014 Citrix | Confidential – Do Not Distribute
Troubleshooting Techniques
Common NetScaler issues/resolutions
HDD Issues...
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute
nstrace & nstcpdump
nstrace
Common syntax:
Nstrace.sh –sz 0
Nstrace.sh –s...
© 2014 Citrix | Confidential – Do Not Distribute
Packet Tracing
Differences between nstrace.sh & nstcpdump.sh
Nstcpdump.sh...
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
-h - prints this message ...
© 2014 Citrix | Confidential – Do Not Distribute
Packet Tracing
nstrace.sh nstcpdump.sh
Proprietary capture format TCPdump...
© 2014 Citrix | Confidential – Do Not Distribute
Trace analysis
nstrace.sh
By Default if nstrace.sh is executed from shell...
© 2014 Citrix | Confidential – Do Not Distribute
Trace Analysis
nstrace syntax examples
Command Purpose
# nstrace.sh Store...
© 2014 Citrix | Confidential – Do Not Distribute
Trace Analysis
nstcpdump.sh example syntax
Command Purpose
# nstcpdump.sh...
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
© 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
CTX109304 Data Collection...
© 2014 Citrix | Confidential – Do Not Distribute
Maximize your knowledge.
Continue your journey with Citrix Education.
Rec...
© 2014 Citrix | Confidential – Do Not Distribute
About
Citrix Services
Citrix Services make sure
you succeed with your
vir...
© 2014 Citrix | Confidential – Do Not Distribute
• 40 insider troubleshooting tips
• Covering XenDesktop, XenServer, XenAp...
© 2014 Citrix | Confidential – Do Not Distribute
Premier Support Calculator
Check it out
Work better. Live better. Use NetScaler
In-depth Troubleshooting on NetScaler using Command Line Tools
In-depth Troubleshooting on NetScaler using Command Line Tools
In-depth Troubleshooting on NetScaler using Command Line Tools
In-depth Troubleshooting on NetScaler using Command Line Tools
In-depth Troubleshooting on NetScaler using Command Line Tools
In-depth Troubleshooting on NetScaler using Command Line Tools
In-depth Troubleshooting on NetScaler using Command Line Tools
Upcoming SlideShare
Loading in …5
×

In-depth Troubleshooting on NetScaler using Command Line Tools

86,674 views

Published on

Webinar recording - https://www1.gotomeeting.com/register/753997104

Citrix NetScaler has a rich Web-based management suite of tools available. To dig deep troubleshooting NetScaler, sometimes it’s best to roll up your sleeves and dig out the command line!
The goal of this session is to demystify some useful command line tools and provide a tactical approach to troubleshooting of NetScaler.
In this session we will demonstrate troubleshooting approaches using the command line and many tips for common issues seen in customer deployments.

In this session you will learn about:
· Differences between NetScaler kernel and BSD
· Processes and disk layout
· Look up stats and statuses
· Troubleshoot using various different logs
· Use counters to help identify issues

Published in: Technology
  • DOWNLOAD FULL. BOOKS INTO AVAILABLE FORMAT ......................................................................................................................... ......................................................................................................................... 1.DOWNLOAD FULL. PDF EBOOK here { https://tinyurl.com/y8nn3gmc } ......................................................................................................................... 1.DOWNLOAD FULL. EPUB Ebook here { https://tinyurl.com/y8nn3gmc } ......................................................................................................................... 1.DOWNLOAD FULL. doc Ebook here { https://tinyurl.com/y8nn3gmc } ......................................................................................................................... 1.DOWNLOAD FULL. PDF EBOOK here { https://tinyurl.com/y8nn3gmc } ......................................................................................................................... 1.DOWNLOAD FULL. EPUB Ebook here { https://tinyurl.com/y8nn3gmc } ......................................................................................................................... 1.DOWNLOAD FULL. doc Ebook here { https://tinyurl.com/y8nn3gmc } ......................................................................................................................... ......................................................................................................................... ......................................................................................................................... .............. Browse by Genre Available eBooks ......................................................................................................................... Art, Biography, Business, Chick Lit, Children's, Christian, Classics, Comics, Contemporary, Cookbooks, Crime, Ebooks, Fantasy, Fiction, Graphic Novels, Historical Fiction, History, Horror, Humor And Comedy, Manga, Memoir, Music, Mystery, Non Fiction, Paranormal, Philosophy, Poetry, Psychology, Religion, Romance, Science, Science Fiction, Self Help, Suspense, Spirituality, Sports, Thriller, Travel, Young Adult,
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

In-depth Troubleshooting on NetScaler using Command Line Tools

  1. 1. Andrew Sandford Senior Readiness Specialist, Worldwide Support Readiness EMEA Citrix Support Secrets Webinar Series In-depth Troubleshooting on NetScaler using Command Line Tools 27 March 2014
  2. 2. © 2014 Citrix | Confidential – Do Not Distribute
  3. 3. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  4. 4. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  5. 5. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  6. 6. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  7. 7. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  8. 8. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  9. 9. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  10. 10. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  11. 11. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  12. 12. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute netscaler.descr: NetScaler Virtual Appliance 3G netscaler.num_pe_running: 1 netscaler.version: NetScaler NS10.1: Build 124.13.nc, Date: Feb 20 2014, 18:53:27 netscaler.model: 3000 netscaler.vmpe_max_cpus: 2 netscaler.nCore: 1
  13. 13. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  14. 14. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  15. 15. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  16. 16. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  17. 17. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  18. 18. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  19. 19. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  20. 20. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute 50185 root 1 44 -52 814M 815M CPU1 1 20.2H 100.00% NSPPE-00
  21. 21. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  22. 22. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  23. 23. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  24. 24. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  25. 25. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute LB_RGB (192.168.47.3:80) - HTTP Type: ADDRESS State: UP Client Idle Timeout: 180 sec Down state flush: ENABLED Disable Primary Vserver On Down : DISABLED Appflow logging: ENABLED Port Rewrite : DISABLED No. of Bound Services : 1 (Total) 1 (Active) Configured Method: ROUNDROBIN Mode: IP Persistence: NONE Vserver IP and Port insertion: OFFWarning: Feature(s) not enabled [LB]
  26. 26. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute 1) svc_blue (192.168.196.62: 80) - HTTP State: UP Weight: 1
  27. 27. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute 1) Monitor Name: mon-http-ecv State: UP Weight: 1 Passive: 0 Probes: 14887 Failed [Total: 124 Current: 0] Last response: Success - Pattern found in response. Response Time: 10.220 millisec State: UP
  28. 28. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  29. 29. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  30. 30. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  31. 31. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  32. 32. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  33. 33. © 2014 Citrix | Confidential – Do Not Distribute Show commands System show node show info show license Vserver/Service show lb vserver show cs vserver show service show persistencesession show connectiontable IP related show route show ip show dns addrec -type proxy Diagnostic show techsupport
  34. 34. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute 2) Node ID: 1 IP: 192.168.1.45 Node State: STAYSECONDARY Master State: Secondary Fail-Safe Mode: OFF INC State: DISABLED Sync State: ENABLED Propagation: ENABLED Enabled Interfaces : 1/8 1/7 1/6 1/5 1/4 1/3 1/2 1/1 Disabled Interfaces : None HA MON ON Interfaces : 1/8 1/7 1/6 1/5 1/4 1/3 1/2 1/1 Interfaces on which heartbeats are not seen : 1/8 1/6 1/5 1/4 1/3 1/2 1/1 Interfaces causing Partial Failure: 1/8 1/6 1/5 1/4 1/3 1/2 1/1 SSL Card Status: UP Local node information: Critical Interfaces: 1/8 1/6 1/5 1/4 1/3 1/2 1/1 > Node State: NOT UP Master State: Secondary Master Enabled Interfaces : 1/8 1/7 1/6 1/5 1/4 1/3 1/2 1/1 Disabled Interfaces : None HA MON ON Interfaces : 1/8 1/7 1/6 1/5 1/4 1/3 1/2 1/1 Interfaces on which heartbeats are not seen : 1/8 1/6 1/5 1/4 1/3 1/2 1/1 Interfaces causing Partial Failure: 1/8 1/6 1/5 1/4 1/3 1/2 1/1 Node State: STAYSECONDARY Master State: Secondary
  35. 35. © 2014 Citrix | Confidential – Do Not Distribute NetScaler Processes Process Description Process Description nsppe NetScaler Packet Engine nsfsyncd Sync bookmarks and SSL certificates nsaaad RBA and SSL VPN External Auth nsnetsvc Used by the GUI for config changes nsconf Writes the ns.conf file nsumond Runs the scriptable monitors nslog.sh Controls Logging for newnslog nsconmsg Controls writing of newnslog nssync HA sync nscollect Statistics gathering for historical reporting nsreadfile Used to read SSL Cert Files imi/ripd/ ospfd/bgpd Routing processes nscrlrefresh SSL CRL list update
  36. 36. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute System Entities Protocols
  37. 37. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  38. 38. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  39. 39. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  40. 40. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute > stat interface 1/1 Interface [1/1]: Interface StateUP Link uptime 00:40:21 Link downtime00:00:00 Throughput Statistics Rate (/s) Total Bytes received42393 54497294 Bytes transmitted 2584 20222135 Packets received 629 710246 Packets transmitted 47 69066 Packet Statistics Rate (/s) Total Multicast packets 18 41219 NetScaler packets 85 98954 LACP Statistics Rate (/s) Total LACPDUs received 0 0 LACPDUs transmitted 0 0 Error Statistics Rate (/s) Total Error packets received (hw) 0 0 Error packets transmitted (hw) 0 0 Inbound packets discarded (hw) 0 0 Outbound packets discarded (hw)0 0 Packets dropped in Rx (sw) 539 599904 Packets dropped in Tx (sw) 0 0 NIC hangs -- 0 Status stalls -- 0 Transmit stalls -- 0 Receive stalls -- 0 Error-disables -- 0 Duplex mismatches -- 0 Link re-initializations -- 0 MAC moves registered 0 0 Times NIC became muted -- 0
  41. 41. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute Non-authoritative entries 0 Authoritative entries 98 Error Statistics Nonexistent domain 102359 Response class unsupported 0 Invalid query format 0 Stray answers 0 Incorrect RD length 0 Requests refused 0 Response type unsupported 0 Query class unsupported 0 Invalid response format 0 No answer responses 102334 Multi queries disabled 0 Other errors 0
  42. 42. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  43. 43. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute Vserver hits 0 0 Requests 0 0 Responses 0 0 Request bytes 0 65 Response bytes 0 188 Total Packets rcvd 0 5 Total Packets sent 0 4 Current client connections -- 0 Current Client Est connections -- 0 Current server connections -- 0 Requests in surge queue -- 0 Requests in vserver's surgeQ -- 0 Requests in service's surgeQs -- 0 Spill Over Threshold -- 0
  44. 44. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  45. 45. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute NetScaler File System
  46. 46. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  47. 47. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  48. 48. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  49. 49. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  50. 50. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute View events View console messages View statistics Debug system counters Debug load balancing issues Debug CPU/Memory utilization Use cases
  51. 51. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute nsconmsg Common Syntax Make sure to use –K, NOT -k
  52. 52. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute Live CPU related stats Archived events HA Failover cause LB stats CS related counters Real-time policy hits SSL related counters Compression related counters
  53. 53. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  54. 54. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute 1906 3910 PPE-0 'interface(1/1)' has been disabled Wed Aug 14 12:27:16 2013 1907 0 PPE-0 'interface(1/1)' DOWN Wed Aug 14 12:27:16 2013 1912 0 PPE-0 'server_svc_cfg_NSSVC_DNS_192.168.204.50:53(SVC_CTXANG_DNS1)' DOWN Wed Aug 14 12:27:25 2013 1913 0 PPE-0 'server_svc_cfg_NSSVC_DNS_192.168.204.51:53(SVC_CTXANG_DNS2)' DOWN Wed Aug 14 12:27:25 2013 1910 0 PPE-0 MonServiceBinding_192.168.204.51:53_(ping- default)(SVC_CTXANG_DNS2): DOWN; Last response: Failure - Probe timed out. Wed Aug 14 12:27:25 2013 1911 0 PPE-0 MonServiceBinding_192.168.204.50:53_(ping- default)(SVC_CTXANG_DNS1): DOWN; Last response: Failure - Probe timed out. Wed Aug 14 12:27:25 2013
  55. 55. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  56. 56. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  57. 57. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute VIP(127.0.0.2:53:DOWN:WEIGHTEDRR): Hits(0, 0/sec) Mbps(0.00) Pers(OFF) Err(0) SO(0) LConn_BestIdx: 1024 Pkt(0/sec, 0 bytes) actSvc(0) DefPol(NONE) override(0) newlyUP(0) Conn: Clt(0, 0/sec, OE[0]) Svr(0) SQ(Total: 0 OnVserver: 0 OnServices: 0) slimit_SO: (Sothreshhold: 0 [Ex: 0] Consumed: [Ex: 0 Borrowed: 0 TotActiveConn: 0] Available: 0-
  58. 58. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute ipConflictAddr = 192.168.47.1 last message repeated 169 times
  59. 59. © 2014 Citrix | Confidential – Do Not Distribute Troubleshooting Techniques Common NetScaler issues/resolutions HDD Issues Logging fails /var missing Flash Issues Config fails to save Config saves partially Sync fails Device fails to boot Memory starvation Dropped sessions CPU starvation All services failing All VIPS down Degraded performance
  60. 60. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  61. 61. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  62. 62. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  63. 63. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  64. 64. © 2014 Citrix | Confidential – Do Not Distribute nstrace & nstcpdump nstrace Common syntax: Nstrace.sh –sz 0 Nstrace.sh –sz 0 –filter “SOURCEIP = 10.198.4.10” –link enabled Filter qualifiers and operators: SOURCEIP, SOURCEPORT, DESTIP, DESTPORT, SVCNAME, VSVRNAME, STATE ==, eq, !=, neq, >, gt, <, lt, >=, ge, <=, le, BETWEEN Compound filters using || and && nstcpdump Common syntax: Nstcpdump.sh –X tcp port 80 Nstcpdump.sh –w testcapture.cap –X src host 10.198.4.10 tcp port 80 Filter qualifiers and operators: tcpdump standard
  65. 65. © 2014 Citrix | Confidential – Do Not Distribute Packet Tracing Differences between nstrace.sh & nstcpdump.sh Nstcpdump.sh Nstrace.sh Useful if traces are to be viewed on standard output nstcpdump.sh –w <filename> option helps writing output to file Useful for offline collection nstrace.sh –sz 0 Saves traces in /var/nstrace in cap format can be used with expressions so that you get to see filtered traffic nstcpdump.sh host <IP> nstcpdump.sh port 21 useful for collection of traces in separate log files based on NICs nstrace.sh –tcpdump1 –nic 1
  66. 66. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute -h - prints this message - exclusive option -nf - number of files to be generated in cycle (def. 24) -time - seconds per file (def. 3600) (could be an expression) -sz - size of the captured data (bytes from 60 to 1514) -tcpdump - 0=nstrace-format (default) or 1=tcpdump-format -nic - use separate trace files for each interface (only works if -tcpdump option is set) -name - name of the trace file -filter - Filter expression for nstrace. The maximum length of filter expression is 255 and it can of following format: <expression> [<relop> <expression>] -link - Log filtered connection's peer's (linked connection's) traffic. Works only with -filter option
  67. 67. © 2014 Citrix | Confidential – Do Not Distribute Packet Tracing nstrace.sh nstcpdump.sh Proprietary capture format TCPdump PCAP capture format Native format captures more information Useful for live capture from CLI Files are stored in /var/nstrace Option to write to a file Needs custom dissector in Wireshark (1.6+) Most TCPdump options supported Works in standard Wireshark
  68. 68. © 2014 Citrix | Confidential – Do Not Distribute Trace analysis nstrace.sh By Default if nstrace.sh is executed from shell prompt Trace files are stored in NetScaler proprietary (.cap) format The trace capture runs for 1 hr. (3600 sec) if not interrupted Files are cyclically numbered from 1-24. Trace mode is 6 (that is the TXB and RX packets are captured) The size of the captured data for each packet is 164
  69. 69. © 2014 Citrix | Confidential – Do Not Distribute Trace Analysis nstrace syntax examples Command Purpose # nstrace.sh Stores the traces in default (proprietary) format # nstrace.sh -tcpdump 1 Begins to save the traces in the TCPDUMP format for a default 3600 seconds # nstrace.sh -tcpdump 1 -nic 1 Logs the traces (in TCPDUMP format) into separate log files based on the NIC IDs # nstrace.sh –nf <value> No of files to be generated in cycle by default is 24 # nstrace.sh –time <value> Seconds per file by default 3600 seconds # nstrace.sh -sz 0 Size of the captured data( by default it is 164), -sz 0 is the entire packet length # nstrace.sh –m Capturing mode: sum of the values (def. 6): 1-Transmitted packets (TX) 2 - Packets buffered for transmission (TXB) 4 - Received packets (RX) # nstrace.sh -stop Can be used to disable tracing (when 'nstrace.sh' is run in the background
  70. 70. © 2014 Citrix | Confidential – Do Not Distribute Trace Analysis nstcpdump.sh example syntax Command Purpose # nstcpdump.sh <type> Possible types are host, net and port .If there is no type qualifier host assumed # nstcpdump.sh <dir> Qualifiers specify a particular transfer direction to and/or from id. Possible directions are src, dst, src or dst and src and dst. If there is no dir qualifier, src or dst is assumed. src foo', `dst net 128.3', `src or dst port ftp- data' # nstcpdump.sh <proto> ether, fddi, ip, arp, rarp, decnet, tcp and udp. # nstcpdump.sh –c <value> Exit after receiving ‘value’ number of packets # nstcpdump.sh –F –I –r Not supported and not to give them as options to the script # nstcpdump.sh –w <file name> Write the raw packets to file rather than parsing and printing them out. Read by typing tcpdump –r test
  71. 71. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  72. 72. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  73. 73. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  74. 74. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  75. 75. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  76. 76. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  77. 77. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute
  78. 78. © 2014 Citrix | Confidential – Do Not Distribute© 2014 Citrix | Confidential – Do Not Distribute CTX109304 Data Collection Procedure to Troubleshoot NetScaler Related Issues http://www.slideshare.net/davidmcg/common-pitfalls-when-setting-up-a-net-scaler-for- the-first-time http://support.citrix.com/search/basic?searchQuery=counters&refinement=Content+Ty pe,Technotes&refinement=Product+Family,NetScaler CTX114999 How to Troubleshoot Authentication with Aaad.debug https://taas.citrix.com/
  79. 79. © 2014 Citrix | Confidential – Do Not Distribute Maximize your knowledge. Continue your journey with Citrix Education. Recommended next step for hands-on technical training: CNS-205 Citrix NetScaler 10 Essentials and Networking Identify the capabilities and functionality of the NetScaler Explain basic NetScaler network architecture Obtain, install, and manage NetScaler licenses Explain how SSL is used to secure the NetScaler Implement NetScaler TriScale Technology, including Clustering Visit bit.ly/NSCOURSE to save 10% now through April 30.* *Not valid with any other promotions, packages or discounts. Applies only to new purchases. Regional limitations may apply.
  80. 80. © 2014 Citrix | Confidential – Do Not Distribute About Citrix Services Citrix Services make sure you succeed with your virtualization programs. How we can help Citrix Education – The fastest, most efficient way to get your team the virtualization skills they need. Online, on-site or in class. citrix.com/training Citrix Consulting – Intensive engagements for complex, critical or just plain massive projects. citrix.com/consulting Citrix Support – Always-on support services that leverage everything we know about best-practice deployment and maintenance. citrix.com/support Educate | Guide | Support | Succeed
  81. 81. © 2014 Citrix | Confidential – Do Not Distribute • 40 insider troubleshooting tips • Covering XenDesktop, XenServer, XenApp and NetScaler • Citrix Support top engineers • FREE eBook • Citrix Auto Support • Now available! Secrets of the Citrix Support Ninjas
  82. 82. © 2014 Citrix | Confidential – Do Not Distribute Premier Support Calculator Check it out
  83. 83. Work better. Live better. Use NetScaler

×