Using Splunk with SAP:Planning for Performance             and Capacity      Shaun Butler and Luke Harris
About Corporate ExpressSupplier of business essentials, established in 1995Revenue $1.16 billion in 2009E-Commerce sales c...
About Shaun ButlerSenior Technology Specialist (Infrastructure Services)RHCE, EMCPA Senior authority for planning, design,...
About Luke HarrisSenior Systems Engineer (Infrastructure Services)Linux SOE Specialist, RHCEEMC Storage AdministratorSplun...
Splunk At CE: Data Sources                            Logfiles   Configs    Messages    Traps        Metrics   Scripts   C...
Splunk At Corporate Express: Deployment                  1 Production server (IBM Blade)                  1 non-producti...
SAP at Corporate Express    nXtgen Project – Business transformation and ERP replacement    SAP applications implemented (...
Splunk’s Value Proposition in a SAP World Powerful Trending + Data Accessibility + Data Augmentation                      ...
SAP Data SourcesECC, CRM, BI – Data retrieved from:         ST03 - SAP Workload Monitor         SM04 – SAP User List   ...
SAP Use Cases At CEApplication PerformanceCapacity/usageNetwork analysis                          10
SAP Use Case 1: Application PerformanceABAP SAP Applications (e.g. ECC, CRM, BI)SAP Master Data Management (MDM)          ...
Application Performance: Summary Dialog           Step Response Time                   12
Application Performance: Detailed Dialog Step               Response Time                      13
Application Performance: Detailed Dialog Step    Response Time (Long Term Trending)                      14
Application Performance: Checking Times                   15
Application Performance: MDM Import TimeFrom This:<Trace ts="2010/07/30 07:02:43.821 GMT" tid="1029" entry-no="18583">[MDS...
Application Performance: MDM Import TimeTo This:                   17
SAP Use Case 2: Throughput/CapacityABAP SAP Applications (e.g. ECC, CRM, BI)   Dialog steps executed over time   System ...
Dialog Steps Executed Over Time         (Business Day)               19
Dialog Steps by Task Type            20
Dialog Steps Since Go Live            21
SAP Throughput as Represented by SAPS                  22
Active vs. Inactive Concurrent Users                 23
Active Users by Transaction Type               24
Active Users By Location           25
SAP Use Case 3: Network AnalysisWAN bandwidth consumption split by SAP applicationSAP vs. Non-SAP WAN bandwidth consumptio...
WAN Bandwidth Consumption    by SAP Application            27
WAN Bandwidth Consumption –      SAP vs. Non-SAP             28
Average WAN Footprint Per User              29
Bringing It All Together...             30
Bringing It Even More Together (SplunkForNagios)                       31
Anticipated ChallengesHave a clear idea of what you are trying to achieveGet your Basis/SAP administrator on board!       ...
The FutureSAP Enterprise PortalAuditingInvestigate implementing ST03/SM04 data output into databaseand index from there   ...
Questions?    34
Upcoming SlideShare
Loading in …5
×

Splunk Conf2010: Corporate Express presents Splunk with SAP

2,448 views
2,227 views

Published on

Corporate Express is in the midst of a business transformation program called “next-gen”, rolling out SAP across New Zealand and Australia. This session will detail how they’re using Splunk to plan for capacity and performance requirements, and the how they’re combining multiple charts, graphs, tables and views from disparate systems into a single pane in Splunk. Learn more here: http://www.splunk.com/view/splunk-at-corporate-express/SP-CAAAFNR

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,448
On SlideShare
0
From Embeds
0
Number of Embeds
11
Actions
Shares
0
Downloads
78
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide
  • We capture system logs from all of our AIX, Linux and Windows servers We capture Active Directory events for auditing We capture power savings from Altiris a daily snapshot of our VMware ESX servers and Virtual Machines and also: task log every 10 minutes syslog of ESX logs splunk light weight forwarder on VirtualCenter server* logs from all of our Cisco devices including Firewalls, IPS, ACE Load Balancers, Routers, Switches, VPN, WAAS and Proxy server hourly snapshots of disk usage on our Symmetrix Storage Array (shell script - symcli) we rsync the nagios log every five minutes to assist with event correlation and troubleshooting* we syslog our external and internal DNS/DHCP servers, and the postfix email gateway servers* we rsync our S.A.P., webMethods (Middleware), and netXpress (Web Portal) logs* and we use wget for Netflow logs to capture bandwidth utilization
  • Dialog Step (Official SAP Definition) - User action that provokes a change of a user&apos;s state by requesting a new screen. Fundamental transaction component of an ABAP based SAP application.
  • Dialog Step (Official SAP Definition) - User action that provokes a change of a user&apos;s state by requesting a new screen. Fundamental transaction component of an ABAP based SAP application.
  • Dialog Step (Official SAP Definition) - User action that provokes a change of a user&apos;s state by requesting a new screen. Fundamental transaction component of an ABAP based SAP application.
  • Warning Alerts - Last 60 Minutes Number of Host &amp; Service alerts with status Warning Critical Alerts - Last 60 Minutes Number of Host &amp; Service alerts with status Critical Warning and Critical Alerts Top 5 Host &amp; Service alerts with status Warning &amp; Critical Top 10 Service Notifications with status Warning Chart of recent service notifications Top 10 Service Notifications with status Critical Chart of recent service notifications
  • Splunk Conf2010: Corporate Express presents Splunk with SAP

    1. 1. Using Splunk with SAP:Planning for Performance and Capacity Shaun Butler and Luke Harris
    2. 2. About Corporate ExpressSupplier of business essentials, established in 1995Revenue $1.16 billion in 2009E-Commerce sales currently account for 80% of all ordersOver 2300 staff in over 40 locations across Australia and New ZealandListed on the ASX with majority shareholder Staples Inc Our mission:“To provide a single source supply solution to make it easier and more cost-effective for our customers to do business.” 2
    3. 3. About Shaun ButlerSenior Technology Specialist (Infrastructure Services)RHCE, EMCPA Senior authority for planning, design, implementation and support inrelation to Tier One Infrastructure (including AIX, System P, Linux,Oracle and Enterprise Storage)Infrastructure Services is responsible for core infrastructurecomponents – datacentre, network, servers, storage, virtualisation,monitoring, DNS/DHCP, email 3
    4. 4. About Luke HarrisSenior Systems Engineer (Infrastructure Services)Linux SOE Specialist, RHCEEMC Storage AdministratorSplunk, Nagios, Cacti, and DNS AdministratorSplunkForNagios developer: http://www.splunkbase.com/apps/All/4.x/Add-On/app:SplunkForNagios 4
    5. 5. Splunk At CE: Data Sources Logfiles Configs Messages Traps Metrics Scripts Changes Tickets AlertsWindows Linux/Unix Virtualization Applications Cisco Storage• Syslog (Snare) • Syslog • Hypervisor (ESX) • Web logs • Firewalls, IPS, ACE • EMC Symmetrix• Event logs • DNS, DHCP • VirtualCenter • SAP • Routers, Switches• Active Directory • Nagios • webMethods • Proxy, WAAS• Altiris • Postfix • netXpress • VPN, netflow 5
    6. 6. Splunk At Corporate Express: Deployment  1 Production server (IBM Blade)  1 non-production server (VM)  Operating System: RHEL 5.5 64-bitInfrastructure  Syslog – Linux, AIX, Windows (via Snare), ESX, Cisco Switches, Routers, Firewalls, Load Balancers, WAAS, VPN Data Inputs  SNMP – Cisco IPS  rsync – SAP, webMethods, Nagios, Proxy, Apache, EMC  CIFS – Altiris  wget – netflow (StatSeeker) 6
    7. 7. SAP at Corporate Express nXtgen Project – Business transformation and ERP replacement SAP applications implemented (5 out of 6) ERP Central Component (ECC)  Master Data Management (MDM) Customer Relationship Management (CRM)  Process Integration (PI) Business Intelligence (BI)  PortalNew Zealand go live April 2010Australia go live 2011 7
    8. 8. Splunk’s Value Proposition in a SAP World Powerful Trending + Data Accessibility + Data Augmentation = Operational Intelligence 8
    9. 9. SAP Data SourcesECC, CRM, BI – Data retrieved from: ST03 - SAP Workload Monitor SM04 – SAP User List SM04/ST03 transactions are periodically called and output dumped into text filesMDM – Application logsFile replication/rsync 9
    10. 10. SAP Use Cases At CEApplication PerformanceCapacity/usageNetwork analysis 10
    11. 11. SAP Use Case 1: Application PerformanceABAP SAP Applications (e.g. ECC, CRM, BI)SAP Master Data Management (MDM) 11
    12. 12. Application Performance: Summary Dialog Step Response Time 12
    13. 13. Application Performance: Detailed Dialog Step Response Time 13
    14. 14. Application Performance: Detailed Dialog Step Response Time (Long Term Trending) 14
    15. 15. Application Performance: Checking Times 15
    16. 16. Application Performance: MDM Import TimeFrom This:<Trace ts="2010/07/30 07:02:43.821 GMT" tid="1029" entry-no="18583">[MDS=syd1sap08 Repository=MDP ClientSystem=Code_TemplatePort=Masterpack_Portal]: Chunk size/parallel[50000/40]: Import Task Started.</Trace> <Timer ts="2010/07/30 07:02:47.426 GMT" tid="1029" entry-no="18584" name="GetInitializationInfoAllLanguages"total="3.604439"/> <Timer ts="2010/07/30 07:02:47.707 GMT" tid="1029" entry-no="18585" name="Add User Dimensions" total="0.000006"/> <Timer ts="2010/07/30 07:02:48.199 GMT" tid="1029" entry-no="18586" name="Regular Table Load" total="0.492183"/> <Timer ts="2010/07/30 07:02:48.200 GMT" tid="1029" entry-no="18587" name="data Table Load " total="0.000095"/> ---*snip 30 lines*---<Trace ts="2010/07/30 07:03:05.515 GMT" tid="1543" entry-no="18620">Import action:<LF/>--Skip: 0<LF/>--Create: 0<LF/>--Updated(NULL fields only): 0<LF/>--Updated (all mapped fields): 36<LF/>--Replace: 0<LF/>--Delete [destination]: 0<LF/>--Value Exceptions:0<LF/>--Import Exceptions: 0</Trace> <Trace ts="2010/07/30 07:03:05.516 GMT" tid="1543" entry-no="18621">xImporter: Total chunk import time:77000.000000000 milli-seconds.</Trace> <Trace ts="2010/07/30 07:03:07.511 GMT" tid="1543" entry-no="18622">xImporter: : Start -&gt; End: 1083000.000000000milli-seconds.</Trace><?xml version="1.0" encoding="utf-8"?><?xml-stylesheet type="text/xsl" href="MDM_Log.xsl"?> <Trace ts="2010/07/30 07:03:08.913 GMT" tid="1029" entry-no="18623">[MDS=syd1sap08 Repository=MDPClientSystem=Code_Template Port=Masterpack_Portal]: Chunk size/parallel[50000/40]: Import Task Finished.</Trace> </Open></MDM_Log> 16
    17. 17. Application Performance: MDM Import TimeTo This: 17
    18. 18. SAP Use Case 2: Throughput/CapacityABAP SAP Applications (e.g. ECC, CRM, BI) Dialog steps executed over time System activity expressed in SAPS Concurrent UsersSAP Master Data Management (MDM) Transaction throughput – Import/syndication 18
    19. 19. Dialog Steps Executed Over Time (Business Day) 19
    20. 20. Dialog Steps by Task Type 20
    21. 21. Dialog Steps Since Go Live 21
    22. 22. SAP Throughput as Represented by SAPS 22
    23. 23. Active vs. Inactive Concurrent Users 23
    24. 24. Active Users by Transaction Type 24
    25. 25. Active Users By Location 25
    26. 26. SAP Use Case 3: Network AnalysisWAN bandwidth consumption split by SAP applicationSAP vs. Non-SAP WAN bandwidth consumptionAverage WAN bandwidth footprint per SAP user 26
    27. 27. WAN Bandwidth Consumption by SAP Application 27
    28. 28. WAN Bandwidth Consumption – SAP vs. Non-SAP 28
    29. 29. Average WAN Footprint Per User 29
    30. 30. Bringing It All Together... 30
    31. 31. Bringing It Even More Together (SplunkForNagios) 31
    32. 32. Anticipated ChallengesHave a clear idea of what you are trying to achieveGet your Basis/SAP administrator on board! 32
    33. 33. The FutureSAP Enterprise PortalAuditingInvestigate implementing ST03/SM04 data output into databaseand index from there 33
    34. 34. Questions? 34

    ×