• Save
SplunkLive! Customer Presentation - Cequint
 

SplunkLive! Customer Presentation - Cequint

on

  • 576 views

 

Statistics

Views

Total Views
576
Views on SlideShare
576
Embed Views
0

Actions

Likes
0
Downloads
0
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

SplunkLive! Customer Presentation - Cequint SplunkLive! Customer Presentation - Cequint Presentation Transcript

  • SLA Compliance Assurance Charles Wheelus Senior Data Scientist, Cequint Splunk LIVE Baltimore December 12th, 2013 1 1
  • 2 2
  • About me: Charles Wheelus, MSCS • Senior Data Scientist, Cequint • Ph.D. Candidate, Florida Atlantic University research interests: Data Mining and Machine Learning • 2012 Splunk Ninja Revolution award recipient • Splunk Certified Architect • Technology consultant for 20 years • Splunk user and evangelist for three years • Started with version 4.3 3 3
  • About Cequint provides handset and Carrier data services to most major wireless carriers in the U.S. http://cequint.com 4 4
  • About 5 5
  • About 6 6
  • Service Level Agreement (SLA) Compliance Assurance Charles Wheelus December 12th, 2013 7 7
  • ...or How to kill a flock of birds with one stone Charles Wheelus December 12th, 2013 8 8
  • Disclaimer: No birds were injured during the production of this presentation. :) Charles Wheelus December 12th, 2013 9 9
  • SLA Compliance (on a Wireless Carrier network) The project: Develop a system that provides proof of our SLA compliance with our carrier customer Time is of the essence! Charles Wheelus December 12th, 2013 10 10
  • SLA Compliance Determine the Key Performance Indicators • Numerous subsystems • Different development teams • Different programming languages • Different operating systems • Wide variety of hardware types Charles Wheelus December 12th, 2013 11 11
  • SLA Compliance The “Cat Herder” Charles Wheelus December 12th, 2013 12 12
  • SLA Compliance Determine what data to get Study the SLA Engage others in the process • Developers • Management • Product team • Operations Charles Wheelus December 12th, 2013 13 13
  • SLA Compliance Determine the best place(s) to get the data from Charles Wheelus December 12th, 2013 14 14
  • SLA Compliance Establish best practice for data input What simple step can you take in the beginning that will save time later? Best practices document Verify the data is in the expected format! Charles Wheelus December 12th, 2013 15 15
  • SLA Compliance Determine transport method for getting the data into Splunk syslog UDP Charles Wheelus December 12th, 2013 16 16
  • SLA Compliance Determine transport method for getting the data into Splunk Universal Forwarder Charles Wheelus December 12th, 2013 17 17
  • SLA Compliance Determine transport method for getting the data into Splunk Charles Wheelus December 12th, 2013 18 18
  • SLA Compliance Determine transport method for getting the data into Splunk Charles Wheelus December 12th, 2013 18 18
  • SLA Compliance Determine transport method for getting the data into Splunk Charles Wheelus December 12th, 2013 18 18
  • SLA Compliance KPI Data flow diagram Charles Wheelus December 12th, 2013 19 19
  • SLA Compliance SLA report (RECAP): • Establish KPI • Get KPI data into Splunk • KPI counter aggregation and reconciliation • Use Splunk REST API to build the report Charles Wheelus December 12th, 2013 20 20
  • SLA Compliance SLA report (RECAP): • Establish KPI • Get KPI data into Splunk • KPI counter aggregation and reconciliation • Use Splunk REST API to build the report Charles Wheelus December 12th, 2013 20 20
  • SLA Compliance Charles Wheelus December 12th, 2013 21 21
  • Charles Wheelus December 12th, 2013 22 22
  • Charles Wheelus December 12th, 2013 22 22
  • “Black-box” testing The problem: Performance information about the Carrier’s self provisioning gateway is unavailable. We have to run our own tests to determine the expected performance Time is of the essence! Charles Wheelus December 12th, 2013 23 23
  • Charles Wheelus December 12th, 2013 24 24
  • Black Box Testing Charles Wheelus December 12th, 2013 25 25
  • Black Box Testing Charles Wheelus December 12th, 2013 25 25
  • Charles Wheelus December 12th, 2013 26 26
  • Charles Wheelus December 12th, 2013 26 26
  • Load test results analysis The problem: We need a quick way to evaluate the results of load testing. Time is of the essence! Charles Wheelus December 12th, 2013 27 27
  • Load test results analysis Charles Wheelus December 12th, 2013 28 28
  • Load test results analysis Charles Wheelus December 12th, 2013 28 28
  • Load test results analysis Charles Wheelus December 12th, 2013 29 29
  • Load test results analysis Charles Wheelus December 12th, 2013 29 29
  • Charles Wheelus December 12th, 2013 30 30
  • Charles Wheelus December 12th, 2013 30 30
  • Event Reporting The problem: Thousands of subsystem events may be generated into the log files, some events are inter-dependent. We need a comprehensive and robust system for detecting, correlating, and reporting these events to the correct development team. Time is of the essence! Charles Wheelus December 12th, 2013 31 31
  • Event Reporting The solution: Splunk saved and scheduled searches! With very brief training, the developers are building their own queries, saving and scheduling Charles Wheelus December 12th, 2013 32 32
  • Event Reporting Charles Wheelus December 12th, 2013 32 32
  • Event Reporting Charles Wheelus December 12th, 2013 32 32
  • Event Reporting Charles Wheelus December 12th, 2013 32 32
  • Charles Wheelus December 12th, 2013 33 33
  • Charles Wheelus December 12th, 2013 33 33
  • Event Monitoring and Alarming The problem: The operations team requires that the KPI produce alarm output into their preexisting monitoring and alarm system Time is of the essence! Charles Wheelus December 12th, 2013 34 34
  • Event Monitoring and Alarming • Operations has pre-existing alarming software • Splunk was connected to OPS alarm system using the Splunk API Charles Wheelus December 12th, 2013 35 35
  • Event Monitoring and Alarming Charles Wheelus December 12th, 2013 35 35
  • Charles Wheelus December 12th, 2013 36 36
  • Charles Wheelus December 12th, 2013 36 36
  • Performance Analysis The problem: The entire team needs to have up to the minute business intelligence. Time is of the essence! Charles Wheelus December 12th, 2013 37 37
  • Performance Analysis The answer: Splunk Dashboards and Apps! Charles Wheelus December 12th, 2013 38 38
  • Performance Analysis • Customized tools for Developers • Dashboards for Operations • Trouble shooting for Developers and Operations • Business Intelligence for Management Charles Wheelus December 12th, 2013 39 39
  • 40 40
  • 40 40
  • 40 40
  • 40 40
  • 40 40
  • 40 40
  • Cut to the chase Splunk’s greatest benefits: •Time savings •Ability to react quickly (SPL) •Real time analytics •Rapid dashboard production •The Splunk Community !! Charles Wheelus December 12th, 2013 41 41
  • What’s next? • New metrics & dashboards • Modular inputs • More use of Splunk 3rd party Apps • Predictive Analytics • Data Models / Pivots Charles Wheelus December 12th, 2013 42 42
  • Charles Wheelus December 12th, 2013 43 43
  • Charles Wheelus http://about.me/charleswheelus http://facebook.com/charleswheelus charles@wheelus.com 44 44