SlideShare a Scribd company logo
Copyright © 2015 Splunk Inc.
Innovate Better
Through Machine Data
Analytics
Hal Rottenberg, Global ITOA Practitioner
Splunk
1
Or…
How to Splunk your
DevOps
Or…
Hal really didn’t like
the first two titles,
thought way too long
on a third one, then
gave up and decided
that what really
mattered was the next
slide anyway
This is what I’m selling
“DEVOPS IS A SUPERSET, NOT A SUBSET”
Is this DevOps?
7
Development Operations
Is this DevOps?
8
Development Operations
This is DevOps!
9
DevOps
Development Operations
How Shall We Get There?
Culture
Data
Analysis
Continuous
Improvement
10
Defining DevOps
INTEGRATION
COLLABORATION
COMMUNICATION
BETWEEN DEV AND OPS
METHODS FOR IMPROVING
CAMS – as close to prescriptive as DevOps gets
BUT WHAT
SHOULD
YOU
MEASURE?
I’m working
super hard!!
That’s my
stapler.
Yeah, but …
… what are you
achieving?
I’m gonna need you
to come in Sunday.
Some DevOps Metrics that Might Matter
Culture
e.g.
• Retention
• Satisfaction
• Callouts
Process
e.g.
• Idea-to-cash
• MTTR
• Deliver time
Quality
e.g.
• Tests passed
• Tests failed
• Best/worst
Systems
e.g.
• Throughput
• Uptime
• Build times
Activity
e.g.
• Commits
• Tests run
• Releases
Impact
e.g.
• Signups
• Checkouts
• Revenue
From every tool, every process, every component, on-prem or off
Machine Data Is A
Critical Source Of
DevOps Metrics
Industry Leading Platform for Machine Data
Any Machine Data
Online
Services Web
Services
Servers
Security GPS
Location
Storage
Desktops
Networks
Packaged
Applications
Custom
ApplicationsMessaging
Telecoms
Online
Shopping
Cart
Web
Clickstreams
Databases
Energy
Meters
Call Detail
Records
Smartphones
and Devices
RFID
Datacenter
Private
Cloud
Public
Cloud
Enterprise
Scalability
Search and
Investigation
Proactive
Monitoring
Operational
Visibility
Real-time
Business
Insights
Operational Intelligence
Visibility Across the Ops Environment
API
SDKs UI
Server, Storage.
N/W
Server
Virtualization
Operating
Systems
Infrastructure
Applications
Mobile
Applications
Cloud Services
Other Tools
Ticketing/Help
Desk
No rigid schemas – add in data from any other source.
Custom
Applications
API Services
Visibility Across the Dev Lifecycle
API
SDKs UI
Other Tools
Escalation/
Collaboration
No rigid schemas – add in data from any other source.
Plan Code Build Test/QA Stage Release Config Monitor
INCREASE
VELOCITY
IMPROVE
QUALITY
DRIVE
IMPACT
Improve the Impact of Application Delivery
What DevOps Data
Can You Splunk?
Machine Data for Provisioning and Config
Machine Data from Pre-Prod/Staging
Machine Data From Testing and QA
Machine Data from Release Servers
Machine Data from Infrastructure Systems
Machine Data from Database Servers
Machine Data from Customer-Facing Systems
CI / Build
Server
Code
Review
Task
Tracking
What Data Can You Splunk?
Which code has already been reviewed for this release/sprint? Who has
completed the most code reviews? What code has NOT been reviewed?
Who is changing files? What kinds of files are being changed? What branches are
most active? What types of activities are occurring for a branch?
Version
Control
How many builds completed today/this week/this month? Which check-in kicked
off this build? Which tests ran against this failed build?
Which tasks are assigned to which developers? What progress is being made to
complete assigned tasks? What tasks remain for this release/sprint?
How Can You Splunk
DevOps?
Industry Leading Platform for Machine Data
Any Machine Data
Online
Services Web
Services
Servers
Security GPS
Location
Storage
Desktops
Networks
Packaged
Applications
Custom
ApplicationsMessaging
Telecoms
Online
Shopping
Cart
Web
Clickstreams
Databases
Energy
Meters
Call Detail
Records
Smartphones
and Devices
RFID
Datacenter
Private
Cloud
Public
Cloud
Enterprise
Scalability
Search and
Investigation
Proactive
Monitoring
Operational
Visibility
Real-time
Business
Insights
Operational Intelligence
Splunk Add-On for Jira
Github Modular Input
Puppet Enterprise App for Splunk
Chef App for Splunk
Splunk App for AWS
Splunk Add-on for Google Cloud Platform
Splunk Logging Driver for Docker
curl -k https://<host>:8088/services/collector -H 'Authorization: Splunk <token>' -d
'{"event":"Hello Event Collector"}'
Applications IoT Devices
Agentless, direct data onboarding via a standard API
HTTP Event Collector
Scales to Millions of Events/Second
AWS Lambda for HTTP Event Collector
Splunk App for Stream
Enables real-time
insights into private,
public and hybrid
cloud infrastructures
Delivers rapid
deployment, easy
scale out and efficient
wire data capture
Capture and analyze
critical events not
found in logs or with
other collection
methods.
1 2 3
Enhance Operational Intelligence With Wire Data Capture
Splunk MINT for Mobile Data
Deliver Better
Performing, More
Reliable Apps
Deliver Real-Time
Analytics
Achieve End-to-End
Visibility
PagerDuty App for Splunk
Copyright © 2015 Splunk Inc.
Why Use Splunk for
DevOps?
Machine Data To Enable Continuous
Improvement
Defect
Information
Capacity
Planning
Quality
Standards
Enhancement
Requests
Integration
Requirements
Acceptance
Metrics
Service Levels
and KPIs
Application Development Test and Acceptance Production
BuildCodePlan Test/QA Stage Release Config Monitor
Infrastructure
Dependencies
Increase Delivery Velocity
DevOps Teams Iterate with
Continuous Insights
Product Managers
identify new
opportunities
Code Continuously delivered
to market
Auditors
have visibility
Customers
are happy
Improve Code Quality
Code quality scans Static security scans
White BoxDevelopers
check in code
Automated
Acceptance Tests
Dynamic Security
Scans
Black Box
“Chaos Monkey”
tests
Test Fail:
Return
Test Fail:
Return
X
X
Production
QA Prod Pattern
QA Pattern Library
Test Pass:
Promote
Test Pass:
Promote to
Production
Pattern
library used
for test and
QA
Align With Business Impact
In Closing…
INCREASE
VELOCITY
IMPROVE
QUALITY
DRIVE
IMPACT
Improve the Impact of Application Delivery
A Reminder
“DEVOPS IS A SUPERSET, NOT A SUBSET”
- HAL ROTTENBERG, MAY 2016
Where to go for more Info
● DevOps Videos, Customer Stories, Whitepapers
‣ http://splunk.com/DevOps
– Developer Tutorials, Code Samples, Downloads
– http://dev.splunk.com
● Splunk Apps and Plugins
– https://splunkbase.splunk.com
● Blogs for Dev, Ops, and DevOps
– http://blogs.splunk.com
53
54
Bonus Content
55
Splunk for Developers
Real-time dashboards show error rate
in production and impact of pushing
new builds
Developers can search and visualize
web logs, Java logs, eventlogs etc;
trace tx without complex
instrumentation
Alerts notify developers as soon as a
problem arises
57
Find and Fix Issues Faster
Gain end-to-end visibility to make
informed decisions
Analytics insights without the need for
additional analytics tools
Ask questions while exploring and
collecting data
58
Push Better Code Using Analytics
Powerful Platform for Enterprise Developers
59
REST API
Build Splunk Apps Extend and Integrate Splunk
Simple XML
JavaScript/CSS Extensions C#
JavaScript
Python
Ruby
Java
PHP
Data Models
Search Extensibility
Modular Inputs
SDKs
KV Store
Splunk Developer Guidance
Splunk Reference Apps
Complete, working real-world Splunk solutions
built together with partners (Conducive; Auth0)
̶ 2 (pseudo-) production releases
̶ entire code & test repos on GitHub
̶ under Apache 2.0
Associated Guidance
I. Start-to-Finish Journey Documentary
II. Essentials


dev.splunk.com/goto/devguide
Splunk in Real World
DevOps Use Cases
Successful Businesses Use Splunk for DevOps
63
Improved DevOps Agility
63
Key Customer Benefits
• Increased success rate of deployments
• Detect issues before they affect broad production
• Monitoring deployment process several times per day
-Robert Gonsalves,
Web Operations
“It’s like we were working
without peripheral vision
before and now we have it.”
64
Deliver Better Code Quality
Key Customer Benefits
-Principal Engineer,
Apollo Group
“Developers are now able to look
for errors and troubleshoot issues
five to ten times faster by having
all their event data centralized in
Splunk.”
• Provide full visibility into QA sanity and load testing
before production
• Exceed SLA thresholds with full visibility and benchmark
key infrastructure metrics and errors
• Easier troubleshooting if tests do not contain the
expected results
65
Enable Data-driven Continuous Delivery
-Alison Perkins,
Senior Systems Engineer
“ Dump all the logs into Splunk,
and it starts looking like one big
system, instead of a bazillion
teeny ones that hate each
other.”
Key Customer Benefits
• Quickly validate and troubleshoot code pushes to
production
• Ensure that new code does not negatively impact
performance or user experience
• Reduced one application’s error rate by 2 orders of
magnitude in a matter of weeks

More Related Content

What's hot

Boston DevOps Days 2016: Implementing Metrics Driven DevOps - Why and How
Boston DevOps Days 2016: Implementing Metrics Driven DevOps - Why and HowBoston DevOps Days 2016: Implementing Metrics Driven DevOps - Why and How
Boston DevOps Days 2016: Implementing Metrics Driven DevOps - Why and How
Andreas Grabner
 
WSO2 Guest Webinar: Building Enterprise Awareness with API Analytics in the A...
WSO2 Guest Webinar: Building Enterprise Awareness with API Analytics in the A...WSO2 Guest Webinar: Building Enterprise Awareness with API Analytics in the A...
WSO2 Guest Webinar: Building Enterprise Awareness with API Analytics in the A...
WSO2
 
Cerner at SplunkLive! Minneapolis
Cerner at SplunkLive! MinneapolisCerner at SplunkLive! Minneapolis
Cerner at SplunkLive! Minneapolis
Splunk
 
Deploying web apis on core clr to docker
Deploying web apis on core clr to dockerDeploying web apis on core clr to docker
Deploying web apis on core clr to docker
Glenn Block
 
Application Quality Gates in Continuous Delivery: Deliver Better Software Fas...
Application Quality Gates in Continuous Delivery: Deliver Better Software Fas...Application Quality Gates in Continuous Delivery: Deliver Better Software Fas...
Application Quality Gates in Continuous Delivery: Deliver Better Software Fas...
Andreas Grabner
 
Improving data interoperability in Python and R
Improving data interoperability in Python and RImproving data interoperability in Python and R
Improving data interoperability in Python and R
Wes McKinney
 
Splunk at Sabre
Splunk at SabreSplunk at Sabre
Splunk at Sabre
Splunk
 
Enterprise Search Europe 2015: Fishing the big data streams - the future of ...
Enterprise Search Europe 2015:  Fishing the big data streams - the future of ...Enterprise Search Europe 2015:  Fishing the big data streams - the future of ...
Enterprise Search Europe 2015: Fishing the big data streams - the future of ...
Charlie Hull
 
Adopting a security attitude in DevOps via DevOpsSec
Adopting a security attitude in DevOps via DevOpsSecAdopting a security attitude in DevOps via DevOpsSec
Adopting a security attitude in DevOps via DevOpsSec
Tapabrata Pal
 
Building an Open Source AppSec Pipeline - 2015 Texas Linux Fest
Building an Open Source AppSec Pipeline - 2015 Texas Linux FestBuilding an Open Source AppSec Pipeline - 2015 Texas Linux Fest
Building an Open Source AppSec Pipeline - 2015 Texas Linux Fest
Matt Tesauro
 
Taking the Best of Agile, DevOps and CI/CD into security
Taking the Best of Agile, DevOps and CI/CD into securityTaking the Best of Agile, DevOps and CI/CD into security
Taking the Best of Agile, DevOps and CI/CD into security
Matt Tesauro
 
GraphQL Europe Recap
GraphQL Europe RecapGraphQL Europe Recap
GraphQL Europe Recap
Philipp Sporrer
 
OOP 2016 - Building Software That Eats The World
OOP 2016 - Building Software That Eats The WorldOOP 2016 - Building Software That Eats The World
OOP 2016 - Building Software That Eats The World
Andreas Grabner
 
Data Science Challenges in Personal Program Analysis
Data Science Challenges in Personal Program AnalysisData Science Challenges in Personal Program Analysis
Data Science Challenges in Personal Program Analysis
Work-Bench
 
APIdays Paris 2018 - Deliver API Updates in Real Time with Mercure.rocks Kévi...
APIdays Paris 2018 - Deliver API Updates in Real Time with Mercure.rocks Kévi...APIdays Paris 2018 - Deliver API Updates in Real Time with Mercure.rocks Kévi...
APIdays Paris 2018 - Deliver API Updates in Real Time with Mercure.rocks Kévi...
apidays
 
GraphQL Munich Meetup #1 - How We Use GraphQL At Commercetools
GraphQL Munich Meetup #1 - How We Use GraphQL At CommercetoolsGraphQL Munich Meetup #1 - How We Use GraphQL At Commercetools
GraphQL Munich Meetup #1 - How We Use GraphQL At Commercetools
Nicola Molinari
 
Scaling Analysis Responsibly
Scaling Analysis ResponsiblyScaling Analysis Responsibly
Scaling Analysis Responsibly
Work-Bench
 
Taking AppSec to 11: AppSec Pipeline, DevOps and Making Things Better
Taking AppSec to 11: AppSec Pipeline, DevOps and Making Things BetterTaking AppSec to 11: AppSec Pipeline, DevOps and Making Things Better
Taking AppSec to 11: AppSec Pipeline, DevOps and Making Things Better
Matt Tesauro
 
Purple is the New Black: Modern Approaches for Application Security
Purple is the New Black: Modern Approaches for Application SecurityPurple is the New Black: Modern Approaches for Application Security
Purple is the New Black: Modern Approaches for Application Security
Tanya Janca
 
AppSec Pipelines and Event based Security
AppSec Pipelines and Event based SecurityAppSec Pipelines and Event based Security
AppSec Pipelines and Event based Security
Matt Tesauro
 

What's hot (20)

Boston DevOps Days 2016: Implementing Metrics Driven DevOps - Why and How
Boston DevOps Days 2016: Implementing Metrics Driven DevOps - Why and HowBoston DevOps Days 2016: Implementing Metrics Driven DevOps - Why and How
Boston DevOps Days 2016: Implementing Metrics Driven DevOps - Why and How
 
WSO2 Guest Webinar: Building Enterprise Awareness with API Analytics in the A...
WSO2 Guest Webinar: Building Enterprise Awareness with API Analytics in the A...WSO2 Guest Webinar: Building Enterprise Awareness with API Analytics in the A...
WSO2 Guest Webinar: Building Enterprise Awareness with API Analytics in the A...
 
Cerner at SplunkLive! Minneapolis
Cerner at SplunkLive! MinneapolisCerner at SplunkLive! Minneapolis
Cerner at SplunkLive! Minneapolis
 
Deploying web apis on core clr to docker
Deploying web apis on core clr to dockerDeploying web apis on core clr to docker
Deploying web apis on core clr to docker
 
Application Quality Gates in Continuous Delivery: Deliver Better Software Fas...
Application Quality Gates in Continuous Delivery: Deliver Better Software Fas...Application Quality Gates in Continuous Delivery: Deliver Better Software Fas...
Application Quality Gates in Continuous Delivery: Deliver Better Software Fas...
 
Improving data interoperability in Python and R
Improving data interoperability in Python and RImproving data interoperability in Python and R
Improving data interoperability in Python and R
 
Splunk at Sabre
Splunk at SabreSplunk at Sabre
Splunk at Sabre
 
Enterprise Search Europe 2015: Fishing the big data streams - the future of ...
Enterprise Search Europe 2015:  Fishing the big data streams - the future of ...Enterprise Search Europe 2015:  Fishing the big data streams - the future of ...
Enterprise Search Europe 2015: Fishing the big data streams - the future of ...
 
Adopting a security attitude in DevOps via DevOpsSec
Adopting a security attitude in DevOps via DevOpsSecAdopting a security attitude in DevOps via DevOpsSec
Adopting a security attitude in DevOps via DevOpsSec
 
Building an Open Source AppSec Pipeline - 2015 Texas Linux Fest
Building an Open Source AppSec Pipeline - 2015 Texas Linux FestBuilding an Open Source AppSec Pipeline - 2015 Texas Linux Fest
Building an Open Source AppSec Pipeline - 2015 Texas Linux Fest
 
Taking the Best of Agile, DevOps and CI/CD into security
Taking the Best of Agile, DevOps and CI/CD into securityTaking the Best of Agile, DevOps and CI/CD into security
Taking the Best of Agile, DevOps and CI/CD into security
 
GraphQL Europe Recap
GraphQL Europe RecapGraphQL Europe Recap
GraphQL Europe Recap
 
OOP 2016 - Building Software That Eats The World
OOP 2016 - Building Software That Eats The WorldOOP 2016 - Building Software That Eats The World
OOP 2016 - Building Software That Eats The World
 
Data Science Challenges in Personal Program Analysis
Data Science Challenges in Personal Program AnalysisData Science Challenges in Personal Program Analysis
Data Science Challenges in Personal Program Analysis
 
APIdays Paris 2018 - Deliver API Updates in Real Time with Mercure.rocks Kévi...
APIdays Paris 2018 - Deliver API Updates in Real Time with Mercure.rocks Kévi...APIdays Paris 2018 - Deliver API Updates in Real Time with Mercure.rocks Kévi...
APIdays Paris 2018 - Deliver API Updates in Real Time with Mercure.rocks Kévi...
 
GraphQL Munich Meetup #1 - How We Use GraphQL At Commercetools
GraphQL Munich Meetup #1 - How We Use GraphQL At CommercetoolsGraphQL Munich Meetup #1 - How We Use GraphQL At Commercetools
GraphQL Munich Meetup #1 - How We Use GraphQL At Commercetools
 
Scaling Analysis Responsibly
Scaling Analysis ResponsiblyScaling Analysis Responsibly
Scaling Analysis Responsibly
 
Taking AppSec to 11: AppSec Pipeline, DevOps and Making Things Better
Taking AppSec to 11: AppSec Pipeline, DevOps and Making Things BetterTaking AppSec to 11: AppSec Pipeline, DevOps and Making Things Better
Taking AppSec to 11: AppSec Pipeline, DevOps and Making Things Better
 
Purple is the New Black: Modern Approaches for Application Security
Purple is the New Black: Modern Approaches for Application SecurityPurple is the New Black: Modern Approaches for Application Security
Purple is the New Black: Modern Approaches for Application Security
 
AppSec Pipelines and Event based Security
AppSec Pipelines and Event based SecurityAppSec Pipelines and Event based Security
AppSec Pipelines and Event based Security
 

Viewers also liked

Are You Ready For The Omni-Channel Era?
Are You Ready For The Omni-Channel Era? Are You Ready For The Omni-Channel Era?
Are You Ready For The Omni-Channel Era?
SPS Commerce
 
Eduketing 2015- Antes y después de Eduketing: Camino de la salvación. El caso...
Eduketing 2015- Antes y después de Eduketing: Camino de la salvación. El caso...Eduketing 2015- Antes y después de Eduketing: Camino de la salvación. El caso...
Eduketing 2015- Antes y después de Eduketing: Camino de la salvación. El caso...
EDUKETING
 
Security As A Code :
Security As A Code : Security As A Code :
Exploiting Blind Vulnerabilities
Exploiting Blind VulnerabilitiesExploiting Blind Vulnerabilities
Exploiting Blind Vulnerabilities
Pichaya Morimoto
 
IT Operation Analytic for security- MiSSconf(sp1)
IT Operation Analytic for security- MiSSconf(sp1)IT Operation Analytic for security- MiSSconf(sp1)
IT Operation Analytic for security- MiSSconf(sp1)
stelligence
 
Accelerate Troubleshooting and Reinvent Monitoring with Interactive Visualiza...
Accelerate Troubleshooting and Reinvent Monitoring with Interactive Visualiza...Accelerate Troubleshooting and Reinvent Monitoring with Interactive Visualiza...
Accelerate Troubleshooting and Reinvent Monitoring with Interactive Visualiza...
Splunk
 
Unlock Security Insight from Machine Data
Unlock Security Insight from Machine DataUnlock Security Insight from Machine Data
Unlock Security Insight from Machine Data
Narudom Roongsiriwong, CISSP
 
Secure Code Review 101
Secure Code Review 101Secure Code Review 101
Secure Code Review 101
Narudom Roongsiriwong, CISSP
 
Data-Driven Marketing Roadshow Splunk - March 26, 2014
Data-Driven Marketing Roadshow Splunk - March 26, 2014Data-Driven Marketing Roadshow Splunk - March 26, 2014
Data-Driven Marketing Roadshow Splunk - March 26, 2014
DDM Alliance
 

Viewers also liked (9)

Are You Ready For The Omni-Channel Era?
Are You Ready For The Omni-Channel Era? Are You Ready For The Omni-Channel Era?
Are You Ready For The Omni-Channel Era?
 
Eduketing 2015- Antes y después de Eduketing: Camino de la salvación. El caso...
Eduketing 2015- Antes y después de Eduketing: Camino de la salvación. El caso...Eduketing 2015- Antes y después de Eduketing: Camino de la salvación. El caso...
Eduketing 2015- Antes y después de Eduketing: Camino de la salvación. El caso...
 
Security As A Code :
Security As A Code : Security As A Code :
Security As A Code :
 
Exploiting Blind Vulnerabilities
Exploiting Blind VulnerabilitiesExploiting Blind Vulnerabilities
Exploiting Blind Vulnerabilities
 
IT Operation Analytic for security- MiSSconf(sp1)
IT Operation Analytic for security- MiSSconf(sp1)IT Operation Analytic for security- MiSSconf(sp1)
IT Operation Analytic for security- MiSSconf(sp1)
 
Accelerate Troubleshooting and Reinvent Monitoring with Interactive Visualiza...
Accelerate Troubleshooting and Reinvent Monitoring with Interactive Visualiza...Accelerate Troubleshooting and Reinvent Monitoring with Interactive Visualiza...
Accelerate Troubleshooting and Reinvent Monitoring with Interactive Visualiza...
 
Unlock Security Insight from Machine Data
Unlock Security Insight from Machine DataUnlock Security Insight from Machine Data
Unlock Security Insight from Machine Data
 
Secure Code Review 101
Secure Code Review 101Secure Code Review 101
Secure Code Review 101
 
Data-Driven Marketing Roadshow Splunk - March 26, 2014
Data-Driven Marketing Roadshow Splunk - March 26, 2014Data-Driven Marketing Roadshow Splunk - March 26, 2014
Data-Driven Marketing Roadshow Splunk - March 26, 2014
 

Similar to Innovate Better Through Machine data Analytics

SplunkLive! London 2016 Splunk for Devops
SplunkLive! London 2016 Splunk for DevopsSplunkLive! London 2016 Splunk for Devops
SplunkLive! London 2016 Splunk for Devops
Splunk
 
Listen to Your Machines: DevOps Analytics for Better Feedback Loops
Listen to Your Machines: DevOps Analytics for Better Feedback LoopsListen to Your Machines: DevOps Analytics for Better Feedback Loops
Listen to Your Machines: DevOps Analytics for Better Feedback Loops
Splunk
 
Data-Driven DevOps: Mining Machine Data for 'Metrics that Matter' in a DevOps...
Data-Driven DevOps: Mining Machine Data for 'Metrics that Matter' in a DevOps...Data-Driven DevOps: Mining Machine Data for 'Metrics that Matter' in a DevOps...
Data-Driven DevOps: Mining Machine Data for 'Metrics that Matter' in a DevOps...
Splunk
 
Data-Driven DevOps: Improve Velocity and Quality of Software Delivery with Me...
Data-Driven DevOps: Improve Velocity and Quality of Software Delivery with Me...Data-Driven DevOps: Improve Velocity and Quality of Software Delivery with Me...
Data-Driven DevOps: Improve Velocity and Quality of Software Delivery with Me...
Splunk
 
Agile & DevOps - It's all about project success
Agile & DevOps - It's all about project successAgile & DevOps - It's all about project success
Agile & DevOps - It's all about project success
Adam Stephensen
 
Devops Powered by Splunk
Devops Powered by SplunkDevops Powered by Splunk
Devops Powered by Splunk
Splunk
 
SplunkLive! London 2015 - DevOps Breakout
SplunkLive! London 2015 - DevOps BreakoutSplunkLive! London 2015 - DevOps Breakout
SplunkLive! London 2015 - DevOps Breakout
Splunk
 
DevOps and Splunk
DevOps and SplunkDevOps and Splunk
DevOps and Splunk
Splunk
 
Creating a DevOps Practice for Analytics -- Strata Data, September 28, 2017
Creating a DevOps Practice for Analytics -- Strata Data, September 28, 2017Creating a DevOps Practice for Analytics -- Strata Data, September 28, 2017
Creating a DevOps Practice for Analytics -- Strata Data, September 28, 2017
Caserta
 
DevOps Powered by Splunk
DevOps Powered by SplunkDevOps Powered by Splunk
DevOps Powered by Splunk
Splunk
 
Continuous Testing: A Key to DevOps Success
Continuous Testing: A Key to DevOps SuccessContinuous Testing: A Key to DevOps Success
Continuous Testing: A Key to DevOps Success
TechWell
 
Keys to Continuous Delivery Success - Mark Warren, Product Director, Perforc...
Keys to Continuous  Delivery Success - Mark Warren, Product Director, Perforc...Keys to Continuous  Delivery Success - Mark Warren, Product Director, Perforc...
Keys to Continuous Delivery Success - Mark Warren, Product Director, Perforc...
Perforce
 
Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0
Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0
Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0
minseok kim
 
From 0 to DevOps in 80 Days [Webinar Replay]
From 0 to DevOps in 80 Days [Webinar Replay]From 0 to DevOps in 80 Days [Webinar Replay]
From 0 to DevOps in 80 Days [Webinar Replay]
Dynatrace
 
Keys to continuous testing for faster delivery euro star webinar
Keys to continuous testing for faster delivery euro star webinar Keys to continuous testing for faster delivery euro star webinar
Keys to continuous testing for faster delivery euro star webinar
TEST Huddle
 
DevOps For Everyone: Bringing DevOps Success to Every App and Every Role in y...
DevOps For Everyone: Bringing DevOps Success to Every App and Every Role in y...DevOps For Everyone: Bringing DevOps Success to Every App and Every Role in y...
DevOps For Everyone: Bringing DevOps Success to Every App and Every Role in y...
Siva Rama Krishna Chunduru
 
From Monoliths to Microservices at Realestate.com.au
From Monoliths to Microservices at Realestate.com.auFrom Monoliths to Microservices at Realestate.com.au
From Monoliths to Microservices at Realestate.com.au
evanbottcher
 
How Azure DevOps can boost your organization's productivity
How Azure DevOps can boost your organization's productivityHow Azure DevOps can boost your organization's productivity
How Azure DevOps can boost your organization's productivity
Ivan Porta
 
Enterprise Devops Presentation @ Magentys Seminar London May 15 2014
Enterprise Devops Presentation @ Magentys Seminar London May 15 2014Enterprise Devops Presentation @ Magentys Seminar London May 15 2014
Enterprise Devops Presentation @ Magentys Seminar London May 15 2014
Jwooldridge
 
Data Engineer's Lunch #68: DevOps Fundamentals
Data Engineer's Lunch #68: DevOps FundamentalsData Engineer's Lunch #68: DevOps Fundamentals
Data Engineer's Lunch #68: DevOps Fundamentals
Anant Corporation
 

Similar to Innovate Better Through Machine data Analytics (20)

SplunkLive! London 2016 Splunk for Devops
SplunkLive! London 2016 Splunk for DevopsSplunkLive! London 2016 Splunk for Devops
SplunkLive! London 2016 Splunk for Devops
 
Listen to Your Machines: DevOps Analytics for Better Feedback Loops
Listen to Your Machines: DevOps Analytics for Better Feedback LoopsListen to Your Machines: DevOps Analytics for Better Feedback Loops
Listen to Your Machines: DevOps Analytics for Better Feedback Loops
 
Data-Driven DevOps: Mining Machine Data for 'Metrics that Matter' in a DevOps...
Data-Driven DevOps: Mining Machine Data for 'Metrics that Matter' in a DevOps...Data-Driven DevOps: Mining Machine Data for 'Metrics that Matter' in a DevOps...
Data-Driven DevOps: Mining Machine Data for 'Metrics that Matter' in a DevOps...
 
Data-Driven DevOps: Improve Velocity and Quality of Software Delivery with Me...
Data-Driven DevOps: Improve Velocity and Quality of Software Delivery with Me...Data-Driven DevOps: Improve Velocity and Quality of Software Delivery with Me...
Data-Driven DevOps: Improve Velocity and Quality of Software Delivery with Me...
 
Agile & DevOps - It's all about project success
Agile & DevOps - It's all about project successAgile & DevOps - It's all about project success
Agile & DevOps - It's all about project success
 
Devops Powered by Splunk
Devops Powered by SplunkDevops Powered by Splunk
Devops Powered by Splunk
 
SplunkLive! London 2015 - DevOps Breakout
SplunkLive! London 2015 - DevOps BreakoutSplunkLive! London 2015 - DevOps Breakout
SplunkLive! London 2015 - DevOps Breakout
 
DevOps and Splunk
DevOps and SplunkDevOps and Splunk
DevOps and Splunk
 
Creating a DevOps Practice for Analytics -- Strata Data, September 28, 2017
Creating a DevOps Practice for Analytics -- Strata Data, September 28, 2017Creating a DevOps Practice for Analytics -- Strata Data, September 28, 2017
Creating a DevOps Practice for Analytics -- Strata Data, September 28, 2017
 
DevOps Powered by Splunk
DevOps Powered by SplunkDevOps Powered by Splunk
DevOps Powered by Splunk
 
Continuous Testing: A Key to DevOps Success
Continuous Testing: A Key to DevOps SuccessContinuous Testing: A Key to DevOps Success
Continuous Testing: A Key to DevOps Success
 
Keys to Continuous Delivery Success - Mark Warren, Product Director, Perforc...
Keys to Continuous  Delivery Success - Mark Warren, Product Director, Perforc...Keys to Continuous  Delivery Success - Mark Warren, Product Director, Perforc...
Keys to Continuous Delivery Success - Mark Warren, Product Director, Perforc...
 
Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0
Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0
Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0
 
From 0 to DevOps in 80 Days [Webinar Replay]
From 0 to DevOps in 80 Days [Webinar Replay]From 0 to DevOps in 80 Days [Webinar Replay]
From 0 to DevOps in 80 Days [Webinar Replay]
 
Keys to continuous testing for faster delivery euro star webinar
Keys to continuous testing for faster delivery euro star webinar Keys to continuous testing for faster delivery euro star webinar
Keys to continuous testing for faster delivery euro star webinar
 
DevOps For Everyone: Bringing DevOps Success to Every App and Every Role in y...
DevOps For Everyone: Bringing DevOps Success to Every App and Every Role in y...DevOps For Everyone: Bringing DevOps Success to Every App and Every Role in y...
DevOps For Everyone: Bringing DevOps Success to Every App and Every Role in y...
 
From Monoliths to Microservices at Realestate.com.au
From Monoliths to Microservices at Realestate.com.auFrom Monoliths to Microservices at Realestate.com.au
From Monoliths to Microservices at Realestate.com.au
 
How Azure DevOps can boost your organization's productivity
How Azure DevOps can boost your organization's productivityHow Azure DevOps can boost your organization's productivity
How Azure DevOps can boost your organization's productivity
 
Enterprise Devops Presentation @ Magentys Seminar London May 15 2014
Enterprise Devops Presentation @ Magentys Seminar London May 15 2014Enterprise Devops Presentation @ Magentys Seminar London May 15 2014
Enterprise Devops Presentation @ Magentys Seminar London May 15 2014
 
Data Engineer's Lunch #68: DevOps Fundamentals
Data Engineer's Lunch #68: DevOps FundamentalsData Engineer's Lunch #68: DevOps Fundamentals
Data Engineer's Lunch #68: DevOps Fundamentals
 

Recently uploaded

Hand Rolled Applicative User Validation Code Kata
Hand Rolled Applicative User ValidationCode KataHand Rolled Applicative User ValidationCode Kata
Hand Rolled Applicative User Validation Code Kata
Philip Schwarz
 
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI AppAI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
Google
 
socradar-q1-2024-aviation-industry-report.pdf
socradar-q1-2024-aviation-industry-report.pdfsocradar-q1-2024-aviation-industry-report.pdf
socradar-q1-2024-aviation-industry-report.pdf
SOCRadar
 
Fundamentals of Programming and Language Processors
Fundamentals of Programming and Language ProcessorsFundamentals of Programming and Language Processors
Fundamentals of Programming and Language Processors
Rakesh Kumar R
 
Codeigniter VS Cakephp Which is Better for Web Development.pdf
Codeigniter VS Cakephp Which is Better for Web Development.pdfCodeigniter VS Cakephp Which is Better for Web Development.pdf
Codeigniter VS Cakephp Which is Better for Web Development.pdf
Semiosis Software Private Limited
 
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptxTop Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
rickgrimesss22
 
Graspan: A Big Data System for Big Code Analysis
Graspan: A Big Data System for Big Code AnalysisGraspan: A Big Data System for Big Code Analysis
Graspan: A Big Data System for Big Code Analysis
Aftab Hussain
 
A Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of PassageA Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of Passage
Philip Schwarz
 
Preparing Non - Technical Founders for Engaging a Tech Agency
Preparing Non - Technical Founders for Engaging  a  Tech AgencyPreparing Non - Technical Founders for Engaging  a  Tech Agency
Preparing Non - Technical Founders for Engaging a Tech Agency
ISH Technologies
 
May Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdfMay Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdf
Adele Miller
 
Transform Your Communication with Cloud-Based IVR Solutions
Transform Your Communication with Cloud-Based IVR SolutionsTransform Your Communication with Cloud-Based IVR Solutions
Transform Your Communication with Cloud-Based IVR Solutions
TheSMSPoint
 
GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)
GOING AOT WITH GRAALVM FOR  SPRING BOOT (SPRING IO)GOING AOT WITH GRAALVM FOR  SPRING BOOT (SPRING IO)
GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)
Alina Yurenko
 
DDS-Security 1.2 - What's New? Stronger security for long-running systems
DDS-Security 1.2 - What's New? Stronger security for long-running systemsDDS-Security 1.2 - What's New? Stronger security for long-running systems
DDS-Security 1.2 - What's New? Stronger security for long-running systems
Gerardo Pardo-Castellote
 
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata
 
SWEBOK and Education at FUSE Okinawa 2024
SWEBOK and Education at FUSE Okinawa 2024SWEBOK and Education at FUSE Okinawa 2024
SWEBOK and Education at FUSE Okinawa 2024
Hironori Washizaki
 
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
mz5nrf0n
 
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit ParisNeo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j
 
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Crescat
 
Launch Your Streaming Platforms in Minutes
Launch Your Streaming Platforms in MinutesLaunch Your Streaming Platforms in Minutes
Launch Your Streaming Platforms in Minutes
Roshan Dwivedi
 
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Need for Speed: Removing speed bumps from your Symfony projects ⚡️Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Łukasz Chruściel
 

Recently uploaded (20)

Hand Rolled Applicative User Validation Code Kata
Hand Rolled Applicative User ValidationCode KataHand Rolled Applicative User ValidationCode Kata
Hand Rolled Applicative User Validation Code Kata
 
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI AppAI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
 
socradar-q1-2024-aviation-industry-report.pdf
socradar-q1-2024-aviation-industry-report.pdfsocradar-q1-2024-aviation-industry-report.pdf
socradar-q1-2024-aviation-industry-report.pdf
 
Fundamentals of Programming and Language Processors
Fundamentals of Programming and Language ProcessorsFundamentals of Programming and Language Processors
Fundamentals of Programming and Language Processors
 
Codeigniter VS Cakephp Which is Better for Web Development.pdf
Codeigniter VS Cakephp Which is Better for Web Development.pdfCodeigniter VS Cakephp Which is Better for Web Development.pdf
Codeigniter VS Cakephp Which is Better for Web Development.pdf
 
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptxTop Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
 
Graspan: A Big Data System for Big Code Analysis
Graspan: A Big Data System for Big Code AnalysisGraspan: A Big Data System for Big Code Analysis
Graspan: A Big Data System for Big Code Analysis
 
A Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of PassageA Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of Passage
 
Preparing Non - Technical Founders for Engaging a Tech Agency
Preparing Non - Technical Founders for Engaging  a  Tech AgencyPreparing Non - Technical Founders for Engaging  a  Tech Agency
Preparing Non - Technical Founders for Engaging a Tech Agency
 
May Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdfMay Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdf
 
Transform Your Communication with Cloud-Based IVR Solutions
Transform Your Communication with Cloud-Based IVR SolutionsTransform Your Communication with Cloud-Based IVR Solutions
Transform Your Communication with Cloud-Based IVR Solutions
 
GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)
GOING AOT WITH GRAALVM FOR  SPRING BOOT (SPRING IO)GOING AOT WITH GRAALVM FOR  SPRING BOOT (SPRING IO)
GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)
 
DDS-Security 1.2 - What's New? Stronger security for long-running systems
DDS-Security 1.2 - What's New? Stronger security for long-running systemsDDS-Security 1.2 - What's New? Stronger security for long-running systems
DDS-Security 1.2 - What's New? Stronger security for long-running systems
 
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024
 
SWEBOK and Education at FUSE Okinawa 2024
SWEBOK and Education at FUSE Okinawa 2024SWEBOK and Education at FUSE Okinawa 2024
SWEBOK and Education at FUSE Okinawa 2024
 
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
 
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit ParisNeo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
 
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
 
Launch Your Streaming Platforms in Minutes
Launch Your Streaming Platforms in MinutesLaunch Your Streaming Platforms in Minutes
Launch Your Streaming Platforms in Minutes
 
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Need for Speed: Removing speed bumps from your Symfony projects ⚡️Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
 

Innovate Better Through Machine data Analytics

  • 1. Copyright © 2015 Splunk Inc. Innovate Better Through Machine Data Analytics Hal Rottenberg, Global ITOA Practitioner Splunk 1
  • 3. How to Splunk your DevOps
  • 5. Hal really didn’t like the first two titles, thought way too long on a third one, then gave up and decided that what really mattered was the next slide anyway
  • 6. This is what I’m selling “DEVOPS IS A SUPERSET, NOT A SUBSET”
  • 10. How Shall We Get There? Culture Data Analysis Continuous Improvement 10
  • 12. CAMS – as close to prescriptive as DevOps gets
  • 15. Yeah, but … … what are you achieving? I’m gonna need you to come in Sunday.
  • 16. Some DevOps Metrics that Might Matter Culture e.g. • Retention • Satisfaction • Callouts Process e.g. • Idea-to-cash • MTTR • Deliver time Quality e.g. • Tests passed • Tests failed • Best/worst Systems e.g. • Throughput • Uptime • Build times Activity e.g. • Commits • Tests run • Releases Impact e.g. • Signups • Checkouts • Revenue
  • 17. From every tool, every process, every component, on-prem or off Machine Data Is A Critical Source Of DevOps Metrics
  • 18. Industry Leading Platform for Machine Data Any Machine Data Online Services Web Services Servers Security GPS Location Storage Desktops Networks Packaged Applications Custom ApplicationsMessaging Telecoms Online Shopping Cart Web Clickstreams Databases Energy Meters Call Detail Records Smartphones and Devices RFID Datacenter Private Cloud Public Cloud Enterprise Scalability Search and Investigation Proactive Monitoring Operational Visibility Real-time Business Insights Operational Intelligence
  • 19. Visibility Across the Ops Environment API SDKs UI Server, Storage. N/W Server Virtualization Operating Systems Infrastructure Applications Mobile Applications Cloud Services Other Tools Ticketing/Help Desk No rigid schemas – add in data from any other source. Custom Applications API Services
  • 20. Visibility Across the Dev Lifecycle API SDKs UI Other Tools Escalation/ Collaboration No rigid schemas – add in data from any other source. Plan Code Build Test/QA Stage Release Config Monitor
  • 22. What DevOps Data Can You Splunk?
  • 23. Machine Data for Provisioning and Config
  • 24. Machine Data from Pre-Prod/Staging
  • 25. Machine Data From Testing and QA
  • 26. Machine Data from Release Servers
  • 27. Machine Data from Infrastructure Systems
  • 28. Machine Data from Database Servers
  • 29. Machine Data from Customer-Facing Systems
  • 30. CI / Build Server Code Review Task Tracking What Data Can You Splunk? Which code has already been reviewed for this release/sprint? Who has completed the most code reviews? What code has NOT been reviewed? Who is changing files? What kinds of files are being changed? What branches are most active? What types of activities are occurring for a branch? Version Control How many builds completed today/this week/this month? Which check-in kicked off this build? Which tests ran against this failed build? Which tasks are assigned to which developers? What progress is being made to complete assigned tasks? What tasks remain for this release/sprint?
  • 31. How Can You Splunk DevOps?
  • 32. Industry Leading Platform for Machine Data Any Machine Data Online Services Web Services Servers Security GPS Location Storage Desktops Networks Packaged Applications Custom ApplicationsMessaging Telecoms Online Shopping Cart Web Clickstreams Databases Energy Meters Call Detail Records Smartphones and Devices RFID Datacenter Private Cloud Public Cloud Enterprise Scalability Search and Investigation Proactive Monitoring Operational Visibility Real-time Business Insights Operational Intelligence
  • 35. Puppet Enterprise App for Splunk
  • 36. Chef App for Splunk
  • 38. Splunk Add-on for Google Cloud Platform
  • 39. Splunk Logging Driver for Docker
  • 40. curl -k https://<host>:8088/services/collector -H 'Authorization: Splunk <token>' -d '{"event":"Hello Event Collector"}' Applications IoT Devices Agentless, direct data onboarding via a standard API HTTP Event Collector Scales to Millions of Events/Second
  • 41. AWS Lambda for HTTP Event Collector
  • 42. Splunk App for Stream Enables real-time insights into private, public and hybrid cloud infrastructures Delivers rapid deployment, easy scale out and efficient wire data capture Capture and analyze critical events not found in logs or with other collection methods. 1 2 3 Enhance Operational Intelligence With Wire Data Capture
  • 43. Splunk MINT for Mobile Data Deliver Better Performing, More Reliable Apps Deliver Real-Time Analytics Achieve End-to-End Visibility
  • 45. Copyright © 2015 Splunk Inc. Why Use Splunk for DevOps?
  • 46. Machine Data To Enable Continuous Improvement Defect Information Capacity Planning Quality Standards Enhancement Requests Integration Requirements Acceptance Metrics Service Levels and KPIs Application Development Test and Acceptance Production BuildCodePlan Test/QA Stage Release Config Monitor Infrastructure Dependencies
  • 47. Increase Delivery Velocity DevOps Teams Iterate with Continuous Insights Product Managers identify new opportunities Code Continuously delivered to market Auditors have visibility Customers are happy
  • 48. Improve Code Quality Code quality scans Static security scans White BoxDevelopers check in code Automated Acceptance Tests Dynamic Security Scans Black Box “Chaos Monkey” tests Test Fail: Return Test Fail: Return X X Production QA Prod Pattern QA Pattern Library Test Pass: Promote Test Pass: Promote to Production Pattern library used for test and QA
  • 52. A Reminder “DEVOPS IS A SUPERSET, NOT A SUBSET” - HAL ROTTENBERG, MAY 2016
  • 53. Where to go for more Info ● DevOps Videos, Customer Stories, Whitepapers ‣ http://splunk.com/DevOps – Developer Tutorials, Code Samples, Downloads – http://dev.splunk.com ● Splunk Apps and Plugins – https://splunkbase.splunk.com ● Blogs for Dev, Ops, and DevOps – http://blogs.splunk.com 53
  • 54. 54
  • 57. Real-time dashboards show error rate in production and impact of pushing new builds Developers can search and visualize web logs, Java logs, eventlogs etc; trace tx without complex instrumentation Alerts notify developers as soon as a problem arises 57 Find and Fix Issues Faster
  • 58. Gain end-to-end visibility to make informed decisions Analytics insights without the need for additional analytics tools Ask questions while exploring and collecting data 58 Push Better Code Using Analytics
  • 59. Powerful Platform for Enterprise Developers 59 REST API Build Splunk Apps Extend and Integrate Splunk Simple XML JavaScript/CSS Extensions C# JavaScript Python Ruby Java PHP Data Models Search Extensibility Modular Inputs SDKs KV Store
  • 60. Splunk Developer Guidance Splunk Reference Apps Complete, working real-world Splunk solutions built together with partners (Conducive; Auth0) ̶ 2 (pseudo-) production releases ̶ entire code & test repos on GitHub ̶ under Apache 2.0 Associated Guidance I. Start-to-Finish Journey Documentary II. Essentials   dev.splunk.com/goto/devguide
  • 61. Splunk in Real World DevOps Use Cases
  • 62. Successful Businesses Use Splunk for DevOps
  • 63. 63 Improved DevOps Agility 63 Key Customer Benefits • Increased success rate of deployments • Detect issues before they affect broad production • Monitoring deployment process several times per day -Robert Gonsalves, Web Operations “It’s like we were working without peripheral vision before and now we have it.”
  • 64. 64 Deliver Better Code Quality Key Customer Benefits -Principal Engineer, Apollo Group “Developers are now able to look for errors and troubleshoot issues five to ten times faster by having all their event data centralized in Splunk.” • Provide full visibility into QA sanity and load testing before production • Exceed SLA thresholds with full visibility and benchmark key infrastructure metrics and errors • Easier troubleshooting if tests do not contain the expected results
  • 65. 65 Enable Data-driven Continuous Delivery -Alison Perkins, Senior Systems Engineer “ Dump all the logs into Splunk, and it starts looking like one big system, instead of a bazillion teeny ones that hate each other.” Key Customer Benefits • Quickly validate and troubleshoot code pushes to production • Ensure that new code does not negatively impact performance or user experience • Reduced one application’s error rate by 2 orders of magnitude in a matter of weeks

Editor's Notes

  1. - You’ve heard the culture story before, let’s go over that briefly
  2. POLL: who measures deployment cycles in: - MONTHS? - WEEKS? - DAYS? - HOURS?
  3. I promised you FIVE. Check it out – this is SIX.
  4. Splunk Enterprise is fully featured, platform for collecting, searching, monitoring and analyzing machine data and getting operational intelligence. You can monitor both real-time (as the data is streaming) and historical data. Splunk collects machine data securely and reliably from wherever it’s generated in any formant. It stores and indexes the data in real time in a centralized location and protects it with role-based access controls. You can troubleshoot your network problems and investigate security incidents in minutes (not hours or days). Monitor your end-to-end infrastructure to avoid service degradation or outages. Gain real-time visibility and critical insights into customer experience, transactions and behavior.
  5. Splunk can provide insight across the entire application delivery lifecycle. Developers can search and visualize data from entire build pipeline and production environments without needing to access production machines.
  6. When using Splunk to mine machine data our customers and prospects can 1) INCREASE APP DELIVERY VELOCITY 2) IMPROVE CODE QUALITY 3) INCREASE BUSINESS IMPACT OF APPLICATION DELIVERY
  7. * PUPPET
  8. - Test harness, build automation
  9. Comparing errors in QA vs PROD
  10. Pro-actively identify business issues Visualize the source of the issue Collect & Analyze diagnostics data automatically Take pro-active actions to mitigate the problem Engage the right people immediately Proactively Identify: Stuck deals are identified before the call is made to support Visualize: Business Activity Monitoring tracks deals; Yellow indicates where the deal is stuck. Red would indicate a catastrophic system failure.
  11. Splunk Enterprise is fully featured, platform for collecting, searching, monitoring and analyzing machine data and getting operational intelligence. You can monitor both real-time (as the data is streaming) and historical data. Splunk collects machine data securely and reliably from wherever it’s generated in any formant. It stores and indexes the data in real time in a centralized location and protects it with role-based access controls. You can troubleshoot your network problems and investigate security incidents in minutes (not hours or days). Monitor your end-to-end infrastructure to avoid service degradation or outages. Gain real-time visibility and critical insights into customer experience, transactions and behavior.
  12. The new app collects and analyzes performance data from Puppet Enterprise. Customers get visibility into critical services, such as PuppetDB, the Puppet Serve, and console services. The app also helps to reduce troubleshooting times and proactively fix health issues in the Puppet environment, and includes the following insights: Console services response times to benchmark and actively plan console resources The number of request errors by Puppet clients to help recognize potential code or infrastructure issues Role-based access control dashboards to monitor user activity, including authentication errors to help with potential security issues Requests from PuppetDB to identify commonly executed or failed queries—isolating potential infrastructure bottlenecks PuppetDB node deactivation activity for isolation of security or automation issues Commonly submitted PuppetDB commands from client IPs to assist in pinpointing potential security issues Puppet Server compilation metrics that help teams evaluate the health of their automation environment and appropriately assign resource
  13. The Chef Analytics App for Splunk is available for free on Splunkbase Splunk app marketplace and provides Chef users with visibility into metrics such as success / failure rates, most active users and most active organizations. The Chef Analytics App for Splunk also helps you understand the frequency of the details of errors across infrastructure so that you can catch and troubleshoot high impact issues, like a major bug in a cookbook or an infrastructure issue like network connectivity, in real time More details: https://www.chef.io/blog/2015/04/17/integrating-chef-analytics-with-splunk/
  14. Why Splunk for AWS? Security Intelligence (Cloudtrail, Config Cloudwatch, VPC) Operational Intelligence (Cloudwatch, Config, ELB, Cloudfront) DevOps Intelligence (Cloudwatch, Lambda) Big Data Insights (Kinesis, EMR, IoT, S3) Data sources in Splunk App for AWS AWS Cloudtrail Service that delivers logs of admin activity on AWS infrastructure Examples: Start/Stop/Create instance Change of User roles/rights Modification of Network Configuration Delivers log files to customers; no UI, display, analysis, search AWS Config Provides resource inventory Provides configuration history & change information Enables security & governance Amazon Cloudwatch Metrics IP traffic information to/from VPC network interfaces Data stored and accessible from AWS Cloudwatch Logs Amazon Cloudwatch VPC Flow Logs IP traffic information to/from VPC network interfaces Data stored and accessible from AWS Cloudwatch Logs AWS Access Logs Elastic Load Balancing (ELB) Cloudfront CDN S3 AWS Billing Current Month via Cloudwatch metrics Monthly Detailed Billing
  15. Secure - Supports TLS / SSL Support for configurable data collection to simplify data classification and access control index sourcetype source Support for collection of container labels and env keys which can further help with data classification Simple Easy to setup e.g., no need to deploy Splunk Universal Forwarder (UF) and scale it Much easier to collect data in Splunk Cloud deployments Scalable built on top of HTTP Event Collector (HEC) Support encryption via SSL as long as Splunk has a TCP SSL endpoint opened. The difference I would say is that with syslog over SSL there is no auth model other than the cert itself and you can only have one SSL cert for all of Splunk. With HEC you have fine grained control of which servers can send data and which indexes they can access as that can be configured per token.  Simplified classification by source and labels, you can do that in syslog driver as well. See labels and env in https://docs.docker.com/engine/admin/logging/overview/ Additional configurations on Splunk logging driver to see “process” field, https://docs.docker.com/engine/admin/logging/log_tags/. Available by default in Syslog. Splunk Cloud: HEC is fully supported in Splunk Cloud. You cannot however arbitrarily open a TCP/UDP port in Splunk Cloud which would be required if you needed to forward Syslog data to a UF running in Splunk Cloud. Need to confirm how to scale HEC in Splunk Cloud. https://docs.docker.com/engine/admin/logging/splunk/
  16. HTTP Event Collector is easy way to send data to Splunk Enterprise. Notably, the EC enables you to send data over HTTP/ HTTPS directly to Splunk Enterprise from your application. The EC was developed with application developers in mind, so that all it takes is a few lines of code added to an app for the app to send data. Also, the EC is token-based, so you never need to hard-code your Splunk Enterprise credentials in your app or supporting files. HTTP Event Collector provides a new way for developers to send application logging and metrics directly to Splunk Enterprise via HTTP in a highly efficient, scalable and secure manner
  17. AWS Lambda is an Amazon Web Services compute service that runs your back-end code in response to events, and manages compute resources for you. In cooperation with Amazon, Splunk is pleased to provide a built-in AWS Lambda Node.js blueprint for HTTP Event Collector. The blueprint makes it easy to get started quickly, sending events from AWS Lambda to HTTP Event Collector running on Splunk Enterprise or Splunk Cloud. You can also write a Lambda function from scratch, either in JavaScript using Node.js or in Java. AWS Lambda can receive event data from Amazon Kinesis, Amazon DynamoDB, Amazon S3, and other Amazon services, and then send it on to HTTP Event Collector. You can collect the data using HTTP Event Collector in Splunk Cloud, which also runs on AWS, or in Splunk Enterprise on-premises.
  18. Splunk App for Stream is a free App that enables you to capture, visualize and analyze data in much more granular way then ever before. You can see everything – ALL user and applications behavior ],response times from every layer, DNS information, storage traffic, network traffic, your websites content, connections. Once this data is in Splunk you can correlate it with other data for much more comprehensive visibility. First Splunk App for Stream is a way of get wire data into Splunk Enterprise. By adding this comprehensive source of machine data, it enables you to extend Operational Intelligence use cases across IT security and the business. It is a software only solution with the ability that can be installed on VM on any host, it enables real-time insights into multi-cloud environments. And as such, it is easy to install anywhere on most of standard machines, it is a passive very efficient way to capture data.
  19. To address the needs of developers, operations and product management, you need Operational Intelligence for your mobile apps. This is what we call mobile intelligence. Mobile intelligence provides real-time insight on how your mobile apps are performing, and can correlate with and enhance Operational Intelligence. Splunk software enables organizations to search, monitor, analyze and visualize machine-generated data from websites, applications, servers, networks, sensors and mobile devices. Splunk MINT helps organizations monitor mobile app usage and performance, gain deep visibility into mobile app transactions and accelerate development Deliver better performing, more reliable apps When a user has a problem with a mobile app, the issue could be isolated or spread across all app versions, handsets and OS types. With Splunk MINT, you can see issues with app performance or availability in real time. Bugs can be addressed quickly, and app developers can gain a head start in creating and delivering valuable app updates. Achieve End-to-End visibility When mobile apps fail, there are many potential sources of failure. With Splunk MINT, you can analyze overall transaction performance. And using Splunk MINT, you can correlate this data with information from back-end apps to gain detailed insight on transaction problems. As a result, operations can reduce MTTR and better anticipate future mobile app back-end requirements. Deliver real-time analytics Mobile apps give enterprises new ways of conducting digital business. With mobile app information in Splunk Enterprise, you can correlate usage and performance information— some call this omni-channel analytics—to better understand how users are engaging all aspects of your organization.
  20. Fast feedback obtained with analytics improves app delivery velocity. From code definition to production, having insight for all the teams leads to less bugs, faster testing, faster releases, less production issues and accelerated innovation. Deliver end-to-end visibility across every DevOps toolchain component Iterate faster with correlated insight across the application delivery lifecycle Improve DevOps team efficiency by measuring and benchmarking release contributions  
  21. Pinpoint and resolve code issues before they impact customers .Find and fix production issues faster Use objective metrics to ensure code is operational and meets quality SLAs
  22. When using Splunk to mine machine data our customers and prospects can 1) INCREASE APP DELIVERY VELOCITY 2) IMPROVE CODE QUALITY 3) INCREASE BUSINESS IMPACT OF APPLICATION DELIVERY
  23. Order Flow, message queues, Garbage Collection, Java Heap identify errors by java class, thread alert actions - jira ticket, service now ticket, webhook
  24. PM’s love to look at feature usage; are new features being used? How do we allocate developer time to create/enhance features
  25. Need to check all of them.
  26. The NBC Universal’s Web Operations team is using Splunk platform to track performance of their releases from pre-production, QA and in production. Splunk software frees up their DevOps teams and enables them to focus on innovation while pushing code to production daily. The way they test these deployments is to release to half of our servers first while they are out of production rotation but still accessible through other non-public DNS paths for testing.  Their “Gamma” environment is a subset of production servers that have been released to for testing, but aren’t taking public traffic.  Theyuse Splunk to monitor new errors on the servers after releasing changes to them, which is easy to do since just before the servers were released to they already had an established error volume baseline from being in production.  If any new errors appear or the volume of traffic for 400/500 errors suddenly increases after the release, They immediately see the spike in our monitoring. Alerting on thresholds for event log errors - roll-back problematic deployments or diagnose a build in a subset of the production environment
  27. Splunk is Used Enterprise-wide at Apollo Group Provide full visibility into sanity and Load testing in QA environments before deploying to production Using the Splunk SDK for Java to gather key machine metrics (CPU, memory, disk utilization) and log file errors metrics are compared to benchmarks and SLA thresholds Helps troubleshooting if tests do not contain the expected results Product Lifecycle Monitoring Custom Application Monitoring Mobile App Monitoring/Analytics Customer Analytics Security and Forensics/Analytics Network Monitoring/Analytics AWS Billing Monitoring/Analytics Cloud and Physical Server Monitoring/Analytics Issue resolution from days to minutes in both QA/staging and production environments – significant productivity/quality impact ROI in the millions - Engineering/IT teams are significantly more productive & Fewer outages
  28. Challenges: No single place to access and visualize machine data Manual diagnosing and searching through data generated by servers and applications To retrieve information, sysadmins have to ssh into production machines before sending off to developers to grep through the logs With Splunk: Quickly validate and troubleshoot code pushes to production Ensure that new code does not negatively impact performance or user experience Reduced one application’s error rate by 2 orders of magnitude in a matter of weeks