Continuous Integration and Continuous Delivery have dramatically accelerated the rate of innovation within both large and small organizations – allowing teams to build and deploy software faster than ever before. Yet, as release automation accelerates the volume, variety and velocity of application changes, an entirely new set of challenges have appeared. Let’s state the obvious here – DevOps, empowered by continuous integration and delivery, doesn’t merely end at deployment. In fact, the fun is just getting started. Part of the mission for today’s IT monitoring teams relates to tracking build numbers, status, success, failure and the rest. Yet, if 80% of application performance problems can be tied to some environmental change, clearly, there’s more to the story. This presentation covers these issues and more, along with some of the relevant capabilities supported via the integration of CA Technologies Application Performance Management and the CloudBees Jenkins automation platform. Take a closer look at how tying together APM and release automation can help identify and remediate changes that impact applications performance, turbocharging the software pipeline. Learn more about CA APM solutions and its integration with CloudBees Jenkins https://www.brighttalk.com/webcast/7819/214101/using-apm-to-turbocharge-continuous-integration

1. “Using APM to Turbocharge Continuous
Integration”
Alan Shimel, Founder & Editor-in-chief, DevOps.com
Matt LeRay, Senior Vice President and Business Unit Executive, CA Technologies
Brad Johnson, VP of Product Marketing, CloudBees
June 28, 2016

2. 2 © 2015 CA. ALL RIGHTS RESERVED.
Today’s Webcast Program
• Introductions
• Current Environment
• Leading Challenges
• APM and DevOps
• Continuous Integration
• Leveraging Integration
• CA APM + Cloudbees Jenkins
• Q&A

3. 3 © 2015 CA. ALL RIGHTS RESERVED.
Panelist Introductions
• Alan Shimel, Founder & Editor-in-Chief, DevOps.com
@ashimmy
• Matt LeRay, Senior Vice President and Business Unit
Executive, CA Technologies
@matthewleray
• Brad Johnson, Vice President of Product Marketing,
Cloudbees
@bradjohnsonsv

4. 4 © 2015 CA. ALL RIGHTS RESERVED.
Forrester: 80% of MTTR (repair)
is actually MTTI (identify)…
“
DORA: DevOps leaders recover
24x faster than other organizations.*
“
Too Little DevOps, Too Much Repair
*2016 State of DevOps Report

5. 5 © 2015 CA. ALL RIGHTS RESERVED.
Manual
testing
Manual
scripting
Developers
deadlocked
Too little
testing, too
late in the cycle
Constrained
environments
Too many
disparate
tools
Poor
customer
experience
Customer
Experience
PLAN
RELEASE
DEFECTS
DEFECTS
OUTAGES
OPSDEV
Challenges of the Traditional Approach

6. 6
© 2016 CA. ALL RIGHTS RESERVED.
Software changes
continuously
deployed to live
production
Continuous
Deployment
Software changes continuously
delivered to stakeholders in
any environment
Continuous
Delivery
Software changes continuously
delivered to stakeholders in
any environment
Continuous
Delivery
Continuous Integration
Automated commit, build and testing of code in
the development environment
DevOps  Cultural approaches & technical practices
User FeedbackRapid Changes
Discipline
AGILE
An incremental
approach to
identifying, prioritizing,
and coordinating
feature development
Development Production / Prod-like Live Production
Env.Stage
Release Deploy Monitor
Upstream (left) Downstream (right)
Define Plan Code Compile Build Unit Test Analyze Integrate Int. Test Package Place Load Test Acct. Test
Change Mgt. Production Bugs
DevOps in Context: CI to CD (to Cd)

7. 7 © 2015 CA. ALL RIGHTS RESERVED.
Bringing Together APM and Continuous Integration
Applications
Performance Data
Build Data
(Status, No., etc.)
DEV OPS
Publish APM Data in Jenkins
Publish CI Data in CA APM

8. 8
© 2016 CA. ALL RIGHTS RESERVED.
Accelerate problem
resolution by
90%
Accelerate app dev
cycles by
15%
Forrester Consulting “Total Economic Impact of CA APM”
“APM makes it easier for us to figure out solutions
quickly because we can involve the right researchers,
quickly figure out where the problem is, [and] get to
the root cause.”
“In essence, we’re issuing less code or less fixes into
production, which allows [us] to focus more on
maintaining a competitive advantage in the market-
place of what we deliver in our online solutions.”
Using APM in Pre-Prod Makes Developers More Efficient

9. 9 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Full
Visibility
Meet
KPIs
Scale to
demand
Better
UX
Device
Tuning
Better
reliability
QA/TESTDEV PRODUCTIONPRE-PROD
Customer
Experience
Code | Integrate | Build Functional & UA Testing Performance Testing Deploy to Production
IT
OPERATIONS
No usability
insights
No device
specific
feedback
No production
crash analytics
Digital
Experience
Management
No business
metrics
Cloud and
Container Blind
Spots
No real world
performance
data
DEVELOPMENT
Crash
analytics
Device specific
reporting
Behavioral
Analytics
Real World
Test Models
Business
Analytics
Cloud and
Container
Monitoring
IDE SCM CI TESTCONTAINER CONFIG CLOUD PROVISION
IDEA
Putting the “Ops” in DevOps to Anticipate User Needs

10. 10
© 2016 CA. ALL RIGHTS RESERVED.
Code & Commit Build & Config Scan & Test Release Deploy
Over 1.2 Million Users
1000+ plugins cover
every delivery stage
Jenkins Connects All the Things

11. 11
© 2016 CA. ALL RIGHTS RESERVED.
Ongoing support & maintenance
Security & compliance
Scale & operations
Control & visibility
Enterprise DevOps
✓
Criteria for DevOps @ Scale

12. 12
© 2016 CA. ALL RIGHTS RESERVED.
The Path To DevOps
Quadrant 1:
Team-level Agile
Quadrant 2:
Team-level
CD
Quadrant 3:
Enterprise Agile
Quadrant 4:
Enterprise
Continuous Delivery
TeamWorkgroupEnterprise
Define Plan Code Build Integrate Test Release Deploy Operate
Getting There: 4 Quadrants of DevOps Maturity

13. 13
© 2016 CA. ALL RIGHTS RESERVED.
• Packaging & managing apps/environments
• Deploying to key stakeholders (maybe Prod)
• Integrated performance metrics to reqs
• Ties to Dev process (Agile practices)
• Standardized “Share Services” models
• Business, Dev, Ops requirements aligned
• Integrated performance metrics to reqs
• Culture of collaboration & integration
4 Quadrants of DevOps Maturity

14. 14
© 2016 CA. ALL RIGHTS RESERVED.
Turbocharge the Software Pipeline using APM and CI
Dev QA/Test ProductionPre-Prod
Application Performance Management
Continuous Integration
Continuous Feedback - Continuous Improvement

15. 15
© 2016 CA. ALL RIGHTS RESERVED.
Capabilities:
– Collects performance data from APM
– Performs multiple build comparison
– Multiple APM/CI integration points
– Helps automate build release process
Features:
– Collect multiple performance KPIs
– Define multiple fail conditions
– Build pass/fail email notification
– Notify build status without fail
– Decorate ATC node with build no./status
– Jump to APM Webview “in context” from
Jenkins build or cross-build dashboard
CA-APM Jenkins Plugin - Overview

16. 16
© 2016 CA. ALL RIGHTS RESERVED.
Jenkins to CA APM WebView

17. 17
© 2016 CA. ALL RIGHTS RESERVED.
Cross Build Dashboard with Reason

18. 18
© 2016 CA. ALL RIGHTS RESERVED.
Use Case: Integrated Workflow
Check in code more frequently and Jenkins runs the build and tests it more
often in pre-production – ensuring quality release to production.
Check in the
code with new
functionality
Jenkins builds
it and runs
the tests
Jenkins marks it
pass or fail based
on CA APM build
conditions
Data through
the CA APM
Jenkins Plugin
Performance
data pulled into
Jenkins from
CA APM
Jenkins
generates cross-
build dashboard
Attributes incl.
build status,
build number
shown on ATC
Allows access to
CA APM in-
context from
Jenkins dashboard

19. 19
© 2016 CA. ALL RIGHTS RESERVED.
Q&A?

20. Thanks!
For more information visit:
CA APM:
http://www.ca.com/us/products/ca-application-performance-management.html
Cloudbees Jenkins:
https://www.cloudbees.com/products/cloudbees-jenkins-platform