Are we there yet?
Scaling DevOps for continuous improvement
Marc Priolo, Urban Science
DevOps Enterprise Summit 2016
v © 2016 Urban Science Confidential
Agenda
• Introduction
• Last time I was here…
• The next step in our journey
• Results
• Remaining challenges
Presenter: Marc Priolo
INTRODUCTION
v © 2016 Urban Science Confidential
Marc Priolo, Software Configuration Manager
Focused on helping Urban Science
deliver high-quality software frequently
and reliably through implementing
“Continuous Delivery” best practices.
Over 15 years of industry experience:
• Consultant
• DBA
• Technical Support (manager)
• Release Management (manager)
Presenter: Marc Priolo
v © 2016 Urban Science Confidential
• As business scientists, we invent solutions for mission critical challenges –
we create powerful, prescriptive, never-been-done-before solutions
• Think Big Data “in” & client unique solutions “out”
Presenter: Marc Priolo
More than a consulting firm. More than a software company.
v © 2016 Urban Science Confidential
Global, proven partners
Years of operation: 40
Country Presence: 100+
Offices: 19
Expert employees: 900
Major auto customers: ALL
Dealership customers: 20K +
B2B client satisfaction Highest in industry
Presenter: Marc Priolo
LAST TIME I WAS HERE…
v © 2016 Urban Science Confidential
Why: Starting the DevOps journey
Increase Scalability
Increase Consistency
Increase Efficiency
Increase Expediency
Reduce Complexity
Presenter: Marc Priolo
v © 2016 Urban Science Confidential
How: Automate everything
We had a choice.
• The most visible
o Hardest to perform manual deployments & newer projects?
• Reduce human error / complexity
• Minimal speed increase
• Low adoption / high maintenance
• ROI more than ½ a year
• The most mundane
o Mature, established and repetitious deployments.
• Reduce human error / complexity
• Drastic speed increase
• High adoption / low maintenance
• ROI less than two months
• Winner!
Presenter: Marc Priolo
v © 2016 Urban Science Confidential
The journey
We’re just getting
started.
• 2014
o Automate 135 monthly European & USA products
• 2015 and beyond
o Automate the “most visible” & newer projects
o Implement end to end automated functional testing
• Let me tell you where we are at now…
Presenter: Marc Priolo
THE NEXT STEP IN OUR JOURNEY
v © 2016 Urban Science Confidential
Provide a pipeline catalogue
Why provide a limited
catalogue?
• Standardization
• Scalability
• Support
Presenter: Marc Priolo
v © 2016 Urban Science Confidential
Catalogue offering
Pipeline offerings
1. Static
a. Data
b. Data & Code
2. Dynamic
3. Self-Service/Sandbox*
Presenter: Marc Priolo
v © 2016 Urban Science Confidential
Static (legacy) deep dive
– Fixed deployment logic tied to
pipeline
– Fixed pipeline environments
– Static pipeline
Commit
Build, Unit Test &
Package
Deploy to
CI
Deploy to
QA
Deploy to
Staging
Deploy to
Production
Presenter: Marc Priolo
v © 2016 Urban Science Confidential
Dynamic deep dive
– Deployment logic checked with code
– Artifact dependency model
– Automated testing, an equal artifact
– Dynamic pipeline environments
– Artifact maturity path
• Dev → QA → RTI → RTD
Presenter: Marc Priolo
Commit
Build, Unit Test &
Package
Deploy to
CI
(Dev)
Deploy to
QA
(QA)
Deploy to
Staging
(RTI)
Deploy to
Production
(RTD)
Deploy to
Smoke
Test
Deploy to
Regression
Deploy to
Nightly
Deploy to
Dev
Deploy to
Preview
Deploy to
Load Test
Deploy to
Mirror
Deploy to
DR
RESULTS
v © 2016 Urban Science Confidential
Continuous Improvement (and how!)
2014 2016
Application
Deployments ~1K >50K
Manual Work
Avoided (hours) ~2K ~22K
Full Time Employees
“Re-deployable” ~1 >10
Presenter: Marc Priolo
v © 2016 Urban Science Confidential
Business Benefit: Agility and Higher Customer Satisfaction!
We used to request at least five business
days notice prior to an update to:
1) give ample time for programming
2) create deployment package, and
3) reserve deployment slot availability.
Now, our team can perform updates
within one business day from receiving
the request from the client.
Presenter: Marc Priolo
5days
1day
From
to
REMAINING CHALLENGES
v © 2016 Urban Science Confidential
Challenges
My coffee is still not Continuously Deployed!!!
Switching from reactive to proactive mindset
Rebalancing roles & expectations
My team a bottleneck…
Education
Presenter: Marc Priolo
v © 2016 Urban Science Confidential
Up next
• Automated functional testing
• Integration into new systems
• Operations Dashboards
• Continuously Improve!
• Enhance, evolve, reinvent
Presenter: Marc Priolo
v © 2016 Urban Science Confidential
Links
• Communication resources:
o Toastmasters international = https://www.toastmasters.org/
• Southern California resources (Shameless plug):
o SoCal Continuous Delivery Meetup = https://www.meetup.com/SoCal-Continuous-Delivery-Meetup
o Orange County DevOps Meetup = https://www.meetup.com/Orange-County-DevOps-Meetup
• Urban Science Job opening (Shameless recruiting):
o We’re hiring! = http://www.urbanscience.com/careers/
• DevOps Release Automation platform
o ElectricFlow = http://electric-cloud.com/products/electricflow
Presenter: Marc Priolo
v © 2016 Urban Science Confidential
QUESTIONS?
Presenter: Marc Priolo
v © 2016 Urban Science Confidential
That’s all folks!
Presenter: Marc Priolo

DOES SFO 2016 - Marc Priolo - Are we there yet?

  • 1.
    Are we thereyet? Scaling DevOps for continuous improvement Marc Priolo, Urban Science DevOps Enterprise Summit 2016
  • 2.
    v © 2016Urban Science Confidential Agenda • Introduction • Last time I was here… • The next step in our journey • Results • Remaining challenges Presenter: Marc Priolo
  • 3.
  • 4.
    v © 2016Urban Science Confidential Marc Priolo, Software Configuration Manager Focused on helping Urban Science deliver high-quality software frequently and reliably through implementing “Continuous Delivery” best practices. Over 15 years of industry experience: • Consultant • DBA • Technical Support (manager) • Release Management (manager) Presenter: Marc Priolo
  • 5.
    v © 2016Urban Science Confidential • As business scientists, we invent solutions for mission critical challenges – we create powerful, prescriptive, never-been-done-before solutions • Think Big Data “in” & client unique solutions “out” Presenter: Marc Priolo More than a consulting firm. More than a software company.
  • 6.
    v © 2016Urban Science Confidential Global, proven partners Years of operation: 40 Country Presence: 100+ Offices: 19 Expert employees: 900 Major auto customers: ALL Dealership customers: 20K + B2B client satisfaction Highest in industry Presenter: Marc Priolo
  • 7.
    LAST TIME IWAS HERE…
  • 8.
    v © 2016Urban Science Confidential Why: Starting the DevOps journey Increase Scalability Increase Consistency Increase Efficiency Increase Expediency Reduce Complexity Presenter: Marc Priolo
  • 9.
    v © 2016Urban Science Confidential How: Automate everything We had a choice. • The most visible o Hardest to perform manual deployments & newer projects? • Reduce human error / complexity • Minimal speed increase • Low adoption / high maintenance • ROI more than ½ a year • The most mundane o Mature, established and repetitious deployments. • Reduce human error / complexity • Drastic speed increase • High adoption / low maintenance • ROI less than two months • Winner! Presenter: Marc Priolo
  • 10.
    v © 2016Urban Science Confidential The journey We’re just getting started. • 2014 o Automate 135 monthly European & USA products • 2015 and beyond o Automate the “most visible” & newer projects o Implement end to end automated functional testing • Let me tell you where we are at now… Presenter: Marc Priolo
  • 11.
    THE NEXT STEPIN OUR JOURNEY
  • 12.
    v © 2016Urban Science Confidential Provide a pipeline catalogue Why provide a limited catalogue? • Standardization • Scalability • Support Presenter: Marc Priolo
  • 13.
    v © 2016Urban Science Confidential Catalogue offering Pipeline offerings 1. Static a. Data b. Data & Code 2. Dynamic 3. Self-Service/Sandbox* Presenter: Marc Priolo
  • 14.
    v © 2016Urban Science Confidential Static (legacy) deep dive – Fixed deployment logic tied to pipeline – Fixed pipeline environments – Static pipeline Commit Build, Unit Test & Package Deploy to CI Deploy to QA Deploy to Staging Deploy to Production Presenter: Marc Priolo
  • 15.
    v © 2016Urban Science Confidential Dynamic deep dive – Deployment logic checked with code – Artifact dependency model – Automated testing, an equal artifact – Dynamic pipeline environments – Artifact maturity path • Dev → QA → RTI → RTD Presenter: Marc Priolo Commit Build, Unit Test & Package Deploy to CI (Dev) Deploy to QA (QA) Deploy to Staging (RTI) Deploy to Production (RTD) Deploy to Smoke Test Deploy to Regression Deploy to Nightly Deploy to Dev Deploy to Preview Deploy to Load Test Deploy to Mirror Deploy to DR
  • 16.
  • 17.
    v © 2016Urban Science Confidential Continuous Improvement (and how!) 2014 2016 Application Deployments ~1K >50K Manual Work Avoided (hours) ~2K ~22K Full Time Employees “Re-deployable” ~1 >10 Presenter: Marc Priolo
  • 18.
    v © 2016Urban Science Confidential Business Benefit: Agility and Higher Customer Satisfaction! We used to request at least five business days notice prior to an update to: 1) give ample time for programming 2) create deployment package, and 3) reserve deployment slot availability. Now, our team can perform updates within one business day from receiving the request from the client. Presenter: Marc Priolo 5days 1day From to
  • 19.
  • 20.
    v © 2016Urban Science Confidential Challenges My coffee is still not Continuously Deployed!!! Switching from reactive to proactive mindset Rebalancing roles & expectations My team a bottleneck… Education Presenter: Marc Priolo
  • 21.
    v © 2016Urban Science Confidential Up next • Automated functional testing • Integration into new systems • Operations Dashboards • Continuously Improve! • Enhance, evolve, reinvent Presenter: Marc Priolo
  • 22.
    v © 2016Urban Science Confidential Links • Communication resources: o Toastmasters international = https://www.toastmasters.org/ • Southern California resources (Shameless plug): o SoCal Continuous Delivery Meetup = https://www.meetup.com/SoCal-Continuous-Delivery-Meetup o Orange County DevOps Meetup = https://www.meetup.com/Orange-County-DevOps-Meetup • Urban Science Job opening (Shameless recruiting): o We’re hiring! = http://www.urbanscience.com/careers/ • DevOps Release Automation platform o ElectricFlow = http://electric-cloud.com/products/electricflow Presenter: Marc Priolo
  • 23.
    v © 2016Urban Science Confidential QUESTIONS? Presenter: Marc Priolo
  • 24.
    v © 2016Urban Science Confidential That’s all folks! Presenter: Marc Priolo

Editor's Notes

  • #3 Due to time, I will not cover the technologies we used. I will be happy to discuss it individually afterwards.
  • #6 Urban Science is essentially a big data company/Global retail performance expert. Our goal is to identify and solve the toughest business challenges of this massive industry. We work with manufacturers to help them understand how people are buying, servicing their vehicles, and using their cars. Basically, if there is any kind of statistic around the automotive industry, Urban Science is tracking and interpreting it. You can imagine the infrastructure and software updates required to support such an operation — with its demanding customers, high stakes business, and massive amount of data being collected from all over the world and analyzed 24/7
  • #7 While we originated in the automotive industry, we are expanding into other industries including healthcare.
  • #9 One story about why these reasons matter and how they need to improve.
  • #10 We chose to use ElectricFlow as our devops platform, but obviously you can use any tools set you choose. ElectricFlow allows us to automate and orchestrate our entire end to end pipeline- from code-check in all the way to Release. It allows us to plug in all our point tools, processes, tests, environments and so on, so that we can gain control and visibility into the entire delivery pipeline.
  • #11 Anticipating 3000+ annual resource hours saved
  • #13 Small team supporting the entire company. Basically we are eating our own dogfood.
  • #16 Keep it kind of high.