The Agile Admins
● Ernest Mueller (@ernestmueller)
● James Wickett (@wickett)
● Karthik Gaekwad (@iteration1)
Who Are We?
Who Are You?
Things DevOpsers Care About
Source: Devopsdays Austin Survey 2015 (500 participants)
Topics covered today
● What is DevOps?
● Why would I use it?
● What’s hot in DevOps?
● What does the future look like?
DevOps Defined
● DevOps is the practice of operations and
development engineers participating
together in the entire service lifecycle, from
design through the development process to
production support.
● DevOps is also characterized by operations
staff making use many of the same
techniques as developers for their systems
work.
The Layers of DevOps
DevOps Principles
DevOps Tools
DevOps Practices
DevOps Principles
● The Three Ways (Gene Kim)
o Systems Thinking
o Amplify Feedback Loops
o Culture of Continual Experimentation
● CAMS (John Willis)
o Culture – People > Process > Tools
o Automation – Infrastructure as Code
o Measurement – Measure Everything
o Sharing – Collaboration/Feedback
● Informed by the values in the Agile Manifesto
and Lean Theory of Constraints
DevOps Practices
•Version Control For All
•Automated Testing
•Proactive Monitoring and Metrics
•Kanban/Scrum
•Visible Ops/Change Management
•Configuration Management
•Incident Command System
•Continuous Integration/Deployment/Delivery
•“Put Developers On Call”
•Virtualization/Cloud/Containers
•Toolchain Approach
•Transparent Uptime/Incident Retrospectives
DevOps Tools
● Hardware (System provisioning/automation)
● Software (Software delivery pipeline)
● Wetware (Process/human element)
● Monitoring/Metrics (of all the above)
DevOps Adoption Impact
● 2014 State of DevOps survey by Puppet
Labs, Thoughtworks, and IT Revolution Press
● Top indicators of high organizational
performance:
o IT performance - Leaders here are twice as likely to
exceed their profitability, market share, and
productivity goals. Deployment frequency, lead time
for changes, mean time to recover from failure are
positively impacted by DevOps practices.
o Organizational culture and climate for learning
o Job satisfaction
What’s Hot Now
● Security and DevOps
● Internet of Things
● Containers and Docker
● Microservices and 12-Factor Apps
● ChatOps
● Unicorns to Horses to Donkeys
Security is where ops was 5 years
ago...
Epiphanies in Security and DevOps
● Smaller batches make you more secure
● Departure from the perimeter mentality
● Instrument your runtime environment and
correlate disparate metrics (e.g. transactions
to csrf token generations)
● Emphasis on MTTD and MTTR
Epiphanies in Security and DevOps
● We can go fast and still do compliance
● Major vulnerabilities like Heartbleed exposed
weaknesses in our software supply chain
● Security testing can be done in development
Security Companies to Watch
● Signal Sciences
● Threat Stack
● Sonatype
● Contrast Security
Internet of Things
DevOps and IoT
● Fully distributed compute on networks you
can’t/don’t control
● Software and tracking components becomes
really hard
● Automation even more necessary
● Security even more necessary
Containers and Docker
Open source platform for developers
and sysadmins to build, ship and run
distributed applications anywhere.
What is Docker?
Docker Components
● Docker Engine
o Runtime and packaging tool
o Installed on hosts that run Docker
● Docker Hub
o Cloud service for storing and sharing apps
o Save your docker images (public/private)
Why is it so popular?
● Portability
o Write once, run anywhere
● Standardized Environments
o Dev/QA/Production can be modeled exactly the
same way
● Rapid scale-up/scale-down
o Containers take seconds to deploy
● Ability to build a continuous delivery (CD)
pipeline
Use cases for Docker
● Continuous Integration & Delivery
o Yelp, Spotify, Mailgun, Cambridge Healthcare
● PaaS
o Yandex, Baidu
● Easier Development & Deployment
o Ebay, Bleacher Report, New Relic
● Hosting Legacy Applications
https://www.docker.com/resources/usecases/
Players in the space
Microservices
“Independent processes communicating with
each other with well defined API’s to form
larger more complex applications”
Microservices
Microservices characteristics
● Do one thing, and do it well (fine grained)
● Independently built- common language to
communicate
● Independently deployable
● Fault tolerant and reliable
12 Factor App
● Use declarative formats for setup automation;
minimize time and cost for new developers joining
the project
● Clean contract with the underlying OS, offering
maximum portability between execution
environments;
● Suitable for deployment on modern cloud platforms
● Minimize divergence between development and
production- enabling continuous deployment
● Scale up without significant changes to tooling,
architecture, or development practices.
Relationship with containers
● Microservices and containers are a great fit.
● Single service on a container.
o Isolates service and makes it easy to manage
● Emerging best practice for new architectures
with containers.
● Consider building your architecture in this
manner.
ChatOps
ChatOps
ChatOps
Unicorns to Horses to Donkeys
Gartner: “By 2016 25% of the G2000 will be employing
DevOps.”
“By 2018, 90% of
I&O organizations
attempting to use
DevOps without
specifically
addressing their
cultural
foundations will
fail.”
The Future...
Future
● More Lean Extension
● Security Fully DevOpsed
● Cloudification/Compute Fabric
● Testing and Monitoring
● Devops - The New Normal
● Containers Rule The World
Nice (Software Supply) Chain!
Extension of Lean
Delivery Pipeline extension to Lean
● Your BOM is part of your product
● Ability to track where all code came from
which products are using it just like
automotive and aeronautical industries
● Quality metrics extending to customer usage
Security into Devops
● Security rebranded in language of Rugged
as features (ruggedsoftware.org)
● Growth around integrating security at all
phases of the delivery pipeline
● Instrument runtime environment with security
metrics
● Movement from security training to security
testing
● Searching for aspirational moment like “10
deploys a day” did for devops
Cloud/Compute Fabric
● Rightscale 2015 State of the Cloud Survey
reveals 93% of organizations are running apps
on or experimenting with IaaS
● 82% of enterprises have a hybrid cloud
strategy
● IoT and Big Data mean large heaps of data it’s
hard to move around the network
● Containerization and microservices mean it’s
easier to move compute to the data than
vice versa
● Eventual: Complex, ultra-distributed compute
Testing and Monitoring
● Automated testing is a best practice
● Light/fast testing feeds CD
● App and system monitoring is a best
practice
● Logging, analytics being absorbed into it
● There is no difference between monitoring
and regression testing theoretically - only
historically
● Eventual: Convergence of regression testing
and monitoring
Containers rule the world
● Yesterday: Docker didn’t exist
● Today: Engineers playing with Docker in
dev/test.
● Tomorrow: Production Docker
● Even lesser emphasis on hardware/cloud.
● Eventual: Microservices and 12 factor apps
inside containers will be the defacto
standard to deploy apps.
DevOps: The New Normal
● Devops is penetrating enterprises.
● Yesterday: Unicorns
● Today: Horses & Donkeys
● Tomorrow: Everyone
● Backlash: Where’s the silver bullet? What is
the correct implementation of DevOps?
● Eventual: Devops will be the new normal
Q&A
http://bit.ly/devops2015

DevOps State of the Union 2015

  • 2.
    The Agile Admins ●Ernest Mueller (@ernestmueller) ● James Wickett (@wickett) ● Karthik Gaekwad (@iteration1) Who Are We?
  • 3.
  • 4.
    Things DevOpsers CareAbout Source: Devopsdays Austin Survey 2015 (500 participants)
  • 5.
    Topics covered today ●What is DevOps? ● Why would I use it? ● What’s hot in DevOps? ● What does the future look like?
  • 6.
    DevOps Defined ● DevOpsis the practice of operations and development engineers participating together in the entire service lifecycle, from design through the development process to production support. ● DevOps is also characterized by operations staff making use many of the same techniques as developers for their systems work.
  • 8.
    The Layers ofDevOps DevOps Principles DevOps Tools DevOps Practices
  • 9.
    DevOps Principles ● TheThree Ways (Gene Kim) o Systems Thinking o Amplify Feedback Loops o Culture of Continual Experimentation ● CAMS (John Willis) o Culture – People > Process > Tools o Automation – Infrastructure as Code o Measurement – Measure Everything o Sharing – Collaboration/Feedback ● Informed by the values in the Agile Manifesto and Lean Theory of Constraints
  • 10.
    DevOps Practices •Version ControlFor All •Automated Testing •Proactive Monitoring and Metrics •Kanban/Scrum •Visible Ops/Change Management •Configuration Management •Incident Command System •Continuous Integration/Deployment/Delivery •“Put Developers On Call” •Virtualization/Cloud/Containers •Toolchain Approach •Transparent Uptime/Incident Retrospectives
  • 11.
    DevOps Tools ● Hardware(System provisioning/automation) ● Software (Software delivery pipeline) ● Wetware (Process/human element) ● Monitoring/Metrics (of all the above)
  • 12.
    DevOps Adoption Impact ●2014 State of DevOps survey by Puppet Labs, Thoughtworks, and IT Revolution Press ● Top indicators of high organizational performance: o IT performance - Leaders here are twice as likely to exceed their profitability, market share, and productivity goals. Deployment frequency, lead time for changes, mean time to recover from failure are positively impacted by DevOps practices. o Organizational culture and climate for learning o Job satisfaction
  • 13.
    What’s Hot Now ●Security and DevOps ● Internet of Things ● Containers and Docker ● Microservices and 12-Factor Apps ● ChatOps ● Unicorns to Horses to Donkeys
  • 14.
    Security is whereops was 5 years ago...
  • 15.
    Epiphanies in Securityand DevOps ● Smaller batches make you more secure ● Departure from the perimeter mentality ● Instrument your runtime environment and correlate disparate metrics (e.g. transactions to csrf token generations) ● Emphasis on MTTD and MTTR
  • 16.
    Epiphanies in Securityand DevOps ● We can go fast and still do compliance ● Major vulnerabilities like Heartbleed exposed weaknesses in our software supply chain ● Security testing can be done in development
  • 17.
    Security Companies toWatch ● Signal Sciences ● Threat Stack ● Sonatype ● Contrast Security
  • 18.
  • 19.
    DevOps and IoT ●Fully distributed compute on networks you can’t/don’t control ● Software and tracking components becomes really hard ● Automation even more necessary ● Security even more necessary
  • 20.
  • 21.
    Open source platformfor developers and sysadmins to build, ship and run distributed applications anywhere. What is Docker?
  • 22.
    Docker Components ● DockerEngine o Runtime and packaging tool o Installed on hosts that run Docker ● Docker Hub o Cloud service for storing and sharing apps o Save your docker images (public/private)
  • 23.
    Why is itso popular? ● Portability o Write once, run anywhere ● Standardized Environments o Dev/QA/Production can be modeled exactly the same way ● Rapid scale-up/scale-down o Containers take seconds to deploy ● Ability to build a continuous delivery (CD) pipeline
  • 24.
    Use cases forDocker ● Continuous Integration & Delivery o Yelp, Spotify, Mailgun, Cambridge Healthcare ● PaaS o Yandex, Baidu ● Easier Development & Deployment o Ebay, Bleacher Report, New Relic ● Hosting Legacy Applications https://www.docker.com/resources/usecases/
  • 25.
  • 26.
  • 27.
    “Independent processes communicatingwith each other with well defined API’s to form larger more complex applications” Microservices
  • 28.
    Microservices characteristics ● Doone thing, and do it well (fine grained) ● Independently built- common language to communicate ● Independently deployable ● Fault tolerant and reliable
  • 29.
    12 Factor App ●Use declarative formats for setup automation; minimize time and cost for new developers joining the project ● Clean contract with the underlying OS, offering maximum portability between execution environments; ● Suitable for deployment on modern cloud platforms ● Minimize divergence between development and production- enabling continuous deployment ● Scale up without significant changes to tooling, architecture, or development practices.
  • 30.
    Relationship with containers ●Microservices and containers are a great fit. ● Single service on a container. o Isolates service and makes it easy to manage ● Emerging best practice for new architectures with containers. ● Consider building your architecture in this manner.
  • 31.
  • 32.
    Unicorns to Horsesto Donkeys Gartner: “By 2016 25% of the G2000 will be employing DevOps.” “By 2018, 90% of I&O organizations attempting to use DevOps without specifically addressing their cultural foundations will fail.”
  • 33.
  • 34.
    Future ● More LeanExtension ● Security Fully DevOpsed ● Cloudification/Compute Fabric ● Testing and Monitoring ● Devops - The New Normal ● Containers Rule The World
  • 35.
    Nice (Software Supply)Chain! Extension of Lean
  • 36.
    Delivery Pipeline extensionto Lean ● Your BOM is part of your product ● Ability to track where all code came from which products are using it just like automotive and aeronautical industries ● Quality metrics extending to customer usage
  • 38.
    Security into Devops ●Security rebranded in language of Rugged as features (ruggedsoftware.org) ● Growth around integrating security at all phases of the delivery pipeline ● Instrument runtime environment with security metrics ● Movement from security training to security testing ● Searching for aspirational moment like “10 deploys a day” did for devops
  • 39.
    Cloud/Compute Fabric ● Rightscale2015 State of the Cloud Survey reveals 93% of organizations are running apps on or experimenting with IaaS ● 82% of enterprises have a hybrid cloud strategy ● IoT and Big Data mean large heaps of data it’s hard to move around the network ● Containerization and microservices mean it’s easier to move compute to the data than vice versa ● Eventual: Complex, ultra-distributed compute
  • 40.
    Testing and Monitoring ●Automated testing is a best practice ● Light/fast testing feeds CD ● App and system monitoring is a best practice ● Logging, analytics being absorbed into it ● There is no difference between monitoring and regression testing theoretically - only historically ● Eventual: Convergence of regression testing and monitoring
  • 41.
    Containers rule theworld ● Yesterday: Docker didn’t exist ● Today: Engineers playing with Docker in dev/test. ● Tomorrow: Production Docker ● Even lesser emphasis on hardware/cloud. ● Eventual: Microservices and 12 factor apps inside containers will be the defacto standard to deploy apps.
  • 42.
    DevOps: The NewNormal ● Devops is penetrating enterprises. ● Yesterday: Unicorns ● Today: Horses & Donkeys ● Tomorrow: Everyone ● Backlash: Where’s the silver bullet? What is the correct implementation of DevOps? ● Eventual: Devops will be the new normal
  • 43.

Editor's Notes

  • #2 Karthik
  • #3 Each of us introduces ourselves briefly
  • #4 Karthik
  • #5 Karthik
  • #6 Ernest
  • #7 Ernest If you want something punchier you can just call it “Agile for Operations.”
  • #8 Ernest The ITSM Service Model
  • #9 Ernest
  • #10 Ernest
  • #11 Ernest No specific one is necessary - or sufficient - for DevOps; they are simply clustered practices many find useful to empower the principles.
  • #12 Ernest
  • #13 https://puppetlabs.com/2014-devops-report 9200 respondents across all sizes of businesses
  • #15 James
  • #16 James
  • #17 James
  • #19 James
  • #21 Karthik
  • #27 Image credit: https://www.etsy.com/shop/SuAmi?ref=l2-shopheader-name
  • #30 http://tech.paulcz.net/2015/01/factorish_and_the_12_fakter_app/
  • #32 Ernest
  • #33 Ernest The Coming Donkey Apocalypse: http://www.slideshare.net/cote/the-coming-donkey-apocalypse-devopsdays-austin-2015 Gartner Says By 2016, DevOps Will Evolve From a Niche to a Mainstream Strategy Employed by 25 Percent of Global 2000 Organizations http://www.gartner.com/newsroom/id/2999017 Ian Head of Gartner says that “by 2018 90% of I & O organizations attempting to use DevOps without specifically addressing their cultural foundations will fail.” http://www.gartner.com/newsroom/id/3032517 Image by Mireille Rae, http://mireille-rae.deviantart.com/art/Unicorn-vs-Donkey-360739152
  • #34 James
  • #36 James
  • #39 James
  • #40 Ernest Rightscale 2015 State of the Cloud Report: http://www.rightscale.com/lp/2015-state-of-the-cloud-report-v1 Do miniature swarms of drones running containers take over the world?
  • #41 Ernest
  • #42 Karthik
  • #43 Karthik
  • #44 Karthik