Dev ops

DevOps IntroductionOps job is NOT to keep the site stable and fast Ops job is to enable the business (this is devs job too)

Who am i ?Systems Administrator @ DevOpsInfrastructure as a code ”Puppet”Cloud Computing… @EslamElHusseiny

Dev or Ops ? 6 days after a successful deployment, server experiences troubles ”high load, resources leak”

Dev or Ops ?There is an issue with build server. Code isnt building.

Dev or Ops ?Software is deployed to the test environment. You cant login to application.

Dev vs. Ops

Dev says ...

Ops replies ...”Its not my server, its your code”

Role of Devs and Ops

Role of Devs and OpsDev Create changes Add / modify featuresOps Maintain stability Create / enhance services

So ?The problem Disconnect between groups Devs dont deploy consistent software Ops motivated to resist changes Devolpment process is Agile Operations process is Static

Our GoalWe are all here to ENABLE business

changeIs required for businessDoesnt mean outageShould be exploited and not fearedShouldnt mean fire fighting

RescueDevOps To The Rescue !

What is DevOps then ?”DevOps is an approach to bridge the gap between agile software development and operations” agileweboperations.comCollaborative mindset of Devs and OpsC.A.M.S

Culture

CultureRelationships Engage early, engage often Be open Eradicate ”lastmile syndrome”

CultureCommunication Talk is cheap (get out of your chair) Involve each other in core proccesses and decisions Ask Questions Dont say ”No”

Automation

AutomationWhat ca be automated ? Builds Deployments Testing Monitoring Selfhealing System configuration

Metrics

MetricsCapture, learn, improve.Assist in: Capacity planning Trend analysis Fault finding

Metrics

Sharing

SharingShare ideasShare metricsOps : Give devs shell accessDevs : see what technology ca be leveraged

DevOps life cycle

BeforeTalk about functional requirementsTalk about nonfunctional requirements Security Backups Availability Upgradeability Configuration management Monitoring / Metrics Logging

DuringCommunicationSource controlAutomate buildsAutomate testsAutomate deployments (Dev, Test, and Prod)Collate App and System metrics

AfterRelease Continue to run tests Monitor application and systemIssues (might happen) Post meetings

What are we doing ?

Puppet

PuppetConfiguration management toolOpen Source Infrastructure as a code

Puppet

node default { include ssh include sudo include ntp}node product.dev inherits default { include nginx include tomcat5}node product.test inherits default{ include nginx include tomcat6}

class sudo { package {sudo: ensure => latest, } file {/etc/sudoers: owner => root, group => root, mode => 0440, source => puppet:///files/sudo/sudoers, require => Package[sudo], }}

Puppet

Lets get hands on Its deploymnt time

Monitoring

Problem ?No one noticedNo one got alertedNo automatic recovery

Probelm ?what is your application doing right now?do you know when it fails?failure means customers lose trustfailure means customers go elsewherefailure means you lose moneyapplication = providing value

SolutionMonitoringMetricsLogging

Monitoring means Is the application available?

Examples

Monitoring is this service currently providing value?is this service consuming too many resources?

Examples

Monitcheck process unicorn with pidfile /var/run/unicorn/unicorn.pid start program = "/etc/init.d/unicorn start" stop program = "/etc/init.d/unicorn stop" if mem is greater than 300.0 MB for 1 cycles then restart if cpu is greater than 50% for 2 cycles then alert if cpu is greater than 80% for 3 cycles then restart group unicorn

Metricsmeasurementshistorical datagraphs

Metrics how many customers are on my site?how many customers were on my site yesterday?

Metrics how slow is paypals api?how slow was paypals api yesterday?

Metrics how much memory is available on my servers?how much has memory usage grown over four weeks?

Metricsnumber of open database connections number of redis commands number of 500 errors rate of HTTP requests number of HTTP connections

Metrics median response time number of failed resque jobs number of twitter followers99th percentile github api response time 95th percentile mysql query time

Examples

Graphite

Metrics as a service

Logging

Logstash log inputs process outputs

Graylog2

Summary own your monitoring own your metrics own your loggingnone of them is optional

Dev ops

by Eslam El Husseiny on Jun 02, 2012

Accessibility

Categories

Upload Details

Usage Rights

1 Embed 4

Statistics

Dev ops Presentation Transcript