Moby is killing your devops efforts

Kris Buytaert
Kris BuytaertDevops, Linux and Open Source Expert at Inuits
Moby is killing your
devops efforts
Kris Buytaert
@krisbuytaert
NOT this guy !NOT this guy !
Kris BuytaertKris Buytaert
● I used to be a Dev,I used to be a Dev,
● Then Became an OpThen Became an Op
● CTO and Open Source ConsultantCTO and Open Source Consultant
@@inuits.euinuits.eu
● Everything is a freaking DNSEverything is a freaking DNS
ProblemProblem
● Evangelizing devopsEvangelizing devops
● Organiser of #devopsdays,Organiser of #devopsdays,
#cfgmgmtcamp, #loadays, ….#cfgmgmtcamp, #loadays, ….
Today's Plan:Today's Plan:
● Opening some eyesOpening some eyes
● Reusing 8 year old slidesReusing 8 year old slides
C(L)AMSC(L)AMS
● CultureCulture
● (Lean)(Lean)
● AutomationAutomation
● MeasurementMeasurement
● SharingSharing
Damon Edwards and JohnDamon Edwards and John
WillisWillis
A global movement to improve theA global movement to improve the
quality of software delivery leveragingquality of software delivery leveraging
Open Source experience, started in GentOpen Source experience, started in Gent
in 2009in 2009
Because the old days:Because the old days:
● ““Put this Code Live, here's a tarball” NOW!Put this Code Live, here's a tarball” NOW!
● What dependencies ?What dependencies ?
● No machines available ?No machines available ?
● What database ?What database ?
● Security ?Security ?
● High Availability ?High Availability ?
● Scalability ?Scalability ?
● My computer can't install this ?My computer can't install this ?
10 days into operations10 days into operations
This new 'D' hypeThis new 'D' hype
● New kid on the blockNew kid on the block
● Vagrant-lxc with a nice cliVagrant-lxc with a nice cli
● The Ultimate “devops tool”The Ultimate “devops tool”
● ““Unseen” growthUnseen” growth
● Docker is the new cool thing to doDocker is the new cool thing to do
DockerDocker
DockerDocker
DockerDockerDockerDocker
DockerDocker
DockerDocker
MobyMoby
MobyMoby
MobyMobyMobyMoby
MobyMoby
MobyMoby
People think I`m the whalePeople think I`m the whale
Some HistorySome History
LessonsLessons
openMosixopenMosix (+/- 2001-2005)(+/- 2001-2005)
● 2.4 Kernel patch,2.4 Kernel patch,
● Loadbalance multiple similar processesLoadbalance multiple similar processes
● Both short (compilations) and longlivedBoth short (compilations) and longlived
(calculations) processes(calculations) processes
● Parts of processes migrated to other nodesParts of processes migrated to other nodes
● OMFS allowed identical access to data from allOMFS allowed identical access to data from all
nodesnodes
openMosix LimitationsopenMosix Limitations
● shared memoryshared memory
•
Limited type of applications could migrateLimited type of applications could migrate
•
Patches available but not successfulPatches available but not successful
● Filesystem accessFilesystem access
oMFS : unstable => removedoMFS : unstable => removed
Lessons from openMosixLessons from openMosix
● Applications need to be adaptedApplications need to be adapted
● Files need to be accessible (oMFS)Files need to be accessible (oMFS)
● Huge gap between developers and consumersHuge gap between developers and consumers
=> Limited working use cases=> Limited working use cases
Linux-HALinux-HA (2005- now)(2005- now)
● Hearbeat, Heartbeat v2, Pacemaker , CorosyncHearbeat, Heartbeat v2, Pacemaker , Corosync
● Define resource (OCF)Define resource (OCF)
● Define constraints, clones, colocation, …Define constraints, clones, colocation, …
● Long running services that should not stopLong running services that should not stop
Working with developersWorking with developers
● State vs StatelessState vs Stateless
•
Most applications have state somewhereMost applications have state somewhere
•
Discuss how to share/access stateDiscuss how to share/access state
● Data accessData access
•
Local filesystem is kingLocal filesystem is king
•
We needed distributed / shared filesystemsWe needed distributed / shared filesystems
● HealthHealth
● MetricsMetrics
Lessons from Linux-HALessons from Linux-HA
● Applications need to be adaptedApplications need to be adapted
● Files need to be accessible (shared/distributedFiles need to be accessible (shared/distributed
FS)FS)
● Monitoring strategy needs changeMonitoring strategy needs change
● Good collaboration between developers andGood collaboration between developers and
ops folksops folks
=> Many general purpose use cases=> Many general purpose use cases
● Works better with an Open Source MindsetWorks better with an Open Source Mindset
Cloud Adoption is (s)lowCloud Adoption is (s)low
● Enterprises are afraid of cloudEnterprises are afraid of cloud
•
Security, Cost, Control, Stability, (insert moreSecurity, Cost, Control, Stability, (insert more
fud here)fud here)
● ““Private cloud” will solve thisPrivate cloud” will solve this
● Please fill in 4 word documents for for each VMPlease fill in 4 word documents for for each VM
you wantyou want
Failed (Private) CloudFailed (Private) Cloud
ProjectsProjects● Identical copies of Bare Metal or vm's movedIdentical copies of Bare Metal or vm's moved
to the cloudto the cloud
● No config managementNo config management
● No monitoringNo monitoring
● No resilienceNo resilience
● No API usageNo API usage
Why ?Why ?
● I want a VMI want a VM
•
Please fill in these 4 formsPlease fill in these 4 forms
•
Wait 5 weeksWait 5 weeks
● RepeatRepeat
IT Departments have not adapted,IT Departments have not adapted,
'Shadow'-IT is winning'Shadow'-IT is winning
DockerDocker
DockerDocker
DockerDockerDockerDocker
DockerDocker
DockerDocker
A Enterprise ContainerA Enterprise Container
● No different from aNo different from a
full vmfull vm
● Multiple servicesMultiple services
running in onerunning in one
containercontainer
● Ssh is the defaultSsh is the default
connectionconnection
Elephant , MonolithElephant , Monolith
vsvs
MicroservicesMicroservices
Docker is a Package managerDocker is a Package manager
Moby is killing your devops efforts
These DaysThese Days
● ““Put this Code Live, here's a DockerPut this Code Live, here's a Docker
Container ”Container ”
● No machines available ?No machines available ?
● What database ? Where to store theWhat database ? Where to store the
data ?data ?
● Security ? What distro is this even ?Security ? What distro is this even ?
Bad Cows ?Bad Cows ?
● How do we monitor his ?How do we monitor his ?
● Backups ?Backups ?
● How did you build this ?How did you build this ?
Moby is killing your devops efforts
11 days into operations11 days into operations
● ““Put this Code Live, here's Dockerfile”Put this Code Live, here's Dockerfile”
● What corporate proxy ?What corporate proxy ?
● Oh I missed 2 other containersOh I missed 2 other containers
● Security ? What distro is this even ?Security ? What distro is this even ?
Bad Cows ?Bad Cows ?
● What do you mean “We are a RHELWhat do you mean “We are a RHEL
shop ?”shop ?”
Closing the gaps between devClosing the gaps between dev
and ops,and ops, AGAIN !!AGAIN !!
● Where do your containers come from ?Where do your containers come from ?
● Who build it ?Who build it ?
● Can you rebuild it ?Can you rebuild it ?
● Do you even need a containerDo you even need a container
● How do you build the hosts that run theHow do you build the hosts that run the
containers ?containers ?
● Infrastructure as code ++Infrastructure as code ++
Operations teams catching upOperations teams catching up
Image Build by devs,Image Build by devs,
maintained by nobodymaintained by nobody
Can you ?Can you ?
● When GitHub is down ?When GitHub is down ?
● When rubygems.org isWhen rubygems.org is
down ?down ?
● When someone removesWhen someone removes
a Node.js library ?a Node.js library ?
● Fix critical SecurityFix critical Security
Issues ?Issues ?
● Can your business suriveCan your business surive
if you answer NO toif you answer NO to
these questions ?these questions ?
Going to ProductionGoing to Production
Dev vs ProdDev vs Prod
● 1 local dev machine1 local dev machine
● 1 local application1 local application
● A clusterA cluster
•
SwarmSwarm
•
KuberenetesKuberenetes
•
MesosMesos
•
NomadNomad
● Other ApplicationsOther Applications
Dev vs ProdDev vs Prod
● Localhost :8081Localhost :8081 ● HttpsHttps
● DnsDns
● IngressIngress
● LoadBalancingLoadBalancing
● Service DiscoveryService Discovery
● Or Vendor Lock InOr Vendor Lock In
Dev vs ProdDev vs Prod
● Local diskLocal disk
● No real dataNo real data
● Actual customer dataActual customer data
● Distributed StorageDistributed Storage
•
2017 is the year of2017 is the year of
NFS (again)NFS (again)
● Object StorageObject Storage
● BackupsBackups
Dev vs ProdDev vs Prod
● Random image fromRandom image from
the internetthe internet
+ Some local files+ Some local files
● CI PipelineCI Pipeline
● Image RegistryImage Registry
● Security ScanningSecurity Scanning
Dev vs ProdDev vs Prod
● Works on myWorks on my
machinemachine
● docker pull yolodocker pull yolo
● MonitoringMonitoring
● MetricsMetrics
● SecuritySecurity
● I love docker as aI love docker as a
technologytechnology
● I hate that it too oftenI hate that it too often
put us back 5 yearsput us back 5 years
with regards towith regards to
Culture adoptionCulture adoption
● Docker is an easyDocker is an easy
victim,victim,
● It's still mostly aboutIt's still mostly about
CultureCulture
It's still aboutIt's still about
collaborationcollaboration
ContactContact
Kris Buytaert Kris.Buytaert@inuits.euKris Buytaert Kris.Buytaert@inuits.eu
Further ReadingFurther Reading
@krisbuytaert@krisbuytaert
http://www.krisbuytaert.be/blog/http://www.krisbuytaert.be/blog/
http://www.inuits.eu/http://www.inuits.eu/
Inuits.euInuits.eu
Essensteenweg 31Essensteenweg 31
BrasschaatBrasschaat
BelgiumBelgium
891.514.231891.514.231
+32 475 961221+32 475 961221
Picture CreditsPicture Credits
https://www.flickr.com/photos/simoncarr/81918853/https://www.flickr.com/photos/simoncarr/81918853/
https://www.flickr.com/photos/tonynetone/8116629238/https://www.flickr.com/photos/tonynetone/8116629238/
https://www.flickr.com/photos/damienz/8665192113/in/photolist-ecHnJ2-x6tV12-63pJ8G-RTfSuB-rud69Z-4SuDfp-orEF86-odnENj-f4dtxn-o7L3LQ-63ktuB-https://www.flickr.com/photos/damienz/8665192113/in/photolist-ecHnJ2-x6tV12-63pJ8G-RTfSuB-rud69Z-4SuDfp-orEF86-odnENj-f4dtxn-o7L3LQ-63ktuB-
rjJUYG-qfSqHA-osWS38-75uUJT-9qrqeC-oKLaaC-qMy9Nf-oqmerS-p1yUcq-fPo32k-Vtc1v6-oarY18-fvH2gR-otbpNC-TGNoW5-oqe8vR-fxJnpw-5SMhm5-oBiLUG-rjJUYG-qfSqHA-osWS38-75uUJT-9qrqeC-oKLaaC-qMy9Nf-oqmerS-p1yUcq-fPo32k-Vtc1v6-oarY18-fvH2gR-otbpNC-TGNoW5-oqe8vR-fxJnpw-5SMhm5-oBiLUG-
pgCMkw-C77xyw-7RjQ9-Lja9B-rvPLg-4dCndQ-TyEc3Q-oLDg4s-soHSub-fcZsZS-cCheFS-bLgJpe-VgEBAF-rBhHfA-VpEAf1-bt1YME-8zoXyQ-6y1Y9B-f4EAfb-pgCMkw-C77xyw-7RjQ9-Lja9B-rvPLg-4dCndQ-TyEc3Q-oLDg4s-soHSub-fcZsZS-cCheFS-bLgJpe-VgEBAF-rBhHfA-VpEAf1-bt1YME-8zoXyQ-6y1Y9B-f4EAfb-
Tay1WgTay1Wg
1 of 43

Recommended

Is there a future for devops ? by
Is there a future for devops ?Is there a future for devops ?
Is there a future for devops ?Kris Buytaert
3.5K views49 slides
From devoops to devops by
From devoops to devopsFrom devoops to devops
From devoops to devopsKris Buytaert
827 views48 slides
Automating MySQL operations with Puppet by
Automating MySQL operations with PuppetAutomating MySQL operations with Puppet
Automating MySQL operations with PuppetKris Buytaert
1.8K views51 slides
The Return of the Dull Stack Engineer by
The Return of the Dull Stack EngineerThe Return of the Dull Stack Engineer
The Return of the Dull Stack EngineerKris Buytaert
2.4K views51 slides
Pipeline as Code by
Pipeline as CodePipeline as Code
Pipeline as CodeKris Buytaert
982 views20 slides
Devops is dead, Long Live Devops by
Devops is dead, Long Live DevopsDevops is dead, Long Live Devops
Devops is dead, Long Live DevopsKris Buytaert
1.7K views27 slides

More Related Content

What's hot

Docker is killing your #devops Efforts by
Docker is killing your #devops EffortsDocker is killing your #devops Efforts
Docker is killing your #devops EffortsKris Buytaert
2.6K views26 slides
Groovy there's a docker in my application pipeline by
Groovy there's a docker in my application pipelineGroovy there's a docker in my application pipeline
Groovy there's a docker in my application pipelineKris Buytaert
1.3K views45 slides
The influence of "Distributed platforms" on #devops by
The influence of "Distributed platforms" on #devopsThe influence of "Distributed platforms" on #devops
The influence of "Distributed platforms" on #devopsKris Buytaert
1.3K views29 slides
Continous Delivery of your Infrastructure by
Continous Delivery of your InfrastructureContinous Delivery of your Infrastructure
Continous Delivery of your InfrastructureKris Buytaert
857 views50 slides
Devops is a Security Requirement by
Devops is a Security RequirementDevops is a Security Requirement
Devops is a Security RequirementKris Buytaert
699 views64 slides
Pipeline as code for your infrastructure as Code by
Pipeline as code for your infrastructure as CodePipeline as code for your infrastructure as Code
Pipeline as code for your infrastructure as CodeKris Buytaert
1.9K views59 slides

What's hot(20)

Docker is killing your #devops Efforts by Kris Buytaert
Docker is killing your #devops EffortsDocker is killing your #devops Efforts
Docker is killing your #devops Efforts
Kris Buytaert2.6K views
Groovy there's a docker in my application pipeline by Kris Buytaert
Groovy there's a docker in my application pipelineGroovy there's a docker in my application pipeline
Groovy there's a docker in my application pipeline
Kris Buytaert1.3K views
The influence of "Distributed platforms" on #devops by Kris Buytaert
The influence of "Distributed platforms" on #devopsThe influence of "Distributed platforms" on #devops
The influence of "Distributed platforms" on #devops
Kris Buytaert1.3K views
Continous Delivery of your Infrastructure by Kris Buytaert
Continous Delivery of your InfrastructureContinous Delivery of your Infrastructure
Continous Delivery of your Infrastructure
Kris Buytaert857 views
Devops is a Security Requirement by Kris Buytaert
Devops is a Security RequirementDevops is a Security Requirement
Devops is a Security Requirement
Kris Buytaert699 views
Pipeline as code for your infrastructure as Code by Kris Buytaert
Pipeline as code for your infrastructure as CodePipeline as code for your infrastructure as Code
Pipeline as code for your infrastructure as Code
Kris Buytaert1.9K views
Dev secops opsec, devsec, devops ? by Kris Buytaert
Dev secops opsec, devsec, devops ?Dev secops opsec, devsec, devops ?
Dev secops opsec, devsec, devops ?
Kris Buytaert17.4K views
On the Importance of Infrastructure as Code by Kris Buytaert
On the Importance of Infrastructure as CodeOn the Importance of Infrastructure as Code
On the Importance of Infrastructure as Code
Kris Buytaert1.8K views
No, we can't do continuous delivery by Kris Buytaert
No, we can't do continuous deliveryNo, we can't do continuous delivery
No, we can't do continuous delivery
Kris Buytaert1.8K views
From MonitoringSucks to Monitoring Love , 2016 Edition by Kris Buytaert
From MonitoringSucks to Monitoring Love , 2016 EditionFrom MonitoringSucks to Monitoring Love , 2016 Edition
From MonitoringSucks to Monitoring Love , 2016 Edition
Kris Buytaert29.4K views
Devops is not about Tooling by Kris Buytaert
Devops is not about ToolingDevops is not about Tooling
Devops is not about Tooling
Kris Buytaert1.2K views
Run stuff, Deploy Stuff, Jax London 2017 Edition by Kris Buytaert
Run stuff, Deploy Stuff, Jax London 2017 EditionRun stuff, Deploy Stuff, Jax London 2017 Edition
Run stuff, Deploy Stuff, Jax London 2017 Edition
Kris Buytaert2.2K views
Another 7 tools for your #devops stack by Kris Buytaert
Another 7 tools for your #devops stackAnother 7 tools for your #devops stack
Another 7 tools for your #devops stack
Kris Buytaert1.6K views
Devopsdays Amsterdam 2017 Keynote, looking back at 5 years of AMS by Kris Buytaert
Devopsdays Amsterdam 2017 Keynote, looking back at 5 years of AMSDevopsdays Amsterdam 2017 Keynote, looking back at 5 years of AMS
Devopsdays Amsterdam 2017 Keynote, looking back at 5 years of AMS
Kris Buytaert772 views
Continuous Infrastructure First by Kris Buytaert
Continuous Infrastructure FirstContinuous Infrastructure First
Continuous Infrastructure First
Kris Buytaert568 views

Similar to Moby is killing your devops efforts

Continuous Infrastructure First by
Continuous Infrastructure FirstContinuous Infrastructure First
Continuous Infrastructure FirstKris Buytaert
521 views42 slides
Continuous Delivery of (y)our infrastructure. by
Continuous Delivery of (y)our infrastructure.Continuous Delivery of (y)our infrastructure.
Continuous Delivery of (y)our infrastructure.Kris Buytaert
3K views45 slides
From Config Management Sucks to #cfgmgmtlove by
From Config Management Sucks to #cfgmgmtlove From Config Management Sucks to #cfgmgmtlove
From Config Management Sucks to #cfgmgmtlove Kris Buytaert
2K views42 slides
OSDC 2016 - Another 7 Tools for your #devops Stack by Kris Buytaert by
OSDC 2016 - Another 7 Tools for your #devops Stack by Kris BuytaertOSDC 2016 - Another 7 Tools for your #devops Stack by Kris Buytaert
OSDC 2016 - Another 7 Tools for your #devops Stack by Kris BuytaertNETWAYS
81 views46 slides
OSMC 2017 | Groovy There is a Docker in my Dashing Pipeline by Kris Buytaert by
OSMC 2017 | Groovy There is a Docker in my Dashing Pipeline by Kris Buytaert OSMC 2017 | Groovy There is a Docker in my Dashing Pipeline by Kris Buytaert
OSMC 2017 | Groovy There is a Docker in my Dashing Pipeline by Kris Buytaert NETWAYS
152 views45 slides
Icinga Camp Amsterdam - Infrastructure as Code by
Icinga Camp Amsterdam - Infrastructure as CodeIcinga Camp Amsterdam - Infrastructure as Code
Icinga Camp Amsterdam - Infrastructure as CodeIcinga
3.3K views37 slides

Similar to Moby is killing your devops efforts(20)

Continuous Infrastructure First by Kris Buytaert
Continuous Infrastructure FirstContinuous Infrastructure First
Continuous Infrastructure First
Kris Buytaert521 views
Continuous Delivery of (y)our infrastructure. by Kris Buytaert
Continuous Delivery of (y)our infrastructure.Continuous Delivery of (y)our infrastructure.
Continuous Delivery of (y)our infrastructure.
Kris Buytaert3K views
From Config Management Sucks to #cfgmgmtlove by Kris Buytaert
From Config Management Sucks to #cfgmgmtlove From Config Management Sucks to #cfgmgmtlove
From Config Management Sucks to #cfgmgmtlove
Kris Buytaert2K views
OSDC 2016 - Another 7 Tools for your #devops Stack by Kris Buytaert by NETWAYS
OSDC 2016 - Another 7 Tools for your #devops Stack by Kris BuytaertOSDC 2016 - Another 7 Tools for your #devops Stack by Kris Buytaert
OSDC 2016 - Another 7 Tools for your #devops Stack by Kris Buytaert
NETWAYS81 views
OSMC 2017 | Groovy There is a Docker in my Dashing Pipeline by Kris Buytaert by NETWAYS
OSMC 2017 | Groovy There is a Docker in my Dashing Pipeline by Kris Buytaert OSMC 2017 | Groovy There is a Docker in my Dashing Pipeline by Kris Buytaert
OSMC 2017 | Groovy There is a Docker in my Dashing Pipeline by Kris Buytaert
NETWAYS152 views
Icinga Camp Amsterdam - Infrastructure as Code by Icinga
Icinga Camp Amsterdam - Infrastructure as CodeIcinga Camp Amsterdam - Infrastructure as Code
Icinga Camp Amsterdam - Infrastructure as Code
Icinga3.3K views
Open Source Monitoring in 2019 by Kris Buytaert
Open Source Monitoring in 2019 Open Source Monitoring in 2019
Open Source Monitoring in 2019
Kris Buytaert1.5K views
Continuous Infrastructure First Ignite Edition by Kris Buytaert
Continuous Infrastructure First  Ignite EditionContinuous Infrastructure First  Ignite Edition
Continuous Infrastructure First Ignite Edition
Kris Buytaert476 views
DevOps Days Kyiv 2019 -- continuous Infrafirstructure First //Kris buytaert by Mykola Marzhan
DevOps Days Kyiv 2019 -- continuous Infrafirstructure First //Kris buytaertDevOps Days Kyiv 2019 -- continuous Infrafirstructure First //Kris buytaert
DevOps Days Kyiv 2019 -- continuous Infrafirstructure First //Kris buytaert
Mykola Marzhan24 views
OSDC 2015: Kris Buytaert | From ConfigManagementSucks to ConfigManagementLove by NETWAYS
OSDC 2015: Kris Buytaert | From ConfigManagementSucks to ConfigManagementLoveOSDC 2015: Kris Buytaert | From ConfigManagementSucks to ConfigManagementLove
OSDC 2015: Kris Buytaert | From ConfigManagementSucks to ConfigManagementLove
NETWAYS204 views
Monitoring Drupal In an Infrastructure as Code Age by Kris Buytaert
Monitoring Drupal In an Infrastructure as Code AgeMonitoring Drupal In an Infrastructure as Code Age
Monitoring Drupal In an Infrastructure as Code Age
Kris Buytaert10.6K views
Drupal and Devops , the Survey Results by Kris Buytaert
Drupal and Devops , the Survey ResultsDrupal and Devops , the Survey Results
Drupal and Devops , the Survey Results
Kris Buytaert5.6K views
Looking back at 7.5 years of Devopsdays , DOd PDX by Kris Buytaert
Looking back at 7.5 years of Devopsdays , DOd PDXLooking back at 7.5 years of Devopsdays , DOd PDX
Looking back at 7.5 years of Devopsdays , DOd PDX
Kris Buytaert463 views
Devops, the future is here, it's just not evenly distributed yet. by Kris Buytaert
Devops, the future is here, it's just not evenly distributed yet.Devops, the future is here, it's just not evenly distributed yet.
Devops, the future is here, it's just not evenly distributed yet.
Kris Buytaert18.3K views
Devops Devops Devops, at Froscon by Kris Buytaert
Devops Devops Devops, at FrosconDevops Devops Devops, at Froscon
Devops Devops Devops, at Froscon
Kris Buytaert8K views
Future of Sysadmin 2014 by Kris Buytaert
Future of Sysadmin 2014Future of Sysadmin 2014
Future of Sysadmin 2014
Kris Buytaert4.8K views
When traditional configuration management is to slow for your needs by Kris Buytaert
When traditional configuration management is to slow for your needsWhen traditional configuration management is to slow for your needs
When traditional configuration management is to slow for your needs
Kris Buytaert1.4K views
Taking Docker to Production: What You Need to Know and Decide by Bret Fisher
Taking Docker to Production: What You Need to Know and DecideTaking Docker to Production: What You Need to Know and Decide
Taking Docker to Production: What You Need to Know and Decide
Bret Fisher53 views
Taking Docker to Production: What You Need to Know and Decide by Docker, Inc.
Taking Docker to Production: What You Need to Know and DecideTaking Docker to Production: What You Need to Know and Decide
Taking Docker to Production: What You Need to Know and Decide
Docker, Inc.1K views

More from Kris Buytaert

Years of (not) learning , from devops to devoops by
Years of (not) learning , from devops to devoopsYears of (not) learning , from devops to devoops
Years of (not) learning , from devops to devoopsKris Buytaert
65 views44 slides
Observability will not fix your Broken Monitoring ,Ignite by
Observability will not fix your Broken Monitoring ,IgniteObservability will not fix your Broken Monitoring ,Ignite
Observability will not fix your Broken Monitoring ,IgniteKris Buytaert
167 views20 slides
Infrastructure as Code Patterns by
Infrastructure as Code PatternsInfrastructure as Code Patterns
Infrastructure as Code PatternsKris Buytaert
117 views53 slides
From devoops to devops 13 years of (not) learning by
From devoops to devops 13 years of (not) learningFrom devoops to devops 13 years of (not) learning
From devoops to devops 13 years of (not) learningKris Buytaert
185 views40 slides
Pipeline all the Dashboards as Code by
Pipeline all the Dashboards as CodePipeline all the Dashboards as Code
Pipeline all the Dashboards as CodeKris Buytaert
644 views20 slides
Help , My Datacenter is on fire by
Help , My Datacenter is on fireHelp , My Datacenter is on fire
Help , My Datacenter is on fireKris Buytaert
542 views38 slides

More from Kris Buytaert(14)

Years of (not) learning , from devops to devoops by Kris Buytaert
Years of (not) learning , from devops to devoopsYears of (not) learning , from devops to devoops
Years of (not) learning , from devops to devoops
Kris Buytaert65 views
Observability will not fix your Broken Monitoring ,Ignite by Kris Buytaert
Observability will not fix your Broken Monitoring ,IgniteObservability will not fix your Broken Monitoring ,Ignite
Observability will not fix your Broken Monitoring ,Ignite
Kris Buytaert167 views
Infrastructure as Code Patterns by Kris Buytaert
Infrastructure as Code PatternsInfrastructure as Code Patterns
Infrastructure as Code Patterns
Kris Buytaert117 views
From devoops to devops 13 years of (not) learning by Kris Buytaert
From devoops to devops 13 years of (not) learningFrom devoops to devops 13 years of (not) learning
From devoops to devops 13 years of (not) learning
Kris Buytaert185 views
Pipeline all the Dashboards as Code by Kris Buytaert
Pipeline all the Dashboards as CodePipeline all the Dashboards as Code
Pipeline all the Dashboards as Code
Kris Buytaert644 views
Help , My Datacenter is on fire by Kris Buytaert
Help , My Datacenter is on fireHelp , My Datacenter is on fire
Help , My Datacenter is on fire
Kris Buytaert542 views
Devops is Dead, Long live Devops by Kris Buytaert
Devops is Dead, Long live DevopsDevops is Dead, Long live Devops
Devops is Dead, Long live Devops
Kris Buytaert289 views
10 years of #devopsdays, but what have we really learned ? by Kris Buytaert
10 years of #devopsdays, but what have we really learned ? 10 years of #devopsdays, but what have we really learned ?
10 years of #devopsdays, but what have we really learned ?
Kris Buytaert594 views
Is there a Future for devops ? by Kris Buytaert
Is there a Future for devops   ? Is there a Future for devops   ?
Is there a Future for devops ?
Kris Buytaert478 views
10 Years of #devopsdays weirdness by Kris Buytaert
10 Years of #devopsdays weirdness10 Years of #devopsdays weirdness
10 Years of #devopsdays weirdness
Kris Buytaert400 views
ADDO 2019: Looking back at over 10 years of Devops by Kris Buytaert
ADDO 2019:    Looking back at over 10 years of DevopsADDO 2019:    Looking back at over 10 years of Devops
ADDO 2019: Looking back at over 10 years of Devops
Kris Buytaert578 views
Looking back at 5 years of #cfgmgmtcamp by Kris Buytaert
Looking back at 5 years of #cfgmgmtcampLooking back at 5 years of #cfgmgmtcamp
Looking back at 5 years of #cfgmgmtcamp
Kris Buytaert625 views

Recently uploaded

Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlue by
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlueElevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlue
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlueShapeBlue
179 views7 slides
State of the Union - Rohit Yadav - Apache CloudStack by
State of the Union - Rohit Yadav - Apache CloudStackState of the Union - Rohit Yadav - Apache CloudStack
State of the Union - Rohit Yadav - Apache CloudStackShapeBlue
253 views53 slides
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ... by
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...ShapeBlue
123 views28 slides
Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or... by
Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or...Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or...
Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or...ShapeBlue
158 views20 slides
Confidence in CloudStack - Aron Wagner, Nathan Gleason - Americ by
Confidence in CloudStack - Aron Wagner, Nathan Gleason - AmericConfidence in CloudStack - Aron Wagner, Nathan Gleason - Americ
Confidence in CloudStack - Aron Wagner, Nathan Gleason - AmericShapeBlue
88 views9 slides
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ... by
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...ShapeBlue
146 views15 slides

Recently uploaded(20)

Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlue by ShapeBlue
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlueElevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlue
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlue
ShapeBlue179 views
State of the Union - Rohit Yadav - Apache CloudStack by ShapeBlue
State of the Union - Rohit Yadav - Apache CloudStackState of the Union - Rohit Yadav - Apache CloudStack
State of the Union - Rohit Yadav - Apache CloudStack
ShapeBlue253 views
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ... by ShapeBlue
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...
ShapeBlue123 views
Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or... by ShapeBlue
Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or...Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or...
Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or...
ShapeBlue158 views
Confidence in CloudStack - Aron Wagner, Nathan Gleason - Americ by ShapeBlue
Confidence in CloudStack - Aron Wagner, Nathan Gleason - AmericConfidence in CloudStack - Aron Wagner, Nathan Gleason - Americ
Confidence in CloudStack - Aron Wagner, Nathan Gleason - Americ
ShapeBlue88 views
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ... by ShapeBlue
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...
ShapeBlue146 views
"Surviving highload with Node.js", Andrii Shumada by Fwdays
"Surviving highload with Node.js", Andrii Shumada "Surviving highload with Node.js", Andrii Shumada
"Surviving highload with Node.js", Andrii Shumada
Fwdays53 views
CloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlue by ShapeBlue
CloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlueCloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlue
CloudStack Managed User Data and Demo - Harikrishna Patnala - ShapeBlue
ShapeBlue94 views
Migrating VMware Infra to KVM Using CloudStack - Nicolas Vazquez - ShapeBlue by ShapeBlue
Migrating VMware Infra to KVM Using CloudStack - Nicolas Vazquez - ShapeBlueMigrating VMware Infra to KVM Using CloudStack - Nicolas Vazquez - ShapeBlue
Migrating VMware Infra to KVM Using CloudStack - Nicolas Vazquez - ShapeBlue
ShapeBlue176 views
The Role of Patterns in the Era of Large Language Models by Yunyao Li
The Role of Patterns in the Era of Large Language ModelsThe Role of Patterns in the Era of Large Language Models
The Role of Patterns in the Era of Large Language Models
Yunyao Li80 views
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N... by James Anderson
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...
James Anderson156 views
Igniting Next Level Productivity with AI-Infused Data Integration Workflows by Safe Software
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Safe Software385 views
VNF Integration and Support in CloudStack - Wei Zhou - ShapeBlue by ShapeBlue
VNF Integration and Support in CloudStack - Wei Zhou - ShapeBlueVNF Integration and Support in CloudStack - Wei Zhou - ShapeBlue
VNF Integration and Support in CloudStack - Wei Zhou - ShapeBlue
ShapeBlue163 views
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit... by ShapeBlue
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...
ShapeBlue117 views
CloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlue by ShapeBlue
CloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlueCloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlue
CloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlue
ShapeBlue93 views
Keynote Talk: Open Source is Not Dead - Charles Schulz - Vates by ShapeBlue
Keynote Talk: Open Source is Not Dead - Charles Schulz - VatesKeynote Talk: Open Source is Not Dead - Charles Schulz - Vates
Keynote Talk: Open Source is Not Dead - Charles Schulz - Vates
ShapeBlue210 views
Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava... by ShapeBlue
Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava...Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava...
Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava...
ShapeBlue101 views

Moby is killing your devops efforts

  • 1. Moby is killing your devops efforts Kris Buytaert @krisbuytaert
  • 2. NOT this guy !NOT this guy !
  • 3. Kris BuytaertKris Buytaert ● I used to be a Dev,I used to be a Dev, ● Then Became an OpThen Became an Op ● CTO and Open Source ConsultantCTO and Open Source Consultant @@inuits.euinuits.eu ● Everything is a freaking DNSEverything is a freaking DNS ProblemProblem ● Evangelizing devopsEvangelizing devops ● Organiser of #devopsdays,Organiser of #devopsdays, #cfgmgmtcamp, #loadays, ….#cfgmgmtcamp, #loadays, ….
  • 4. Today's Plan:Today's Plan: ● Opening some eyesOpening some eyes ● Reusing 8 year old slidesReusing 8 year old slides
  • 5. C(L)AMSC(L)AMS ● CultureCulture ● (Lean)(Lean) ● AutomationAutomation ● MeasurementMeasurement ● SharingSharing Damon Edwards and JohnDamon Edwards and John WillisWillis
  • 6. A global movement to improve theA global movement to improve the quality of software delivery leveragingquality of software delivery leveraging Open Source experience, started in GentOpen Source experience, started in Gent in 2009in 2009
  • 7. Because the old days:Because the old days: ● ““Put this Code Live, here's a tarball” NOW!Put this Code Live, here's a tarball” NOW! ● What dependencies ?What dependencies ? ● No machines available ?No machines available ? ● What database ?What database ? ● Security ?Security ? ● High Availability ?High Availability ? ● Scalability ?Scalability ? ● My computer can't install this ?My computer can't install this ?
  • 8. 10 days into operations10 days into operations
  • 9. This new 'D' hypeThis new 'D' hype ● New kid on the blockNew kid on the block ● Vagrant-lxc with a nice cliVagrant-lxc with a nice cli ● The Ultimate “devops tool”The Ultimate “devops tool” ● ““Unseen” growthUnseen” growth ● Docker is the new cool thing to doDocker is the new cool thing to do
  • 12. People think I`m the whalePeople think I`m the whale
  • 14. openMosixopenMosix (+/- 2001-2005)(+/- 2001-2005) ● 2.4 Kernel patch,2.4 Kernel patch, ● Loadbalance multiple similar processesLoadbalance multiple similar processes ● Both short (compilations) and longlivedBoth short (compilations) and longlived (calculations) processes(calculations) processes ● Parts of processes migrated to other nodesParts of processes migrated to other nodes ● OMFS allowed identical access to data from allOMFS allowed identical access to data from all nodesnodes
  • 15. openMosix LimitationsopenMosix Limitations ● shared memoryshared memory • Limited type of applications could migrateLimited type of applications could migrate • Patches available but not successfulPatches available but not successful ● Filesystem accessFilesystem access oMFS : unstable => removedoMFS : unstable => removed
  • 16. Lessons from openMosixLessons from openMosix ● Applications need to be adaptedApplications need to be adapted ● Files need to be accessible (oMFS)Files need to be accessible (oMFS) ● Huge gap between developers and consumersHuge gap between developers and consumers => Limited working use cases=> Limited working use cases
  • 17. Linux-HALinux-HA (2005- now)(2005- now) ● Hearbeat, Heartbeat v2, Pacemaker , CorosyncHearbeat, Heartbeat v2, Pacemaker , Corosync ● Define resource (OCF)Define resource (OCF) ● Define constraints, clones, colocation, …Define constraints, clones, colocation, … ● Long running services that should not stopLong running services that should not stop
  • 18. Working with developersWorking with developers ● State vs StatelessState vs Stateless • Most applications have state somewhereMost applications have state somewhere • Discuss how to share/access stateDiscuss how to share/access state ● Data accessData access • Local filesystem is kingLocal filesystem is king • We needed distributed / shared filesystemsWe needed distributed / shared filesystems ● HealthHealth ● MetricsMetrics
  • 19. Lessons from Linux-HALessons from Linux-HA ● Applications need to be adaptedApplications need to be adapted ● Files need to be accessible (shared/distributedFiles need to be accessible (shared/distributed FS)FS) ● Monitoring strategy needs changeMonitoring strategy needs change ● Good collaboration between developers andGood collaboration between developers and ops folksops folks => Many general purpose use cases=> Many general purpose use cases ● Works better with an Open Source MindsetWorks better with an Open Source Mindset
  • 20. Cloud Adoption is (s)lowCloud Adoption is (s)low ● Enterprises are afraid of cloudEnterprises are afraid of cloud • Security, Cost, Control, Stability, (insert moreSecurity, Cost, Control, Stability, (insert more fud here)fud here) ● ““Private cloud” will solve thisPrivate cloud” will solve this ● Please fill in 4 word documents for for each VMPlease fill in 4 word documents for for each VM you wantyou want
  • 21. Failed (Private) CloudFailed (Private) Cloud ProjectsProjects● Identical copies of Bare Metal or vm's movedIdentical copies of Bare Metal or vm's moved to the cloudto the cloud ● No config managementNo config management ● No monitoringNo monitoring ● No resilienceNo resilience ● No API usageNo API usage
  • 22. Why ?Why ? ● I want a VMI want a VM • Please fill in these 4 formsPlease fill in these 4 forms • Wait 5 weeksWait 5 weeks ● RepeatRepeat IT Departments have not adapted,IT Departments have not adapted, 'Shadow'-IT is winning'Shadow'-IT is winning
  • 24. A Enterprise ContainerA Enterprise Container ● No different from aNo different from a full vmfull vm ● Multiple servicesMultiple services running in onerunning in one containercontainer ● Ssh is the defaultSsh is the default connectionconnection
  • 25. Elephant , MonolithElephant , Monolith vsvs MicroservicesMicroservices
  • 26. Docker is a Package managerDocker is a Package manager
  • 28. These DaysThese Days ● ““Put this Code Live, here's a DockerPut this Code Live, here's a Docker Container ”Container ” ● No machines available ?No machines available ? ● What database ? Where to store theWhat database ? Where to store the data ?data ? ● Security ? What distro is this even ?Security ? What distro is this even ? Bad Cows ?Bad Cows ? ● How do we monitor his ?How do we monitor his ? ● Backups ?Backups ? ● How did you build this ?How did you build this ?
  • 30. 11 days into operations11 days into operations ● ““Put this Code Live, here's Dockerfile”Put this Code Live, here's Dockerfile” ● What corporate proxy ?What corporate proxy ? ● Oh I missed 2 other containersOh I missed 2 other containers ● Security ? What distro is this even ?Security ? What distro is this even ? Bad Cows ?Bad Cows ? ● What do you mean “We are a RHELWhat do you mean “We are a RHEL shop ?”shop ?”
  • 31. Closing the gaps between devClosing the gaps between dev and ops,and ops, AGAIN !!AGAIN !! ● Where do your containers come from ?Where do your containers come from ? ● Who build it ?Who build it ? ● Can you rebuild it ?Can you rebuild it ? ● Do you even need a containerDo you even need a container ● How do you build the hosts that run theHow do you build the hosts that run the containers ?containers ? ● Infrastructure as code ++Infrastructure as code ++
  • 32. Operations teams catching upOperations teams catching up
  • 33. Image Build by devs,Image Build by devs, maintained by nobodymaintained by nobody
  • 34. Can you ?Can you ? ● When GitHub is down ?When GitHub is down ? ● When rubygems.org isWhen rubygems.org is down ?down ? ● When someone removesWhen someone removes a Node.js library ?a Node.js library ? ● Fix critical SecurityFix critical Security Issues ?Issues ? ● Can your business suriveCan your business surive if you answer NO toif you answer NO to these questions ?these questions ?
  • 35. Going to ProductionGoing to Production
  • 36. Dev vs ProdDev vs Prod ● 1 local dev machine1 local dev machine ● 1 local application1 local application ● A clusterA cluster • SwarmSwarm • KuberenetesKuberenetes • MesosMesos • NomadNomad ● Other ApplicationsOther Applications
  • 37. Dev vs ProdDev vs Prod ● Localhost :8081Localhost :8081 ● HttpsHttps ● DnsDns ● IngressIngress ● LoadBalancingLoadBalancing ● Service DiscoveryService Discovery ● Or Vendor Lock InOr Vendor Lock In
  • 38. Dev vs ProdDev vs Prod ● Local diskLocal disk ● No real dataNo real data ● Actual customer dataActual customer data ● Distributed StorageDistributed Storage • 2017 is the year of2017 is the year of NFS (again)NFS (again) ● Object StorageObject Storage ● BackupsBackups
  • 39. Dev vs ProdDev vs Prod ● Random image fromRandom image from the internetthe internet + Some local files+ Some local files ● CI PipelineCI Pipeline ● Image RegistryImage Registry ● Security ScanningSecurity Scanning
  • 40. Dev vs ProdDev vs Prod ● Works on myWorks on my machinemachine ● docker pull yolodocker pull yolo ● MonitoringMonitoring ● MetricsMetrics ● SecuritySecurity
  • 41. ● I love docker as aI love docker as a technologytechnology ● I hate that it too oftenI hate that it too often put us back 5 yearsput us back 5 years with regards towith regards to Culture adoptionCulture adoption ● Docker is an easyDocker is an easy victim,victim, ● It's still mostly aboutIt's still mostly about CultureCulture It's still aboutIt's still about collaborationcollaboration
  • 42. ContactContact Kris Buytaert Kris.Buytaert@inuits.euKris Buytaert Kris.Buytaert@inuits.eu Further ReadingFurther Reading @krisbuytaert@krisbuytaert http://www.krisbuytaert.be/blog/http://www.krisbuytaert.be/blog/ http://www.inuits.eu/http://www.inuits.eu/ Inuits.euInuits.eu Essensteenweg 31Essensteenweg 31 BrasschaatBrasschaat BelgiumBelgium 891.514.231891.514.231 +32 475 961221+32 475 961221
  • 43. Picture CreditsPicture Credits https://www.flickr.com/photos/simoncarr/81918853/https://www.flickr.com/photos/simoncarr/81918853/ https://www.flickr.com/photos/tonynetone/8116629238/https://www.flickr.com/photos/tonynetone/8116629238/ https://www.flickr.com/photos/damienz/8665192113/in/photolist-ecHnJ2-x6tV12-63pJ8G-RTfSuB-rud69Z-4SuDfp-orEF86-odnENj-f4dtxn-o7L3LQ-63ktuB-https://www.flickr.com/photos/damienz/8665192113/in/photolist-ecHnJ2-x6tV12-63pJ8G-RTfSuB-rud69Z-4SuDfp-orEF86-odnENj-f4dtxn-o7L3LQ-63ktuB- rjJUYG-qfSqHA-osWS38-75uUJT-9qrqeC-oKLaaC-qMy9Nf-oqmerS-p1yUcq-fPo32k-Vtc1v6-oarY18-fvH2gR-otbpNC-TGNoW5-oqe8vR-fxJnpw-5SMhm5-oBiLUG-rjJUYG-qfSqHA-osWS38-75uUJT-9qrqeC-oKLaaC-qMy9Nf-oqmerS-p1yUcq-fPo32k-Vtc1v6-oarY18-fvH2gR-otbpNC-TGNoW5-oqe8vR-fxJnpw-5SMhm5-oBiLUG- pgCMkw-C77xyw-7RjQ9-Lja9B-rvPLg-4dCndQ-TyEc3Q-oLDg4s-soHSub-fcZsZS-cCheFS-bLgJpe-VgEBAF-rBhHfA-VpEAf1-bt1YME-8zoXyQ-6y1Y9B-f4EAfb-pgCMkw-C77xyw-7RjQ9-Lja9B-rvPLg-4dCndQ-TyEc3Q-oLDg4s-soHSub-fcZsZS-cCheFS-bLgJpe-VgEBAF-rBhHfA-VpEAf1-bt1YME-8zoXyQ-6y1Y9B-f4EAfb- Tay1WgTay1Wg