SlideShare a Scribd company logo
Docker Hamburg 
The upcoming talk will be presented in English
Data focused Docker 
clustering 
Marcus Hughes
What was HybridCluster? 
• Full stack LAMP platform 
• FreeBSD Chroot containers 
• ZFS 
• Auto scaling 
• Failover 
• “AwesomeProxy”
Docker 
• Containers! 
• Application level containerisation 
• Data in “volumes” 
• Lack of data portability
Docker containers are portable
Introduction to Flocker 
• Open source volume manager 
• Multi-node “cluster” 
• 0.1 Released on 13th August (0.2 due on 2nd)
Flocker
Proxy layer 
• Moving an application can be disruptive 
• Application port responds on any node 
• Routes reconfigured on migration
ZFS 
• Similarities to Docker containers 
• ZFS on Linux 
• Resilient 
• Continuous replication
Migration 
• Container stops 
• Volumes (ZFS dataset) is sent 
• Routes altered 
• Container re-started on new host 
0.2 
• Incremental send
Application configuration 
"version": 1 
"applications": 
"mongodb-volume-example": 
"image": "clusterhq/mongodb" 
"ports": 
- "internal": 27017 
"external": 27017 
"volume": 
"mountpoint": "/data/db"
Deployment configuration 
"version": 1 
"nodes": 
"172.16.255.250": ["mongodb-volume-example"] 
"172.16.255.251": []
Deployment configuration 
flocker-deploy deployment.yml application.yml
Demo 
Lets see what these configuration files do!
Real world uses 
• Moving applications to production 
• Replacing servers 
• Scalability 
Future 
• Clone datasets
The Future 
Ideas from our past and possible directions
Contribute! 
• GitHub https://github.com/ClusterHQ/flocker 
• Email Marcus@ClusterHQ.com
Questions?

More Related Content

What's hot

GeoDistributed datacenter: the DNS way
GeoDistributed datacenter: the DNS wayGeoDistributed datacenter: the DNS way
GeoDistributed datacenter: the DNS way
Moyd.co LTD
 
Civil War: LXD vs Docker
Civil War: LXD vs DockerCivil War: LXD vs Docker
Civil War: LXD vs Docker
OpenNebula Project
 
Beyond Xen: A look into the Xen Cloud Platform
Beyond Xen: A look into the Xen Cloud PlatformBeyond Xen: A look into the Xen Cloud Platform
Beyond Xen: A look into the Xen Cloud Platform
The Linux Foundation
 
Automating Gluster @ Facebook - Shreyas Siravara
Automating Gluster @ Facebook - Shreyas SiravaraAutomating Gluster @ Facebook - Shreyas Siravara
Automating Gluster @ Facebook - Shreyas Siravara
Gluster.org
 
Heketi Functionality into Glusterd2
Heketi Functionality into Glusterd2Heketi Functionality into Glusterd2
Heketi Functionality into Glusterd2
Gluster.org
 
Kubernetes Workshop
Kubernetes WorkshopKubernetes Workshop
Kubernetes Workshop
Walter Liu
 
Scalability and Performance of CNS 3.6
Scalability and Performance of CNS 3.6Scalability and Performance of CNS 3.6
Scalability and Performance of CNS 3.6
Gluster.org
 
Kubernetes Webinar - Using ConfigMaps & Secrets
Kubernetes Webinar - Using ConfigMaps & Secrets Kubernetes Webinar - Using ConfigMaps & Secrets
Kubernetes Webinar - Using ConfigMaps & Secrets
Janakiram MSV
 
Branch Management in Git Fusion
Branch Management in Git FusionBranch Management in Git Fusion
Branch Management in Git Fusion
Perforce
 
MesosCon EU 2017 - Criteo - Operating Mesos-based Infrastructures
MesosCon EU 2017 - Criteo - Operating Mesos-based InfrastructuresMesosCon EU 2017 - Criteo - Operating Mesos-based Infrastructures
MesosCon EU 2017 - Criteo - Operating Mesos-based Infrastructures
pierrecdn -
 
Gluster as Native Storage for Containers - past, present and future
Gluster as Native Storage for Containers - past, present and futureGluster as Native Storage for Containers - past, present and future
Gluster as Native Storage for Containers - past, present and future
Gluster.org
 
GlusterFS and Openstack Storage
GlusterFS and Openstack StorageGlusterFS and Openstack Storage
GlusterFS and Openstack Storage
Deepak Shetty
 
WSO2Con EU 2016: Creating Microservices with WSO2 Microservices Framework fo...
WSO2Con EU 2016: Creating Microservices with WSO2 Microservices  Framework fo...WSO2Con EU 2016: Creating Microservices with WSO2 Microservices  Framework fo...
WSO2Con EU 2016: Creating Microservices with WSO2 Microservices Framework fo...
WSO2
 
What’s the Deal with Containers, Anyway?
What’s the Deal with Containers, Anyway?What’s the Deal with Containers, Anyway?
What’s the Deal with Containers, Anyway?
Stephen Foskett
 
Максим Барышиков-«WoT: Geographically distributed cluster of clusters»
Максим Барышиков-«WoT: Geographically distributed cluster of clusters»Максим Барышиков-«WoT: Geographically distributed cluster of clusters»
Максим Барышиков-«WoT: Geographically distributed cluster of clusters»
Tanya Denisyuk
 
Kubernetes Webinar Series - Exploring Daemon Sets and Jobs
Kubernetes Webinar Series - Exploring Daemon Sets and JobsKubernetes Webinar Series - Exploring Daemon Sets and Jobs
Kubernetes Webinar Series - Exploring Daemon Sets and Jobs
Janakiram MSV
 
Getting started with kubernetes
Getting started with kubernetesGetting started with kubernetes
Getting started with kubernetes
Janakiram MSV
 
Persistent Storage in Openshift using GlusterFS
Persistent Storage in Openshift using GlusterFSPersistent Storage in Openshift using GlusterFS
Persistent Storage in Openshift using GlusterFS
Humble Chirammal
 
Game DDOS Prevention
Game DDOS PreventionGame DDOS Prevention
Game DDOS Prevention
Walter Liu
 
Why Choose Xen For Your Cloud?
Why Choose Xen For Your Cloud? Why Choose Xen For Your Cloud?
Why Choose Xen For Your Cloud?
Todd Deshane
 

What's hot (20)

GeoDistributed datacenter: the DNS way
GeoDistributed datacenter: the DNS wayGeoDistributed datacenter: the DNS way
GeoDistributed datacenter: the DNS way
 
Civil War: LXD vs Docker
Civil War: LXD vs DockerCivil War: LXD vs Docker
Civil War: LXD vs Docker
 
Beyond Xen: A look into the Xen Cloud Platform
Beyond Xen: A look into the Xen Cloud PlatformBeyond Xen: A look into the Xen Cloud Platform
Beyond Xen: A look into the Xen Cloud Platform
 
Automating Gluster @ Facebook - Shreyas Siravara
Automating Gluster @ Facebook - Shreyas SiravaraAutomating Gluster @ Facebook - Shreyas Siravara
Automating Gluster @ Facebook - Shreyas Siravara
 
Heketi Functionality into Glusterd2
Heketi Functionality into Glusterd2Heketi Functionality into Glusterd2
Heketi Functionality into Glusterd2
 
Kubernetes Workshop
Kubernetes WorkshopKubernetes Workshop
Kubernetes Workshop
 
Scalability and Performance of CNS 3.6
Scalability and Performance of CNS 3.6Scalability and Performance of CNS 3.6
Scalability and Performance of CNS 3.6
 
Kubernetes Webinar - Using ConfigMaps & Secrets
Kubernetes Webinar - Using ConfigMaps & Secrets Kubernetes Webinar - Using ConfigMaps & Secrets
Kubernetes Webinar - Using ConfigMaps & Secrets
 
Branch Management in Git Fusion
Branch Management in Git FusionBranch Management in Git Fusion
Branch Management in Git Fusion
 
MesosCon EU 2017 - Criteo - Operating Mesos-based Infrastructures
MesosCon EU 2017 - Criteo - Operating Mesos-based InfrastructuresMesosCon EU 2017 - Criteo - Operating Mesos-based Infrastructures
MesosCon EU 2017 - Criteo - Operating Mesos-based Infrastructures
 
Gluster as Native Storage for Containers - past, present and future
Gluster as Native Storage for Containers - past, present and futureGluster as Native Storage for Containers - past, present and future
Gluster as Native Storage for Containers - past, present and future
 
GlusterFS and Openstack Storage
GlusterFS and Openstack StorageGlusterFS and Openstack Storage
GlusterFS and Openstack Storage
 
WSO2Con EU 2016: Creating Microservices with WSO2 Microservices Framework fo...
WSO2Con EU 2016: Creating Microservices with WSO2 Microservices  Framework fo...WSO2Con EU 2016: Creating Microservices with WSO2 Microservices  Framework fo...
WSO2Con EU 2016: Creating Microservices with WSO2 Microservices Framework fo...
 
What’s the Deal with Containers, Anyway?
What’s the Deal with Containers, Anyway?What’s the Deal with Containers, Anyway?
What’s the Deal with Containers, Anyway?
 
Максим Барышиков-«WoT: Geographically distributed cluster of clusters»
Максим Барышиков-«WoT: Geographically distributed cluster of clusters»Максим Барышиков-«WoT: Geographically distributed cluster of clusters»
Максим Барышиков-«WoT: Geographically distributed cluster of clusters»
 
Kubernetes Webinar Series - Exploring Daemon Sets and Jobs
Kubernetes Webinar Series - Exploring Daemon Sets and JobsKubernetes Webinar Series - Exploring Daemon Sets and Jobs
Kubernetes Webinar Series - Exploring Daemon Sets and Jobs
 
Getting started with kubernetes
Getting started with kubernetesGetting started with kubernetes
Getting started with kubernetes
 
Persistent Storage in Openshift using GlusterFS
Persistent Storage in Openshift using GlusterFSPersistent Storage in Openshift using GlusterFS
Persistent Storage in Openshift using GlusterFS
 
Game DDOS Prevention
Game DDOS PreventionGame DDOS Prevention
Game DDOS Prevention
 
Why Choose Xen For Your Cloud?
Why Choose Xen For Your Cloud? Why Choose Xen For Your Cloud?
Why Choose Xen For Your Cloud?
 

Viewers also liked

Brand setters: A creative view by symbians
Brand setters: A creative view by symbiansBrand setters: A creative view by symbians
Brand setters: A creative view by symbians
ac001
 
All About Forklifts And Other Lifting Equipment For Dubai Businesses
All About Forklifts And Other Lifting Equipment For Dubai BusinessesAll About Forklifts And Other Lifting Equipment For Dubai Businesses
All About Forklifts And Other Lifting Equipment For Dubai Businessesspeedymaynardf
 
Kormákur lokahóf
Kormákur lokahófKormákur lokahóf
Kormákur lokahóf
Björgvin Brynjólfsson
 
Bren Starlight on Old Madras Road- Call 1800 3000 5245
Bren Starlight on Old Madras Road- Call 1800 3000 5245Bren Starlight on Old Madras Road- Call 1800 3000 5245
Bren Starlight on Old Madras Road- Call 1800 3000 5245
Kin Housing
 
Proposal for PSEB
Proposal for PSEBProposal for PSEB
Proposal for PSEB
Charu Pandey
 
Salarpuria Divinity Mysore Road Bangalore
Salarpuria Divinity Mysore Road BangaloreSalarpuria Divinity Mysore Road Bangalore
Salarpuria Divinity Mysore Road Bangalore
Kin Housing
 
Assignment 5B
Assignment 5BAssignment 5B
Assignment 5B
lturne3
 
Mahindra Windchimes Overview - Call on 1800 3000 5245
Mahindra Windchimes Overview - Call on 1800 3000 5245 Mahindra Windchimes Overview - Call on 1800 3000 5245
Mahindra Windchimes Overview - Call on 1800 3000 5245
Kin Housing
 

Viewers also liked (9)

Brand setters: A creative view by symbians
Brand setters: A creative view by symbiansBrand setters: A creative view by symbians
Brand setters: A creative view by symbians
 
All About Forklifts And Other Lifting Equipment For Dubai Businesses
All About Forklifts And Other Lifting Equipment For Dubai BusinessesAll About Forklifts And Other Lifting Equipment For Dubai Businesses
All About Forklifts And Other Lifting Equipment For Dubai Businesses
 
Kormákur lokahóf
Kormákur lokahófKormákur lokahóf
Kormákur lokahóf
 
Bren Starlight on Old Madras Road- Call 1800 3000 5245
Bren Starlight on Old Madras Road- Call 1800 3000 5245Bren Starlight on Old Madras Road- Call 1800 3000 5245
Bren Starlight on Old Madras Road- Call 1800 3000 5245
 
Proposal for PSEB
Proposal for PSEBProposal for PSEB
Proposal for PSEB
 
Salarpuria Divinity Mysore Road Bangalore
Salarpuria Divinity Mysore Road BangaloreSalarpuria Divinity Mysore Road Bangalore
Salarpuria Divinity Mysore Road Bangalore
 
Assignment 5B
Assignment 5BAssignment 5B
Assignment 5B
 
Mahindra Windchimes Overview - Call on 1800 3000 5245
Mahindra Windchimes Overview - Call on 1800 3000 5245 Mahindra Windchimes Overview - Call on 1800 3000 5245
Mahindra Windchimes Overview - Call on 1800 3000 5245
 
REVIVAL FLAMES
REVIVAL FLAMESREVIVAL FLAMES
REVIVAL FLAMES
 

Similar to Data Focused Docker Clustering. Docker Hamburg

Docker Dojo
Docker DojoDocker Dojo
Docker from A to Z, including Swarm and OCCS
Docker from A to Z, including Swarm and OCCSDocker from A to Z, including Swarm and OCCS
Docker from A to Z, including Swarm and OCCS
Frank Munz
 
Docker in the Oracle Universe / WebLogic 12c / OFM 12c
Docker in the Oracle Universe / WebLogic 12c / OFM 12cDocker in the Oracle Universe / WebLogic 12c / OFM 12c
Docker in the Oracle Universe / WebLogic 12c / OFM 12c
Frank Munz
 
Docker
DockerDocker
Docker Containers Deep Dive
Docker Containers Deep DiveDocker Containers Deep Dive
Docker Containers Deep Dive
Will Kinard
 
Containers and Cloud: From LXC to Docker to Kubernetes
Containers and Cloud: From LXC to Docker to KubernetesContainers and Cloud: From LXC to Docker to Kubernetes
Containers and Cloud: From LXC to Docker to Kubernetes
Shreyas MM
 
Civil War: Docker vs LXD
Civil War: Docker vs LXDCivil War: Docker vs LXD
Docker
DockerDocker
Develop with linux containers and docker
Develop with linux containers and dockerDevelop with linux containers and docker
Develop with linux containers and docker
Fabio Fumarola
 
Flocker
FlockerFlocker
Intro to Docker November 2013
Intro to Docker November 2013Intro to Docker November 2013
Intro to Docker November 2013Docker, Inc.
 
2 Linux Container and Docker
2 Linux Container and Docker2 Linux Container and Docker
2 Linux Container and Docker
Fabio Fumarola
 
Docker.pptx
Docker.pptxDocker.pptx
Docker.pptx
balaji257
 
Service discovery in Docker environments
Service discovery in Docker environmentsService discovery in Docker environments
Service discovery in Docker environments
alexandru giurgiu
 
Docker Presentation
Docker PresentationDocker Presentation
Docker Presentation
Adhoura Academy
 
Linux High Availability Overview - openSUSE.Asia Summit 2015
Linux High Availability Overview - openSUSE.Asia Summit 2015 Linux High Availability Overview - openSUSE.Asia Summit 2015
Linux High Availability Overview - openSUSE.Asia Summit 2015
Roger Zhou 周志强
 
NoSQL on the move
NoSQL on the moveNoSQL on the move
NoSQL on the move
Codemotion
 
Shipping NodeJS with Docker and CoreOS (No Notes)
Shipping NodeJS with Docker and CoreOS (No Notes)Shipping NodeJS with Docker and CoreOS (No Notes)
Shipping NodeJS with Docker and CoreOS (No Notes)
Ross Kukulinski
 
Cohesion Techsessie Docker - Daniel Palstra
Cohesion Techsessie Docker - Daniel PalstraCohesion Techsessie Docker - Daniel Palstra
Cohesion Techsessie Docker - Daniel Palstra
Daniel Palstra
 

Similar to Data Focused Docker Clustering. Docker Hamburg (20)

Docker Dojo
Docker DojoDocker Dojo
Docker Dojo
 
Docker from A to Z, including Swarm and OCCS
Docker from A to Z, including Swarm and OCCSDocker from A to Z, including Swarm and OCCS
Docker from A to Z, including Swarm and OCCS
 
Docker in the Oracle Universe / WebLogic 12c / OFM 12c
Docker in the Oracle Universe / WebLogic 12c / OFM 12cDocker in the Oracle Universe / WebLogic 12c / OFM 12c
Docker in the Oracle Universe / WebLogic 12c / OFM 12c
 
Docker
DockerDocker
Docker
 
Docker Containers Deep Dive
Docker Containers Deep DiveDocker Containers Deep Dive
Docker Containers Deep Dive
 
Containers and Cloud: From LXC to Docker to Kubernetes
Containers and Cloud: From LXC to Docker to KubernetesContainers and Cloud: From LXC to Docker to Kubernetes
Containers and Cloud: From LXC to Docker to Kubernetes
 
Civil War: Docker vs LXD
Civil War: Docker vs LXDCivil War: Docker vs LXD
Civil War: Docker vs LXD
 
Docker
DockerDocker
Docker
 
Develop with linux containers and docker
Develop with linux containers and dockerDevelop with linux containers and docker
Develop with linux containers and docker
 
Flocker
FlockerFlocker
Flocker
 
Intro to Docker November 2013
Intro to Docker November 2013Intro to Docker November 2013
Intro to Docker November 2013
 
Docker-Intro
Docker-IntroDocker-Intro
Docker-Intro
 
2 Linux Container and Docker
2 Linux Container and Docker2 Linux Container and Docker
2 Linux Container and Docker
 
Docker.pptx
Docker.pptxDocker.pptx
Docker.pptx
 
Service discovery in Docker environments
Service discovery in Docker environmentsService discovery in Docker environments
Service discovery in Docker environments
 
Docker Presentation
Docker PresentationDocker Presentation
Docker Presentation
 
Linux High Availability Overview - openSUSE.Asia Summit 2015
Linux High Availability Overview - openSUSE.Asia Summit 2015 Linux High Availability Overview - openSUSE.Asia Summit 2015
Linux High Availability Overview - openSUSE.Asia Summit 2015
 
NoSQL on the move
NoSQL on the moveNoSQL on the move
NoSQL on the move
 
Shipping NodeJS with Docker and CoreOS (No Notes)
Shipping NodeJS with Docker and CoreOS (No Notes)Shipping NodeJS with Docker and CoreOS (No Notes)
Shipping NodeJS with Docker and CoreOS (No Notes)
 
Cohesion Techsessie Docker - Daniel Palstra
Cohesion Techsessie Docker - Daniel PalstraCohesion Techsessie Docker - Daniel Palstra
Cohesion Techsessie Docker - Daniel Palstra
 

Recently uploaded

Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Product School
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
91mobiles
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi
Fwdays
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
Alison B. Lowndes
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Tobias Schneck
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
Paul Groth
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Inflectra
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Jeffrey Haguewood
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
Ralf Eggert
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
Product School
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
DianaGray10
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
Elena Simperl
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Product School
 

Recently uploaded (20)

Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
 

Data Focused Docker Clustering. Docker Hamburg

Editor's Notes

  1. Berlin specific stuff – After the 8 months in production maybe we can help with some of the issues encountered
  2. Introduction - English only - Name, About ClusterHQ and HybridCluster
  3. What We Learnt From HybridCluster - What was HybridCluster - Commercial Product - Pro - Containers over VMs (Lightweight [1]) - Reference IBM research paper (July 21st) - ZFS (supporters of openzfs project) Knew people would like containers and still believe this “All enterprises will use containers” [5] Lack of public documentation This portability would be more useful in general rather than limited to LAMP
  4. Lets talk Docker Docker - Extremely portable ... but! - Lack of Data Management in Docker - Volumes Caught out eye because containers! Originally based off of LXC and now have own containerisation engine, libContainer Quickly spawn an application (seconds), almost nil boot
  5. Docker captures the application very well. Makes it easy to provision a new instance elsewhere using “Docker run” as long as you don’t intent to carry over the state. We believe you should be able to carry over the state also. Welcome, Flocker.
  6. Flocker handled the data of your cluster. Define “cluster”. A group of servers running the same software (Flocker). - Luke described as “homogeneous”. - one node can be in your office, one on digitalocean, one AWS … irrelevant - servers be able to stand in for each other in the even of a failure - One server can fill in for another, more examples at end 0.2 introduces a couple of important features which are explained further
  7. We feel like we’re able to pick up on the portability where Docker left off. Using technologies before I mentions we can capture the volumes and make them equally as portable. ZFS Proxy – next slide
  8. Moving data means you need to be careful about inbound connections being routed correctly A port will route to the correct destination (where the docker container is live) When a container is migrated, the route to the port is altered to the new master Future, pause connections when a migration is happening and resume upon completion with the new route (NOT in this version).
  9. Contrary to belief, ZFS is stable (in citations) Luke liked ZFS to Docker containers Lightweight Portable Supporters of ZFSonLinux project. We employee two developers, one from the original FreeBSD implementation, and another Linux dev. We used ZFS on FreeBSD for HybridCluster and it worked very well. Self healing Pools are great, explain datasets Docker community seems to have this love for Btrfs. Richard Yao made an article about advantages of ZFS (Cite 2). Now supported by Debian. Continuous replication, can take snapshots up until a point in time and send them. (In 0.1.1 this is useful, explain on next slide).
  10. What happens when we want to move a container from server A to B? - Stop container - Replicate data with ZFS send/receive - Future - Snapshot, send data, stop container, send remaining data (due for 0.2) Future (undefined) Currently Geard manages router HybridCluster had a PythonProxy which is much more configurable Pause TCP connections Unleash upon completion
  11. All this together we have 3 layers Network Proxy Containers ZFS (local storage) When a migration happens the container is started (downloaded from repo if necessary) and dataset copied Routes recreated User requests handled by ALL nodes in the cluster
  12. Main thing to start with here, is like Docker… Flocker is split into a node and a CLI. You can run the CLI locally and connect to production flocker nodes. “fig style” application configuration. - Ties application components together - Makes it easy to spawn a full application and all services together Run through each stage of the configuration Coming in 0.2 Environment variables The main feature of Flocker however is to cluster the nodes together.
  13. So the deployment configuration is where magic happens. This defines which application gets defined on which of the generic servers. It’s a super simple configuration, and explain moving from one node to another is just changing the value of the node
  14. Super simple one line! Put all this together and have one line which handles your application deployment - routes Containers Datasets
  15. Follow notes in notes.txt at /home/clusterhq/deployments
  16. Moving from dev to staging to production Replace server by moving application to another node, removing old node, and maybe adding a new one? LAMP example, all on one node, it gets busy and you want a dedicated MySQL server, easily moved with Flocker The ability to clone configurations, the containers and their associated data. Useful for Dev environments Disposable applications for testing etc, maybe CI?
  17. Failover Continuous replication - point in time restore? Generic RPM so can be easily installed on existing systems Python proxy for holding requests More application configuration options - Env variables coming soon (0.2) - Building Dockerfiles? Many possibilities, it’s important you contribute Clone data
  18. Give it a try! Vargant image Tutorial on next slide We always need contributors Give us your thoughts What seems bad? What would you like to see? What direction do you think we should head Fork and contribute code