SlideShare a Scribd company logo
1 of 46
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
SYNNEFO: A COMPLETE CLOUD PLATFORM 
OVER GOOGLE GANETI WITH OPENSTACK APIs 
VANGELIS KOUKIS, TECH LEAD, SYNNEFO 
1
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
2 
Synnefo cloud platform 
An all-in-one cloud solution 
− Written from scratch in Python 
− Manages multiple Google Ganeti clusters of VMs 
− Uses Archipelago to unify all cloud storage resources 
− Exposes the OpenStack APIs to end users 
Production since 2011 
− Came out of the ~okeanos public cloud service
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
3 
Synnefo cloud platform 
A complete cloud platform 
− Identity Service 
− Object Storage Service 
− Compute Service 
− Network Service 
− Image Service 
− Volume Service
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
4 
Unified view of storage resources 
Files 
- User files, with Dropbox-like syncing 
Images 
- Templates for VM creation 
Volumes 
- Live disks, as seen from VMs 
Snapshots 
- Point-in-time snapshots of Volumes
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
5 
Services Overview
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
6 
Identity Service 
Identity Management, Resource Accounting and SSO 
− Multiple authentication methods per user 
 LDAP, AD, Local username/password, Federated (Shibboleth) 
 Google, Twitter, LinkedIn 
− Fine-grained per-user, per-resource quota 
− Exposes the OpenStack APIs (Keystone) to users
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
7 
Identity Service 
A single dashboard for users 
− View/modify profile information 
− Set/unset active authentication methods 
− Easy, integrated reporting of per-resource quotas 
− Project management: View/Join/Leave projects 
− Manage API access and retrieve authentication tokens
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
8 
Compute/Network/Image/Volume Service 
Layer over multiple Ganeti clusters 
− Python/Django implementation 
− Exposes the OpenStack APIs (Nova, Neutron, Glance, Cinder) 
A thin translation layer 
− From user (API) requests 
− To VM operations on multiple Ganeti clusters 
Ganeti clusters are distinct entities 
− May be geographically remote 
− Admin always has direct access for troubleshooting
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
9 
Compute/Network/Image/Volume Service 
Networking 
− Fully pluggable, for integration with existing infrastructure 
 VLAN pool, or MAC-prefix-based filtering on single VLAN 
 VXLAN for all-IP datacenter-wide networking 
 Open vSwitch support 
− IPv4/IPv6 public networks, complete isolation among VMs 
− Tens of thousands of private networks over single VLAN 
− Floating (“elastic”) IPv4 addresses, shared among VMs 
− NIC hotplugging for dynamic IP attachment/detachment 
− No need for NAT setup
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
10 
Compute/Network/Image/Volume Service 
Image Handling 
− Spawning VMs from custom Images 
− Images treated as Files on Storage service 
− System and User Images, fine-grained sharing, custom ACLs 
Images for all major Operating Systems 
− Windows Server 2008, 2008 R2, 2012, 2012 R2 
− Debian, Ubuntu, RHEL, CentOS, Fedora, ArchLinux, 
openSUSE, Gentoo 
− NetBSD, FreeBSD, OpenBSD
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
11 
Storage service 
A single location for user Files, VM Images, and Snapshots 
Exposes the OpenStack Object Storage API (Swift) 
− plus extensions, for sharing and syncing 
Rich sharing, with fine-grained Access Control Lists 
Hash-based (sha256) deduplication for individual blocks 
Partial file transfers, efficient syncing (Dropbox-like) 
Backed by Archipelago
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
12 
Layered design 
UI 
API 
CLOUD 
CLUSTER 
NODE 
HYPERVISOR 
OpenStack Synnefo 
OpenStack OpenStack 
Synnefo 
OpenStack 
Ganeti 
libvirt 
KVM / XEN KVM / XEN 
Client 
vCloud 
vCloud 
vCenter 
vSphere 
ESXi
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
13 
Architecture
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
14 
Google Ganeti 
Mature, production-ready VM cluster management 
− developed by Google, for Google’s corporate infra 
− as open source VMware alternative 
− scalable over commodity hw 
− in production inside Google since 2006 
Easy to integrate into existing infrastructure 
− Remote API over HTTP, pre/post hooks for every action!
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
15 
Google Ganeti 
Multiple storage backends out of the box 
− Local LVM 
− DRBD 
− Files on local or shared directory 
− RBD (Ceph/RADOS) 
− GlusterFS 
External Storage Interface for SAN/NAS support 
Support for Archipelago
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
16 
Archipelago 
Storage Virtualization System 
− Powering storage in Synnefo 
Decouples storage resources from storage backends 
− Files / Images / Volumes / Snapshots 
Unified way to provision, handle, and present resources 
Decouples logic from actual physical storage 
− Software-Defined Storage
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
17 
Interaction with Archipelago 
A common storage substrate for Synnefo 
Everything is a resource on Archipelago 
The same resource is exposed as 
− A File through the API of the Storage Service 
− An Image through the API of the Image Service 
− A live disk / VM Volume through the API of the Volume Service 
− A Snapshot through the API of the Volume Service 
All data remain in one place 
No copying of data around
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
18 
Cloud Storage with Archipelago 
Archipelago 
Storage backend 1 
(e.g., Ceph) 
Storage backend 2 
(e.g., GlusterFS) 
Storage backend 3 
(e.g., NFS over NAS)
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
19 
Composing Resources with Archipelago
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
20 
Archipelago logic 
Thin provisioning, with clones and snapshots 
− Independent from the underlying storage technology 
Hash-based data deduplication 
Pluggable architecture 
− Multiple endpoint (northbound) drivers 
− Multiple backend (southbound) drivers 
Multiple storage backends 
− Unified management 
− with storage migrations
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
21 
Spawn 
Freeze 
my own Ubuntu
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
22 
Clone 
Snapshot 
Ubuntu + user data
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
23
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
24
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
Monitor nodes 
25 
Storage 
RADOS 
Object Storage nodes 
block I/O 
Linux block 
driver 
Northbound 
interface 
Volume Composer 
Mapper 
Archipelago 
Ceph/RADOS 
driver 
Southbound 
interface 
object I/O 
Core
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
26 
Archipelago interfaces 
GLUSTER DRIVER 
GLUSTER
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
27 
Running Archipelago
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
28 
Comparison to OpenStack?
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
29 
Synnefo
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
30 
Why Synnefo? A: Enterprise VMs at Cloud scale. 
The best of both worlds 
− Enterprise, persistent, stable VMs, live migrations (VMware-like) 
 Key technologies: Ganeti 
− Over commodity hardware, no SAN needed 
 Key technologies: DRBD, Archipelago, Ceph 
− at Cloud scale, accessible over Cloud APIs (OpenStack-like) 
 Key technologies: Synnefo
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
31 
Why Synnefo? B: Unified Cloud Storage. 
Storage virtualization with Archipelago 
− Common storage pool for everything 
 User files, Images (VM templates), live VM volumes, Snapshots 
− Zero-copy thin cloning / snapshotting for super-fast provisioning 
 Over commodity hardware, no SAN needed 
 Less than 30 sec for a VM to be fully up and running 
− Independent of the actual data store 
− Pluggable storage: NFS/NAS, Ceph, Gluster, even SAN all at once 
 With inter-backend data moves
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
32 
Why Synnefo? C: Easier to run at scale. 
Distinct management domains: Synnefo and Ganeti 
− Management of self-contained Ganeti clusters 
− Distinct Synnefo and Ganeti upgrade cycles 
− Independent upgrades with no VM downtime 
Limited access to DBs, decentralized VM state 
− Only Synnefo workers need access to DBs 
− No access from Ganeti nodes 
 Reduces impact of possible VM breakout 
 Boosts scalability to thousands of nodes 
− Easier to firewall, easier to handle security-wise
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
33 
Why Synnefo? D: Survives failure. 
Physical node management 
− Dynamically add/remove/drain/set offline physical nodes 
− Dynamically add/remove/drain/rebalance whole Ganeti clusters 
− Evacuate failing nodes with live VM migrations, no VM downtime 
Recovery from failure 
− Built-in reconciliation mechanisms 
− Able to recover from Synnefo/Ganeti downtime 
 Ensures in-sync state across components 
Easier to contain failure 
− Outages contained inside smaller domains 
 inside a node, or inside a Ganeti cluster
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
34 
The ~okeanos use case 
Production since July 2011 
Numbers 
− Users: > 10000 
− VMs: > 10000 currently active 
− More than 350k VMs spawned so far, more than 100k networks 
Physical Infrastructure 
− 13 Ganeti Clusters, spanning a whole DC 
− 1PB of raw storage capacity
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
35 
Try it out! 
http://www.synnefo.org
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
36 
Thank you!
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
37 
Screenshots.
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
38
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
39
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
40
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
41
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
42
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
43
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
44
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
45
LinuxCon/CloudOpen 
North America 2014 
vkoukis@grnet.gr 
46

More Related Content

What's hot

Cloud Native Security: New Approach for a New Reality
Cloud Native Security: New Approach for a New RealityCloud Native Security: New Approach for a New Reality
Cloud Native Security: New Approach for a New RealityCarlos Andrés García
 
Anton Grishko "Multi-cloud with Google Anthos, Kubernetes and Istio. How to s...
Anton Grishko "Multi-cloud with Google Anthos, Kubernetes and Istio. How to s...Anton Grishko "Multi-cloud with Google Anthos, Kubernetes and Istio. How to s...
Anton Grishko "Multi-cloud with Google Anthos, Kubernetes and Istio. How to s...Fwdays
 
AnsibleFest 2020 - Automate cybersecurity solutions in a cloud native scenario
AnsibleFest 2020 - Automate cybersecurity solutions in a cloud native scenarioAnsibleFest 2020 - Automate cybersecurity solutions in a cloud native scenario
AnsibleFest 2020 - Automate cybersecurity solutions in a cloud native scenarioRoberto Carratala
 
Choosing PaaS: Cisco and Open Source Options: an overview
Choosing PaaS:  Cisco and Open Source Options: an overviewChoosing PaaS:  Cisco and Open Source Options: an overview
Choosing PaaS: Cisco and Open Source Options: an overviewCisco DevNet
 
PKS - Solving Complexity for Modern Data Workloads
PKS - Solving Complexity for Modern Data Workloads PKS - Solving Complexity for Modern Data Workloads
PKS - Solving Complexity for Modern Data Workloads Carlos Andrés García
 
Securing and Automating Kubernetes with Kyverno
Securing and Automating Kubernetes with KyvernoSecuring and Automating Kubernetes with Kyverno
Securing and Automating Kubernetes with KyvernoSaim Safder
 
Cloud Application Blueprints with Apache Brooklyn by Alex Henevald
Cloud Application Blueprints with Apache Brooklyn by Alex HenevaldCloud Application Blueprints with Apache Brooklyn by Alex Henevald
Cloud Application Blueprints with Apache Brooklyn by Alex Henevaldbuildacloud
 
CWIN17 london becoming cloud native part 2 - guy martin docker
CWIN17 london   becoming cloud native part 2 - guy martin dockerCWIN17 london   becoming cloud native part 2 - guy martin docker
CWIN17 london becoming cloud native part 2 - guy martin dockerCapgemini
 
State of the Stack v4 - OpenStack in All It's Glory
State of the Stack v4 - OpenStack in All It's GloryState of the Stack v4 - OpenStack in All It's Glory
State of the Stack v4 - OpenStack in All It's GloryRandy Bias
 
Getting started with OpenStack
Getting started with OpenStackGetting started with OpenStack
Getting started with OpenStackKnoldus Inc.
 
Google Anthos - Azure Stack - AWS Outposts :Comparison
Google Anthos - Azure Stack - AWS Outposts :ComparisonGoogle Anthos - Azure Stack - AWS Outposts :Comparison
Google Anthos - Azure Stack - AWS Outposts :ComparisonKrishna-Kumar
 
Java EE Modernization with Mesosphere DCOS
Java EE Modernization with Mesosphere DCOSJava EE Modernization with Mesosphere DCOS
Java EE Modernization with Mesosphere DCOSMesosphere Inc.
 
Rightscale Webinar: Designing Private & Hybrid Clouds (Hosted by Citrix)
Rightscale Webinar: Designing Private & Hybrid Clouds (Hosted by Citrix)Rightscale Webinar: Designing Private & Hybrid Clouds (Hosted by Citrix)
Rightscale Webinar: Designing Private & Hybrid Clouds (Hosted by Citrix)RightScale
 
Cloud Native Summit 2019 Summary
Cloud Native Summit 2019 SummaryCloud Native Summit 2019 Summary
Cloud Native Summit 2019 SummaryEverett Toews
 
Introduction to OpenStack (Juno)
Introduction to OpenStack (Juno)Introduction to OpenStack (Juno)
Introduction to OpenStack (Juno)Krunal Jain
 
CSTA - Cisco Security Technical Alliances, New Ecosystem Program Built on the...
CSTA - Cisco Security Technical Alliances, New Ecosystem Program Built on the...CSTA - Cisco Security Technical Alliances, New Ecosystem Program Built on the...
CSTA - Cisco Security Technical Alliances, New Ecosystem Program Built on the...Cisco DevNet
 
OpenStack- A ringside view of Services and Architecture
OpenStack- A ringside view of Services and ArchitectureOpenStack- A ringside view of Services and Architecture
OpenStack- A ringside view of Services and ArchitectureRitesh Somani
 
Webinar: What's New in DC/OS 1.11
Webinar: What's New in DC/OS 1.11Webinar: What's New in DC/OS 1.11
Webinar: What's New in DC/OS 1.11Mesosphere Inc.
 
Anthos Security: modernize your security posture for cloud native applications
Anthos Security: modernize your security posture for cloud native applicationsAnthos Security: modernize your security posture for cloud native applications
Anthos Security: modernize your security posture for cloud native applicationsGreg Castle
 
OpenStack 101 Presentation
OpenStack 101 PresentationOpenStack 101 Presentation
OpenStack 101 PresentationEVault
 

What's hot (20)

Cloud Native Security: New Approach for a New Reality
Cloud Native Security: New Approach for a New RealityCloud Native Security: New Approach for a New Reality
Cloud Native Security: New Approach for a New Reality
 
Anton Grishko "Multi-cloud with Google Anthos, Kubernetes and Istio. How to s...
Anton Grishko "Multi-cloud with Google Anthos, Kubernetes and Istio. How to s...Anton Grishko "Multi-cloud with Google Anthos, Kubernetes and Istio. How to s...
Anton Grishko "Multi-cloud with Google Anthos, Kubernetes and Istio. How to s...
 
AnsibleFest 2020 - Automate cybersecurity solutions in a cloud native scenario
AnsibleFest 2020 - Automate cybersecurity solutions in a cloud native scenarioAnsibleFest 2020 - Automate cybersecurity solutions in a cloud native scenario
AnsibleFest 2020 - Automate cybersecurity solutions in a cloud native scenario
 
Choosing PaaS: Cisco and Open Source Options: an overview
Choosing PaaS:  Cisco and Open Source Options: an overviewChoosing PaaS:  Cisco and Open Source Options: an overview
Choosing PaaS: Cisco and Open Source Options: an overview
 
PKS - Solving Complexity for Modern Data Workloads
PKS - Solving Complexity for Modern Data Workloads PKS - Solving Complexity for Modern Data Workloads
PKS - Solving Complexity for Modern Data Workloads
 
Securing and Automating Kubernetes with Kyverno
Securing and Automating Kubernetes with KyvernoSecuring and Automating Kubernetes with Kyverno
Securing and Automating Kubernetes with Kyverno
 
Cloud Application Blueprints with Apache Brooklyn by Alex Henevald
Cloud Application Blueprints with Apache Brooklyn by Alex HenevaldCloud Application Blueprints with Apache Brooklyn by Alex Henevald
Cloud Application Blueprints with Apache Brooklyn by Alex Henevald
 
CWIN17 london becoming cloud native part 2 - guy martin docker
CWIN17 london   becoming cloud native part 2 - guy martin dockerCWIN17 london   becoming cloud native part 2 - guy martin docker
CWIN17 london becoming cloud native part 2 - guy martin docker
 
State of the Stack v4 - OpenStack in All It's Glory
State of the Stack v4 - OpenStack in All It's GloryState of the Stack v4 - OpenStack in All It's Glory
State of the Stack v4 - OpenStack in All It's Glory
 
Getting started with OpenStack
Getting started with OpenStackGetting started with OpenStack
Getting started with OpenStack
 
Google Anthos - Azure Stack - AWS Outposts :Comparison
Google Anthos - Azure Stack - AWS Outposts :ComparisonGoogle Anthos - Azure Stack - AWS Outposts :Comparison
Google Anthos - Azure Stack - AWS Outposts :Comparison
 
Java EE Modernization with Mesosphere DCOS
Java EE Modernization with Mesosphere DCOSJava EE Modernization with Mesosphere DCOS
Java EE Modernization with Mesosphere DCOS
 
Rightscale Webinar: Designing Private & Hybrid Clouds (Hosted by Citrix)
Rightscale Webinar: Designing Private & Hybrid Clouds (Hosted by Citrix)Rightscale Webinar: Designing Private & Hybrid Clouds (Hosted by Citrix)
Rightscale Webinar: Designing Private & Hybrid Clouds (Hosted by Citrix)
 
Cloud Native Summit 2019 Summary
Cloud Native Summit 2019 SummaryCloud Native Summit 2019 Summary
Cloud Native Summit 2019 Summary
 
Introduction to OpenStack (Juno)
Introduction to OpenStack (Juno)Introduction to OpenStack (Juno)
Introduction to OpenStack (Juno)
 
CSTA - Cisco Security Technical Alliances, New Ecosystem Program Built on the...
CSTA - Cisco Security Technical Alliances, New Ecosystem Program Built on the...CSTA - Cisco Security Technical Alliances, New Ecosystem Program Built on the...
CSTA - Cisco Security Technical Alliances, New Ecosystem Program Built on the...
 
OpenStack- A ringside view of Services and Architecture
OpenStack- A ringside view of Services and ArchitectureOpenStack- A ringside view of Services and Architecture
OpenStack- A ringside view of Services and Architecture
 
Webinar: What's New in DC/OS 1.11
Webinar: What's New in DC/OS 1.11Webinar: What's New in DC/OS 1.11
Webinar: What's New in DC/OS 1.11
 
Anthos Security: modernize your security posture for cloud native applications
Anthos Security: modernize your security posture for cloud native applicationsAnthos Security: modernize your security posture for cloud native applications
Anthos Security: modernize your security posture for cloud native applications
 
OpenStack 101 Presentation
OpenStack 101 PresentationOpenStack 101 Presentation
OpenStack 101 Presentation
 

Similar to Synnefo @ LinuxCon/CloudOpen North America 2014

The Enhanced Cisco Container Platform
The Enhanced Cisco Container PlatformThe Enhanced Cisco Container Platform
The Enhanced Cisco Container PlatformRobb Boyd
 
OpenNebulaConf 2016 - OpenNebula, a story about flexibility and technological...
OpenNebulaConf 2016 - OpenNebula, a story about flexibility and technological...OpenNebulaConf 2016 - OpenNebula, a story about flexibility and technological...
OpenNebulaConf 2016 - OpenNebula, a story about flexibility and technological...OpenNebula Project
 
Swiss IPv6 Council – Case Study - Deployment von IPv6 in einer Container Plat...
Swiss IPv6 Council – Case Study - Deployment von IPv6 in einer Container Plat...Swiss IPv6 Council – Case Study - Deployment von IPv6 in einer Container Plat...
Swiss IPv6 Council – Case Study - Deployment von IPv6 in einer Container Plat...Digicomp Academy AG
 
IPv6 on Container Plattforms
IPv6 on Container PlattformsIPv6 on Container Plattforms
IPv6 on Container PlattformsAarno Aukia
 
Storage as a service OpenStack
Storage as a service OpenStackStorage as a service OpenStack
Storage as a service OpenStackopenstackindia
 
OpenEBS Technical Workshop - KubeCon San Diego 2019
OpenEBS Technical Workshop - KubeCon San Diego 2019OpenEBS Technical Workshop - KubeCon San Diego 2019
OpenEBS Technical Workshop - KubeCon San Diego 2019MayaData Inc
 
An overview of OpenStack for the VMware community
An overview of OpenStack for the VMware communityAn overview of OpenStack for the VMware community
An overview of OpenStack for the VMware communityAnthony Chow
 
Cloud Strategies for a modern hybrid datacenter - Dec 2015
Cloud Strategies for a modern hybrid datacenter - Dec 2015Cloud Strategies for a modern hybrid datacenter - Dec 2015
Cloud Strategies for a modern hybrid datacenter - Dec 2015Miguel Pérez Colino
 
Redfish and python-redfish for Software Defined Infrastructure
Redfish and python-redfish for Software Defined InfrastructureRedfish and python-redfish for Software Defined Infrastructure
Redfish and python-redfish for Software Defined InfrastructureBruno Cornec
 
Comparison of control plane deployment architectures in the scope of hypercon...
Comparison of control plane deployment architectures in the scope of hypercon...Comparison of control plane deployment architectures in the scope of hypercon...
Comparison of control plane deployment architectures in the scope of hypercon...Miroslav Halas
 
Manila-An Update from Liberty
Manila-An Update from LibertyManila-An Update from Liberty
Manila-An Update from Libertyakshai_sarathy
 
CSEUG introduction
CSEUG introductionCSEUG introduction
CSEUG introductionShapeBlue
 
Ceph Day Amsterdam 2015 - Building your own disaster? The safe way to make C...
Ceph Day Amsterdam 2015 - Building your own disaster?  The safe way to make C...Ceph Day Amsterdam 2015 - Building your own disaster?  The safe way to make C...
Ceph Day Amsterdam 2015 - Building your own disaster? The safe way to make C...Ceph Community
 
Moby Open Source Summit North America 2017
Moby Open Source Summit North America 2017Moby Open Source Summit North America 2017
Moby Open Source Summit North America 2017Patrick Chanezon
 
Open stack icehouse microsoftupdate
Open stack icehouse microsoftupdateOpen stack icehouse microsoftupdate
Open stack icehouse microsoftupdateKamesh Pemmaraju
 
kata-containers-onboarding-deck.pptx
kata-containers-onboarding-deck.pptxkata-containers-onboarding-deck.pptx
kata-containers-onboarding-deck.pptxQforQA
 
OpenNebula Conf 2014 | Using Ceph to provide scalable storage for OpenNebula ...
OpenNebula Conf 2014 | Using Ceph to provide scalable storage for OpenNebula ...OpenNebula Conf 2014 | Using Ceph to provide scalable storage for OpenNebula ...
OpenNebula Conf 2014 | Using Ceph to provide scalable storage for OpenNebula ...NETWAYS
 
OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...
OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...
OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...OpenNebula Project
 
Deploying Windows Apps to Kubernetes with Draft and Helm
Deploying Windows Apps to Kubernetes with Draft and HelmDeploying Windows Apps to Kubernetes with Draft and Helm
Deploying Windows Apps to Kubernetes with Draft and HelmJessica Deen
 
CoreOS and cloud provider integration: simple cloud-init example at Exoscale
CoreOS and cloud provider integration: simple cloud-init example at ExoscaleCoreOS and cloud provider integration: simple cloud-init example at Exoscale
CoreOS and cloud provider integration: simple cloud-init example at ExoscaleAntoine COETSIER
 

Similar to Synnefo @ LinuxCon/CloudOpen North America 2014 (20)

The Enhanced Cisco Container Platform
The Enhanced Cisco Container PlatformThe Enhanced Cisco Container Platform
The Enhanced Cisco Container Platform
 
OpenNebulaConf 2016 - OpenNebula, a story about flexibility and technological...
OpenNebulaConf 2016 - OpenNebula, a story about flexibility and technological...OpenNebulaConf 2016 - OpenNebula, a story about flexibility and technological...
OpenNebulaConf 2016 - OpenNebula, a story about flexibility and technological...
 
Swiss IPv6 Council – Case Study - Deployment von IPv6 in einer Container Plat...
Swiss IPv6 Council – Case Study - Deployment von IPv6 in einer Container Plat...Swiss IPv6 Council – Case Study - Deployment von IPv6 in einer Container Plat...
Swiss IPv6 Council – Case Study - Deployment von IPv6 in einer Container Plat...
 
IPv6 on Container Plattforms
IPv6 on Container PlattformsIPv6 on Container Plattforms
IPv6 on Container Plattforms
 
Storage as a service OpenStack
Storage as a service OpenStackStorage as a service OpenStack
Storage as a service OpenStack
 
OpenEBS Technical Workshop - KubeCon San Diego 2019
OpenEBS Technical Workshop - KubeCon San Diego 2019OpenEBS Technical Workshop - KubeCon San Diego 2019
OpenEBS Technical Workshop - KubeCon San Diego 2019
 
An overview of OpenStack for the VMware community
An overview of OpenStack for the VMware communityAn overview of OpenStack for the VMware community
An overview of OpenStack for the VMware community
 
Cloud Strategies for a modern hybrid datacenter - Dec 2015
Cloud Strategies for a modern hybrid datacenter - Dec 2015Cloud Strategies for a modern hybrid datacenter - Dec 2015
Cloud Strategies for a modern hybrid datacenter - Dec 2015
 
Redfish and python-redfish for Software Defined Infrastructure
Redfish and python-redfish for Software Defined InfrastructureRedfish and python-redfish for Software Defined Infrastructure
Redfish and python-redfish for Software Defined Infrastructure
 
Comparison of control plane deployment architectures in the scope of hypercon...
Comparison of control plane deployment architectures in the scope of hypercon...Comparison of control plane deployment architectures in the scope of hypercon...
Comparison of control plane deployment architectures in the scope of hypercon...
 
Manila-An Update from Liberty
Manila-An Update from LibertyManila-An Update from Liberty
Manila-An Update from Liberty
 
CSEUG introduction
CSEUG introductionCSEUG introduction
CSEUG introduction
 
Ceph Day Amsterdam 2015 - Building your own disaster? The safe way to make C...
Ceph Day Amsterdam 2015 - Building your own disaster?  The safe way to make C...Ceph Day Amsterdam 2015 - Building your own disaster?  The safe way to make C...
Ceph Day Amsterdam 2015 - Building your own disaster? The safe way to make C...
 
Moby Open Source Summit North America 2017
Moby Open Source Summit North America 2017Moby Open Source Summit North America 2017
Moby Open Source Summit North America 2017
 
Open stack icehouse microsoftupdate
Open stack icehouse microsoftupdateOpen stack icehouse microsoftupdate
Open stack icehouse microsoftupdate
 
kata-containers-onboarding-deck.pptx
kata-containers-onboarding-deck.pptxkata-containers-onboarding-deck.pptx
kata-containers-onboarding-deck.pptx
 
OpenNebula Conf 2014 | Using Ceph to provide scalable storage for OpenNebula ...
OpenNebula Conf 2014 | Using Ceph to provide scalable storage for OpenNebula ...OpenNebula Conf 2014 | Using Ceph to provide scalable storage for OpenNebula ...
OpenNebula Conf 2014 | Using Ceph to provide scalable storage for OpenNebula ...
 
OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...
OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...
OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...
 
Deploying Windows Apps to Kubernetes with Draft and Helm
Deploying Windows Apps to Kubernetes with Draft and HelmDeploying Windows Apps to Kubernetes with Draft and Helm
Deploying Windows Apps to Kubernetes with Draft and Helm
 
CoreOS and cloud provider integration: simple cloud-init example at Exoscale
CoreOS and cloud provider integration: simple cloud-init example at ExoscaleCoreOS and cloud provider integration: simple cloud-init example at Exoscale
CoreOS and cloud provider integration: simple cloud-init example at Exoscale
 

Recently uploaded

Understanding Flamingo - DeepMind's VLM Architecture
Understanding Flamingo - DeepMind's VLM ArchitectureUnderstanding Flamingo - DeepMind's VLM Architecture
Understanding Flamingo - DeepMind's VLM Architecturerahul_net
 
20240415 [Container Plumbing Days] Usernetes Gen2 - Kubernetes in Rootless Do...
20240415 [Container Plumbing Days] Usernetes Gen2 - Kubernetes in Rootless Do...20240415 [Container Plumbing Days] Usernetes Gen2 - Kubernetes in Rootless Do...
20240415 [Container Plumbing Days] Usernetes Gen2 - Kubernetes in Rootless Do...Akihiro Suda
 
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfGOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfAlina Yurenko
 
Introduction Computer Science - Software Design.pdf
Introduction Computer Science - Software Design.pdfIntroduction Computer Science - Software Design.pdf
Introduction Computer Science - Software Design.pdfFerryKemperman
 
CRM Contender Series: HubSpot vs. Salesforce
CRM Contender Series: HubSpot vs. SalesforceCRM Contender Series: HubSpot vs. Salesforce
CRM Contender Series: HubSpot vs. SalesforceBrainSell Technologies
 
Post Quantum Cryptography – The Impact on Identity
Post Quantum Cryptography – The Impact on IdentityPost Quantum Cryptography – The Impact on Identity
Post Quantum Cryptography – The Impact on Identityteam-WIBU
 
Comparing Linux OS Image Update Models - EOSS 2024.pdf
Comparing Linux OS Image Update Models - EOSS 2024.pdfComparing Linux OS Image Update Models - EOSS 2024.pdf
Comparing Linux OS Image Update Models - EOSS 2024.pdfDrew Moseley
 
Salesforce Implementation Services PPT By ABSYZ
Salesforce Implementation Services PPT By ABSYZSalesforce Implementation Services PPT By ABSYZ
Salesforce Implementation Services PPT By ABSYZABSYZ Inc
 
Machine Learning Software Engineering Patterns and Their Engineering
Machine Learning Software Engineering Patterns and Their EngineeringMachine Learning Software Engineering Patterns and Their Engineering
Machine Learning Software Engineering Patterns and Their EngineeringHironori Washizaki
 
Sending Calendar Invites on SES and Calendarsnack.pdf
Sending Calendar Invites on SES and Calendarsnack.pdfSending Calendar Invites on SES and Calendarsnack.pdf
Sending Calendar Invites on SES and Calendarsnack.pdf31events.com
 
Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...
Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...
Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...Cizo Technology Services
 
Tech Tuesday - Mastering Time Management Unlock the Power of OnePlan's Timesh...
Tech Tuesday - Mastering Time Management Unlock the Power of OnePlan's Timesh...Tech Tuesday - Mastering Time Management Unlock the Power of OnePlan's Timesh...
Tech Tuesday - Mastering Time Management Unlock the Power of OnePlan's Timesh...OnePlan Solutions
 
Software Project Health Check: Best Practices and Techniques for Your Product...
Software Project Health Check: Best Practices and Techniques for Your Product...Software Project Health Check: Best Practices and Techniques for Your Product...
Software Project Health Check: Best Practices and Techniques for Your Product...Velvetech LLC
 
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...confluent
 
Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsSafe Software
 
Ahmed Motair CV April 2024 (Senior SW Developer)
Ahmed Motair CV April 2024 (Senior SW Developer)Ahmed Motair CV April 2024 (Senior SW Developer)
Ahmed Motair CV April 2024 (Senior SW Developer)Ahmed Mater
 
Large Language Models for Test Case Evolution and Repair
Large Language Models for Test Case Evolution and RepairLarge Language Models for Test Case Evolution and Repair
Large Language Models for Test Case Evolution and RepairLionel Briand
 
Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...
Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...
Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...Natan Silnitsky
 
SpotFlow: Tracking Method Calls and States at Runtime
SpotFlow: Tracking Method Calls and States at RuntimeSpotFlow: Tracking Method Calls and States at Runtime
SpotFlow: Tracking Method Calls and States at Runtimeandrehoraa
 

Recently uploaded (20)

Understanding Flamingo - DeepMind's VLM Architecture
Understanding Flamingo - DeepMind's VLM ArchitectureUnderstanding Flamingo - DeepMind's VLM Architecture
Understanding Flamingo - DeepMind's VLM Architecture
 
20240415 [Container Plumbing Days] Usernetes Gen2 - Kubernetes in Rootless Do...
20240415 [Container Plumbing Days] Usernetes Gen2 - Kubernetes in Rootless Do...20240415 [Container Plumbing Days] Usernetes Gen2 - Kubernetes in Rootless Do...
20240415 [Container Plumbing Days] Usernetes Gen2 - Kubernetes in Rootless Do...
 
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfGOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
 
Introduction Computer Science - Software Design.pdf
Introduction Computer Science - Software Design.pdfIntroduction Computer Science - Software Design.pdf
Introduction Computer Science - Software Design.pdf
 
2.pdf Ejercicios de programación competitiva
2.pdf Ejercicios de programación competitiva2.pdf Ejercicios de programación competitiva
2.pdf Ejercicios de programación competitiva
 
CRM Contender Series: HubSpot vs. Salesforce
CRM Contender Series: HubSpot vs. SalesforceCRM Contender Series: HubSpot vs. Salesforce
CRM Contender Series: HubSpot vs. Salesforce
 
Post Quantum Cryptography – The Impact on Identity
Post Quantum Cryptography – The Impact on IdentityPost Quantum Cryptography – The Impact on Identity
Post Quantum Cryptography – The Impact on Identity
 
Comparing Linux OS Image Update Models - EOSS 2024.pdf
Comparing Linux OS Image Update Models - EOSS 2024.pdfComparing Linux OS Image Update Models - EOSS 2024.pdf
Comparing Linux OS Image Update Models - EOSS 2024.pdf
 
Salesforce Implementation Services PPT By ABSYZ
Salesforce Implementation Services PPT By ABSYZSalesforce Implementation Services PPT By ABSYZ
Salesforce Implementation Services PPT By ABSYZ
 
Machine Learning Software Engineering Patterns and Their Engineering
Machine Learning Software Engineering Patterns and Their EngineeringMachine Learning Software Engineering Patterns and Their Engineering
Machine Learning Software Engineering Patterns and Their Engineering
 
Sending Calendar Invites on SES and Calendarsnack.pdf
Sending Calendar Invites on SES and Calendarsnack.pdfSending Calendar Invites on SES and Calendarsnack.pdf
Sending Calendar Invites on SES and Calendarsnack.pdf
 
Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...
Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...
Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...
 
Tech Tuesday - Mastering Time Management Unlock the Power of OnePlan's Timesh...
Tech Tuesday - Mastering Time Management Unlock the Power of OnePlan's Timesh...Tech Tuesday - Mastering Time Management Unlock the Power of OnePlan's Timesh...
Tech Tuesday - Mastering Time Management Unlock the Power of OnePlan's Timesh...
 
Software Project Health Check: Best Practices and Techniques for Your Product...
Software Project Health Check: Best Practices and Techniques for Your Product...Software Project Health Check: Best Practices and Techniques for Your Product...
Software Project Health Check: Best Practices and Techniques for Your Product...
 
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
 
Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data Streams
 
Ahmed Motair CV April 2024 (Senior SW Developer)
Ahmed Motair CV April 2024 (Senior SW Developer)Ahmed Motair CV April 2024 (Senior SW Developer)
Ahmed Motair CV April 2024 (Senior SW Developer)
 
Large Language Models for Test Case Evolution and Repair
Large Language Models for Test Case Evolution and RepairLarge Language Models for Test Case Evolution and Repair
Large Language Models for Test Case Evolution and Repair
 
Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...
Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...
Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...
 
SpotFlow: Tracking Method Calls and States at Runtime
SpotFlow: Tracking Method Calls and States at RuntimeSpotFlow: Tracking Method Calls and States at Runtime
SpotFlow: Tracking Method Calls and States at Runtime
 

Synnefo @ LinuxCon/CloudOpen North America 2014

  • 1. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr SYNNEFO: A COMPLETE CLOUD PLATFORM OVER GOOGLE GANETI WITH OPENSTACK APIs VANGELIS KOUKIS, TECH LEAD, SYNNEFO 1
  • 2. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 2 Synnefo cloud platform An all-in-one cloud solution − Written from scratch in Python − Manages multiple Google Ganeti clusters of VMs − Uses Archipelago to unify all cloud storage resources − Exposes the OpenStack APIs to end users Production since 2011 − Came out of the ~okeanos public cloud service
  • 3. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 3 Synnefo cloud platform A complete cloud platform − Identity Service − Object Storage Service − Compute Service − Network Service − Image Service − Volume Service
  • 4. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 4 Unified view of storage resources Files - User files, with Dropbox-like syncing Images - Templates for VM creation Volumes - Live disks, as seen from VMs Snapshots - Point-in-time snapshots of Volumes
  • 5. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 5 Services Overview
  • 6. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 6 Identity Service Identity Management, Resource Accounting and SSO − Multiple authentication methods per user  LDAP, AD, Local username/password, Federated (Shibboleth)  Google, Twitter, LinkedIn − Fine-grained per-user, per-resource quota − Exposes the OpenStack APIs (Keystone) to users
  • 7. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 7 Identity Service A single dashboard for users − View/modify profile information − Set/unset active authentication methods − Easy, integrated reporting of per-resource quotas − Project management: View/Join/Leave projects − Manage API access and retrieve authentication tokens
  • 8. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 8 Compute/Network/Image/Volume Service Layer over multiple Ganeti clusters − Python/Django implementation − Exposes the OpenStack APIs (Nova, Neutron, Glance, Cinder) A thin translation layer − From user (API) requests − To VM operations on multiple Ganeti clusters Ganeti clusters are distinct entities − May be geographically remote − Admin always has direct access for troubleshooting
  • 9. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 9 Compute/Network/Image/Volume Service Networking − Fully pluggable, for integration with existing infrastructure  VLAN pool, or MAC-prefix-based filtering on single VLAN  VXLAN for all-IP datacenter-wide networking  Open vSwitch support − IPv4/IPv6 public networks, complete isolation among VMs − Tens of thousands of private networks over single VLAN − Floating (“elastic”) IPv4 addresses, shared among VMs − NIC hotplugging for dynamic IP attachment/detachment − No need for NAT setup
  • 10. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 10 Compute/Network/Image/Volume Service Image Handling − Spawning VMs from custom Images − Images treated as Files on Storage service − System and User Images, fine-grained sharing, custom ACLs Images for all major Operating Systems − Windows Server 2008, 2008 R2, 2012, 2012 R2 − Debian, Ubuntu, RHEL, CentOS, Fedora, ArchLinux, openSUSE, Gentoo − NetBSD, FreeBSD, OpenBSD
  • 11. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 11 Storage service A single location for user Files, VM Images, and Snapshots Exposes the OpenStack Object Storage API (Swift) − plus extensions, for sharing and syncing Rich sharing, with fine-grained Access Control Lists Hash-based (sha256) deduplication for individual blocks Partial file transfers, efficient syncing (Dropbox-like) Backed by Archipelago
  • 12. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 12 Layered design UI API CLOUD CLUSTER NODE HYPERVISOR OpenStack Synnefo OpenStack OpenStack Synnefo OpenStack Ganeti libvirt KVM / XEN KVM / XEN Client vCloud vCloud vCenter vSphere ESXi
  • 13. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 13 Architecture
  • 14. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 14 Google Ganeti Mature, production-ready VM cluster management − developed by Google, for Google’s corporate infra − as open source VMware alternative − scalable over commodity hw − in production inside Google since 2006 Easy to integrate into existing infrastructure − Remote API over HTTP, pre/post hooks for every action!
  • 15. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 15 Google Ganeti Multiple storage backends out of the box − Local LVM − DRBD − Files on local or shared directory − RBD (Ceph/RADOS) − GlusterFS External Storage Interface for SAN/NAS support Support for Archipelago
  • 16. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 16 Archipelago Storage Virtualization System − Powering storage in Synnefo Decouples storage resources from storage backends − Files / Images / Volumes / Snapshots Unified way to provision, handle, and present resources Decouples logic from actual physical storage − Software-Defined Storage
  • 17. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 17 Interaction with Archipelago A common storage substrate for Synnefo Everything is a resource on Archipelago The same resource is exposed as − A File through the API of the Storage Service − An Image through the API of the Image Service − A live disk / VM Volume through the API of the Volume Service − A Snapshot through the API of the Volume Service All data remain in one place No copying of data around
  • 18. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 18 Cloud Storage with Archipelago Archipelago Storage backend 1 (e.g., Ceph) Storage backend 2 (e.g., GlusterFS) Storage backend 3 (e.g., NFS over NAS)
  • 19. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 19 Composing Resources with Archipelago
  • 20. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 20 Archipelago logic Thin provisioning, with clones and snapshots − Independent from the underlying storage technology Hash-based data deduplication Pluggable architecture − Multiple endpoint (northbound) drivers − Multiple backend (southbound) drivers Multiple storage backends − Unified management − with storage migrations
  • 21. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 21 Spawn Freeze my own Ubuntu
  • 22. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 22 Clone Snapshot Ubuntu + user data
  • 23. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 23
  • 24. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 24
  • 25. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr Monitor nodes 25 Storage RADOS Object Storage nodes block I/O Linux block driver Northbound interface Volume Composer Mapper Archipelago Ceph/RADOS driver Southbound interface object I/O Core
  • 26. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 26 Archipelago interfaces GLUSTER DRIVER GLUSTER
  • 27. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 27 Running Archipelago
  • 28. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 28 Comparison to OpenStack?
  • 29. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 29 Synnefo
  • 30. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 30 Why Synnefo? A: Enterprise VMs at Cloud scale. The best of both worlds − Enterprise, persistent, stable VMs, live migrations (VMware-like)  Key technologies: Ganeti − Over commodity hardware, no SAN needed  Key technologies: DRBD, Archipelago, Ceph − at Cloud scale, accessible over Cloud APIs (OpenStack-like)  Key technologies: Synnefo
  • 31. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 31 Why Synnefo? B: Unified Cloud Storage. Storage virtualization with Archipelago − Common storage pool for everything  User files, Images (VM templates), live VM volumes, Snapshots − Zero-copy thin cloning / snapshotting for super-fast provisioning  Over commodity hardware, no SAN needed  Less than 30 sec for a VM to be fully up and running − Independent of the actual data store − Pluggable storage: NFS/NAS, Ceph, Gluster, even SAN all at once  With inter-backend data moves
  • 32. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 32 Why Synnefo? C: Easier to run at scale. Distinct management domains: Synnefo and Ganeti − Management of self-contained Ganeti clusters − Distinct Synnefo and Ganeti upgrade cycles − Independent upgrades with no VM downtime Limited access to DBs, decentralized VM state − Only Synnefo workers need access to DBs − No access from Ganeti nodes  Reduces impact of possible VM breakout  Boosts scalability to thousands of nodes − Easier to firewall, easier to handle security-wise
  • 33. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 33 Why Synnefo? D: Survives failure. Physical node management − Dynamically add/remove/drain/set offline physical nodes − Dynamically add/remove/drain/rebalance whole Ganeti clusters − Evacuate failing nodes with live VM migrations, no VM downtime Recovery from failure − Built-in reconciliation mechanisms − Able to recover from Synnefo/Ganeti downtime  Ensures in-sync state across components Easier to contain failure − Outages contained inside smaller domains  inside a node, or inside a Ganeti cluster
  • 34. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 34 The ~okeanos use case Production since July 2011 Numbers − Users: > 10000 − VMs: > 10000 currently active − More than 350k VMs spawned so far, more than 100k networks Physical Infrastructure − 13 Ganeti Clusters, spanning a whole DC − 1PB of raw storage capacity
  • 35. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 35 Try it out! http://www.synnefo.org
  • 36. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 36 Thank you!
  • 37. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 37 Screenshots.
  • 38. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 38
  • 39. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 39
  • 40. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 40
  • 41. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 41
  • 42. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 42
  • 43. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 43
  • 44. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 44
  • 45. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 45
  • 46. LinuxCon/CloudOpen North America 2014 vkoukis@grnet.gr 46