PERSISTENT STORAGE FOR CONTAINERS
Ric Wheeler, Sr. Director, Red Hat Storage Engineering
Vijay Bellur, Lead Architect, Red Hat Gluster Storage
What Are Linux Containers?
Software packaging concept that typically includes an
application and all of its runtime dependencies
• HIGHER quality software releases
• SHORTER test cycles
• EASIER application management
CONTAINER CONTAINER
APP
LIBS
HOST OS
SERVER
APP
LIBS
BENEFITS
Greater Portability, Automation, and Integration
PUSH IMAGE
CODE REGISTRY
CODE & BUILD TEST DEPLOY
PULL IMAGE
How Did We Get Here?
Development
Model
Application
Architecture
Deployment &
Packaging
Application
Infrastructure
Storage
Waterfall
Agile
Monolithic
N-tier
Bare Metal
Virtual Servers
Data Center
Hosted
Scale Up
Scale Out
DevOps MicroServices Containers Hybrid Cloud
Storage as
a Service
WHY PERSISTENT STORAGE FOR CONTAINERS?
“For which workloads or application use cases have you used/do you anticipate to use containers?”
Data Apps
Cloud Apps
Systems of
Engagement
Systems of
Record Web and Commerce
Software
Mobile Apps
Social Apps
77%
71%
62% 62%
57% 52%
46%
Base: 194 IT operations and development decision-makers at enterprise in APAC, EMEA,
and North America Source: A commissioned study conducted by Forrester Consulting on behalf of Red Hat, January 2015
Scalable, Cost Effective, Distributed Storage for Containers
CHOICE OF VOLUME PLUGINS
Red Hat’s Upstream Contributions
AUTOMATED CONFIGURATION
SINGLE CONTROL PANEL
CHOICE OF PERSISTENT STORAGE
Ceph RBD
Amazon EBS
Fiber Channel
GCE
iSCSI
NFS
GlusterFS
DRIVING THE FUTURE OF STORAGE
Nov 2015 Mar 2016 Summer 2016
CONVERGENCE OF STORAGE AND COMPUTE
RHGS Container
• Dedicated storage cluster for
containerized
• and PaaS environments
• Supported for OpenShift Enterprise
• Containerized Red Hat Gluster Storage serving
• storage from a dedicated storage cluster
• Optimized for applications running on RHEL 7,
• OpenShift Enterprise, and RHEL Container Host
• Containerized Red Hat Gluster Storage
inside OpenShift Enterprise alongside
application containers
• Red Hat Gluster Storage cluster
comprised of disks from multiple container
cluster nodes
CONTAINER READY STORAGE CONTAINERIZED STORAGE CONTAINER NATIVE STORAGE
MySQL Container
CONTAINER READY STORAGE
CONTAINER NODE 1
CONTAINER NODE 2
CONTAINER NODE 1
CONTAINER NODE 3
NGINX Container
NGINX Container
NGINX Container
CONTAINERIZED RED HAT GLUSTER STORAGE
CONTAINER NODE 1
CONTAINER NODE 2
NGINX Container
NGINX Container
CONTAINERIZED
RED HAT GLUSTER
STORAGE
OPENSHIFT NODE 2
CONTAINER-NATIVE STORAGE
Lower TCO
Unified Orchestration
Ease of Use
Greater control
OPENSHIFT NODE 3
OPENSHIFT NODE 1
RHGS Container RHGS Container
OPENSHIFT NODE 4
MASTER
NGINX Container NGINX Container
Elasticsearch Container
RHGS Container
CONTAINER TECHNOLOGIES
DevOps Tools and User Experience
Language Runtimes and Middleware
Databases and Other Services
Container Orchestration and Management
Container API Container Host
Storage
CUSTOMER SUCCESS
APPLICATION
SERVERS
CONVERGED
SERVERS
STORAGE
SERVERS
NEW AGILITIES allowed telco to bring a new offering to market faster and cheaper
LOWER COST than traditional storage and avoiding endless commitment to proprietary vendors
FLEXIBLE geo-replicated architecture can grow/shrink dynamically
OPTION to be tuned for price or performance
BENEFITS
CONTAINERIZED STORAGE
Applications and storage can co-exist on the same hardware
Higher server utilization and lowers operational costs
Storage generates only 3%-10% overhead on compute
servers
WHAT’S THE BIG DEAL?
BARE METAL VIRTUALIZATION CONTAINERS
Deploy in Days or Weeks
Single App Instance
Deploy in Hours or Days
10s or 100s of Apps
Deploy in Seconds or Minutes
100s or 1000s of Apps
APP
LIBS
HOST OS
SERVER
HOST OS
SERVER
HOST OS, SHARED SVCS
SERVER, CLOUD
APP APP
LIBS LIBS
GUEST OS GUEST OS
VIRTUAL
MACHINE
VIRTUAL
MACHINE
APP APP
LIBS LIBS
CONTAINER CONTAINER
HYPERVISOR
LIGHTWEIGHT VIRTUALIZATION
Less Overhead
Faster Instantiation
Better Isolation
Easier Scale
SERVER
HYPERVISOR
HOST OSHOST OS, SHARED SVCS
SERVER, CLOUD
VIRTUAL
MACHINE
VIRTUAL
MACHINE
CONTAINER CONTAINER
APP
LIBS
APP
LIBS
GUEST OS GUEST OS
APP
LIBS
APP
LIBS
CONTAINERS VS. VIRTUALIZATION
Containers Virtualization
• Abstracts OS Kernel
• Limited to Linux
• Unified CPU and memory mgr
• Up in seconds
• 100s or 1000s
• Multiple copies of single app
• Abstracts entire device
• Any Operating System
• Separate CPU and memory mgrs
• Up in hours or days
• 10s or 100s
• Multiple apps
VS
WHAT’S AHEAD?
Dynamic Provisioning and New Workload Support
2016
E2E Dynamic Provisioning support
Applications attach (or detach) to
RHGS volumes as needed with zero
admin intervention dynamically
Usability improvements
Address customer pain point of
static/inflexible storage provisioning
Persistent Storage for OpenShift 3.4 Persistent Storage for OpenShift 3.5+
Support for containerized
database workloads via non-
shared persistent storage
Support for containerized databases
such as MySql, PostGres, and MariaDB
2017
JOIN THE CONVERSATION
redhat.com/ContainerStorage
• Demos
• Analyst Opinion
@RedHatStorage
• Storage Days
• Promotions
redhatstorage.redhat.com
• Thought Leadership
• Announcements
redhat.com/containerstorage
plus.google.com/+RedHat
linkedin.com/company/red-
hat
youtube.com/user/RedHatVide
os
facebook.com/redhatinc
twitter.com/RedHatNews

Red Hat Storage Day Boston - Persistent Storage for Containers

  • 1.
    PERSISTENT STORAGE FORCONTAINERS Ric Wheeler, Sr. Director, Red Hat Storage Engineering Vijay Bellur, Lead Architect, Red Hat Gluster Storage
  • 2.
    What Are LinuxContainers? Software packaging concept that typically includes an application and all of its runtime dependencies • HIGHER quality software releases • SHORTER test cycles • EASIER application management CONTAINER CONTAINER APP LIBS HOST OS SERVER APP LIBS BENEFITS
  • 3.
    Greater Portability, Automation,and Integration PUSH IMAGE CODE REGISTRY CODE & BUILD TEST DEPLOY PULL IMAGE
  • 4.
    How Did WeGet Here? Development Model Application Architecture Deployment & Packaging Application Infrastructure Storage Waterfall Agile Monolithic N-tier Bare Metal Virtual Servers Data Center Hosted Scale Up Scale Out DevOps MicroServices Containers Hybrid Cloud Storage as a Service
  • 5.
    WHY PERSISTENT STORAGEFOR CONTAINERS? “For which workloads or application use cases have you used/do you anticipate to use containers?” Data Apps Cloud Apps Systems of Engagement Systems of Record Web and Commerce Software Mobile Apps Social Apps 77% 71% 62% 62% 57% 52% 46% Base: 194 IT operations and development decision-makers at enterprise in APAC, EMEA, and North America Source: A commissioned study conducted by Forrester Consulting on behalf of Red Hat, January 2015 Scalable, Cost Effective, Distributed Storage for Containers
  • 6.
    CHOICE OF VOLUMEPLUGINS Red Hat’s Upstream Contributions AUTOMATED CONFIGURATION SINGLE CONTROL PANEL CHOICE OF PERSISTENT STORAGE Ceph RBD Amazon EBS Fiber Channel GCE iSCSI NFS GlusterFS
  • 7.
    DRIVING THE FUTUREOF STORAGE Nov 2015 Mar 2016 Summer 2016 CONVERGENCE OF STORAGE AND COMPUTE RHGS Container • Dedicated storage cluster for containerized • and PaaS environments • Supported for OpenShift Enterprise • Containerized Red Hat Gluster Storage serving • storage from a dedicated storage cluster • Optimized for applications running on RHEL 7, • OpenShift Enterprise, and RHEL Container Host • Containerized Red Hat Gluster Storage inside OpenShift Enterprise alongside application containers • Red Hat Gluster Storage cluster comprised of disks from multiple container cluster nodes CONTAINER READY STORAGE CONTAINERIZED STORAGE CONTAINER NATIVE STORAGE
  • 8.
    MySQL Container CONTAINER READYSTORAGE CONTAINER NODE 1 CONTAINER NODE 2 CONTAINER NODE 1 CONTAINER NODE 3 NGINX Container NGINX Container NGINX Container
  • 9.
    CONTAINERIZED RED HATGLUSTER STORAGE CONTAINER NODE 1 CONTAINER NODE 2 NGINX Container NGINX Container CONTAINERIZED RED HAT GLUSTER STORAGE
  • 10.
    OPENSHIFT NODE 2 CONTAINER-NATIVESTORAGE Lower TCO Unified Orchestration Ease of Use Greater control OPENSHIFT NODE 3 OPENSHIFT NODE 1 RHGS Container RHGS Container OPENSHIFT NODE 4 MASTER NGINX Container NGINX Container Elasticsearch Container RHGS Container
  • 11.
    CONTAINER TECHNOLOGIES DevOps Toolsand User Experience Language Runtimes and Middleware Databases and Other Services Container Orchestration and Management Container API Container Host Storage
  • 12.
    CUSTOMER SUCCESS APPLICATION SERVERS CONVERGED SERVERS STORAGE SERVERS NEW AGILITIESallowed telco to bring a new offering to market faster and cheaper LOWER COST than traditional storage and avoiding endless commitment to proprietary vendors FLEXIBLE geo-replicated architecture can grow/shrink dynamically OPTION to be tuned for price or performance BENEFITS CONTAINERIZED STORAGE Applications and storage can co-exist on the same hardware Higher server utilization and lowers operational costs Storage generates only 3%-10% overhead on compute servers
  • 13.
    WHAT’S THE BIGDEAL? BARE METAL VIRTUALIZATION CONTAINERS Deploy in Days or Weeks Single App Instance Deploy in Hours or Days 10s or 100s of Apps Deploy in Seconds or Minutes 100s or 1000s of Apps APP LIBS HOST OS SERVER HOST OS SERVER HOST OS, SHARED SVCS SERVER, CLOUD APP APP LIBS LIBS GUEST OS GUEST OS VIRTUAL MACHINE VIRTUAL MACHINE APP APP LIBS LIBS CONTAINER CONTAINER HYPERVISOR
  • 14.
    LIGHTWEIGHT VIRTUALIZATION Less Overhead FasterInstantiation Better Isolation Easier Scale SERVER HYPERVISOR HOST OSHOST OS, SHARED SVCS SERVER, CLOUD VIRTUAL MACHINE VIRTUAL MACHINE CONTAINER CONTAINER APP LIBS APP LIBS GUEST OS GUEST OS APP LIBS APP LIBS
  • 15.
    CONTAINERS VS. VIRTUALIZATION ContainersVirtualization • Abstracts OS Kernel • Limited to Linux • Unified CPU and memory mgr • Up in seconds • 100s or 1000s • Multiple copies of single app • Abstracts entire device • Any Operating System • Separate CPU and memory mgrs • Up in hours or days • 10s or 100s • Multiple apps VS
  • 16.
    WHAT’S AHEAD? Dynamic Provisioningand New Workload Support 2016 E2E Dynamic Provisioning support Applications attach (or detach) to RHGS volumes as needed with zero admin intervention dynamically Usability improvements Address customer pain point of static/inflexible storage provisioning Persistent Storage for OpenShift 3.4 Persistent Storage for OpenShift 3.5+ Support for containerized database workloads via non- shared persistent storage Support for containerized databases such as MySql, PostGres, and MariaDB 2017
  • 17.
    JOIN THE CONVERSATION redhat.com/ContainerStorage •Demos • Analyst Opinion @RedHatStorage • Storage Days • Promotions redhatstorage.redhat.com • Thought Leadership • Announcements
  • 18.