0
Use Cases and Reference Architectures
Laying Cinder Blocks (Volumes)
#rackstackatl
Introductions
Aaron Delp
James Ruddy
Office of the CTO
EMC
John Griffith
John Griffith
OpenStack PTL for Cin...
#rackstackatl
Agenda • Introductions
• Cinder: OpenStack Block Storage
• Cinder with Commodity Storage
• Cinder with Enter...
#rackstackatl
OpenStack & Storage
Cinder / Block Storage Swift / Object Storage
Objectives
• Storage for running VM disk v...
#rackstackatl
OpenStack
Cinder
(Block Storage)
• Architected to provide traditional block-level
storage resources to other...
#rackstackatl
Cinder Based Features
• create/delete volumes
• specify custom "types/extra-specs"
• clone
• copy image to v...
#rackstackatl
Graphic Source: http://crystaltec.com.au/services/virtualization
Commodity Cinder Storage Components
• Contr...
#rackstackatl
Cinder Volume - Manages block storage devices, specifically
the back-end devices themselves
• Recommended Co...
#rackstackatl
Commodity Cinder Storage Architecture
Controller 1
Nova
Horizon
Keystone
Glance
RabbitMQ
MySQL
Cinder-API
Ci...
#rackstackatl
Graphic Source: http://crystaltec.com.au/services/virtualization
Commodity Storage Advantages
• Low initial ...
#rackstackatl
Graphic Source: http://crystaltec.com.au/services/virtualization
Commodity Storage Limitations
• Commodity s...
#rackstackatl
Graphic Source: http://crystaltec.com.au/services/virtualization
Multiple Cinder Nodes Architecture
Controll...
#rackstackatl
Graphic Source: http://crystaltec.com.au/services/virtualization
Multiple Cinder Nodes Capacity
Typical Rack...
#rackstackatl
Provides ability to choose
• Plugin architecture, multiple choices for backend
storage
• Don’t have to choos...
#rackstackatl
Graphic Source: http://crystaltec.com.au/services/virtualization
Cinder With Enterprise Storage Architecture...
#rackstackatl
Good
#rackstackatl
Even Better
#rackstackatl
Enterprise Storage Advantages
• Simplified capacity scaling
• High Availability (HA) for increased uptime
• ...
#rackstackatl
Proprietary/Vendors they’re not evil
• Having Vendor support in the community is good
• Choices are good
• M...
#rackstackatl
So how do I choose
#rackstackatl
There’s a lot to choose from
• Over two dozen backend drivers in Cinder (and
growing with each release)
• St...
#rackstackatl
Cinder Backend Devices, use what fits
#rackstackatl
Considerations Based on Experience
• High-level of integration and support with OpenStack
• Flexible scalabi...
#rackstackatl
You’re not locked in
• The intent of the Cinder design is to keep you
from being locked in
• You can easily ...
#rackstackatl
SolidFire & OpenStack
"SolidFire has done a great job leading the Block Storage project in line with the Ope...
#rackstackatl
SolidFire &
Cinder
• Full SolidFire driver integration with latest
OpenStack software release
• Set and main...
#rackstackatl
SolidFire & Cinder
• Demo of Integration
#rackstackatl
EMC
The role of the storage architect in Openstack
• Old School – Storage admin is the Master of his
Domain
#rackstackatl
EMC
The role of the storage architect in Openstack
• New School– Its all about the pool
#rackstackatl
Specifics on implementation
VMAX
VNX
Isilon
ScaleIO
Beta!
XtremIO
Release Protocol Vol fxns Snap fxn Vol Cop...
#rackstackatl
EMC & Cinder
• Demo of the new consumption model
#rackstackatl
Resources
• http://www.rackspace.com/cloud/private/
• www.solidfire.com/solutions/cloud-orchestration/openst...
#rackstackatl
RACKSPACE® HOSTING | 5000 WALZEM ROAD | SAN ANTONIO, TX 78218
US SALES: 1-800-961-2888 | US SUPPORT: 1-800-9...
Upcoming SlideShare
Loading in...5
×

Laying Cinder Blocks (Volumes) Use Cases and Reference Architectures

1,910

Published on

Cinder is an OpenStack project that is often overlooked but can be critical in an OpenStack deployment. In this presentation, serveral OpenStack practitioners will walk through not merely the basics of Cinder, but show how Cinder is being deployed today and review what are the recommended practices and relevant design considerations. This talk will cover both commodity hardware and third-party enterprise storage solutions that integrate with Cinder.

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,910
On Slideshare
0
From Embeds
0
Number of Embeds
9
Actions
Shares
0
Downloads
69
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Laying Cinder Blocks (Volumes) Use Cases and Reference Architectures"

  1. 1. Use Cases and Reference Architectures Laying Cinder Blocks (Volumes)
  2. 2. #rackstackatl Introductions Aaron Delp James Ruddy Office of the CTO EMC John Griffith John Griffith OpenStack PTL for Cinder Solutions Architect SolidFire Kenneth H Kenneth Hui OpenStack Ambassador Technology Evangelist Rackspace
  3. 3. #rackstackatl Agenda • Introductions • Cinder: OpenStack Block Storage • Cinder with Commodity Storage • Cinder with Enterprise Storage • SolidFire Integration • EMC Integration
  4. 4. #rackstackatl OpenStack & Storage Cinder / Block Storage Swift / Object Storage Objectives • Storage for running VM disk volumes on a host • Ideal for performance sensitive apps • Enables Amazon EBS-like service • Ideal for cost effective, scale-out storage • Fully distributed, API-accessible • Well suited for backup, archiving, data retention • Enables Dropbox-like service Use Cases • Production Applications • Traditional IT Systems • Database Driven Apps • Messaging / Collaboration • Dev / Test Systems • VM Templates • ISO Images • Disk Volume Snapshots • Backup / Archive • Image / Video Repository Workloads • High Change Content • Smaller, Random R/W • Higher / “Bursty” IO • Typically More Static Content • Larger, Sequential R/W • Lower IOPS
  5. 5. #rackstackatl OpenStack Cinder (Block Storage) • Architected to provide traditional block-level storage resources to other OpenStack services • Presents persistent block-level storage volumes for use with OpenStack Nova compute instances • Manages the creation, attaching and detaching of these volumes between a storage system and different host servers
  6. 6. #rackstackatl Cinder Based Features • create/delete volumes • specify custom "types/extra-specs" • clone • copy image to volume and volume to image • point in time copy (snapshots of volumes) • create volume from snapshot • backup volume (to Object Store, SWIFT and CEPH) • transfer volume ownership • customized scheduling filters • per tenant usage quotas
  7. 7. #rackstackatl Graphic Source: http://crystaltec.com.au/services/virtualization Commodity Cinder Storage Components • Controller Nodes • Cinder API – Accepts, authenticates, and routes requests throughout the block storage service • Cinder Scheduler - Schedules and routes requests to the appropriate volume service • Storage Networking • iSCSI Networks required • Redundant 10gb network connections recommended
  8. 8. #rackstackatl Cinder Volume - Manages block storage devices, specifically the back-end devices themselves • Recommended Configuration • 1 compute core for every 3 TBs under management • Minimum of 2GB RAM plus an additional 250 MB RAM for every 1TB under management • Minimum of 6 physical drives • Hardware RAID5 or RAID10 protection Cinder Node and Storage Configurations
  9. 9. #rackstackatl Commodity Cinder Storage Architecture Controller 1 Nova Horizon Keystone Glance RabbitMQ MySQL Cinder-API Cinder-Scheduler Controller 2 Nova Horizon Keystone Glance RabbitMQ MySQL Cinder-API Cinder-Scheduler
  10. 10. #rackstackatl Graphic Source: http://crystaltec.com.au/services/virtualization Commodity Storage Advantages • Low initial cost during exploratory phase of deployment • Typically very little change in procurement with known vendors • Basic storage infrastructure knowledge
  11. 11. #rackstackatl Graphic Source: http://crystaltec.com.au/services/virtualization Commodity Storage Limitations • Commodity storage does not support cinder node redundancy • Commodity storage has limited or no capacity scaling • By definition, commodity storage is basic block-storage that is missing value-added services like: • Advanced Quality of Service (QoS) • Auto-tiering • De-duplication/Compression • Replication
  12. 12. #rackstackatl Graphic Source: http://crystaltec.com.au/services/virtualization Multiple Cinder Nodes Architecture Controller 1 Nova Horizon Keystone Glance RabbitMQ MySQL Cinder-API Cinder-Scheduler Controller 2 Nova Horizon Keystone Glance RabbitMQ MySQL Cinder-API Cinder-Scheduler
  13. 13. #rackstackatl Graphic Source: http://crystaltec.com.au/services/virtualization Multiple Cinder Nodes Capacity Typical Rackspace Private Cloud (RPC) configuration of (8) 600 GB 15K SAS drives in RAID10 configuration (4.8 TB raw/2.3 TB usable) MySQL database with 8TB requirement
  14. 14. #rackstackatl Provides ability to choose • Plugin architecture, multiple choices for backend storage • Don’t have to choose just one • Use the storage that fits your needs • Mix of proprietary and open-source choices
  15. 15. #rackstackatl Graphic Source: http://crystaltec.com.au/services/virtualization Cinder With Enterprise Storage Architecture Enterprise Array Controller 1 Nova Horizon Keystone Glance RabbitMQ MySQL Cinder-API Cinder-Scheduler Cinder-Volume Controller 2 Nova Horizon Keystone Glance RabbitMQ MySQL Cinder-API Cinder-Scheduler Cinder-Volume
  16. 16. #rackstackatl Good
  17. 17. #rackstackatl Even Better
  18. 18. #rackstackatl Enterprise Storage Advantages • Simplified capacity scaling • High Availability (HA) for increased uptime • Storage is tested and supported in OpenStack environments • Delivers enhanced features only provided by enterprise storage vendors • Repurposing of current storage investments
  19. 19. #rackstackatl Proprietary/Vendors they’re not evil • Having Vendor support in the community is good • Choices are good • More participation is good • Everybody wins • Sometimes combining Open Source and proprietary results in best of both worlds
  20. 20. #rackstackatl So how do I choose
  21. 21. #rackstackatl There’s a lot to choose from • Over two dozen backend drivers in Cinder (and growing with each release) • Strive for consistency (they should all work) • Features and characteristics are what sets them apart
  22. 22. #rackstackatl Cinder Backend Devices, use what fits
  23. 23. #rackstackatl Considerations Based on Experience • High-level of integration and support with OpenStack • Flexible scalability for ever-changing environments • Automation integration via APIs • Resiliency for increased reliability and uptime • Predictable performance (not just fast) • What will I be using it for • What *might* I be using it for
  24. 24. #rackstackatl You’re not locked in • The intent of the Cinder design is to keep you from being locked in • You can easily change the backend • Migrate the data • Expect the same base level of functionality
  25. 25. #rackstackatl SolidFire & OpenStack "SolidFire has done a great job leading the Block Storage project in line with the OpenStack philosophy of delivering a pluggable architecture with integration points for multiple vendors and technologies. It's exciting to see more production implementations and configuration options available to OpenStack users.” Jonathan Bryce, Executive Director, OpenStack Foundation • The industry’s most comprehensive Cinder support • Unparalleled combination of guaranteed performance, high-availability and scale • Established interoperability & partnerships with industry leaders
  26. 26. #rackstackatl SolidFire & Cinder • Full SolidFire driver integration with latest OpenStack software release • Set and maintain true QoS levels on a per- volume basis • Create, snapshot, clone and manage SolidFire volumes using OpenStack clients and APIs • Bootable SolidFire Volumes • Web-based API exposing all cluster functionality • SolidFire integration with Cinder can be configured in less than a minute
  27. 27. #rackstackatl SolidFire & Cinder • Demo of Integration
  28. 28. #rackstackatl EMC The role of the storage architect in Openstack • Old School – Storage admin is the Master of his Domain
  29. 29. #rackstackatl EMC The role of the storage architect in Openstack • New School– Its all about the pool
  30. 30. #rackstackatl Specifics on implementation VMAX VNX Isilon ScaleIO Beta! XtremIO Release Protocol Vol fxns Snap fxn Vol Copy Backup Grizzly, Havana, IceHouse iSCSI, FC Out of Band Grizzly, Havana, IceHouse iSCSI, FC Out of Band Havana iSCSI Out of Band Havana SDC, SDS Out of Band Havana, IceHouseNFS (Cinder) Out of Band Havana, IceHouseiSCSI, FC Out of band Beta! Beta! All required functions, except ‘Create Vol from snapshot’, ‘Extend vol’ All required functions All required functions All required functions All required functions All required functions++
  31. 31. #rackstackatl EMC & Cinder • Demo of the new consumption model
  32. 32. #rackstackatl Resources • http://www.rackspace.com/cloud/private/ • www.solidfire.com/solutions/cloud-orchestration/openstack/ • http://theruddyduck.typepad.com/theruddyduck/2013/11/deploy-opensatck-cinder- with-emc-vipr-part-1.html • Podcasts: The Cloudcast.net https://itunes.apple.com/us/podcast/cloudcast-.net- weekly-cloud/id417826820?mt=2
  33. 33. #rackstackatl RACKSPACE® HOSTING | 5000 WALZEM ROAD | SAN ANTONIO, TX 78218 US SALES: 1-800-961-2888 | US SUPPORT: 1-800-961-4454 | WWW.RACKSPACE.COM RACKSPACE® HOSTING | © RACKSPACE US, INC. | RACKSPACE® AND FANATICAL SUPPORT® ARE SERVICE MARKS OF RACKSPACE US, INC. REGISTERED IN TH E UNITED STATES AND OTHER COUNTRIES. | WWW.RACKSPACE.COMRACKSPACE® HOSTING | © RACKSPACE US, INC. | RACKSPACE® AND FANATICAL SUPPORT® ARE SERVICE MARKS OF RACKSPACE US, INC. REGISTERED IN TH E UNITED STATES AND OTHER COUNTRIES. | WWW.RACKSPACE.COM
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×