Ceph & OpenStack;
Going Plaid!
OpenStack Meetup | Boston, MA | 14 AUG 2013
2
•Patrick McGarry
•Community monkey
•Inktank / Ceph
•/. > ALU > P4
•@scuttlemonkey
•patrick@inktankcom
Accept no substitutes
C’est Moi
3
•Ceph in <30s
•Ceph & OpenStack
•Distro Wars?
•Orchestration
•What’s Next?
•Questions
The plan, Stan
Welcome!
4
On commodity hardware
Ceph can run on any
infrastructure, metal
or virtualized to
provide a cheap and
powerful storage
cluster.
Object, block, and file
Low overhead doesn’t
mean just hardware,
it means people too!
Awesomesauce
Infrastructure-aware
placement algorithm
allows you to do really
cool stuff.
Huge and beyond
Designed for exabyte,
current
implementations in
the multi-petabyte.
HPC, Big Data, Cloud,
raw storage.
…besides wicked-awesome?
What is Ceph?
Software All-in-1 CRUSH Scale
5
Find out more!
Ceph.com
…but you can find out more
Use it today
Dreamhost.com/cloud/DreamObjects
Get Support
Inktank.com
That WAS fast
6
Good together
OpenStack && Ceph
7
Come for the block
Stay for the object and file
Cinders and Glances and …bears?
Reduced Overhead
Easier to manage one cluster
“Other Stuff”
Identity with Keystone, CephFS
prototypes,
Gateway Drug
8
Squash Hotspots
Multiple hosts = parallel workload
But what does that mean?
Instant Clones
No time to boot for many images
Live migration
Shared storage allows you to
move instances between compute
nodes transparently.
Blocks are delicious
9
Speak SWIFT
Native support for SWIFT
And less filling!
Keystone
Integration with identity
Horizontal Scaling
Easy with HAProxy or others
Objects can juggle
1
0
Neat prototypes
Image distribution to hypervisors
You can dress them up, but you can’t take them anywhere
Still early
You can fix that!
Outside uses
Great way to combine resources.
Files are tricksy
1
1
OBJECTS VIRTUAL DISKS FILES & DIRECTORIES
CEPH
FILE SYSTEM
A distributed, scale-out
filesystem with POSIX
semantics that provides
storage for a legacy and
modern applications
CEPH
GATEWAY
A powerful S3- and Swift-
compatible gateway that
brings the power of the
Ceph Object Store to
modern applications
CEPH
BLOCK DEVICE
A distributed virtual block
device that delivers high-
performance, cost-effective
storage for virtual machines
and legacy applications
CEPH OBJECT STORE
A reliable, easy to manage, next-generation distributed object
store that provides storage of unstructured data for applications
#DREAMCON2013
1
2
NOM NOM NOM
Not just a theory…
1
3
No incendiary devices please…
Linux Distros
1
4
Where the metal meets the…software
Deploying this stuff
1
5
Procedural, Ruby
Written in Ruby, this
is more of the dev-
side of DevOps. Once
you get past the
learning curve it’s
powerful though.
Model-driven
Aimed more at the
sysadmin, this
procedural tool has a
very wide penetration
(even on Windows!).
Agentless, whole stack
Using the built-in
OpenSSH in your OS,
this super easy tool
goes further up the
stack than most.
Fast, 0MQ
Using ZeroMQ this tool
is designed for massive
scale and fast, fast, fast.
Unfortunately 0MQ has
no built in encryption.
The new hotness
Orchestration
Chef Puppet Ansible Salt
1
6
Canonical Unleashed
Being language
agnostic, this tool can
completely encapsulate
a service. Can also
handle provisioning all
the way down to
hardware.
Dell has skin in the game
Complete operations
platform that can dive
all the way down to
BIOS/RAID level.
Others are joining in
Custom provisioning
and orchestration,
just one example of
how busy this corner
of the market is.
Doing it w/o a tool
If you prefer not to
use a tool, Ceph gives
you an easy way to
deploy your cluster by
hand.
MOAR HOTNESS
Orchestration Cont’d
Juju Crowbar ComodIT Ceph-deploy
1
7
This Ceph thing sounds hot.
What’s Next?
1
8
All about RBD!
CLI -> Librbd
No, not that one…
Nova
Better boot support from Nova
Backups
Including incremental backups for
RBD
Havana
1
9
Live migration
Improve Nova’s checks
Delightfully frosty
Bug Fixing
New features from Havana
And you!
The community does a lot to drive
direction, we love input
(especially when it looks like
code)!
Icehouse
2
0
An ongoing process
While the first pass
for disaster recovery
is done, we want to
get to built-in, world-
wide replication.
Reception efficiency
Currently underway
in the community!
Headed to dynamic
Can already do this in
a static pool-based
setup. Looking to get
to a use-based
migration.
Making it open-er
Been talking about it
forever. The time is
coming!
Hop on board!
The Ceph Train
Geo-Replication Erasure Coding Tiering Governance
2
1
Quarterly Online Summit
Online summit puts
the core devs together
with the Ceph
community.
Not just for NYC
More planned,
including Santa Clara
and London. Keep an
eye out:
http://inktank.com/cephdays/
Geek-on-duty
During the week
there are times when
Ceph experts are
available to help. Stop
by oftc.net/ceph
Email makes the world go
Our mailing lists are
very active, check out
ceph.com for details
on how to join in!
Open Source is Open!
Get Involved!
CDS Ceph Day IRC Lists
2
2
Comments? Anything for the good of the cause?
Questions?
E-MAIL
patrick@inktank.com
WEBSITE
Ceph.com
SOCIAL
@scuttlemonkey
@ceph
Facebook.com/cephstorage

Ceph & OpenStack - Boston Meetup

  • 1.
    Ceph & OpenStack; GoingPlaid! OpenStack Meetup | Boston, MA | 14 AUG 2013
  • 2.
    2 •Patrick McGarry •Community monkey •Inktank/ Ceph •/. > ALU > P4 •@scuttlemonkey •patrick@inktankcom Accept no substitutes C’est Moi
  • 3.
    3 •Ceph in <30s •Ceph& OpenStack •Distro Wars? •Orchestration •What’s Next? •Questions The plan, Stan Welcome!
  • 4.
    4 On commodity hardware Cephcan run on any infrastructure, metal or virtualized to provide a cheap and powerful storage cluster. Object, block, and file Low overhead doesn’t mean just hardware, it means people too! Awesomesauce Infrastructure-aware placement algorithm allows you to do really cool stuff. Huge and beyond Designed for exabyte, current implementations in the multi-petabyte. HPC, Big Data, Cloud, raw storage. …besides wicked-awesome? What is Ceph? Software All-in-1 CRUSH Scale
  • 5.
    5 Find out more! Ceph.com …butyou can find out more Use it today Dreamhost.com/cloud/DreamObjects Get Support Inktank.com That WAS fast
  • 6.
  • 7.
    7 Come for theblock Stay for the object and file Cinders and Glances and …bears? Reduced Overhead Easier to manage one cluster “Other Stuff” Identity with Keystone, CephFS prototypes, Gateway Drug
  • 8.
    8 Squash Hotspots Multiple hosts= parallel workload But what does that mean? Instant Clones No time to boot for many images Live migration Shared storage allows you to move instances between compute nodes transparently. Blocks are delicious
  • 9.
    9 Speak SWIFT Native supportfor SWIFT And less filling! Keystone Integration with identity Horizontal Scaling Easy with HAProxy or others Objects can juggle
  • 10.
    1 0 Neat prototypes Image distributionto hypervisors You can dress them up, but you can’t take them anywhere Still early You can fix that! Outside uses Great way to combine resources. Files are tricksy
  • 11.
    1 1 OBJECTS VIRTUAL DISKSFILES & DIRECTORIES CEPH FILE SYSTEM A distributed, scale-out filesystem with POSIX semantics that provides storage for a legacy and modern applications CEPH GATEWAY A powerful S3- and Swift- compatible gateway that brings the power of the Ceph Object Store to modern applications CEPH BLOCK DEVICE A distributed virtual block device that delivers high- performance, cost-effective storage for virtual machines and legacy applications CEPH OBJECT STORE A reliable, easy to manage, next-generation distributed object store that provides storage of unstructured data for applications
  • 12.
  • 13.
    1 3 No incendiary devicesplease… Linux Distros
  • 14.
    1 4 Where the metalmeets the…software Deploying this stuff
  • 15.
    1 5 Procedural, Ruby Written inRuby, this is more of the dev- side of DevOps. Once you get past the learning curve it’s powerful though. Model-driven Aimed more at the sysadmin, this procedural tool has a very wide penetration (even on Windows!). Agentless, whole stack Using the built-in OpenSSH in your OS, this super easy tool goes further up the stack than most. Fast, 0MQ Using ZeroMQ this tool is designed for massive scale and fast, fast, fast. Unfortunately 0MQ has no built in encryption. The new hotness Orchestration Chef Puppet Ansible Salt
  • 16.
    1 6 Canonical Unleashed Being language agnostic,this tool can completely encapsulate a service. Can also handle provisioning all the way down to hardware. Dell has skin in the game Complete operations platform that can dive all the way down to BIOS/RAID level. Others are joining in Custom provisioning and orchestration, just one example of how busy this corner of the market is. Doing it w/o a tool If you prefer not to use a tool, Ceph gives you an easy way to deploy your cluster by hand. MOAR HOTNESS Orchestration Cont’d Juju Crowbar ComodIT Ceph-deploy
  • 17.
    1 7 This Ceph thingsounds hot. What’s Next?
  • 18.
    1 8 All about RBD! CLI-> Librbd No, not that one… Nova Better boot support from Nova Backups Including incremental backups for RBD Havana
  • 19.
    1 9 Live migration Improve Nova’schecks Delightfully frosty Bug Fixing New features from Havana And you! The community does a lot to drive direction, we love input (especially when it looks like code)! Icehouse
  • 20.
    2 0 An ongoing process Whilethe first pass for disaster recovery is done, we want to get to built-in, world- wide replication. Reception efficiency Currently underway in the community! Headed to dynamic Can already do this in a static pool-based setup. Looking to get to a use-based migration. Making it open-er Been talking about it forever. The time is coming! Hop on board! The Ceph Train Geo-Replication Erasure Coding Tiering Governance
  • 21.
    2 1 Quarterly Online Summit Onlinesummit puts the core devs together with the Ceph community. Not just for NYC More planned, including Santa Clara and London. Keep an eye out: http://inktank.com/cephdays/ Geek-on-duty During the week there are times when Ceph experts are available to help. Stop by oftc.net/ceph Email makes the world go Our mailing lists are very active, check out ceph.com for details on how to join in! Open Source is Open! Get Involved! CDS Ceph Day IRC Lists
  • 22.
    2 2 Comments? Anything forthe good of the cause? Questions? E-MAIL patrick@inktank.com WEBSITE Ceph.com SOCIAL @scuttlemonkey @ceph Facebook.com/cephstorage