Ceph & OpenStack - Boston Meetup


Published on

Presentation materials for the Boston OpenStack meetup on 14AUG2013

Published in: Technology
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Ceph & OpenStack - Boston Meetup

  1. 1. Ceph & OpenStack; Going Plaid! OpenStack Meetup | Boston, MA | 14 AUG 2013
  2. 2. 2 •Patrick McGarry •Community monkey •Inktank / Ceph •/. > ALU > P4 •@scuttlemonkey •patrick@inktankcom Accept no substitutes C’est Moi
  3. 3. 3 •Ceph in <30s •Ceph & OpenStack •Distro Wars? •Orchestration •What’s Next? •Questions The plan, Stan Welcome!
  4. 4. 4 On commodity hardware Ceph can run on any infrastructure, metal or virtualized to provide a cheap and powerful storage cluster. Object, block, and file Low overhead doesn’t mean just hardware, it means people too! Awesomesauce Infrastructure-aware placement algorithm allows you to do really cool stuff. Huge and beyond Designed for exabyte, current implementations in the multi-petabyte. HPC, Big Data, Cloud, raw storage. …besides wicked-awesome? What is Ceph? Software All-in-1 CRUSH Scale
  5. 5. 5 Find out more! Ceph.com …but you can find out more Use it today Dreamhost.com/cloud/DreamObjects Get Support Inktank.com That WAS fast
  6. 6. 6 Good together OpenStack && Ceph
  7. 7. 7 Come for the block Stay for the object and file Cinders and Glances and …bears? Reduced Overhead Easier to manage one cluster “Other Stuff” Identity with Keystone, CephFS prototypes, Gateway Drug
  8. 8. 8 Squash Hotspots Multiple hosts = parallel workload But what does that mean? Instant Clones No time to boot for many images Live migration Shared storage allows you to move instances between compute nodes transparently. Blocks are delicious
  9. 9. 9 Speak SWIFT Native support for SWIFT And less filling! Keystone Integration with identity Horizontal Scaling Easy with HAProxy or others Objects can juggle
  10. 10. 1 0 Neat prototypes Image distribution to hypervisors You can dress them up, but you can’t take them anywhere Still early You can fix that! Outside uses Great way to combine resources. Files are tricksy
  11. 11. 1 1 OBJECTS VIRTUAL DISKS FILES & DIRECTORIES CEPH FILE SYSTEM A distributed, scale-out filesystem with POSIX semantics that provides storage for a legacy and modern applications CEPH GATEWAY A powerful S3- and Swift- compatible gateway that brings the power of the Ceph Object Store to modern applications CEPH BLOCK DEVICE A distributed virtual block device that delivers high- performance, cost-effective storage for virtual machines and legacy applications CEPH OBJECT STORE A reliable, easy to manage, next-generation distributed object store that provides storage of unstructured data for applications
  12. 12. #DREAMCON2013 1 2 NOM NOM NOM Not just a theory…
  13. 13. 1 3 No incendiary devices please… Linux Distros
  14. 14. 1 4 Where the metal meets the…software Deploying this stuff
  15. 15. 1 5 Procedural, Ruby Written in Ruby, this is more of the dev- side of DevOps. Once you get past the learning curve it’s powerful though. Model-driven Aimed more at the sysadmin, this procedural tool has a very wide penetration (even on Windows!). Agentless, whole stack Using the built-in OpenSSH in your OS, this super easy tool goes further up the stack than most. Fast, 0MQ Using ZeroMQ this tool is designed for massive scale and fast, fast, fast. Unfortunately 0MQ has no built in encryption. The new hotness Orchestration Chef Puppet Ansible Salt
  16. 16. 1 6 Canonical Unleashed Being language agnostic, this tool can completely encapsulate a service. Can also handle provisioning all the way down to hardware. Dell has skin in the game Complete operations platform that can dive all the way down to BIOS/RAID level. Others are joining in Custom provisioning and orchestration, just one example of how busy this corner of the market is. Doing it w/o a tool If you prefer not to use a tool, Ceph gives you an easy way to deploy your cluster by hand. MOAR HOTNESS Orchestration Cont’d Juju Crowbar ComodIT Ceph-deploy
  17. 17. 1 7 This Ceph thing sounds hot. What’s Next?
  18. 18. 1 8 All about RBD! CLI -> Librbd No, not that one… Nova Better boot support from Nova Backups Including incremental backups for RBD Havana
  19. 19. 1 9 Live migration Improve Nova’s checks Delightfully frosty Bug Fixing New features from Havana And you! The community does a lot to drive direction, we love input (especially when it looks like code)! Icehouse
  20. 20. 2 0 An ongoing process While the first pass for disaster recovery is done, we want to get to built-in, world- wide replication. Reception efficiency Currently underway in the community! Headed to dynamic Can already do this in a static pool-based setup. Looking to get to a use-based migration. Making it open-er Been talking about it forever. The time is coming! Hop on board! The Ceph Train Geo-Replication Erasure Coding Tiering Governance
  21. 21. 2 1 Quarterly Online Summit Online summit puts the core devs together with the Ceph community. Not just for NYC More planned, including Santa Clara and London. Keep an eye out: http://inktank.com/cephdays/ Geek-on-duty During the week there are times when Ceph experts are available to help. Stop by oftc.net/ceph Email makes the world go Our mailing lists are very active, check out ceph.com for details on how to join in! Open Source is Open! Get Involved! CDS Ceph Day IRC Lists
  22. 22. 2 2 Comments? Anything for the good of the cause? Questions? E-MAIL patrick@inktank.com WEBSITE Ceph.com SOCIAL @scuttlemonkey @ceph Facebook.com/cephstorage