Ceph Day Santa Clara: Ceph and Apache CloudStack

359 views

Published on

David Nally, Apache CloudStack Contributor

Much of the cloud storage hype of late has been focused on object storage. Ceph fulfills this role well, as a number of the production public object stores prove. But Ceph provides more than object storage, the more difficult role of distributed, commodity block storage; and that has really become the next cloud storage frontier. Apache CloudStack has been able to consume RBD as storage for running virtual machines for almost a year, but things continue to improve, and we’ll discuss what the future holds as well.

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
359
On SlideShare
0
From Embeds
0
Number of Embeds
5
Actions
Shares
0
Downloads
23
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • I was actually using S3 prior to its launch - I was one of the beta users.
  • I was actually using S3 prior to its launch - I was one of the beta users.
  • I was actually using S3 prior to its launch - I was one of the beta users.
  • I was actually using S3 prior to its launch - I was one of the beta users.
  • I was actually using S3 prior to its launch - I was one of the beta users.
  • I was actually using S3 prior to its launch - I was one of the beta users.
  • Yay AWS 2006
  • format 1 - Use the original format for a new rbd image. This format is understood by all versions of librbd and the kernel rbd module, but does not support newer features like cloning. format 2 - Use the second rbd format, which is supported by librbd (but not the kernel rbd module) at this time. This adds support for cloning and is more easily extensible to allow more features in the future. See http://ceph.com/docs/next/man/8/rbd/
  • I was actually using S3 prior to its launch - I was one of the beta users.
  • I was actually using S3 prior to its launch - I was one of the beta users.
  • Ceph Day Santa Clara: Ceph and Apache CloudStack

    1. 1. Ceph and Apache CloudStack David Nalley ke4qqq@apache.org @ke4qqq
    2. 2. #whoami Distributed storage junkie Recovering sysadmin Member, Apache Software Foundation PMC Member, Apache CloudStack Employed by Citrix in the Open Source Business Office
    3. 3. Setting the stage Apache CloudStack is... ● an open source IaaS platform ● proven in production at massive scale ● awesome
    4. 4. Gorgeous UI
    5. 5. API ● Native: http://cloudstack.apache.org/docs/api ● EC2
    6. 6. A brief history of cloud-y storage ● Most would say it started early 2006 with S3 launch ● This really set the stage and everyone's assumptions. ● Cloud-y storage == S3 == Object Storage ● Incredibly useful - typically able to scale well past traditional filesystem levels ● Super simple - to consume.
    7. 7. A brief history of cloud-y storage ● Since then, we've had a number of open source and proprietary object storage alternatives emerge: – OpenStack Swift – Riak CS – Ceph (has an object storage option) – Caringo
    8. 8. But we have largely ignored.... ● EC2 - used ephemeral storage initially ● Introduced EBS – Apparently zone-wide block storage
    9. 9. So object storage is nice but... ● Doesn't fill the void for EBS-like storage ● Neither does traditional storage ● Traditional NAS/SAN aren't economically scalable
    10. 10. Rados Block Device ● Ceph provides RBD ● Exposes a block storage device - like a SAN ● Easily scales for both performance and capacity
    11. 11. Rados Block Device - Features ● Thin-provisioning ● Snapshotting ● Caching
    12. 12. Let's talk about today ● CloudStack primarily is a consumer of storage ● Historically we've made storage the fault line – Concerns were IOPS, SPOF, Cost – Typically no more than 16 hypervisors per a single storage resource – So you needed lots of storage resources.....or just use local disk ● Distributed storage gives better scalability. – Mimics EBS requires data-center wide capabilities – Reduces costs, and constraints.
    13. 13. What else is coming.. ● Support for format 2 RBD ● Snapshots ● Datacenter wide storage resources. ● Removal of need for legacy storage
    14. 14. What else is coming.. XenServer support http://xenserver.org/blog/entry/tech-preview-of-xenserver-libvirt-ceph.html
    15. 15. Resources ● http://ceph.com/docs/master/rbd/rbd-cloudstack/ ● http://blog.widodh.nl/
    16. 16. Questions ● Slides at: http://www.slideshare.net/ke4qqq/ceph-and-apache-cloudstack
    17. 17. Contact ● Project – http://cloudstack.apache.org – #cloudstack on irc.freenode.net ● Me – ke4qqq on irc.freenode.net – ke4qqq@apache.org – @ke4qqq on Twitter

    ×