Your SlideShare is downloading. ×

DreamObjects - Ceph Day Nov 2012

723

Published on

Slides regarding DreamObjects, a competitive cloud storage service to S3 based entirely on Ceph's object store. Presented by Ross Turk.

Slides regarding DreamObjects, a competitive cloud storage service to S3 based entirely on Ceph's object store. Presented by Ross Turk.

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
723
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
39
Comments
0
Likes
1
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. DreamObjects Cloud Object Storage Powered by CephMonday, November 5, 12
  • 2. This slide is all about me, me, me. Ross Turk Community Manager, Ceph VP Community, Inktank ross@inktank.com | @rossturk inktank.com | ceph.com 2Monday, November 5, 12
  • 3. DreamHost Imagine the Web,Your Way 15 years creating and deploying services Over 340,000 entrepreneur and developer customers Open source obsessed • Hosting over 500,000 WordPress sites • Contributing Ceph, Ceilometer, Akanda • OpenStack innovator & contributorMonday, November 5, 12
  • 4. Selection Criteria Must be able to deploy at large scale • Cope with large objects, or large numbers of small objects • Transparently handle continuous component failures Must be managed in a cost-effective way • Run on commodity hardware and free open source software • Automatically handle failures, new hardware, decommissioning Must be brought to market quickly • Mature enough to be quickly productized Must enable hybrid deployments • Customers should be able to use in hybrid private/public setup • Customers should have the freedom to build it themselves 4Monday, November 5, 12
  • 5. What Is DreamObjects? It’s where data hangs its hat in the cloud. Web App Storage Backups Digital Media Freedom: No vendor lock-in • Powered by Ceph, an open source, portable storage platform Flexibility: It’s compatible • Access DreamObjects with either Amazon S3 API or Swift API Priced RIght: Unique Pricing Model • $0.07/GB, inbound data transfer is free, unlimited API requestsMonday, November 5, 12
  • 6. APP APP HOST/VM CLIENT RADOSGW RBD CEPH FS LIBRADOS A bucket-based REST A reliable and fully- A POSIX-compliant A library allowing gateway, compatible with distributed block device, distributed file system, apps to directly S3 and Swift with a Linux kernel client with a Linux kernel client access RADOS, and a QEMU/KVM driver and support for FUSE with support for C, C++, Java, Python, Ruby, and PHP RADOS A reliable, autonomous, distributed object store comprised of self-healing, self-managing, intelligent storage nodesMonday, November 5, 12
  • 7. APP APP HOST/VM CLIENT RADOSGW RBD CEPH FS LIBRADOS A bucket-based REST A reliable and fully- A POSIX-compliant A library allowing gateway, compatible with distributed block device, distributed file system, apps to directly S3 and Swift with a Linux kernel client with a Linux kernel client access RADOS, and a QEMU/KVM driver and support for FUSE with support for C, C++, Java, Python, Ruby, and PHP RADOS A reliable, autonomous, distributed object store comprised of self-healing, self-managing, intelligent storage nodesMonday, November 5, 12
  • 8. x12 M x12 LOAD BALANCER M x12 LOAD M BALANCER x12 36TB PER MACHINE x12 radosgw M ceph-mon ceph-osdMonday, November 5, 12
  • 9. DreamObjects Hardware Specs STORAGE NODE LOAD BALANCER x2 Dell PowerEdge R515 6 core AMD CPU, 32GB RAM MANAGEMENT NODE x4 2x 300GB SAS drives (OS) 12x 3TB SATA drives 2x 10GbE, 1x 1GbE, IPMI STORAGE NODE STORAGE NODE MANAGEMENT NODE STORAGE NODE Dell PowerEdge R415 STORAGE NODE x90 2x 1TB SATA STORAGE NODE STORAGE NODE 1x 10GbE MANAGEMENT NODE M x3Monday, November 5, 12
  • 10. 3TB per OSD x 12 = x 12 OSDs per node = 36TB per node 3TB 36TB 36TB per node x 90 = x 90 nodes = ~3PB total capacity 36TB ~3PB ~3PB total capacity /3= / 3 replicas per object = ~1PB usable capacity ~3PB ~1PBMonday, November 5, 12
  • 11. Deployment DreamHost deploys Ceph with Opscode Chef • Reduce operations overhead • Maintain efficiency to keep costs down • Provide consistency • Always deploy / manage resources the same way Ceph has cookbooks: https://github.com/ceph/ceph-cookbooks 11Monday, November 5, 12
  • 12. 12Monday, November 5, 12
  • 13. 13Monday, November 5, 12
  • 14. 14Monday, November 5, 12
  • 15. Case Study Available (Soon!) http://inktank.com/dhcs 15Monday, November 5, 12
  • 16. Questions? Ross Turk Community Manager, Ceph VP Community, Inktank ross@inktank.com | @rossturk inktank.com | ceph.com Read about DreamObjects: http://inktank.com/dhcs 16Monday, November 5, 12

×