SlideShare a Scribd company logo
1 of 16
Download to read offline
DreamObjects
                         Cloud Object Storage
                            Powered by Ceph




Monday, November 5, 12
This slide is all about me, me, me.

                  Ross Turk
                  Community Manager, Ceph
                  VP Community, Inktank

                  ross@inktank.com | @rossturk

                  inktank.com | ceph.com




                                                   2
Monday, November 5, 12
DreamHost
                                        Imagine the Web,Your Way

             15 years creating and deploying services

             Over 340,000 entrepreneur and developer customers

             Open source obsessed
               • Hosting over 500,000 WordPress sites
               • Contributing Ceph, Ceilometer, Akanda
               • OpenStack innovator & contributor




Monday, November 5, 12
Selection Criteria

             Must be able to deploy at large scale
               • Cope with large objects, or large numbers of small objects
               • Transparently handle continuous component failures


             Must be managed in a cost-effective way
               • Run on commodity hardware and free open source software
               • Automatically handle failures, new hardware, decommissioning


             Must be brought to market quickly
               • Mature enough to be quickly productized


             Must enable hybrid deployments
               • Customers should be able to use in hybrid private/public setup
               • Customers should have the freedom to build it themselves

                                                                                  4
Monday, November 5, 12
What Is DreamObjects?
             It’s where data hangs its hat in the cloud.


                         Web App Storage        Backups                Digital Media


             Freedom: No vendor lock-in
               • Powered by Ceph, an open source, portable storage platform

             Flexibility: It’s compatible
               • Access DreamObjects with either Amazon S3 API or Swift API


             Priced RIght: Unique Pricing Model
               • $0.07/GB, inbound data transfer is free, unlimited API requests




Monday, November 5, 12
APP                   APP                     HOST/VM                       CLIENT



                                RADOSGW                     RBD                         CEPH FS
          LIBRADOS
                                A bucket-based REST      A reliable and fully-          A POSIX-compliant
          A library allowing    gateway, compatible with distributed block device,      distributed file system,
          apps to directly      S3 and Swift             with a Linux kernel client     with a Linux kernel client
          access RADOS,                                  and a QEMU/KVM driver          and support for FUSE
          with support for
          C, C++, Java,
          Python, Ruby,
          and PHP




       RADOS

       A reliable, autonomous, distributed object store comprised of self-healing, self-managing, intelligent storage
       nodes




Monday, November 5, 12
APP                   APP                     HOST/VM                       CLIENT



                                RADOSGW                     RBD                         CEPH FS
          LIBRADOS
                                A bucket-based REST      A reliable and fully-          A POSIX-compliant
          A library allowing    gateway, compatible with distributed block device,      distributed file system,
          apps to directly      S3 and Swift             with a Linux kernel client     with a Linux kernel client
          access RADOS,                                  and a QEMU/KVM driver          and support for FUSE
          with support for
          C, C++, Java,
          Python, Ruby,
          and PHP




       RADOS

       A reliable, autonomous, distributed object store comprised of self-healing, self-managing, intelligent storage
       nodes




Monday, November 5, 12
x12

                                                    M

                                                              x12
                           LOAD
                         BALANCER
                                                    M

                                                              x12

                           LOAD                     M
                         BALANCER
                                                              x12

                                                   36TB PER
                                                   MACHINE
                                                              x12


          radosgw        M   ceph-mon   ceph-osd

Monday, November 5, 12
DreamObjects Hardware Specs

                  STORAGE NODE           LOAD BALANCER        x2
             Dell PowerEdge R515
             6 core AMD CPU, 32GB RAM   MANAGEMENT NODE       x4
             2x 300GB SAS drives (OS)
             12x 3TB SATA drives
             2x 10GbE, 1x 1GbE, IPMI     STORAGE NODE
                                         STORAGE NODE
               MANAGEMENT NODE           STORAGE NODE

             Dell PowerEdge R415         STORAGE NODE         x90
             2x 1TB SATA                 STORAGE NODE
                                         STORAGE NODE
             1x 10GbE
                                        MANAGEMENT NODE   M   x3



Monday, November 5, 12
3TB per OSD
                                x 12 =          x 12 OSDs per node
                                                = 36TB per node
                         3TB             36TB



                                                  36TB per node
                                x 90 =          x 90 nodes
                                                = ~3PB total capacity

                         36TB            ~3PB


                                                  ~3PB total capacity
                                /3=             / 3 replicas per object
                                                = ~1PB usable capacity

                         ~3PB            ~1PB



Monday, November 5, 12
Deployment

             DreamHost deploys Ceph with Opscode Chef
               • Reduce operations overhead
               • Maintain efficiency to keep costs down
               • Provide consistency
                  • Always deploy / manage resources the same way


             Ceph has cookbooks:

                             https://github.com/ceph/ceph-cookbooks




                                                                      11
Monday, November 5, 12
12
Monday, November 5, 12
13
Monday, November 5, 12
14
Monday, November 5, 12
Case Study Available (Soon!)




                         http://inktank.com/dhcs

                                                   15
Monday, November 5, 12
Questions?

                  Ross Turk
                  Community Manager, Ceph
                  VP Community, Inktank

                  ross@inktank.com | @rossturk

                  inktank.com | ceph.com

                  Read about DreamObjects:
                  http://inktank.com/dhcs



                                                 16
Monday, November 5, 12

More Related Content

What's hot

OSDC 2015: John Spray | The Ceph Storage System
OSDC 2015: John Spray | The Ceph Storage SystemOSDC 2015: John Spray | The Ceph Storage System
OSDC 2015: John Spray | The Ceph Storage SystemNETWAYS
 
Ceph Day Beijing: Containers and Ceph
Ceph Day Beijing: Containers and Ceph Ceph Day Beijing: Containers and Ceph
Ceph Day Beijing: Containers and Ceph Ceph Community
 
What you need to know about ceph
What you need to know about cephWhat you need to know about ceph
What you need to know about cephEmma Haruka Iwao
 
Ceph Day NYC: The Future of CephFS
Ceph Day NYC: The Future of CephFSCeph Day NYC: The Future of CephFS
Ceph Day NYC: The Future of CephFSCeph Community
 
Keeping OpenStack storage trendy with Ceph and containers
Keeping OpenStack storage trendy with Ceph and containersKeeping OpenStack storage trendy with Ceph and containers
Keeping OpenStack storage trendy with Ceph and containersSage Weil
 
Introduction into Ceph storage for OpenStack
Introduction into Ceph storage for OpenStackIntroduction into Ceph storage for OpenStack
Introduction into Ceph storage for OpenStackOpenStack_Online
 
The State of Ceph, Manila, and Containers in OpenStack
The State of Ceph, Manila, and Containers in OpenStackThe State of Ceph, Manila, and Containers in OpenStack
The State of Ceph, Manila, and Containers in OpenStackSage Weil
 
SF Ceph Users Jan. 2014
SF Ceph Users Jan. 2014SF Ceph Users Jan. 2014
SF Ceph Users Jan. 2014Kyle Bader
 
2015 open storage workshop ceph software defined storage
2015 open storage workshop   ceph software defined storage2015 open storage workshop   ceph software defined storage
2015 open storage workshop ceph software defined storageAndrew Underwood
 
Ceph, Now and Later: Our Plan for Open Unified Cloud Storage
Ceph, Now and Later: Our Plan for Open Unified Cloud StorageCeph, Now and Later: Our Plan for Open Unified Cloud Storage
Ceph, Now and Later: Our Plan for Open Unified Cloud StorageSage Weil
 
Ceph Day Chicago - Ceph at work at Bloomberg
Ceph Day Chicago - Ceph at work at Bloomberg Ceph Day Chicago - Ceph at work at Bloomberg
Ceph Day Chicago - Ceph at work at Bloomberg Ceph Community
 
HKG15-401: Ceph and Software Defined Storage on ARM servers
HKG15-401: Ceph and Software Defined Storage on ARM serversHKG15-401: Ceph and Software Defined Storage on ARM servers
HKG15-401: Ceph and Software Defined Storage on ARM serversLinaro
 
The container revolution, and what it means to operators.pptx
The container revolution, and what it means to operators.pptxThe container revolution, and what it means to operators.pptx
The container revolution, and what it means to operators.pptxRobert Starmer
 
2011 03-31 Riak Stockholm Meetup
2011 03-31 Riak Stockholm Meetup2011 03-31 Riak Stockholm Meetup
2011 03-31 Riak Stockholm MeetupMårten Gustafson
 
New Ceph capabilities and Reference Architectures
New Ceph capabilities and Reference ArchitecturesNew Ceph capabilities and Reference Architectures
New Ceph capabilities and Reference ArchitecturesKamesh Pemmaraju
 
Ceph Object Storage at Spreadshirt
Ceph Object Storage at SpreadshirtCeph Object Storage at Spreadshirt
Ceph Object Storage at SpreadshirtJens Hadlich
 
ceph openstack dream team
ceph openstack dream teamceph openstack dream team
ceph openstack dream teamUdo Seidel
 

What's hot (19)

OSDC 2015: John Spray | The Ceph Storage System
OSDC 2015: John Spray | The Ceph Storage SystemOSDC 2015: John Spray | The Ceph Storage System
OSDC 2015: John Spray | The Ceph Storage System
 
Ceph Day Beijing: Containers and Ceph
Ceph Day Beijing: Containers and Ceph Ceph Day Beijing: Containers and Ceph
Ceph Day Beijing: Containers and Ceph
 
What you need to know about ceph
What you need to know about cephWhat you need to know about ceph
What you need to know about ceph
 
Ceph Day NYC: The Future of CephFS
Ceph Day NYC: The Future of CephFSCeph Day NYC: The Future of CephFS
Ceph Day NYC: The Future of CephFS
 
Keeping OpenStack storage trendy with Ceph and containers
Keeping OpenStack storage trendy with Ceph and containersKeeping OpenStack storage trendy with Ceph and containers
Keeping OpenStack storage trendy with Ceph and containers
 
Introduction into Ceph storage for OpenStack
Introduction into Ceph storage for OpenStackIntroduction into Ceph storage for OpenStack
Introduction into Ceph storage for OpenStack
 
The State of Ceph, Manila, and Containers in OpenStack
The State of Ceph, Manila, and Containers in OpenStackThe State of Ceph, Manila, and Containers in OpenStack
The State of Ceph, Manila, and Containers in OpenStack
 
SF Ceph Users Jan. 2014
SF Ceph Users Jan. 2014SF Ceph Users Jan. 2014
SF Ceph Users Jan. 2014
 
2015 open storage workshop ceph software defined storage
2015 open storage workshop   ceph software defined storage2015 open storage workshop   ceph software defined storage
2015 open storage workshop ceph software defined storage
 
Gluster Fs
Gluster FsGluster Fs
Gluster Fs
 
Ceph, Now and Later: Our Plan for Open Unified Cloud Storage
Ceph, Now and Later: Our Plan for Open Unified Cloud StorageCeph, Now and Later: Our Plan for Open Unified Cloud Storage
Ceph, Now and Later: Our Plan for Open Unified Cloud Storage
 
Ceph Day Chicago - Ceph at work at Bloomberg
Ceph Day Chicago - Ceph at work at Bloomberg Ceph Day Chicago - Ceph at work at Bloomberg
Ceph Day Chicago - Ceph at work at Bloomberg
 
HKG15-401: Ceph and Software Defined Storage on ARM servers
HKG15-401: Ceph and Software Defined Storage on ARM serversHKG15-401: Ceph and Software Defined Storage on ARM servers
HKG15-401: Ceph and Software Defined Storage on ARM servers
 
The container revolution, and what it means to operators.pptx
The container revolution, and what it means to operators.pptxThe container revolution, and what it means to operators.pptx
The container revolution, and what it means to operators.pptx
 
2011 03-31 Riak Stockholm Meetup
2011 03-31 Riak Stockholm Meetup2011 03-31 Riak Stockholm Meetup
2011 03-31 Riak Stockholm Meetup
 
NoSQL @ Qbranch -2010-04-15
NoSQL @ Qbranch -2010-04-15NoSQL @ Qbranch -2010-04-15
NoSQL @ Qbranch -2010-04-15
 
New Ceph capabilities and Reference Architectures
New Ceph capabilities and Reference ArchitecturesNew Ceph capabilities and Reference Architectures
New Ceph capabilities and Reference Architectures
 
Ceph Object Storage at Spreadshirt
Ceph Object Storage at SpreadshirtCeph Object Storage at Spreadshirt
Ceph Object Storage at Spreadshirt
 
ceph openstack dream team
ceph openstack dream teamceph openstack dream team
ceph openstack dream team
 

Viewers also liked

Using Ceph in a Private Cloud - Ceph Day Frankfurt
Using Ceph in a Private Cloud - Ceph Day Frankfurt Using Ceph in a Private Cloud - Ceph Day Frankfurt
Using Ceph in a Private Cloud - Ceph Day Frankfurt Ceph Community
 
JMP206 : Calling Home: Enabling the IBM Sametime Softphone in ST9
JMP206 : Calling Home: Enabling the IBM Sametime Softphone in ST9JMP206 : Calling Home: Enabling the IBM Sametime Softphone in ST9
JMP206 : Calling Home: Enabling the IBM Sametime Softphone in ST9Keith Brooks
 
Application Logging for Forensics
Application Logging for ForensicsApplication Logging for Forensics
Application Logging for ForensicsRaffael Marty
 
Webinar - Getting Started With Ceph
Webinar - Getting Started With CephWebinar - Getting Started With Ceph
Webinar - Getting Started With CephCeph Community
 
Scaling Ceph at CERN - Ceph Day Frankfurt
Scaling Ceph at CERN - Ceph Day Frankfurt Scaling Ceph at CERN - Ceph Day Frankfurt
Scaling Ceph at CERN - Ceph Day Frankfurt Ceph Community
 
Trying and evaluating the new features of GlusterFS 3.5
Trying and evaluating the new features of GlusterFS 3.5Trying and evaluating the new features of GlusterFS 3.5
Trying and evaluating the new features of GlusterFS 3.5Keisuke Takahashi
 
The TLS/SSLv3 renegotiation vulnerability explained
The TLS/SSLv3 renegotiation vulnerability explainedThe TLS/SSLv3 renegotiation vulnerability explained
The TLS/SSLv3 renegotiation vulnerability explainedThierry Zoller
 
DNSSEC and DANE – E-Mail security reloaded
DNSSEC and DANE – E-Mail security reloadedDNSSEC and DANE – E-Mail security reloaded
DNSSEC and DANE – E-Mail security reloadedMen and Mice
 
NetBSD syslogd with IETF Syslog Protocols
NetBSD syslogd with IETF Syslog ProtocolsNetBSD syslogd with IETF Syslog Protocols
NetBSD syslogd with IETF Syslog ProtocolsMartin Schütte
 

Viewers also liked (12)

Using Ceph in a Private Cloud - Ceph Day Frankfurt
Using Ceph in a Private Cloud - Ceph Day Frankfurt Using Ceph in a Private Cloud - Ceph Day Frankfurt
Using Ceph in a Private Cloud - Ceph Day Frankfurt
 
ION Tokyo: The Business Case for DNSSEC and DANE, Dan York
ION Tokyo: The Business Case for DNSSEC and DANE, Dan YorkION Tokyo: The Business Case for DNSSEC and DANE, Dan York
ION Tokyo: The Business Case for DNSSEC and DANE, Dan York
 
JMP206 : Calling Home: Enabling the IBM Sametime Softphone in ST9
JMP206 : Calling Home: Enabling the IBM Sametime Softphone in ST9JMP206 : Calling Home: Enabling the IBM Sametime Softphone in ST9
JMP206 : Calling Home: Enabling the IBM Sametime Softphone in ST9
 
Application Logging for Forensics
Application Logging for ForensicsApplication Logging for Forensics
Application Logging for Forensics
 
Webinar - Getting Started With Ceph
Webinar - Getting Started With CephWebinar - Getting Started With Ceph
Webinar - Getting Started With Ceph
 
Scaling Ceph at CERN - Ceph Day Frankfurt
Scaling Ceph at CERN - Ceph Day Frankfurt Scaling Ceph at CERN - Ceph Day Frankfurt
Scaling Ceph at CERN - Ceph Day Frankfurt
 
Trying and evaluating the new features of GlusterFS 3.5
Trying and evaluating the new features of GlusterFS 3.5Trying and evaluating the new features of GlusterFS 3.5
Trying and evaluating the new features of GlusterFS 3.5
 
The TLS/SSLv3 renegotiation vulnerability explained
The TLS/SSLv3 renegotiation vulnerability explainedThe TLS/SSLv3 renegotiation vulnerability explained
The TLS/SSLv3 renegotiation vulnerability explained
 
DNSSEC and DANE – E-Mail security reloaded
DNSSEC and DANE – E-Mail security reloadedDNSSEC and DANE – E-Mail security reloaded
DNSSEC and DANE – E-Mail security reloaded
 
Analyzing OAuth
Analyzing OAuthAnalyzing OAuth
Analyzing OAuth
 
ION Sri Lanka - DANE: The Future of TLS
ION Sri Lanka - DANE: The Future of TLSION Sri Lanka - DANE: The Future of TLS
ION Sri Lanka - DANE: The Future of TLS
 
NetBSD syslogd with IETF Syslog Protocols
NetBSD syslogd with IETF Syslog ProtocolsNetBSD syslogd with IETF Syslog Protocols
NetBSD syslogd with IETF Syslog Protocols
 

Similar to DreamObjects - Ceph Day Nov 2012

New features for Ceph with Cinder and Beyond
New features for Ceph with Cinder and BeyondNew features for Ceph with Cinder and Beyond
New features for Ceph with Cinder and BeyondCeph Community
 
New Features for Ceph with Cinder and Beyond
New Features for Ceph with Cinder and BeyondNew Features for Ceph with Cinder and Beyond
New Features for Ceph with Cinder and BeyondOpenStack Foundation
 
London Ceph Day: The Future of CephFS
London Ceph Day: The Future of CephFSLondon Ceph Day: The Future of CephFS
London Ceph Day: The Future of CephFSCeph Community
 
End of RAID as we know it with Ceph Replication
End of RAID as we know it with Ceph ReplicationEnd of RAID as we know it with Ceph Replication
End of RAID as we know it with Ceph ReplicationCeph Community
 
Storage Developer Conference - 09/19/2012
Storage Developer Conference - 09/19/2012Storage Developer Conference - 09/19/2012
Storage Developer Conference - 09/19/2012Ceph Community
 
Ceph LISA'12 Presentation
Ceph LISA'12 PresentationCeph LISA'12 Presentation
Ceph LISA'12 PresentationCeph Community
 
The Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red Hat
The Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red HatThe Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red Hat
The Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red HatOpenStack
 
Cache Tiering and Erasure Coding
Cache Tiering and Erasure CodingCache Tiering and Erasure Coding
Cache Tiering and Erasure CodingShinobu Kinjo
 
Cache Tiering and Erasure Coding
Cache Tiering and Erasure CodingCache Tiering and Erasure Coding
Cache Tiering and Erasure CodingShinobu KINJO
 
Riak at Engine Yard Cloud
Riak at Engine Yard CloudRiak at Engine Yard Cloud
Riak at Engine Yard CloudInes Sombra
 
Open Source Storage at Scale: Ceph @ GRNET
Open Source Storage at Scale: Ceph @ GRNETOpen Source Storage at Scale: Ceph @ GRNET
Open Source Storage at Scale: Ceph @ GRNETNikos Kormpakis
 
Drbd9 and drbdmanage_june_2016
Drbd9 and drbdmanage_june_2016Drbd9 and drbdmanage_june_2016
Drbd9 and drbdmanage_june_2016Philipp Reisner
 
Ceph Day Santa Clara: The Future of CephFS + Developing with Librados
Ceph Day Santa Clara: The Future of CephFS + Developing with LibradosCeph Day Santa Clara: The Future of CephFS + Developing with Librados
Ceph Day Santa Clara: The Future of CephFS + Developing with LibradosCeph Community
 
drbd9_and_drbdmanage_may_2015
drbd9_and_drbdmanage_may_2015drbd9_and_drbdmanage_may_2015
drbd9_and_drbdmanage_may_2015Alexandre Huynh
 
Ceph - A distributed storage system
Ceph - A distributed storage systemCeph - A distributed storage system
Ceph - A distributed storage systemItalo Santos
 
What CloudStackers Need To Know About LINSTOR/DRBD
What CloudStackers Need To Know About LINSTOR/DRBDWhat CloudStackers Need To Know About LINSTOR/DRBD
What CloudStackers Need To Know About LINSTOR/DRBDShapeBlue
 
OpenNebulaConf 2016 - The DRBD SDS for OpenNebula by Philipp Reisner, LINBIT
OpenNebulaConf 2016 - The DRBD SDS for OpenNebula by Philipp Reisner, LINBITOpenNebulaConf 2016 - The DRBD SDS for OpenNebula by Philipp Reisner, LINBIT
OpenNebulaConf 2016 - The DRBD SDS for OpenNebula by Philipp Reisner, LINBITOpenNebula Project
 
Seattle Scalability Meetup - Ted Dunning - MapR
Seattle Scalability Meetup - Ted Dunning - MapRSeattle Scalability Meetup - Ted Dunning - MapR
Seattle Scalability Meetup - Ted Dunning - MapRclive boulton
 

Similar to DreamObjects - Ceph Day Nov 2012 (20)

New features for Ceph with Cinder and Beyond
New features for Ceph with Cinder and BeyondNew features for Ceph with Cinder and Beyond
New features for Ceph with Cinder and Beyond
 
New Features for Ceph with Cinder and Beyond
New Features for Ceph with Cinder and BeyondNew Features for Ceph with Cinder and Beyond
New Features for Ceph with Cinder and Beyond
 
London Ceph Day: The Future of CephFS
London Ceph Day: The Future of CephFSLondon Ceph Day: The Future of CephFS
London Ceph Day: The Future of CephFS
 
End of RAID as we know it with Ceph Replication
End of RAID as we know it with Ceph ReplicationEnd of RAID as we know it with Ceph Replication
End of RAID as we know it with Ceph Replication
 
Storage Developer Conference - 09/19/2012
Storage Developer Conference - 09/19/2012Storage Developer Conference - 09/19/2012
Storage Developer Conference - 09/19/2012
 
Ceph LISA'12 Presentation
Ceph LISA'12 PresentationCeph LISA'12 Presentation
Ceph LISA'12 Presentation
 
The Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red Hat
The Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red HatThe Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red Hat
The Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red Hat
 
Cache Tiering and Erasure Coding
Cache Tiering and Erasure CodingCache Tiering and Erasure Coding
Cache Tiering and Erasure Coding
 
Cache Tiering and Erasure Coding
Cache Tiering and Erasure CodingCache Tiering and Erasure Coding
Cache Tiering and Erasure Coding
 
Scale 10x 01:22:12
Scale 10x 01:22:12Scale 10x 01:22:12
Scale 10x 01:22:12
 
Riak at Engine Yard Cloud
Riak at Engine Yard CloudRiak at Engine Yard Cloud
Riak at Engine Yard Cloud
 
Strata - 03/31/2012
Strata - 03/31/2012Strata - 03/31/2012
Strata - 03/31/2012
 
Open Source Storage at Scale: Ceph @ GRNET
Open Source Storage at Scale: Ceph @ GRNETOpen Source Storage at Scale: Ceph @ GRNET
Open Source Storage at Scale: Ceph @ GRNET
 
Drbd9 and drbdmanage_june_2016
Drbd9 and drbdmanage_june_2016Drbd9 and drbdmanage_june_2016
Drbd9 and drbdmanage_june_2016
 
Ceph Day Santa Clara: The Future of CephFS + Developing with Librados
Ceph Day Santa Clara: The Future of CephFS + Developing with LibradosCeph Day Santa Clara: The Future of CephFS + Developing with Librados
Ceph Day Santa Clara: The Future of CephFS + Developing with Librados
 
drbd9_and_drbdmanage_may_2015
drbd9_and_drbdmanage_may_2015drbd9_and_drbdmanage_may_2015
drbd9_and_drbdmanage_may_2015
 
Ceph - A distributed storage system
Ceph - A distributed storage systemCeph - A distributed storage system
Ceph - A distributed storage system
 
What CloudStackers Need To Know About LINSTOR/DRBD
What CloudStackers Need To Know About LINSTOR/DRBDWhat CloudStackers Need To Know About LINSTOR/DRBD
What CloudStackers Need To Know About LINSTOR/DRBD
 
OpenNebulaConf 2016 - The DRBD SDS for OpenNebula by Philipp Reisner, LINBIT
OpenNebulaConf 2016 - The DRBD SDS for OpenNebula by Philipp Reisner, LINBITOpenNebulaConf 2016 - The DRBD SDS for OpenNebula by Philipp Reisner, LINBIT
OpenNebulaConf 2016 - The DRBD SDS for OpenNebula by Philipp Reisner, LINBIT
 
Seattle Scalability Meetup - Ted Dunning - MapR
Seattle Scalability Meetup - Ted Dunning - MapRSeattle Scalability Meetup - Ted Dunning - MapR
Seattle Scalability Meetup - Ted Dunning - MapR
 

DreamObjects - Ceph Day Nov 2012

  • 1. DreamObjects Cloud Object Storage Powered by Ceph Monday, November 5, 12
  • 2. This slide is all about me, me, me. Ross Turk Community Manager, Ceph VP Community, Inktank ross@inktank.com | @rossturk inktank.com | ceph.com 2 Monday, November 5, 12
  • 3. DreamHost Imagine the Web,Your Way 15 years creating and deploying services Over 340,000 entrepreneur and developer customers Open source obsessed • Hosting over 500,000 WordPress sites • Contributing Ceph, Ceilometer, Akanda • OpenStack innovator & contributor Monday, November 5, 12
  • 4. Selection Criteria Must be able to deploy at large scale • Cope with large objects, or large numbers of small objects • Transparently handle continuous component failures Must be managed in a cost-effective way • Run on commodity hardware and free open source software • Automatically handle failures, new hardware, decommissioning Must be brought to market quickly • Mature enough to be quickly productized Must enable hybrid deployments • Customers should be able to use in hybrid private/public setup • Customers should have the freedom to build it themselves 4 Monday, November 5, 12
  • 5. What Is DreamObjects? It’s where data hangs its hat in the cloud. Web App Storage Backups Digital Media Freedom: No vendor lock-in • Powered by Ceph, an open source, portable storage platform Flexibility: It’s compatible • Access DreamObjects with either Amazon S3 API or Swift API Priced RIght: Unique Pricing Model • $0.07/GB, inbound data transfer is free, unlimited API requests Monday, November 5, 12
  • 6. APP APP HOST/VM CLIENT RADOSGW RBD CEPH FS LIBRADOS A bucket-based REST A reliable and fully- A POSIX-compliant A library allowing gateway, compatible with distributed block device, distributed file system, apps to directly S3 and Swift with a Linux kernel client with a Linux kernel client access RADOS, and a QEMU/KVM driver and support for FUSE with support for C, C++, Java, Python, Ruby, and PHP RADOS A reliable, autonomous, distributed object store comprised of self-healing, self-managing, intelligent storage nodes Monday, November 5, 12
  • 7. APP APP HOST/VM CLIENT RADOSGW RBD CEPH FS LIBRADOS A bucket-based REST A reliable and fully- A POSIX-compliant A library allowing gateway, compatible with distributed block device, distributed file system, apps to directly S3 and Swift with a Linux kernel client with a Linux kernel client access RADOS, and a QEMU/KVM driver and support for FUSE with support for C, C++, Java, Python, Ruby, and PHP RADOS A reliable, autonomous, distributed object store comprised of self-healing, self-managing, intelligent storage nodes Monday, November 5, 12
  • 8. x12 M x12 LOAD BALANCER M x12 LOAD M BALANCER x12 36TB PER MACHINE x12 radosgw M ceph-mon ceph-osd Monday, November 5, 12
  • 9. DreamObjects Hardware Specs STORAGE NODE LOAD BALANCER x2 Dell PowerEdge R515 6 core AMD CPU, 32GB RAM MANAGEMENT NODE x4 2x 300GB SAS drives (OS) 12x 3TB SATA drives 2x 10GbE, 1x 1GbE, IPMI STORAGE NODE STORAGE NODE MANAGEMENT NODE STORAGE NODE Dell PowerEdge R415 STORAGE NODE x90 2x 1TB SATA STORAGE NODE STORAGE NODE 1x 10GbE MANAGEMENT NODE M x3 Monday, November 5, 12
  • 10. 3TB per OSD x 12 = x 12 OSDs per node = 36TB per node 3TB 36TB 36TB per node x 90 = x 90 nodes = ~3PB total capacity 36TB ~3PB ~3PB total capacity /3= / 3 replicas per object = ~1PB usable capacity ~3PB ~1PB Monday, November 5, 12
  • 11. Deployment DreamHost deploys Ceph with Opscode Chef • Reduce operations overhead • Maintain efficiency to keep costs down • Provide consistency • Always deploy / manage resources the same way Ceph has cookbooks: https://github.com/ceph/ceph-cookbooks 11 Monday, November 5, 12
  • 15. Case Study Available (Soon!) http://inktank.com/dhcs 15 Monday, November 5, 12
  • 16. Questions? Ross Turk Community Manager, Ceph VP Community, Inktank ross@inktank.com | @rossturk inktank.com | ceph.com Read about DreamObjects: http://inktank.com/dhcs 16 Monday, November 5, 12