Storage with ceph (osdc 2013)

•

0 likes•520 views

Martin Loschwitz

Storage with Ceph
Scale-Out made easy
Martin Gerhard Loschwitz
© 2013 hastexo Professional Services GmbH. All rights reserved.

Who?

Scalable Storage

2 types of Scalability

Scale-Up

Scale-Up before:

Scale-Up afterwards:

Scale-Up quickly comes
to its limits

Scale-Out

Scale-Out before:

Scale-Out afterwards:

Scale-Out is hip

Webserver

Databases

Even me!

Storage? Meh.

The Block problem

HDD
FS
User Space

Blocks for distributed systems?

I don’t think so, Tim!

Object Stores

User Space
Objects
HDD
FS
HDD
FS
HDD
FS
HDD
FS
HDD
FS
HDD
FS
HDD
FS

User Space
Objects
HDD
FS
HDD
FS
HDD
FS
HDD
FS
HDD
FS
HDD
FS
HDD
FS

Originally a PhD thesis

Object Store

RADOS

Redundant
Autonomic
Distributed
Object
Store

2 Components

OSDs

MONs

Data Placement

MONs

MONs

MONs

MONs

MONs

MONs

MONs

Parallelization

221 1
MONs

221 1
MONs

221 11 2 21
MONs

MONs

CRUSH

Controlled
Replication
Under
Scalable
Hashing

Rack aware

Clients?

Block Device Driver

RBD (RADOS Block Device)

rbd

Qemu-RBD

ReSTful API

radosgw

Compatible with S3 and Swift

POSIX ﬁle system

CephFS

Still Beta!

Need a special client?

librados

Use cases

Gigantic Storage

40TB, 3 replicas = € 21.000

Virtualization

iSCSI Storage

Cloud

OpenStack

live demo

24. May 2013
OpenStack DACH Day 2013
http://openstackdach2013.eventbrite.com

goo.gl/S1sYZ (me on Google+)
twitter.com/hastexo
hastexo.com
221 11 2 21
MONS

More Related Content

What's hot

A Storage Story #ChefConf2013

A Storage Story #ChefConf2013

A Storage Story #ChefConf2013Kyle Bader

PostgreSQL on ZFS Lightning Talk

PostgreSQL on ZFS Lightning Talk

PostgreSQL on ZFS Lightning TalkSean Chittenden

An Overview of Next-Gen Filesystems

An Overview of Next-Gen Filesystems

An Overview of Next-Gen FilesystemsGreat Wide Open

What you need to know about ceph

What you need to know about ceph

What you need to know about cephEmma Haruka Iwao

Why flash storage caching

Why flash storage caching

Why flash storage cachingTim Fletcher

Beyondfs-introKim Yong-Duk

Introduction to BTRFS and ZFS

Introduction to BTRFS and ZFS

Introduction to BTRFS and ZFSTsung-en Hsiao

PostgreSQL on EXT4, XFS, BTRFS and ZFS

PostgreSQL on EXT4, XFS, BTRFS and ZFS

PostgreSQL on EXT4, XFS, BTRFS and ZFSTomas Vondra

Synology RAID F1 final

Synology RAID F1 final

Synology RAID F1 finalJosh Chambers

The container revolution, and what it means to operators.pptx

The container revolution, and what it means to operators.pptx

The container revolution, and what it means to operators.pptxRobert Starmer

Ceph Object Storage at Spreadshirt

Ceph Object Storage at Spreadshirt

Ceph Object Storage at SpreadshirtJens Hadlich

Ceph Object Storage at Spreadshirt (July 2015, Ceph Berlin Meetup)

Ceph Object Storage at Spreadshirt (July 2015, Ceph Berlin Meetup)

Ceph Object Storage at Spreadshirt (July 2015, Ceph Berlin Meetup)Jens Hadlich

Storage Devices And Backup Media

Storage Devices And Backup Media

Storage Devices And Backup MediaTyrone Turner

BluestorePatrick McGarry

Exploiting Your File System to Build Robust & Efficient Workflows

Exploiting Your File System to Build Robust & Efficient Workflows

Exploiting Your File System to Build Robust & Efficient Workflowsjasonajohnson

C* Summit EU 2013: Cassandra on Flash: Performance & Efficiency Lessons Learned

C* Summit EU 2013: Cassandra on Flash: Performance & Efficiency Lessons Learned

C* Summit EU 2013: Cassandra on Flash: Performance & Efficiency Lessons Learned DataStax Academy

Solid State Drive Technology - MIT Lincoln Labs

Solid State Drive Technology - MIT Lincoln Labs

Solid State Drive Technology - MIT Lincoln LabsMatt Simmons

Introduction to Btrfs - FLOSS UK Spring Conference York 2015

Introduction to Btrfs - FLOSS UK Spring Conference York 2015

Introduction to Btrfs - FLOSS UK Spring Conference York 2015Richard Melville

Ceph InternalsVictor Santos

What's hot (20)

A Storage Story #ChefConf2013

A Storage Story #ChefConf2013

A Storage Story #ChefConf2013

PostgreSQL on ZFS Lightning Talk

PostgreSQL on ZFS Lightning Talk

PostgreSQL on ZFS Lightning Talk

An Overview of Next-Gen Filesystems

An Overview of Next-Gen Filesystems

An Overview of Next-Gen Filesystems

What you need to know about ceph

What you need to know about ceph

What you need to know about ceph

Why flash storage caching

Why flash storage caching

Why flash storage caching

Beyondfs-intro

Introduction to BTRFS and ZFS

Introduction to BTRFS and ZFS

Introduction to BTRFS and ZFS

PostgreSQL on EXT4, XFS, BTRFS and ZFS

PostgreSQL on EXT4, XFS, BTRFS and ZFS

PostgreSQL on EXT4, XFS, BTRFS and ZFS

Synology RAID F1 final

Synology RAID F1 final

Synology RAID F1 final

The container revolution, and what it means to operators.pptx

The container revolution, and what it means to operators.pptx

The container revolution, and what it means to operators.pptx

Ceph Object Storage at Spreadshirt

Ceph Object Storage at Spreadshirt

Ceph Object Storage at Spreadshirt

Ceph Object Storage at Spreadshirt (July 2015, Ceph Berlin Meetup)

Ceph Object Storage at Spreadshirt (July 2015, Ceph Berlin Meetup)

Ceph Object Storage at Spreadshirt (July 2015, Ceph Berlin Meetup)

ZFS

Storage Devices And Backup Media

Storage Devices And Backup Media

Storage Devices And Backup Media

Bluestore

Exploiting Your File System to Build Robust & Efficient Workflows

Exploiting Your File System to Build Robust & Efficient Workflows

Exploiting Your File System to Build Robust & Efficient Workflows

C* Summit EU 2013: Cassandra on Flash: Performance & Efficiency Lessons Learned

C* Summit EU 2013: Cassandra on Flash: Performance & Efficiency Lessons Learned

C* Summit EU 2013: Cassandra on Flash: Performance & Efficiency Lessons Learned

Solid State Drive Technology - MIT Lincoln Labs

Solid State Drive Technology - MIT Lincoln Labs

Solid State Drive Technology - MIT Lincoln Labs

Introduction to Btrfs - FLOSS UK Spring Conference York 2015

Introduction to Btrfs - FLOSS UK Spring Conference York 2015

Introduction to Btrfs - FLOSS UK Spring Conference York 2015

Ceph Internals

Viewers also liked

LCA 2012: High Availability Sprint

LCA 2012: High Availability Sprint

LCA 2012: High Availability Sprinthastexo

Storage with Ceph (OSDC 2013)

Storage with Ceph (OSDC 2013)

Storage with Ceph (OSDC 2013)hastexo

CloudKC: Evolution of Network Virtualization

CloudKC: Evolution of Network Virtualization

CloudKC: Evolution of Network VirtualizationCynthia Thomas

Florian Haas, hastexo - heat, cloud-init and cloud-config: OpenStack Orchestr...

Florian Haas, hastexo - heat, cloud-init and cloud-config: OpenStack Orchestr...

Florian Haas, hastexo - heat, cloud-init and cloud-config: OpenStack Orchestr...Cloud Native Day Tel Aviv

Openstack Basic with Neutron

Openstack Basic with Neutron

Openstack Basic with NeutronKwonSun Bae

OpenStack Neutron Tutorial

OpenStack Neutron Tutorial

OpenStack Neutron Tutorialmestery

Viewers also liked (6)

LCA 2012: High Availability Sprint

LCA 2012: High Availability Sprint

LCA 2012: High Availability Sprint

Storage with Ceph (OSDC 2013)

Storage with Ceph (OSDC 2013)

Storage with Ceph (OSDC 2013)

CloudKC: Evolution of Network Virtualization

CloudKC: Evolution of Network Virtualization

CloudKC: Evolution of Network Virtualization

Florian Haas, hastexo - heat, cloud-init and cloud-config: OpenStack Orchestr...

Florian Haas, hastexo - heat, cloud-init and cloud-config: OpenStack Orchestr...

Florian Haas, hastexo - heat, cloud-init and cloud-config: OpenStack Orchestr...

Openstack Basic with Neutron

Openstack Basic with Neutron

Openstack Basic with Neutron

OpenStack Neutron Tutorial

OpenStack Neutron Tutorial

OpenStack Neutron Tutorial

Similar to Storage with ceph (osdc 2013)

Red Hat Storage 2014 - Product(s) Overview

Red Hat Storage 2014 - Product(s) Overview

Red Hat Storage 2014 - Product(s) OverviewMarcel Hergaarden

Block Storage For VMs With Ceph

Block Storage For VMs With Ceph

Block Storage For VMs With CephThe Linux Foundation

XenSummit - 08/28/2012

XenSummit - 08/28/2012

XenSummit - 08/28/2012Ceph Community

INFINISTORE(tm) - Scalable Open Source Storage Arhcitecture

INFINISTORE(tm) - Scalable Open Source Storage Arhcitecture

INFINISTORE(tm) - Scalable Open Source Storage ArhcitectureThomas Uhl

Storage tiering and erasure coding in Ceph (SCaLE13x)

Storage tiering and erasure coding in Ceph (SCaLE13x)

Storage tiering and erasure coding in Ceph (SCaLE13x)Sage Weil

Ceph Day NYC: The Future of CephFS

Ceph Day NYC: The Future of CephFS

Ceph Day NYC: The Future of CephFSCeph Community

Ceph as software define storage

Ceph as software define storage

Ceph as software define storageMahmoud Shiri Varamini

Ceph Introduction 2017

Ceph Introduction 2017

Ceph Introduction 2017 Karan Singh

OSDC 2015: John Spray | The Ceph Storage System

OSDC 2015: John Spray | The Ceph Storage System

OSDC 2015: John Spray | The Ceph Storage SystemNETWAYS

Hadoop architecture (Delhi Hadoop User Group Meetup 10 Sep 2011)

Hadoop architecture (Delhi Hadoop User Group Meetup 10 Sep 2011)

Hadoop architecture (Delhi Hadoop User Group Meetup 10 Sep 2011)Hari Shankar Sreekumar

Hadoop Architecture

Hadoop Architecture

Hadoop ArchitectureDelhi/NCR HUG

The Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red Hat

The Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red Hat

The Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red HatOpenStack

London Ceph Day: The Future of CephFS

London Ceph Day: The Future of CephFS

London Ceph Day: The Future of CephFSCeph Community

Zero to 60 with Azure Cosmos DB

Zero to 60 with Azure Cosmos DB

Zero to 60 with Azure Cosmos DBAdnan Hashmi

Ceph LISA'12 Presentation

Ceph LISA'12 Presentation

Ceph LISA'12 PresentationCeph Community

A Look at the Future of Storage

A Look at the Future of Storage

A Look at the Future of StorageIT Brand Pulse

Ceph Day San Jose - Ceph at Salesforce

Ceph Day San Jose - Ceph at Salesforce

Ceph Day San Jose - Ceph at Salesforce Ceph Community

Open Source Storage at Scale: Ceph @ GRNET

Open Source Storage at Scale: Ceph @ GRNET

Open Source Storage at Scale: Ceph @ GRNETNikos Kormpakis

Etu L2 Training - Hadoop 企業應用實作

Etu L2 Training - Hadoop 企業應用實作

Etu L2 Training - Hadoop 企業應用實作James Chen

Ceph Block Devices: A Deep Dive

Ceph Block Devices: A Deep Dive

Ceph Block Devices: A Deep Divejoshdurgin

Similar to Storage with ceph (osdc 2013) (20)

Red Hat Storage 2014 - Product(s) Overview

Red Hat Storage 2014 - Product(s) Overview

Red Hat Storage 2014 - Product(s) Overview

Block Storage For VMs With Ceph

Block Storage For VMs With Ceph

Block Storage For VMs With Ceph

XenSummit - 08/28/2012

XenSummit - 08/28/2012

XenSummit - 08/28/2012

INFINISTORE(tm) - Scalable Open Source Storage Arhcitecture

INFINISTORE(tm) - Scalable Open Source Storage Arhcitecture

INFINISTORE(tm) - Scalable Open Source Storage Arhcitecture

Storage tiering and erasure coding in Ceph (SCaLE13x)

Storage tiering and erasure coding in Ceph (SCaLE13x)

Storage tiering and erasure coding in Ceph (SCaLE13x)

Ceph Day NYC: The Future of CephFS

Ceph Day NYC: The Future of CephFS

Ceph Day NYC: The Future of CephFS

Ceph as software define storage

Ceph as software define storage

Ceph as software define storage

Ceph Introduction 2017

Ceph Introduction 2017

Ceph Introduction 2017

OSDC 2015: John Spray | The Ceph Storage System

OSDC 2015: John Spray | The Ceph Storage System

OSDC 2015: John Spray | The Ceph Storage System

Hadoop architecture (Delhi Hadoop User Group Meetup 10 Sep 2011)

Hadoop architecture (Delhi Hadoop User Group Meetup 10 Sep 2011)

Hadoop architecture (Delhi Hadoop User Group Meetup 10 Sep 2011)

Hadoop Architecture

Hadoop Architecture

Hadoop Architecture

The Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red Hat

The Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red Hat

The Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red Hat

London Ceph Day: The Future of CephFS

London Ceph Day: The Future of CephFS

London Ceph Day: The Future of CephFS

Zero to 60 with Azure Cosmos DB

Zero to 60 with Azure Cosmos DB

Zero to 60 with Azure Cosmos DB

Ceph LISA'12 Presentation

Ceph LISA'12 Presentation

Ceph LISA'12 Presentation

A Look at the Future of Storage

A Look at the Future of Storage

A Look at the Future of Storage

Ceph Day San Jose - Ceph at Salesforce

Ceph Day San Jose - Ceph at Salesforce

Ceph Day San Jose - Ceph at Salesforce

Open Source Storage at Scale: Ceph @ GRNET

Open Source Storage at Scale: Ceph @ GRNET

Open Source Storage at Scale: Ceph @ GRNET

Etu L2 Training - Hadoop 企業應用實作

Etu L2 Training - Hadoop 企業應用實作

Etu L2 Training - Hadoop 企業應用實作

Ceph Block Devices: A Deep Dive

Ceph Block Devices: A Deep Dive

Ceph Block Devices: A Deep Dive

Storage with ceph (osdc 2013)

1. Storage with Ceph Scale-Out made easy Martin Gerhard Loschwitz © 2013 hastexo Professional Services GmbH. All rights reserved.

3.

4.

5.

6.

7.

8.

9.

10.

11.

12. Scalable Storage

13. 2 types of Scalability

15. Scale-Up before:

16. Scale-Up afterwards:

17. Scale-Up quickly comes to its limits

19. Scale-Out before:

20. Scale-Out afterwards:

21. Scale-Out is hip

25. Storage? Meh.

26. The Block problem

27. HDD FS User Space

28. Blocks for distributed systems?

29. I don’t think so, Tim!

30. Object Stores

31.

32. User Space Objects HDD FS HDD FS HDD FS HDD FS HDD FS HDD FS HDD FS

33. User Space Objects HDD FS HDD FS HDD FS HDD FS HDD FS HDD FS HDD FS

34.

35. Originally a PhD thesis

36.

37. Object Store

39. Redundant Autonomic Distributed Object Store

40. 2 Components

43. Data Placement

44.

52. Parallelization

55. 221 11 2 21 MONs

58. Controlled Replication Under Scalable Hashing

61. Block Device Driver

62. RBD (RADOS Block Device)

65.

66. ReSTful API

68. Compatible with S3 and Swift

69. POSIX ﬁle system

71. Still Beta!

72. Need a special client?

75. Gigantic Storage

76. 40TB, 3 replicas = € 21.000

77. Virtualization

78. iSCSI Storage

82. 24. May 2013 OpenStack DACH Day 2013 http://openstackdach2013.eventbrite.com

83. Special thanks goes to: Sage Weil (Twitter: @liewegas) & crew for Ceph Inktank (Twitter: @inktank) for the Ceph logo

84. goo.gl/S1sYZ (me on Google+) twitter.com/hastexo hastexo.com 221 11 2 21 MONS