Ceph, Open Source, and the Path to Ubiquity in Storage - AACS Meetup 2014
Upcoming SlideShare
Loading in...5
×
 

Ceph, Open Source, and the Path to Ubiquity in Storage - AACS Meetup 2014

on

  • 517 views

Everyone needs storage, but Open Source is changing how we think about storage infrastructure through new features, added durability, and reduced cost. New storage solutions like Ceph are providing ...

Everyone needs storage, but Open Source is changing how we think about storage infrastructure through new features, added durability, and reduced cost. New storage solutions like Ceph are providing distributed, flexible, powerful options that can support a myriad of use cases across object, block, and file system applications. This talk will explore the history and basics of Ceph, the current status of the community, and where the project is headed in the near future.

Statistics

Views

Total Views
517
Views on SlideShare
513
Embed Views
4

Actions

Likes
1
Downloads
27
Comments
0

1 Embed 4

http://www.slideee.com 4

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • Make it a horizontal timeline

Ceph, Open Source, and the Path to Ubiquity in Storage - AACS Meetup 2014 Ceph, Open Source, and the Path to Ubiquity in Storage - AACS Meetup 2014 Presentation Transcript

  • Ceph, Open Source, and the Path to Ubiquity in Storage AACS – 2014 Apr 02
  • Copyright © 2014 by Inktank | Private and Confidential WHO? 2
  • Copyright © 2014 by Inktank | Private and Confidential AGENDA 3
  • THE FORECAST By 2020 over 15 ZB of data will be stored. 1 .5 ZB are stored today. 4 Copyright © 2014 by Inktank | Private and Confidential
  • THE PROBLEM  Existing systems don’t scale  Increasing cost and complexity  Need to invest in new platforms ahead of time2010 2020 IT Storage Budget Growth of data 5 Copyright © 2014 by Inktank | Private and Confidential
  • THE SOLUTION PAST: SCALE UP FUTURE: SCALE OUT 6 Copyright © 2014 by Inktank | Private and Confidential
  • INTRO TO CEPH
  • HISTORICAL TIMELINE Copyright © 2013 by Inktank | Private and Confidential 8 RHEL-OSP & RHEV Support FEB 2014 MAY 2012 Launch of Inktank OpenStack Integration 2011 2010 Mainline Linux Kernel Open Source 2006 2004 Project Starts at UCSC Production Ready Ceph SEPT 2012 2012 CloudStack Integration OCT 2013 Inktank Ceph Enterprise Launch Xen Integration 2013
  • ARCHITECTURAL COMPONENTS 9 Copyright © 2014 by Inktank | Private and Confidential APP HOST/VM CLIENT
  • CEPH UNIFIED STORAGE FILE SYSTEM BLOCK STORAGE OBJECT STORAGE Keystone Geo-Replication Native API 10 Multi-tenant S3 & Swift OpenStack Linux Kernel iSCSI Clones Snapshots CIFS/NFS HDFS Distributed Metadata Linux Kernel POSIX Copyright © 2014 by Inktank | Private and Confidential
  • TRADITIONAL STORAGE VS. CEPH TRADITIONAL ENTERPRISE STORAGE 11 Copyright © 2014 by Inktank | Private and Confidential
  • CEPH WITH OPENSTACK 12 Copyright © 2014 by Inktank | Private and Confidential
  • WEB APPLICATION STORAGE 13 Copyright © 2014 by Inktank | Private and Confidential S3/Swift S3/Swift S3/Swift S3/Swift
  • MULTI-SITE OBJECT STORAGE 14 Copyright © 2014 by Inktank | Private and Confidential
  • Copyright © 2014 by Inktank | Private and Confidential ARCHITECTURE
  • ARCHITECTURAL COMPONENTS 16 Copyright © 2014 by Inktank | Private and Confidential APP HOST/VM CLIENT
  • 1 DISK FS DISK DISK OSD DISK DISK OSD OSD OSD OSD FS FS FSFS btrfs xfs ext4 MMM 17
  • 1 M M M HUMAN 18
  • 1 Monitors: Maintain cluster map Provide consensus for distributed decision-making Must have an odd number These do not serve stored objects to clients M OSDs: •One per disk (recommended) •At least three in a cluster •Serve stored objects to clients •Intelligently peer to perform replication tasks •Supports object classes 19
  • 2 M M M CLIENT 01 10 data metadata 20
  • 2 Metadata Server Manages metadata for a POSIX- compliant shared filesystem Directory hierarchy File metadata (owner, timestamps, mode, etc.) Stores metadata in RADOS Does not serve file data to clients Only required for shared filesystem 21
  • CRUSH  Pseudo-random placement algorithm  Ensures even distribution  Repeatable, deterministic  Rule-based configuration  Replica count  Infrastructure topology  Weighting CRUSH 22
  • 2 10 10 01 01 10 10 01 11 01 10 10 10 01 01 10 10 01 11 01 10 hash(object name) % num pg CRUSH(pg, cluster state, rule set) 23
  • 2 CLIENT ?? 24
  • 2 25
  • 2 26
  • 2 CLIENT ?? 27
  • Ceph Developer Summit 29 • Recent: “Giant” • March 04-05 • wiki.ceph.com • Virtual (irc, hangout, pad, blueprint, youtube) • 2 days (soon to be 3?) • Discuss all work • Recruit for your projects!
  • New Contribute Page 30 • http://ceph.com/ community/ Contribute • Source tree • Issues • Share experiences • Standups • One-stop shop
  • New Ceph Wiki 31
  •  Accepted as a mentoring organization  8 mentors from Inktank & Community  http://ceph.com/gsoc2014/  Student applications being evaluated  Hope to turn this into academic outreach Google Summer of Code 2014 32
  • Ceph Days 33 • inktank.com/ cephdays • Recently: London, Frankfurt, NYC, Santa Clara • Aggressive program • Upcoming: Sunnyvale, Austin, Boston, Kuala Lumpur
  • Meetups 34 • Community organized • World wide • Wiki • Ceph-community • Goodies available • Logistical support • Drinkup to tradeshow
  •  We haven’t forgotten!  Looking for potential founding members  Especially important to keep the IP clean Ceph Foundation 35
  • Coordinated Efforts 36 • Always need help • CentOS SIG • OCP • Xen • Hadoop • OpenStack • CloudStack • Ganetti • Many more!
  • http://metrics.ceph.com 37 Copyright © 2014 by Inktank | Private and Confidential
  • THE PRODUCT
  • 39 INKTANK CEPH ENTERPRISE WHAT’S INSIDE? Ceph Object and Ceph Block Calamari Enterprise Plugins (2014) Support Services Copyright © 2014 by Inktank | Private and Confidential
  • Ceph Inktank Ceph Enterprise Open-Source Ceph ✔ ✔ Object Storage ✔ ✔ Block Storage ✔ ✔ File System ✔ Management API ✔ ✔ Management GUI ✔ Hyper-V Support Q3 2014 SNMP Support Q3 2014 24x7 Support ✔ Bug Prioritization ✔ FEATURE COMPARISON 41 Copyright © 2014 by Inktank | Private and Confidential
  • ROADMAP INKTANK CEPH ENTERPRISE 42 Copyright © 2014 by Inktank | Private and Confidential April 2014 September 2014 2015
  • RELEASE SCHEDULE Copyright © 2014 by Inktank | Private and Confidential 43 2013 2014 2015 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2
  • Copyright © 2014 by Inktank | Private and Confidential QUESTIONS? 44
  • THANK YOU! Patrick McGarry Director, Community patrick@inktank.co m irc.oftc.net/ceph @scuttlemonkey @ceph