Ceph Day London Keynote Presentation - Ross Turk, Red Hat

1. CEPH DAY
London – October 22, 2014

2. WELCOME

3. CEPH DAYS SCHEDULE
Ceph Day New York
Ceph Day Santa Clara
Ceph Day London
Ceph Day Frankfurt
Ceph Day Boston
Ceph Day Paris
Ceph Day San Jose
Ceph Day New York #2
Ceph Day London #2
August 1, 2013
September 12, 2013
October 9, 2013
February 27, 2014
June 10, 2014
September 18, 2014
September 24, 2014
October 8, 2014
October 22, 2014

4. A SHOW OF HANDS
4

5. A SHOW OF HANDS
5

6. A SHOW OF HANDS
6

7. A SHOW OF HANDS
7

8. A SHOW OF HANDS
8
OBJECTS

9. A SHOW OF HANDS
9
OBJECTS BLOCKS

10. A SHOW OF HANDS
10
OBJECTS BLOCKS FILES

11. A SHOW OF HANDS
11
RHEL / CENTOS

12. A SHOW OF HANDS
12
RHEL / CENTOS UBUNTU / DEBIAN

13. A SHOW OF HANDS
13
RHEL / CENTOS UBUNTU / DEBIAN SUSE

14. MORNING AGENDA

15. AFTERNOON AGENDA #1

16. AFTERNOON AGENDA #2

17. SPONSORS

18. WELCOME TO CEPH DAY

19. CEPH ECOSYSTEM OVERVIEW
OCT 22 2014

20. Copyright © 2014 Red Hat, Inc. | Private and Confidential
AGENDA
20

21. THE STORY SO FAR

22. THE STORY SO FAR…

23. THE STORY SO FAR…

24. THE STORY SO FAR…

25. THE STORY SO FAR…

26. A STORAGE REVOLUTION
Copyright © 2014 Red Hat, Inc. | Private and Confidential
26

27. THE RED HAT OF STORAGE?
Copyright © 2014 Red Hat, Inc. | Private and Confidential
27

28. WHAT’S NEW

29. FIREFLY
29
 Released May 7, 2014
 Based on Ceph 0.80.x
 Includes:
 Cache tiering pools
 Erasure coded pools
 RGW user quotas

30. ERASURE CODING
Copyright © 2014 Red Hat, Inc. | Private and Confidential
30
CEPH STORAGE CLUSTER CEPH STORAGE CLUSTER
Full copies of stored objects
 Very high durability
 Quicker recovery
One copy plus parity
 Cost-effective durability
 Expensive recovery

31. CACHE TIERING
Read/Write Read/Write
Copyright © 2014 Red Hat, Inc. | Private and Confidential
31
CEPH STORAGE CLUSTER
CACHE TIERING
POOLS
 Separate hot and
cold data onto
different devices
 Use w/erasure
coded pools for a
blend of economy
and performance
 Can be used in
writeback mode

32. CACHE TIERING
Write Write Read Read
Copyright © 2014 Red Hat, Inc. | Private and Confidential
32
CEPH STORAGE CLUSTER
CACHE TIERING
POOLS
 Can also be used in
read-only mode,
where writes are
made directly to
backing pool

33. THE FUTURE

34. EXISTING USE CASES
CAPACITY PERFORMANCE
NEXT-GEN
TRADITIONAL
Copyright © 2014 Red Hat, Inc. | Private and Confidential
34

35. THEME 1: OPTIMIZE
CAPACITY PERFORMANCE
NEXT-GEN
TRADITIONAL
Copyright © 2014 Red Hat, Inc. | Private and Confidential
35

36. THEME 2: INTEGRATE
CAPACITY PERFORMANCE
NEXT-GEN
TRADITIONAL
Copyright © 2014 Red Hat, Inc. | Private and Confidential
36

37. THEME 3: SIMPLIFY
CAPACITY PERFORMANCE
NEXT-GEN
TRADITIONAL
Copyright © 2014 Red Hat, Inc. | Private and Confidential
37

38. TARGET USE CASES
CAPACITY PERFORMANCE
NEXT-GEN
TRADITIONAL
Copyright © 2014 Red Hat, Inc. | Private and Confidential
38

39. GIANT
39
 Tree frozen September 9
 0.85 dev release includes
 RDMA support groundwork
 Improved SSD performance
 Improvements to stand alone
civetweb-based RGW frontend
 New ‘osd blocked by’ command
 0.86 released 07 Oct (Giant RC)
 Low level OSD debugging tool
 Local repairable codes (LRC)
 Librados locking refactor
 MDS and mon improvements

40. RBD
40
 Client-side caching
 (Now enabled by default!)
 New option that makes cache write-through
until “flushed”
 Eucalyptus support
 https://mdshaonimran.wordpress.com/2
014/09/17/eucalyptus-block-storage-service-
with-ceph-rbd/

41. RGW
41
 Stand-alone civetweb front end
 Civetweb – embedded C/C++ web
server
 No need for Apache overhead,
dependencies, etc

42. CEPHFS
42
 Lots of activity!
 1/3 of core team assigned here
 A lot of outside commits
 Inktank / Red Hat team using CephFS
internally on QA infrastructure
 Sanding rough edges
 “Not Supported” vs “Not Ready”
 Feedback encouraged

43. ECOSYSTEM UPDATE

44. LIVING IN A POST-ACQUISITION
WORLD
 “Business as usual” for Inktank
and customers
 Increased support for RHEL,
Fedora, and CentOS
 Continued current level of
Ubuntu / SUSE support
 Ceph vs. Gluster
 (and other false dichotomies)
 Hiring and growing!
44

45. CEPH DEVELOPER SUMMIT
 Quarterly design summits to plan a future Ceph
version
 100% virtual format (provides equal
opportunity)
 Driven by the blueprint design process
Copyright © 2014 by Inktank | Private and Confidential
45
CDS Hammer
 October 28-29
 MEGABLUEPRIN
TS
CDS Giant
 ~60 participants
 EC, RDMA,
tiering
CDS Firefly
 ~50 participants
 EC, crypto,
striping

46.  Bitergia-hosted metrics platform
 Continues to evolve over time
 We benefit from improvements to their
core platform
 Current metrics
 Source code (github.com/ceph/ceph)
 Issues (tracker.ceph.com)
 IRC (#ceph-devel, #ceph)
 Mailing lists (ceph-devel, ceph-users)
 Coming soon
 Downloads (RPM, DEB, source
tarballs)
Copyright © 2014 by Inktank | Private and Confidential
METRICS
46

47. STRONG & GROWING
COMMUNITY
47
METRICS.CEPH.COM
Copyright © 2014 Red Hat, Inc. | Private and Confidential

48. GOOGLE SUMMER OF CODE
Copyright © 2014 by Inktank | Private and Confidential
48
Program Lifetime
 7500 students
 7000 mentors
 100 countries
 50M LOC
Ceph in 2014
 15 students
 7 proposals
 2 slots
 All on the
wiki!

49. Weekly Performance Standups!
 ~15 people in attendance
 http://pad.ceph.com/p/performance_weekly
Copyright © 2014 Red Hat, Inc. | Private and Confidential
49

50. THANK YOU!
Ross Turk
DIRECTOR, PRODUCT
MARKETING
ross@redhat.com
@rossturk