Ceph Status && Community Update
Ceph Day Berlin 2015
COMMUNITY
DEV
 Hammer
 Modules
 Orchestration / Deployment
 Release Cycle
QUESTIONS
AGENDA
2
COMMUNITY
 Focused on being non-disruptive
 RHEL / Fedora / CentOS coverage
 Maintaining Ubuntu / SUSE coverage
 Co-Existing with Gluster
 Bi-directional learning is fun!
LIVING IN A POST-ACQUISITION
WORLD
4
CEPH DAYS
 You’re here!
 Turning up the heat
 100% Community-focused
 Upcoming
 Beijing
 Bay Area
 Los Angeles
 Chicago
 Autstin
 Melbourne
5
 Hosted by Intel in Hillsboro, OR
 10-13 Aug
 <25 people
 Real work!
 Performance (Mark Nelson)
 RBD focus
 RGW features and integration
 Spread the word!
 Email pmcgarry@redhat.com
Copyright © 2013 by Inktank | Private and Confidential
Ceph Hackathon
6
METRICS
7
 Bitergia Platform
 New Quarterly View
 Community-driven
 Good growth
 Code/Tracker/IRC/Lists
 Continuing to evolve
USER COMMITTEE
8
 Started after Dumpling
 Current chair: Eric Mourgaya
 Periodic meetings to discuss community matters
 Most recently:
 Release cadence
 Contributor credits
 Meetups
 RADOS Gateway use cases
 Discuss upcoming work
 First steps towards broader governance
Google Summer of Code
9
 Ceph project’s second year
 6 slots, used 4
 Last year
 Wireshark
 Reliability Model
 Work published on Ceph wiki
 Outreachy too
 Get involved!
CentOS Storage SIG
10
 Creating a collection of packages
 http://wiki.centos.org/SpecialIntere
stGroup/Storage/Proposal
 Easier to deploy CentOS as a
storage node
 Early days
 Packages for Ceph & Gluster
 Get involved!
GOVERNANCE
11
We haven’t forgotten about you!
CEPH DEVELOPER SUMMIT
12
 Quarterly developer summit
 100% online (Blue Jeans / IRC)
 Infernalis summit just completed
 Videos on Ceph YouTube
channel
 Next up: “J”
DEVELOPMENT
HAMMER STATUS
14
 Released 13 Apr 2015
 Major Features:
 cephfs: journal scavenger repair tool (John Spray)
 crush: new and improved straw2 bucket type (Sage Weil,
Christina Anderson, Xiaoxi Chen)
 doc: improved guidance for CephFS early adopters (John
Spray)
 librbd: add per-image object map for improved performance
(Jason Dillaman)
 librbd: copy-on-read (Min Chen, Li Wang, Yunchuan Wen,
Cheng Cheng)
 librados: fadvise-style IO hints (Jianpeng Ma)
 mds: many many snapshot-related fixes (Yan, Zheng)
 mon: new ‘ceph osd df’ command (Mykola Golub)
 mon: new ‘ceph pg ls …’ command (Xinxin Shu)
 osd: improved performance for high-performance backends
 osd: improved recovery behavior (Samuel Just)
 osd: improved cache tier behavior with reads (Zhiqiang
Wang)
 rgw: S3-compatible bucket versioning support (Yehuda
Sadeh)
 rgw: large bucket index sharding (Guang Yang, Yehuda
Sadeh)
 RDMA “xio” messenger support (Matt Benjamin, Vu Pham)
CephFS
15
 Lots of hard work!
 Dogfooding
 Code
 Src/mds: 366 commits, 19,417 lines added/removed
 Src/client: 131 commits, 4289 lines
 Src/tools/cephfs: 41 commits, 4179 lines
 Ceph-qa-suite: 4842 added lines of FS-related python
 Tracker
 108 FS tickets resolved since Firefly (of which 97 were created
since Firefly)
 83 ticket currently open for FS, of which 35 were created since
Firefly
 31 feature tickets resolved
librados
16
 Many more deployments/apps using direct librados
 Native library for accessing RADOS
 Librados.so shared library
 C, C++, Python, Erlang, Haskell, PHP, Java (JNA)
 Direct data path to storage nodes
 Speaks native Ceph protocol with cluster
 Exposes
 Mutable objects
 Rich per-object API and data model
 Hides
 Data distribution, migration, replication, failures
 Making your intelligent nodes, intelligent-er!
 Allows you to dynamically extend objects in RADOS
 Examples
 MD5 hash
 Image thumbnail service
 Log post-processing
 Whatever you build!
 Uses LUA
 Ask Noah!
Copyright © 2013 by Inktank | Private and Confidential
Object Classes
17
DEPLOYMENT / ORCHESTRATION
18
 Ceph-deploy in a good place
 Chef / Puppet / Ansible / Salt / Juju
 Docker is the up-and-comer
 Ask Chris!
RELEASE CYCLE COMMS
19
 Increased communication requested (user committee)
 Alternating releases (ex: emperor vs firefly)
 Product vs upstream church and state
THANK YOU!
Patrick McGarry
Dir Ceph Community
pmcgarry@
redhat.com
@scuttlemonkey

Ceph Day Berlin: Community Update

  • 1.
    Ceph Status &&Community Update Ceph Day Berlin 2015
  • 2.
    COMMUNITY DEV  Hammer  Modules Orchestration / Deployment  Release Cycle QUESTIONS AGENDA 2
  • 3.
  • 4.
     Focused onbeing non-disruptive  RHEL / Fedora / CentOS coverage  Maintaining Ubuntu / SUSE coverage  Co-Existing with Gluster  Bi-directional learning is fun! LIVING IN A POST-ACQUISITION WORLD 4
  • 5.
    CEPH DAYS  You’rehere!  Turning up the heat  100% Community-focused  Upcoming  Beijing  Bay Area  Los Angeles  Chicago  Autstin  Melbourne 5
  • 6.
     Hosted byIntel in Hillsboro, OR  10-13 Aug  <25 people  Real work!  Performance (Mark Nelson)  RBD focus  RGW features and integration  Spread the word!  Email pmcgarry@redhat.com Copyright © 2013 by Inktank | Private and Confidential Ceph Hackathon 6
  • 7.
    METRICS 7  Bitergia Platform New Quarterly View  Community-driven  Good growth  Code/Tracker/IRC/Lists  Continuing to evolve
  • 8.
    USER COMMITTEE 8  Startedafter Dumpling  Current chair: Eric Mourgaya  Periodic meetings to discuss community matters  Most recently:  Release cadence  Contributor credits  Meetups  RADOS Gateway use cases  Discuss upcoming work  First steps towards broader governance
  • 9.
    Google Summer ofCode 9  Ceph project’s second year  6 slots, used 4  Last year  Wireshark  Reliability Model  Work published on Ceph wiki  Outreachy too  Get involved!
  • 10.
    CentOS Storage SIG 10 Creating a collection of packages  http://wiki.centos.org/SpecialIntere stGroup/Storage/Proposal  Easier to deploy CentOS as a storage node  Early days  Packages for Ceph & Gluster  Get involved!
  • 11.
  • 12.
    CEPH DEVELOPER SUMMIT 12 Quarterly developer summit  100% online (Blue Jeans / IRC)  Infernalis summit just completed  Videos on Ceph YouTube channel  Next up: “J”
  • 13.
  • 14.
    HAMMER STATUS 14  Released13 Apr 2015  Major Features:  cephfs: journal scavenger repair tool (John Spray)  crush: new and improved straw2 bucket type (Sage Weil, Christina Anderson, Xiaoxi Chen)  doc: improved guidance for CephFS early adopters (John Spray)  librbd: add per-image object map for improved performance (Jason Dillaman)  librbd: copy-on-read (Min Chen, Li Wang, Yunchuan Wen, Cheng Cheng)  librados: fadvise-style IO hints (Jianpeng Ma)  mds: many many snapshot-related fixes (Yan, Zheng)  mon: new ‘ceph osd df’ command (Mykola Golub)  mon: new ‘ceph pg ls …’ command (Xinxin Shu)  osd: improved performance for high-performance backends  osd: improved recovery behavior (Samuel Just)  osd: improved cache tier behavior with reads (Zhiqiang Wang)  rgw: S3-compatible bucket versioning support (Yehuda Sadeh)  rgw: large bucket index sharding (Guang Yang, Yehuda Sadeh)  RDMA “xio” messenger support (Matt Benjamin, Vu Pham)
  • 15.
    CephFS 15  Lots ofhard work!  Dogfooding  Code  Src/mds: 366 commits, 19,417 lines added/removed  Src/client: 131 commits, 4289 lines  Src/tools/cephfs: 41 commits, 4179 lines  Ceph-qa-suite: 4842 added lines of FS-related python  Tracker  108 FS tickets resolved since Firefly (of which 97 were created since Firefly)  83 ticket currently open for FS, of which 35 were created since Firefly  31 feature tickets resolved
  • 16.
    librados 16  Many moredeployments/apps using direct librados  Native library for accessing RADOS  Librados.so shared library  C, C++, Python, Erlang, Haskell, PHP, Java (JNA)  Direct data path to storage nodes  Speaks native Ceph protocol with cluster  Exposes  Mutable objects  Rich per-object API and data model  Hides  Data distribution, migration, replication, failures
  • 17.
     Making yourintelligent nodes, intelligent-er!  Allows you to dynamically extend objects in RADOS  Examples  MD5 hash  Image thumbnail service  Log post-processing  Whatever you build!  Uses LUA  Ask Noah! Copyright © 2013 by Inktank | Private and Confidential Object Classes 17
  • 18.
    DEPLOYMENT / ORCHESTRATION 18 Ceph-deploy in a good place  Chef / Puppet / Ansible / Salt / Juju  Docker is the up-and-comer  Ask Chris!
  • 19.
    RELEASE CYCLE COMMS 19 Increased communication requested (user committee)  Alternating releases (ex: emperor vs firefly)  Product vs upstream church and state
  • 20.
    THANK YOU! Patrick McGarry DirCeph Community pmcgarry@ redhat.com @scuttlemonkey

Editor's Notes

  • #9 Make it a horizontal timeline
  • #10 Make it a horizontal timeline