State of HBase
Invasion of the Release Managers
Release Managers
• 0.94 Lars Hofhansl
• 0.96 Michael Stack
• 0.98 Andrew Purtell
• 1.0 Enis Söztutar
Outline
• State of each branch
• Q&A
0.94 Attributes
• Frequent bug fix releases (monthly)
• Still sees minor features
• Support for Hadoop 1, 2.0.x, Java 6 and 7
• Old (0.92) DNA, no protobufs, old AM
0.94 State
• Current release 0.94.19
• Will have a few more releases
• Many large production installs out there
• Super stable and battle hardened
• EOL? Downtime for upgrade to 0.96+
• The “Singularity”
o Released 10/19/2013
o 18 months in the making
o 2k issues fixed/1500 in 0.96 only
• Big Themes
o Stability
o Operability
o Scaling
https://www.flickr.com/photos/sysli/3026288256/sizes/q/in/photostream/
Attributes
• Currently 0.96.2
• Maybe 0.96.3, but EOL’ing => 0.98.x!
• In CDH 5.0.x (0.96.1.1)/HDP 2.0.x
State
0.98 Attributes
• Major themes
o Security
o Evolution
o Performance improvements
o API cleanups/deprecations on the road to HBase 1.0
• Monthly release schedule
• Support for Hadoop 1 and 2, but focus is on
Hadoop 2; Java 6 and 7
0.98 State
• Current release 0.98.2
• Field testing for 1.0
o Expect incremental additive feature evolution
o HFile V3 and dependent features experimental until
1.0
• Seamless upgrade from 0.96
• CDH 5.1.x (not out yet)/HDP 2.1.x
1.0 Attributes
• Stability of 0.96 / 0.98 line
• API cleanup
o Table / Connection
o Annotation of what is public
o Replication / Coprocessor APIs
• Semantic improvements
o Security / ACLs
o SeqId
1.0 Attributes
• Masters become region servers
o (Optional) only system tables are hosted in active
master
• Cell level ACL / HFile v3 completion
• Dist log replay enabled by default
• Perf improvements
1.0 State
• Planned a couple of 0.99.x releases
o A developer releases which won’t be supported
o Summer timeframe
o 0.99.x will become 1.0.0
• Use semantic versioning afterwards
o Major, minor, and patch releases
o More frequent major releases
Q&A

State of HBase: Meet the Release Managers

  • 1.
    State of HBase Invasionof the Release Managers
  • 2.
    Release Managers • 0.94Lars Hofhansl • 0.96 Michael Stack • 0.98 Andrew Purtell • 1.0 Enis Söztutar
  • 3.
    Outline • State ofeach branch • Q&A
  • 4.
    0.94 Attributes • Frequentbug fix releases (monthly) • Still sees minor features • Support for Hadoop 1, 2.0.x, Java 6 and 7 • Old (0.92) DNA, no protobufs, old AM
  • 5.
    0.94 State • Currentrelease 0.94.19 • Will have a few more releases • Many large production installs out there • Super stable and battle hardened • EOL? Downtime for upgrade to 0.96+
  • 6.
    • The “Singularity” oReleased 10/19/2013 o 18 months in the making o 2k issues fixed/1500 in 0.96 only • Big Themes o Stability o Operability o Scaling https://www.flickr.com/photos/sysli/3026288256/sizes/q/in/photostream/ Attributes
  • 7.
    • Currently 0.96.2 •Maybe 0.96.3, but EOL’ing => 0.98.x! • In CDH 5.0.x (0.96.1.1)/HDP 2.0.x State
  • 8.
    0.98 Attributes • Majorthemes o Security o Evolution o Performance improvements o API cleanups/deprecations on the road to HBase 1.0 • Monthly release schedule • Support for Hadoop 1 and 2, but focus is on Hadoop 2; Java 6 and 7
  • 9.
    0.98 State • Currentrelease 0.98.2 • Field testing for 1.0 o Expect incremental additive feature evolution o HFile V3 and dependent features experimental until 1.0 • Seamless upgrade from 0.96 • CDH 5.1.x (not out yet)/HDP 2.1.x
  • 10.
    1.0 Attributes • Stabilityof 0.96 / 0.98 line • API cleanup o Table / Connection o Annotation of what is public o Replication / Coprocessor APIs • Semantic improvements o Security / ACLs o SeqId
  • 11.
    1.0 Attributes • Mastersbecome region servers o (Optional) only system tables are hosted in active master • Cell level ACL / HFile v3 completion • Dist log replay enabled by default • Perf improvements
  • 12.
    1.0 State • Planneda couple of 0.99.x releases o A developer releases which won’t be supported o Summer timeframe o 0.99.x will become 1.0.0 • Use semantic versioning afterwards o Major, minor, and patch releases o More frequent major releases
  • 13.

Editor's Notes

  • #3 Current live branches, 0.90, 0.92 are EOL’d.
  • #7 MTTR, protobufs everywhere, integration test suit, metrics revamp,
  • #8 Suspect not wide deploy; folks going to 0.98
  • #14 + Where do you see HBase being in a year?