Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

HFOF – FileSizeDatePartitioner  1 Low Latency “OLAP” with HBase - HBaseCon 2012

32,648 views

Published on

HFOF – FileSizeDatePartitioner  1 partition(reduce) / day for initial import  Uneven reduce (partitions) due to data growth over time  Reduce k: 2010-12-04 = 500MB  Reduce n: 2012-05-22 = 5GB => slow and will result in a 5GB region  Balance reduce buckets based on input file sizes and the reduce key  Generate sub-partitions based on predefined size (e.g. 1GB)© 2012 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 17

Published in: Technology, Business
  • Be the first to comment

×