Downloaded 15 times
![Number_Guessing_Game_Dsbsbssbzboc[1].pptx](https://cdn.slidesharecdn.com/ss_thumbnails/numberguessinggamedoc1-251206215042-a076fc05-thumbnail.jpg?width=640&height=640&fit=bounds)
HBaseConAsia2018 Track3-5: HBase Practice at Lianjia
- 1. hosted by Hbase PracticeAt ke.com Guoxian Zhao
- 2. hosted by Content 01 02 04 03 Architecture Evolution OlapScenario Monitor Scenario Data Mining Scenario 05 Reatime ETL Scenario 06 Hdic Scenario
- 3.
- 4. hosted by bigdata architecturefor ke Evolution
- 5.
- 6. hosted by Olap Scenario RequirementList Billion data set subsecond response times High concurrency sql interface
- 7.
- 8. hosted by Olap dataarchitecture map permission Olap Scenario monitor meta scheduler Hbase … hadoop, warehouse + compute … load Alluxio Sparksql Spark cluster presto queryengine adhoc build zk build nginx query query Offline kylin Kylin middleware query Meta manager Cube execute Statistics redis redisMetrics api product
- 9. hosted by Data ForKylin 800+cube、16+business 200T storage、160000 million data、1 cube 6000 million Query/day million， <500ms(95%), <1s (99%)
- 10. hosted by Data Product Metricsplatform • roll-up drill • multidimensional analysis • self-service configuration report • standard indices
- 11. hosted by Performance OptimizationsFor Hbase SSD-FIRST • Read remote ssds first Client H D D S S D H D D DN1 DN2 DN3 OR
- 12. hosted by Performance OptimizationsFor Hbase others HDFS short-circuit Data hedged ，multi thread read Test stale datanodes, avoid the slow datanode Shutdown balance Multiwal， Improve write performance
- 13.
- 14. hosted by Monitor senario HAProxy TeleGraf Taskmetrics Hadoopmetric s TSD TSD HBASE grafana
- 15.
- 16. hosted by Data MiningScenario04
- 17. hosted by Data MiningScenario
- 18. hosted by RealTime ETLScenario05
- 19. hosted by RealTime ETLScenario Subtitle Text RealTime DB ETL RealTime log ETL 3 4 HBASE fast write fast read change record bigdata storage
- 20.
- 21. hosted by Hdic Scenario SubtitleText 3 4
- 22.
- 23.