Zh Tw Introduction To H Base

Hbase (Data Model) (Architecture) Public 2009/5/13

HBase … • 不是關聯式(Relational)資料庫系統 – 表格(Table)只有一個主要索引 (primary index) 即 row key. – 不提供 join – 不提供 SQL語法。 • 提供Java函式庫, 與 REST與Thrift等介面。 • 提供 getRow(), Scan() 存取資料。 – getRow()可以取得一筆row range的資料，同時也可以指定版本 (timestamp)。 – Scan()可以取得整個表格的資料或是一組row range (設定start key, end  key) – 有限的單元性(Aatomicity)與交易 (transaction)功能. – 只有一種資料型態 (bytes) Copyright 2009 - Trend Micro Inc.

(Logical Data Model) • Table row key • Table schema column families . – column family columns – column (timestamp) – Column row columns – column family columns column – byte[] (Row, Family: Column, Timestamp)  Value Row Key Time Column Column (Family) Stamp (Family) “anchor:” “content:” com.cnn.www t9 “<html>…” “anchor:cnnsi.com” “CNN” t8 “anchor:cnnsi.com” “CNN” “anchor:my.lock.ca” “MyLook” t6 “<html>…” Classification Copyright 2009 - Trend Micro Inc.

(Physical Data Model) • HBase Table column family Row Key Time Column (Family) Stamp “content:” com.cnn.www t9 “<html>…” t6 “<html>…” Row Key Time Column (Family) Stamp “anchor:” com.cnn.www t9 “anchor:cnnsi. “CNN” com” t8 “anchor:cnnsi. “CNN” com” “MyLook” “anchor:my.loc k.ca” Classification Copyright 2009 - Trend Micro Inc.

– HBase Table Schema • Row key – type ( 2 ) timestamp – rows type timestamp scan () Table • BLOGENTRY COMMENT ” ” comment_title, comment_author, comment_text column families column Column comment timestamp column family column Classification Copyright 2009 - Trend Micro Inc.

HBase Region Row Keys Column Family • region “Content:” Region 1 00000 … – Region startKey 00001 … endKey … … • region 09999 … Region 2 10000 … HDFS … … region Hadoop … … 29999 … Classification Copyright 2009 - Trend Micro Inc.

HBase • Region Servers – request (write/read/scan) – heartbeat master – region servers throughput • HBase Master – region servers – regions region servers – region server – master single point of failure Classification Copyright 2009 - Trend Micro Inc.

HBase Client Interface • Java client – get(byte [] row, byte [] column, long timestamp, int versions); • Non-Java clients – Thrift server • Sample ruby, c++, & java (via thrift) clients – REST server • TableInput/OutputFormat for MapReduce • HBase Shell – ./bin/hbase shell YOUR_SCRIPT Classification Copyright 2009 - Trend Micro Inc.

• Google BigTable – http://labs.google.com/papers/bigtable.html • HBase – http://hadoop.apache.org/hbase/ • HBase wiki – http://wiki.apache.org/hadoop/Hbase Classification Copyright 2009 - Trend Micro Inc.

Zh Tw Introduction To H Base

0 comments

Notes on slide 1

Favorites, Groups & Events