Your SlideShare is downloading. ×
Usage case of HBase for real-time application
Usage case of HBase for real-time application
Usage case of HBase for real-time application
Usage case of HBase for real-time application
Usage case of HBase for real-time application
Usage case of HBase for real-time application
Usage case of HBase for real-time application
Usage case of HBase for real-time application
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Usage case of HBase for real-time application

17,546

Published on

..

..

Published in: Technology
0 Comments
5 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
17,546
On Slideshare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
72
Comments
0
Likes
5
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. A usage case of HBase for real-time application Edward J.Yoon
  • 2. udanax.org • URL shortener service • Provides HTTP, JSON and RESTful API • Used for some twitter clients and a number of web sites • Rows are increasing as almost 30 per second • Runs on 5 nodes HBase cluster
  • 3. Block Diagram Clients ... Apache Web Server Tomcat 1 Tomcat 2 ... HBase Hadoop HDFS
  • 4. HBase Table Schema row longURL: creator: clickLog: longURL: creator: clickLog:{referrer url} 3XqT <LONG_URL> <IP address> <IP address> ... longURL: 3xqS ... ... <LONG_URL> ... ...
  • 5. MR and Hama BSP • Information-Flow Analysis • Web Structure Mining • User propensity Analysis
  • 6. Hadoop Scheduler • FIFO: Queue-based scheduler • FSS: Fair share scheduler
  • 7. fair share scheduler • Group jobs into “pools” • Assign each pool a guaranteed minimum share • Divide excess capacity evenly between pools
  • 8. fair share scheduler

×