Apache Hama
● What is it ?
● What is it used for ?
● How does it work ?
● Architecture
www.semtech-solutions.co.nz info@se...
Hama – What is it ?
● A Distributed computing framework
● For massive scientific calculations
● For distributed computing
...
Hama – What is it used for ?
● large scale computations that
– exceed the abilities of Map reduce
● Machine learning
● Mat...
Hama – How does it work ?
● A series of super steps
● Each of which is
– Concurent computation on local data
– Point to po...
Hama – Architecture
Hama consists of BSP Master, GroomServers, ZooKeeper
www.semtech-solutions.co.nz info@semtech-solution...
Hama – Architecture
● Role of BSPMaster
– Maintain groom server statuses
– Controlling cluster super steps
– Maintaining j...
Hama – Architecture
● Role of GroomServer
– Performs BSP tasks
– Reports status to master
– Runs on a single HDFS data nod...
Hama – Architecture
● Role of ZooKeeper
– Manages barrier synchronisation of BSP Peers
www.semtech-solutions.co.nz info@se...
Contact Us
● Feel free to contact us at
– www.semtech-solutions.co.nz
– info@semtech-solutions.co.nz
● We offer IT project...
Contact Us
● Feel free to contact us at
– www.semtech-solutions.co.nz
– info@semtech-solutions.co.nz
● We offer IT project...
Upcoming SlideShare
Loading in …5
×

An Introduction to Apache Hama

898 views
706 views

Published on

An Introduction to Apache Hama, what is it ?
Why is it useful for scientific computations
on big data ?

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
898
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
41
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

An Introduction to Apache Hama

  1. 1. Apache Hama ● What is it ? ● What is it used for ? ● How does it work ? ● Architecture www.semtech-solutions.co.nz info@semtech-solutions.co.nz
  2. 2. Hama – What is it ? ● A Distributed computing framework ● For massive scientific calculations ● For distributed computing ● Uses Bulk Synchronous Parallel Computing ( BSP ) ● Written in Java ● Licensed via Apache ● Available for Hadoop greater than 1.0.x ● Requires Java 1.6.x or higher www.semtech-solutions.co.nz info@semtech-solutions.co.nz
  3. 3. Hama – What is it used for ? ● large scale computations that – exceed the abilities of Map reduce ● Machine learning ● Matrix ● Graph ● Network Algorithms www.semtech-solutions.co.nz info@semtech-solutions.co.nz
  4. 4. Hama – How does it work ? ● A series of super steps ● Each of which is – Concurent computation on local data – Point to point communication – Synchronise all processors ● Uses Hadoop RPC for communication www.semtech-solutions.co.nz info@semtech-solutions.co.nz
  5. 5. Hama – Architecture Hama consists of BSP Master, GroomServers, ZooKeeper www.semtech-solutions.co.nz info@semtech-solutions.co.nz
  6. 6. Hama – Architecture ● Role of BSPMaster – Maintain groom server statuses – Controlling cluster super steps – Maintaining job progress information – Scheduling Jobs – Assign tasks to groom servers – Fault control – Provide cluster control to users www.semtech-solutions.co.nz info@semtech-solutions.co.nz
  7. 7. Hama – Architecture ● Role of GroomServer – Performs BSP tasks – Reports status to master – Runs on a single HDFS data node – Starts with a BSP Peer instance www.semtech-solutions.co.nz info@semtech-solutions.co.nz
  8. 8. Hama – Architecture ● Role of ZooKeeper – Manages barrier synchronisation of BSP Peers www.semtech-solutions.co.nz info@semtech-solutions.co.nz
  9. 9. Contact Us ● Feel free to contact us at – www.semtech-solutions.co.nz – info@semtech-solutions.co.nz ● We offer IT project consultancy ● We are happy to hear about your problems ● You can just pay for those hours that you need ● To solve your problems
  10. 10. Contact Us ● Feel free to contact us at – www.semtech-solutions.co.nz – info@semtech-solutions.co.nz ● We offer IT project consultancy ● We are happy to hear about your problems ● You can just pay for those hours that you need ● To solve your problems

×