An Introduction to Apache Oozie
Upcoming SlideShare
Loading in...5
×
 

An Introduction to Apache Oozie

on

  • 1,660 views

An Introduction to Apache Oozie, what is it and what is it used

An Introduction to Apache Oozie, what is it and what is it used
for ? How is it used with Hadoop ?

Statistics

Views

Total Views
1,660
Views on SlideShare
1,660
Embed Views
0

Actions

Likes
1
Downloads
40
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as OpenOffice

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

An Introduction to Apache Oozie An Introduction to Apache Oozie Presentation Transcript

  • Apache Oozie ● What is it ? ● Why use it ? ● Architecture ● Examples www.semtech-solutions.co.nz info@semtech-solutions.co.nz
  • Oozie – What is it ? ● Work flow scheduler for Hadoop ● Manages Hadoop Jobs ● Integrated with many Hadoop apps i.e. Pig ● Scaleable ● Schedule jobs ● A work flow is a collection of actions i.e. – map/reduce, pig, hfs ● A work flow is – Arranged as a DAG ( direct acyclic graph ) – Graph stored as hPDL ( XML process definition ) www.semtech-solutions.co.nz info@semtech-solutions.co.nz
  • Oozie – Why use it ? ● It is designed for Hadoop ● It is open source ● It is designed for big data ● It allows you to design task work flow ● It allows you to interact with jobs – Stop, start, suspend, resume, rerun www.semtech-solutions.co.nz info@semtech-solutions.co.nz
  • Oozie – Architecture www.semtech-solutions.co.nz info@semtech-solutions.co.nz
  • Oozie – Architecture ● Install Oozie on edge node / not on cluster ● Oozie has client – Launches jobs and talks to server ● Ozzie has server – Controls jobs – Launches jobs ● Pipelines – Chained workflows – Work flow output – Is input to next www.semtech-solutions.co.nz info@semtech-solutions.co.nz
  • Oozie – Architecture www.semtech-solutions.co.nz info@semtech-solutions.co.nz
  • Contact Us ● Feel free to contact us at – www.semtech-solutions.co.nz – info@semtech-solutions.co.nz ● We offer IT project consultancy ● We are happy to hear about your problems ● You can just pay for those hours that you need ● To solve your problems