SlideShare is now on Android. 15 million presentations at your fingertips.  Get the app

×
  • Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
 

Putting Lipstick on Apache Pig at Netflix

by Manager, Data Platform Architecture at Netflix on Aug 15, 2013

  • 1,152 views

Slides from the Big Data Gurus meetup at Samsung R&D, August 14, 2013 ...

Slides from the Big Data Gurus meetup at Samsung R&D, August 14, 2013

This presentation covers the high level architecture of the Netflix Data Platform with a deep dive into the architecture, implementation, use cases, and future of Lipstick (https://github.com/Netflix/Lipstick) - our open source tool for graphically analyzing and monitoring the execution of Apache Pig scripts.

Netflix uses Apache Pig to express many complex data manipulation and analytics workflows. While Pig provides a great level of abstraction between MapReduce and data flow logic, once scripts reach a sufficient level of complexity, it becomes very difficult to understand how data is being transformed and manipulated across MapReduce jobs. To address this problem, we created (and open sourced) a tool named Lipstick that visualizes and monitors the progress and performance of Pig scripts.

Statistics

Views

Total Views
1,152
Views on SlideShare
1,143
Embed Views
9

Actions

Likes
5
Downloads
1
Comments
1

1 Embed 9

https://twitter.com 9

Accessibility

Categories

Upload Details

Uploaded via SlideShare as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel

11 of 1 previous next

  • sujee sujee good talk Jeff!
    meetup page : http://www.meetup.com/BigDataGurus/
    (Founder / Organizer, Big Data Guru meetup)
    8 months ago
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Putting Lipstick on Apache Pig at Netflix Putting Lipstick on Apache Pig at Netflix Presentation Transcript