SlideShare is now on Android. 15 million presentations at your fingertips.  Get the app

×
  • Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
 

April 2013 HUG: Storm and Hadoop - Convergence of Big-Data and Low-Latency Processing

by on Apr 22, 2013

  • 2,158 views

At Yahoo!, Hadoop plays a central role in providing personalized experiences for our users and creating value for our advertisers. In this talk, we will discuss the convergence of low-latency ...

At Yahoo!, Hadoop plays a central role in providing personalized experiences for our users and creating value for our advertisers. In this talk, we will discuss the convergence of low-latency processing and Hadoop platform. Through a collection of use cases, we will explain how Yahoo! delivers personalized user experience through Hadoop and Storm. We have developed Storm-on-YARN to enable Storm streaming/micro-batch applications and Hadoop batch applications hosted on a single cluster. Storm applications could leverage YARN for resource management, and apply Hadoop style security to Hadoop datasets on HDFS and HBase. Yahoo! has recently released our Storm enhancement as open source.

Presenter(s):
Andy Feng, Distinguished Architect, Cloud Engineering Group, Yahoo!
Bobby Evans, Tech Yahoo!, Apache Hadoop PMC and Committer

Statistics

Views

Total Views
2,158
Views on SlideShare
2,143
Embed Views
15

Actions

Likes
6
Downloads
0
Comments
0

2 Embeds 15

https://twitter.com 12
http://www.linkedin.com 3

Accessibility

Categories

Upload Details

Uploaded via SlideShare as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
Post Comment
Edit your comment

April 2013 HUG: Storm and Hadoop - Convergence of Big-Data and Low-Latency Processing April 2013 HUG: Storm and Hadoop - Convergence of Big-Data and Low-Latency Processing Presentation Transcript