×
  • Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
 

Hadoop Summit 2012 | Optimizing MapReduce Job Performance

by on Jun 18, 2012

  • 21,878 views

Optimizing MapReduce job performance is often seen as something of a black art. In order to maximize performance, developers need to understand the inner workings of the MapReduce execution framework ...

Optimizing MapReduce job performance is often seen as something of a black art. In order to maximize performance, developers need to understand the inner workings of the MapReduce execution framework and how they are affected by various configuration parameters and MR design patterns. The talk will illustrate the underlying mechanics of job and task execution, including the map side sort/spill, the shuffle, and the reduce side merge, and then explain how different job configuration parameters and job design strategies affect the performance of these operations. Though the talk will cover internals, it will also provide practical tips, guidelines, and rules of thumb for better job performance. The talk is primarily targeted towards developers directly using the MapReduce API, though will also include some tips for users of higher level frameworks.

Statistics

Views

Total Views
21,878
Views on SlideShare
18,420
Embed Views
3,458

Actions

Likes
99
Downloads
0
Comments
4

19 Embeds 3,458

http://d.hatena.ne.jp 1559
http://www.cloudera.com 1307
http://www.technology-mania.com 269
http://www.scoop.it 195
http://nosqlbigdata.com 37
https://twitter.com 34
http://eventifier.co 22
http://beyondj2ee.wordpress.com 15
http://blog.cloudera.com 6
http://us-w1.rockmelt.com 3
http://www.redditmedia.com 2
http://webcache.googleusercontent.com 2
http://author.cloudera.solutionset.com 1
http://cloudera.com 1
http://www.onlydoo.com 1
http://localhost 1
http://www.moriwaki.net 1
http://twitter.com 1
https://www.google.com 1
More...

Accessibility

Categories

Upload Details

Uploaded via SlideShare as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel

14 of 4 previous next Post a comment

Post Comment
Edit your comment

Hadoop Summit 2012 | Optimizing MapReduce Job Performance Hadoop Summit 2012 | Optimizing MapReduce Job Performance Presentation Transcript