×
  • Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
 

Hadoop Summit 2012 | Optimizing MapReduce Job Performance

by on Jun 18, 2012

  • 22,158 views

Optimizing MapReduce job performance is often seen as something of a black art. In order to maximize performance, developers need to understand the inner workings of the MapReduce execution framework ...

Optimizing MapReduce job performance is often seen as something of a black art. In order to maximize performance, developers need to understand the inner workings of the MapReduce execution framework and how they are affected by various configuration parameters and MR design patterns. The talk will illustrate the underlying mechanics of job and task execution, including the map side sort/spill, the shuffle, and the reduce side merge, and then explain how different job configuration parameters and job design strategies affect the performance of these operations. Though the talk will cover internals, it will also provide practical tips, guidelines, and rules of thumb for better job performance. The talk is primarily targeted towards developers directly using the MapReduce API, though will also include some tips for users of higher level frameworks.

Statistics

Views

Total Views
22,158
Views on SlideShare
18,675
Embed Views
3,483

Actions

Likes
99
Downloads
0
Comments
4

19 Embeds 3,483

http://d.hatena.ne.jp 1576
http://www.cloudera.com 1313
http://www.technology-mania.com 269
http://www.scoop.it 197
http://nosqlbigdata.com 37
https://twitter.com 34
http://eventifier.co 22
http://beyondj2ee.wordpress.com 15
http://blog.cloudera.com 6
http://us-w1.rockmelt.com 3
http://www.redditmedia.com 2
http://webcache.googleusercontent.com 2
http://author.cloudera.solutionset.com 1
http://cloudera.com 1
http://www.onlydoo.com 1
http://localhost 1
http://www.moriwaki.net 1
http://twitter.com 1
https://www.google.com 1
More...

Accessibility

Categories

Upload Details

Uploaded via SlideShare as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel

14 of 4 previous next Post a comment

Post Comment
Edit your comment

Hadoop Summit 2012 | Optimizing MapReduce Job Performance Hadoop Summit 2012 | Optimizing MapReduce Job Performance Presentation Transcript