Advanced Hadoop Tuning and Optimization - Hadoop Consulting
•Download as PPT, PDF•
107 likes•23,432 views
Impetus provides expert consulting services around Hadoop implementations, including R&D, assessment, deployment (on private and public clouds), optimizations for enhanced static shared data implementations. This presentation speaks about Advanced Hadoop Tuning and Optimisation.
![Hadoop- The Good/Bad/Ugly ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Download the Whitepaper: Deriving Intelligence from Large Data Using Hadoop and Applying Analytics at http://bit.ly/cNCCGj](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Advanced Hadoop Tuning and Optimization - Hadoop Consulting
Similar to Advanced Hadoop Tuning and Optimization - Hadoop Consulting (20)
More from Impetus Technologies
More from Impetus Technologies (20)
Recently uploaded
Recently uploaded (20)
Advanced Hadoop Tuning and Optimization - Hadoop Consulting
- 1. Presented By: Sanjay Sharma Advanced Hadoop Tuning and Optimizations Download the Whitepaper: Deriving Intelligence from Large Data Using Hadoop and Applying Analytics at http://bit.ly/cNCCGj
- 13. Other hotspots
Editor's Notes
- e.g. a node has 8GB main memory + 8 core CPU + swap space Maximum memory required by a task ~ 500MB Memory required by Tasktracker, Datanode and other processes ~ (1 + 1 +1) = 3GB Maximum tasks that can be run = (8-3) GB/500MB = 10 Number of map or reduce task (out of the maximum tasks) can be decided on the basis of memory usage and computation complexities of the tasks. The memory available to each task (JVM) is controlled by mapred.child.java.opts property. The default is –Xmx200m (200 MB). Other JVM options can also be provided in this property.