Prem Chand Mali of Mindfire Solutions gave a presentation on Apache Hadoop. The presentation introduced Hadoop, describing its history and key components including HDFS and MapReduce. HDFS is Hadoop's distributed file system using NameNodes and DataNodes to store data across commodity hardware. MapReduce provides a programming model for distributed processing of large datasets using a Map and Reduce workflow. The presentation provided overviews of HDFS and MapReduce to explain how Hadoop supports scalable, fault-tolerant distributed computing.

1. Introduction of Apache
Hadoop
Presenter: Prem Chand Mali, Mindfire Solutions
Date: 30/01/2014

2. About Me
SCJP/OCJP - Oracle Certified Java Programmer
MCP:70-480 - Specialist certification in HTML5
with JavaScript and CSS3 Exam
Skills : Java, Swings, Springs,
Hibernate, JavaFX, Jquery,
prototypeJS, ExtJS.
Connect Me :
https://www.facebook.com/prem.c.mali
http://www.linkedin.com/in/premmali
https://twitter.com/prem_mali
https://plus.google.com/106150245941317924019/about/p/pub
Contact Me :
premchandm@mindfiresolutions.com / prem.c.mali@gmail.com
mfsi_premchandm
Presenter: Prem Chand Mali, Mindfire Solutions

3. Agenda
History
What is Apache Hadoop
Why Apache Hadoop
HDFS
MapReduce
Q&A
Presenter: Prem Chand Mali, Mindfire Solutions

4. History
• Nutch Crawler based search
• GFS and Map Reduce paper published.
• Yahoo! hired Doug Cutting and given dedicated team.
Presenter: Prem Chand Mali, Mindfire Solutions

5. What is Apache Hadoop ?
• Apache Hadoop is an open-source software framework that supports dataintensive distributed applications licensed under the Apache v2 license. It supports
running applications on large clusters of commodity hardware.
• Hadoop are designed with a fundamental assumption that hardware failures (of
individual machines, or racks of machines) are common and thus should be
automatically handled in software by the framework.
• Apache Hadoop's MapReduce and HDFS components originally derived
respectively from Google's MapReduce and Google File System (GFS) papers.
Presenter: Prem Chand Mali, Mindfire Solutions

6. What is Apache Hadoop ?
• The Apache Hadoop framework is composed of the following modules :
– Hadoop Distributed File System (HDFS) - a distributed file-system that stores
data on the commodity machines, providing very high aggregate bandwidth
across the cluster.
– Hadoop MapReduce - a programming model for large scale data processing.
– Hadoop Common - contains libraries and utilities needed by other Hadoop
modules
– Hadoop YARN - a resource-management platform responsible for managing
compute resources in clusters and using them for scheduling of users'
applications.
Presenter: Prem Chand Mali, Mindfire Solutions

7. Why Apache Hadoop ?
• State of Data
– 90% of data in past three years.
– Type of data
• Unstructured
• Semi-structured
• Relational
– Relation world can handle GB of data.
• Distributed
• Scalable
• Flexible
• Fault tolerant
• Intelligent
Presenter: Prem Chand Mali, Mindfire Solutions

8. HDFS
• HDFS is the primary distributed storage used by Hadoop applications. It consist of
following two type of components.
– NameNode
– DataNode
• HDFS, is well suited for distributed storage and distributed processing using
commodity hardware.
• Hadoop supports shell-like commands to interact with HDFS directly.
Presenter: Prem Chand Mali, Mindfire Solutions

9. HDFS
Presenter: Prem Chand Mali, Mindfire Solutions

10. MapReduce
• MapReduce if combination of following three things.
– Map
– Shuffle
– Reduce
• It done it's job through Job Tracker and Task Tracker
Presenter: Prem Chand Mali, Mindfire Solutions

11. MapReduce
Presenter: Prem Chand Mali, Mindfire Solutions

12. MapReduce
Presenter: Prem Chand Mali, Mindfire Solutions

13. MapReduce
Presenter: Prem Chand Mali, Mindfire Solutions

14. Question and
Answer
Presenter: Prem Chand Mali, Mindfire Solutions

15. Thank you
Presenter: Prem Chand Mali, Mindfire Solutions

16. www.mindfiresolutions.com
https://www.facebook.com/MindfireSolutions
http://www.linkedin.com/company/mindfire-solutions
http://twitter.com/mindfires
Presenter: Prem Chand Mali, Mindfire Solutions