This document discusses the features, key advantages, and versions of Hadoop. Hadoop is an open-source framework that allows for the distributed processing of large data sets across clusters of computers. It offers tooling, code generation, modeling, and scheduling features that help developers build and run big data applications efficiently. Some key advantages of Hadoop include its scalability, cost effectiveness, flexibility to handle various data types, fast processing, and resilience to failures. The document outlines the differences between Hadoop versions 1.0 and 2.0, with 2.0 offering enhanced flexibility and support for various data processing engines beyond just MapReduce.

1. Hadoop
Features,Key
Advantages,Versions
BY,
J.G.Rohini,
II-M.Sc.,Computer Science.

2. Features

3. 1. Tooling :
 Developers can create, design, and deploy big
data services on any platform or development
environment as per their choice.

4. 2. Code generation :
 Hadoop big data suite, there is no need of
writing, debugging, analyzing, and optimizing
MapReduce code
 the complete code is auto generated.

5. 3. Modeling :
 Every Hadoop distribution provides the
infrastructure to integrate Hadoop clusters.
 developers have to make complex codes to
develop MapReduce program.
 They can write such codes in simple Java, or
even can use optimized languages, such as
PigLatin, HQL,etc.

6. 4. Scheduling :
 Big Data jobs execution needs to be monitored
and scheduled.
 Instead of writing jobs for scheduling, developers
can take help of big data suite to define and
handle the execution tasks in most efficient way.

7. 5. Integration :
 Hadoop- it wants to integrate data from all types
of products and technologies.
 Along with files and SQL databases, developers
wants to integrate data from NoSQL databases,
social media, B2B products, etc.

8. Key Advantages
There are many advantages associated with Hadoop.
In this presentation we have came up with some
major advantages of Hadoop.

9. Scalable:
 Hadoop is highly scalable.
 it can store and distribute very large data sets
across hundreds of inexpensive servers.

10. Cost effective:
 Owing to its scale-out architecture
 Hadoop offers a cost effective storage solution
and processing

11. Flexible:
 Ability to work with all kind of data: structured,
semi-structured and unstructured.
 it can be used for a wide variety of purposes,
such as log processing, recommendation
systems,data warehousing ,data mining and more.

12. Fast:
 the process is extremely fast in compared to other
conventional systems owing to the ”move code to
data” paradigm.

13. Resilient to failure:
 Hadoop is fault tolerance.
 It practices replication of data diligently.
 ensuring that in the event of a node failure.

14. Versions of Hadoop

15. There are two version of Hadoop available:
1.Hadoop 1.0
2.Hadoop 2.0

16. Hadoop 1.0
It has two main parts:
1.Data storage framework
2.Data processing framework
1.Data storage framework:
 It is a general –purpose filesystem called
Hadoop Distributed File System.
 HDFS is schema-less.
 It stores data files can be in just about any
format.

17. 2.Data processing framework:
 Is a simple functional programming model.
 It essentially uses two functions:
1.MAP
2.REDUCE
1.The “Mapers” take set of key-value pairs and
generate intermediate data.
2.The“Reducers” then act on this input to
produce the output data.

18. Hadoop 1.0
MapReduce
(Cluster Resource Manager
And Data Processing)
HDFS
(Redundant , reliable
storage)

19. Hadoop 2.0
 HDFS continues to be the data storage
framework.
 A new and separate resource management
framework called Yet Another Resource
Negotiator(YARN) has been added.
 Any application capable of dividing itself into
parallel tasks is supported by YARN.
 YARN coordinates the allocation of subtasks of the
submitted applications.

20.  Further enhancing the flexibility , scalability , and
efficiency of the applications.
 ApplicationMaster is able to run any application
and not just MapReduce.
 only supports batch processing but also real-time
processing.
 MapReduce is no longer the only data
processing option.

21. Hadoop 2.0
MapReduce
(Data Processing)
Others
(Data processing)
YARN
(cluster resource manager)
HDFS
(Redundant , reliable storage)