Short Introduction on Hadoop. Presented at Inter Collegiate Competition.

1. Technical Presentation
on

2. What is ?
 “Hadoop” is a free, Java-based programming
framework that supports the processing of
large data sets in a distributed computing
environment. It is part of the Apache project
sponsored by the Apache Software
Foundation.

5. Other Notable
users
 New York Times
 Baidu
 eHarmony
 Rackspace

6. in the real world.
 Telecommunicatio
ns
 Data Warehousing
 Market Research
Forecasting
 Social Networking
 Natural
Language
Processing
(NLP)
 Image Video
Processing
 Academic
Research
…

7. ‘s History
 Inspired by Big Table and
MapReduce
papers circa. 2004.
 Created By Doug Cutting.
 Originally built to support distribution for Nutch
Search Engine.
 Named after a stuff elephant.

8. What is NOT ?
 It isn’t a relational database...
an online transaction processing
system...
a structured data store of any kind!

9. Components of :
Hadoop
Libraries
HDFS
YARN MapReduce

10. Why is important ?

11. Challenges of using
:
 There’s a widely acknowledged talent gap. (it
can be difficult for entry level programmers
who don’t have sufficient skills to be productive
with MapReduce)
 Data Security.
 Full fledged data management and
governance.

12. References:
 http://www.sas.com/en_us/insights/big-
data/hadoop.html
 http://searchcloudcomputing.techtarget.com/de
finition/Hadoop
 http://wiki.apache.org/hadoop/