1. Building A Smarter Planet
“ INTRODUCTION TO BIG DATA AND HADOOP“
“ Avishek ghosh“
Presented By:
ACADEMY OF TECHNOLOGY,ADISAPTAGRAM

2. BIG DATA AND HADOOP
ECOSYSTEM

3. What is Big Data?
Big data-A growing torrent of data
1

4. $600 to buy a disk drive that can
store all of the world music
2

5. What Launch Big Data Era?
Data Torrent Computing Anytime,
Anywhere
Big Data Era3

6. Where Does Big Data Comes From?
Machines People Organizations
3 major sources of Big Data
4

7. Machine Generated Data-It’s Everywhere and there’s a Lot!
Big Plane -> Big Data?
5

8. More data = More safe
 Sensors
Temperature
Pressure
Malfunctions
 Real time problem Detection
6

9. Big Data Generated By People-The Unstructured Challenge
Text Heavy
Unstructured
>
7

10. Company Data Processed Daily
eBay 100Petabytes(PB)
Google 100PB
Facebook 30+PB
Twitter 100TeraBytes(TB)
Spotify 64 TB
 The Unstructured Data Challenge
8

11. Structure
9

12.  80%-90% of entire Data is Unstructured!
10

13. 11

14. Tools Data Skilled People
Value
12

15. Organization Generated Data-Structured But Often Siloed
Commercial
Transactions
Banking/Stock
Records
Credit
Cards
Government
Open Data
E-Commerce
Medical
Records
…..
13

16. Real-World Examples
16 Million
Shipments Per Day
40 Million
Tracking Records
UPS is estimated to have
16 PBs
Of data about its operations
14

17. Can You Guess How
much money UPS
Can Save by Reducing
Each Driver’s Route
by just 1 Mile?
50 Million
Dollars!
15

18. • How much Companies are spending on Big
Data?
 Benefits using Big Data
Efficient Operation Higher Sales
Improved Safety
Customer Satisfaction Better Profit Margins
Improved Product Placement

19. Characteristics Of Big Data-V’s Of Big Data
17

20. Getting Started-Why Hadoop?
The Hadoop Ecosystem is Great for Big Data
Major Goals
• Enable Scalability
• Optimized for a variety data types
• Facilitate Shared Environment
• Provide Value
• Handle Fault Tolerance
18

21. The Hadoop Ecosystem
Main Hadoop Components
MapReduce
YARN
HDFS
19

22. HDFS = foundation for Hadoop
Ecosystem
What is HDFS?
Up to 200
petabytes,
1 billion files and
blocks!
20

24. 22

26. QUESTIONS?
24

27. SOURCES:-
• University Of California , San Diego(Super Computer)
• http://www.cloudera.com/
• http://www.ibm.com/big-data/us/en/
25

28. ACKNOWLEDGEMENTS:-
I would like to thank Prof. Prasenjit Das for her cordial support and
encouragement which was one of the key resources behind this presentation. And
also thanks to all faculty of CSE for your support too.
26