This Hadoop tutorial provides a short introduction into working with big data in Hadoop via the Hortonworks Sandbox, HCatalog, Pig and Hive. Hi, We offer online and offline IT Trainings with Placements, Project Assistance in different platforms with real time Industry Consultants to provide quality training for all IT professionals, corporate clients and students etc. If you are interested in taking any of the training please contact us: QUONTRASOLUTIONS 204-226 Imperial Drive, Rayners Lane, Harrow HA27HH Email: info@quontrasolutions.co.uk Contact: +44(0)-20-3734-1498 / 1499 Web: http://www.quontrasolutions.co.uk

1. HADOOP INTRODUCTION
By
Quontra Solutions
www.quontrasolutions.co.uk
info@quontrasolutions.co.uk
Contact: +44(0)-20-3734-1498 / 1499

2. About Quontra Solutions
 Quontra Solutions is one of the leading players in the professional IT
Training Services.
 We believe the need of quality people in the IT Industry is growing and
there are always opportunities for the best trained.
 We have been providing the best training that suits the specific
requirements of the student and also the current market trends.
www.quontrasolutions.co.uk info@quontrasolutions.co.uk
info@quontrasolutions.co.uk
Contact: +44(0)-20-3734-1498 / 1499

3. OUR SERVICES
www.quontrasolutions.co.uk info@quontrasolutions.co.uk
We provide Classroom training as well as Online training so that one can take
the training at the comfort of their own home or office.
Online Training In-Class Training
Corporate IT-Training
IT-Consulting and staffing
info@quontrasolutions.co.uk
Contact: +44(0)-20-3734-1498 / 1499

4. What is Hadoop
Hadoop is a software framework for distributed processing of large
datasets across large clusters of computers.
 Large datasets  Terabytes or petabytes of data
 Large clusters  hundreds or thousands of nodes
www.quontrasolutions.co.uk info@quontrasolutions.co.uk
info@quontrasolutions.co.uk
Contact: +44(0)-20-3734-1498 / 1499

5. What is Hadoop (Cont’d)
Hadoop framework consists on two main layers
 Distributed file system (HDFS)
 Execution engine (Map Reduce)
www.quontrasolutions.co.uk info@quontrasolutions.co.uk
info@quontrasolutions.co.uk
Contact: +44(0)-20-3734-1498 / 1499

6. Hadoop Master/Slave Architecture
Hadoop is designed as a master-slave shared-nothing architecture
Master node (single node)
Many slave nodes
www.quontrasolutions.co.uk info@quontrasolutions.co.uk
info@quontrasolutions.co.uk
Contact: +44(0)-20-3734-1498 / 1499

7. Design Principles of Hadoop
Automatic parallelization & distribution
 Hidden from the end-user
Fault tolerance and automatic recovery
 Nodes/tasks will fail and will recover automatically
Clean and simple programming abstraction
 Users only provide two functions “map” and “reduce”
www.quontrasolutions.co.uk info@quontrasolutions.co.uk
info@quontrasolutions.co.uk
Contact: +44(0)-20-3734-1498 / 1499

8. Who Uses Map Reduce/Hadoop
 Google: Inventors of Map Reduce computing
paradigm
 Yahoo: Developing Hadoop open-source of Map
Reduce
 IBM, Microsoft, Oracle
 Facebook, Amazon, AOL, Net Flex
 Many others + universities and research labs
www.quontrasolutions.co.uk info@quontrasolutions.co.uk
info@quontrasolutions.co.uk
Contact: +44(0)-20-3734-1498 / 1499

9. Hadoop Distributed File System (HDFS)
Centralized name node
-
Many datanode (1000s)
1 2 3 4 5
File F
Blocks (64 MB)
www.quontrasolutions.co.uk info@quontrasolutions.co.uk
Contact: +44(0)-20-3734-1498 / 1499

10. Effective course List
 Microsoft Courses  Programming Courses
 Mobile Apps
 Networking Courses Testing Tools
 Digital Marketing
 Salesforce CRM
 Business Analyst
 Hadoop
www.quontrasolutions.co.uk
info@quontrasolutions.co.uk
Contact: +44(0)-20-3734-1498 / 1499

11. For More Hadoop In-depth Knowledge
QUONTRASOLUTIONS
204-226 Imperial Drive, Rayners Lane, Harrow HA27HH
Email: info@quontrasolutions.co.uk
Contact: +44(0)-20-3734-1498 / 1499
info@quontrasolutions.co.uk
Contact Us
www.quontrasolutions.co.uk
Contact: +44(0)-20-3734-1498 / 1499