HDFS (Hadoop Distributed File System) is an open-source, distributed file system written in Java that is used to store large files across commodity hardware. HDFS distributes data across clusters of servers and provides fault tolerance by replicating data blocks on multiple data nodes. To ensure fault tolerance, HDFS utilizes mechanisms like heartbeat monitoring between the namenode and datanodes, rack awareness for replication, and redundant namenodes for high availability.

1. Fault Tolerance in HDFS
By: emad soltani nezhad
May 2018

2. Out Line:
 What is HDFS?
 Data distribution using HDFS
 Architecture HDFS
 Fault Tolerance in HDFS

3. What is HDFS?
 Hadoop Distributed File System
 Written in Java
 Open Source
 Swiss knife of the 21st century

4. Data distribution using HDFS
64 MGB 64 MGB 64 MGB
HDFS
Server1 Server2 Server3
Big Data

5. Data distribution using HDFS

6. Data distribution using HDFS
 Mont Blanc is the largest photograph in the world
 Panorama of 70,000 photos
 Image Size 45 TB
 Distribution and processed by Apache Hadoop
cluster with 20 nodes within 10 days
 May 2015

7. Data distribution using HDFS

8. Architecture HDFS

9. Fault Tolerance in HDFS
NameNode
DataNode
Heartbeat
Dead

10. Fault Tolerance in HDFS
Rack Awareness
Rack1-Cluster1 Rack2-Cluster2
Data Center1
Data Center2

11. Fault Tolerance in HDFS
Rack1-Cluster1
Rack2-Cluster2
Data Center-Larg Cluster
HDFS Federation
Rack3-Cluster3

12. Fault Tolerance in HDFS
Single Point of Failyre

13. Fault Tolerance in HDFS
NameNodeRedundantHeart Beat
ONE Cluster
Hi Availability

14. Fault Tolerance in HDFS

15. Fault Tolerance in HDFS