The document contains screenshots and descriptions of the setup and configuration of a Hadoop cluster. It includes images showing the cluster with different numbers of live and dead nodes, replication settings across nodes, and outputs of commands like fsck and job execution information. The screenshots demonstrate how to view cluster health metrics, manage nodes, and run MapReduce jobs on the Hadoop cluster.

1. 4/8/2015 ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS
http://kalyanhadooptraining.blogspot.in/2015/04/orienit-hadoop-practical-cluster-setup.html 1/22
[http://2.bp.blogspot.com/­
V805IaKnxFA/VSUVV0YOiZI/AAAAAAAAAaA/4NkgwkyN65E/s1600/orienit­
logo.png]
`
Cluster with 24 Live Nodes
[http://3.bp.blogspot.com/­
X_ADY7MxKSE/VSUVLBODOEI/AAAAAAAAAXc/u7zfg2uNjZ0/s1600/After_removing_2_DN_FROM_Cluster.png]
Cluster with 14 Live Nodes
ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS

2. 4/8/2015 ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS
http://kalyanhadooptraining.blogspot.in/2015/04/orienit-hadoop-practical-cluster-setup.html 2/22
[http://1.bp.blogspot.com/­LuHE7UX3bXM/VSUVM­temKI/AAAAAAAAAYA/NnFgzfpJ8ms/s1600/Custer_Summary3.png]
Cluster with 24 Live Nodes, 2 Dead Nodes
[http://3.bp.blogspot.com/­
X_ADY7MxKSE/VSUVLBODOEI/AAAAAAAAAXc/u7zfg2uNjZ0/s1600/After_removing_2_DN_FROM_Cluster.png]
Cluster with 13 Live Nodes, 1 Dead Node, 1 Decommission
Node

3. 4/8/2015 ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS
http://kalyanhadooptraining.blogspot.in/2015/04/orienit-hadoop-practical-cluster-setup.html 3/22
[http://3.bp.blogspot.com/­J5_hi6ZyqgQ/VSUVLCKtgOI/AAAAAAAAAXY/qSeRwDiGPdM/s1600/Change_decommission.png]
Cluster with 15 Live Nodes, 2 Decommission Nodes
[http://2.bp.blogspot.com/­lnDgCQnRMSs/VSUVPPD6MgI/AAAAAAAAAYQ/9lwHL6lLUzY/s1600/Decommissioning_Info.png]
Cluster with 9 Live Nodes, 5 Dead Nodes

4. 4/8/2015 ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS
http://kalyanhadooptraining.blogspot.in/2015/04/orienit-hadoop-practical-cluster-setup.html 4/22
[http://4.bp.blogspot.com/­nkBzupGETTE/VSUVMqMXbOI/AAAAAAAAAXo/LiKwnYOzjyY/s1600/Custer_Summary1.png]
Cluster with 24 Live Nodes information
[http://2.bp.blogspot.com/­Oi2RNqKnyog/VSUVRAYu87I/AAAAAAAAAY0/2GYSRECmGUM/s1600/List_of_livenodes2.png]
Cluster with 14 Live Nodes information

5. 4/8/2015 ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS
http://kalyanhadooptraining.blogspot.in/2015/04/orienit-hadoop-practical-cluster-setup.html 5/22
[http://1.bp.blogspot.com/­TTS_4ZWIlDg/VSUVQjvGzNI/AAAAAAAAAYo/_mDai_9r_bw/s1600/List_of_livenodes1.png]
Cluster with 9 Live Nodes information
[http://1.bp.blogspot.com/­SozgqYx3vFM/VSUVQL9jA2I/AAAAAAAAAYk/XagYnb7D45M/s1600/List_of_livenodes.png]
Cluster with 5 Dead Nodes information

6. 4/8/2015 ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS
http://kalyanhadooptraining.blogspot.in/2015/04/orienit-hadoop-practical-cluster-setup.html 6/22
[http://1.bp.blogspot.com/­R7dX1USXZ6g/VSUVOF43jXI/AAAAAAAAAYE/nqwY8zzdHLk/s1600/Deadnodes.png]
Cluster with 2 Dead Nodes information
[http://3.bp.blogspot.com/­pYeoxJ8M_aQ/VSUVNcae­KI/AAAAAAAAAX4/yuTd85Qq6q8/s1600/Dead_Nodes.png]
Cluster with 0 Decommission Nodes information

7. 4/8/2015 ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS
http://kalyanhadooptraining.blogspot.in/2015/04/orienit-hadoop-practical-cluster-setup.html 7/22
[http://1.bp.blogspot.com/­bvXfwaNBjho/VSUVOzBVb0I/AAAAAAAAAYM/x9vBWd53f24/s1600/Decommission_Nodes.png]
Commission and Decommission properties in hdfs­site.xml
[http://4.bp.blogspot.com/­TfOqdLw5F6M/VSUVTdNImoI/AAAAAAAAAZc/1XeSw­kgukA/s1600/hdfs_site_cluster.png]
Number of Under­Replicated Blocks

8. 4/8/2015 ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS
http://kalyanhadooptraining.blogspot.in/2015/04/orienit-hadoop-practical-cluster-setup.html 8/22
[http://3.bp.blogspot.com/­e5Nv7k1na­
s/VSUVK7gAJEI/AAAAAAAAAXU/TF1pXSEMQYY/s1600/Before_increasing_no_of_nodes.png]
[http://3.bp.blogspot.com/­J5_hi6ZyqgQ/VSUVLCKtgOI/AAAAAAAAAXY/qSeRwDiGPdM/s1600/Change_decommission.png]

9. 4/8/2015 ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS
http://kalyanhadooptraining.blogspot.in/2015/04/orienit-hadoop-practical-cluster-setup.html 9/22
[http://3.bp.blogspot.com/­90Y8HQJy1C4/VSUVSyEa3HI/AAAAAAAAAZQ/ecp6jiPTtqM/s1600/Under_replication.png]
Different Java version issue in Cluster
[http://4.bp.blogspot.com/­753UT7thVGk/VSUVL9ymbZI/AAAAAAAAAXg/v1Ftz6NNXns/s1600/ClusterError.png]
Distcp command job execution: transfer the data from one
cluster to other cluster

10. 4/8/2015 ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS
http://kalyanhadooptraining.blogspot.in/2015/04/orienit-hadoop-practical-cluster-setup.html 10/22
[http://3.bp.blogspot.com/­pZR6WxBeExA/VSUVPQ35xpI/AAAAAAAAAYU/OokGjj7gWT0/s1600/Distcp_comand.png]
File with 1 block and corresponding replication information
[http://1.bp.blogspot.com/­dZCwvNEzxWA/VSUVXWO8xaI/AAAAAAAAAag/KBye7VGL­Y4/s1600/replica_nodes1.png]

11. 4/8/2015 ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS
http://kalyanhadooptraining.blogspot.in/2015/04/orienit-hadoop-practical-cluster-setup.html 11/22
[http://2.bp.blogspot.com/­ziPKKmJPj­g/VSUVYNgI0DI/AAAAAAAAAas/nFcTE8wee_M/s1600/replica_nodes3.png]
[http://1.bp.blogspot.com/­6­18gKK9zlI/VSUVYQ1pF­I/AAAAAAAAAaw/qV_1y9_Zrv4/s1600/replica_places.png]

12. 4/8/2015 ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS
http://kalyanhadooptraining.blogspot.in/2015/04/orienit-hadoop-practical-cluster-setup.html 12/22
[http://3.bp.blogspot.com/­dofDdhka79M/VSUVYsska1I/AAAAAAAAAa0/Lx1J3Lqx1wg/s1600/replica_places_1.png]
File with 3 blocks and corresponding replication information
[http://2.bp.blogspot.com/­PYojigJ7Fn4/VSUVXhbca4I/AAAAAAAAAak/uRSJFT6­AUk/s1600/replica_nodes2.png]
hadoop fsck command information on NameNode machine

13. 4/8/2015 ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS
http://kalyanhadooptraining.blogspot.in/2015/04/orienit-hadoop-practical-cluster-setup.html 13/22
[http://2.bp.blogspot.com/­­Pn9rbpZmT4/VSUVP1hdrrI/AAAAAAAAAYg/p3mcsprAcFc/s1600/HealthCheck.png]
hadoop fsck command information on other
than NameNode machine
[http://3.bp.blogspot.com/­RBzMys1KKvE/VSUVr­
85OGI/AAAAAAAAAbw/GGgjukEIJ9I/s1600/Other_Than_NN_machine_issue.png]
Cluster with different replication factors in hadoop files

14. 4/8/2015 ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS
http://kalyanhadooptraining.blogspot.in/2015/04/orienit-hadoop-practical-cluster-setup.html 14/22
[http://2.bp.blogspot.com/­­ZjsC9ng_P8/VSUVZdNAr­I/AAAAAAAAAa8/E­H1nfpWoVw/s1600/replication_12.png]
[http://2.bp.blogspot.com/­H1bcvwnMKi8/VSUVZBAN7VI/AAAAAAAAAa4/g­Ae0dQ0pxg/s1600/replication.png]

15. 4/8/2015 ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS
http://kalyanhadooptraining.blogspot.in/2015/04/orienit-hadoop-practical-cluster-setup.html 15/22
[http://1.bp.blogspot.com/­lBg62YGDvOI/VSUVXPaNBTI/AAAAAAAAAac/FOSWXvwjM6Q/s1600/replica.png]
[http://1.bp.blogspot.com/­TTS_4ZWIlDg/VSUVQjvGzNI/AAAAAAAAAYo/_mDai_9r_bw/s1600/List_of_livenodes1.png]
[http://2.bp.blogspot.com/­LRztqwULAQE/VSUVT5RklTI/AAAAAAAAAZg/fvG3nu6STYI/s1600/hosts_replica_5.png]
Hadoop job mapper and reducer information

16. 4/8/2015 ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS
http://kalyanhadooptraining.blogspot.in/2015/04/orienit-hadoop-practical-cluster-setup.html 16/22
[http://1.bp.blogspot.com/­5Z8wD4Ak9gM/VSUVULPqidI/AAAAAAAAAZk/eXY0w8p1nN0/s1600/job_info1.png]
Cluster with 24 live nodes and corresponding map & reduce
task capacity information
[http://1.bp.blogspot.com/­gNJSfRHKlMA/VSUVR4oGWGI/AAAAAAAAAZE/­svzmwqV3Bs/s1600/MapRed%2BHome.png]
Cluster with 8 live nodes and corresponding map & reduce task
capacity information

17. 4/8/2015 ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS
http://kalyanhadooptraining.blogspot.in/2015/04/orienit-hadoop-practical-cluster-setup.html 17/22
ORIENIT HADOOP
PRACTICAL CLUSTER
SETUP SCREENSHOTS
2
[http://2.bp.blogspot.com/­JSQ­86kYPPQ/VSUVUQYZBmI/AAAAAAAAAZs/Ucv8KftSefU/s1600/jobtracker1.png]
Completed jobs information in a cluster
[http://3.bp.blogspot.com/­l8eymbwdrvM/VSUVTCcJkjI/AAAAAAAAAZU/qX8Xab6pwMY/s1600/completed_jobs.png]
Cluster with hadoop wordcount program execution information
Home Big Data Hadoop Hadoop Programming Hadoop Certification Map Reduce Hive Pig Hbase Mahout Unix Commands Unix Commands
Sidebar
…Kalyan Hadoop T search

18. 4/8/2015 ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS
http://kalyanhadooptraining.blogspot.in/2015/04/orienit-hadoop-practical-cluster-setup.html 18/22
ORIENIT HADOOP
TRAINING VIDEOS @
3
Hadoop SafeMode
command usage @
Kalyan Hadoop ORIENIT
0
Hadoop jar command
usage @ Kalyan Hadoop
ORIENIT
0
How to change the
hadoop properties @
Kalyan Hadoop ORIENIT
0
ORIENIT Big Data
Training @ Kalyan
0
Map Reduce Word Count
Program @ Kalyan
ORIENIT
0
Apache Hadoop 1.2.1
installation @ Kalyan
ORIENIT
0
Cloudera Certified
Administrator for Apache
Hadoop (CCAH) study
3
Training content 1
ubuntu installation using
virtualbox
1
Hadoop Monitoring Using
Ganglia
2
Introduction to Ganglia
on Ubuntu 14.04
2
HBase via Hive 2
Why are Facebook, Digg,
and Twitter so hard to
scale?
2
What the heck are you
actually using NoSQL for?
2
Facebook's New Realtime
Analytics System: HBase
to Process 20 Billion
2
Twitter’s Plan to Analyze
100 Billion Tweets
2
FaceBook Underlying
Technology of Messages
2
Why pig is called as data
flow language?
2
How to use blank as null
in Hive
2
How to Fix Hadoop for
non-Unix platform
(Windows OS) ?
2
Code , Debug & Test
Apache Pig Scripts using
Eclipse on Windows
2
Hadoop MapReduce -- A
Java vs Pig Example
2
Apache Pig -- Beginnings 2
Some tips on R data
frames
2
Hadoop/R Integration:
Streaming
2
R examples 2
Big Data Architecture
Best Practices
2
The Developer’s Guide to
Data Science
1
R: A first attempt at
linear regression
2
Hadoop and the mystery
of the version number
2
Elasticsearch in Map 2
[http://3.bp.blogspot.com/­i8BH0umi_0E/VSUVRS52C7I/AAAAAAAAAY8/iYtrGBPxR2I/s1600/Madred_job.png]
Cluster with hadoop wordcount program exectuion information
with 6 reducers
[http://2.bp.blogspot.com/­hpQw2sHHI9U/VSUVSfAKk­I/AAAAAAAAAZI/274oB7YR1rM/s1600/MapReduce_job_6_Reducers.png]
Cluster with hadoop map task information
http://kalyanhadooptraining.blogspot.in/. Dynamic Views template. Powered by Blogger.

19. 4/8/2015 ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS
http://kalyanhadooptraining.blogspot.in/2015/04/orienit-hadoop-practical-cluster-setup.html 19/22
Reduce
Harpoon helps in facing
your data: HDFS is not a
data warehouse.
2
Hadoop in Practice 2
Scheduling Workflows
Using Oozie Coordinator
2
Hadoop Tutorials:
Ingesting XML in Hive
using XPath
2
Parquet – columnar
storage for Hadoop
2
Snappy compression with
Pig and native
MapReduce
2
Hadoop
java.lang.OutOfMemory…
Java heap space
2
Hadoop, Pig, Ruby,
Map/Reduce, on OSX via
Homebrew
2
Parse large XML files in
Ruby
2
Apache Hive – Getting
Started
3
Apache Hadoop
Streaming
2
Apache Sqoop Tutorials 2
Apache Pig Tutorials 2
Apache Oozie Installation 2
XML Data Processing
Using Talend Open Studio
2
Ganglia configuration for
a small Hadoop cluster
and some troubleshooting
1
Pivotal HD and
Greenplum Database
Integration
2
[http://3.bp.blogspot.com/­5rqtXykRZ8o/VSUVViPT0pI/AAAAAAAAAaI/NIglp3YFGl8/s1600/mapper_process.png]
Cluster with hadoop map task attempt information
[http://1.bp.blogspot.com/­­WnWU0m3kcg/VSUVVfxdC_I/AAAAAAAAAZ8/fS0a9WhxLWg/s1600/map_tasks.png]

20. 4/8/2015 ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS
http://kalyanhadooptraining.blogspot.in/2015/04/orienit-hadoop-practical-cluster-setup.html 20/22
[http://3.bp.blogspot.com/­xnW0bx­WSME/VSUVUyIUOdI/AAAAAAAAAZ0/_lHQ4yzKz5g/s1600/map_task_node2.png]
[http://3.bp.blogspot.com/­6iTQ_Ine6nI/VSUVUsbCslI/AAAAAAAAAZw/G7F1cnpqFYQ/s1600/map_task_node1.png]
Cluster with hadoop reduce task information

21. 4/8/2015 ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS
http://kalyanhadooptraining.blogspot.in/2015/04/orienit-hadoop-practical-cluster-setup.html 21/22
[http://3.bp.blogspot.com/­By16vmn4ENA/VSUVWQDGk3I/AAAAAAAAAaQ/Jcuhdp8rp9I/s1600/reduce_task.png]
Cluster with hadoop reduce task attempt information
[http://1.bp.blogspot.com/­0Dq5IGnAz5s/VSUVWq9T7lI/AAAAAAAAAaU/QXLiZ8bjkmI/s1600/reduce_task_node1.png]
Posted 6 minutes ago by Kalyan Hadoop
Labels: Administration, Hadoop, Installations
2 View comments

22. 4/8/2015 ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS
http://kalyanhadooptraining.blogspot.in/2015/04/orienit-hadoop-practical-cluster-setup.html 22/22
2 comments
Top comments
Kalyan Hadoop shared this via Google+ 5 minutes ago - Shared publicly
· 1 Reply
Kalyan Hadoop via Google+ 6 minutes ago - Shared publicly
ORIENIT HADOOP PRACTICAL CLUSTER SETUP SCREENSHOTS
` Cluster with 24 Live Nodes Cluster with 14 Live Nodes Cluster with 24 Live Nodes, 2 Dead
Nodes Cluster with 13 Live Nodes, 1 Dead Node, 1 Decommission Node Cluster with 15 Live Nodes, 2
Decommission Nodes Cluster with 9 Live No...​
·
1 Reply
Add a comment as Kalyan Hadoop