Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Installing HortonWork's Hadoop on AWS EC2

3,808 views

Published on

This is the slides used in the Youtube Video "Installing Hortonwork's Hadoop on AWS EC2" -

  • Be the first to comment

Installing HortonWork's Hadoop on AWS EC2

  1. 1. Installing Hortonwork’s Hadoop on AWS BY Rohit Ghatol Director of Engineering @ Synerzip http://www.linkedin.com/in/rohitghatol @rohitghatol http://rohitghatol.com
  2. 2. Software Stack
  3. 3. EC2 Hadoop Hadoop Hadoop Hadoop Hadoop Hadoop Controls & Monitors Hadoop Services • HDFS • YARN • Hbase • Hive • Pig • Sqoop • Oozie • Zookeeper • Nagios • Ganglia Ambari Apache Ambari
  4. 4. Step 1 – Create Base AMI Community Red hat AMI Base AMI 6
  5. 5. Step 2 – Password Less SSH Access Laptop accessing EC2 Instance EC2 Instance accessing other Download SSH PEM Key EC2 Instances Access Using SSH EC2 (Ambari Server) Upload PEM Key EC2 EC2 EC2 EC2 AMI
  6. 6. Step 3 – Launch 6 Instances using Base Image EC2 EC2 EC2 EC2 AMI EC2 EC2 EC2 Launc h 6 Note the Private DNS names of all these machines • ip-10-23-12-33 • ip-10-23-11-23 • ip-10-23-32-54 • ip-10-23-44-14 • ip-10-23-65-73 • ip-10-23-37-47
  7. 7. Step 4 – Install Ambari Server on EC2 Install Ambari Server EC2 Ambari Server Installs Ambari Agent EC2 EC2 EC2 Supply the earlier recorded private DNS to Ambari • ip-10-23-12-33 • ip-10-23-11-23 • ip-10-23-32-54 • ip-10-23-44-14 • ip-10-23-65-73 • ip-10-23-37-47 Supply list of private DNS EC2 EC2 EC2 EC2 EC2 EC2
  8. 8. Step 5 – Install X service on Y machine EC2 EC2 EC2 EC2 EC2 EC2 EC2 Installs services Hadoop Services • HDFS • YARN • Hbase • Hive • Pig • Sqoop • Oozie • Zookeeper • Nagios • Ganglia EC2 with Ambari
  9. 9. Step 6 – Launch Ambari Web Console http://<<ambari-server>>:8080

×