• Email
  • Like
  • Save
  • Private Content
  • Embed
 

Hadoop on ec2

by

  • 2,125 views

How to run your Hadoop clusters and HBase on EC2, without loosing the data :)

How to run your Hadoop clusters and HBase on EC2, without loosing the data :)

Accessibility

Categories

Upload Details

Uploaded via SlideShare as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate. If needed, use the feedback form to let us know more details.

Cancel

Statistics

Likes
1
Downloads
27
Comments
1
Embed Views
0
Views on SlideShare
2,125
Total Views
2,125

11 of 1 previous next

  • prashanthayyavu1 Prashanth Ayyavu at GE Hadoop web interfaces not available - in Amazon EC2 Hi, I created 2 Amazon EC2 micro instances for my hadoop practice. I am using mapreduce version 1. I used the following apache whirr config whirr.cluster-name=prashanth-hadoop whirr.instance-templates=1 hadoop-namenode+hadoop-jobtracker,1 hadoop-datanode+hadoop-tasktracker #hadoop mr1 whirr.hadoop.version=1.1.1 whirr.hadoop.tarball.url=http://www.us.apache.org/dist/hadoop/common/hadoop-1.1.1/hadoop-1.1.1-bin.tar.gz #java whirr.java.install-function=install_openjdk hadoop-env.JAVA_HOME=/usr/lib/jvm/java-6-openjdk whirr.provider=aws-ec2 whirr.identity=AXXXXXXXXXXXXXXXXXXXQ whirr.credential=7nnnnnnnnnnnnnnnnnnnnnnnn4 whirr.hardware-id=t1.micro whirr.private-key-file=/Users/prashanthayyavu/amazon_ec2_login/prashanth whirr.public-key-file=/Users/prashanthayyavu/amazon_ec2_login/prashanth.pub I am unable to see the masternode/datnode web interfaces. My security group looks like the following, Ports Protocol Source jclouds#prashanth-hadoop 1-65535 tcp sg-b3b2aadb 1-65535 udp sg-b3b2aadb -1 icmp sg-b3b2aadb 22 tcp 0.0.0.0/0 8020 tcp y.y.y.y/32 8021 tcp y.y.y.y/32 50030 tcp x.x.x.x/32 50070 tcp x.x.x.x/32 I logged into the amazon instance using SSH and tried curl. prashanthayyavu@c-c-c-c-c:~$ curl localhost:50030 curl: (7) couldn't connect to host prashanthayyavu@c-c-c-c-c:~$ curl localhost:50070 curl: (7) couldn't connect to host prashanthayyavu@c-c-c-c-c-:~$ Please help me guys. Thanks, Prashanth 2 months ago
    Are you sure you want to
Post Comment
Edit your comment

Hadoop on ec2 Hadoop on ec2 Presentation Transcript