사내강의 2013 hadoop_eclipse플러그인

501 views

Published on

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
501
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
9
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

사내강의 2013 hadoop_eclipse플러그인

  1. 1. 오픈강의 Hadoop & Eclipse Plugin 류지만 ryu.jiman@gmail.com
  2. 2. ## PATH 설정 export PATH=$PATH:$HIVE_HOME/bin:$PATH:$PIG_HOME/bin:$PATH ####### hadoop export HADOOP_PREFIX=/Users/jimanryu/BigData/hadoop-2.0.5-alpha export HADOOP_COMMON_HOME=$HADOOP_PREFIX export HADOOP_HDFS_HOME=$HADOOP_PREFIX export HADOOP_MAPRED_HOME=$HADOOP_PREFIX export YARN_HOME=$HADOOP_PREFIX export HADOOP_CONF_HOME=$HADOOP_PREFIX/etc/hadoop export YARN_CONF_DIR=$HADOOP_PREFIX/etc/hadoop export HADOOP_HOME_WARN_SUPPRESS=true export HADOOP_OPTS="-Djava.security.krb5.realm=OX.AC.UK -Djava.security.krb5.kdc=kdc0.ox.ac.uk:kdc1.ox.ac.uk" export PATH=$PATH:$HADOOP_PREFIX/bin export PATH=$PATH:$HADOOP_PREFIX/sbin alias java6="export JAVA_HOME=`/usr/libexec/java_home -v1.6`" alias java7="export JAVA_HOME=`/usr/libexec/java_home -v1.7`" lcn-ryu:~ jimanryu$
  3. 3. lcn-ryu:~ jimanryu$ ssh-keygen -t rsa -P "jmryu" Generating public/private rsa key pair. Enter file in which to save the key (/Users/jimanryu/.ssh/id_rsa): Your identification has been saved in /Users/jimanryu/.ssh/id_rsa. Your public key has been saved in /Users/jimanryu/.ssh/id_rsa.pub. The key fingerprint is: d8:d4:43:24:7d:4d:e0:e9:57:05:f5:5e:16:89:c3:07 jimanryu@lcn-ryu.local The key's randomart image is: +--[ RSA 2048]----+ | .oo oE=++| | +...=.o+| | . o.o o =| | + o +.| | . S . . .| | . | | | | | | | +-----------------+ lcn-ryu:~ jimanryu$ cat $HOME/.ssh/id_rsa.pub >> $HOME/.ssh/authorized_keys lcn-ryu:~ jimanryu$ ssh localhost Identity added: /Users/jimanryu/.ssh/id_rsa (/Users/jimanryu/.ssh/id_rsa) Last login: Fri Jul 26 12:58:47 2013 lcn-ryu:~ jimanryu$
  4. 4. 1) 비밀번호 : jmryu ./sbin/hadoop-daemon.sh start namenode ./sbin/hadoop-daemon.sh start secondarynamenode ./sbin/hadoop-daemon.sh start datanode ./sbin/mr-jobhistory-daemon.sh start historyserver 2) 사이트접속 http://localhost:9000/ http://localhost:8088/cluster http://localhost:8042/node http://localhost:19888/jobhistory
  5. 5. File  New  Other Project. Select "Map/Reduce Project” 선택
  6. 6. Hadoop-0.20.2 버전 사용 hadoop-2.0.0-alpha은 안된다.

×