The document provides step-by-step instructions for installing Hadoop, Hive, and Derby on CentOS. It includes downloading and configuring the software, modifying configuration files, starting services, and provides URLs for accessing the interfaces. The author encourages visiting their site or following their Twitter for more tutorials.

1. visit me at http://jamesjara.com or follow me at http://twitter.com/jamesjara by ww
source:http://linux-costarica.blogspot.com/2012/02/installing-hadoophivederby-on-centos.html, http://linux-costarica.blogspot.com/2012/02/installing-
hadoophivederby-on-centos.html
More:visitmeathttp://jamesjara.comorfollowmeathttp://twitter.com/jamesjara
source:http://linux-costarica.blogspot.com/2012/02/installing-hadoophivederby-on-centos.html, http://linux-costarica.blogspot.com/2012/02/installing-
hadoophivederby-on-centos.html
More:visitmeathttp://jamesjara.comorfollowmeathttp://twitter.com/jamesjara
INSTALLING HADOOP,HIVE,DERBY ON CENTOS
Please subscribe to my site www.jamesjara.com to get more tutorials.
INSTALLING HADOOP IN centos 6
INSTALLING HIVE IN centos 6
INSTALLING DERBY IN centos 6
hadoop-0.20.203.0rc1
thisistheguidefortheinstallationofHadoopecosystem,
is very extended so please follow step by step
====INSTALLATION=====
1.Installingjava
 Âyum installsun-java6-jdk
2.Adding a dedicated user for hadoop
Thiswilladdtheuserhdoopuserandthegrouphdoopgrouptoyourlocalmachine.
   /usr/sbin/useradd hdoopuser
   groupadd hdoopgroup
   usermod -a -G hdoopgroup hdoopuser
3.ConfiguringSSH

2. visit me at http://jamesjara.com or follow me at http://twitter.com/jamesjara by ww
  su - hdoopuser      #login as hdoopuser
ÂÂ Â ssh-keygen -t rsa -P ""Â Â Â #generate key without password
  cat $HOME/.ssh/id_rsa.pub >> $HOME/.ssh/authorized_keys   #enable the new key
  chmod 0600 $HOME/.ssh/authorized_keys   #enable empty password
4.DisablingIPv6
   sed -i s/^(NETWORKINGs*=s*).*$/NETWORKING=NO/ /etc/sysconfig/network
5.Installation/Conf/startupofHadoop
   mkdir /hadoop
   chown -R hdoopuser /hadoop
   cd /hadoop/
   wget http://mirrors.abdicar.com/Apache-HTTP-Server//hadoop/common/stable/hadoop-0.20.203.0rc1.tar.gz
   tar -xvzf hadoop-0.20.203.0rc1.tar.gz
   ln -s /hadoop/hadoop-0.20.203.0rc1/ /hadoop/hadoop
   cd /hadoop/hadoop
ÂÂ Â#basicconfig
ÂÂ Â 1)
ÂÂ Âvimconf/core-site.xml
ÂÂ ÂÂÂ Â#Addthefollowinginsidethe<configuration>tag
ÂÂ Â Â Â Â <property>
ÂÂ ÂÂÂ ÂÂ <name>fs.default.name</name>
ÂÂ ÂÂÂ ÂÂ <value>hdfs://localhost:9000/</value>
ÂÂ Â Â Â Â </property>
ÂÂ Â Â Â Â <property>
ÂÂ ÂÂÂ Â<name>dfs.permissions</name>
ÂÂ ÂÂÂ Â<value>false</value>
ÂÂ Â Â Â Â </property>
ÂÂ Â 2)
ÂÂ Âvimconf/hdfs-site.xml
ÂÂ ÂÂÂ Â#Addthefollowinginsidethe<configuration>tag
ÂÂ Â Â Â Â <property>

3. visit me at http://jamesjara.com or follow me at http://twitter.com/jamesjara by ww
ÂÂ Â Â Â Â Â <name>dfs.name.dir</name>
ÂÂ Â Â Â Â Â <value>/hadoop/hdfs/name</value>
ÂÂ Â Â Â Â </property>
ÂÂ Â Â Â Â <property>
ÂÂ Â Â Â Â Â <name>dfs.data.dir</name>
ÂÂ Â Â Â Â Â <value>/hadoop/hdfs/data</value>
ÂÂ Â Â Â Â </property>
ÂÂ Â Â Â Â <property>
ÂÂ Â Â Â Â Â <name>dfs.replication</name>
ÂÂ Â Â Â Â Â <value>2</value>
ÂÂ Â Â Â Â </property>
ÂÂ Â 3)
ÂÂ Âvimconf/mapred-site.xml
ÂÂ ÂÂÂ Â#Addthefollowinginsidethe<configuration>tag
ÂÂ Â Â Â Â <property>
ÂÂ Â Â Â Â Â <name>mapred.job.tracker</name>
ÂÂ Â Â Â Â Â <value>localhost:9001</value>
ÂÂ Â Â Â Â </property>
ÂÂ Â 4)
ÂÂ Âvimconf/hadoop-env.sh
ÂÂ Â Â Â Â export JAVA_HOME=/opt/jre/
ÂÂ Â Â Â Â export HADOOP_OPTS=-Djava.net.preferIPv4Stack=true
ÂÂ Â 5)
ÂÂ Â Fomart nodes
ÂÂ Â Â Â Â su - hdoopuser
ÂÂ Â Â Â Â cd /hadoop/hadoop
ÂÂ Â Â Â Â bin/hadoop namenode -format
ÂÂ Â 6)Start hadoop
ÂÂ Â Â Â Â bin/start-all.sh
ÂÂ Â Â Â Â notes:Â HTTP CONSOLE OF HADOOP
ÂÂ Â Â Â Â Â Â Â http://localhost:50030/ for the jobtrackeR
ÂÂ Â Â Â Â Â Â Â http://localhost:50070/ for the namenode

4. visit me at http://jamesjara.com or follow me at http://twitter.com/jamesjara by ww
5.Installation/Conf/startupofHive/Derby
   cd /hadoop
ÂÂ Âwgethttp://mirrors.ucr.ac.cr/apache//hive/stable/hive-0.8.1-bin.tar.gz
   tar -xvzf hive-0.8.1-bin.tar.gz
   ln -s /hadoop/hive-0.8.1-bin/ /hadoop/hive
   export HADOOP_HOME=/hadoop/hadoop/
linux-costarica.blogspot.com   cd /hadoop/hive
ÂÂÂ Âmvconf/hive-default.xml.templateconf/hive-site.xml
   #test hive
ÂÂ Âbin/hive
      > show tables;
ÂÂ Â#installingderbymetadatastore
   cd /hadoop
   wget http://archive.apache.org/dist/db/derby/db-derby-10.4.2.0/db-derby-10.4.2.0-bin.tar.gz
   tar -xzf db-derby-10.4.2.0-bin.tar.gz
   ln -s db-derby-10.4.2.0-bin derby
   mkdir derby/data
   export DERBY_INSTALL=/hadoop/derby/
   export DERBY_HOME=/hadoop/derby/
   export HADOOP=/hadoop/hadoop/bin/hadoop Â
ÂÂ Â vim /hadoop/hadoop/bin/start-dfs.sh
ÂÂ Â #add to the file start-dfs.sh the next 2 lines
ÂÂ Â Â Â Â cd /hadoop/derby/data
ÂÂ Â Â Â Â nohup /hadoop/derby/bin/startNetworkServer -h 0.0.0.0 &
ÂÂ Âvim/hadoop/hadoop/bin/start-all.sh
ÂÂ Â#addtothefilestart-all.shthenext2lines
ÂÂ Â Â Â Â cd /hadoop/derby/data
ÂÂ Â Â Â Â nohup /hadoop/derby/bin/startNetworkServer -h 0.0.0.0 &
   #HIVE CONF
ÂÂ Âvim/hadoop/hive/conf/hive-site.xmlÂÂ Â#installingwebpanelforhive,searchandreplace

5. visit me at http://jamesjara.com or follow me at http://twitter.com/jamesjara by ww
ÂÂ Â#searchfor"javax.jdo.option.ConnectionURL"andeditlikethefollowing
ÂÂ Â Â Â Â <property>
ÂÂ Â Â Â Â Â <name>javax.jdo.option.ConnectionURL</name>
ÂÂ Â Â Â Â Â <value>jdbc:derby://localhost:1527/metastore_db;create=true</value>
ÂÂ Â Â Â Â Â <description>JDBC connect string for a JDBC metastore</description>
ÂÂ Â Â Â Â </property>
ÂÂ Â #HTTP CONSOLE OF HIVE
ÂÂ Â bin/hive --service hwi &Â Â Â Â Â Â Â Â Â Â Â
ÂÂ ÂÂÂ ÂURL:http://localhost:9999/
ÂÂ Â #create new file
ÂÂ Âvim/hadoop/hive/conf/jpox.properties
ÂÂ Â#addthefollowing
ÂÂ Â Â Â Â javax.jdo.PersistenceManagerFactoryClass=org.jpox.PersistenceManagerFactoryImpl
ÂÂ Â Â Â Â org.jpox.autoCreateSchema=false
ÂÂ Â Â Â Â org.jpox.validateTables=false
ÂÂ Â Â Â Â org.jpox/usr/share/javadoc/java-1.6.0-openjdk/jre/.validateColumns=false
ÂÂ Â Â Â Â org.jpox.validateConstraints=false
ÂÂ Â Â Â Â org.jpox.storeManagerType=rdbms
     org.jpox.autoCreateSccp /hadoop/derby/lib/derbytools.jar /hadoop/hive/libhema=true
ÂÂ Â Â Â Â org.jpox.autoStartMechanismMode=checked
ÂÂ Â Â Â Â org.jpox.transactionIsolation=read_committed
ÂÂ ÂÂÂ Âjavax.jdo.option.DetachAllOnCommit=true
ÂÂ Â Â Â Â javax.jdo.option.NontransactionalRead=true
ÂÂ Â Â Â Â javax.jdo.option.ConnectionDriverName=org.apache.derby.jdbc.ClientDriver
ÂÂ Â Â Â Â javax.jdo.option.ConnectionURL=jdbc:derby://localhost:1527/metastore_db;create=true
ÂÂ Â Â Â Â javax.jdo.option.ConnectionUserName=APP
ÂÂ Â Â Â Â javax.jdo.option.ConnectionPassword=mine
ÂÂ Â #now copy derby jar sources to Hive lib
ÂÂ Âcp/hadoop/derby/lib/derbyclient.jar/hadoop/hive/lib
  cp /hadoop/derby/lib/derbytools.jar /hadoop/hive/lib
   #HTTP CONSOLE OF HIVE    Â

6. visit me at http://jamesjara.com or follow me at http://twitter.com/jamesjara by ww
ÂÂ Âhttp://localhost:9999/hwi/forthehive
6.START CLUSTER
   /hadoop/hadoop/bin/start-all.sh
ÂÂ Â/hadoop/hive/bin/hive--servicehwi&ÂÂ #hwi=webpanel
ÂÂ
7. FOR NEXT TIME AND EVER. Create a bash profile
ÂÂ Âvi/etc/profile
   export JAVA_HOME=/opt/jre/
   export HADOOP_OPTS=-Djava.net.preferIPv4Stack=true
   export HADOOP_HOME=/hadoop/hadoop/
   export DERBY_INSTALL=/hadoop/derby/
   export DERBY_HOME=/hadoop/derby/
   export HADOOP=/hadoop/hadoop/bin/hadoop
======RUNNING======
PANELS:
http://localhost:50030/ for the jobtrackeR
http://localhost:50060/ for the tasktracker
http://localhost:50070/forthenamenode
http://localhost:9999/hwi/forthehive
source:http://linux-costarica.blogspot.com/2012/02/installing-hadoophivederby-on-centos.html, http://linux-costarica.blogspot.com/2012/02/installing-
hadoophivederby-on-centos.html
More:followmehttp://twitter.com/jamesjaraorvisitmeathttp://jamesjara.com
source:http://linux-costarica.blogspot.com/2012/02/installing-hadoophivederby-on-centos.html, http://linux-costarica.blogspot.com/2012/02/installing-
hadoophivederby-on-centos.html
More:followmehttp://twitter.com/jamesjaraorvisitmeathttp://jamesjara.com