하둡 구성을 위한 설치 환경 만들고 하둡을 올리는 순서입니다..

하둡 구성을 위한 설치 환경 만들고 하둡을 올리는 순서입니다..

1. vmware

yum install ssh

    service sshd start

   chkconfig sshd on

2. namenode server centos

   root# vi /etc/hosts   192.168.73.71 

vmware Edit - Virtual Edit Newro subnet IP dchp setting startip to end ip

system - preferr - network conn ipv4 setting manual addres netamask 

gateway dnserver

namenode datanodes

3. root# jdk   classpath  /usr/local/java  vi /etc/profile  add java classpath

4. hadoop download

   hive download

   hbase download

   pig download

5. vmware clone 3 X datanode

6. ssh-keygen -t rsa        chmod 700 .ssh   chmod 644 authorized_keys

    (4servers) -> namenode > cat >> authorized_keys (include 4 ssh id_rsa.pub)

     >> scp -rp to 3servers

   chmod 700 .ssh   chmod 644 authorized_keys

7. ssh datanode1 ssh namenode

8. root# /etc/init.d/iptables stop or ui port add <<<

9. tar xvzf hadoop

10. modify configuration 6 files

11. tar cvzf hadoop  > scp to 3 server

12. tar xvzf hadoop

13. ./bin/hadoop namenode -format

14. ./bin/start-all.sh

15. jps

16. ./bin/hadoop fs -put ivy.xml conf/

15. ./bin/hadoop jar hadoop-.......jar wordcount conf/ivy.xml conf/output