본문 바로가기

Bigdata 동영상

(15)
HBase basic commands and RegionSplitter [하둡 동영상 강의] 이곳에는 간단한 HBase 명령어 실행과 RegionSplitter 사용을 본다. 동영상 제작해서 만들어 업로드기까지는 시간이 엄청나게 걸리는 작업인 걸 이번에 알았다......... [hadoop@h001 hbase]$ ./bin/hbase shellHBase Shell; enter 'help' for list of supported commands. Type "exit" to leave the HBase Shell Version 0.94.7, r1471806, Wed Apr 24 18:48:26 PDT 2013 hbase(main):001:0> helpHBase Shell, version 0.94.7, r1471806, Wed Apr 24 18:48:26 PDT 2013 Type 'help "COMM..
HBase install and basic command [하둡 동영상 강의] HBase 설치 진행내역을 담았습니다. [column base db] Prerequisite : HDFS [refered to sites below and downloaded hbase tar.gz file] http://hbase.apache.org/ http://www.apache.org/dyn/closer.cgi/hbase/ http://hbase.apache.org/book/quickstart.html # vi /etc/profile export HBASE_HOME=/home/hadoop/hbase export PATH=$PATH:$JAVA_HOME/bin:$ANT_HOME:$HADOOP_HOME/bin:$HBASE_HOME/bin # source /etc/profile # cat hbase-en..
RHadoop install [하둡 동영상 강의] 동영상은 조만간 upload 예정입니다. [refered to http://cran.r-project.org/bin/linux/suse/README.html][refered to http://bighadoop.wordpress.com/2013/02/25/r-and-hadoop-data-analysis-rhadoop/][refered to http://kertz.egloos.com/199360] Centos / not Ubuntu> install.packages( c('RJSONIO', 'itertools', 'digest', 'Rcpp', 'bitops', 'functional', 'stringr', 'plyr', 'reshape2', 'rJava'), repos='http://cran.revolutio..
Hive install QL use [하둡 동영상 강의] Hive downloadhttp://apache.mirror.cdnetworks.com/hive/stable/ $HIVE_HOME/bin/hive --service metastore $HIVE_HOME/bin/hive --service hiveserver Hive tar xvzf./bin/hivehive> create database calebpro;hive> use calebpro;hive> create table table01( a string, b int);hive> show tables;hive> drop table table01;hive> show tables;hive> create table airline_delay ( ....columns..... ) partitioned by (delayY..
HDFS Management [하둡 동영상 강의] jpsh001:50070h002:50075./bin/hadoop fs -lsr./bin/hadoop fs -dus./bin/hadoop fs -du./bin/hadoop fs -rmr./bin/hadoop fs -expunge./bin/hadoop fs -mkdir./bin/hadoop fs -put* 가 작동하는 특정 조건이 있는 듯 함.
MapReduce Wordcount [하둡 동영상 강의] hadoop execution ./bin/hadoop namenode -format ./bin/start-all.sh $ jps ./bin/hadoop fs -ls ./bin/hadoop fs -mkdir jacob ./bin/hadoop fs -put news.text jacob/ ./bin/hadoop jar hadoop-examples-1.0.4.jar wordcount jacob/news.text jacob/newsoutput ./bin/hadoop fs -cat jacob/newsoutput/part-r-00000
Hadoop install hadoop-env.sh masters.xml slaves core-site.xml hdfs-site.xml mapred-site.xml hosts profiile - add classpath HADOOP_HOME source 1. 작업하다가 중간에 버튼을 잘못 눌러서 의도적이지 않게 두개로 분리됨. 2.
JAVA Install 1. java download 2. make symbolic link 3. set classpath 4. code simple java coding 5. execute class