본문 바로가기

Items

(391)
R CMD INSTALL rhdfs_1.0.6.tar.gz RHadoop 설치하는데 장애물을 하나씩 들쳐내면서 수풀을 헤치고 나가는 느낌이다. 결정적으로 rhbase 설치에서 자꾸 예기치 못한게 나오는데 .. . . . . [hadoop@h001 Downloads]$ R CMD INSTALL rhdfs_1.0.6.tar.gz * installing to library ‘/home/hadoop/R/x86_64-redhat-linux-gnu-library/3.0’* installing *source* package ‘rhdfs’ ...** R** inst** preparing package for lazy loading** help*** installing help indices converting help for package ‘rhdfs’ finding HTML..
Thrift is a lightweight, language-independent software stack with an associated code generation mechanism for RPC. [hadoop@h001 thrift-0.9.0]$ cat README Apache Thrift Last Modified: 2010-Nov-04 License======= Licensed to the Apache Software Foundation (ASF) under oneor more contributor license agreements. See the NOTICE filedistributed with this work for additional informationregarding copyright ownership. The ASF licenses this fileto you under the Apache License, Version 2.0 (the"License"); you may not use..
RHadoop execution > b.time small.ints= to.dfs(1:900000) 13/06/27 23:26:25 INFO util.NativeCodeLoader: Loaded the native-hadoop library13/06/27 23:26:25 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib library13/06/27 23:26:25 INFO compress.CodecPool: Got brand-new compressorWarning message: In to.dfs(1:9e+05) : Converting to.dfs argument to keyval with a NULL key > result = mapreduce(input = s..
RHadoop log Error 발생 Error in mr(map = map, reduce = reduce, combine = combine, vectorized.reduce, : hadoop streaming failed with error code 1 2013-06-27 20:18:13,019 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201306271950_0003_m_000000_0: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1 [refered to http://blrunner.com/23] ./bin/hadoop jar contr..
RHadoop install [하둡 동영상 강의] 동영상은 조만간 upload 예정입니다. [refered to http://cran.r-project.org/bin/linux/suse/README.html][refered to http://bighadoop.wordpress.com/2013/02/25/r-and-hadoop-data-analysis-rhadoop/][refered to http://kertz.egloos.com/199360] Centos / not Ubuntu> install.packages( c('RJSONIO', 'itertools', 'digest', 'Rcpp', 'bitops', 'functional', 'stringr', 'plyr', 'reshape2', 'rJava'), repos='http://cran.revolutio..
RStudio-server version install http://www.wsyang.com/2011/04/%EC%83%88%EB%A1%9C%EC%9A%B4-r%EC%9D%98-%ED%86%B5%ED%95%A9%ED%99%98%EA%B2%BD-rstudio/ C:\Windows\System32\drivers\etc Default rstudio server port : 8787http://www.rstudio.com/ide/docs/server/configurationhttp://www.rstudio.com/ide/docs/server/management Starting RStudio-server#/etc/init.d/rstudioserver start R>Sys.setenv(HADOOP_HOME="/home/hadoop/hadoop/")R>Sys.seten..
R installation on Centos 제목 : R installation on Centos [ 2013-05-13 ] http://cafe.naver.com/sqlpd/2202 -- 카페에 올렸던 글임. Error message : ...... X11 headers/libs are not availableR version : R-2.15.2.tar.gzOS : Centos 6.4 Kernel Linux 2.6.32-358.el6.x86_64 R 은 Windows 상에서만 설치하여 MongoDB 데이타를 import 하는 것 까지 성공확인 이후스터디 때 사용해 오다가 결국은 R 도 Linux 상에서 쓰는것이 맞지 않을까 싶어 Linux 에서 설치시도 들어갔네요. 그런데 이거 Windows 에서 설치하는 것과 달리 하나하나가 걸림돌이네요 혹시 ..
Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient [hadoop@h001 hive]$ ./bin/hive WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files. Logging initialized using configuration in file:/home/hadoop/hive/conf/hive-log4j.properties Hive history file=/tmp/hadoop/hive_job_log_hadoop_201306251755_694415549.txt hive> show tables; OK Time taken: 35.976 ..