[hadoop@h001 bin]$
./hbase org.apache.hadoop.hbase.util.RegionSplitter ta02_split_table HexStringSplit -c 3 -f f1
-c 3 : 미리 생성할 region 개수를 지정
-f f1 : table 에 포함하고자 하는 column familites 를 미리 지정
[ where -c 10, specifies the requested number of regions as 10, and -f specifies the column families you want in the table, separated by “:”. The tool will create a table named “test_table” with 10 regions: ]
[ refered to http://hortonworks.com/blog/apache-hbase-region-splitting-and-merging/ ]
[hadoop@h001 ~]$ ./hadoop/bin/hadoop fs -cat
/hbase/ta02_split_table/1c48716184cd69b16867d1450d5deb66/.regioninfo
{NAME => 'ta02_split_table,aaaaaaaa,1372606707325.1c48716184cd69b16867d1450d5deb66.', STARTKEY => 'aaaaaaaa', ENDKEY => '', ENCODED => 1c48716184cd69b16867d1450d5deb66, }
/hbase/ta02_split_table
/hbase/ta02_split_table/.tableinfo.0000000001
/hbase/ta02_split_table/.tmp
/hbase/ta02_split_table/1c48716184cd69b16867d1450d5deb66
/hbase/ta02_split_table/1c48716184cd69b16867d1450d5deb66/.regioninfo
/hbase/ta02_split_table/1c48716184cd69b16867d1450d5deb66/.tmp
/hbase/ta02_split_table/1c48716184cd69b16867d1450d5deb66/f1
/hbase/ta02_split_table/1c48716184cd69b16867d1450d5deb66/f1/61b50da9c7ce4accab9e24076d859b2a
/hbase/ta02_split_table/24cc1b7ce1cb0bafe49d80fa6d2feeba
/hbase/ta02_split_table/24cc1b7ce1cb0bafe49d80fa6d2feeba/.regioninfo
/hbase/ta02_split_table/24cc1b7ce1cb0bafe49d80fa6d2feeba/f1
/hbase/ta02_split_table/d3f48ecc4d24379a6afde38fb70a6fb2
/hbase/ta02_split_table/d3f48ecc4d24379a6afde38fb70a6fb2/.regioninfo
/hbase/ta02_split_table/d3f48ecc4d24379a6afde38fb70a6fb2/f1
[hadoop@h001 bin]$
./hbase org.apache.hadoop.hbase.util.RegionSplitter ta20_split_table HexStringSplit -c 20 -f f1
13/07/01 00:38:25 DEBUG util.RegionSplitter: Creating table ta02_split_table with 1 column families. Presplitting to 3 regions
13/07/01 00:38:26 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
13/07/01 00:38:26 INFO zookeeper.ZooKeeper: Client environment:host.name=h001
13/07/01 00:38:26 INFO zookeeper.ZooKeeper: Client environment:java.version=1.7.0_21
13/07/01 00:38:26 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
13/07/01 00:38:26 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/local/jdk1.7.0_21/jre
13/07/01 00:38:26 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/home/hadoop/hbase/conf:/usr/local/java/lib/tools.jar:/home/hadoop/hbase:/home/hadoop/hbase/hbase-0.94.7.jar:/home/hadoop/hbase/hbase-0.94.7-tests.jar:/home/hadoop/hbase/lib/activation-1.1.jar:/home/hadoop/hbase/lib/asm-3.1.jar:/home/hadoop/hbase/lib/avro-1.5.3.jar:/home/hadoop/hbase/lib/avro-ipc-1.5.3.jar:/home/hadoop/hbase/lib/commons-beanutils-1.7.0.jar:/home/hadoop/hbase/lib/commons-beanutils-core-1.8.0.jar:/home/hadoop/hbase/lib/commons-cli-1.2.jar:/home/hadoop/hbase/lib/commons-codec-1.4.jar:/home/hadoop/hbase/lib/commons-collections-3.2.1.jar:/home/hadoop/hbase/lib/commons-configuration-1.6.jar:/home/hadoop/hbase/lib/commons-digester-1.8.jar:/home/hadoop/hbase/lib/commons-el-1.0.jar:/home/hadoop/hbase/lib/commons-httpclient-3.1.jar:/home/hadoop/hbase/lib/commons-io-2.1.jar:/home/hadoop/hbase/lib/commons-lang-2.5.jar:/home/hadoop/hbase/lib/commons-logging-1.1.1.jar:/home/hadoop/hbase/lib/commons-math-2.1.jar:/home/hadoop/hbase/lib/commons-net-1.4.1.jar:/home/hadoop/hbase/lib/core-3.1.1.jar:/home/hadoop/hbase/lib/guava-11.0.2.jar:/home/hadoop/hbase/lib/hadoop-core-1.0.4.jar:/home/hadoop/hbase/lib/high-scale-lib-1.1.1.jar:/home/hadoop/hbase/lib/httpclient-4.1.2.jar:/home/hadoop/hbase/lib/httpcore-4.1.3.jar:/home/hadoop/hbase/lib/jackson-core-asl-1.8.8.jar:/home/hadoop/hbase/lib/jackson-jaxrs-1.8.8.jar:/home/hadoop/hbase/lib/jackson-mapper-asl-1.8.8.jar:/home/hadoop/hbase/lib/jackson-xc-1.8.8.jar:/home/hadoop/hbase/lib/jamon-runtime-2.3.1.jar:/home/hadoop/hbase/lib/jasper-compiler-5.5.23.jar:/home/hadoop/hbase/lib/jasper-runtime-5.5.23.jar:/home/hadoop/hbase/lib/jaxb-api-2.1.jar:/home/hadoop/hbase/lib/jaxb-impl-2.2.3-1.jar:/home/hadoop/hbase/lib/jersey-core-1.8.jar:/home/hadoop/hbase/lib/jersey-json-1.8.jar:/home/hadoop/hbase/lib/jersey-server-1.8.jar:/home/hadoop/hbase/lib/jettison-1.1.jar:/home/hadoop/hbase/lib/jetty-6.1.26.jar:/home/hadoop/hbase/lib/jetty-util-6.1.26.jar:/home/hadoop/hbase/lib/jruby-complete-1.6.5.jar:/home/hadoop/hbase/lib/jsp-2.1-6.1.14.jar:/home/hadoop/hbase/lib/jsp-api-2.1-6.1.14.jar:/home/hadoop/hbase/lib/jsr305-1.3.9.jar:/home/hadoop/hbase/lib/junit-4.10-HBASE-1.jar:/home/hadoop/hbase/lib/libthrift-0.8.0.jar:/home/hadoop/hbase/lib/log4j-1.2.16.jar:/home/hadoop/hbase/lib/metrics-core-2.1.2.jar:/home/hadoop/hbase/lib/netty-3.2.4.Final.jar:/home/hadoop/hbase/lib/protobuf-java-2.4.0a.jar:/home/hadoop/hbase/lib/servlet-api-2.5-6.1.14.jar:/home/hadoop/hbase/lib/slf4j-api-1.4.3.jar:/home/hadoop/hbase/lib/slf4j-log4j12-1.4.3.jar:/home/hadoop/hbase/lib/snappy-java-1.0.3.2.jar:/home/hadoop/hbase/lib/stax-api-1.0.1.jar:/home/hadoop/hbase/lib/velocity-1.7.jar:/home/hadoop/hbase/lib/xmlenc-0.52.jar:/home/hadoop/hbase/lib/zookeeper-3.4.5.jar:/home/hadoop/hbase/conf:/home/hadoop/hadoop/libexec/../conf:/usr/local/java/lib/tools.jar:/home/hadoop/hadoop/libexec/..:/home/hadoop/hadoop/libexec/../hadoop-core-1.0.4.jar:/home/hadoop/hadoop/libexec/../lib/asm-3.2.jar:/home/hadoop/hadoop/libexec/../lib/aspectjrt-1.6.5.jar:/home/hadoop/hadoop/libexec/../lib/aspectjtools-1.6.5.jar:/home/hadoop/hadoop/libexec/../lib/commons-beanutils-1.7.0.jar:/home/hadoop/hadoop/libexec/../lib/commons-beanutils-core-1.8.0.jar:/home/hadoop/hadoop/libexec/../lib/commons-cli-1.2.jar:/home/hadoop/hadoop/libexec/../lib/commons-codec-1.4.jar:/home/hadoop/hadoop/libexec/../lib/commons-collections-3.2.1.jar:/home/hadoop/hadoop/libexec/../lib/commons-configuration-1.6.jar:/home/hadoop/hadoop/libexec/../lib/commons-daemon-1.0.1.jar:/home/hadoop/hadoop/libexec/../lib/commons-digester-1.8.jar:/home/hadoop/hadoop/libexec/../lib/commons-el-1.0.jar:/home/hadoop/hadoop/libexec/../lib/commons-httpclient-3.0.1.jar:/home/hadoop/hadoop/libexec/../lib/commons-io-2.1.jar:/home/hadoop/hadoop/libexec/../lib/commons-lang-2.4.jar:/home/hadoop/hadoop/libexec/../lib/commons-logging-1.1.1.jar:/home/hadoop/hadoop/libexec/../lib/commons-logging-api-1.0.4.jar:/home/hadoop/hadoop/libexec/../lib/commons-math-2.1.jar:/home/hadoop/hadoop/libexec/../lib/commons-net-1.4.1.jar:/home/hadoop/hadoop/libexec/../lib/core-3.1.1.jar:/home/hadoop/hadoop/libexec/../lib/hadoop-capacity-scheduler-1.0.4.jar:/home/hadoop/hadoop/libexec/../lib/hadoop-fairscheduler-1.0.4.jar:/home/hadoop/hadoop/libexec/../lib/hadoop-thriftfs-1.0.4.jar:/home/hadoop/hadoop/libexec/../lib/hsqldb-1.8.0.10.jar:/home/hadoop/hadoop/libexec/../lib/jackson-core-asl-1.8.8.jar:/home/hadoop/hadoop/libexec/../lib/jackson-mapper-asl-1.8.8.jar:/home/hadoop/hadoop/libexec/../lib/jasper-compiler-5.5.12.jar:/home/hadoop/hadoop/libexec/../lib/jasper-runtime-5.5.12.jar:/home/hadoop/hadoop/libexec/../lib/jdeb-0.8.jar:/home/hadoop/hadoop/libexec/../lib/jersey-core-1.8.jar:/home/hadoop/hadoop/libexec/../lib/jersey-json-1.8.jar:/home/hadoop/hadoop/libexec/../lib/jersey-server-1.8.jar:/home/hadoop/hadoop/libexec/../lib/jets3t-0.6.1.jar:/home/hadoop/hadoop/libexec/../lib/jetty-6.1.26.jar:/home/hadoop/hadoop/libexec/../lib/jetty-util-6.1.26.jar:/home/hadoop/hadoop/libexec/../lib/jsch-0.1.42.jar:/home/hadoop/hadoop/libexec/../lib/junit-4.5.jar:/home/hadoop/hadoop/libexec/../lib/kfs-0.2.2.jar:/home/hadoop/hadoop/libexec/../lib/log4j-1.2.15.jar:/home/hadoop/hadoop/libexec/../lib/mockito-all-1.8.5.jar:/home/hadoop/hadoop/libexec/../lib/oro-2.0.8.jar:/home/hadoop/hadoop/libexec/../lib/servlet-api-2.5-20081211.jar:/home/hadoop/hadoop/libexec/../lib/slf4j-api-1.4.3.jar:/home/hadoop/hadoop/libexec/../lib/slf4j-log4j12-1.4.3.jar:/home/hadoop/hadoop/libexec/../lib/xmlenc-0.52.jar:/home/hadoop/hadoop/libexec/../lib/jsp-2.1/jsp-2.1.jar:/home/hadoop/hadoop/libexec/../lib/jsp-2.1/jsp-api-2.1.jar
13/07/01 00:38:26 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/home/hadoop/hadoop/libexec/../lib/native/Linux-amd64-64:/home/hadoop/hbase/lib/native/Linux-amd64-64
13/07/01 00:38:26 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
13/07/01 00:38:26 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
13/07/01 00:38:26 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
13/07/01 00:38:26 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
13/07/01 00:38:26 INFO zookeeper.ZooKeeper: Client environment:os.version=2.6.32-358.el6.x86_64
13/07/01 00:38:26 INFO zookeeper.ZooKeeper: Client environment:user.name=hadoop
13/07/01 00:38:26 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/hadoop
13/07/01 00:38:26 INFO zookeeper.ZooKeeper: Client environment:user.dir=/home/hadoop/hbase/bin
13/07/01 00:38:26 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=192.168.73.74:2181,192.168.73.73:2181,192.168.73.72:2181,192.168.73.71:2181 sessionTimeout=180000 watcher=hconnection
13/07/01 00:38:26 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 7073@h001
13/07/01 00:38:26 INFO zookeeper.ClientCnxn: Opening socket connection to server h003/192.168.73.73:2181. Will not attempt to authenticate using SASL (unknown error)
13/07/01 00:38:26 INFO zookeeper.ClientCnxn: Socket connection established to h003/192.168.73.73:2181, initiating session
13/07/01 00:38:26 INFO zookeeper.ClientCnxn: Session establishment complete on server h003/192.168.73.73:2181, sessionid = 0x23f95b78dae0001, negotiated timeout = 180000
13/07/01 00:38:27 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=192.168.73.74:2181,192.168.73.73:2181,192.168.73.72:2181,192.168.73.71:2181 sessionTimeout=180000 watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@4303418
13/07/01 00:38:27 INFO zookeeper.ClientCnxn: Opening socket connection to server h004/192.168.73.74:2181. Will not attempt to authenticate using SASL (unknown error)
13/07/01 00:38:27 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 7073@h001
13/07/01 00:38:27 DEBUG catalog.CatalogTracker: Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@47c3666a
13/07/01 00:38:27 INFO zookeeper.ClientCnxn: Socket connection established to h004/192.168.73.74:2181, initiating session
13/07/01 00:38:27 INFO zookeeper.ClientCnxn: Session establishment complete on server h004/192.168.73.74:2181, sessionid = 0x33f95b790390001, negotiated timeout = 180000
13/07/01 00:38:27 DEBUG client.HConnectionManager$HConnectionImplementation: Looked up root region location, connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@4303418; serverName=h003,60020,1372606406897
13/07/01 00:38:27 DEBUG client.HConnectionManager$HConnectionImplementation: Cached location for .META.,,1.1028785192 is h004:60020
13/07/01 00:38:27 DEBUG client.ClientScanner: Creating scanner over .META. starting at key 'ta02_split_table,,'
13/07/01 00:38:27 DEBUG client.ClientScanner: Advancing internal scanner to startKey at 'ta02_split_table,,'
13/07/01 00:38:27 DEBUG catalog.CatalogTracker: Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@47c3666a
13/07/01 00:38:27 INFO zookeeper.ZooKeeper: Session: 0x33f95b790390001 closed
13/07/01 00:38:27 INFO zookeeper.ClientCnxn: EventThread shut down
13/07/01 00:38:27 DEBUG client.MetaScanner: Scanning .META. starting at row=ta02_split_table,,00000000000000 for max=2147483647 rows using org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@4303418
13/07/01 00:38:28 DEBUG client.MetaScanner: Scanning .META. starting at row=ta02_split_table,,00000000000000 for max=2147483647 rows using org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@4303418
13/07/01 00:38:28 DEBUG util.RegionSplitter: Table created! Waiting for regions to show online in META...
13/07/01 00:38:28 DEBUG util.RegionSplitter: Finished creating table with 3 regions
[hadoop@h001 bin]$
[hadoop@h001 bin]$./hbase org.apache.hadoop.hbase.util.RegionSplitterta03_split_table HexStringSplit -c 3 -f f1:f2:f3:d1:d2
'Hadoop Ecosystem' 카테고리의 다른 글
| Data Locality, The heart of MapReduce (0) | 2013.07.05 |
|---|---|
| sqoop import failure (0) | 2013.07.01 |
| zookeeper.RecoverableZooKeeper: ZooKeeper exists failed after 3 retries (0) | 2013.07.01 |
| R CMD INSTALL rhdfs_1.0.6.tar.gz (0) | 2013.06.29 |
| Thrift is a lightweight, language-independent software stack with an associated code generation mechanism for RPC. (0) | 2013.06.29 |