Hypertable on hadoop 安裝

軟體：

hadoop-0.20.2-cdh-u3

hypertable-0.9.5.6

ruby-1.8.7

CentOS-6.2

yum -y install gcc

yum -y install gcc-c++

yum install make

安裝 BerkeleyDB4.6+

==================================

tar zxvf db-5.3.21.gz 

cd db-5.3.21

cd build_unix/

../dist/configure --prefix=/usr/local/berkeleydb --enable-cxx

make

make install

安裝 Boost1.34.1+

=================================== 

tar zxvf boost_1_49_0.tar.gz

cd boost_1_49_0

cd tools/build/v2/

./bootstrap.sh 

./b2 install --prefix=/usr/local

安裝 log4cpp 1.0+

==================================

yum install expat-devel)

==================================

yum install readline-devel)

==================================

安裝 Hypertable-0.9.5.6

==================================

yum install perl-Bit-Vector

yum install perl-IO-Zlib

yum install perl-IO-Socket-INET6

yum install perl-IO-Socket-SSL

yum install perl-IO-String.noarch

yum install perl-libwww-perl-5.833-2.el6.noarch

rpm -ivh hypertable-0.9.5.6-linux-x86_64.rpm

安裝 ruby-1.8.7

===================================

yum install ruby ruby-devel

tar zxvf rubygems-1.3.5.tgz

cd rubygems-1.3.5

ruby setup.rb 

gem update

gem install capistrano

安裝hadoop(Hypertable自帶的hadoop jar是cloudera CHD3-u3的)

===================================

具體安裝參見相關文檔

在hadoop上建立hypertable檔案夾

bin/hadoop fs -mkdir /hypertable

bin/hadoop fs -chmod 777 /hypertable

Hypertable 安裝配置

===================================

将/opt/hypertable/0.9.5.6/conf/Capfile.cluster檔案拷貝到工作目錄下（例如目前使用者的home目錄），重命名為Capfile，修改裡面内容

set :source_machine,     "dlxa111"

set :install_dir,        "/opt/hypertable" 

set :hypertable_version, "0.9.5.6"

set :default_pkg,        "/root/hypertable-0.9.5.6-linux-x86_64.rpm"

set :default_dfs,        "hadoop"

set :default_config,     "/root/hypertable.cfg"   ##hypertable 配置檔案路徑

role :source, "dlxa111"

role :master, "dlxa111"

role :hyperspace, "dlxa112", "dlxa113", "dlxa114"

role :slave,  "dlxa115", "dlxa116", "dlxa117", "dlxa118"

role :localhost, "dlxa111"

role :thriftbroker

role :spare

安裝指令

===================================

cap install_package   ##向各台機器分發安裝

cap dist              ##檢視各台機器的安裝

cap shell             ##建立目錄

cap> mkdir /etc/opt/hypertable /var/opt/hypertable

cap> chown smp:smp /etc/opt/hypertable /var/opt/hypertable

cap> quit

cap fhsize

建立hypertable配置檔案(hypertable.cfg)

=====================================

#

# hypertable.cfg

#

# HDFS Broker

HdfsBroker.fs.default.name=hdfs://dlxa111:9000

# Ceph Broker

CephBroker.MonAddr=dlxa111:6789

# Local Broker

DfsBroker.Local.Root=fs/local

# DFS Broker - for clients

DfsBroker.Port=38030

# Hyperspace

Hyperspace.Replica.Host=dlxa113

Hyperspace.Replica.Host=dlxa115

Hyperspace.Replica.Host=dlxa117

Hyperspace.Replica.Host=dlxa118

Hyperspace.Replica.Port=38040

Hyperspace.Replica.Dir=hyperspace

# Hypertable.Master

Hypertable.Master.Port=38050

# Hypertable.RangeServer

Hypertable.RangeServer.Port=38060

Hyperspace.KeepAlive.Interval=30000

Hyperspace.Lease.Interval=1000000

Hyperspace.GracePeriod=200000

# ThriftBroker

ThriftBroker.Port=38080

将配置檔案分發到各個機器的hypertable上

cap push_config

cap set_current        ##建立一個軟連接配接

檢視各台機器時間是否一緻，如果不一緻，請使用NTP做時間同步，NTP的安裝參見相關文檔

===============================================================================

cap shell

cap> date

安裝web監控界面

=================================

gem install sinatra rack thin json titleize

yum install rrdtool

啟動叢集

=================================

cap start

停止叢集

=================================

cap stop

檢視叢集

=================================

http://dlxa111:38090/