轉自:https://blog.csdn.net/jssg_tzw/article/details/72730186
Kudu1.4在CentOS7 的安裝與配置(rpm)
前言
Apache Kudu是一個比較新的大資料組建,在國内大規模應用的公司不多,Kudu的安裝文檔也隻能找到官網上的一份,自己按照官網的步驟進行安裝的過程中也遇到了一些問題,現記錄下完整的安裝過程。
為了簡化操作:
* kudu master: *
hostname: apollo.spk.com
ip: 192.168.56.101
* kudu tablet: *
hostname: uranus.spk.com
ip: 192.168.56.102
1.下載下傳:http://archive.cloudera.com/kudu/redhat/7/x86_64/kudu/5/RPMS/x86_64/
2.Kudu安裝
# 安裝依賴包
[[email protected] kudu]# yum -y install cyrus-sasl-plain lsb ntp
# 檢視安裝包
[[email protected] kudu]# ls
kudu-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
kudu-client0-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
kudu-client-devel-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
kudu-debuginfo-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
kudu-master-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
kudu-tserver-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
# 安裝kudu
[[email protected] kudu]# rpm -ivh kudu-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm kudu-master-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm kudu-tserver-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm kudu-client0-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm kudu-client-devel-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
3.Kudu配置
3.1.檢視/etc/kudu/conf/下的配置檔案清單
[[email protected] kudu]# ls -la /etc/kudu/conf/
total 8
drwxr-xr-x 2 root root 53 May 24 09:25 .
drwxr-xr-x 3 root root 33 May 24 09:25 ..
-rw-r--r-- 1 root root 233 Apr 12 17:08 master.gflagfile
-rw-r--r-- 1 root root 236 Apr 12 17:08 tserver.gflagfile
3.2.檢視主,、從機/etc/kudu/master.gflagfile内容
[[email protected] kudu]# more /etc/kudu/conf/master.gflagfile
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-master.
--fromenv=rpc_bind_addresses
--fromenv=log_dir
--fs_wal_dir=/var/lib/kudu/master
--fs_data_dirs=/var/lib/kudu/master
[[email protected] kudu]# more /etc/kudu/conf/master.gflagfile
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-master.
--fromenv=rpc_bind_addresses
--fromenv=log_dir
--fs_wal_dir=/var/lib/kudu/master
--fs_data_dirs=/var/lib/kudu/master
3.3.檢視主、從機/etc/kudu/conf/tserver.gflagfile
#主機
[[email protected] kudu]# more /etc/kudu/conf/tserver.gflagfile
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-tserver.
--fromenv=rpc_bind_addresses
--fromenv=log_dir
--fs_wal_dir=/var/lib/kudu/tserver
--fs_data_dirs=/var/lib/kudu/tserver
--tserver_master_addrs=apollo.spk.com:7051 #設定kudu master address
#從機(需要添回最後一行master address)
[[email protected] kudu]# more /etc/kudu/conf/tserver.gflagfile
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-tserver.
--fromenv=rpc_bind_addresses
--fromenv=log_dir
--fs_wal_dir=/var/lib/kudu/tserver
--fs_data_dirs=/var/lib/kudu/tserver
--tserver_master_addrs=apollo.spk.com:7051 ######設定kudu master address
3.4.檢視/etc/default/有關kudu配置的檔案清單
[[email protected] kudu]# ls -la /etc/default/kudu*
-rw-r--r-- 1 root root 80 Apr 12 17:08 /etc/default/kudu-master
-rw-r--r-- 1 root root 80 Apr 12 17:08 /etc/default/kudu-tserver
3.4.1.修改/etc/default/kudu-master内容
#主機上設定kudu master
[[email protected] default]# vim kudu-master
export FLAGS_log_dir=/var/log/kudu
#export FLAGS_rpc_bind_addresses=0.0.0.0:7051
export FLAGS_rpc_bind_addresses=apollo.spk.com:7051 ###添加主機的位址
#從機上設定kudu master
[[email protected] kudu]# vim /etc/default/kudu-master
export FLAGS_log_dir=/var/log/kudu
#export FLAGS_rpc_bind_addresses=0.0.0.0:7051
export FLAGS_rpc_bind_addresses=apollo.spk.com:7051 ###設定kudu master address
3.4.2.修改主從機/etc/default/kudu-tserver
#修改主機上的kudu tserver
[[email protected] default]# vim kudu-tserver
export FLAGS_log_dir=/var/log/kudu
export FLAGS_rpc_bind_addresses=0.0.0.0:7050
#修改改從機上的kudu tserver
[[email protected] kudu]# vim /etc/default/kudu-tserver
export FLAGS_log_dir=/var/log/kudu
#export FLAGS_rpc_bind_addresses=0.0.0.0:7050
export FLAGS_rpc_bind_addresses=uranus.spk.com:7050 #添加從機tserver
4.NTP同步
配置檔案配置好後,進入/etc/init.d目錄下,執行./ntpd restart來ntp同步,這個是安裝kudu需要的。
#主機同步時間
[[email protected] init.d]# systemctl restart ntpd
#從機同步時間
[[email protected] init.d]# systemctl restart ntpd
#設定開機啟動
[[email protected] init.d]# systemctl enable ntpd
[[email protected] init.d]# systemctl enable ntpd
5.設定kudu的使用者及所屬組
建立配置檔案中的目錄,并且修改使用者和所屬組,因為kudu已經預設建立好kudu使用者,是以可以直接在目錄下執行如下指令:
#主機
[[email protected] lib]# chown -R kudu:kudu /var/lib/kudu/
#從機
[[email protected] conf]# chown -R kudu:kudu /var/lib/kudu/
6.啟動Kudu Master和Kudu Tablet
master 隻需要在主節點(host1)上啟動就可以,tablet server 需要在所有的節點(host1、host2、host3)上啟動:
[[email protected] conf]# systemctl restart kudu-master #啟動主機
[[email protected] ~]# systemctl restart kudu-tserver #啟動從機