天天看點

Apache kudu1.4在CentOS7 的安裝與配置(rpm) 的安裝與配置Kudu1.4在CentOS7 的安裝與配置(rpm)

轉自:https://blog.csdn.net/jssg_tzw/article/details/72730186

Kudu1.4在CentOS7 的安裝與配置(rpm)

前言

Apache Kudu是一個比較新的大資料組建,在國内大規模應用的公司不多,Kudu的安裝文檔也隻能找到官網上的一份,自己按照官網的步驟進行安裝的過程中也遇到了一些問題,現記錄下完整的安裝過程。 

為了簡化操作: 

* kudu master: *

hostname: apollo.spk.com 

ip: 192.168.56.101

* kudu tablet: *

hostname: uranus.spk.com 

ip: 192.168.56.102

1.下載下傳:http://archive.cloudera.com/kudu/redhat/7/x86_64/kudu/5/RPMS/x86_64/

Apache kudu1.4在CentOS7 的安裝與配置(rpm) 的安裝與配置Kudu1.4在CentOS7 的安裝與配置(rpm)

2.Kudu安裝

# 安裝依賴包
[[email protected] kudu]# yum -y install cyrus-sasl-plain lsb ntp
# 檢視安裝包
[[email protected] kudu]# ls
kudu-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
kudu-client0-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
kudu-client-devel-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
kudu-debuginfo-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
kudu-master-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
kudu-tserver-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm

# 安裝kudu
[[email protected] kudu]# rpm -ivh kudu-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm kudu-master-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm kudu-tserver-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm kudu-client0-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm kudu-client-devel-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm 
           

3.Kudu配置

3.1.檢視/etc/kudu/conf/下的配置檔案清單

[[email protected] kudu]# ls -la /etc/kudu/conf/
total 8
drwxr-xr-x 2 root root  53 May 24 09:25 .
drwxr-xr-x 3 root root  33 May 24 09:25 ..
-rw-r--r-- 1 root root 233 Apr 12 17:08 master.gflagfile
-rw-r--r-- 1 root root 236 Apr 12 17:08 tserver.gflagfile
           

3.2.檢視主,、從機/etc/kudu/master.gflagfile内容

[[email protected] kudu]# more /etc/kudu/conf/master.gflagfile 
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-master.
--fromenv=rpc_bind_addresses
--fromenv=log_dir

--fs_wal_dir=/var/lib/kudu/master
--fs_data_dirs=/var/lib/kudu/master

[[email protected] kudu]# more /etc/kudu/conf/master.gflagfile 
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-master.
--fromenv=rpc_bind_addresses
--fromenv=log_dir

--fs_wal_dir=/var/lib/kudu/master
--fs_data_dirs=/var/lib/kudu/master
           

3.3.檢視主、從機/etc/kudu/conf/tserver.gflagfile

#主機
[[email protected] kudu]# more /etc/kudu/conf/tserver.gflagfile 
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-tserver.
--fromenv=rpc_bind_addresses
--fromenv=log_dir

--fs_wal_dir=/var/lib/kudu/tserver
--fs_data_dirs=/var/lib/kudu/tserver
--tserver_master_addrs=apollo.spk.com:7051 #設定kudu master address

#從機(需要添回最後一行master address)
[[email protected] kudu]# more /etc/kudu/conf/tserver.gflagfile 
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-tserver.
--fromenv=rpc_bind_addresses
--fromenv=log_dir

--fs_wal_dir=/var/lib/kudu/tserver
--fs_data_dirs=/var/lib/kudu/tserver
--tserver_master_addrs=apollo.spk.com:7051  ######設定kudu master address
           

3.4.檢視/etc/default/有關kudu配置的檔案清單

[[email protected] kudu]# ls -la /etc/default/kudu*
-rw-r--r-- 1 root root 80 Apr 12 17:08 /etc/default/kudu-master
-rw-r--r-- 1 root root 80 Apr 12 17:08 /etc/default/kudu-tserver
           

3.4.1.修改/etc/default/kudu-master内容

#主機上設定kudu master
[[email protected] default]# vim kudu-master
export FLAGS_log_dir=/var/log/kudu
#export FLAGS_rpc_bind_addresses=0.0.0.0:7051
export FLAGS_rpc_bind_addresses=apollo.spk.com:7051   ###添加主機的位址

#從機上設定kudu master
[[email protected] kudu]# vim /etc/default/kudu-master
export FLAGS_log_dir=/var/log/kudu
#export FLAGS_rpc_bind_addresses=0.0.0.0:7051
export FLAGS_rpc_bind_addresses=apollo.spk.com:7051 ###設定kudu master address
           

3.4.2.修改主從機/etc/default/kudu-tserver

#修改主機上的kudu tserver
[[email protected] default]# vim kudu-tserver 
export FLAGS_log_dir=/var/log/kudu
export FLAGS_rpc_bind_addresses=0.0.0.0:7050


#修改改從機上的kudu tserver
[[email protected] kudu]# vim /etc/default/kudu-tserver 
export FLAGS_log_dir=/var/log/kudu
#export FLAGS_rpc_bind_addresses=0.0.0.0:7050
export FLAGS_rpc_bind_addresses=uranus.spk.com:7050  #添加從機tserver
           

4.NTP同步

配置檔案配置好後,進入/etc/init.d目錄下,執行./ntpd restart來ntp同步,這個是安裝kudu需要的。

#主機同步時間
[[email protected] init.d]# systemctl restart ntpd
#從機同步時間
[[email protected] init.d]# systemctl restart ntpd

#設定開機啟動
[[email protected] init.d]# systemctl enable ntpd
[[email protected] init.d]# systemctl enable ntpd
           

5.設定kudu的使用者及所屬組

建立配置檔案中的目錄,并且修改使用者和所屬組,因為kudu已經預設建立好kudu使用者,是以可以直接在目錄下執行如下指令:

#主機
[[email protected] lib]# chown -R kudu:kudu /var/lib/kudu/

#從機
[[email protected] conf]# chown -R kudu:kudu /var/lib/kudu/
           

6.啟動Kudu Master和Kudu Tablet

master 隻需要在主節點(host1)上啟動就可以,tablet server 需要在所有的節點(host1、host2、host3)上啟動:

[[email protected] conf]# systemctl restart kudu-master #啟動主機
[[email protected] ~]# systemctl restart kudu-tserver    #啟動從機
           

7. 通過master的8051端口檢視可以看到tablet servers

Apache kudu1.4在CentOS7 的安裝與配置(rpm) 的安裝與配置Kudu1.4在CentOS7 的安裝與配置(rpm)

8.通過kudu tserver可以8050端口檢視

Apache kudu1.4在CentOS7 的安裝與配置(rpm) 的安裝與配置Kudu1.4在CentOS7 的安裝與配置(rpm)