天天看点

Apache kudu1.4在CentOS7 的安装与配置(rpm) 的安装与配置Kudu1.4在CentOS7 的安装与配置(rpm)

转自:https://blog.csdn.net/jssg_tzw/article/details/72730186

Kudu1.4在CentOS7 的安装与配置(rpm)

前言

Apache Kudu是一个比较新的大数据组建,在国内大规模应用的公司不多,Kudu的安装文档也只能找到官网上的一份,自己按照官网的步骤进行安装的过程中也遇到了一些问题,现记录下完整的安装过程。 

为了简化操作: 

* kudu master: *

hostname: apollo.spk.com 

ip: 192.168.56.101

* kudu tablet: *

hostname: uranus.spk.com 

ip: 192.168.56.102

1.下载:http://archive.cloudera.com/kudu/redhat/7/x86_64/kudu/5/RPMS/x86_64/

Apache kudu1.4在CentOS7 的安装与配置(rpm) 的安装与配置Kudu1.4在CentOS7 的安装与配置(rpm)

2.Kudu安装

# 安装依赖包
[[email protected] kudu]# yum -y install cyrus-sasl-plain lsb ntp
# 查看安装包
[[email protected] kudu]# ls
kudu-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
kudu-client0-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
kudu-client-devel-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
kudu-debuginfo-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
kudu-master-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
kudu-tserver-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm

# 安装kudu
[[email protected] kudu]# rpm -ivh kudu-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm kudu-master-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm kudu-tserver-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm kudu-client0-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm kudu-client-devel-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm 
           

3.Kudu配置

3.1.查看/etc/kudu/conf/下的配置文件列表

[[email protected] kudu]# ls -la /etc/kudu/conf/
total 8
drwxr-xr-x 2 root root  53 May 24 09:25 .
drwxr-xr-x 3 root root  33 May 24 09:25 ..
-rw-r--r-- 1 root root 233 Apr 12 17:08 master.gflagfile
-rw-r--r-- 1 root root 236 Apr 12 17:08 tserver.gflagfile
           

3.2.查看主,、从机/etc/kudu/master.gflagfile内容

[[email protected] kudu]# more /etc/kudu/conf/master.gflagfile 
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-master.
--fromenv=rpc_bind_addresses
--fromenv=log_dir

--fs_wal_dir=/var/lib/kudu/master
--fs_data_dirs=/var/lib/kudu/master

[[email protected] kudu]# more /etc/kudu/conf/master.gflagfile 
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-master.
--fromenv=rpc_bind_addresses
--fromenv=log_dir

--fs_wal_dir=/var/lib/kudu/master
--fs_data_dirs=/var/lib/kudu/master
           

3.3.查看主、从机/etc/kudu/conf/tserver.gflagfile

#主机
[[email protected] kudu]# more /etc/kudu/conf/tserver.gflagfile 
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-tserver.
--fromenv=rpc_bind_addresses
--fromenv=log_dir

--fs_wal_dir=/var/lib/kudu/tserver
--fs_data_dirs=/var/lib/kudu/tserver
--tserver_master_addrs=apollo.spk.com:7051 #设置kudu master address

#从机(需要添回最后一行master address)
[[email protected] kudu]# more /etc/kudu/conf/tserver.gflagfile 
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-tserver.
--fromenv=rpc_bind_addresses
--fromenv=log_dir

--fs_wal_dir=/var/lib/kudu/tserver
--fs_data_dirs=/var/lib/kudu/tserver
--tserver_master_addrs=apollo.spk.com:7051  ######设置kudu master address
           

3.4.查看/etc/default/有关kudu配置的文件列表

[[email protected] kudu]# ls -la /etc/default/kudu*
-rw-r--r-- 1 root root 80 Apr 12 17:08 /etc/default/kudu-master
-rw-r--r-- 1 root root 80 Apr 12 17:08 /etc/default/kudu-tserver
           

3.4.1.修改/etc/default/kudu-master内容

#主机上设置kudu master
[[email protected] default]# vim kudu-master
export FLAGS_log_dir=/var/log/kudu
#export FLAGS_rpc_bind_addresses=0.0.0.0:7051
export FLAGS_rpc_bind_addresses=apollo.spk.com:7051   ###添加主机的地址

#从机上设置kudu master
[[email protected] kudu]# vim /etc/default/kudu-master
export FLAGS_log_dir=/var/log/kudu
#export FLAGS_rpc_bind_addresses=0.0.0.0:7051
export FLAGS_rpc_bind_addresses=apollo.spk.com:7051 ###设置kudu master address
           

3.4.2.修改主从机/etc/default/kudu-tserver

#修改主机上的kudu tserver
[[email protected] default]# vim kudu-tserver 
export FLAGS_log_dir=/var/log/kudu
export FLAGS_rpc_bind_addresses=0.0.0.0:7050


#修改改从机上的kudu tserver
[[email protected] kudu]# vim /etc/default/kudu-tserver 
export FLAGS_log_dir=/var/log/kudu
#export FLAGS_rpc_bind_addresses=0.0.0.0:7050
export FLAGS_rpc_bind_addresses=uranus.spk.com:7050  #添加从机tserver
           

4.NTP同步

配置文件配置好后,进入/etc/init.d目录下,执行./ntpd restart来ntp同步,这个是安装kudu需要的。

#主机同步时间
[[email protected] init.d]# systemctl restart ntpd
#从机同步时间
[[email protected] init.d]# systemctl restart ntpd

#设置开机启动
[[email protected] init.d]# systemctl enable ntpd
[[email protected] init.d]# systemctl enable ntpd
           

5.设置kudu的用户及所属组

创建配置文件中的目录,并且修改用户和所属组,因为kudu已经默认创建好kudu用户,所以可以直接在目录下执行如下命令:

#主机
[[email protected] lib]# chown -R kudu:kudu /var/lib/kudu/

#从机
[[email protected] conf]# chown -R kudu:kudu /var/lib/kudu/
           

6.启动Kudu Master和Kudu Tablet

master 只需要在主节点(host1)上启动就可以,tablet server 需要在所有的节点(host1、host2、host3)上启动:

[[email protected] conf]# systemctl restart kudu-master #启动主机
[[email protected] ~]# systemctl restart kudu-tserver    #启动从机
           

7. 通过master的8051端口查看可以看到tablet servers

Apache kudu1.4在CentOS7 的安装与配置(rpm) 的安装与配置Kudu1.4在CentOS7 的安装与配置(rpm)

8.通过kudu tserver可以8050端口查看

Apache kudu1.4在CentOS7 的安装与配置(rpm) 的安装与配置Kudu1.4在CentOS7 的安装与配置(rpm)