用Openfiler 給Oracle RAC叢集配置共享存儲

用Openfiler 給Oracle RAC叢集配置共享存儲.

實驗環境

RAC OS: Oracle linux 6.3

openfiler 版本: 2.3或2.99

1.配置Openfiler  

安裝：

需要兩塊網卡：

eth0: 192.168.115.109

eth1:172.168.146.109

關于網卡：

openfiler版本是2.3的話,1塊或2塊無所謂，最後綁定的時候使用1塊，我在綁定到主機時使用的是eth1

如果是2.99的話，最好使用1塊網卡，如果是2塊的話，且都和主機能通，綁定到主機時會磁盤會多出來一份。

Openfiler作業系統安裝省略，給Openfiler加載兩塊盤，1塊盤用來安裝openfiler作業系統，另1塊盤用于為其他機器做存儲。

我在實驗中作業系統用的盤分了20G，為其他機器用的盤分了50G。

安裝完成後的界面

登陸到openfiler Web 管理GUI

Openfiler的預設使用者名為openfiler，密碼為password

需要添加通路該存儲的機器

配置存儲

1.    增加physicalvolumes

在volumnes /blockdevicees頁面添加，本次測試增加/dev/sdb1

2.    增加volume groups

在 “volumnes/volume Groups”頁面

3.在volume groups建立 logical volumes

在 “volumnes/add volume”頁面

4.配置lun

在 “volumnes/iscsi targets”頁面操作

如果是上面灰色狀态，說明iscsi-target服務未啟動

[[email protected] ~]# service iscsi-target status

iSCSI target stopped

[[email protected] ~]# service iscsi-target start

Starting iSCSI target service: [  OK  ]

[[email protected] ~]# chkconfig iscsi-target on

啟1個自己好認的名字

再增加1塊IQN

再增加1塊IQN

DB機器上配置

yum  install iscsi-initiator-utils

[[email protected]]# service iscsid start

[[email protected]]# chkconfig iscsid on

[[email protected]]# chkconfig iscsi on

[[email protected]]# vi /etc/hosts

172.168.146.109openfiler1-priv

~

檢驗配置是否正常工作

[[email protected]~]#  iscsiadm -mdiscovery -t sendtargets -p openfiler1-priv

172.168.146.109:3260,1iqn.2006-01.com.openfiler:rac.fra

172.168.146.109:3260,1iqn.2006-01.com.openfiler:rac.data

172.168.146.109:3260,1iqn.2006-01.com.openfiler:rac.crs

手動登入到 iSCSI目标

# iscsiadm -m node -T iqn.2006-01.com.openfiler:rac.crs  -p 172.168.146.109 -l

Logging in to[iface: default, target: iqn.2006-01.com.openfiler:rac.crs, portal:172.168.146.109,3260] (multiple)

Login to [iface:default, target: iqn.2006-01.com.openfiler:rac.crs, portal:172.168.146.109,3260] successful.

# iscsiadm -m node -T iqn.2006-01.com.openfiler:rac.data  -p 172.168.146.109 -l

Logging in to[iface: default, target: iqn.2006-01.com.openfiler:rac.data, portal:172.168.146.109,3260] (multiple)

Login to [iface:default, target: iqn.2006-01.com.openfiler:rac.data, portal:172.168.146.109,3260] successful.

# iscsiadm -m node -T iqn.2006-01.com.openfiler:rac.fra  -p 172.168.146.109 -l

Logging in to[iface: default, target: iqn.2006-01.com.openfiler:rac.fra, portal: 172.168.146.109,3260](multiple)

Login to [iface:default, target: iqn.2006-01.com.openfiler:rac.fra, portal:172.168.146.109,3260] successful.

# iscsiadm -m node-T iqn.2006-01.com.openfiler:racdb.data1 -p 172.168.146.109 --op update -nnode.startup -v automatic

配置自動登入

[[email protected] ~]# iscsiadm -m node-T iqn.2006-01.com.openfiler:rac.crs  -p172.168.146.109 --op update -n node.startup -v automatic

[[email protected]~]#  iscsiadm -mnode -T iqn.2006-01.com.openfiler:rac.data -p 172.168.146.109 --op update -n node.startup -v automatic

[[email protected]~]#  iscsiadm -mnode -T iqn.2006-01.com.openfiler:rac.fra -p 172.168.146.109 --op update -n node.startup -v automatic

建立永久映射關系：

(以下腳本來自于網絡，經過驗證，腳本可行，無須修改 )

[[email protected]]# vi /etc/udev/rules.d/55-openiscsi.rules
 
#/etc/udev/rules.d/55-openiscsi.rules
KERNEL=="sd*",BUS=="scsi", PROGRAM="/etc/udev/scripts/iscsidev.sh %b",
SYMLINK+="iscsi/%c/part%n"
~
 
[[email protected] ~]#vi /etc/udev/scripts/iscsidev.sh
 
#!/bin/sh
# FILE:/etc/udev/scripts/iscsidev.sh
 
BUS=${1}
HOST=${BUS%%:*}
[ -e/sys/class/iscsi_host ] || exit 1
file="/sys/class/iscsi_host/host${HOST}/device/session*/iscsi_session*/
targetname"
target_name=$(cat${file})
# This is not anopen-scsi drive
if [ -z"${target_name}" ]; then
exit 1
fi
 
# Check if QNAPdrive
check_qnap_target_name=${target_name%%:*}
if [ $check_qnap_target_name= "iqn.2004-04.com.qnap" ]; then
target_name=`echo"${target_name%.*}"`
fi
 
echo"${target_name##*.}"
"/etc/udev/scripts/iscsidev.sh"22L, 497C
#!/bin/sh
# FILE:/etc/udev/scripts/iscsidev.sh
 
BUS=${1}
HOST=${BUS%%:*}
[ -e /sys/class/iscsi_host] || exit 1
file="/sys/class/iscsi_host/host${HOST}/device/session*/iscsi_session*/
targetname"
target_name=$(cat${file})
# This is not anopen-scsi drive
if [ -z"${target_name}" ]; then
exit 1
fi
 
# Check if QNAPdrive
check_qnap_target_name=${target_name%%:*}
if [$check_qnap_target_name = "iqn.2004-04.com.qnap" ]; then
target_name=`echo"${target_name%.*}"`
fi
 
echo"${target_name##*.}"
 
 
           

做完後通過指令 fdisk 或直接 到/dev/disk/by-path下面可以看到映射到的新盤。  比如 /dev/sdb  /dev/sdc /dev/sde

可能的問題：DB機器上發現不了

---openfiler2.99，openfile2.3都适用

[[email protected]~]#  iscsiadm -m discovery -t sendtargets-p 172.168.146.110

iscsiadm: Noportals found

[[email protected] network-scripts]# cat/etc/initiators.allow

# PLEASE DO NOT MODIFY THIS CONFIGURATIONFILE!

#      This configuration file was autogenerated

#      by Openfiler. Any manual changes will be overwritten

#      Generated at: Tue Apr 1 9:48:28 CST 2014

iqn.2006-01.com.openfiler:rac.crs  172.168.146.51/24, 172.168.146.52/24

iqn.2006-01.com.openfiler:rac.data  172.168.146.51/24, 172.168.146.52/24

iqn.2006-01.com.openfiler:rac.fra  172.168.146.51/24, 172.168.146.52/24

# End of Openfiler configuration

[[email protected] network-scripts]# cat /etc/initiators.deny

# PLEASE DO NOT MODIFY THIS CONFIGURATIONFILE!

#      This configuration file was autogenerated

#      by Openfiler. Any manual changes will be overwritten

#      Generated at: Tue Apr 1 9:48:28 CST 2014

iqn.2006-01.com.openfiler:rac.crs ALL

iqn.2006-01.com.openfiler:rac.data ALL

iqn.2006-01.com.openfiler:rac.fra ALL

# End of Openfiler configuration

[[email protected] network-scripts]#

注釋掉了/etc/initiators.deny 檔案中的内容，通路正常。

#iqn.2006-01.com.openfiler:rac.crs ALL

#iqn.2006-01.com.openfiler:rac.data ALL

#iqn.2006-01.com.openfiler:rac.fra ALL

[[email protected] ~]#  iscsiadm -m discovery -t sendtargets -p172.168.146.110

172.168.146.110:3260,1iqn.2006-01.com.openfiler:rac.fra

172.168.146.110:3260,1iqn.2006-01.com.openfiler:rac.data

172.168.146.110:3260,1iqn.2006-01.com.openfiler:rac.crs