What is being announced?
This document is only about support delivery for GFS, LVM and LVM2. If you are looking for product or configuration certification / supportability check MetaLink Certification and specific product related documents likeNote 329530.1 Using Redhat Global File System (GFS) as shared storage for
RAC
The following information has been updated on April 4th, 2007.Enterprise Linux Support for GFS
Global File System (GFS) is available on Enterprise Linux 4. Oracle Enterprise Linux Support team does not provide support for GFS on EL4/RHEL4 or earlier.Enterprise Linux Support for LVM
Enterprise Linux Support team does not provide support for Logical Volume Manager (LVM) for clustered environments and support is provided for single node situations only.Enterprise Linux Support for LVM2
Enterprise Linux Support team does not provide support for Logical Volume Manager 2 (LVM2) for clustered environments and support is provided for single node situations only.OCFS2 Support for LVM/LVM2
As of latest update of this document any combination of OCFS2 with LVM or LVM2 is not supported including clustered and single node configurations.What do you need to do?
If you are running any of the unsupported configurations described above, change your configuration to a supported one to be able to get support from Oracle Enterprise Linux Support team.Who to contact for more information?
Contact Oracle Enterprise Linux Support Team by filing a Service Request via MetaLink.
其實把裸裝置綁定以後 就成了字元裝置 跟aix hp下面的管理方式就完全一樣了
使用raw /dev/raw/raw1 /dev/datavg01/ocr01 之類的。。。 不多說 下面來正題
在執行root.sh的時候報錯 log如下：
2010-09-04 04:06:38.230: [ OCRRAW][3842053264]propriogid:1: INVALID FORMAT
2010-09-04 04:06:38.231: [ OCRRAW][3842053264]ibctx:1:ERROR: INVALID FORMAT
2010-09-04 04:06:38.231: [ OCRRAW][3842053264]proprinit:problem reading the bootblock or superbloc 22
2010-09-04 04:06:38.231: [ default][3842053264]a_init:7!: Backend init unsuccessful : [22]
2010-09-04 04:06:38.231: [OCRCHECK][3842053264]Failed to initialize OCR context: [PROC-22: The OCR backend has an invalid format]
2010-09-04 04:06:38.231: [OCRCHECK][3842053264]Failed to initialize ocrchek2
2010-09-04 04:06:38.231: [OCRCHECK][3842053264]Exiting [status=failed]...
[[email protected] client]# more ocrconfig_21058.log
Oracle Database 10g CRS Release 10.2.0.1.0 Production Copyright 1996, 2005 Oracle. All rights reserved.
2010-09-04 03:45:09.706: [ OCRCONF][1704617104]ocrconfig starts...
2010-09-04 03:45:09.706: [ OCRCONF][1704617104]Upgrading OCR data
2010-09-04 03:45:09.845: [ OCRRAW][1704617104]propriogid:1: INVALID FORMAT
2010-09-04 03:45:09.845: [ OCRRAW][1704617104]ibctx:1:ERROR: INVALID FORMAT
2010-09-04 03:45:09.845: [ OCRRAW][1704617104]proprinit:problem reading the bootblock or superbloc 22
2010-09-04 03:45:09.845: [ default][1704617104]a_init:7!: Backend init unsuccessful : [22]
2010-09-04 03:45:09.845: [ OCRCONF][1704617104]Exporting OCR data to [OCRUPGRADEFILE]
2010-09-04 03:45:09.845: [ OCRAPI][1704617104]a_init:7!: Backend init unsuccessful : [33]
2010-09-04 03:45:09.846: [ OCRCONF][1704617104]There was no previous version of OCR. error:[PROC-33: Oracle Cluster Registry is not configured]
2010-09-04 03:45:09.853: [ OCRRAW][1704617104]propriogid:1: INVALID FORMAT
2010-09-04 03:45:09.854: [ OCRRAW][1704617104]ibctx:1:ERROR: INVALID FORMAT
2010-09-04 03:45:09.854: [ OCRRAW][1704617104]proprinit:problem reading the bootblock or superbloc 22
2010-09-04 03:45:09.854: [ default][1704617104]a_init:7!: Backend init unsuccessful : [22]
2010-09-04 03:45:09.862: [ OCRRAW][1704617104]propriogid:1: INVALID FORMAT
2010-09-04 03:45:09.862: [ OCRRAW][1704617104]ibctx:1:ERROR: INVALID FORMAT
2010-09-04 03:45:09.862: [ OCRRAW][1704617104]proprinit:problem reading the bootblock or superbloc 22
2010-09-04 03:45:09.870: [ OCRRAW][1704617104]propriogid:1: INVALID FORMAT
2010-09-04 03:45:09.986: [ OCRRAW][1704617104]propriowv: Vote information on disk 0 [/dev/raw/raw20] is adjusted from [0/0] to [2/2]
2010-09-04 03:45:10.000: [ OCRRAW][1704617104]propriniconfig:No 92 configuration
2010-09-04 03:45:10.000: [ OCRAPI][1704617104]a_init:6a: Backend init successful
2010-09-04 03:45:10.066: [ OCRCONF][1704617104]Initialized DATABASE keys in OCR
2010-09-04 03:45:10.082: [ OCRCONF][1704617104]csetskgfrblock0: clsfmt returned with error [4].
2010-09-04 03:45:10.082: [ OCRCONF][1704617104]Failure in setting block0 [-1]
2010-09-04 03:45:10.082: [ OCRCONF][1704617104]OCR block 0 is not set !
2010-09-04 03:45:10.082: [ OCRCONF][1704617104]Exiting [status=failed]...
很怪異 一般無非就是權限的問題 我看了下 裸裝置 以及lv都沒問題 咋會報錯呢
開始還以為是沒有dd幹淨 重新來過錯誤依舊 郁悶。。。
最後發現原來是個bug 我汗 如下：Executing root.sh errors with "Failed To Upgrade Oracle Cluster Registry Configuration" [ID 466673.1]
修改時間 07-JUN-2010 類型 PROBLEM 狀态 PUBLISHED
Applies to:Oracle Server - Enterprise Edition - Version: 10.2.0.1 and later [Release: 10.2 and later ]
Linux x86
IBM: Linux on POWER Systems
Linux x86-64
Linux Itanium
SymptomsOn a new clusterware installation on Linux root.sh script is failing with the following error while running root.sh on the first node:
PROT-1: Failed to initialize ocrconfig
Failed to upgrade Oracle Cluster Registry configuration
The problem can be tracked down to clsfmt command:
./clsfmt ocr /dev/raw/raw1
clsfmt: Received unexpected error 4 from skgfifi
skgfifi: Additional information: -2
Additional information: 1000718336
ChangesIt has been found that the following changes can cause this problem to occur:
1. Use Mutiple Path (MP) disk configuration, may hit this issue.
2. Use EMC device (powerpath**) may hit this issue.
But it was not confirmed that these are the only things that can cause this problem to occur, as it has been found that on other hardware and configuration the problem might occur, the key change in this issue is that if the disk size presented from the storage to the cluster nodes are not dividable by 4K the problem should occur.
CauseThis issue is addressed in Bug:4679769 which states that this is a known issue with the clusterware installation on platforms: Linux x86, x86-64 and "IBM Power Based Linux".
SolutionBefore running the root.sh on the first node in the cluster do the following:
1. Download Patch:4679769 from Metalink (contains a patched version of clsfmt.bin).
2. Do the following steps as stated in the patch README to fix the problem:
Note: clsfmt.bin need only be replaced on the 1st node of the cluster
# Patch Installation Instructions:
# --------------------------------
# To apply the patch, unzip the PSE container file:
#
# p4679769_10201_LINUX.zip
#
# Set your current directory to the directory where the patch
# is located:
#
# % cd 4679769
#
# Copy the clsfmt.bin binary to the $ORACLE_HOME/bin directory where
# clsfmt is being run:
#
# % cp $ORACLE_HOME/bin/clsfmt.bin $ORACLE_HOME/bin/clsfmt.bin.bak
# % cp clsfmt.bin $ORACLE_HOME/bin/clsfmt.bin
#
# Ensure permissions on the clsfmt.bin binary are correct:
#
# % chmod 755 $ORACLE_HOME/bin/clsfmt.bin
3. Run the root.sh script and proceed with the installation.
ReferencesBUG:4679769 - FAILED TO FORMAT OCR DISK USING CLSFMT
打該patch很簡單 直接cp過去覆寫就OK了 覆寫以後 先把ocr和voting dd掉 再執行root.sh即可。下面是我後執行的結果：[[email protected] raw]# /opt/oracle/product/10.2/crs/root.sh
WARNING: directory '/opt/oracle/product/10.2' is not owned by root
WARNING: directory '/opt/oracle/product' is not owned by root
WARNING: directory '/opt/oracle' is not owned by root
Checking to see if Oracle CRS stack is already configuredSetting the permissions on OCR backup directory
Setting up NS directories
Oracle Cluster Registry configuration upgraded successfully
WARNING: directory '/opt/oracle/product/10.2' is not owned by root
WARNING: directory '/opt/oracle/product' is not owned by root
WARNING: directory '/opt/oracle' is not owned by root
Successfully accumulated necessary OCR keys.
Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node :
node 1: rac1 rac1-priv rac1
node 2: rac2 rac2-priv rac2
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
Now formatting voting device: /dev/raw/raw21
Format of 1 voting devices complete.
Startup will be queued to init within 90 seconds.
Adding daemons to inittab
Expecting the CRS daemons to be up within 600 seconds.
CSS is active on these nodes.
rac1
CSS is inactive on these nodes.
rac2
Local node checking complete.
Run root.sh on remaining nodes to start CRS daemons. 最後手動執行vpica 完事收工 [[email protected] sysconfig]$ crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.hongshu.db application ONLINE ONLINE rac2
ora....u1.inst application ONLINE ONLINE rac1
ora....u2.inst application ONLINE ONLINE rac2
ora....C1.lsnr application ONLINE ONLINE rac1
ora.rac1.gsd application ONLINE ONLINE rac1
ora.rac1.ons application ONLINE ONLINE rac1
ora.rac1.vip application ONLINE ONLINE rac1
ora....C2.lsnr application ONLINE ONLINE rac2
ora.rac2.gsd application ONLINE ONLINE rac2
ora.rac2.ons application ONLINE ONLINE rac2
ora.rac2.vip application ONLINE ONLINE rac2