error discovering the disk for ASM diskgroup creation

[user1221]

Hi All,
I want to create a database with ASM on HP-Unix 11.31, I want to assign the local disk for the ASM diskgroup, but while creation of ASM instance the DBCA is not able to discover the disk,

oracle@hrdbdr01:/dev/rdsk$ ll
total 0
crw-r--r-- 1 bin sys 188 0x006000 Dec 15 16:50 c0t6d0
crw-r--r-- 1 bin sys 188 0x006001 Dec 15 16:50 c0t6d0s1
crw-r--r-- 1 bin sys 188 0x006002 Dec 15 16:50 c0t6d0s2
crw-r--r-- 1 bin sys 188 0x006003 Dec 15 16:50 c0t6d0s3
crw-r--r-- 1 bin sys 188 0x012000 Dec 15 16:50 c1t2d0
crw-rw---- 1 oracle dba 188 0x036000 May 5 12:35 c3t6d0
crw-rw---- 1 bin sys 188 0x036001 Dec 15 16:50 c3t6d0s1
crw-rw---- 1 bin sys 188 0x036002 Dec 15 16:50 c3t6d0s2
crw-rw---- 1 bin sys 188 0x036003 Dec 15 16:50 c3t6d0s3


I want to assign the disk, /dev/rdsk/c3t6d0 for the ASM diskgroup, Oracle doc says that the disk should not be the part of an LVM Volume group, thats why I just provided the ownership to the oracle user and dba group on that disk and tried to create ASM instance but while creating diskgroup it is not discovering the disk.

PLEASE HELP!!!

Thanks & Regards

[Duncan Edmonstone]

If this is 11.31, your really shouldn't be using the legacy DSFs (unless for some reason you're using EMC PowerPath, but I can't think why anyone would want to use that on 11.31)

i) Use the new agile DSFs under /dev/rdisk
ii) set the value of the ASM parameter ASM_DISKSTRING appropriately

HTH

Duncan

[user1221]

Thanks for you reply!!!

How can set the agile DSF?

I gave the asm_diskstring=/dev/rdsk/c3t6d0 during the ASM instance creatioin using DBCA,
but it failed to discover it.

Thanks

[user1221]

root@hrdbdr01:/# ioscan -fnNkC disk
Class I H/W Path Driver S/W State H/W Type Description
===================================================================
disk 3 64000/0xfa00/0x0 esdisk CLAIMED DEVICE HP 300 GST3300655LC
/dev/disk/disk3 /dev/rdisk/disk3
/dev/disk/disk3_p1 /dev/rdisk/disk3_p1
/dev/disk/disk3_p2 /dev/rdisk/disk3_p2
/dev/disk/disk3_p3 /dev/rdisk/disk3_p3
disk 4 64000/0xfa00/0x1 esdisk CLAIMED DEVICE Optiarc DVD RW AD-5170A
/dev/disk/disk4 /dev/rdisk/disk4
disk 5 64000/0xfa00/0x9 esdisk CLAIMED DEVICE HP 300 GST3300655LC
/dev/disk/disk5 /dev/rdisk/disk5
/dev/disk/disk5_p1 /dev/rdisk/disk5_p1
/dev/disk/disk5_p2 /dev/rdisk/disk5_p2
/dev/disk/disk5_p3 /dev/rdisk/disk5_p3


I want to use /dev/rdisk/disk5 as a diskstring, but I want to change its name to /dev/rdisk/asm_data1a and also the partitions disk5_p1, disk5_p2, disk5_p3, how can I use them? do I need to change the name for those as well? or should I assign only hte disk5 with the changed name i.r; /dev/rdisk/asm_data1a to the asm_diskstring???

Thanks.

[Duncan Edmonstone]

aren't these devices your boot disks? You can't use your boot disks as ASM disks!

what's the output of

lvlnboot -v vg00


HTH

Duncan

[user1221]

Hte disk /dev/rdisk/disk5 is not a boot disk and it is not under any volume group.

root@hrdbdr01:/# lvlnboot -v vg00
Boot Definitions for Volume Group /dev/vg00:
Physical Volumes belonging in Root Volume Group:
/dev/disk/disk3_p2 -- Boot Disk
Boot: lvol1 on: /dev/disk/disk3_p2
Root: lvol3 on: /dev/disk/disk3_p2
Swap: lvol2 on: /dev/disk/disk3_p2
Dump: lvol2 on: /dev/disk/disk3_p2, 0

root@hrdbdr01:/dev/rdisk# ll
total 0
crw-r----- 1 bin sys 23 0x000000 Dec 15 16:50 disk3
crw-r----- 1 bin sys 23 0x00002e Dec 15 16:50 disk3_p1
crw-r----- 1 bin sys 23 0x000035 Feb 19 11:55 disk3_p2
crw-r----- 1 bin sys 23 0x000036 Dec 15 16:50 disk3_p3
crw-r----- 1 bin sys 23 0x000001 Dec 15 16:50 disk4
crw-rw---- 1 oracle dba 23 0x000009 Dec 15 16:50 disk5
crw-rw---- 1 oracle dba 23 0x000037 Dec 15 16:50 disk5_p1
crw-rw---- 1 oracle dba 23 0x000038 Dec 15 16:50 disk5_p2
crw-rw---- 1 oracle dba 23 0x000039 Dec 15 16:50 disk5_p3

I tried again with the dbca, it is raising ORA -15032 and ORA-15063 errors, ASM discovered an insufficient number of disks for diskgroup "DATADG".

[Duncan Edmonstone · Accepted solution]

A few points...

1. if disk5 isn't a boot disk, why does it have partitions on it - I expect you need to get rid of those...

use:

idisk -R /dev/rdisk/disk5

to remove the partitions, then use rmsf to get rid of all the partition DSFs (both agile and legacy DSFs)

rmsf /dev/disk/disk5_p*
rmsf /dev/rdisk/disk5_p*
rmsf /dev/dsk/c3t6d0s*
rmsf /dev/rdsk/c3t6d0s*


2. The error message suggests that the disk already has ASM headers on it - has it been used for ASM before? If you have patch PHCO_38368 or the superseding patch PHCO_38803 you will have the diskowner command which you can use against the DSFD to determine what sort of volume headers if any are on the disk...

3. If it has been used for ASM before you should overwrite the first few MB of the disk to get rid of the old ASM data on there which can confuse the ASM instance. You can do this using dd:

dd if=/dev/zero of=/dev/rdisk/disk5 bs=1024 count=10240

4. If you only have the one disk, make sure when you are creating the disk group you specifcy "external redundancy", as you won't be able to do "normal redundancy" with just a single disk (nowhere to mirror to)

5. I generally create some new DSFs to represent my ASM disks, to keep them seperate from the other disks in the system. In your case you could do something like this:

mkdir /asm
mknod /asm/asm_data1a c 23 0x000009
chown -R oracle:dba /asm

Then set asm_diskstring=/asm

That way if someone runs "insf -e", your disk permissions won't get set back to bin:sys

HTH

Duncan

[user1221]

Thanks for your reply!!!

root@hrdbdr01:/# idisk -R /dev/rdisk/disk5
idisk version: 1.44
********************** WARNING ************
If you continue you will destroy all partition data on this disk.
Do you wish to continue(yes/no)? yes
root@hrdbdr01:/# cd /dev/rdisk

cannot remove the partitions using rmsf command,
root@hrdbdr01:/dev/disk# ls
disk3 disk3_p2 disk4 disk5_p1 disk5_p3 disk3_p1 disk3_p3 disk5 disk5_p2

root@hrdbdr01:/dev/disk# rmsf disk5_p*
rmsf: disk5_p1: No such file or directory
rmsf: disk5_p2: No such file or directory
rmsf: disk5_p3: No such file or directory

root@hrdbdr01:/dev/rdisk# ls
disk3 disk3_p2 disk4 disk5_p1 disk5_p3 disk3_p1 disk3_p3 disk5 disk5_p2

root@hrdbdr01:/dev/rdisk# rmsf disk5_p*
rmsf: disk5_p1: No such file or directory
rmsf: disk5_p2: No such file or directory
rmsf: disk5_p3: No such file or directory

root@hrdbdr01:/dev/dsk# ls
c0t6d0 c0t6d0s2 c1t2d0 c3t6d0s1 c3t6d0s3 c0t6d0s1 c0t6d0s3 c3t6d0 c3t6d0s2

root@hrdbdr01:/dev/dsk# rmsf c3t6d0s*
rmsf: c3t6d0s1: No such file or directory
rmsf: c3t6d0s2: No such file or directory
rmsf: c3t6d0s3: No such file or directory

root@hrdbdr01:/dev/rdsk# ls
c0t6d0 c0t6d0s2 c1t2d0 c3t6d0s1 c3t6d0s3 c0t6d0s1 c0t6d0s3 c3t6d0 c3t6d0s2

root@hrdbdr01:/dev/rdsk# rmsf c3t6d0s*
rmsf: c3t6d0s1: No such file or directory
rmsf: c3t6d0s2: No such file or directory
rmsf: c3t6d0s3: No such file or directory

2. There is no PHCO_38368 and PHCO_38803 istalled on hte server.

3. Overwrite of the disk successful
root@hrdbdr01:/dev/dsk# dd if=/dev/zero of=/dev/rdisk/disk5 bs=1024 count=10240
10240+0 records in
10240+0 records out

4. Yes I am going to create the Diskgroup with External redundancy.

5. I created a new DSF in the /dev/rdisk directory itselff with the name /dev/rdisk/asm_data1a
root@hrdbdr01:/dev/rdisk# ll
total 0
crw-rw-rw- 1 oracle dba 23 0x000009 May 10 09:19 asm_data1a
crw-r----- 1 bin sys 23 0x000000 Dec 15 16:50 disk3
crw-r----- 1 bin sys 23 0x00002e Dec 15 16:50 disk3_p1
crw-r----- 1 bin sys 23 0x000035 Feb 19 11:55 disk3_p2
crw-r----- 1 bin sys 23 0x000036 Dec 15 16:50 disk3_p3
crw-r----- 1 bin sys 23 0x000001 Dec 15 16:50 disk4
crw-rw---- 1 oracle dba 23 0x000009 May 10 08:54 disk5
crw-rw---- 1 oracle dba 23 0x000037 Dec 15 16:50 disk5_p1
crw-rw---- 1 oracle dba 23 0x000038 Dec 15 16:50 disk5_p2
crw-rw---- 1 oracle dba 23 0x000039 Dec 15 16:50 disk5_p3


I tried to create the diskgroup again
SQL> alter diskgroup datadg add disk '/dev/rdisk/asm_data1a';
alter diskgroup datadg add disk '/dev/rdisk/asm_data1a'
*
ERROR at line 1:
ORA-15032: not all alterations performed
ORA-15001: diskgroup "DATADG" does not exist or is not mounted


SQL> alter diskgroup DATADG add disk '/dev/rdsk/c3t6d0';
alter diskgroup DATADG add disk '/dev/rdsk/c3t6d0'
*
ERROR at line 1:
ORA-15032: not all alterations performed
ORA-15001: diskgroup "DATADG" does not exist or is not mounted


SQL> select GROUP_NUMBER,DISK_NUMBER,MOUNT_STATUS,HEADER_STATUS,NAME,PATH from v$asm_
disk;

no rows selected
PLEASE HELP!

Thanks & Regards

[user1221]

SQL> create diskgroup datadg external redundancy disk '/dev/rdisk/asm_data1a' size 28
5690m;
create diskgroup datadg external redundancy disk '/dev/rdisk/asm_data1a' size 285690m
*
ERROR at line 1:
ORA-15018: diskgroup cannot be created
ORA-15031: disk specification '/dev/rdisk/asm_data1a' matches no disks
ORA-15014: location '/dev/rdisk/asm_data1a' is not in the discovery set


SQL> create diskgroup datadg external redundancy disk '/dev/rdsk/c3t6d0' size 270000m
;
create diskgroup datadg external redundancy disk '/dev/rdsk/c3t6d0' size 270000m
*
ERROR at line 1:
ORA-15018: diskgroup cannot be created
ORA-15031: disk specification '/dev/rdsk/c3t6d0' matches no disks
ORA-15014: location '/dev/rdsk/c3t6d0' is not in the discovery set

[user1221]

SQL> Alter system set asm_diskstring='/dev/rdisk/asm_data1a';

SQL> select GROUP_NUMBER,DISK_NUMBER,MOUNT_STATUS,HEADER_STATUS,NAME,PATH from v$asm_
disk;
GROUP_NUMBER DISK_NUMBER MOUNT_S HEADER_STATU NAME
------------ ----------- ------- ------------ ------------
PATH
------------------------------
1 0 CACHED MEMBER DATADG_0000
/dev/rdisk/asm_data1a

The diskgroup is now created.

Now I am going to create database with the all the datafiles & controlfile in that diskgroup and the redo's, Archivelog in the local file system.

THANKS for your GREAT HELP DUNCUN !!!