No disk under /dev/rdisk

[Mousa55]

Hi,

i have 2 node (HP-UX 11.31) with oracle rac, and we have 3 disk from SAN storage assigned to both node for ASM data.

i can see the 3 disk on both server by ioscan command, like below

disk     10  64000/0xfa00/0x3  esdisk   CLAIMED     DEVICE       HP      OPEN-V
                      /dev/disk/disk10   /dev/rdisk/disk10
disk     12  64000/0xfa00/0x4  esdisk   CLAIMED     DEVICE       HP      OPEN-V
                      /dev/disk/disk12   /dev/rdisk/disk12
disk     11  64000/0xfa00/0x5  esdisk   CLAIMED     DEVICE       HP      OPEN-V
                      /dev/disk/disk11   /dev/rdisk/disk11
disk     13  64000/0xfa00/0x6  esdisk   CLAIMED     DEVICE       HP      OPEN-V
                      /dev/disk/disk13   /dev/rdisk/disk13 

but i can't see the disk on node 1 under /dev/rdisk but on other node it's available

Node 1

=======

#cd /dev/rdisk
#ll
total 0
crw-r-----   1 bin        sys         13 0x000001 Jun  4 09:59 disk1
crw-r-----   1 bin        sys         13 0x000003 Jun  4 09:59 disk10
crw-r-----   1 bin        sys         13 0x000005 Jun  4 10:03 disk11
crw-r-----   1 bin        sys         13 0x000004 Jun  4 09:59 disk12
crw-r-----   1 bin        sys         13 0x000006 Jun  4 09:59 disk13
crw-r-----   1 bin        sys         13 0x000007 Jun  4 09:59 disk1_p1
crw-r-----   1 bin        sys         13 0x000008 Jun  4 09:59 disk1_p2
crw-r-----   1 bin        sys         13 0x000009 Jun  4 09:59 disk1_p3

Node2

=====

crw-r-----   1 bin        sys         13 0x000001 Dec 11  2011 disk1
crw-r-----   1 bin        sys         13 0x000006 Dec 13  2011 disk10
crw-r-----   1 bin        sys         13 0x000007 Dec 13  2011 disk11
crw-r-----   1 bin        sys         13 0x000008 Dec 13  2011 disk12
crw-r-----   1 bin        sys         13 0x000009 Dec 13  2011 disk13
crw-r-----   1 bin        sys         13 0x000002 Dec 11  2011 disk1_p1
crw-r-----   1 bin        sys         13 0x000003 Dec 11  2011 disk1_p2
crw-r-----   1 bin        sys         13 0x000004 Dec 11  2011 disk1_p3
crw-rw-rw-   1 oracle     oinstall    13 0x000007 Jun  9 14:47 smh_data
crw-rw-rw-   1 oracle     oinstall    13 0x000008 Jun  9 14:47 smh_fra
crw-rw-rw-   1 oracle     oinstall    13 0x000006 Jun  9 14:47 smh_ocr_vd

and i run this command on node1 and i found the below

 #scsimgr lun_map -D /dev/rdisk/disk10

        LUN PATH INFORMATION FOR LUN : /dev/rdisk/disk10

Total number of LUN paths     = 2
World Wide Identifier(WWID)    = 0x60060e80164d4c0000014d4c00000600

LUN path : lunpath4
Class                         = lunpath
Instance                      = 4
Hardware path                 = 0/0/0/5/0/0/0.0x50060e80164d4c41.0x4000000000000000
SCSI transport protocol       = fibre_channel
State                         = UNOPEN
Last Open or Close state      = ACTIVE

LUN path : lunpath9
Class                         = lunpath
Instance                      = 9
Hardware path                 = 0/0/0/5/0/0/1.0x50060e80164d4c51.0x4000000000000000
SCSI transport protocol       = fibre_channel
State                         = UNOPEN
Last Open or Close state      = ACTIVE

on Node2

========

#scsimgr lun_map -D /dev/rdisk/disk10

        LUN PATH INFORMATION FOR LUN : /dev/rdisk/disk10

Total number of LUN paths     = 2
World Wide Identifier(WWID)    = 0x60060e80164d4c0000014d4c00000600

LUN path : lunpath4
Class                         = lunpath
Instance                      = 4
Hardware path                 = 0/0/0/5/0/0/0.0x50060e80164d4c40.0x4000000000000000
SCSI transport protocol       = fibre_channel
State                         = ACTIVE
Last Open or Close state      = ACTIVE

LUN path : lunpath8
Class                         = lunpath
Instance                      = 8
Hardware path                 = 0/0/0/5/0/0/1.0x50060e80164d4c50.0x4000000000000000
SCSI transport protocol       = fibre_channel
State                         = ACTIVE
Last Open or Close state      = ACTIVE

please your support

thanks

[Aneesh Mohan]

Can you confirm the below device files in the node2 is  not created manually or using ASMLib asmlibraries.

Aneesh

[Mousa55]

Hi,

yes it's created by using ASMLib asmlibraries.

Thanks

[Emil Velez_2]

you should be able to do a insf -e to recreate device files that are missing.. IT should not interfear with device files already created.

[Bill Hassell]

>> you should be able to do a insf -e to recreate device files that are missing..

>> IT should not interfear with device files already created.

Actually, a very BAD suggestion.

insf -e will change the ownership and permissions of every device file!!!

The man page does not provide any emphasis on just how bad this is, but does describe the behavior as a "reinstall".

So every disk LUN including Oracle ASM disks (or Sybase or Informix...) will be changed to bin:sys, and permissions changed to what insf thinks is proper, usually resulting is a database failure.

The man page also implies that the way to recreate missing device files is -e but this isn't the only way.

The safe usage is insf -C <class> as in insf -C disk

This will install any missing or newly discovered disk device files, without modifying existing device files.

 Unfortunately many documents and trainng materials recommend insf -e and fail to mention insf -C or to provide a warning about -e.