No disk under /dev/rdisk

Mousa55 — Sun, 09 Jun 2013 12:02:10 GMT

Hi,

i have 2 node (HP-UX 11.31) with oracle rac, and we have 3 disk from SAN storage assigned to both node for ASM data.

i can see the 3 disk on both server by ioscan command, like below

disk     10 64000/0xfa00/0x3 esdisk   CLAIMED     DEVICE       HP      OPEN-V
                      /dev/disk/disk10   /dev/rdisk/disk10
disk     12 64000/0xfa00/0x4 esdisk   CLAIMED     DEVICE       HP      OPEN-V
                      /dev/disk/disk12   /dev/rdisk/disk12
disk     11 64000/0xfa00/0x5 esdisk   CLAIMED     DEVICE       HP      OPEN-V
                      /dev/disk/disk11   /dev/rdisk/disk11
disk     13 64000/0xfa00/0x6 esdisk   CLAIMED     DEVICE       HP      OPEN-V
                      /dev/disk/disk13   /dev/rdisk/disk13

but i can't see the disk on node 1 under /dev/rdisk but on other node it's available

Node 1

=======

#cd /dev/rdisk
#ll
total 0
crw-r-----   1 bin        sys         13 0x000001 Jun 4 09:59 disk1
crw-r-----   1 bin        sys         13 0x000003 Jun 4 09:59 disk10
crw-r-----   1 bin        sys         13 0x000005 Jun 4 10:03 disk11
crw-r-----   1 bin        sys         13 0x000004 Jun 4 09:59 disk12
crw-r-----   1 bin        sys         13 0x000006 Jun 4 09:59 disk13
crw-r-----   1 bin        sys         13 0x000007 Jun 4 09:59 disk1_p1
crw-r-----   1 bin        sys         13 0x000008 Jun 4 09:59 disk1_p2
crw-r-----   1 bin        sys         13 0x000009 Jun 4 09:59 disk1_p3

Node2

=====

crw-r-----   1 bin        sys         13 0x000001 Dec 11 2011 disk1
crw-r-----   1 bin        sys         13 0x000006 Dec 13 2011 disk10
crw-r-----   1 bin        sys         13 0x000007 Dec 13 2011 disk11
crw-r-----   1 bin        sys         13 0x000008 Dec 13 2011 disk12
crw-r-----   1 bin        sys         13 0x000009 Dec 13 2011 disk13
crw-r-----   1 bin        sys         13 0x000002 Dec 11 2011 disk1_p1
crw-r-----   1 bin        sys         13 0x000003 Dec 11 2011 disk1_p2
crw-r-----   1 bin        sys         13 0x000004 Dec 11 2011 disk1_p3
crw-rw-rw-   1 oracle     oinstall    13 0x000007 Jun 9 14:47 smh_data
crw-rw-rw-   1 oracle     oinstall    13 0x000008 Jun 9 14:47 smh_fra
crw-rw-rw-   1 oracle     oinstall    13 0x000006 Jun 9 14:47 smh_ocr_vd

and i run this command on node1 and i found the below

#scsimgr lun_map -D /dev/rdisk/disk10

LUN PATH INFORMATION FOR LUN : /dev/rdisk/disk10

Total number of LUN paths = 2
World Wide Identifier(WWID) = 0x60060e80164d4c0000014d4c00000600

LUN path : lunpath4
Class                         = lunpath
Instance                      = 4
Hardware path                 = 0/0/0/5/0/0/0.0x50060e80164d4c41.0x4000000000000000
SCSI transport protocol       = fibre_channel
State                         = UNOPEN
Last Open or Close state      = ACTIVE

LUN path : lunpath9
Class                         = lunpath
Instance                      = 9
Hardware path                 = 0/0/0/5/0/0/1.0x50060e80164d4c51.0x4000000000000000
SCSI transport protocol       = fibre_channel
State                         = UNOPEN
Last Open or Close state      = ACTIVE

on Node2

========

#scsimgr lun_map -D /dev/rdisk/disk10

LUN PATH INFORMATION FOR LUN : /dev/rdisk/disk10

Total number of LUN paths = 2
World Wide Identifier(WWID) = 0x60060e80164d4c0000014d4c00000600

LUN path : lunpath4
Class                         = lunpath
Instance                      = 4
Hardware path                 = 0/0/0/5/0/0/0.0x50060e80164d4c40.0x4000000000000000
SCSI transport protocol       = fibre_channel
State                         = ACTIVE
Last Open or Close state      = ACTIVE

LUN path : lunpath8
Class                         = lunpath
Instance                      = 8
Hardware path                 = 0/0/0/5/0/0/1.0x50060e80164d4c50.0x4000000000000000
SCSI transport protocol       = fibre_channel
State                         = ACTIVE
Last Open or Close state      = ACTIVE

please your support

thanks

Re: No disk under /dev/rdisk

Aneesh Mohan — Sun, 09 Jun 2013 14:29:45 GMT

Can you confirm the below device files in the node2 is not created manually or using ASMLib asmlibraries.

Aneesh

Re: No disk under /dev/rdisk

Mousa55 — Mon, 10 Jun 2013 06:12:57 GMT

Hi,

yes it's created by using ASMLib asmlibraries.

Thanks

Re: No disk under /dev/rdisk

Emil Velez_2 — Wed, 12 Jun 2013 19:32:33 GMT

you should be able to do a insf -e to recreate device files that are missing.. IT should not interfear with device files already created.

Re: No disk under /dev/rdisk

Bill Hassell — Thu, 13 Jun 2013 04:28:41 GMT

>> you should be able to do a insf -e to recreate device files that are missing..

>> IT should not interfear with device files already created.

Actually, a very BAD suggestion.

insf -e will change the ownership and permissions of every device file!!!

The man page does not provide any emphasis on just how bad this is, but does describe the behavior as a "reinstall".

So every disk LUN including Oracle ASM disks (or Sybase or Informix...) will be changed to bin:sys, and permissions changed to what insf thinks is proper, usually resulting is a database failure.

The man page also implies that the way to recreate missing device files is -e but this isn't the only way.

The safe usage is insf -C <class> as in insf -C disk

This will install any missing or newly discovered disk device files, without modifying existing device files.

Unfortunately many documents and trainng materials recommend insf -e and fail to mention insf -C or to provide a warning about -e.

topic Re: No disk under /dev/rdisk in Operating System - HP-UX

No disk under /dev/rdisk

Re: No disk under /dev/rdisk

Re: No disk under /dev/rdisk

Re: No disk under /dev/rdisk

Re: No disk under /dev/rdisk