topic Re: Problem with RHEL AS 4 with Virtual Disk form EVA3000 in Operating System - Linux

Problem with RHEL AS 4 with Virtual Disk form EVA3000

Sebastian Szewczyk — Tue, 15 Jan 2008 08:08:13 GMT

Hi
I have problem with my RHEL AS4 Update 5.
I configured five LUNS.
My problem is that if I reboot server, sometimes change the special files associated to LUN.
This in not a problem with LVM2 but on one of this LUN's I have rawdevices on which I have installed Oracle Clusterware. And after restart Linux change the /dev/sda become /dev/sdb and this is a huge problem because Oracle Clusterware isn't startet properly. I must change /etc/sysconfig/rawdevices and restart service rawdevices?

Any suggestion please?
Thanks seboizm

Re: Problem with RHEL AS 4 with Virtual Disk form EVA3000

Rob Leadbeater — Tue, 15 Jan 2008 10:08:51 GMT

Hi,

This shouldn't happen. Can you confirm what multipathing software you're using, if any...

Cheers,

Rob

Re: Problem with RHEL AS 4 with Virtual Disk form EVA3000

Sebastian Szewczyk — Tue, 15 Jan 2008 10:16:35 GMT

Only I have installed rpm like -

device-mapper-multipath-0.4.5-21.RHEL4

Do yo think that i can do with /etc/multipath.conf in my situation.

Best regards
seboizm

Re: Problem with RHEL AS 4 with Virtual Disk form EVA3000

Rob Leadbeater — Tue, 15 Jan 2008 10:27:21 GMT

Hi,

I'd avoid device-mapper-multipath.

If you're using QLogic HBAs, then the failover options built into the drivers work fine...

Cheers,
Rob

Re: Problem with RHEL AS 4 with Virtual Disk form EVA3000

Sebastian Szewczyk — Tue, 15 Jan 2008 12:43:46 GMT

Hello
I have two FC cards:
---info---
HP FC2142SR 4Gb PCI-e, SC, Fibre Channel Adapter on PCI bus 0e device 00 irq 177
---lpfc_drvr_version---
Emulex LightPulse Fibre Channel SCSI driver 8.0.16.32

What can i do with my situation because after restart on one of two nodes change /dev/sda on /dev/sdj and my rawdevices not started and Clusterware and ASM dosen't start properly?

Best regards
seboizm

Re: Problem with RHEL AS 4 with Virtual Disk form EVA3000

Rob Leadbeater — Tue, 15 Jan 2008 14:32:58 GMT

Hi,

I've never used these cards, but it looks like you should use these drivers:

http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareDescription.jsp?lang=en&cc=us&prodTypeId=12169&prodSeriesId=1809835&swItem=co-51731-1&prodNameId=1143949&swEnvOID=2025&swLang=8&taskId=135&mode=4&idx=0

You should use INSTALL -m option to enable failover mode...

Hope this helps,

Regards,

Rob

Re: Problem with RHEL AS 4 with Virtual Disk form EVA3000

Sebastian Szewczyk — Tue, 15 Jan 2008 14:49:11 GMT

Oki youh have me driver which have something like that:
hp-lpfc-2007-06-19.tar.gz:
fibreutils-2.3-2.linux.i386.rpm
fibreutils-2.3-2.linux.ia64.rpm
fibreutils-2.3-2.linux.x86_64.rpm
hp-lpfc-7.3.6-6.linux.rpm
hp-lpfc-8.0.16.32-4.linux.rpm
hp-lpfc-8.1.6.8-5.linux.rpm
hp-multipulse-2.2.22-1.linux.rpm

On my server now i have installed:
[root@serv1 ~]# rpm -qa | grep fibreutils
fibreutils-2.3-4
[root@serv1 ~]# rpm -qa | grep hp-lpfc
hp-lpfc-8.0.16.32-4
[root@serv1 ~]# rpm -qa | grep hp-multi
My rpm's is newer than your prpose driver - what can i do in that situation.
Only I don't have hp-multipulse.
On my linux after install them always I isntall last SupportPack with newest driver for dedicated operating system....
You have some proposution.
I think about Firmware - my FC card is - HP FC2142SR 4Gb PCI-e HBA Firmware Version: 2.50A6 - but on hp portal i see 2.72a2 version of firmware. What do you think upgrade firmware that's my problem?

Best regards
seboizm

Re: Problem with RHEL AS 4 with Virtual Disk form EVA3000

Reiß, Thomas — Wed, 16 Jan 2008 07:21:57 GMT

What happen when you not use device name /dev/sda, but /dev/disk/by-name (or -path or -wwn or whatever you found as alternate Device name)?

Re: Problem with RHEL AS 4 with Virtual Disk form EVA3000

Sebastian Szewczyk — Wed, 16 Jan 2008 07:40:09 GMT

So in Oracle ASM and Clusterware I must used /dev/sdx because in/etc/sysconfig/rawdevices defitnition raw partition is like that:
/dev/raw/raw1 /dev/sde1
/dev/raw/raw2 /dev/sde2
/dev/raw/raw3 /dev/sde3
/dev/raw/raw4 /dev/sde5
/dev/raw/raw5 /dev/sde6
where /dev/sde is:
sde 0,0,1,5 HP HSV100 3028
and alternate form second FC card:
sdf 1,0,0,5 HP HSV100 3028
After restart server character device is change on /dev/sda and /dev/sdj and rawdevices isn't start at start the server and ASM and Cluster ware don't start too.
You have some suggestion

Best regards
seboizm

Re: Problem with RHEL AS 4 with Virtual Disk form EVA3000

Bharath_Pingali — Wed, 16 Jan 2008 13:43:42 GMT

Hello Seboizm and All,

Can you try using "udev"? This will ensure that the device names dont change on reboot.

The new devices will be under /dev/disk/.

-Thank You
Bharath

Re: Problem with RHEL AS 4 with Virtual Disk form EVA3000

TwoProc — Wed, 16 Jan 2008 20:45:35 GMT

This might be kudzu killing you.

find the script in /etc/rc3.d (assuming you're running servers at lvl 3 and not 5) that has kudzu in it. Mine is "S05kudzu", and rename it to "s05kudzu" so that it doesn't start on reboot and see if your problem goes away.

Re: Problem with RHEL AS 4 with Virtual Disk form EVA3000

TwoProc — Wed, 16 Jan 2008 20:46:41 GMT

Oh, just an fyi - kudzu is the program that goes out and looks for new hardware, and assigns devices, etc to them. Don't let it. I turn this off of ALL servers that I have.