Multi-path RedHat AS4 and EVA8000

Yermek Bissenbayev — Mon, 17 Apr 2006 23:45:54 GMT

Dear All,
Please help to enable multi-path on RedHat AS4.
The equipment:
1) EVA8000 2C6D.
2) Dell PowerEge 2600 with OS Linux RedHAt AS4 Kernel: 2.6.9-5.ELsmp; 2-FCA2214 (driver hp_qla2x00src 8.00.02p11 Release: 24).
3) SAN

100GB from EVA presented to a Linux server.

Disk Info:
sda 0,2,0,0 MegaRAID LD0 RAID1 69358R 2.37
sdb 1,0,0,1 HP HSV210 5031 5000-1fe1-5006-3029
sdc 1,0,1,1 HP HSV210 5031 5000-1fe1-5006-302b
sdd 1,0,2,1 HP HSV210 5031 5000-1fe1-5006-302d
sde 1,0,3,1 HP HSV210 5031 5000-1fe1-5006-302f
sdf 2,0,0,1 HP HSV210 5031 5000-1fe1-5006-3028
sdg 2,0,1,1 HP HSV210 5031 5000-1fe1-5006-302a
sdh 2,0,2,1 HP HSV210 5031 5000-1fe1-5006-302e
sdi 2,0,3,1 HP HSV210 5031 5000-1fe1-5006-302c

OS sees one VDISK disk on 8 paths. At enabled multipath (ql2xfailover Default: 1) OS should see only one, similarly to /dev/sdb. Most likely ql2xfailover don't work.

How to solve this problem??!!
Full log in attache.

Re: Multi-path RedHat AS4 and EVA8000

Ivan Ferreira — Tue, 18 Apr 2006 08:01:46 GMT

There are sometimes where the hp provided driver does not work. Try downloading the drivers from the qlogic page.

Re: Multi-path RedHat AS4 and EVA8000

Yermek Bissenbayev — Wed, 19 Apr 2006 07:00:22 GMT

Dear Ivan,

I' download from http://support.qlogic.com last versuib driver.

Please see bellow.
[root@keglin qlogic]# cd qla2xxx-8.01.03/
[root@keglin qla2xxx-8.01.03]# ls
exioct.h Makefile ql2300.c ql2400_fw.c qla2xxx_conf.c qla_cfgln.c qla_fo.c qla_gbl.h qla_iocb.c qla_mbx.c qla_sup.c qlfoln.h
exioctln.h ql2100.c ql2300_fw.c ql6312.c qla_32ioctl.c qla_dbg.c qla_fo.h qla_gs.c qla_ip.c qla_opts.h qla_version.h release.txt
extras ql2100_fw.c ql2322.c ql6312_fw.c qla_32ioctl.h qla_dbg.h qla_foln.c qla_inioct.c qla_ip.h qla_os.c qla_xioct.c revision.notes
inioct.h ql2200.c ql2322_fw.c qla2xip.c qla_cfg.c qla_def.h qla_foln.h qla_init.c qla_isr.c qla_rscn.c qlfo.h
Kconfig ql2200_fw.c ql2400.c qla2xip.h qla_cfg.h qla_devtbl.h qla_fw.h qla_inline.h qla_listops.h qla_settings.h qlfolimits.h
[root@keglin qla2xxx-8.01.03]# ./extras/build.sh
QLA2XXX -- Building the qla2xxx driver...
make: Entering directory `/usr/src/kernels/2.6.9-5.EL-i686'
scripts/Makefile.build:19: kbuild: /qla2xxx/qlogic/qla2xxx-8.01.03/Makefile - Usage of host-progs is deprecated. Please replace with hostprogs-y!
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql2100.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql2100_fw.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql2200.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql2300.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql2200_fw.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql2300_fw.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql2322.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql2322_fw.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql2400.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql2400_fw.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_os.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_init.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_mbx.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_iocb.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_isr.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_gs.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_dbg.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_sup.o
/qla2xxx/qlogic/qla2xxx-8.01.03/qla_os.c: In function `qla2x00_cleanup_module_exit':
/qla2xxx/qlogic/qla2xxx-8.01.03/qla_os.c:5480: warning: `inter_module_put' is deprecated (declared at include/linux/module.h:572)
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_rscn.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_xioct.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_inioct.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_fo.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_foln.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_cfg.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_cfgln.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_32ioctl.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_ip.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql6312.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql6312_fw.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2xxx_conf.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2xip.o
/qla2xxx/qlogic/qla2xxx-8.01.03/qla2xxx_conf.c: In function `conf_init':
/qla2xxx/qlogic/qla2xxx-8.01.03/qla2xxx_conf.c:41: warning: `inter_module_register' is deprecated (declared at include/linux/module.h:567)
/qla2xxx/qlogic/qla2xxx-8.01.03/qla2xxx_conf.c: In function `conf_exit':
/qla2xxx/qlogic/qla2xxx-8.01.03/qla2xxx_conf.c:47: warning: `inter_module_unregister' is deprecated (declared at include/linux/module.h:568)
HOSTCC /qla2xxx/qlogic/qla2xxx-8.01.03/extras/qla_nvr
HOSTCC /qla2xxx/qlogic/qla2xxx-8.01.03/extras/qla_opts
/qla2xxx/qlogic/qla2xxx-8.01.03/qla2xip.c:61: warning: `MODULE_PARM_' is deprecated (declared at include/linux/module.h:552)
/qla2xxx/qlogic/qla2xxx-8.01.03/qla2xip.c:67: warning: `MODULE_PARM_' is deprecated (declared at include/linux/module.h:552)
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2xxx.o
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2100.o
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2200.o
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2322.o
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2300.o
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2400.o
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla6312.o
Building modules, stage 2.
MODPOST
Warning: could not find versions for .tmp_versions/qla2100.mod
Warning: could not find versions for .tmp_versions/qla2200.mod
Warning: could not find versions for .tmp_versions/qla2300.mod
Warning: could not find versions for .tmp_versions/qla2322.mod
Warning: could not find versions for .tmp_versions/qla2400.mod
Warning: could not find versions for .tmp_versions/qla2xxx.mod
Warning: could not find versions for .tmp_versions/qla6312.mod
CC /qla2xxx/qlogic/qla2xxx-8.01.03/qla2100.mod.o
CC /qla2xxx/qlogic/qla2xxx-8.01.03/qla2200.mod.o
CC /qla2xxx/qlogic/qla2xxx-8.01.03/qla2322.mod.o
CC /qla2xxx/qlogic/qla2xxx-8.01.03/qla2400.mod.o
CC /qla2xxx/qlogic/qla2xxx-8.01.03/qla2300.mod.o
CC /qla2xxx/qlogic/qla2xxx-8.01.03/qla2xip.mod.o
CC /qla2xxx/qlogic/qla2xxx-8.01.03/qla2xxx.mod.o
CC /qla2xxx/qlogic/qla2xxx-8.01.03/qla2xxx_conf.mod.o
CC /qla2xxx/qlogic/qla2xxx-8.01.03/qla6312.mod.o
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2100.ko
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2200.ko
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2300.ko
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2322.ko
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2400.ko
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla6312.ko
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2xip.ko
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2xxx_conf.ko
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2xxx.ko
make: Leaving directory `/usr/src/kernels/2.6.9-5.EL-i686'
[root@keglin qla2xxx-8.01.03]# insmod qla2xxx_conf.ko
insmod: error inserting 'qla2xxx_conf.ko': -1 Invalid module format
[root@keglin qla2xxx-8.01.03]# insmod qla2300
insmod: can't read 'qla2300': No such file or directory
[root@keglin qla2xxx-8.01.03]# ./extras/build.sh install
QLA2XXX -- Building the qla2xxx driver...
make: Entering directory `/usr/src/kernels/2.6.9-5.EL-i686'
scripts/Makefile.build:19: kbuild: /qla2xxx/qlogic/qla2xxx-8.01.03/Makefile - Usage of host-progs is deprecated. Please replace with hostprogs-y!
Building modules, stage 2.
MODPOST
Warning: could not find versions for .tmp_versions/qla2100.mod
Warning: could not find versions for .tmp_versions/qla2200.mod
Warning: could not find versions for .tmp_versions/qla2300.mod
Warning: could not find versions for .tmp_versions/qla2322.mod
Warning: could not find versions for .tmp_versions/qla2400.mod
Warning: could not find versions for .tmp_versions/qla2xxx.mod
Warning: could not find versions for .tmp_versions/qla6312.mod
make: Leaving directory `/usr/src/kernels/2.6.9-5.EL-i686'
QLA2XXX -- Installing the qla2xxx modules to
/lib/modules/2.6.9-5.EL/kernel/drivers/scsi/qla2xxx/...
[root@keglin qla2xxx-8.01.03]# modprobe -v qla2300
insmod /lib/modules/2.6.9-5.EL/kernel/drivers/scsi/qla2xxx/qla2xxx.ko
WARNING: Error inserting qla2xxx (/lib/modules/2.6.9-5.EL/kernel/drivers/scsi/qla2xxx/qla2xxx.ko): Invalid module format
insmod /lib/modules/2.6.9-5.EL/kernel/drivers/scsi/qla2xxx/qla2300.ko
FATAL: Error inserting qla2300 (/lib/modules/2.6.9-5.EL/kernel/drivers/scsi/qla2xxx/qla2300.ko): Invalid module format
[root@keglin qla2xxx-8.01.03]# ls -l /lib/modules/2.6.9-5.EL/kernel/drivers/scsi/qla
qla1280.ko qla2xxx/

After rebbot error messages to console:
qla2xxx: version magic '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.2' should be '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.4'
qla2300: version magic '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.2' should be '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.4'
qla2xxx: version magic '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.2' should be '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.4'
qla2300: version magic '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.2' should be '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.4'
qla2xxx: version magic '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.2' should be '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.4'
qla2300: version magic '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.2' should be '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.4'

What to do? Full log in attache.

Re: Multi-path RedHat AS4 and EVA8000

Alan_152 — Wed, 19 Apr 2006 10:45:16 GMT

THis is a known issue with rhel4, evas, and qla drivers. Your best bet is the following:

1) make sure that the qla firmware and drivers are completely up to date -- download the latest of both from the HP site
2) make sure that the eva's firmware is up to date (both drives, controller, and interface)
3) make sure you don't have too many redudant physical and virtual fiber connections running running between your server and the eva (especially if a zoned switch is involved somewhere).

What I generally end up doing (because "3" is a bit tough in my particular environment) is going into /dev and deleting the redundant sd? device links.

Re: Multi-path RedHat AS4 and EVA8000

Tom O'Toole — Wed, 19 Apr 2006 11:03:10 GMT

Hi Alan,

Do you know of any advisories or other doc. on this issue? If you delete the redundant devices, will it not also lose the failover paths? Anybody have a list of hw/fw/sw component revs that work?

Re: Multi-path RedHat AS4 and EVA8000

Yermek Bissenbayev — Tue, 16 May 2006 06:30:08 GMT

Problem solve after reinstall system.

topic Re: Multi-path RedHat AS4 and EVA8000 in Operating System - Linux

Multi-path RedHat AS4 and EVA8000

Re: Multi-path RedHat AS4 and EVA8000

Re: Multi-path RedHat AS4 and EVA8000

Re: Multi-path RedHat AS4 and EVA8000

Re: Multi-path RedHat AS4 and EVA8000

Re: Multi-path RedHat AS4 and EVA8000