Multi-path RedHat AS4 and EVA8000

[Yermek Bissenbayev]

Dear All,
Please help to enable multi-path on RedHat AS4.
The equipment:
1) EVA8000 2C6D.
2) Dell PowerEge 2600 with OS Linux RedHAt AS4 Kernel: 2.6.9-5.ELsmp; 2-FCA2214 (driver hp_qla2x00src 8.00.02p11 Release: 24).
3) SAN

100GB from EVA presented to a Linux server.

Disk Info:
sda 0,2,0,0 MegaRAID LD0 RAID1 69358R 2.37
sdb 1,0,0,1 HP HSV210 5031 5000-1fe1-5006-3029
sdc 1,0,1,1 HP HSV210 5031 5000-1fe1-5006-302b
sdd 1,0,2,1 HP HSV210 5031 5000-1fe1-5006-302d
sde 1,0,3,1 HP HSV210 5031 5000-1fe1-5006-302f
sdf 2,0,0,1 HP HSV210 5031 5000-1fe1-5006-3028
sdg 2,0,1,1 HP HSV210 5031 5000-1fe1-5006-302a
sdh 2,0,2,1 HP HSV210 5031 5000-1fe1-5006-302e
sdi 2,0,3,1 HP HSV210 5031 5000-1fe1-5006-302c

OS sees one VDISK disk on 8 paths. At enabled multipath (ql2xfailover Default: 1) OS should see only one, similarly to /dev/sdb. Most likely ql2xfailover don't work.

How to solve this problem??!!
Full log in attache.

[Ivan Ferreira]

There are sometimes where the hp provided driver does not work. Try downloading the drivers from the qlogic page.

[Yermek Bissenbayev]

Dear Ivan,

I' download from http://support.qlogic.com last versuib driver.

Please see bellow.
[root@keglin qlogic]# cd qla2xxx-8.01.03/
[root@keglin qla2xxx-8.01.03]# ls
exioct.h Makefile ql2300.c ql2400_fw.c qla2xxx_conf.c qla_cfgln.c qla_fo.c qla_gbl.h qla_iocb.c qla_mbx.c qla_sup.c qlfoln.h
exioctln.h ql2100.c ql2300_fw.c ql6312.c qla_32ioctl.c qla_dbg.c qla_fo.h qla_gs.c qla_ip.c qla_opts.h qla_version.h release.txt
extras ql2100_fw.c ql2322.c ql6312_fw.c qla_32ioctl.h qla_dbg.h qla_foln.c qla_inioct.c qla_ip.h qla_os.c qla_xioct.c revision.notes
inioct.h ql2200.c ql2322_fw.c qla2xip.c qla_cfg.c qla_def.h qla_foln.h qla_init.c qla_isr.c qla_rscn.c qlfo.h
Kconfig ql2200_fw.c ql2400.c qla2xip.h qla_cfg.h qla_devtbl.h qla_fw.h qla_inline.h qla_listops.h qla_settings.h qlfolimits.h
[root@keglin qla2xxx-8.01.03]# ./extras/build.sh
QLA2XXX -- Building the qla2xxx driver...
make: Entering directory `/usr/src/kernels/2.6.9-5.EL-i686'
scripts/Makefile.build:19: kbuild: /qla2xxx/qlogic/qla2xxx-8.01.03/Makefile - Usage of host-progs is deprecated. Please replace with hostprogs-y!
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql2100.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql2100_fw.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql2200.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql2300.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql2200_fw.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql2300_fw.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql2322.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql2322_fw.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql2400.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql2400_fw.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_os.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_init.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_mbx.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_iocb.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_isr.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_gs.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_dbg.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_sup.o
/qla2xxx/qlogic/qla2xxx-8.01.03/qla_os.c: In function `qla2x00_cleanup_module_exit':
/qla2xxx/qlogic/qla2xxx-8.01.03/qla_os.c:5480: warning: `inter_module_put' is deprecated (declared at include/linux/module.h:572)
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_rscn.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_xioct.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_inioct.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_fo.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_foln.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_cfg.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_cfgln.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_32ioctl.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla_ip.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql6312.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/ql6312_fw.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2xxx_conf.o
CC [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2xip.o
/qla2xxx/qlogic/qla2xxx-8.01.03/qla2xxx_conf.c: In function `conf_init':
/qla2xxx/qlogic/qla2xxx-8.01.03/qla2xxx_conf.c:41: warning: `inter_module_register' is deprecated (declared at include/linux/module.h:567)
/qla2xxx/qlogic/qla2xxx-8.01.03/qla2xxx_conf.c: In function `conf_exit':
/qla2xxx/qlogic/qla2xxx-8.01.03/qla2xxx_conf.c:47: warning: `inter_module_unregister' is deprecated (declared at include/linux/module.h:568)
HOSTCC /qla2xxx/qlogic/qla2xxx-8.01.03/extras/qla_nvr
HOSTCC /qla2xxx/qlogic/qla2xxx-8.01.03/extras/qla_opts
/qla2xxx/qlogic/qla2xxx-8.01.03/qla2xip.c:61: warning: `MODULE_PARM_' is deprecated (declared at include/linux/module.h:552)
/qla2xxx/qlogic/qla2xxx-8.01.03/qla2xip.c:67: warning: `MODULE_PARM_' is deprecated (declared at include/linux/module.h:552)
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2xxx.o
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2100.o
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2200.o
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2322.o
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2300.o
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2400.o
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla6312.o
Building modules, stage 2.
MODPOST
Warning: could not find versions for .tmp_versions/qla2100.mod
Warning: could not find versions for .tmp_versions/qla2200.mod
Warning: could not find versions for .tmp_versions/qla2300.mod
Warning: could not find versions for .tmp_versions/qla2322.mod
Warning: could not find versions for .tmp_versions/qla2400.mod
Warning: could not find versions for .tmp_versions/qla2xxx.mod
Warning: could not find versions for .tmp_versions/qla6312.mod
CC /qla2xxx/qlogic/qla2xxx-8.01.03/qla2100.mod.o
CC /qla2xxx/qlogic/qla2xxx-8.01.03/qla2200.mod.o
CC /qla2xxx/qlogic/qla2xxx-8.01.03/qla2322.mod.o
CC /qla2xxx/qlogic/qla2xxx-8.01.03/qla2400.mod.o
CC /qla2xxx/qlogic/qla2xxx-8.01.03/qla2300.mod.o
CC /qla2xxx/qlogic/qla2xxx-8.01.03/qla2xip.mod.o
CC /qla2xxx/qlogic/qla2xxx-8.01.03/qla2xxx.mod.o
CC /qla2xxx/qlogic/qla2xxx-8.01.03/qla2xxx_conf.mod.o
CC /qla2xxx/qlogic/qla2xxx-8.01.03/qla6312.mod.o
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2100.ko
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2200.ko
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2300.ko
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2322.ko
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2400.ko
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla6312.ko
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2xip.ko
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2xxx_conf.ko
LD [M] /qla2xxx/qlogic/qla2xxx-8.01.03/qla2xxx.ko
make: Leaving directory `/usr/src/kernels/2.6.9-5.EL-i686'
[root@keglin qla2xxx-8.01.03]# insmod qla2xxx_conf.ko
insmod: error inserting 'qla2xxx_conf.ko': -1 Invalid module format
[root@keglin qla2xxx-8.01.03]# insmod qla2300
insmod: can't read 'qla2300': No such file or directory
[root@keglin qla2xxx-8.01.03]# ./extras/build.sh install
QLA2XXX -- Building the qla2xxx driver...
make: Entering directory `/usr/src/kernels/2.6.9-5.EL-i686'
scripts/Makefile.build:19: kbuild: /qla2xxx/qlogic/qla2xxx-8.01.03/Makefile - Usage of host-progs is deprecated. Please replace with hostprogs-y!
Building modules, stage 2.
MODPOST
Warning: could not find versions for .tmp_versions/qla2100.mod
Warning: could not find versions for .tmp_versions/qla2200.mod
Warning: could not find versions for .tmp_versions/qla2300.mod
Warning: could not find versions for .tmp_versions/qla2322.mod
Warning: could not find versions for .tmp_versions/qla2400.mod
Warning: could not find versions for .tmp_versions/qla2xxx.mod
Warning: could not find versions for .tmp_versions/qla6312.mod
make: Leaving directory `/usr/src/kernels/2.6.9-5.EL-i686'
QLA2XXX -- Installing the qla2xxx modules to
/lib/modules/2.6.9-5.EL/kernel/drivers/scsi/qla2xxx/...
[root@keglin qla2xxx-8.01.03]# modprobe -v qla2300
insmod /lib/modules/2.6.9-5.EL/kernel/drivers/scsi/qla2xxx/qla2xxx.ko
WARNING: Error inserting qla2xxx (/lib/modules/2.6.9-5.EL/kernel/drivers/scsi/qla2xxx/qla2xxx.ko): Invalid module format
insmod /lib/modules/2.6.9-5.EL/kernel/drivers/scsi/qla2xxx/qla2300.ko
FATAL: Error inserting qla2300 (/lib/modules/2.6.9-5.EL/kernel/drivers/scsi/qla2xxx/qla2300.ko): Invalid module format
[root@keglin qla2xxx-8.01.03]# ls -l /lib/modules/2.6.9-5.EL/kernel/drivers/scsi/qla
qla1280.ko qla2xxx/


After rebbot error messages to console:
qla2xxx: version magic '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.2' should be '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.4'
qla2300: version magic '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.2' should be '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.4'
qla2xxx: version magic '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.2' should be '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.4'
qla2300: version magic '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.2' should be '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.4'
qla2xxx: version magic '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.2' should be '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.4'
qla2300: version magic '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.2' should be '2.6.9-5.EL 686 REGPARM 4KSTACKS gcc-3.4'

What to do? Full log in attache.

[Alan_152]

THis is a known issue with rhel4, evas, and qla drivers. Your best bet is the following:

1) make sure that the qla firmware and drivers are completely up to date -- download the latest of both from the HP site
2) make sure that the eva's firmware is up to date (both drives, controller, and interface)
3) make sure you don't have too many redudant physical and virtual fiber connections running running between your server and the eva (especially if a zoned switch is involved somewhere).

What I generally end up doing (because "3" is a bit tough in my particular environment) is going into /dev and deleting the redundant sd? device links.

[Tom O'Toole]

Hi Alan,

Do you know of any advisories or other doc. on this issue? If you delete the redundant devices, will it not also lose the failover paths? Anybody have a list of hw/fw/sw component revs that work?

[Yermek Bissenbayev]

Problem solve after reinstall system.