topic Re: QLogic HBA Driver failover and multipath problem in HPE EVA Storage

QLogic HBA Driver failover and multipath problem

niki67 — Tue, 17 Mar 2009 12:45:55 GMT

Hi,
my question concern a FC Adapter, with QLogic driver 8.02.14.01-fo, installed on RedHat AS 4.6, kernel 2.6.9-78.0.1.ELsmp. This FC Adapter have two channel HBA0 and HBA1 attached to a couple of Cisco MDS9216i FC Switch.
My problem concern tha failover and multipath.
I have presented a LUNs from HP Storageworks EVA 4000 to my host, and I see the LUNs only one path (the preferred path). But when I disconnect the channel HBA across which I see my LUNs, the driver do not change the path and even if I try the rescan the system do not see the LUNs.

Anyone have the idea on this problem?

Thanks in advance,
Nicola.

Re: QLogic HBA Driver failover and multipath problem

emha_1 — Wed, 18 Mar 2009 06:51:17 GMT

do you have set up SAN zoning properly?

emha.

Re: QLogic HBA Driver failover and multipath problem

niki67 — Wed, 18 Mar 2009 07:34:17 GMT

I have two sites with one EVA4000, and two CISCO MDS Switch, for each site, and the sites are connected via ISL.
The two controllers of EVA4000, with two FC port, is attached on the two CISCO MDS Switch, and the two channel of my host are attached one to first switch and second to the other.

The zoning is the following:

a) HBA0 Channel of host + EVA Controller A fibre port 1 + EVA Controller B fibre port 1;

b) HBA1 Channel of host + EVA Controller A fibre port 2 + EVA Controller B fibre port 2.

Is the correct zoninig?

Hi, Nicola.

Re: QLogic HBA Driver failover and multipath problem

emha_1 — Thu, 19 Mar 2009 09:24:08 GMT

if you realy listed zonning setup and not physical connections, then it looks ok.

there is SANsurfer application out there for QLogic HBA's. do you have it installed? what does it show?

emha.

Re: QLogic HBA Driver failover and multipath problem

niki67 — Thu, 19 Mar 2009 10:23:35 GMT

Yes, I show you the phisical connections of FC and the zoning configuration on the Fabric Manager.

Yes the SANSurfer Manager is installed on remote machine, and it show, for host, the two port HBA0 and HBA1, and the device attached to there with LUNs presented.

In particular on the port HBA1 is setted the preferred path to one of two controllers of EVA.

I try to disconnect the FC port on the MDS related to HBA1 of host, the port across I see my LUNs. The SANsurfer show the device attached to HBA1 in the offline status, and the port HBA0 continue to show the device online, but when I see the current path the column of HBA1 is blanck and in the column of HBA0 I do not see any preferred path setted, that is the phrase "Current: preferred".

I suppose that if the failover parameter is set to "Enable", the driver of QLogic must switched to new path and set a new preferred path on HBA alive.

Is correct?

If my assumption is true, there is a solution?

Hi, Nicola.

Re: QLogic HBA Driver failover and multipath problem

emha_1 — Thu, 19 Mar 2009 11:51:40 GMT

if your setup allows to access LUNs via both HBA's and via both ports of both controlers, you should then see for every LUN 4 paths/connections. one of them for every LUN should be 'current', all the other 'alternate'.

if you do not see it this way, and all the hw components/wiring are healthy, then the most probably zonning hides some paths and should be checked.

assuming your hw, fw, drivers, kernel, etc are all accordinf certification matrix ...

emha.

Re: QLogic HBA Driver failover and multipath problem

niki67 — Thu, 19 Mar 2009 12:58:46 GMT

Hi,
I see 4 path for each LUN, but one is "Current: prefered" and other as "Preferred" only and not "Alternate".

I believe my zoning is correct, but I see again the configuration.

Thanks.

Hi, Nicola.

Re: QLogic HBA Driver failover and multipath problem

emha_1 — Fri, 20 Mar 2009 07:28:12 GMT

if you really see all 4 paths, then it looks your qlogic driver config doesn't use them in failover mode.

could post output of /proc/scsi/qla2xxx/<#>
and /etc/modprobe.conf?

emha.

Re: QLogic HBA Driver failover and multipath problem

niki67 — Fri, 20 Mar 2009 07:40:48 GMT

The file in /proc/scsi/qla2xxx are:

::::::::::::::
0
::::::::::::::
QLogic PCI to Fibre Channel Host Adapter for QLA2342:
Firmware version 3.03.25 IPX, Driver version 8.02.14.01-debug-fo
BIOS version 1.45
FCODE version
EFI version 0.00
Flash FW version 0.00.00 0000
ISP: ISP2312, Serial# F72792
Request Queue = 0x313ac0000, Response Queue = 0x313920000
Request Queue count = 2048, Response Queue count = 512
Total number of active commands = 0
Total number of interrupts = 5600
Device queue depth = 0x10
Number of free request entries = 542
Number of mailbox timeouts = 0
Number of ISP aborts = 0
Number of loop resyncs = 0
Number of retries for empty slots = 0
Number of reqs in pending_q= 0, retry_q= 0, done_q= 0, scsi_retry_q= 0
Number of reqs in failover_q= 0
Host adapter:loop state = , flags = 0x85a43
Dpc flags = 0x0
MBX flags = 0x0
Link down Timeout = 008
Port down retry = 030
Login retry count = 030
Commands retried with dropped frame(s) = 0
Product ID = 4953 5020 2020 0002

SCSI Device Information:
scsi-qla0-adapter-node=200000e08b8878bd;
scsi-qla0-adapter-port=210000e08b8878bd;
scsi-qla0-target-0=50001fe150082069;
scsi-qla0-target-1=50001fe15008206d;

FC Port Information:
scsi-qla0-port-0=50001fe150082060:50001fe150082069:6b0000:81;
scsi-qla0-port-1=50001fe150082060:50001fe15008206d:6b0001:82;

SCSI LUN Information:
(Id:Lun) * - indicates lun is not registered with the OS.
( 0: 0): Total reqs 20, Pending reqs 0, flags 0x0, Dflags 0x0, 0:0:81 0c
( 0: 3): Total reqs 151, Pending reqs 0, flags 0x2, Dflags 0x0, 1:0:82 00
( 0: 4): Total reqs 163, Pending reqs 0, flags 0x2, Dflags 0x0, 0:0:81 00
( 0: 5): Total reqs 163, Pending reqs 0, flags 0x2, Dflags 0x0, 1:0:82 00
( 0: 6): Total reqs 163, Pending reqs 0, flags 0x2, Dflags 0x0, 0:0:81 00
( 0: 7): Total reqs 163, Pending reqs 0, flags 0x2, Dflags 0x0, 1:0:82 00
( 0: 8): Total reqs 163, Pending reqs 0, flags 0x2, Dflags 0x0, 0:0:81 00
( 0: 9): Total reqs 163, Pending reqs 0, flags 0x2, Dflags 0x0, 1:0:82 00
( 1: 0): Total reqs 12, Pending reqs 0, flags 0x0, Dflags 0x0, 0:0:82 0c
::::::::::::::
1
::::::::::::::
QLogic PCI to Fibre Channel Host Adapter for QLA2342:
Firmware version 3.03.25 IPX, Driver version 8.02.14.01-debug-fo
BIOS version 1.45
FCODE version
EFI version 0.00
Flash FW version 0.00.00 0000
ISP: ISP2312, Serial# F72792
Request Queue = 0x313400000, Response Queue = 0x313bf0000
Request Queue count = 2048, Response Queue count = 512
Total number of active commands = 0
Total number of interrupts = 7128
Device queue depth = 0x10
Number of free request entries = 909
Number of mailbox timeouts = 0
Number of ISP aborts = 0
Number of loop resyncs = 0
Number of retries for empty slots = 0
Number of reqs in pending_q= 0, retry_q= 0, done_q= 0, scsi_retry_q= 0
Number of reqs in failover_q= 0
Host adapter:loop state = , flags = 0x85a43
Dpc flags = 0x0
MBX flags = 0x0
Link down Timeout = 008
Port down retry = 030
Login retry count = 030
Commands retried with dropped frame(s) = 0
Product ID = 4953 5020 2020 0002

SCSI Device Information:
scsi-qla1-adapter-node=200100e08ba878bd;
scsi-qla1-adapter-port=210100e08ba878bd;
scsi-qla1-target-0=50001fe15008206c;
scsi-qla1-target-2=50001fe150082068;
scsi-qla1-target-3=100000e00223298d;

FC Port Information:
scsi-qla1-port-0=50001fe150082060:50001fe15008206c:550006:81;
scsi-qla1-port-1=50001fe150082060:50001fe150082068:550007:82;
scsi-qla1-port-2=100000e00203298d:100000e00223298d:5503e4:83;

SCSI LUN Information:
(Id:Lun) * - indicates lun is not registered with the OS.
( 0: 0): Total reqs 12, Pending reqs 0, flags 0x0, Dflags 0x0, 1:0:81 0c
( 2: 0): Total reqs 12, Pending reqs 0, flags 0x0, Dflags 0x0, 1:0:82 0c
( 3: 0): Total reqs 17, Pending reqs 0, flags 0x0, Dflags 0x0, 1:0:83 08
( 3: 2): Total reqs 0, Pending reqs 0, flags 0x0*, Dflags 0x0, 1:0:83 01
( 3: 3): Total reqs 0, Pending reqs 0, flags 0x0, Dflags 0x0, 1:0:83 0c

and for /etc/modprobe.conf:

alias eth0 tg3
alias eth1 tg3
alias scsi_hostadapter cciss
alias usb-controller ehci-hcd
alias usb-controller1 uhci-hcd
options scsi_mod max_luns=255
alias eth3 e1000
alias eth2 e1000
install bond0 /sbin/modprobe bonding -o bond0 mode=0 miimon=100
install bond1 /sbin/modprobe bonding -o bond1 mode=0 miimon=100
alias scsi_hostadapter6 ata_piix
install qla2xxx /sbin/modprobe qla2xxx_conf; /sbin/modprobe --ignore-install qla2xxx
remove qla2xxx /sbin/modprobe -r --first-time --ignore-remove qla2xxx && { /sbin/modprobe -r --ignore-remove qla2xxx_conf; }
alias qla2100 qla2xxx
alias qla2200 qla2xxx
alias qla2300 qla2xxx
alias qla2322 qla2xxx
alias qla2400 qla2xxx
alias scsi_hostadapter1 qla2xxx_conf
alias scsi_hostadapter2 qla2xxx
options qla2xxx ql2xextended_error_logging=1 ql2xmaxqdepth=16 qlport_down_retry=30 ql2xloginretrycount=30 ql2xfailover=1 ConfigRequired=0 ql2xretryc
ount=30 ql2xlbType=1

Hi, Nicola.