Linux RH 5.3 and HPD Multipath

[Sebastian Szewczyk]

Hello,

I install HPDMmultipath-4.2.0 on my Linux Red Hat 5.3 because I can't used my Device-mapper-multipath from Red Hat Installation box. When I install and try them I have identical problem:
# ll
total 64
drwxr-xr-x 2 root root 4096 Nov 7 10:38 bin
drwxr-xr-x 2 root root 4096 Feb 25 16:57 conf
-rw-r--r-- 1 root root 25284 Nov 7 10:38 COPYING
drwxr-xr-x 2 root root 4096 Feb 26 11:43 docs
-rwxr--r-- 1 root root 13929 Feb 3 12:31 INSTALL
-rw-r--r-- 1 root root 1535 Feb 26 11:54 README.txt
drwxr-xr-x 2 root root 4096 Feb 2 10:44 SRPMS
# ./INSTALL


** HPDMmultipath-4.2.0 kit Installation. Date : Thu Apr 16 11:16:21 CEST 2009 **

Checking for previous installation. Please wait...

HP Device Mapper Multipath v4.2.0 kit - Installation Menu

1. Install HPDM Multipath Utilities
2. Uninstall HPDM Multipath Utilities
3. Exit
Enter choice [1/2/3] :1

Note: This kit installs the binaries and configuration file required to
support HP StorageWorks Disk Arrays.


Warning: If you are retaining the existing /etc/multipath.conf file, you will
have to manually edit the file with HP recommended parameters.
Please refer user documentation for more details.


Would you like to overwrite the existing /etc/multipath.conf file with the
new multipath configuration file ? (y/n) : y

Saving /etc/multipath.conf file to /etc/multipath.conf.savefile
Copying new multipath configuration file multipath.conf to /etc directory

********************************************************************************
* Complete the following steps to create the Device Mapper multipath devices *
* *
* 1. Restart the multipath services *
* ~foo# /etc/init.d/multipathd restart *
* *
* 2. Create the Device Mapper multipath devices *
* ~foo# multipath -v0 *
* *
********************************************************************************
Installation completed successfully!

# /etc/init.d/multipathd restart
Stopping multipathd daemon: [ OK ]
Starting multipathd daemon: [ OK ]
# multipath -v0
# cd /etc
# vi multipath.conf
# multipath -F
# multipath -d
create: mpath0 (3600508b4001003b100013000047c0000) HP,HSV100
[size=15G][features=0][hwhandler=0][n/a]
\_ round-robin 0 [prio=0][undef]
\_ 0:0:0:1 sda 8:0 [undef][ready]
\_ round-robin 0 [prio=0][undef]
\_ 1:0:1:1 sdb 8:16 [undef][ready]
# cat /etc/re
readahead.d/ reader.conf.d/ redhat-release request-key.conf
reader.conf redhat-lsb/ reposd.conf resolv.conf
# cat /etc/redhat-release
Red Hat Enterprise Linux Server release 5.3 (Tikanga)
In /var/log/messages I have something like that information:
Apr 16 11:38:31 xxx multipathd: --------shut down-------
Apr 16 11:38:32 xxx multipathd: cannot open /sbin/dasd_id : No such file or directory
Apr 16 11:38:32 xxx multipathd: cannot open /sbin/gnbd_import : No such file or directory
Apr 16 11:38:32 xxx multipathd: [copy.c] cannot open /sbin/dasd_id
Apr 16 11:38:32 xxx multipathd: cannot copy /sbin/dasd_id in ramfs : No such file or directory
Apr 16 11:38:32 xxx multipathd: [copy.c] cannot open /sbin/gnbd_import
Apr 16 11:38:32 xxx kernel: device-mapper: table: 253:5: multipath: error getting device
Apr 16 11:38:32 xxx kernel: device-mapper: ioctl: error adding target to table
Apr 16 11:38:32 xxx kernel: device-mapper: table: 253:5: multipath: error getting device
Apr 16 11:38:32 xxx kernel: device-mapper: ioctl: error adding target to table
Apr 16 11:38:32 xxx kernel: device-mapper: table: 253:5: multipath: error getting device
Apr 16 11:38:32 xxx kernel: device-mapper: ioctl: error adding target to table
Apr 16 11:38:32 xxx kernel: device-mapper: table: 253:5: multipath: error getting device
Apr 16 11:38:32 xxx kernel: device-mapper: ioctl: error adding target to table
Apr 16 11:38:32 xxx multipathd: cannot copy /sbin/gnbd_import in ramfs : No such file or directory
Apr 16 11:38:32 xxx multipathd: path checkers start up

What can I do in that situation.
Give me some advice?

Best regards
seboizm

[Jimmy Vance]

You really don't need to install the HP multipath kit with RHEL5.3, just use the inbox device mapper and HBA drivers. The only thin in the kit that is really usefull is the multipath.conf.template file that includes all the HP storage devices

[Sebastian Szewczyk]

Ok on my other server I install driver first time form Qlogic website second time from HP website (HP kit) and I have the same problem .
Now I will uninstall HPD and install driver for my Qlogic HBA and run Device-mapper-multipath and give you output of my problem with configuration with your suggestion.

Best regards
seboizm

[Sebastian Szewczyk]

Hello
I uninstall HPDM and I install driver for Qlogic HBA like qlafc-linux-8.02.14.01-1 (identical drivers for HBA0 and HBA1):
more /proc/scsi/qla2xxx/0
QLogic PCI to Fibre Channel Host Adapter for QMI2472:
Firmware version 4.04.00 [IP] [84XX] , Driver version 8.02.14.01
BIOS version 2.02
FCODE version 2.00
EFI version 1.08
Flash FW version 4.00.27 0083
ISP: ISP2422
Request Queue = 0x32e300000, Response Queue = 0x32e120000
Request Queue count = 4096, Response Queue count = 512
Total number of active commands = 0
Total number of interrupts = 7869
Device queue depth = 0x20
Number of free request entries = 1441
Number of mailbox timeouts = 0
Number of ISP aborts = 0
Number of loop resyncs = 0
Number of retries for empty slots = 0
Number of reqs in pending_q= 0, retry_q= 0, done_q= 0, scsi_retry_q= 0
Host adapter:loop state = , flags = 0x5a43
Dpc flags = 0x0
MBX flags = 0x0
Link down Timeout = 030
Port down retry = 030
Login retry count = 030
Commands retried with dropped frame(s) = 0
Product ID = 0000 0000 0000 0000


SCSI Device Information:
scsi-qla0-adapter-node=2000001b3283bdaf;
scsi-qla0-adapter-port=2100001b3283bdaf;
scsi-qla0-target-0=50001fe15003681c;
scsi-qla0-target-1=50001fe150036819;

FC Port Information:
scsi-qla0-port-0=50001fe150036810:50001fe15003681c:014a00:81;
scsi-qla0-port-1=50001fe150036810:50001fe150036819:014b00:82;

SCSI LUN Information:
(Id:Lun) * - indicates lun is not registered with the OS.
( 0: 0): Total reqs 3, Pending reqs 0, flags 0x0, Dflags 0x0, 0:0:81 0c
( 0: 1): Total reqs 320, Pending reqs 0, flags 0x0, Dflags 0x0, 0:0:81 00
( 1: 0): Total reqs 3, Pending reqs 0, flags 0x0, Dflags 0x0, 0:0:82 0c
( 1: 1): Total reqs 2, Pending reqs 0, flags 0x0*, Dflags 0x0, 0:0:82 00

and run default configuration for Device-mapper-multipath /etc/multipath.conf I add in attachment. After ttah i run multipath and I have identical situation like before in my first post opinion:
# /etc/init.d/multipathd restart
Stopping multipathd daemon: [ OK ]
Starting multipathd daemon: [ OK ]
# multipath -v0
# multipath -F
# multipath -d
create: mpath0 (3600508b4001003b100013000047c0000) HP,HSV100
[size=15G][features=0][hwhandler=0][n/a]
\_ round-robin 0 [prio=2][undef]
\_ 0:0:0:1 sda 8:0 [undef][ready]
\_ 1:0:1:1 sdb 8:16 [undef][ready]
[root@mid class]# multipath -v4
dm-0: blacklisted
dm-1: blacklisted
dm-2: blacklisted
dm-3: blacklisted
dm-4: blacklisted
md0: blacklisted
ram0: blacklisted
ram10: blacklisted
ram11: blacklisted
ram12: blacklisted
ram13: blacklisted
ram14: blacklisted
ram15: blacklisted
ram1: blacklisted
ram2: blacklisted
ram3: blacklisted
ram4: blacklisted
ram5: blacklisted
ram6: blacklisted
ram7: blacklisted
ram8: blacklisted
ram9: blacklisted
sda: not found in pathvec
sda: mask = 0x1f
sda: bus = 1
sda: dev_t = 8:0
sda: size = 31457280
sda: vendor = HP
sda: product = HSV100
sda: rev = 3028
sda: h:b:t:l = 0:0:0:1
sda: serial = P66C5E2AAQS032
sda: path checker = readsector0 (config file default)
sda: state = 2
sda: getprio = NULL (internal default)
sda: prio = 1
sda: getuid = /sbin/scsi_id -g -u -s /block/%n (config file default)
sda: uid = 3600508b4001003b100013000047c0000 (callout)
sdb: not found in pathvec
sdb: mask = 0x1f
sdb: bus = 1
sdb: dev_t = 8:16
sdb: size = 31457280
sdb: vendor = HP
sdb: product = HSV100
sdb: rev = 3028
sdb: h:b:t:l = 1:0:1:1
sdb: serial = P66C5E2AAQS032
sdb: path checker = readsector0 (config file default)
sdb: state = 2
sdb: getprio = NULL (internal default)
sdb: prio = 1
sdb: getuid = /sbin/scsi_id -g -u -s /block/%n (config file default)
sdb: uid = 3600508b4001003b100013000047c0000 (callout)
sr0: blacklisted
===== paths list =====
uuid hcil dev dev_t pri dm_st chk_st vend/pr
3600508b4001003b100013000047c0000 0:0:0:1 sda 8:0 1 [undef][ready] HP,HSV1
3600508b4001003b100013000047c0000 1:0:1:1 sdb 8:16 1 [undef][ready] HP,HSV1
Found matching wwid [3600508b4001003b100013000047c0000] in bindings file.
Setting alias to mpath0
sda: ownership set to mpath0
sda: not found in pathvec
sda: mask = 0xc
sda: state = 2
sda: prio = 1
sdb: ownership set to mpath0
sdb: not found in pathvec
sdb: mask = 0xc
sdb: state = 2
sdb: prio = 1
mpath0: pgfailover = -1 (internal default)
mpath0: pgpolicy = multibus (config file default)
mpath0: selector = round-robin 0 (internal default)
mpath0: features = 0 (internal default)
mpath0: hwhandler = 0 (internal default)
mpath0: rr_weight = 1 (internal default)
mpath0: minio = 1000 (config file default)
mpath0: no_path_retry = NONE (internal default)
pg_timeout = NONE (internal default)
mpath0: set ACT_CREATE (map does not exist)
libdevmapper: ioctl/libdm-iface.c(1634): device-mapper: reload ioctl failed: Invalid argument
libdevmapper: ioctl/libdm-iface.c(1634): device-mapper: reload ioctl failed: Invalid argument
mpath0: domap (0) failure for create/reload map
mpath0: remove multipath map
sda: orphaned
sdb: orphaned
Found matching wwid [3600508b4001003b100013000047c0000] in bindings file.
Setting alias to mpath0
sda: ownership set to mpath0
sda: not found in pathvec
sda: mask = 0xc
sda: path checker = readsector0 (config file default)
sda: state = 2
sda: getprio = NULL (internal default)
sda: prio = 1
sdb: ownership set to mpath0
sdb: not found in pathvec
sdb: mask = 0xc
sdb: path checker = readsector0 (config file default)
sdb: state = 2
sdb: getprio = NULL (internal default)
sdb: prio = 1
mpath0: pgfailover = -1 (internal default)
mpath0: pgpolicy = multibus (config file default)
mpath0: selector = round-robin 0 (internal default)
mpath0: features = 0 (internal default)
mpath0: hwhandler = 0 (internal default)
mpath0: rr_weight = 1 (internal default)
mpath0: minio = 1000 (config file default)
mpath0: no_path_retry = NONE (internal default)
pg_timeout = NONE (internal default)
mpath0: set ACT_CREATE (map does not exist)
libdevmapper: ioctl/libdm-iface.c(1634): device-mapper: reload ioctl failed: Invalid argument
libdevmapper: ioctl/libdm-iface.c(1634): device-mapper: reload ioctl failed: Invalid argument
mpath0: domap (0) failure for create/reload map
mpath0: remove multipath map
sda: orphaned
sdb: orphaned

What can I do in thath situation?

Best Regards
seboizm

[Jimmy Vance]

Do you have the QLogic driver in failover mode?

[Sebastian Szewczyk]

No I don't have driver qlogic in failovwer mode.
Because when I install my qlogic driver in failover mode I can't present new disk from my array. I present them from may EVA 3000 or EVA500 but system with failover driver don't see anything.
What nao?

Best regards
seboizm

[Jimmy Vance]

Not sure what to tell you. I just install RHEL 5.3 and use all the drivers that ship with RHEL and have no problms connecting to my EVA's or MSA's. I use the multipath.conf file from the HPDMmultipath kit as it has the all the correct entries for EVA and MSA

[Sebastian Szewczyk]

Wow taht;s great but when I do like I write I have:
# multipath -v0
# multipath -F
# multipath -d
create: mpath0 (3600508b4001003b100013000047c0000) HP,HSV100
[size=15G][features=0][hwhandler=0][n/a]
\_ round-robin 0 [prio=2][undef]
\_ 0:0:0:1 sda 8:0 [undef][ready]
\_ 1:0:1:1 sdb 8:16 [undef][ready]
If you can attach your conf file and version of multipath etc.
Perhaps i find what i do wrong.

Best regards
seboizm

[Jimmy Vance]

How many paths are on your EVA? I forget how many the older HSV controllers have. Your last output looks like 2 paths into the EVA with the path_grouping_policy set to multibus instead of group_by_prio

relevant section of multipath.conf

# For EVA A/A arrays

device {
vendor "HP|COMPAQ"
product "HSV1[01]1 \(C\)COMPAQ|HSV[2][01]0|HSV300|HSV4[05]0"
path_grouping_policy group_by_prio
getuid_callout "/sbin/scsi_id -g -u -s /block/%n"
path_checker tur
path_selector "round-robin 0"
prio alua
rr_weight uniform
failback immediate
hardware_handler "0"
no_path_retry 12
rr_min_io 100
}

One of my systems, 4 paths into the EVA and 2 paths into the MSA

[root@bl490cg6 ~]# multipath -l
360014380024d2c0f00003000011b0000dm-1 HP,HSV300
[size=72G][features=1 queue_if_no_path][hwhandler=0]
\_ round-robin 0 [prio=0][active]
\_ 2:0:3:1 sdd 8:48 [active][undef]
\_ 3:0:3:1 sdg 8:96 [active][undef]
\_ round-robin 0 [prio=0][enabled]
\_ 2:0:2:1 sdc 8:32 [active][undef]
\_ 3:0:2:1 sdf 8:80 [active][undef]
3600c0ff000d5fbe2c63c9f4901000000dm-0 HP,MSA2212fc
[size=69G][features=0][hwhandler=0]
\_ round-robin 0 [prio=0][active]
\_ 2:0:1:1 sdb 8:16 [active][undef]
\_ round-robin 0 [prio=0][enabled]
\_ 3:0:1:1 sde 8:64 [active][undef]
[root@bl490cg6 ~]#

[Sebastian Szewczyk]

Yes I have 2 paths from my EVA Array - I change my configuration with your advice and i don't have any changes in my situation. I change group_by_prio on multibus and this is nothing change. Always after I run multipath I have something like that:
[root@bim1 etc]# multipath -d
create: mpath0 (3600508b4001003b10001300004710000) HP,HSV100
[size=15G][features=0][hwhandler=0]
\_ round-robin 0 [prio=2][undef]
\_ 0:0:0:1 sda 8:0 [undef][ready]
\_ 1:0:1:1 sdb 8:16 [undef][ready]
Command multipath -l or -ll don't give me outback on my stdout.

Best regards
seboizm

[Jimmy Vance]

Multipath -d is just a dry run, it doesn't set anything. the multipath.conf file needs to be in /etc

try /etc/init.d/multipathd restart and then see what multipath -l shows

[Sebastian Szewczyk]

Like I write in last poste when I multpiath -l or -ll i don't see anything special like that:
[root@bim1 /]# /etc/init.d/multipathd restart
Stopping multipathd daemon: [ OK ]
Starting multipathd daemon: [ OK ]
[root@bim1 /]# multipath -l
[root@bim1 /]# multipath -ll
[root@bim1 /]# multipath -v1
[root@bim1 /]# multipath -v2
[root@bim1 /]# multipath -v4
dm-0: blacklisted
dm-1: blacklisted
dm-2: blacklisted
dm-3: blacklisted
md0: blacklisted
ram0: blacklisted
ram10: blacklisted
ram11: blacklisted
ram12: blacklisted
ram13: blacklisted
ram14: blacklisted
ram15: blacklisted
ram1: blacklisted
ram2: blacklisted
ram3: blacklisted
ram4: blacklisted
ram5: blacklisted
ram6: blacklisted
ram7: blacklisted
ram8: blacklisted
ram9: blacklisted
sda: not found in pathvec
sda: mask = 0x1f
sda: bus = 1
sda: dev_t = 8:0
sda: size = 31457280
sda: vendor = HP
sda: product = HSV100
sda: rev = 3028
sda: h:b:t:l = 0:0:0:1
sda: serial = P66C5E1AAQ1054
sda: path checker = tur (controller setting)
sda: state = 2
sda: getprio = NULL (internal default)
sda: prio = 1
sda: getuid = /sbin/scsi_id -g -u -s /block/%n (controller setting)
sda: uid = 3600508b4001003b10001300004710000 (callout)
sdb: not found in pathvec
sdb: mask = 0x1f
sdb: bus = 1
sdb: dev_t = 8:16
sdb: size = 31457280
sdb: vendor = HP
sdb: product = HSV100
sdb: rev = 3028
sdb: h:b:t:l = 1:0:1:1
sdb: serial = P66C5E1AAQ1054
sdb: path checker = tur (controller setting)
sdb: state = 2
sdb: getprio = NULL (internal default)
sdb: prio = 1
sdb: getuid = /sbin/scsi_id -g -u -s /block/%n (controller setting)
sdb: uid = 3600508b4001003b10001300004710000 (callout)
===== paths list =====
uuid hcil dev dev_t pri dm_st chk_st vend/pr
3600508b4001003b10001300004710000 0:0:0:1 sda 8:0 1 [undef][ready] HP,HSV1
3600508b4001003b10001300004710000 1:0:1:1 sdb 8:16 1 [undef][ready] HP,HSV1
Found matching wwid [3600508b4001003b10001300004710000] in bindings file.
Setting alias to mpath0
sda: ownership set to mpath0
sda: not found in pathvec
sda: mask = 0xc
sda: state = 2
sda: prio = 1
sdb: ownership set to mpath0
sdb: not found in pathvec
sdb: mask = 0xc
sdb: state = 2
sdb: prio = 1
mpath0: pgfailback = -2 (controller setting)
mpath0: pgpolicy = multibus (controller setting)
mpath0: selector = round-robin 0 (controller setting)
mpath0: features = 0 (internal default)
mpath0: hwhandler = 0 (controller setting)
mpath0: rr_weight = 1 (internal default)
mpath0: minio = 100 (controller setting)
mpath0: no_path_retry = 12 (controller setting)
pg_timeout = NONE (internal default)
mpath0: set ACT_CREATE (map does not exist)
libdevmapper: ioctl/libdm-iface.c(1623): device-mapper: reload ioctl failed: Invalid argument
mpath0: domap (0) failure for create/reload map
mpath0: remove multipath map
sda: orphaned
sdb: orphaned
Found matching wwid [3600508b4001003b10001300004710000] in bindings file.
Setting alias to mpath0
sda: ownership set to mpath0
sda: not found in pathvec
sda: mask = 0xc
sda: path checker = tur (controller setting)
sda: state = 2
sda: getprio = NULL (internal default)
sda: prio = 1
sdb: ownership set to mpath0
sdb: not found in pathvec
sdb: mask = 0xc
sdb: path checker = tur (controller setting)
sdb: state = 2
sdb: getprio = NULL (internal default)
sdb: prio = 1
mpath0: pgfailback = -2 (controller setting)
mpath0: pgpolicy = multibus (controller setting)
mpath0: selector = round-robin 0 (controller setting)
mpath0: features = 0 (internal default)
mpath0: hwhandler = 0 (controller setting)
mpath0: rr_weight = 1 (internal default)
mpath0: minio = 100 (controller setting)
mpath0: no_path_retry = 12 (controller setting)
pg_timeout = NONE (internal default)
mpath0: set ACT_CREATE (map does not exist)
libdevmapper: ioctl/libdm-iface.c(1623): device-mapper: reload ioctl failed: Invalid argument
mpath0: domap (0) failure for create/reload map
mpath0: remove multipath map
sda: orphaned
sdb: orphaned

What can I do in that situation?

Best regards
seboizm

[Jimmy Vance]

Try looking in SPOCK and make sure all the components you have are supported

http://www.hp.com/storage/spock

[Charles Snowdon]

Hi
Your output in the error message
mpath0 (3600508b4001003b100013000047c0000) HP,HSV100

indicates you have an EVA 3000/5000 running 3.x VCS code, this is not supported with Device Mapper as this is considered and Active / Passive storage array.

The correct entry would look like

mpath0 (3600508b4001003b100013000047c0000) HP,HSV101

and would indicate you are running VCS4.x code stream and this is an Active / Active storage array.

In the /etc/multipath.conf file, it does not show a MSA2000 configuration, this is also required.

either remove the EVA from the configuration or upgrade the VCS on the EVA.


my suggestion is to carefull read the Device mapper documentation, the ./INSTALL will provide details of missing pre-requisites and copy the correct template for /etc/multipath.conf per the OS version you have.

[Alzhy]

Charles is correct.

Active/Passive EVA 3000/5000 does not support multi-pathing. You will need to have SecurePath for A/P arrays installed to get your older EVAs working with Linux multi-pather.