- Community Home
- >
- Servers and Operating Systems
- >
- Operating Systems
- >
- Operating System - Linux
- >
- Re: RHEL 5.5 multipath problem (P700m + MSA2324sa)
Categories
Company
Local Language
Forums
Discussions
Forums
- Data Protection and Retention
- Entry Storage Systems
- Legacy
- Midrange and Enterprise Storage
- Storage Networking
- HPE Nimble Storage
Discussions
Discussions
Discussions
Forums
Forums
Discussions
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
- BladeSystem Infrastructure and Application Solutions
- Appliance Servers
- Alpha Servers
- BackOffice Products
- Internet Products
- HPE 9000 and HPE e3000 Servers
- Networking
- Netservers
- Secure OS Software for Linux
- Server Management (Insight Manager 7)
- Windows Server 2003
- Operating System - Tru64 Unix
- ProLiant Deployment and Provisioning
- Linux-Based Community / Regional
- Microsoft System Center Integration
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Community
Resources
Forums
Blogs
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-07-2011 06:25 AM
тАО03-07-2011 06:25 AM
RHEL 5.5 multipath problem (P700m + MSA2324sa)
We are having problems configuring multipath with RHEL 5.5.
multipath -ll doesn't show anything and -v5 produces the following errors:
cciss!c0d0: not found in pathvec
cciss!c0d0: mask = 0x1f
cciss!c0d0: bus = 4
cciss!c0d0: dev_t = 104:0
cciss!c0d0: size = 234374976
cciss!c1d0: not found in pathvec
cciss!c1d0: mask = 0x1f
cciss!c1d0: bus = 4
cciss!c1d0: dev_t = 105:0
Collected below are the other background details of the installation.
--
HW configuration:
--------------------------------------------
BladeSystem c7000 Enclosure G2
ProLiant BL460c G7 (603588-B21)
Smart Array P700m (508226-B21)
3Gb SAS Switch (AJ865A)
MSA2324sa (AJ807A Rev B)
Base Install:
--------------------------------------
RHEL5 Update 5
Installed packages:
--------------------------------------
PSP 8.60
device-mapper-multipath-0.4.7-42.el5.i386.rpm
kpartx-0.4.7-42.el5.i386.rpm
HPDMmultipath-4.4.1.tar.gz
# rpm -qa --last
device-mapper-multipath-0.4.7-42.el5 kpartx-0.4.7-42.el5 mptlinux-4.00.13.07-5 hpvca-6.2.0-8 hponcfg-3.1.0-0 hpmouse-1.2.0-96 hpdiags-8.6.0-18 hpacucli-8.60-8.0 hp-smh-templates-8.6.0.14-16
hp-snmp-agents-8.6.0.18-18 hpsmh-6.2.0-12 hp-ilo-8.5.0-1.rhel5 hp-health-8.6.0.24-27 hp-OpenIPMI-8.5.0-1.rhel5 cpqacuxe-8.60-7.0
cpq_cciss-3.6.26-5
# /etc/multipath.conf
defaults {
udev_dir /dev
polling_interval 10
selector "round-robin 0"
path_grouping_policy failover
getuid_callout "/sbin/scsi_id -g -u -s /block/%n"
prio_callout "/bin/true"
path_checker tur
rr_min_io 100
rr_weight uniform
failback immediate
no_path_retry 12
user_friendly_names yes
}
blacklist {
devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*"
devnode "^hd[a-z][[0-9]*]"
}
devices {
device {
vendor "HP"
product "MSA2012sa|MSA2312sa|MSA2324sa"
path_grouping_policy group_by_prio
getuid_callout "/sbin/scsi_id -g -u -n -s /block/%n"
path_checker tur
path_selector "round-robin 0"
prio_callout "/sbin/mpath_prio_alua %d"
rr_weight uniform
failback immediate
hardware_handler "0"
no_path_retry 18
rr_min_io 100
}
}
# /var/log/dmesg (When only one cable connected)
SCSI subsystem initialized
HP CISS Driver (v 3.6.26-5)
cciss: Device 0x3230 has been found at bus 6 dev 0 func 0
ACPI: PCI Interrupt 0000:06:00.0[A] -> GSI 30 (level, low) -> IRQ 122
cciss0: Placing controller into performant mode
cciss/c0d0: p1 p2 p3 p4 < p5 >
cciss: Device 0x323a has been found at bus 12 dev 0 func 0
ACPI: PCI Interrupt 0000:0c:00.0[A] -> GSI 16 (level, low) -> IRQ 169
cciss1: Placing controller into performant mode
Fusion MPT SAS Host driver 4.00.13.07
Fusion MPT SPI Host driver 4.00.13.07
device-mapper: uevent: version 1.0.3
device-mapper: ioctl: 4.11.5-ioctl (2007-12-12) initialised: dm-devel@redhat.com
usb 6-1: new full speed USB device using uhci_hcd and address 2
device-mapper: dm-raid45: initialized v0.2594l
# multipath -ll
# multipath -v5
cciss!c0d0: not found in pathvec
cciss!c0d0: mask = 0x1f
cciss!c0d0: bus = 4
cciss!c0d0: dev_t = 104:0
cciss!c0d0: size = 234374976
cciss!c1d0: not found in pathvec
cciss!c1d0: mask = 0x1f
cciss!c1d0: bus = 4
cciss!c1d0: dev_t = 105:0
dm-0: blacklisted
dm-1: blacklisted
dm-2: blacklisted
dm-3: blacklisted
dm-4: blacklisted
dm-5: blacklisted
dm-6: blacklisted
dm-7: blacklisted
dm-8: blacklisted
dm-9: blacklisted
loop0: blacklisted
loop1: blacklisted
loop2: blacklisted
loop3: blacklisted
loop4: blacklisted
loop5: blacklisted
loop6: blacklisted
loop7: blacklisted
md0: blacklisted
ram0: blacklisted
ram10: blacklisted
ram11: blacklisted
ram12: blacklisted
ram13: blacklisted
ram14: blacklisted
ram15: blacklisted
ram1: blacklisted
ram2: blacklisted
ram3: blacklisted
ram4: blacklisted
ram5: blacklisted
ram6: blacklisted
ram7: blacklisted
ram8: blacklisted
ram9: blacklisted
===== no paths =====
libdevmapper: ioctl/libdm-iface.c(1740): dm names NF [16384]
libdevmapper: ioctl/libdm-iface.c(1740): dm table vg00-tmp NF [16384]
libdevmapper: ioctl/libdm-iface.c(1740): dm table vg00-home NF [16384]
libdevmapper: ioctl/libdm-iface.c(1740): dm table vg00-log NF [16384]
libdevmapper: ioctl/libdm-iface.c(1740): dm table vg00-mcx NF [16384]
libdevmapper: ioctl/libdm-iface.c(1740): dm table vg00-usr NF [16384]
libdevmapper: ioctl/libdm-iface.c(1740): dm table vg00-var NF [16384]
libdevmapper: ioctl/libdm-iface.c(1740): dm table vg00-archive NF [16384]
libdevmapper: ioctl/libdm-iface.c(1740): dm table vg00-cdr NF [16384]
libdevmapper: ioctl/libdm-iface.c(1740): dm table vg00-opt NF [16384]
libdevmapper: ioctl/libdm-iface.c(1740): dm table vg00-ready NF [16384]
# /sbin/hp_scsi_id -g -u -n -s /block/cciss\!c0d0
3600c0ff0001047c653f06b4d01000000
We need urgent help to get this problem solved - has anyone managed to get ths HW+SW combo working?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-07-2011 07:29 AM
тАО03-07-2011 07:29 AM
Re: RHEL 5.5 multipath problem (P700m + MSA2324sa)
Can you pst your complete /etc/multipath.conf?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-07-2011 08:35 AM
тАО03-07-2011 08:35 AM
Re: RHEL 5.5 multipath problem (P700m + MSA2324sa)
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-07-2011 08:40 AM
тАО03-07-2011 08:40 AM
Re: RHEL 5.5 multipath problem (P700m + MSA2324sa)
blacklist {
# wwid 26353900f02796769
devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*"
devnode "^hd[a-z][[0-9]*]"
devnode "^cciss!c[0-9]d[0-9]*"
# device {
# vendor "HP"
# product "OPEN-*"
# }
}
Then multipath -F
Then do issue_lip and scan on each of your fc hosts.
Do you have lsscsi installed? Do the MAS luns even appear at all?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-07-2011 09:04 AM
тАО03-07-2011 09:04 AM
Re: RHEL 5.5 multipath problem (P700m + MSA2324sa)
Hence I have to keed the cciss part commented or else all devices are blacklisted.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-07-2011 10:00 AM
тАО03-07-2011 10:00 AM
Re: RHEL 5.5 multipath problem (P700m + MSA2324sa)
I never had any HP Array that's SAS connected... do you have documentation handy for your MSA array and possibly a HOWTO in a Linux environment?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-08-2011 10:01 AM
тАО03-08-2011 10:01 AM
Re: RHEL 5.5 multipath problem (P700m + MSA2324sa)
1) Installed RHEL 5.5 again with following base install:
%packages
@admin-tools
@base
@core
@development-tools
@development-libs
@system-tools
@base-x
@editors
2) Installed PSP 8.60 with following packages:
cpq_cciss-3.6.26-5.rhel5.i686.rpm
mptlinux-4.00.13.07-5.rhel5.i686.rpm
hp-OpenIPMI-8.5.0-1.rhel5.i386.rpm
hp-ilo-8.5.0-1.rhel5.i386.rpm
hp-health-8.6.0.24-27.rhel5.i386.rpm
hp-snmp-agents-8.6.0.18-18.rhel5.i386.rpm
hpmouse-1.2.0-96.noarch.rpm
hpsmh-6.2.0-12.i386.rpm
hp-smh-templates-8.6.0.14-16.noarch.rpm
hpvca-6.2.0-8.linux.rpm
cpqacuxe-8.60-7.0.noarch.rpm
hpacucli-8.60-8.0.noarch.rpm
hpdiags-8.6.0-18.linux.i586.rpm
hponcfg-3.1.0-0.noarch.rpm
3) Installed HPDMmultipath-4.4.1
Situation after this:
# multipath -v3
...
===== paths list =====
uuid hcil dev dev_t pri dm_st chk_st
3600c0ff0001021929bb9744d01000000 #:#:#:# cciss!c0d0 104:0 50 [undef][ready]
3600c0ff0001021929bb9744d01000000 #:#:#:# cciss!c0d1 104:16 10 [undef][ready]
3600c0ff0001021929bb9744d01000000 #:#:#:# cciss!c0d2 104:32 10 [undef][ready]
3600c0ff0001021929bb9744d01000000 #:#:#:# cciss!c0d3 104:48 50 [undef][ready]
Found matching wwid [3600c0ff0001021929bb9744d01000000] in bindings file.
Setting alias to mpath0
cciss!c0d0: ownership set to mpath0
cciss!c0d0: not found in pathvec
cciss!c0d0: mask = 0xc
cciss!c0d0: state = 2
cciss!c0d0: prio = 50
cciss!c0d1: ownership set to mpath0
cciss!c0d1: not found in pathvec
cciss!c0d1: mask = 0xc
cciss!c0d1: state = 2
cciss!c0d1: prio = 10
cciss!c0d2: ownership set to mpath0
cciss!c0d2: not found in pathvec
cciss!c0d2: mask = 0xc
cciss!c0d2: state = 2
cciss!c0d2: prio = 10
cciss!c0d3: ownership set to mpath0
cciss!c0d3: not found in pathvec
cciss!c0d3: mask = 0xc
cciss!c0d3: state = 2
cciss!c0d3: prio = 50
mpath0: pgfailback = -2 (controller setting)
mpath0: pgpolicy = group_by_prio (controller setting)
mpath0: selector = round-robin 0 (controller setting)
mpath0: features = 0 (internal default)
mpath0: hwhandler = 0 (controller setting)
mpath0: rr_weight = 1 (internal default)
mpath0: minio = 100 (controller setting)
mpath0: no_path_retry = 18 (controller setting)
pg_timeout = NONE (internal default)
mpath0: set ACT_CREATE (map does not exist)
mpath0: failed to load map (a path might be in use)
mpath0: domap (0) failure for create/reload map
...
and
# multipath -d
create: mpath0 (3600c0ff0001021929bb9744d01000000) HP,MSA2324sa
[size=121G][features=0][hwhandler=0][n/a]
\_ round-robin 0 [prio=100][undef]
\_ #:#:#:# cciss!c0d0 104:0 [undef][ready]
\_ #:#:#:# cciss!c0d3 104:48 [undef][ready]
\_ round-robin 0 [prio=20][undef]
\_ #:#:#:# cciss!c0d1 104:16 [undef][ready]
\_ #:#:#:# cciss!c0d2 104:32 [undef][ready]
note!
# multipath
# multipath -ll >> doesn't return anything
Can anybody help me forward from here on???
-Timo
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО04-12-2011 05:45 AM
тАО04-12-2011 05:45 AM
Re: RHEL 5.5 multipath problem (P700m + MSA2324sa)
Thanks
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО04-22-2011 07:41 AM
тАО04-22-2011 07:41 AM
Re: RHEL 5.5 multipath problem (P700m + MSA2324sa)
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО04-22-2011 07:53 AM
тАО04-22-2011 07:53 AM
Re: RHEL 5.5 multipath problem (P700m + MSA2324sa)
HP support has verified that the problem exists, at least with my RedHat5.6 version. I am now trying to resolve with RedHat. HP has no know resolution.
I will update this thread as I receive results.