rx6600 Linux HBA problem

[MartyB]

Hello, I am testing RHEL4U5 on one of our rx6600 systems attached to a DMX, but I'm having trouble getting the system to see the presented LUN. I've already asked our DMX admin to double check all zoning/presentation setttings. I have been able to get the SCSI layer to see it:

# cat /proc/scsi/scsi
Attached devices:
Host: scsi0 Channel: 00 Id: 00 Lun: 00
Vendor: TEAC Model: DV-28E-N Rev: C.6C
Type: CD-ROM ANSI SCSI revision: 02
Host: scsi1 Channel: 00 Id: 03 Lun: 00
Vendor: HP Model: DG072ABAB3 Rev: HPD5
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi1 Channel: 00 Id: 04 Lun: 00
Vendor: HP Model: DG072ABAB3 Rev: HPD5
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi2 Channel: 00 Id: 00 Lun: 00
Vendor: EMC Model: SYMMETRIX Rev: 5771
Type: RAID ANSI SCSI revision: 02
Host: scsi3 Channel: 00 Id: 00 Lun: 00
Vendor: EMC Model: SYMMETRIX Rev: 5771
Type: RAID ANSI SCSI revision: 02

But I can't get a device assigned. I'm thinking it may be the driver, but I'm not sure. Any ideas? Here's some other info that may be relevant:

/var/log/messages:

Feb 29 18:22:51 host kernel: ACPI: PCI Interrupt 0000:0f:01.0[A] -> GSI 49 (level, low) -> IRQ 53
Feb 29 18:22:51 host kernel: qla2400 0000:0f:01.0: Found an ISP2422, irq 53, iobase 0xc0000000b0040000
Feb 29 18:22:51 host kernel: qla2400 0000:0f:01.0: Configuring PCI space...
Feb 29 18:22:51 host kernel: qla2400 0000:0f:01.0: Configure NVRAM parameters...
Feb 29 18:22:51 host kernel: qla2400 0000:0f:01.0: Verifying loaded RISC code...
Feb 29 18:22:51 host kernel: qla2400 0000:0f:01.0: Allocated (1061 KB) for firmware dump...
Feb 29 18:22:51 host kernel: qla2400 0000:0f:01.0: Waiting for LIP to complete...
Feb 29 18:22:51 host kernel: qla2400 0000:0f:01.0: LIP reset occured (f7f7).
Feb 29 18:22:51 host kernel: qla2400 0000:0f:01.0: Cable is unplugged...
Feb 29 18:22:51 host kernel: scsi2 : qla2xxx
Feb 29 18:22:51 host kernel: qla2400 0000:0f:01.0:
Feb 29 18:22:51 host kernel: QLogic Fibre Channel HBA Driver: 8.01.04-d8
Feb 29 18:22:51 host kernel: QLogic HP AB378-60101 -
Feb 29 18:22:51 host kernel: ISP2422: PCI-X Mode 2 (133 MHz) @ 0000:0f:01.0 hdma+, host#=2, fw=4.00.23 [IP]
Feb 29 18:22:51 host kernel: ACPI: PCI Interrupt 0000:23:01.0[A] -> GSI 93 (level, low) -> IRQ 57
Feb 29 18:22:51 host kernel: qla2400 0000:23:01.0: Found an ISP2422, irq 57, iobase 0xc0000000f0040000
Feb 29 18:22:51 host kernel: qla2400 0000:23:01.0: Configuring PCI space...
Feb 29 18:22:51 host kernel: qla2400 0000:23:01.0: Configure NVRAM parameters...
Feb 29 18:22:51 host kernel: qla2400 0000:23:01.0: Verifying loaded RISC code...
Feb 29 18:22:51 host kernel: qla2400 0000:23:01.0: Allocated (1061 KB) for firmware dump...
Feb 29 18:22:51 host kernel: qla2400 0000:23:01.0: Waiting for LIP to complete...
Feb 29 18:22:51 host kernel: qla2400 0000:23:01.0: LIP reset occured (f7f7).
Feb 29 18:22:51 host kernel: qla2400 0000:23:01.0: Cable is unplugged...
Feb 29 18:22:51 host kernel: scsi3 : qla2xxx
Feb 29 18:22:51 host kernel: qla2400 0000:23:01.0:
Feb 29 18:22:51 host kernel: QLogic Fibre Channel HBA Driver: 8.01.04-d8
Feb 29 18:22:51 host kernel: QLogic HP AB378-60101 -
Feb 29 18:22:52 host kernel: ISP2422: PCI-X Mode 2 (133 MHz) @ 0000:23:01.0 hdma+, host#=3, fw=4.00.23 [IP]
Feb 29 18:22:52 host kernel: device-mapper: 4.5.5-ioctl (2006-12-01) initialised: dm-devel@redhat.com


Thanks!

[Ivan Ferreira · Accepted solution]

If you already rebooted the server, then I had similar problems with a Solaris Host. After I changed a value in the HBA using QLogic SanSurfer, the LUNs where visible.

I don't remember exactly the value, but was something related to "publish any lun visible to host" instead of only those with persistend binding configured.

[MartyB]

Thanks for the reply Ivan! I think this is what you're talking about, and I believe I already have the correct option enabled:

1: Present targets that are persistently bound plus
any new target(s) (Current)
2: Present targets that are persistently bound Only
3: Bind by World Wide Port Name (Current)
4: Bind by Port ID
5: Commit Changes for this HBA
6: Return to HBA Selection Menu

If you're referring to something else, please let me know!

[skt_skt]

post "/etc/modprobe.conf"

[skt_skt]

options qla2xxx ConfigRequired=0 ql2xfailover=0

ql2xfailover=0 is to facilitate HBA failover using the qlogic driver. ConfigRequired=0 says all the LUNS discovered in this system will be presented to the OS.
If this value is set to 1, only those LUNS specified in /etc/qla2xxx.conf will be visibile to the OS

[MartyB]

Santhosh, thanks for the tip! It appears my modprobe.conf is good, but here it is in case I'm missing something:

# cat /etc/modprobe.conf
alias scsi_hostadapter usb-storage
alias eth0 e1000
alias eth1 e1000
alias scsi_hostadapter2 mptbase
alias scsi_hostadapter3 mptscsi
alias scsi_hostadapter4 mptspi
alias scsi_hostadapter5 mptsas
alias scsi_hostadapter6 mptscsih
alias usb-controller ehci-hcd
alias usb-controller1 ohci-hcd
options scsi_mod max_luns=255
install qla2xxx /sbin/modprobe qla2xxx_conf; /sbin/modprobe --ignore-install qla2xxx
remove qla2xxx /sbin/modprobe -r --first-time --ignore-remove qla2xxx && { /sbin/modprobe -r --ignore-remove qla2xxx_conf; }
options qla2xxx ql2xfailover=0 ConfigRequired=0
alias scsi_hostadapter1 qla2xxx_conf
alias scsi_hostadapter7 qla2xxx
alias scsi_hostadapter8 qla2400

[skt_skt]

we dont use the install and remove entry

root [/etc]cat modprobe.conf
alias eth0 tg3
alias eth1 tg3
alias scsi_hostadapter qla2xxx
alias scsi_hostadapter1 ips
alias scsi_hostadapter2 ata_piix
alias scsi_hostadapter3 qla2400
alias usb-controller ehci-hcd
alias usb-controller1 uhci-hcd
options scsi_mod max_luns=256
options qla2xxx ql2xfailover=0 ConfigRequired=0 ql2xprocessrscn=1
###BEGINPP
include /etc/modprobe.conf.pp
###ENDPP

[MartyB]

I went ahead and commented them out (and rebooted) hoping it'd help, but I'm still dead in the water.

Any other ideas out there??

[skt_skt]

did u rebuld the initrd image(keep a backup)after the change in the modprobe.conf.

mkinitrd -f /boot/initrd-`uname -r`.img `uname -r`After the initrd is rebuilt, reboot the system for the changes to take effect.

[MartyB]

Sorry for the late reply on this. Yes, when I installed the QLogic driver, it automatically rebuilt the initrd for me. Any other things I can try / look at?

Thanks!

[skt_skt]

i meant you need to rebuild the *.img(take a backup) after the chnages in modprobe.conf.

[MartyB]

Unfortunately, it's still a no go. Here's a snip from /var/log/messages on this most recent reboot:

Mar 20 18:06:27 host kernel: mptbase: Initiating ioc0 bringup
Mar 20 18:06:27 host kernel: ioc0: SAS1068: Capabilities={Initiator}
Mar 20 18:06:27 host kernel: scsi1 : ioc0: LSISAS1068, FwRev=01100000h, Ports=1, MaxQ=268, IRQ=54
Mar 20 18:06:27 host kernel: Vendor: HP Model: DG072ABAB3 Rev: HPD5
Mar 20 18:06:27 host kernel: Type: Direct-Access ANSI SCSI revision: 05
Mar 20 18:06:27 host kernel: SCSI device sda: 143374738 512-byte hdwr sectors (73408 MB)
Mar 20 18:06:27 host kernel: SCSI device sda: drive cache: write through
Mar 20 18:06:27 host kernel: SCSI device sda: 143374738 512-byte hdwr sectors (73408 MB)
Mar 20 18:06:27 host kernel: SCSI device sda: drive cache: write through
Mar 20 18:06:27 host kernel: sda: sda1 sda2 sda3
Mar 20 18:06:27 host kernel: Attached scsi disk sda at scsi1, channel 0, id 3, lun 0
Mar 20 18:06:27 host kernel: Vendor: HP Model: DG072ABAB3 Rev: HPD5
Mar 20 18:06:27 host kernel: Type: Direct-Access ANSI SCSI revision: 05
Mar 20 18:06:27 host kernel: SCSI device sdb: 143374738 512-byte hdwr sectors (73408 MB)
Mar 20 18:06:27 host kernel: SCSI device sdb: drive cache: write through
Mar 20 18:06:27 host kernel: SCSI device sdb: 143374738 512-byte hdwr sectors (73408 MB)
Mar 20 18:06:27 host kernel: SCSI device sdb: drive cache: write through
Mar 20 18:06:27 host kernel: sdb: sdb1 sdb2
Mar 20 18:06:27 host kernel: Attached scsi disk sdb at scsi1, channel 0, id 4, lun 0
Mar 20 18:06:27 host kernel: ACPI: PCI Interrupt 0000:0f:01.0[A] -> GSI 49 (level, low) -> IRQ 53
Mar 20 18:06:27 host kernel: qla2400 0000:0f:01.0: Found an ISP2422, irq 53, iobase 0xc0000000b0040000
Mar 20 18:06:27 host kernel: qla2400 0000:0f:01.0: Configuring PCI space...
Mar 20 18:06:27 host kernel: qla2400 0000:0f:01.0: Configure NVRAM parameters...
Mar 20 18:06:27 host kernel: qla2400 0000:0f:01.0: Verifying loaded RISC code...
Mar 20 18:06:27 host kernel: qla2400 0000:0f:01.0: Allocated (64 KB) for EFT...
Mar 20 18:06:27 host kernel: qla2400 0000:0f:01.0: Allocated (1413 KB) for firmware dump...
Mar 20 18:06:27 host kernel: qla2400 0000:0f:01.0: Waiting for LIP to complete...
Mar 20 18:06:28 host kernel: qla2400 0000:0f:01.0: LIP reset occured (f7f7).
Mar 20 18:06:28 host kernel: qla2400 0000:0f:01.0: LOOP UP detected (2 Gbps).
Mar 20 18:06:28 host kernel: qla2400 0000:0f:01.0: Topology - (F_Port), Host Loop address 0x0
Mar 20 18:06:28 host kernel: scsi2 : qla2xxx
Mar 20 18:06:28 host kernel: qla2400 0000:0f:01.0:
Mar 20 18:06:28 host kernel: QLogic Fibre Channel HBA Driver: 8.01.07.15
Mar 20 18:06:28 host kernel: QLogic HP AB378-60101 -
Mar 20 18:06:28 host kernel: ISP2422: PCI-X Mode 2 (133 MHz) @ 0000:0f:01.0 hdma+, host#=2, fw=4.00.26 [IP]
Mar 20 18:06:28 host kernel: scsi: unknown device type 12
Mar 20 18:06:28 host kernel: Vendor: EMC Model: SYMMETRIX Rev: 5771
Mar 20 18:06:28 host kernel: Type: RAID ANSI SCSI revision: 02
Mar 20 18:06:28 host kernel: qla2400 0000:0f:01.0: scsi(2:0:0:0): Enabled tagged queuing, queue depth 32.
Mar 20 18:06:28 host kernel: ACPI: PCI Interrupt 0000:23:01.0[A] -> GSI 93 (level, low) -> IRQ 57
Mar 20 18:06:28 host kernel: qla2400 0000:23:01.0: Found an ISP2422, irq 57, iobase 0xc0000000f0040000
Mar 20 18:06:28 host kernel: qla2400 0000:23:01.0: Configuring PCI space...
Mar 20 18:06:28 host kernel: qla2400 0000:23:01.0: Configure NVRAM parameters...
Mar 20 18:06:28 host kernel: qla2400 0000:23:01.0: Verifying loaded RISC code...
Mar 20 18:06:28 host kernel: qla2400 0000:23:01.0: Allocated (64 KB) for EFT...
Mar 20 18:06:28 host kernel: qla2400 0000:23:01.0: Allocated (1413 KB) for firmware dump...
Mar 20 18:06:28 host kernel: qla2400 0000:23:01.0: Waiting for LIP to complete...
Mar 20 18:06:28 host kernel: qla2400 0000:23:01.0: LIP reset occured (f7f7).
Mar 20 18:06:28 host kernel: qla2400 0000:23:01.0: LOOP UP detected (2 Gbps).
Mar 20 18:06:28 host kernel: qla2400 0000:23:01.0: Topology - (F_Port), Host Loop address 0x0
Mar 20 18:06:28 host kernel: scsi3 : qla2xxx
Mar 20 18:06:28 host kernel: qla2400 0000:23:01.0:
Mar 20 18:06:28 host kernel: QLogic Fibre Channel HBA Driver: 8.01.07.15
Mar 20 18:06:28 host kernel: QLogic HP AB378-60101 -
Mar 20 18:06:28 host kernel: ISP2422: PCI-X Mode 2 (133 MHz) @ 0000:23:01.0 hdma+, host#=3, fw=4.00.26 [IP]
Mar 20 18:06:28 host kernel: scsi: unknown device type 12
Mar 20 18:06:28 host kernel: Vendor: EMC Model: SYMMETRIX Rev: 5771
Mar 20 18:06:28 host kernel: Type: RAID ANSI SCSI revision: 02
Mar 20 18:06:28 host kernel: qla2400 0000:23:01.0: scsi(3:0:0:0): Enabled tagged queuing, queue depth 32.
Mar 20 18:06:28 host kernel: device-mapper: 4.5.5-ioctl (2006-12-01) initialised: dm-devel@redhat.com

Does anything jump out?

Thanks for the help!

[skt_skt]

Do you power path also here? If not ignore.
PP and DM need to be present at the same time.

[MartyB]

Nope, no PowerPath installed on this system.

[MartyB]

FINALLY! After getting our SAN guy to take another look, there was some zoning issue that he overlooked. It's all good now.

Thanks so much for everyone's advice.

[MartyB]

see last comment

[skt_skt]

let us know what was really wrong at SAN side?

masking Databse not refreshed or what ever...