EVA3000, QLA2340 & linux not seeing new LUNs without a reboot

[James Specht]

Hopefully someone can help me on this one. We are a month into a new EVA3000 server configuration. We are testing SUSE linux 9.1, which will be our database server, in the SAN. We can added and resize luns but only see the changes on a reboot, which is will not happen often once we go live. We also have plans to use Business Copy to do some of the database backups and clones so we really need to see the new luns without rebooting. We don not use Secure Path per HP's installers. The QLogic drivers handle the fail-over, fail-back fine.

Here are the facts:
EVA3000
SUSE linux 9.1
QLA2340 (two for multi path fail-over)

Currently the server is sitting with 6 LUNs attached and in use, one LUN presented but not completely seen by SUSE. (See dmesg) and one LUN has been resized, which is in the same state as the newly presented disk. (Output from fdsik & dmesg)

# cat /proc/scsi/scsi
Attached devices:
Host: scsi0 Channel: 00 Id: 00 Lun: 01
Vendor: HP Model: HSV100 Rev: 3020
Type: Direct-Access ANSI SCSI revision: 02
Host: scsi0 Channel: 00 Id: 00 Lun: 02
Vendor: HP Model: HSV100 Rev: 3020
Type: Direct-Access ANSI SCSI revision: 02
Host: scsi0 Channel: 00 Id: 00 Lun: 03
Vendor: HP Model: HSV100 Rev: 3020
Type: Direct-Access ANSI SCSI revision: 02
Host: scsi0 Channel: 00 Id: 00 Lun: 04
Vendor: HP Model: HSV100 Rev: 3020
Type: Direct-Access ANSI SCSI revision: 02
Host: scsi0 Channel: 00 Id: 00 Lun: 05
Vendor: HP Model: HSV100 Rev: 3020
Type: Direct-Access ANSI SCSI revision: 02
Host: scsi0 Channel: 00 Id: 00 Lun: 06
Vendor: HP Model: HSV100 Rev: 3020
Type: Direct-Access ANSI SCSI revision: 02
Host: scsi0 Channel: 00 Id: 02 Lun: 00
Vendor: HP Model: HSV100 Rev: 3020
Type: RAID ANSI SCSI revision: 02
Host: scsi0 Channel: 00 Id: 00 Lun: 00
Vendor: HP Model: HSV100 Rev: 3020
Type: RAID ANSI SCSI revision: 02


# cat /proc/scsi/qla2xxx/0
QLogic PCI to Fibre Channel Host Adapter for QLA2340:
Firmware version 3.02.30 IPX, Driver version 8.00.00b14-fo
Entry address = f9194000
ISP: ISP2312, Serial# R28095
Request Queue = 0x36d00000, Response Queue = 0x36cf0000
Request Queue count = 2048, Response Queue count = 512
Total number of active commands = 0
Total number of interrupts = 5113079
Device queue depth = 0x10
Number of free request entries = 852
Number of mailbox timeouts = 0
Number of ISP aborts = 0
Number of loop resyncs = 0
Number of retries for empty slots = 0
Number of reqs in pending_q= 0, retry_q= 0, done_q= 0, scsi_retry_q= 0
Number of reqs in failover_q= 0
Host adapter:loop state = , flags = 0x1a03
Dpc flags = 0x0
MBX flags = 0x0
Link down Timeout = 008
Port down retry = 030
Login retry count = 030
Commands retried with dropped frame(s) = 0
Product ID = 4953 5020 2020 0002


SCSI Device Information:
scsi-qla0-adapter-node=200000e08b1a5f5e;
scsi-qla0-adapter-port=210000e08b1a5f5e;
scsi-qla0-target-0=50001fe150046459;
scsi-qla0-target-2=50001fe1500463c9;

FC Port Information:
scsi-qla0-port-0=50001fe150046450:50001fe150046459:0b0100:81;
scsi-qla0-port-1=50001fe150046450:50001fe15004645c:0b0200:82;
scsi-qla0-port-2=50001fe1500463c0:50001fe1500463c9:0d0100:83;
scsi-qla0-port-3=50001fe1500463c0:50001fe1500463cc:0d0200:84;

SCSI LUN Information:
(Id:Lun) * - indicates lun is not registered with the OS.
( 0: 0): Total reqs 14, Pending reqs 0, flags 0x0, 0:0:81 00
( 0: 1): Total reqs 612, Pending reqs 0, flags 0x0, 0:0:81 00
( 0: 2): Total reqs 80241, Pending reqs 0, flags 0x0, 0:0:81 00
( 0: 3): Total reqs 4242672, Pending reqs 0, flags 0x0, 0:1:82 00
( 0: 4): Total reqs 785780, Pending reqs 0, flags 0x0, 0:1:82 00
( 0: 5): Total reqs 316, Pending reqs 0, flags 0x0, 0:0:81 00
( 0: 6): Total reqs 2914, Pending reqs 0, flags 0x0, 0:0:81 00
( 2: 0): Total reqs 8, Pending reqs 0, flags 0x0, 0:0:83 00


# cat /proc/scsi/qla2xxx/1
QLogic PCI to Fibre Channel Host Adapter for QLA2340:
Firmware version 3.02.30 IPX, Driver version 8.00.00b14-fo
Entry address = f9194000
ISP: ISP2312, Serial# R28150
Request Queue = 0x36bc0000, Response Queue = 0x36c20000
Request Queue count = 2048, Response Queue count = 512
Total number of active commands = 0
Total number of interrupts = 12209
Device queue depth = 0x10
Number of free request entries = 2047
Number of mailbox timeouts = 0
Number of ISP aborts = 0
Number of loop resyncs = 0
Number of retries for empty slots = 0
Number of reqs in pending_q= 0, retry_q= 0, done_q= 0, scsi_retry_q= 0
Number of reqs in failover_q= 0
Host adapter:loop state = , flags = 0x1a03
Dpc flags = 0x0
MBX flags = 0x0
Link down Timeout = 008
Port down retry = 030
Login retry count = 030
Commands retried with dropped frame(s) = 0
Product ID = 4953 5020 2020 0002


SCSI Device Information:
scsi-qla1-adapter-node=200000e08b1a965e;
scsi-qla1-adapter-port=210000e08b1a965e;

FC Port Information:
scsi-qla1-port-0=50001fe150046450:50001fe150046458:0a0100:81;
scsi-qla1-port-1=50001fe150046450:50001fe15004645d:0a0200:82;
scsi-qla1-port-2=50001fe1500463c0:50001fe1500463c8:0c0100:83;
scsi-qla1-port-3=50001fe1500463c0:50001fe1500463cd:0c0200:84;

SCSI LUN Information:
(Id:Lun) * - indicates lun is not registered with the OS.


# cat /proc/scsi/qla2xxx/1
QLogic PCI to Fibre Channel Host Adapter for QLA2340:
Firmware version 3.02.30 IPX, Driver version 8.00.00b14-fo
Entry address = f9194000
ISP: ISP2312, Serial# R28150
Request Queue = 0x36bc0000, Response Queue = 0x36c20000
Request Queue count = 2048, Response Queue count = 512
Total number of active commands = 0
Total number of interrupts = 12209
Device queue depth = 0x10
Number of free request entries = 2047
Number of mailbox timeouts = 0
Number of ISP aborts = 0
Number of loop resyncs = 0
Number of retries for empty slots = 0
Number of reqs in pending_q= 0, retry_q= 0, done_q= 0, scsi_retry_q= 0
Number of reqs in failover_q= 0
Host adapter:loop state = , flags = 0x1a03
Dpc flags = 0x0
MBX flags = 0x0
Link down Timeout = 008
Port down retry = 030
Login retry count = 030
Commands retried with dropped frame(s) = 0
Product ID = 4953 5020 2020 0002


SCSI Device Information:
scsi-qla1-adapter-node=200000e08b1a965e;
scsi-qla1-adapter-port=210000e08b1a965e;

FC Port Information:
scsi-qla1-port-0=50001fe150046450:50001fe150046458:0a0100:81;
scsi-qla1-port-1=50001fe150046450:50001fe15004645d:0a0200:82;
scsi-qla1-port-2=50001fe1500463c0:50001fe1500463c8:0c0100:83;
scsi-qla1-port-3=50001fe1500463c0:50001fe1500463cd:0c0200:84;

SCSI LUN Information:
(Id:Lun) * - indicates lun is not registered with the OS.


The resized disk was originally 10G and was resized to 15G.
# fdisk -l /dev/sdd

Disk /dev/sdd: 10.7 GB, 10737418240 bytes
64 heads, 32 sectors/track, 10240 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Device Boot Start End Blocks Id System
/dev/sdd1 1 10240 10485744 83 Linux

A full dmesg is attached.

[Kevin Joubert]

I don't know if anyone has answered this yet.. but you have to force the system to re-read the disk geometry after you resize the LUN.

There are numerous ways to accomplish this, but the one that works for me is...

sfdisk -R /dev/sd?

where /dev/sd? is your resized LUN (ie. sda, etc.)

[James Specht]

Thanks.

We can consider this closed. I resolved the issue myself.

[SAKET_5]

James,

Mind sharing how you resolved the issue? Sfdisk or HPFibreChannel Utilities or something else did the trick?

Regards,

[James Specht]

If you look at the driver information SUSE 9.x installed its own drivers which is listed below.

Firmware version 3.02.30 IPX, Driver version 8.00.00b14-fo

Notice the "b14" and the firmware version.

HP had me uninstall SUSE's drivers and manually install theirs as there is a problem with the 64bit drivers logic in the install.sh script. Now everything works fine under the following setting.

Firmware version 3.03.01 IPX, Driver version 8.00.00-fo

[James Specht]

Thread closed.