SAN problem RHEL 3

[abhijit007]

My problem is that whenever i try to unzip a dump file(.dmp) the mount point hangs(ll command not responding).I checked the /var/log
messages-"kernel: 467 [RAIDarray.mpp]cannot get memory for mppLnx_CmndEntry_t".Other moint point is working fine.

[Matti_Kurkela]

If a kernel says "cannot get memory" for any reason, that means either your system is under a very heavy workload and desperately needs some more RAM, or the driver or the kernel is buggy.

RHEL 3 is fairly old, and many kernel bugs have been patched during its lifetime. Is your system up to date?

Please show us the output of the following commands:

cat /etc/redhat-release
uname -a
cat /proc/scsi/qla2300/?

These will allow us to identify the update level of RHEL3, kernel version and QLogic driver version (assuming I've guessed your HBA type correctly).

MK

[abhijit007]

Dear M.K,
Here are the outputs od the commands you had given-
QLogic PCI to Fibre Channel Host Adapter for QLA2340:
Firmware version: 3.03.11, Driver version 7.05.00-RH1
Entry address = f884e060
HBA: QLA2312 , Serial# Q10064
Request Queue = 0x36f40000, Response Queue = 0x36f30000
Request Queue count= 512, Response Queue count= 512
Total number of active commands = 0
Total number of interrupts = 9104349
Total number of IOCBs (used/max) = (0/600)
Total number of queued commands = 0
Device queue depth = 0x20
Number of free request entries = 347
Number of mailbox timeouts = 0
Number of ISP aborts = 0
Number of loop resyncs = 3
Number of retries for empty slots = 0
Number of reqs in pending_q= 0, retry_q= 0, done_q= 0, scsi_retry_q= 0
Host adapter:loop state= , flags= 0x860813
Dpc flags = 0x0
MBX flags = 0x0
SRB Free Count = 4096
Link down Timeout = 000
Port down retry = 030
Login retry count = 030
Commands retried with dropped frame(s) = 0
Configured characteristic impedence: 50 ohms
Configured data rate: 1-2 Gb/sec auto-negotiate


SCSI Device Information:
scsi-qla0-adapter-node=200000e08b185091;
scsi-qla0-adapter-port=210000e08b185091;
scsi-qla0-target-0=201100a0b813ccc1;
scsi-qla0-target-1=500308c1427af004;
scsi-qla0-target-2=201000a0b813ccc1;
scsi-qla0-target-3=500308c1427af001;

SCSI LUN Information:
(Id:Lun) * - indicates lun is not registered with the OS.
( 0: 0): Total reqs 2971, Pending reqs 0, flags 0x0, 0:0:81,
( 0: 1): Total reqs 116, Pending reqs 0, flags 0x0, 0:0:81,
( 0: 2): Total reqs 467487, Pending reqs 0, flags 0x0, 0:0:81,
( 0: 3): Total reqs 111, Pending reqs 0, flags 0x0, 0:0:81,
( 0: 4): Total reqs 7, Pending reqs 0, flags 0x0, 0:0:81,
( 0: 5): Total reqs 1554589, Pending reqs 0, flags 0x0, 0:0:81,
( 0: 6): Total reqs 7, Pending reqs 0, flags 0x0, 0:0:81,
( 0: 8): Total reqs 7, Pending reqs 0, flags 0x0, 0:0:81,
( 0: 9): Total reqs 7, Pending reqs 0, flags 0x0, 0:0:81,
( 0:10): Total reqs 993767, Pending reqs 0, flags 0x0, 0:0:81,
( 0:11): Total reqs 53, Pending reqs 0, flags 0x0, 0:0:81,
( 0:12): Total reqs 7, Pending reqs 0, flags 0x0, 0:0:81,
( 0:13): Total reqs 1315256, Pending reqs 0, flags 0x0, 0:0:81,
( 0:14): Total reqs 135486, Pending reqs 0, flags 0x0, 0:0:81,
( 0:15): Total reqs 17, Pending reqs 0, flags 0x0, 0:0:81,
( 0:31): Total reqs 8, Pending reqs 0, flags 0x0, 0:0:81,
( 1: 0): Total reqs 6, Pending reqs 0, flags 0x0, 0:0:83,
( 2: 0): Total reqs 10860, Pending reqs 0, flags 0x0, 0:0:84,
( 2: 1): Total reqs 2716, Pending reqs 0, flags 0x0, 0:0:84,
( 2: 2): Total reqs 2714, Pending reqs 0, flags 0x0, 0:0:84,
( 2: 3): Total reqs 2730, Pending reqs 0, flags 0x0, 0:0:84,
( 2: 4): Total reqs 2531461, Pending reqs 0, flags 0x0, 0:0:84,
( 2: 5): Total reqs 2740, Pending reqs 0, flags 0x0, 0:0:84,
( 2: 6): Total reqs 73119, Pending reqs 0, flags 0x0, 0:0:84,
( 2: 8): Total reqs 2976, Pending reqs 0, flags 0x0, 0:0:84,
( 2: 9): Total reqs 2117380, Pending reqs 0, flags 0x0, 0:0:84,
( 2:10): Total reqs 2707, Pending reqs 0, flags 0x0, 0:0:84,
( 2:11): Total reqs 2707, Pending reqs 0, flags 0x0, 0:0:84,
( 2:12): Total reqs 2770, Pending reqs 0, flags 0x0, 0:0:84,
( 2:13): Total reqs 2707, Pending reqs 0, flags 0x0, 0:0:84,
( 2:14): Total reqs 2707, Pending reqs 0, flags 0x0, 0:0:84,
( 2:15): Total reqs 2707, Pending reqs 0, flags 0x0, 0:0:84,
( 2:31): Total reqs 7, Pending reqs 0, flags 0x0, 0:0:84,
( 3: 0): Total reqs 6, Pending reqs 0, flags 0x0, 0:0:86,
( 3: 1): Total reqs 4, Pending reqs 0, flags 0x0, 0:0:86,
QLogic PCI to Fibre Channel Host Adapter for QLA2340:
Firmware version: 3.03.11, Driver version 7.05.00-RH1
Entry address = f884e060
HBA: QLA2312 , Serial# Q71758
Request Queue = 0x36eb0000, Response Queue = 0x36ea0000
Request Queue count= 512, Response Queue count= 512
Total number of active commands = 0
Total number of interrupts = 9052748
Total number of IOCBs (used/max) = (0/600)
Total number of queued commands = 0
Device queue depth = 0x20
Number of free request entries = 404
Number of mailbox timeouts = 0
Number of ISP aborts = 0
Number of loop resyncs = 0
Number of retries for empty slots = 0
Number of reqs in pending_q= 0, retry_q= 0, done_q= 0, scsi_retry_q= 0
Host adapter:loop state= , flags= 0x860813
Dpc flags = 0x0
MBX flags = 0x0
SRB Free Count = 4096
Link down Timeout = 000
Port down retry = 030
Login retry count = 030
Commands retried with dropped frame(s) = 0
Configured characteristic impedence: 50 ohms
Configured data rate: 1-2 Gb/sec auto-negotiate


SCSI Device Information:
scsi-qla1-adapter-node=200000e08b194e82;
scsi-qla1-adapter-port=210000e08b194e82;
scsi-qla1-target-0=201000a0b813ccc1;
scsi-qla1-target-1=500308c1427af001;
scsi-qla1-target-2=201100a0b813ccc1;
scsi-qla1-target-3=500308c1427af004;

SCSI LUN Information:
(Id:Lun) * - indicates lun is not registered with the OS.
( 0: 0): Total reqs 12, Pending reqs 0, flags 0x0, 1:0:81,
( 0: 1): Total reqs 6, Pending reqs 0, flags 0x0, 1:0:81,
( 0: 2): Total reqs 6, Pending reqs 0, flags 0x0, 1:0:81,
( 0: 3): Total reqs 6, Pending reqs 0, flags 0x0, 1:0:81,
( 0: 4): Total reqs 2528745, Pending reqs 0, flags 0x0, 1:0:81,
( 0: 5): Total reqs 6, Pending reqs 0, flags 0x0, 1:0:81,
( 0: 6): Total reqs 70400, Pending reqs 0, flags 0x0, 1:0:81,
( 0: 8): Total reqs 272, Pending reqs 0, flags 0x0, 1:0:81,
( 0: 9): Total reqs 2114676, Pending reqs 0, flags 0x0, 1:0:81,
( 0:10): Total reqs 6, Pending reqs 0, flags 0x0, 1:0:81,
( 0:11): Total reqs 6, Pending reqs 0, flags 0x0, 1:0:81,
( 0:12): Total reqs 66, Pending reqs 0, flags 0x0, 1:0:81,
( 0:13): Total reqs 6, Pending reqs 0, flags 0x0, 1:0:81,
( 0:14): Total reqs 6, Pending reqs 0, flags 0x0, 1:0:81,
( 0:15): Total reqs 6, Pending reqs 0, flags 0x0, 1:0:81,
( 0:31): Total reqs 7, Pending reqs 0, flags 0x0, 1:0:81,
( 1: 0): Total reqs 6, Pending reqs 0, flags 0x0, 1:0:83,
( 1: 1): Total reqs 4, Pending reqs 0, flags 0x0, 1:0:83,
( 2: 0): Total reqs 257, Pending reqs 0, flags 0x0, 1:0:84,
( 2: 1): Total reqs 112, Pending reqs 0, flags 0x0, 1:0:84,
( 2: 2): Total reqs 467482, Pending reqs 0, flags 0x0, 1:0:84,
( 2: 3): Total reqs 106, Pending reqs 0, flags 0x0, 1:0:84,
( 2: 4): Total reqs 5, Pending reqs 0, flags 0x0, 1:0:84,
( 2: 5): Total reqs 1554584, Pending reqs 0, flags 0x0, 1:0:84,
( 2: 6): Total reqs 5, Pending reqs 0, flags 0x0, 1:0:84,
( 2: 8): Total reqs 5, Pending reqs 0, flags 0x0, 1:0:84,
( 2: 9): Total reqs 5, Pending reqs 0, flags 0x0, 1:0:84,
( 2:10): Total reqs 993762, Pending reqs 0, flags 0x0, 1:0:84,
( 2:11): Total reqs 49, Pending reqs 0, flags 0x0, 1:0:84,
( 2:12): Total reqs 5, Pending reqs 0, flags 0x0, 1:0:84,
( 2:13): Total reqs 1315251, Pending reqs 0, flags 0x0, 1:0:84,
( 2:14): Total reqs 135482, Pending reqs 0, flags 0x0, 1:0:84,
( 2:15): Total reqs 13, Pending reqs 0, flags 0x0, 1:0:84,
( 2:31): Total reqs 5, Pending reqs 0, flags 0x0, 1:0:84,
( 3: 0): Total reqs 6, Pending reqs 0, flags 0x0, 1:0:86,


Thanks,
abhijit

[Matti_Kurkela]

(I didn't see the output of "cat /etc/redhat-release" and "uname -a" in there, so I cannot verify the kernel patchlevel and the Update level of your RHEL 3.)

So.. your driver version is 7.05.00-RH1.

The latest driver version for RHEL 3 seems to be 7.07.05.08. It might be good to update. This driver version was released in mid-2008, so it certainly should not be "too fresh to trust" any more.

http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareIndex.jsp?lang=en&cc=us&prodNameId=315741&prodTypeId=12169&prodSeriesId=439556&swLang=8&taskId=135&swEnvOID=1080

Pick the "Linux Driver Kit for HP Qlogic HBAs and mezzanine HBAs".

Please read the Release Notes too: the installation instructions are in there.

http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareDescription.jsp?lang=en&cc=us&prodTypeId=12169&prodSeriesId=439556&swItem=co-54962-2&prodNameId=315741&swEnvOID=1080&swLang=8&taskId=135&mode=4&idx=0

MK

[abhijit007]

Dear M.K,
Here are the outputs-
Red Hat Enterprise Linux ES release 3 (Taroon Update 6)

Linux NIC-800000-GEM2 2.4.21-37.ELsmp #1 SMP Wed Sep 7 13:28:55 EDT 2005 i686 i686 i386 GNU/Linux