fcmsutil and powermt display shows error counts

[skt_skt]

hp-ux 11.11/S16K-A

root [/root] powermt display
Symmetrix logical device count=31
CLARiiON logical device count=0
==============================================================================
----- Host Bus Adapters --------- ------ I/O Paths ----- ------ Stats ------
### HW Path Summary Total Dead IO/Sec Q-IOs Errors
==============================================================================
38 0/0/10/0/0.97.28.19.0 optimal 31 0 - 12 10
48 0/0/8/0/0.98.28.19.0 optimal 31 0 - 11 10

from cstm-:
Summary of: /var/stm/logs/os/log244.raw.cur

Date/time of first entry: Sun Sep 16 03:25:15 2007

Date/time of last entry: Mon Sep 17 11:32:25 2007



Number of LPMC entries: 0
Number of System Overtemp entries: 0
Number of LVM entries: 0
Number of Logger Event entries: 0

Number of I/O Error entries: 341


[/root] /opt/fcms/bin/fcmsutil /dev/td0 stat
Mon Sep 17 12:12:01 2007
Channel Statistics

Statistics From Link Status Registers ...
Loss of signal 0 Bad Rx Char 255
Loss of Sync 5 Link Fail 0
Received EOFa 0 Discarded Frame 0
Bad CRC 0 Protocol Error 0


CE_FCP_FREEZE Request 6715
CE_FCP_UNFREEZE Request 6715

CE_FCP_UNFREEZE recvd in CS_FCP_FROZEN 6715
Error Idle Interrupts 0
ERQ/FCP Assists Resumed 6715


root] /opt/fcms/bin/fcmsutil /dev/td1 stat
Mon Sep 17 12:13:30 2007
Channel Statistics

Statistics From Link Status Registers ...
Loss of signal 0 Bad Rx Char 255
Loss of Sync 5 Link Fail 0
Received EOFa 0 Discarded Frame 0
Bad CRC 0 Protocol Error 0

CE_FCP_FREEZE Request 6755
CE_FCP_UNFREEZE Request 6755

CE_FCP_UNFREEZE recvd in CS_FCP_FROZEN 6755
Error Idle Interrupts 0
ERQ/FCP Assists Resumed 6755


i am curious why there is a huge counts for events "CE_FCP_FREEZE Request", "CE_FCP_UNFREEZE Request" and "ERQ/FCP Assists Resumed" and they are increasing too.

[/root] ioscan -funC fc
Class I H/W Path Driver S/W State H/W Type Description
===================================================================
fc 0 0/0/8/0/0 td CLAIMED INTERFACE HP Tachyon XL2 Fibre Channel Mass Storage Adapter
/dev/td0
fc 1 0/0/10/0/0 td CLAIMED INTERFACE HP Tachyon XL2 Fibre Channel Mass Storage Adapter
/dev/td1

for both the cards

Driver Version = @(#) libtd.a HP Fibre Channel Tachyon TL/TS/XL2 Driver B.11.11.12 PATCH_11.11 (PHSS_31326) /ux/kern/kisu/TL/src/common/wsio/td_glue.c: Sep 5 2005, 10:14:40


Any tips..

[Duncan Edmonstone]

CE_FCP_FREEZE Request 6755
CE_FCP_UNFREEZE Request 6755

These values *can* indicate a situation where the upper layer SCSI modules are sending more IO at the FC interfaces than the SAN can cope with - this could be number of IO requests rather than the actual volume of oustanding IO (of course it can be other things as well and this can be a symptom rather than a problem)

There are two things I would consider here:

i) Are you 100% sure that the SAN (what sort of switch, what firmware version) and EMC array are performing without issues - are IO times to the disks reasonable?

ii) Has any sort of tuning taken place to the IO stack on this sytem recently e.g. SCSI queue depth or VxFS parameter (/etc/vxtunefs) changes?


Also you seem to have only posted parts of the 'fcmsutil stat' output. Can you post the whole thing?


HTH

Duncan

[AwadheshPandey]

Use this

powermt restore
powermt check
powermt config
powermt save

aP

[skt_skt]

There are two things I would consider here:

i) Are you 100% sure that the SAN (what sort of switch, what firmware version) and EMC array are performing without issues - are IO times to the disks reasonable?

some time the service times are not that good that is why this analysis..

ii) Has any sort of tuning taken place to the IO stack on this sytem recently e.g. SCSI queue depth or VxFS parameter (/etc/vxtunefs) changes?

NO

Also you seem to have only posted parts of the 'fcmsutil stat' output. Can you post the whole thing?


[/root] /opt/fcms/bin/fcmsutil /dev/td1 stat
Tue Sep 18 09:05:33 2007
Channel Statistics

Statistics From Link Status Registers ...
Loss of signal 0 Bad Rx Char 255
Loss of Sync 5 Link Fail 0
Received EOFa 0 Discarded Frame 0
Bad CRC 0 Protocol Error 0

Channel State M/C Statistics ...
TL Errata D40 0
Unexpected OCM for FCP_DATA phase 0
LSM Link Fail State 0
No. of times LUP timer popped 0
HBA Changing AL_PA Across LIP 0
Channel Reset Request 0
Channel Offline Request 0
CE_FCP_FREEZE Request 6841
CE_FCP_UNFREEZE Request 6841
CE_FCP_FREEZE Cancel 0
CE_LDN Event 0
CE_LUP Event 1
ERQ frzn CMs, after chip is resumed 0
FCP frzn CMs, after chip is resumed 0
LDN EICM, when ERQ/FCP not frzn 0
FTO EICM, when ERQ/FCP not frzn 0
CE_FCP_FROZEN Event 0
Number Of Delayed Freeze Operations 0
CE_FCP_UNFREEZE recvd in CS_FCP_FROZEN 6841
Error Idle Interrupts 0
ERQ/FCP Assists Resumed 6841
Loop State T/O, when LSM is not ONLINE 0
Loop State T/O, when LSM is ONLINE 0
Loop State T/O, when LSM is in ARB 0
Credit Errors 0
LIPs due to OLS 1

FLOGI Statistics ...
FLOGIs sent 1
FLOGI Resps recvd 1
LS_RJTs for FLOGI 0
Short FLOGI Resps 0
Version_Hi Error in FLOGI Resps 0
Version_Lo Error in FLOGI Resps 0
No class 3 support in FLOGI Resps 0
Invalid datasize/resvd2/fport_nport in FLOGI Resps 0
Invalid RA_TOV in FLOGI Resps 0
Invalid ED_TOV in FLOGI Resps 0
FLOGI Retries skipped due to Parse Errors 0
FTO OCMs for FLOGIs sent 0
FLOGIs timedout 0
FLOGI retries > High Water Mark 0

Fabric Statistics ...
FANs received 0
FANs timedout 0
FANs recvd in CS_FLOGI_SENT 0
Unexpected FANs received 0
ns_open failures 0
Changes detected in own nport_id 0
Changes detected in Fabric PWWN 0
Changes detected in Fabric NWWN 0
Channel in TD_FABRIC topology 1
Channel in TD_PUBLIC_LOOP topology 0
Channel in TD_PRIVATE_LOOP topology 0
Topology mode toggles during initialization 0
Topology changes across LDN/LUP 0
Successful initializations in P2P mode 1
Successful initializations in Loop mode 0

Storm Statistics ...
Elastic Store Error Storm 0
Link Fail storm . 0
LIP(f8, xx) storm . 0
Loss Of Signal Storm 0
Out Of Sync Storm 0
Link Fault Storm 0
NOS_OLS Storm 0

PCI Error Interrupt Statistics ...
MPE Interrupts 0
CRS Interrupts 0
DER Interrupts 0
PER Interrupts 0


Channel OLAR Statistics ...
Number of suspend requests 0
Number of resume requests 0
Number of forced suspends 0
Number of resume failures 0
Number of validation failures 0
Target State M/C Statistics ...
Target Thread Alloc. Fail 0
Frames with length < FC-PH Hdr length 0
Frames with incorrect ROUTING FC-PH Hdr 0
Frames with invalid CS_CTL FC-PH Hdr 0
Frames with invalid TYPE FC-PH Hdr 0
Frames with invalid DF_CTL FC-PH Hdr 0
Invalid SOF/EOF Received 0
Multi-Frame Sequences Received 0
SFS Received With S_ID/D_ID Mismatch 0
SFS Received exceeding TD_SFTBFSZ 0
Inbound non-Class3 Frames 0
Inbound Frame large than TD_SFTBFSZ 0
Kmalloc Failures 0
Out of order Multi-Frame sequences 0

I/O Error Statistics ...
FCP Frames Recvd As Responder 0
Bad Unassisted FCP frame 0
Bad S_ID in Unassisted FCP frame 0
No cdb for I/O 0
IRB entries on ERQ 0
SCSI Linked list entries 0
Late ABTS Responses Received 0
Too many mapping entries for a single I/O 0
Unexpected events in state cdbs_uninit 0

SF state m/c statistics...
Rcvd ABTS dropped due to lack of SFT 0
No reply before timeout 0
SF failed due to LDN 0
SF failed due to ASN, LKF or FTO 0
SF thread Allocation failures 0
Unable to map SF payload 0
SFT in ERQ during Chip Reset 0
Late ICM from Non-compliant target 0

Auto Speed Negotiation related statistics...
ASN started on chip and FM init 1
ASN started on Link Down 0
ASN started on Link Failure 0
ASN succeeded 1
ASN failed due to time out 0
ASN failed due to bad link quality 0
Seconds since last statistics reset 6228179


[/root] /opt/fcms/bin/fcmsutil /dev/td0 stat
Tue Sep 18 09:05:20 2007
Channel Statistics

Statistics From Link Status Registers ...
Loss of signal 0 Bad Rx Char 255
Loss of Sync 5 Link Fail 0
Received EOFa 0 Discarded Frame 0
Bad CRC 0 Protocol Error 0

Channel State M/C Statistics ...
TL Errata D40 0
Unexpected OCM for FCP_DATA phase 0
LSM Link Fail State 0
No. of times LUP timer popped 0
HBA Changing AL_PA Across LIP 0
Channel Reset Request 0
Channel Offline Request 0
CE_FCP_FREEZE Request 6814
CE_FCP_UNFREEZE Request 6814
CE_FCP_FREEZE Cancel 0
CE_LDN Event 0
CE_LUP Event 1
ERQ frzn CMs, after chip is resumed 0
FCP frzn CMs, after chip is resumed 0
LDN EICM, when ERQ/FCP not frzn 0
FTO EICM, when ERQ/FCP not frzn 0
CE_FCP_FROZEN Event 0
Number Of Delayed Freeze Operations 0
CE_FCP_UNFREEZE recvd in CS_FCP_FROZEN 6814
Error Idle Interrupts 0
ERQ/FCP Assists Resumed 6814
Loop State T/O, when LSM is not ONLINE 0
Loop State T/O, when LSM is ONLINE 0
Loop State T/O, when LSM is in ARB 0
Credit Errors 0
LIPs due to OLS 1

FLOGI Statistics ...
FLOGIs sent 1
FLOGI Resps recvd 1
LS_RJTs for FLOGI 0
Short FLOGI Resps 0
Version_Hi Error in FLOGI Resps 0
Version_Lo Error in FLOGI Resps 0
No class 3 support in FLOGI Resps 0
Invalid datasize/resvd2/fport_nport in FLOGI Resps 0
Invalid RA_TOV in FLOGI Resps 0
Invalid ED_TOV in FLOGI Resps 0
FLOGI Retries skipped due to Parse Errors 0
FTO OCMs for FLOGIs sent 0
FLOGIs timedout 0
FLOGI retries > High Water Mark 0

Fabric Statistics ...
FANs received 0
FANs timedout 0
FANs recvd in CS_FLOGI_SENT 0
Unexpected FANs received 0
ns_open failures 0
Changes detected in own nport_id 0
Changes detected in Fabric PWWN 0
Changes detected in Fabric NWWN 0
Channel in TD_FABRIC topology 1
Channel in TD_PUBLIC_LOOP topology 0
Channel in TD_PRIVATE_LOOP topology 0
Topology mode toggles during initialization 0
Topology changes across LDN/LUP 0
Successful initializations in P2P mode 1
Successful initializations in Loop mode 0

Storm Statistics ...
Elastic Store Error Storm 0
Link Fail storm . 0
LIP(f8, xx) storm . 0
Loss Of Signal Storm 0
Out Of Sync Storm 0
Link Fault Storm 0
NOS_OLS Storm 0

PCI Error Interrupt Statistics ...
MPE Interrupts 0
CRS Interrupts 0
DER Interrupts 0
PER Interrupts 0


Channel OLAR Statistics ...
Number of suspend requests 0
Number of resume requests 0
Number of forced suspends 0
Number of resume failures 0
Number of validation failures 0
Target State M/C Statistics ...
Target Thread Alloc. Fail 0
Frames with length < FC-PH Hdr length 0
Frames with incorrect ROUTING FC-PH Hdr 0
Frames with invalid CS_CTL FC-PH Hdr 0
Frames with invalid TYPE FC-PH Hdr 0
Frames with invalid DF_CTL FC-PH Hdr 0
Invalid SOF/EOF Received 0
Multi-Frame Sequences Received 0
SFS Received With S_ID/D_ID Mismatch 0
SFS Received exceeding TD_SFTBFSZ 0
Inbound non-Class3 Frames 0
Inbound Frame large than TD_SFTBFSZ 0
Kmalloc Failures 0
Out of order Multi-Frame sequences 0

I/O Error Statistics ...
FCP Frames Recvd As Responder 0
Bad Unassisted FCP frame 0
Bad S_ID in Unassisted FCP frame 0
No cdb for I/O 0
IRB entries on ERQ 0
SCSI Linked list entries 0
Late ABTS Responses Received 0
Too many mapping entries for a single I/O 0
Unexpected events in state cdbs_uninit 0

SF state m/c statistics...
Rcvd ABTS dropped due to lack of SFT 0
No reply before timeout 0
SF failed due to LDN 0
SF failed due to ASN, LKF or FTO 0
SF thread Allocation failures 0
Unable to map SF payload 0
SFT in ERQ during Chip Reset 0
Late ICM from Non-compliant target 0

Auto Speed Negotiation related statistics...
ASN started on chip and FM init 1
ASN started on Link Down 0
ASN started on Link Failure 0
ASN succeeded 1
ASN failed due to time out 0
ASN failed due to bad link quality 0
Seconds since last statistics reset 6228167

[skt_skt]

There are two things I would consider here:

i) Are you 100% sure that the SAN (what sort of switch, what firmware version) and EMC array are performing without issues - are IO times to the disks reasonable?

some time the service times are not that good that is why this analysis..

EMC symmtrix 2000S-M2
mocro code version 5671
cache 49152

ii) Has any sort of tuning taken place to the IO stack on this sytem recently e.g. SCSI queue depth or VxFS parameter (/etc/vxtunefs) changes?


NO

Also you seem to have only posted parts of the 'fcmsutil stat' output. Can you post the whole thing?


[/root] /opt/fcms/bin/fcmsutil /dev/td1 stat
Tue Sep 18 09:05:33 2007
Channel Statistics

Statistics From Link Status Registers ...
Loss of signal 0 Bad Rx Char 255
Loss of Sync 5 Link Fail 0
Received EOFa 0 Discarded Frame 0
Bad CRC 0 Protocol Error 0

Channel State M/C Statistics ...
TL Errata D40 0
Unexpected OCM for FCP_DATA phase 0
LSM Link Fail State 0
No. of times LUP timer popped 0
HBA Changing AL_PA Across LIP 0
Channel Reset Request 0
Channel Offline Request 0
CE_FCP_FREEZE Request 6841
CE_FCP_UNFREEZE Request 6841
CE_FCP_FREEZE Cancel 0
CE_LDN Event 0
CE_LUP Event 1
ERQ frzn CMs, after chip is resumed 0
FCP frzn CMs, after chip is resumed 0
LDN EICM, when ERQ/FCP not frzn 0
FTO EICM, when ERQ/FCP not frzn 0
CE_FCP_FROZEN Event 0
Number Of Delayed Freeze Operations 0
CE_FCP_UNFREEZE recvd in CS_FCP_FROZEN 6841
Error Idle Interrupts 0
ERQ/FCP Assists Resumed 6841
Loop State T/O, when LSM is not ONLINE 0
Loop State T/O, when LSM is ONLINE 0
Loop State T/O, when LSM is in ARB 0
Credit Errors 0
LIPs due to OLS 1

FLOGI Statistics ...
FLOGIs sent 1
FLOGI Resps recvd 1
LS_RJTs for FLOGI 0
Short FLOGI Resps 0
Version_Hi Error in FLOGI Resps 0
Version_Lo Error in FLOGI Resps 0
No class 3 support in FLOGI Resps 0
Invalid datasize/resvd2/fport_nport in FLOGI Resps 0
Invalid RA_TOV in FLOGI Resps 0
Invalid ED_TOV in FLOGI Resps 0
FLOGI Retries skipped due to Parse Errors 0
FTO OCMs for FLOGIs sent 0
FLOGIs timedout 0
FLOGI retries > High Water Mark 0

Fabric Statistics ...
FANs received 0
FANs timedout 0
FANs recvd in CS_FLOGI_SENT 0
Unexpected FANs received 0
ns_open failures 0
Changes detected in own nport_id 0
Changes detected in Fabric PWWN 0
Changes detected in Fabric NWWN 0
Channel in TD_FABRIC topology 1
Channel in TD_PUBLIC_LOOP topology 0
Channel in TD_PRIVATE_LOOP topology 0
Topology mode toggles during initialization 0
Topology changes across LDN/LUP 0
Successful initializations in P2P mode 1
Successful initializations in Loop mode 0

Storm Statistics ...
Elastic Store Error Storm 0
Link Fail storm . 0
LIP(f8, xx) storm . 0
Loss Of Signal Storm 0
Out Of Sync Storm 0
Link Fault Storm 0
NOS_OLS Storm 0

PCI Error Interrupt Statistics ...
MPE Interrupts 0
CRS Interrupts 0
DER Interrupts 0
PER Interrupts 0


Channel OLAR Statistics ...
Number of suspend requests 0
Number of resume requests 0
Number of forced suspends 0
Number of resume failures 0
Number of validation failures 0
Target State M/C Statistics ...
Target Thread Alloc. Fail 0
Frames with length < FC-PH Hdr length 0
Frames with incorrect ROUTING FC-PH Hdr 0
Frames with invalid CS_CTL FC-PH Hdr 0
Frames with invalid TYPE FC-PH Hdr 0
Frames with invalid DF_CTL FC-PH Hdr 0
Invalid SOF/EOF Received 0
Multi-Frame Sequences Received 0
SFS Received With S_ID/D_ID Mismatch 0
SFS Received exceeding TD_SFTBFSZ 0
Inbound non-Class3 Frames 0
Inbound Frame large than TD_SFTBFSZ 0
Kmalloc Failures 0
Out of order Multi-Frame sequences 0

I/O Error Statistics ...
FCP Frames Recvd As Responder 0
Bad Unassisted FCP frame 0
Bad S_ID in Unassisted FCP frame 0
No cdb for I/O 0
IRB entries on ERQ 0
SCSI Linked list entries 0
Late ABTS Responses Received 0
Too many mapping entries for a single I/O 0
Unexpected events in state cdbs_uninit 0

SF state m/c statistics...
Rcvd ABTS dropped due to lack of SFT 0
No reply before timeout 0
SF failed due to LDN 0
SF failed due to ASN, LKF or FTO 0
SF thread Allocation failures 0
Unable to map SF payload 0
SFT in ERQ during Chip Reset 0
Late ICM from Non-compliant target 0

Auto Speed Negotiation related statistics...
ASN started on chip and FM init 1
ASN started on Link Down 0
ASN started on Link Failure 0
ASN succeeded 1
ASN failed due to time out 0
ASN failed due to bad link quality 0
Seconds since last statistics reset 6228179


[/root] /opt/fcms/bin/fcmsutil /dev/td0 stat
Tue Sep 18 09:05:20 2007
Channel Statistics

Statistics From Link Status Registers ...
Loss of signal 0 Bad Rx Char 255
Loss of Sync 5 Link Fail 0
Received EOFa 0 Discarded Frame 0
Bad CRC 0 Protocol Error 0

Channel State M/C Statistics ...
TL Errata D40 0
Unexpected OCM for FCP_DATA phase 0
LSM Link Fail State 0
No. of times LUP timer popped 0
HBA Changing AL_PA Across LIP 0
Channel Reset Request 0
Channel Offline Request 0
CE_FCP_FREEZE Request 6814
CE_FCP_UNFREEZE Request 6814
CE_FCP_FREEZE Cancel 0
CE_LDN Event 0
CE_LUP Event 1
ERQ frzn CMs, after chip is resumed 0
FCP frzn CMs, after chip is resumed 0
LDN EICM, when ERQ/FCP not frzn 0
FTO EICM, when ERQ/FCP not frzn 0
CE_FCP_FROZEN Event 0
Number Of Delayed Freeze Operations 0
CE_FCP_UNFREEZE recvd in CS_FCP_FROZEN 6814
Error Idle Interrupts 0
ERQ/FCP Assists Resumed 6814
Loop State T/O, when LSM is not ONLINE 0
Loop State T/O, when LSM is ONLINE 0
Loop State T/O, when LSM is in ARB 0
Credit Errors 0
LIPs due to OLS 1

FLOGI Statistics ...
FLOGIs sent 1
FLOGI Resps recvd 1
LS_RJTs for FLOGI 0
Short FLOGI Resps 0
Version_Hi Error in FLOGI Resps 0
Version_Lo Error in FLOGI Resps 0
No class 3 support in FLOGI Resps 0
Invalid datasize/resvd2/fport_nport in FLOGI Resps 0
Invalid RA_TOV in FLOGI Resps 0
Invalid ED_TOV in FLOGI Resps 0
FLOGI Retries skipped due to Parse Errors 0
FTO OCMs for FLOGIs sent 0
FLOGIs timedout 0
FLOGI retries > High Water Mark 0

Fabric Statistics ...
FANs received 0
FANs timedout 0
FANs recvd in CS_FLOGI_SENT 0
Unexpected FANs received 0
ns_open failures 0
Changes detected in own nport_id 0
Changes detected in Fabric PWWN 0
Changes detected in Fabric NWWN 0
Channel in TD_FABRIC topology 1
Channel in TD_PUBLIC_LOOP topology 0
Channel in TD_PRIVATE_LOOP topology 0
Topology mode toggles during initialization 0
Topology changes across LDN/LUP 0
Successful initializations in P2P mode 1
Successful initializations in Loop mode 0

Storm Statistics ...
Elastic Store Error Storm 0
Link Fail storm . 0
LIP(f8, xx) storm . 0
Loss Of Signal Storm 0
Out Of Sync Storm 0
Link Fault Storm 0
NOS_OLS Storm 0

PCI Error Interrupt Statistics ...
MPE Interrupts 0
CRS Interrupts 0
DER Interrupts 0
PER Interrupts 0


Channel OLAR Statistics ...
Number of suspend requests 0
Number of resume requests 0
Number of forced suspends 0
Number of resume failures 0
Number of validation failures 0
Target State M/C Statistics ...
Target Thread Alloc. Fail 0
Frames with length < FC-PH Hdr length 0
Frames with incorrect ROUTING FC-PH Hdr 0
Frames with invalid CS_CTL FC-PH Hdr 0
Frames with invalid TYPE FC-PH Hdr 0
Frames with invalid DF_CTL FC-PH Hdr 0
Invalid SOF/EOF Received 0
Multi-Frame Sequences Received 0
SFS Received With S_ID/D_ID Mismatch 0
SFS Received exceeding TD_SFTBFSZ 0
Inbound non-Class3 Frames 0
Inbound Frame large than TD_SFTBFSZ 0
Kmalloc Failures 0
Out of order Multi-Frame sequences 0

I/O Error Statistics ...
FCP Frames Recvd As Responder 0
Bad Unassisted FCP frame 0
Bad S_ID in Unassisted FCP frame 0
No cdb for I/O 0
IRB entries on ERQ 0
SCSI Linked list entries 0
Late ABTS Responses Received 0
Too many mapping entries for a single I/O 0
Unexpected events in state cdbs_uninit 0

SF state m/c statistics...
Rcvd ABTS dropped due to lack of SFT 0
No reply before timeout 0
SF failed due to LDN 0
SF failed due to ASN, LKF or FTO 0
SF thread Allocation failures 0
Unable to map SF payload 0
SFT in ERQ during Chip Reset 0
Late ICM from Non-compliant target 0

Auto Speed Negotiation related statistics...
ASN started on chip and FM init 1
ASN started on Link Down 0
ASN started on Link Failure 0
ASN succeeded 1
ASN failed due to time out 0
ASN failed due to bad link quality 0
Seconds since last statistics reset 6228167

[skt_skt]

does that do anything related with ISL(inter switch linking)?We use the core and edge switch concept here and this host is connected to the edge switch.

[Tim Nelson]

Just a basic initial question.

Did you recently clear the stats ? They could be errors from long ago ? Make sure you are troubleshooting a real problem.

[skt_skt]

CE_FCP_FREEZE Request", "CE_FCP_UNFREEZE Request" and "ERQ/FCP Assists Resumed" are still increasing..

[Tim Nelson]

Just checking..

My next tip would be to attempt to isolate.

Match the errors between the server and the switch port(s).

Match / relate same errors on ISL and port(s).

Match / relate errors from switch port(s) to Clariion SPs.

My idea here is that if there are no errors at the clariion end, then check ISL ports, if none there then move back to the switch / server hba. Once isolated you should / would be able to id either the server HBA or switch port that could be going bad or has a software/firmware issue.

If things look like a hba or port issue try moving connections around with known good ones or spares( i.e. GBICs etc ).

I would suspect once or if you evetually talk with HP that you will be required to update to latest driver patches if you do not have them.

[Sameer_Nirmal]

The stats show FCP Assists are being freezed and resumed. The number is high and determination of it's cause is little tricky here. Maybe you need to follow the isolation ways as mentioned above.

Do you see any EMS event generated for these adapters ? EMS event description is helpful to understand that those stats means.

The driver FibrChanl00 version is little old. Current one is B.11.11.15 Consider to install the latest driver.

What is the firmware version of the HBAs ?