Disk Enclosures
1753695 Members
5961 Online
108799 Solutions
New Discussion

HP P400 NCQ question - OpenIndiana

 
internaut19
Occasional Visitor

HP P400 NCQ question - OpenIndiana

Hello,

 

I've managed to setup a supermicro as a FC target using OpenIndiana 151a8 for our VmWare Initiators. The raid controller that we are using in the SuperMicro is a HP P400 with the latest firmware available (7.24).

 

My issue is that during the Veeam Replication process, looking at the iostat command on the OpenIndiana I see that the disks are 99 % -100 % busy all the time. I am not seeing peaks it's like that all the time during backup and some of the other VMs are suffering during that period.

 

With the P400 I have installed 2TB SATA disks configured in RAID10.

 

I am suspecting the NCQ to be the culprit because an output from hpacucli shows that the controller does not support NCQ:

Smart Array P400 in Slot 5
   Bus Interface: PCI
   Slot: 5
   Serial Number: xxxxxxxxxx
   Cache Serial Number: xxxxxxx
   RAID 6 (ADG) Status: Enabled
   Controller Status: OK
   Hardware Revision: B
   Firmware Version: 7.24
   Rebuild Priority: Medium
   Expand Priority: Medium
   Surface Scan Delay: 15 secs
   Surface Scan Mode: Idle
   Wait for Cache Room: Disabled
   Surface Analysis Inconsistency Notification: Disabled
   Post Prompt Timeout: 0 secs
   Cache Board Present: True
   Cache Status: OK
   Accelerator Ratio: 25% Read / 75% Write
   Drive Write Cache: Enabled
   Total Cache Size: 512 MB
   Total Cache Memory Available: 464 MB
   No-Battery Write Cache: Disabled
   Cache Backup Power Source: Batteries
   Battery/Capacitor Count: 1
   Battery/Capacitor Status: OK
   SATA NCQ Supported: False

but the drives are NCQ capable:

....

      physicaldrive 1I:0:2
         Port: 1I
         Box: 0
         Bay: 2
         Status: OK
         Drive Type: Data Drive
         Interface Type: SATA
         Size: 2 TB
         Firmware Revision: 0004
         Serial Number:             xxxxx
         Model: ATA     ST32000645NS
         SATA NCQ Capable: True
         SATA NCQ Enabled: True
         Current Temperature (C): 26
         Maximum Temperature (C): 36
         PHY Count: 1
         PHY Transfer Rate: 1.5GBPS
...

 

Am I on the right track, believing that the NCQ is the culprit? Can the NCQ feature be activated on the controller using hpacucli or is it driver related?

 

I've updated to the latest 2.6.0 cpqary3 driver hoping that will fix it but still no go. I can't find any documentation on the cpqary3 driver, thinking that maybe is a hidden option that i can enable on it.

 

Any help will be greatly apreciated.

 

Thanks,

Cristian.

 

 

P.S. This thread has been moevd from Storage Area Networks (SAN) (Enterprise) to Disk Array. - Hp Forum Moderator

2 REPLIES 2
internaut19
Occasional Visitor

Re: HP P400 NCQ question - OpenIndiana

If nobody encountered this issue, maybe someone can point out some real documentation on the cpqary3 driver.

 

 

Thanks,


Cristian.

Cyford
Occasional Advisor

Re: HP P400 NCQ question - OpenIndiana

I am having the same issue  on my linux server,  I   it seems  when getting hammered  my slot 0   going insto rebuilding...     why is it so hard to  find how to force     "SATA NCQ Supported: True"

 

=> ctrl all show config detail                           

Smart Array 642 in Slot 0 (Embedded)
   Bus Interface: PCI
   Slot: 0
   Serial Number: P9226AN9SW804Y
   RAID 6 (ADG) Status: Disabled
   Controller Status: OK
   Hardware Revision: B
   Firmware Version: 2.80
   Post Prompt Timeout: 0 secs
   Cache Board Present: True
   Cache Status: Not Configured
   Total Cache Size: 64 MB
   Total Cache Memory Available: 32 MB
   No-Battery Write Cache: Disabled
   Battery/Capacitor Count: 0
   SATA NCQ Supported: False



Smart Array P400 in Slot 1
   Bus Interface: PCI
   Slot: 1
   Serial Number: PA2240J9STS3MR
   Cache Serial Number: PA82C0J9VVZ1OI
   RAID 6 (ADG) Status: Enabled
   Controller Status: OK
   Hardware Revision: B
   Firmware Version: 7.24
   Rebuild Priority: Medium
   Expand Priority: Medium
   Surface Scan Delay: 15 secs
   Surface Scan Mode: Idle
   Wait for Cache Room: Disabled
   Surface Analysis Inconsistency Notification: Disabled
   Post Prompt Timeout: 0 secs
   Cache Board Present: True
   Cache Status: OK
   Cache Ratio: 25% Read / 75% Write
   Drive Write Cache: Enabled
   Total Cache Size: 256 MB
   Total Cache Memory Available: 208 MB
   No-Battery Write Cache: Enabled
   Cache Backup Power Source: Batteries
   Battery/Capacitor Count: 1
   Battery/Capacitor Status: Failed (Replace Batteries)
   SATA NCQ Supported: False

   Array: A
      Interface Type: SATA
      Unused Space: 0  MB
      Status: OK
      Array Type: Data



      Logical Drive: 1
         Size: 29.8 GB
         Fault Tolerance: 0
         Heads: 255
         Sectors Per Track: 32
         Cylinders: 7655
         Strip Size: 128 KB
         Full Stripe Size: 128 KB
         Status: OK
         Caching:  Enabled
         Unique Identifier: 600508B100104A39535453334D520002
         Disk Name: /dev/cciss/c0d0
         Mount Points: /boot 298 MB
         OS Status: LOCKED
         Logical Drive Label: A0002286PA2240J9STS3MRA8E1
         Drive Type: Data

      physicaldrive 1I:1:8
         Port: 1I
         Box: 1
         Bay: 8
         Status: OK
         Drive Type: Data Drive
         Interface Type: SATA
         Size: 32.0 GB
         Firmware Revision: 1.6     
         Serial Number: 1A29I3J662R163PBI526
         Model: ATA     OCZ-ONYX        
         SATA NCQ Capable: True
         SATA NCQ Enabled: True
         PHY Count: 1
         PHY Transfer Rate: 1.5Gbps


   Array: B
      Interface Type: SATA
      Unused Space: 0  MB
      Status: OK
      Array Type: Data



      Logical Drive: 2
         Size: 931.5 GB
         Fault Tolerance: 5
         Heads: 255
         Sectors Per Track: 32
         Cylinders: 65535
         Strip Size: 64 KB
         Full Stripe Size: 128 KB
         Status: Recovering, 79% complete
         Caching:  Enabled
         Parity Initialization Status: Initialization Failed
         Unique Identifier: 600508B100104A39535453334D520003
         Disk Name: /dev/cciss/c0d1
         Mount Points: / 8.0 GB
         OS Status: LOCKED
         Logical Drive Label: A0004EEFPA2240J9STS3MR2999
         Drive Type: Data

      physicaldrive 2I:1:1
         Port: 2I
         Box: 1
         Bay: 1
         Status: Rebuilding
         Drive Type: Data Drive
         Interface Type: SATA
         Size: 500 GB
         Firmware Revision: AX001A  
         Serial Number:            83JTPT5ZT
         Model: ATA     TOSHIBA MQ01ABD0
         SATA NCQ Capable: True
         SATA NCQ Enabled: True
         Current Temperature (C): 34
         Maximum Temperature (C): 36
         PHY Count: 1
         PHY Transfer Rate: 1.5Gbps

      physicaldrive 2I:1:2
         Port: 2I
         Box: 1
         Bay: 2
         Status: OK
         Drive Type: Data Drive
         Interface Type: SATA
         Size: 500 GB
         Firmware Revision: AX001A  
         Serial Number:            83JTPT5YT
         Model: ATA     TOSHIBA MQ01ABD0
         SATA NCQ Capable: True
         SATA NCQ Enabled: True
         Current Temperature (C): 34
         Maximum Temperature (C): 36
         PHY Count: 1
         PHY Transfer Rate: 1.5Gbps

      physicaldrive 2I:1:3
         Port: 2I
         Box: 1
         Bay: 3
         Status: OK
         Drive Type: Data Drive
         Interface Type: SATA
         Size: 500 GB
         Firmware Revision: AX001A  
         Serial Number:            83JTPT5XT
         Model: ATA     TOSHIBA MQ01ABD0
         SATA NCQ Capable: True
         SATA NCQ Enabled: True
         Current Temperature (C): 33
         Maximum Temperature (C): 36
         PHY Count: 1
         PHY Transfer Rate: 1.5Gbps
=> ctrl all show config detail                           

Smart Array 642 in Slot 0 (Embedded)
   Bus Interface: PCI
   Slot: 0
   Serial Number: P9226AN9SW804Y
   RAID 6 (ADG) Status: Disabled
   Controller Status: OK
   Hardware Revision: B
   Firmware Version: 2.80
   Post Prompt Timeout: 0 secs
   Cache Board Present: True
   Cache Status: Not Configured
   Total Cache Size: 64 MB
   Total Cache Memory Available: 32 MB
   No-Battery Write Cache: Disabled
   Battery/Capacitor Count: 0
   SATA NCQ Supported: False



Smart Array P400 in Slot 1
   Bus Interface: PCI
   Slot: 1
   Serial Number: PA2240J9STS3MR
   Cache Serial Number: PA82C0J9VVZ1OI
   RAID 6 (ADG) Status: Enabled
   Controller Status: OK
   Hardware Revision: B
   Firmware Version: 7.24
   Rebuild Priority: Medium
   Expand Priority: Medium
   Surface Scan Delay: 15 secs
   Surface Scan Mode: Idle
   Wait for Cache Room: Disabled
   Surface Analysis Inconsistency Notification: Disabled
   Post Prompt Timeout: 0 secs
   Cache Board Present: True
   Cache Status: OK
   Cache Ratio: 25% Read / 75% Write
   Drive Write Cache: Enabled
   Total Cache Size: 256 MB
   Total Cache Memory Available: 208 MB
   No-Battery Write Cache: Enabled
   Cache Backup Power Source: Batteries
   Battery/Capacitor Count: 1
   Battery/Capacitor Status: Failed (Replace Batteries)
   SATA NCQ Supported: False

   Array: A
      Interface Type: SATA
      Unused Space: 0  MB
      Status: OK
      Array Type: Data



      Logical Drive: 1
         Size: 29.8 GB
         Fault Tolerance: 0
         Heads: 255
         Sectors Per Track: 32
         Cylinders: 7655
         Strip Size: 128 KB
         Full Stripe Size: 128 KB
         Status: OK
         Caching:  Enabled
         Unique Identifier: 600508B100104A39535453334D520002
         Disk Name: /dev/cciss/c0d0
         Mount Points: /boot 298 MB
         OS Status: LOCKED
         Logical Drive Label: A0002286PA2240J9STS3MRA8E1
         Drive Type: Data

      physicaldrive 1I:1:8
         Port: 1I
         Box: 1
         Bay: 8
         Status: OK
         Drive Type: Data Drive
         Interface Type: SATA
         Size: 32.0 GB
         Firmware Revision: 1.6     
         Serial Number: 1A29I3J662R163PBI526
         Model: ATA     OCZ-ONYX        
         SATA NCQ Capable: True
         SATA NCQ Enabled: True
         PHY Count: 1
         PHY Transfer Rate: 1.5Gbps


   Array: B
      Interface Type: SATA
      Unused Space: 0  MB
      Status: OK
      Array Type: Data



      Logical Drive: 2
         Size: 931.5 GB
         Fault Tolerance: 5
         Heads: 255
         Sectors Per Track: 32
         Cylinders: 65535
         Strip Size: 64 KB
         Full Stripe Size: 128 KB
         Status: Recovering, 79% complete
         Caching:  Enabled
         Parity Initialization Status: Initialization Failed
         Unique Identifier: 600508B100104A39535453334D520003
         Disk Name: /dev/cciss/c0d1
         Mount Points: / 8.0 GB
         OS Status: LOCKED
         Logical Drive Label: A0004EEFPA2240J9STS3MR2999
         Drive Type: Data

      physicaldrive 2I:1:1
         Port: 2I
         Box: 1
         Bay: 1
         Status: Rebuilding
         Drive Type: Data Drive
         Interface Type: SATA
         Size: 500 GB
         Firmware Revision: AX001A  
         Serial Number:            83JTPT5ZT
         Model: ATA     TOSHIBA MQ01ABD0
         SATA NCQ Capable: True
         SATA NCQ Enabled: True
         Current Temperature (C): 34
         Maximum Temperature (C): 36
         PHY Count: 1
         PHY Transfer Rate: 1.5Gbps

      physicaldrive 2I:1:2
         Port: 2I
         Box: 1
         Bay: 2
         Status: OK
         Drive Type: Data Drive
         Interface Type: SATA
         Size: 500 GB
         Firmware Revision: AX001A  
         Serial Number:            83JTPT5YT
         Model: ATA     TOSHIBA MQ01ABD0
         SATA NCQ Capable: True
         SATA NCQ Enabled: True
         Current Temperature (C): 34
         Maximum Temperature (C): 36
         PHY Count: 1
         PHY Transfer Rate: 1.5Gbps

      physicaldrive 2I:1:3
         Port: 2I
         Box: 1
         Bay: 3
         Status: OK
         Drive Type: Data Drive
         Interface Type: SATA
         Size: 500 GB
         Firmware Revision: AX001A  
         Serial Number:            83JTPT5XT
         Model: ATA     TOSHIBA MQ01ABD0
         SATA NCQ Capable: True
         SATA NCQ Enabled: True
         Current Temperature (C): 33
         Maximum Temperature (C): 36
         PHY Count: 1
         PHY Transfer Rate: 1.5Gbps