slow speed array with hpsa driver

piopio — Thu, 17 May 2012 16:23:04 GMT

Hello !

We have server with Smart Array P410 and 8 drivers

4xSAS raid10 array and 4x SATA raid10 array

We have upgraded the kernel to 3.2 version and hpsa driver then disable the cciss

Now we have very poor speed from hdparm

With cciss driver and kernel 2.6.32 we have normal speed about 400MB/s on SAS and 250MB/s on SATA array disk

[root@s89:: ~ ]:# hdparm -t /dev/sda
/dev/sda:
Timing buffered disk reads: 216 MB in 3.03 seconds = 71.37 MB/sec

[root@s89:: ~ ]:# hdparm -t /dev/sdb
/dev/sdb:
Timing buffered disk reads: 310 MB in 3.01 seconds = 102.85 MB/sec
[root@s89:: ~ ]:#

and the configuration

[root@s89:: ~ ]:# dmesg |grep -i hps
[ 6.569618] HP HPSA Driver (v 3.0.0-7)
[ 6.569652] hpsa 0000:06:00.0: PCI INT A -> GSI 24 (level, low) -> IRQ 24
[ 6.569668] hpsa 0000:06:00.0: MSIX
[ 6.569732] hpsa 0000:06:00.0: irq 66 for MSI/MSI-X
[ 6.569746] hpsa 0000:06:00.0: irq 67 for MSI/MSI-X
[ 6.569756] hpsa 0000:06:00.0: irq 68 for MSI/MSI-X
[ 6.569764] hpsa 0000:06:00.0: irq 69 for MSI/MSI-X
[ 6.582594] hpsa 0000:06:00.0: hpsa0: <0x323a> at IRQ 66 using DAC
[ 6.598799] scsi0 : hpsa
[ 6.601440] hpsa 0000:06:00.0: RAID device c0b3t0l0 added.
[ 6.601443] hpsa 0000:06:00.0: Direct-Access device c0b0t0l0 added.
[ 6.601446] hpsa 0000:06:00.0: Direct-Access device c0b0t0l1 added.

[root@s89:: ~ ]:# hpacucli ctrl slot=1 show detail
iopl(3): Operation not permitted
iopl(3): Operation not permitted
iopl(3): Operation not permitted

Smart Array P410 in Slot 1
Bus Interface: PCI
Slot: 1
Serial Number: PACCRID114911G7
Cache Serial Number: PBCDH0CRH1P6CN
RAID 6 (ADG) Status: Disabled
Controller Status: OK
Hardware Revision: Rev C
Firmware Version: 5.14
Rebuild Priority: Medium
Expand Priority: Medium
Surface Scan Delay: 15 secs
Surface Scan Mode: Idle
Queue Depth: Automatic
Monitor and Performance Delay: 60 min
Elevator Sort: Enabled
Degraded Performance Optimization: Disabled
Inconsistency Repair Policy: Disabled
Wait for Cache Room: Disabled
Surface Analysis Inconsistency Notification: Disabled
Post Prompt Timeout: 0 secs
Cache Board Present: True
Cache Status: OK
Accelerator Ratio: 25% Read / 75% Write
Drive Write Cache: Disabled
Total Cache Size: 512 MB
No-Battery Write Cache: Disabled
Cache Backup Power Source: Capacitors
Battery/Capacitor Count: 1
Battery/Capacitor Status: OK
SATA NCQ Supported: True

[root@s89:: ~ ]:# hpacucli ctrl all show config detail
iopl(3): Operation not permitted
iopl(3): Operation not permitted
iopl(3): Operation not permitted

Smart Array P410 in Slot 1
Bus Interface: PCI
Slot: 1
Serial Number: PACCRID114911G7
Cache Serial Number: PBCDH0CRH1P6CN
RAID 6 (ADG) Status: Disabled
Controller Status: OK
Hardware Revision: Rev C
Firmware Version: 5.14
Rebuild Priority: Medium
Expand Priority: Medium
Surface Scan Delay: 15 secs
Surface Scan Mode: Idle
Queue Depth: Automatic
Monitor and Performance Delay: 60 min
Elevator Sort: Enabled
Degraded Performance Optimization: Disabled
Inconsistency Repair Policy: Disabled
Wait for Cache Room: Disabled
Surface Analysis Inconsistency Notification: Disabled
Post Prompt Timeout: 0 secs
Cache Board Present: True
Cache Status: OK
Accelerator Ratio: 25% Read / 75% Write
Drive Write Cache: Disabled
Total Cache Size: 512 MB
No-Battery Write Cache: Disabled
Cache Backup Power Source: Capacitors
Battery/Capacitor Count: 1
Battery/Capacitor Status: OK
SATA NCQ Supported: True

Array: A
Interface Type: SAS
Unused Space: 0 MB
Status: OK

Logical Drive: 1
Size: 558.7 GB
Fault Tolerance: RAID 1+0
Heads: 255
Sectors Per Track: 32
Cylinders: 65535
Strip Size: 256 KB
Status: OK
Array Accelerator: Enabled
Unique Identifier: 600508B1001C94276A31AC23F75393E9
Disk Name: /dev/sda
Mount Points: /boot 190 MB, /tmp 4.7 GB, / 531.5 GB
Logical Drive Label: AF7711D8PACCRID114911G7989C
Mirror Group 0:
physicaldrive 1I:1:1 (port 1I:box 1:bay 1, SAS, 300 GB, OK)
physicaldrive 1I:1:2 (port 1I:box 1:bay 2, SAS, 300 GB, OK)
Mirror Group 1:
physicaldrive 1I:1:3 (port 1I:box 1:bay 3, SAS, 300 GB, OK)
physicaldrive 1I:1:4 (port 1I:box 1:bay 4, SAS, 300 GB, OK)

physicaldrive 1I:1:1
Port: 1I
Box: 1
Bay: 1
Status: OK
Drive Type: Data Drive
Interface Type: SAS
Size: 300 GB
Rotational Speed: 15000
Firmware Revision: E516
Serial Number: JTYY35GJ
Model: HITACHI HUS156030VLS600
Current Temperature (C): 36
PHY Count: 2
PHY Transfer Rate: 3.0GBPS, Unknown

physicaldrive 1I:1:2
Port: 1I
Box: 1
Bay: 2
Status: OK
Drive Type: Data Drive
Interface Type: SAS
Size: 300 GB
Rotational Speed: 15000
Firmware Revision: E516
Serial Number: JTYVSV4J
Model: HITACHI HUS156030VLS600
Current Temperature (C): 35
PHY Count: 2
PHY Transfer Rate: 3.0GBPS, Unknown

physicaldrive 1I:1:3
Port: 1I
Box: 1
Bay: 3
Status: OK
Drive Type: Data Drive
Interface Type: SAS
Size: 300 GB
Rotational Speed: 15000
Firmware Revision: HS0F
Serial Number: 3QP2XAGH
Model: SEAGATE ST3300656SS
Current Temperature (C): 33
PHY Count: 2
PHY Transfer Rate: 3.0GBPS, Unknown

physicaldrive 1I:1:4
Port: 1I
Box: 1
Bay: 4
Status: OK
Drive Type: Data Drive
Interface Type: SAS
Size: 300 GB
Rotational Speed: 15000
Firmware Revision: HS0F
Serial Number: 3QP2W6WN
Model: SEAGATE ST3300656SS
Current Temperature (C): 33
PHY Count: 2
PHY Transfer Rate: 3.0GBPS, Unknown

Array: B
Interface Type: SATA
Unused Space: 0 MB
Status: OK

Logical Drive: 2
Size: 1.8 TB
Fault Tolerance: RAID 1+0
Heads: 255
Sectors Per Track: 32
Cylinders: 65535
Strip Size: 256 KB
Status: OK
Array Accelerator: Enabled
Unique Identifier: 600508B1001C556A097AEAF3D42F23DA
Disk Name: /dev/sdb
Mount Points: /home 1.8 TB
Logical Drive Label: AF7701E0PACCRID114911G79B8C
Mirror Group 0:
physicaldrive 1I:1:5 (port 1I:box 1:bay 5, SATA, 1 TB, OK)
physicaldrive 1I:1:6 (port 1I:box 1:bay 6, SATA, 1 TB, OK)
Mirror Group 1:
physicaldrive 1I:1:7 (port 1I:box 1:bay 7, SATA, 1 TB, OK)
physicaldrive 1I:1:8 (port 1I:box 1:bay 8, SATA, 1 TB, OK)

physicaldrive 1I:1:5
Port: 1I
Box: 1
Bay: 5
Status: OK
Drive Type: Data Drive
Interface Type: SATA
Size: 1 TB
Firmware Revision: HPG2
Serial Number: WMAW30416924
Model: ATA MB1000EBNCF
SATA NCQ Capable: True
SATA NCQ Enabled: True
Current Temperature (C): 33
Maximum Temperature (C): 43
PHY Count: 1
PHY Transfer Rate: 3.0GBPS

physicaldrive 1I:1:6
Port: 1I
Box: 1
Bay: 6
Status: OK
Drive Type: Data Drive
Interface Type: SATA
Size: 1 TB
Firmware Revision: HPG2
Serial Number: WMAW30417134
Model: ATA MB1000EBNCF
SATA NCQ Capable: True
SATA NCQ Enabled: True
Current Temperature (C): 31
Maximum Temperature (C): 42
PHY Count: 1
PHY Transfer Rate: 3.0GBPS

physicaldrive 1I:1:7
Port: 1I
Box: 1
Bay: 7
Status: OK
Drive Type: Data Drive
Interface Type: SATA
Size: 1 TB
Firmware Revision: HPG2
Serial Number: WMAW30459976
Model: ATA MB1000EBNCF
SATA NCQ Capable: True
SATA NCQ Enabled: True
Current Temperature (C): 35
Maximum Temperature (C): 42
PHY Count: 1
PHY Transfer Rate: 3.0GBPS

physicaldrive 1I:1:8
Port: 1I
Box: 1
Bay: 8
Status: OK
Drive Type: Data Drive
Interface Type: SATA
Size: 1 TB
Firmware Revision: HPG2
Serial Number: WMAW30449502
Model: ATA MB1000EBNCF
SATA NCQ Capable: True
SATA NCQ Enabled: True
Current Temperature (C): 32
Maximum Temperature (C): 40
PHY Count: 1
PHY Transfer Rate: 3.0GBPS

Expander 250
Device Number: 250
Firmware Version: 2.18
WWID: 50014380170E1EF0
Port: 1I
Box: 1
Vendor ID: HP

Enclosure SEP (Vendor ID HP, Model DL18xG6BP) 248
Device Number: 248
Firmware Version: 2.18
WWID: 50014380170E1F03
Port: 1I
Box: 1
Vendor ID: HP
Model: DL18xG6BP

SEP (Vendor ID PMCSIERA, Model SRC 8x6G) 249
Device Number: 249
Firmware Version: RevC
WWID: 500143801889278F
Vendor ID: PMCSIERA
Model: SRC 8x6G

regards,

Piotr

Re: slow speed array with hpsa driver

piopio — Thu, 17 May 2012 18:26:28 GMT

It was problem with bad parameter in kernel..

blockdev --setra 2048 /dev/sdb
blockdev --setra 2048 /dev/sda

this help to get good read spped from array

Piotr

Re: slow speed array with hpsa driver

Johan Guldmyr — Tue, 22 May 2012 10:51:12 GMT

Does this also improve the performance of the services running on the server?

topic Re: slow speed array with hpsa driver in Operating System - Linux

slow speed array with hpsa driver

Re: slow speed array with hpsa driver

Re: slow speed array with hpsa driver