ProLiant Servers (ML,DL,SL)
1748070 Members
5289 Online
108758 Solutions
New Discussion юеВ

Re: DL380p G8, RAID 10 strange activity lights

 
SOLVED
Go to solution
Bogdan-VMCLOUD
Established Member

DL380p G8, RAID 10 strange activity lights

Hello Community,

My name is Bogdan and i am new here, so please be gentle  I hope this is the right place for my question.

I have recently bought 2 DL380p G8 with 12 LFF disks and I see strange behaviour on activity lights. 

First off all you have to know that I am using nonHP disks but new ones and I dont have any problem in ILO or on POST, all the hard disk are recognized ok and they work perfect.

When I create RAID 10 between 6 x 2TB SATA disks, activity ring is running constantly even after 3-4 days (so it is not initialization), NON-STOP, it doesn't stop like on RAID 1 or 5 where it stays off and goes on only if it have activity. This issue is present with empty array in RAW format and also when I create NTFS/ReFS volume. I know some will say that it is because I use nonHP drives but:

- this doesn't happen if I use RAID 0 on each drive or all in a RAID 0 array ( here, activity ring it goes on only when there is activity) so there are no signaling problems in RAID 0

- it happens to show some activity on disks if I use RAID 5 but not so much like on RAID 10

- it appears there is a RAID 10 specific behaviour.

- all the other RAID arrays ( 0 and 1 ) doesent show any activity ( SSD and hard drives )

What I want to know:

do you have the same problem with activity ring in RAID 10 config? 

is this only a activity light problem from firmware/caddy or there is real work from raid controller to hard disks?

can i use some commands in CLI to see if the controller ( P420i ) it is actualy doing something with hard disks from the array or maybe it is just a signaling problem?

Every where I look ( ILO, Insight manager, RAID config. software ) everything is good or OK, no problems, nothing,only Activity Ring that it circles permanently. I am afraid not to damage or create fatigue on hard drives and reduce there life time.

I post my firmware versions but I think it is all new or what I found to upgrade. 

iLO 2.73 Feb 11 2020 Intelligent Platform Abstraction Data 1.01 Intelligent Provisioning 1.71.19 Power Management Controller Firmware 3.3 Power Management Controller Firmware Bootloader 2.7 Redundant System ROM P70 02/10/2014 SAS Programmable Logic Device Version 0x0C Server Platform Services (SPS) Firmware 2.1.7.E7.4 Smart Array P420i Controller 8.32 System Programmable Logic Device Version 0x32 System ROM P70 05/24/2019 System ROM Bootblock 03/05/2013

 

 

Thank you very much for your time and expertise!

Bogdan Mohora,
VMCLOUD SYSTEMS
9 REPLIES 9
Dominix_
Advisor

Re: DL380p G8, RAID 10 strange activity lights

hi bogdan, 

this is strange, as you said. This make me thing about a kind of disk scrubing that could be launched to verify the array . It could be some smart verification  on disk surface ... did it happend before Boot ? after Boot ?

Did you check your firmware for P420i for updates ? Bios updates ? HPIP updates ? 

In case activity is on after boot, which OS are you using, with which filesystem ? because some test to do could be differrent depending on OS you're using. (or file system, or snapshot)

can you run hpssacli or hpacucli with "hpssacli ctrl all show config detail" and show us the config.

 

Bogdan-VMCLOUD
Established Member

Re: DL380p G8, RAID 10 strange activity lights

Hi Dominix_

I will use commands you gave me when I get to my office and post the config, until then:
- we use Windows Server 2019 Standard bu it is not from the OS because it happens even when I am in storage configuration software GUI and if I delete the OS from boot and server hangs at "No operating sistem found" it also have constant activity. To exclude caddy or backplane problem I installed a Adaptec 6805 RAID adapter and the Activity Ring works normal, only when I copy something on the array, this makes me think that problem is from P420i.

I will come back with config exports.

Thank you!
Bogdan Mohora,
VMCLOUD SYSTEMS
DANDKS
HPE Pro

Re: DL380p G8, RAID 10 strange activity lights

If the issue is not observed with an Adaptec RAID controller, it is clear that the Non HPE Drives are not compatible with the Gen8 Smart Array Controller. For a RAID 10 Array, there is a huge amount of parity work to be done on the Drives. Usually this could take time to complete the parity initialization. Install the Smart Storage Administrator for WIndows & you may check the Drive/RAID status in GUI which will clearly provide you the information about the Drives/RAID.

Thank you


I am an HPE employee
Accept or Kudo
DANDKS
HPE Pro

Re: DL380p G8, RAID 10 strange activity lights

Hi,

Please update if the issue is resolved. Were you able to isolate the issue, if it was with the Drive or the Drive Bay.


I am an HPE employee
Accept or Kudo
Bogdan-VMCLOUD
Established Member

Re: DL380p G8, RAID 10 strange activity lights

Hello, I am very sorry for late response, we are very busy with a client and some ransomware, decripting, backup and reinstalling a lot of systems to minimize the downtime.
For this reason we have no time for our internal project, I hope in this weekend to make more tests.

Thank you!
Bogdan Mohora,
VMCLOUD SYSTEMS
Bogdan-VMCLOUD
Established Member

Re: DL380p G8, RAID 10 strange activity lights

Hello,

In this weekend I tested more the DL380p G8 and I have no concluzion why it behave wired. 

Speed in RAID 10 config with 6 x 2TB 7200RPM is 1.1 - 1.3 GB /s to write on array( a 25GB folder with some ISO files), so It looks like it is not impacting the perormance, also I didnt masure IOPS. My big concern is about life time of disks if they have so much traffic, i supose the constant read and write will affect them.

In SSA for Windows I dont see enithing more than in provisioning SSA,  status is ok/ready I post down the export from CLI

 

=> ctrl all show config detail

Smart Array P420i in Slot 0 (Embedded)
Bus Interface: PCI
Slot: 0
Serial Number: 00143803005A870
Cache Serial Number: PBKUC0BRH7S8CB
RAID 6 (ADG) Status: Enabled
Controller Status: OK
Hardware Revision: B
Firmware Version: 8.32
Rebuild Priority: High
Expand Priority: Medium
Surface Scan Delay: 3 secs
Surface Scan Mode: Idle
Queue Depth: Automatic
Monitor and Performance Delay: 60 min
Elevator Sort: Enabled
Degraded Performance Optimization: Disabled
Inconsistency Repair Policy: Disabled
Wait for Cache Room: Disabled
Surface Analysis Inconsistency Notification: Disabled
Post Prompt Timeout: 15 secs
Cache Board Present: True
Cache Status: OK
Cache Ratio: 30% Read / 70% Write
Drive Write Cache: Disabled
Total Cache Size: 1024 MB
Total Cache Memory Available: 816 MB
No-Battery Write Cache: Enabled
SSD Caching RAID5 WriteBack Enabled: False
SSD Caching Version: 1
Cache Backup Power Source: Capacitors
Battery/Capacitor Count: 1
Battery/Capacitor Status: OK
SATA NCQ Supported: True
Spare Activation Mode: Activate on physical drive failure (default)
Controller Temperature (C): 79
Cache Module Temperature (C): 39
Capacitor Temperature (C): 25
Number of Ports: 2 Internal only
Encryption Supported: False
Driver Name: HpSAMD.sys
Driver Version: 8.0.4.0
Driver Supports HP SSD Smart Path: False


Gen8 ServBP 12+2 at Port 1I, Box 1, OK
Power Supply Status: Not Redundant
Vendor ID: HP
Serial Number: FZ42BP0895
Firmware Version: 3.30
Drive Bays: 14
Port: 1I
Box: 1
Location: Internal

Expander 380
Device Number: 380
Firmware Version: 3.30
WWID: 5001438029C11A40
Port: 1I
Box: 1
Vendor ID: HP

Enclosure SEP (Vendor ID HP, Model Gen8 ServBP 12+2) 378
Device Number: 378
Firmware Version: 3.30
WWID: 5001438029C11A59
Port: 1I
Box: 1
Vendor ID: HP
Model: Gen8 ServBP 12+2

Physical Drives
physicaldrive 1I:1:1 (port 1I:box 1:bay 1, Solid State SATA, 250 GB, OK)
physicaldrive 1I:1:2 (port 1I:box 1:bay 2, SATA, 2 TB, OK)
physicaldrive 1I:1:3 (port 1I:box 1:bay 3, Solid State SATA, 500 GB, OK)
physicaldrive 1I:1:4 (port 1I:box 1:bay 4, Solid State SATA, 250 GB, OK)
physicaldrive 1I:1:5 (port 1I:box 1:bay 5, SATA, 2 TB, OK)
physicaldrive 1I:1:6 (port 1I:box 1:bay 6, Solid State SATA, 500 GB, OK)
physicaldrive 1I:1:7 (port 1I:box 1:bay 7, SATA, 2 TB, OK)
physicaldrive 1I:1:8 (port 1I:box 1:bay 8, SATA, 2 TB, OK)
physicaldrive 1I:1:9 (port 1I:box 1:bay 9, Solid State SATA, 1 TB, OK)
physicaldrive 1I:1:10 (port 1I:box 1:bay 10, SATA, 2 TB, OK)
physicaldrive 1I:1:11 (port 1I:box 1:bay 11, SATA, 2 TB, OK)

Array: A
Interface Type: SATA
Unused Space: 0 MB
Status: OK
Array Type: Data
HP SSD Smart Path: disable

 

Logical Drive: 1
Size: 5.5 TB
Fault Tolerance: 1+0
Heads: 255
Sectors Per Track: 32
Cylinders: 65535
Strip Size: 64 KB
Full Stripe Size: 192 KB
Status: OK
Caching: Enabled
Unique Identifier: 600508B1001CC7B182A630D13F99F856
Disk Name: \\.\PhysicalDrive1 (Bus: 0,Target: 10,Lun: 0)
Mount Points: D:\ 5.5 TB Partition Number 3
Logical Drive Label: 015AA9B000143803005A870930A
Mirror Group 0:
physicaldrive 1I:1:2 (port 1I:box 1:bay 2, SATA, 2 TB, OK)
physicaldrive 1I:1:5 (port 1I:box 1:bay 5, SATA, 2 TB, OK)
physicaldrive 1I:1:7 (port 1I:box 1:bay 7, SATA, 2 TB, OK)
Mirror Group 1:
physicaldrive 1I:1:8 (port 1I:box 1:bay 8, SATA, 2 TB, OK)
physicaldrive 1I:1:10 (port 1I:box 1:bay 10, SATA, 2 TB, OK)
physicaldrive 1I:1:11 (port 1I:box 1:bay 11, SATA, 2 TB, OK)
Drive Type: Data
LD Acceleration Method: Controller Cache

physicaldrive 1I:1:2
Port: 1I
Box: 1
Bay: 2
Status: OK
Drive Type: Data Drive
Interface Type: SATA
Size: 2 TB
Native Block Size: 4096
Rotational Speed: 7200
Firmware Revision: 0001
Serial Number: WFL3F6R5
Model: ATA ST2000DM008-2FR1
SATA NCQ Capable: True
SATA NCQ Enabled: True
Current Temperature (C): 28
Maximum Temperature (C): 35
PHY Count: 1
PHY Transfer Rate: 6.0Gbps
Drive Authentication Status: OK
Carrier Application Version: 11
Carrier Bootloader Version: 6

physicaldrive 1I:1:5
Port: 1I
Box: 1
Bay: 5
Status: OK
Drive Type: Data Drive
Interface Type: SATA
Size: 2 TB
Native Block Size: 4096
Rotational Speed: 7200
Firmware Revision: 0001
Serial Number: WFL3M6PN
Model: ATA ST2000DM008-2FR1
SATA NCQ Capable: True
SATA NCQ Enabled: True
Current Temperature (C): 27
Maximum Temperature (C): 34
PHY Count: 1
PHY Transfer Rate: 6.0Gbps
Drive Authentication Status: OK
Carrier Application Version: 11
Carrier Bootloader Version: 6

physicaldrive 1I:1:7
Port: 1I
Box: 1
Bay: 7
Status: OK
Drive Type: Data Drive
Interface Type: SATA
Size: 2 TB
Native Block Size: 4096
Rotational Speed: 7200
Firmware Revision: CC26
Serial Number: Z4Z9J05V
Model: ATA ST2000DM006-2DM1
SATA NCQ Capable: True
SATA NCQ Enabled: True
Current Temperature (C): 25
Maximum Temperature (C): 46
PHY Count: 1
PHY Transfer Rate: 6.0Gbps
Drive Authentication Status: OK
Carrier Application Version: 11
Carrier Bootloader Version: 6

physicaldrive 1I:1:8
Port: 1I
Box: 1
Bay: 8
Status: OK
Drive Type: Data Drive
Interface Type: SATA
Size: 2 TB
Native Block Size: 4096
Rotational Speed: 7200
Firmware Revision: 0001
Serial Number: WFL3F1MG
Model: ATA ST2000DM008-2FR1
SATA NCQ Capable: True
SATA NCQ Enabled: True
Current Temperature (C): 29
Maximum Temperature (C): 35
PHY Count: 1
PHY Transfer Rate: 6.0Gbps
Drive Authentication Status: OK
Carrier Application Version: 11
Carrier Bootloader Version: 6

physicaldrive 1I:1:10
Port: 1I
Box: 1
Bay: 10
Status: OK
Drive Type: Data Drive
Interface Type: SATA
Size: 2 TB
Native Block Size: 4096
Rotational Speed: 7200
Firmware Revision: CC26
Serial Number: Z560BHJZ
Model: ATA ST2000DM001-1ER1
SATA NCQ Capable: True
SATA NCQ Enabled: True
Current Temperature (C): 26
Maximum Temperature (C): 48
PHY Count: 1
PHY Transfer Rate: 6.0Gbps
Drive Authentication Status: OK
Carrier Application Version: 11
Carrier Bootloader Version: 6

physicaldrive 1I:1:11
Port: 1I
Box: 1
Bay: 11
Status: OK
Drive Type: Data Drive
Interface Type: SATA
Size: 2 TB
Native Block Size: 4096
Rotational Speed: 7200
Firmware Revision: 0001
Serial Number: WFL3F18F
Model: ATA ST2000DM008-2FR1
SATA NCQ Capable: True
SATA NCQ Enabled: True
Current Temperature (C): 29
Maximum Temperature (C): 35
PHY Count: 1
PHY Transfer Rate: 6.0Gbps
Drive Authentication Status: OK
Carrier Application Version: 11
Carrier Bootloader Version: 6


Array: B
Interface Type: Solid State SATA
Unused Space: 0 MB
Status: OK
Array Type: Data
HP SSD Smart Path: enable

 

Logical Drive: 2
Size: 232.9 GB
Fault Tolerance: 1
Heads: 255
Sectors Per Track: 32
Cylinders: 59844
Strip Size: 256 KB
Full Stripe Size: 256 KB
Status: OK
Caching: Disabled
Unique Identifier: 600508B1001CFCEEABAF85395B6FF056
Disk Name: \\.\PhysicalDrive0 (Bus: 0,Target: 4,Lun: 0)
Mount Points: Unknown 549 MB Partition Number 2, C:\ 232.3 GB Partition Number 3
Logical Drive Label: RAID1_OS
Mirror Group 0:
physicaldrive 1I:1:1 (port 1I:box 1:bay 1, Solid State SATA, 250 GB, OK)
Mirror Group 1:
physicaldrive 1I:1:4 (port 1I:box 1:bay 4, Solid State SATA, 250 GB, OK)
Drive Type: Data
LD Acceleration Method: HP SSD Smart Path

physicaldrive 1I:1:1
Port: 1I
Box: 1
Bay: 1
Status: OK
Drive Type: Data Drive
Interface Type: Solid State SATA
Size: 250 GB
Native Block Size: 4096
Firmware Revision: M3CR023
Serial Number: 2004E2845528
Model: ATA CT250MX500SSD1
SATA NCQ Capable: True
SATA NCQ Enabled: True
Current Temperature (C): 31
Maximum Temperature (C): 45
SSD Smart Trip Wearout: Not Supported
PHY Count: 1
PHY Transfer Rate: 6.0Gbps
Drive Authentication Status: OK
Carrier Application Version: 11
Carrier Bootloader Version: 6

physicaldrive 1I:1:4
Port: 1I
Box: 1
Bay: 4
Status: OK
Drive Type: Data Drive
Interface Type: Solid State SATA
Size: 250 GB
Native Block Size: 4096
Firmware Revision: M3CR023
Serial Number: 2004E28459F4
Model: ATA CT250MX500SSD1
SATA NCQ Capable: True
SATA NCQ Enabled: True
Current Temperature (C): 28
Maximum Temperature (C): 47
SSD Smart Trip Wearout: Not Supported
PHY Count: 1
PHY Transfer Rate: 6.0Gbps
Drive Authentication Status: OK
Carrier Application Version: 11
Carrier Bootloader Version: 6


Array: C
Interface Type: Solid State SATA
Unused Space: 0 MB
Status: OK
Array Type: Data
HP SSD Smart Path: enable

 

Logical Drive: 3
Size: 465.7 GB
Fault Tolerance: 1
Heads: 255
Sectors Per Track: 32
Cylinders: 65535
Strip Size: 64 KB
Full Stripe Size: 64 KB
Status: OK
Caching: Disabled
Unique Identifier: 600508B1001CDAB7D2E10278E4123D6F
Disk Name: \\.\PhysicalDrive2 (Bus: 0,Target: 6,Lun: 0)
Mount Points: None
Logical Drive Label: 0930E30D00143803005A8701F04
Mirror Group 0:
physicaldrive 1I:1:3 (port 1I:box 1:bay 3, Solid State SATA, 500 GB, OK)
Mirror Group 1:
physicaldrive 1I:1:6 (port 1I:box 1:bay 6, Solid State SATA, 500 GB, OK)
Drive Type: Data
LD Acceleration Method: HP SSD Smart Path

physicaldrive 1I:1:3
Port: 1I
Box: 1
Bay: 3
Status: OK
Drive Type: Data Drive
Interface Type: Solid State SATA
Size: 500 GB
Native Block Size: 512
Firmware Revision: RVT04B6Q
Serial Number: S4XBNF0N337068J
Model: ATA Samsung SSD 860
SATA NCQ Capable: True
SATA NCQ Enabled: True
Current Temperature (C): 24
Maximum Temperature (C): 40
SSD Smart Trip Wearout: Not Supported
PHY Count: 1
PHY Transfer Rate: 6.0Gbps
Drive Authentication Status: OK
Carrier Application Version: 11
Carrier Bootloader Version: 6

physicaldrive 1I:1:6
Port: 1I
Box: 1
Bay: 6
Status: OK
Drive Type: Data Drive
Interface Type: Solid State SATA
Size: 500 GB
Native Block Size: 512
Firmware Revision: RVT04B6Q
Serial Number: S3Z2NB1KC42852Z
Model: ATA Samsung SSD 860
SATA NCQ Capable: True
SATA NCQ Enabled: True
Current Temperature (C): 24
Maximum Temperature (C): 49
SSD Smart Trip Wearout: Not Supported
PHY Count: 1
PHY Transfer Rate: 6.0Gbps
Drive Authentication Status: OK
Carrier Application Version: 11
Carrier Bootloader Version: 6


Array: D
Interface Type: Solid State SATA
Unused Space: 0 MB
Status: OK
Array Type: Data
HP SSD Smart Path: enable

 

Logical Drive: 4
Size: 931.5 GB
Fault Tolerance: 0
Heads: 255
Sectors Per Track: 32
Cylinders: 65535
Strip Size: 64 KB
Full Stripe Size: 64 KB
Status: OK
Caching: Disabled
Unique Identifier: 600508B1001CDF6361DC23BAAB1358EB
Disk Name: \\.\PhysicalDrive3 (Bus: 0,Target: 7,Lun: 0)
Mount Points: None
Logical Drive Label: RAID0_VM_STORAGE
Drive Type: Data
LD Acceleration Method: HP SSD Smart Path

physicaldrive 1I:1:9
Port: 1I
Box: 1
Bay: 9
Status: OK
Drive Type: Data Drive
Interface Type: Solid State SATA
Size: 1 TB
Native Block Size: 512
Firmware Revision: RVT04B6Q
Serial Number: S3Z9NY0M716682J
Model: ATA Samsung SSD 860
SATA NCQ Capable: True
SATA NCQ Enabled: True
Current Temperature (C): 24
Maximum Temperature (C): 47
SSD Smart Trip Wearout: Not Supported
PHY Count: 1
PHY Transfer Rate: 6.0Gbps
Drive Authentication Status: OK
Carrier Application Version: 11
Carrier Bootloader Version: 6


Enclosure SEP (Vendor ID HP, Model Gen8 ServBP 12+2) 378
Device Number: 378
Firmware Version: 3.30
WWID: 5001438029C11A59
Port: 1I
Box: 1
Vendor ID: HP
Model: Gen8 ServBP 12+2

Expander 380
Device Number: 380
Firmware Version: 3.30
WWID: 5001438029C11A40
Port: 1I
Box: 1
Vendor ID: HP

SEP (Vendor ID PMCSIERA, Model SRCv8x6G) 379
Device Number: 379
Firmware Version: RevB
WWID: 500143803005A87F
Vendor ID: PMCSIERA
Model: SRCv8x6G

 

As another ideea what do you think about using a LSI 9271-4i, do you think I would get another compatibility problem? Will i be able to boot from it? 

Do you think it has same or better performance than p420i?

 

Thank you very much!

Bogdan Mohora,
VMCLOUD SYSTEMS
DANDKS
HPE Pro

Re: DL380p G8, RAID 10 strange activity lights

One of the main reason for any issues observed is due to using Non HPE parts which have not been tested & certified by HPE. All HPE parts will have required sensors, firmware & drivers which will work in conjunction with iLO firmware to report any issues with any HPE parts.

Using Non HPE parts, will not work fine with iLO to report any status of the parts as they will not have required sensors or compatible drivers to work with iLO.

The hardware may work as usual, however the reporting of the device status will not be correct.

Other than this, the hardware will continue to work as usual. Ensure that all the hardware firmware & drivers are kept updated

Thank you


I am an HPE employee
Accept or Kudo
Bogdan-VMCLOUD
Established Member

Re: DL380p G8, RAID 10 strange activity lights

Thank you for reply,

As I sad in my first post I am aware that using nonHP disks will be a little problematic, I dont have a problem if it is only a signaling / lights problem. What I want to know is if there is any software to check if the RAID controller makes to much trafic damaging disks or if there is only a led/signaling problem. 

If there are intensive writes and reads  that are not as usual I think I should use another controller like LSI.

 

Bogdan Mohora,
VMCLOUD SYSTEMS
DANDKS
HPE Pro
Solution

Re: DL380p G8, RAID 10 strange activity lights

Recommended sw is IO Meter to monitor the traffice & IOPS. Nothing specific to monitor the Controller passing the traffice

Thank you


I am an HPE employee
Accept or Kudo