topic Physical Drive State: Predictive failure. This physical drive is predicted to fail soon in ProLiant Servers (ML,DL,SL)

Physical Drive State: Predictive failure. This physical drive is predicted to fail soon

oneup — Sun, 05 Apr 2020 14:26:06 GMT

We recently replaced a failed drive in a Smart Array P420i and after a day of work, the drive is showing a warning: Physical Drive State: Predictive failure. This physical drive is predicted to fail soon.

Is there anything we can do besides replacing the hard drive? And what is the process to replace it? Can we do it without shutting down the server?

Thank you in advance.

Here is the ACU Diagnostics report:

[ Top ] → [ Smart Array P420i in Embedded Slot ] → [ Internal Drive Cage at Port 1I : Box 1 ] → [ Drive Cage on Port 1I ] → Physical Drive (600 GB SAS) 1I:1:2 Report Section(s): Physical Drive Status
Monitor and Performance Statistics (Since Factory)
Monitor and Performance Statistics (Since Reset)
Serial SCSI Physical Drive Error Log
Mode Sense 10
VPD Page 80 - Serial Number
VPD Page 83 - Array Information
[ Top ] → [ Smart Array P420i in Embedded Slot ] → [ Internal Drive Cage at Port 1I : Box 1 ] → [ Drive Cage on Port 1I ] → [ Physical Drive (600 GB SAS) 1I:1:2 ] → Device Error Report
Device Status
Physical Drive (600 GB SAS) 1I:1:2 Physical Drive State: Predictive failure. This physical drive is predicted to fail soon.
[ Top ] → [ Smart Array P420i in Embedded Slot ] → [ Internal Drive Cage at Port 1I : Box 1 ] → [ Drive Cage on Port 1I ] → [ Physical Drive (600 GB SAS) 1I:1:2 ] → Physical Drive Status
SCSI Bus 0 (0x00)
SCSIID 1 (0x01)
Block Size 512 Bytes Per Block (0x0200)
Total Blocks 600 GB (0x45dd2fb0)
Reserved Blocks 0x00010000
Drive Model HP EF0600FARNA
Drive Serial Number XXXXXXXXXXXXXXXXXXX
Drive Firmware Revision HPD6
SCSI Inquiry Bits 0x02
Compaq Drive Stamped Stamped For Monitoring (0x01)
Last Failure Reason Hardware Error (0x0d)
Device Flags 0x01Position Device Flag Status
0 Drive Present And Operational Informational

More Device Flags 0x2fPosition Device Flag Status
0 SMART Predictive Failure Supported Informational
1 SMART Predictive Failure Errors Are Recorded In The Factory MP Data For This Drive Warning
2 SMART Predictive Failure Is Enabled Informational
3 SMART Predictive Failure Errors Are Recorded In The Since Power MP Data For This Drive Warning
4 Device Attached To Internal Connector Informational
5 Configured Data Drive Informational

SCSI Lun 0x00
Yet More Device Flags 0x80Position Device Flag Status
7 Drive Write Cache Setting Is Changeable Informational

Even More Device Flags 0x10Position Device Flag Status
4 PHY To PHY Map Is Supported Informational

Spi Speed Rules 0x00000000
Physical Port 1I
Physical Box 1 (0x01)
Physical Bay 2 (0x02)
RPM 15000 RPM (0x00003a98)
Device Type SAS (0x02)
SATA Version 0x00
Big Total Block Count 0x0000000045dd2fb0
RIS Starting LBA 0x0000000045dc37b0
RIS Size 160 KB (0x00000140)
WWID 5000c50068099fbd (0x50 0x00 0xc5 0x00 0x68 0x09 0x9f 0xbd 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00)
Controller PHY Map 0x02 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
PHY Count 2 (0x0002)
PHY Connected Device Type 0x07 0x02 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
PHY To Drive Bay Number 0x02 0x02 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
PHY To Attached Device Index 0xfffe 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000 0x0000
Box Index 0 (0x00)
MSA Support 0x00
Extra Device Flags 0x4000Position Device Flag Status
14 Rapid Parity Initialization Capable Informational

Negotiated Link Rate 0x0a 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
Phy To Phy Map 0x01 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
Redundant Path Present Map 0x01
Redundant Path Failure Map 0x00
Active Path Number 0x00
Multi Path Port 1 1I
Multi Path Port 2 empty
Multi Path Port 3 empty
Multi Path Port 4 empty
Multi Path Port 5 empty
Multi Path Port 6 empty
Multi Path Port 7 empty
Multi Path Port 8 empty
Multi Path Box 1 0x01
Multi Path Box 2 0x00
Multi Path Box 3 0x00
Multi Path Box 4 0x00
Multi Path Box 5 0x00
Multi Path Box 6 0x00
Multi Path Box 7 0x00
Multi Path Box 8 0x00
Multi LUN Device LUN Count 0x00
Minimum Good Firmware Revision empty
Vendor Unique Inquiry Bytes 0x36 0x53 0x4c 0x36 0x41 0x47 0x43 0x35 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
Current Temperature 0x38
Temperature Threshold 0x3c
Maximum Temperature 0x39
Logical Blocks Per Physical Block 0x00
Current Q Depth Limit 0x0020
Switch Name All Zeroes (10 x [0x00])
Switch Port 0x0000
Alternate Paths Switch Name All Zeroes (40 x [0x00])
Alternate Paths Switch Port 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
Power On Hours 0xa992
Percent Endurance Used 0x0000
Drive Authentication 0x80
Smart Carrier Authentication 0x01
Smart Carrier Application Version 0x0b
Smart Carrier Bootloader Version 0x06
Sanititze Erase Support 0x80
Encryption Flags 0x00
Encryption Key Name HP_HDD_SAS_____600GB_15K_EF0600FARNA______6SL6AGC50000N3431S15
[ Top ] → [ Smart Array P420i in Embedded Slot ] → [ Internal Drive Cage at Port 1I : Box 1 ] → [ Drive Cage on Port 1I ] → [ Physical Drive (600 GB SAS) 1I:1:2 ] → Monitor and Performance Statistics (Since Factory)
Serial Number XXXXXXXXXXXXXXXXXXX
Firmware Revision HPD6
Product Revision HP EF0600FARNA
Reference Time 0x00000b1d
Sectors Read 0x00000000f16cc129
Read Errors Hard 0x0000005e
Read Errors Retry Recovered 0x00000000
Read Errors ECC Corrected 0x0000000000000009
Sectors Written 0x0000000048f3a217
Write Errors Hard 0x00000000
Write Errors Retry Recovered 0x00000000
Seek Count 0xffffffffffffffff
Seek Errors 0xffffffffffffffff
Spin Cycles 0x00000001
Spin Up Time 0x004a
Performance Test 1 0x0000
Performance Test 2 0xffff
Performance Test 3 0xffff
Performance Test 4 0xffff
Reallocation Sectors 0xffffffff
Reallocated Sectors 0xffffffff
DRQ Time Outs 0xffff
Other Time Outs 0x0000
Drive Rebuild Count 1 (0x0001)
Spin Retries 65535 (0xffff)
Recovers Failed Read 0x0000
Recovers Failed Write 0x0000
Format Errors 0x0000
Self Test Failures 0xffff
Not Ready Failures 0x00000000
Remap Abort Failures 0xffffffff
IRQ Deglitch Count 4294967295 (0xffffffff)
Bus Faults 0x00000000
Hot Plug Count 0 (0x00000000)
Track Rewrite Errors 0xffff
Write Errors After Remap 0x0000
Background Firmware Revision 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
Media Failures 0x0000
Hardware Errors 0x0000
Aborted Command Failures 0x0000
Spin Up Failures 0x0000
Bad Target Count 0 (0x0000)
Predictive Failure Errors 0x00000aad
[ Top ] → [ Smart Array P420i in Embedded Slot ] → [ Internal Drive Cage at Port 1I : Box 1 ] → [ Drive Cage on Port 1I ] → [ Physical Drive (600 GB SAS) 1I:1:2 ] → Monitor and Performance Statistics (Since Reset)
Serial Number XXXXXXXXXXXXXXXXXXX
Firmware Revision HPD6
Product Revision HP EF0600FARNA
Reference Time 0x00000b1d
Sectors Read 0x00000000f16cc2b8
Read Errors Hard 0x0000005e
Read Errors Retry Recovered 0x00000000
Read Errors ECC Corrected 0x0000000000000009
Sectors Written 0x0000000048f3a257
Write Errors Hard 0x00000000
Write Errors Retry Recovered 0x00000000
Seek Count 0xffffffffffffffff
Seek Errors 0xffffffffffffffff
Spin Cycles 0x00000000
Spin Up Time 0x0000
Performance Test 1 0x0000
Performance Test 2 0xffff
Performance Test 3 0xffff
Performance Test 4 0xffff
Reallocation Sectors 0xffffffff
Reallocated Sectors 0xffffffff
DRQ Time Outs 0xffff
Other Time Outs 0x0000
Drive Rebuild Count 1 (0x0001)
Spin Retries 65535 (0xffff)
Recovers Failed Read 0x0000
Recovers Failed Write 0x0000
Format Errors 0x0000
Self Test Failures 0xffff
Not Ready Failures 0x00000000
Remap Abort Failures 0xffffffff
IRQ Deglitch Count 4294967295 (0xffffffff)
Bus Faults 0x00000000
Hot Plug Count 0 (0x00000000)
Track Rewrite Errors 0xffff
Write Errors After Remap 0x0000
Background Firmware Revision 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
Media Failures 0x0000
Hardware Errors 0x0000
Aborted Command Failures 0x0000
Spin Up Failures 0x0000
Bad Target Count 0 (0x0000)
Predictive Failure Errors 0x00000aad
[ Top ] → [ Smart Array P420i in Embedded Slot ] → [ Internal Drive Cage at Port 1I : Box 1 ] → [ Drive Cage on Port 1I ] → [ Physical Drive (600 GB SAS) 1I:1:2 ] → Serial SCSI Physical Drive Error Log
Entry Size 20 (0x14)
Entry Count 64 (0x0040)
Next Entry Offset 0x29
Errors Logged 105 (0x00000069)
Physical Drive Error Log Entries Error Type SCSI Operation Code SCSI Status CAM Status Sense Key ASC ASCQ Block Valid Block Reference Time Additional Information
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a6b9e7 0x0000009a 0x0000
0x01 0x28 0x02 0x04 0x03 0x16 0x00 0x01 0x08a6b9e8 0x0000009a 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a6bfdc 0x0000009a 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a6c5d0 0x0000009a 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a6c5d1 0x0000009a 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a6cbc4 0x0000009a 0x0000
0x01 0x28 0x02 0x04 0x03 0x16 0x00 0x01 0x08a6cbc5 0x0000009a 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a6d1b9 0x0000009a 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a6d7ad 0x0000009a 0x0000
0x01 0x28 0x02 0x04 0x03 0x16 0x00 0x01 0x08a6d7ae 0x0000009a 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a6dda2 0x0000009b 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a6e396 0x0000009b 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a6e98a 0x0000009b 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a6e98b 0x0000009b 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a6ef7f 0x0000009b 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a6f573 0x0000009b 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a6fb67 0x0000009c 0x0000
0x01 0x28 0x02 0x04 0x03 0x16 0x00 0x01 0x08a6fb68 0x0000009c 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a7015c 0x0000009c 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a70750 0x0000009c 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a70751 0x0000009c 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a70d44 0x0000009c 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a70d45 0x0000009c 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a71999 0x0000009c 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a71f8d 0x0000009d 0x0000
0x01 0x28 0x02 0x04 0x03 0x16 0x00 0x01 0x08a71f8e 0x0000009d 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a72582 0x0000009d 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a72b76 0x0000009d 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a7316a 0x0000009d 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a7316b 0x0000009d 0x0000
0x01 0x28 0x02 0x04 0x01 0x5d 0x10 0x00 0x08a73400 0x0000009d 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a7375f 0x0000009d 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a73d53 0x0000009d 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a74347 0x0000009e 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a74348 0x0000009e 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a7493c 0x0000009e 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a74f30 0x0000009e 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a75524 0x0000009e 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a75525 0x0000009e 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a75b19 0x0000009e 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a78f34 0x0000009e 0x0000
0x01 0x28 0x02 0x04 0x01 0x18 0x07 0x01 0x08a7a706 0x0000009e 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a8580b 0x0000009f 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a85863 0x0000009f 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a85864 0x0000009f 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a85866 0x0000009f 0x0000
0x01 0x28 0x02 0x04 0x01 0x18 0x07 0x01 0x08a858bf 0x0000009f 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a85a7f 0x0000009f 0x0000
0x01 0x28 0x02 0x04 0x01 0x18 0x07 0x01 0x08a8ffda 0x0000009f 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a91e0b 0x0000009f 0x0000
0x01 0x28 0x02 0x04 0x01 0x18 0x07 0x01 0x08a953a2 0x0000009f 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a95946 0x0000009f 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a95f3a 0x000000a0 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a95f3b 0x000000a0 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a9652f 0x000000a0 0x0000
0x01 0x28 0x02 0x04 0x01 0x18 0x07 0x01 0x08a96b23 0x000000a0 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a97d6c 0x000000a0 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a98955 0x000000a0 0x0000
0x01 0x28 0x02 0x04 0x01 0x18 0x07 0x01 0x08a98f49 0x000000a0 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a9953d 0x000000a0 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a9a126 0x000000a0 0x0000
0x01 0x28 0x02 0x04 0x03 0x11 0x00 0x01 0x08a9a71a 0x000000a1 0x0000
0x01 0x28 0x02 0x04 0x01 0x18 0x07 0x01 0x08a79b1d 0x000006b8 0x0000
0x01 0x28 0x02 0x04 0x01 0x18 0x07 0x01 0x08a77d57 0x000006b8 0x0000

Reference Time 0x00000b1d
[ Top ] → [ Smart Array P420i in Embedded Slot ] → [ Internal Drive Cage at Port 1I : Box 1 ] → [ Drive Cage on Port 1I ] → [ Physical Drive (600 GB SAS) 1I:1:2 ] → Mode Sense 10
Header 0x00 0xce 0x00 0x10 0x00 0x00 0x00 0x08 0x00 0x00 0x00 0x00 0x00 0x00 0x02 0x00
Mode Page Page Number Page Data
0x00 0x80 0x06 0x02 0x80 0x0f 0x00 0x00 0x00
0x01 0x81 0x0a 0xe4 0x0b 0xff 0x00 0x00 0x00 0x05 0x00 0xff 0xff
0x02 0x82 0x0e 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
0x03 0x83 0x16 0xbb 0xd0 0x00 0x00 0x00 0x00 0x03 0x80 0x04 0xc4 0x02 0x00 0x00 0x01 0x00 0xc0 0x00 0x4c 0x40 0x00 0x00 0x00
0x04 0x84 0x16 0x01 0x8a 0x9a 0x08 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x3a 0xa7 0x00 0x00
0x07 0x87 0x0a 0x04 0x0b 0xff 0x00 0x00 0x00 0x00 0x00 0xff 0xff
0x08 0x88 0x12 0x10 0x00 0xff 0xff 0x00 0x00 0xff 0xff 0xff 0xff 0x00 0x20 0x00 0x00 0x00 0x00 0x00 0x00
0x09 0x89 0x0e 0x0c 0x20 0x00 0x00 0x00 0x0b 0x00 0x00 0x00 0x00 0x00 0x0c 0x40 0x00
0x0a 0x8a 0x0a 0x00 0x10 0x00 0x00 0x00 0x00 0x00 0x00 0x0e 0x92
0x18 0x98 0x06 0x06 0x00 0x00 0x00 0x00 0x00
0x19 0x99 0x0e 0x36 0x00 0x07 0xd0 0x27 0x10 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
0x1a 0x9a 0x0a 0x00 0x02 0x00 0x00 0x00 0x14 0xff 0xff 0xff 0xff
0x1c 0x9c 0x0a 0x11 0x04 0x00 0x00 0x0b 0xb8 0x00 0x00 0x00 0x02

[ Top ] → [ Smart Array P420i in Embedded Slot ] → [ Internal Drive Cage at Port 1I : Box 1 ] → [ Drive Cage on Port 1I ] → [ Physical Drive (600 GB SAS) 1I:1:2 ] → VPD Page 80 - Serial Number
Product Serial Number XXXXXXXXXXXXXXXXXXX
[ Top ] → [ Smart Array P420i in Embedded Slot ] → [ Internal Drive Cage at Port 1I : Box 1 ] → [ Drive Cage on Port 1I ] → [ Physical Drive (600 GB SAS) 1I:1:2 ] → VPD Page 83 - Array Information
Array Code Set Identifier Type Association Identifier Length Identifier
0x01 0x03 0x00 0x08 0x50 0x00 0xc5 0x00 0x68 0x09 0x9f 0xbf
0x01 0x03 0x01 0x08 0x50 0x00 0xc5 0x00 0x68 0x09 0x9f 0xbd
0x01 0x04 0x01 0x04 0x00 0x00 0x00 0x01
0x01 0x03 0x02 0x08 0x50 0x00 0xc5 0x00 0x68 0x09 0x9f 0xbc
0x03 0x08 0x02 0x18 0x6e 0x61 0x61 0x2e 0x35 0x30 0x30 0x30 0x43 0x35 0x30 0x30 0x36 0x38 0x30 0x39 0x39 0x46 0x42 0x43 0x00 0x00 0x00 0x00

Re: Physical Drive State: Predictive failure. This physical drive is predicted to fail soon

6BQ5 — Fri, 03 Apr 2020 00:52:24 GMT

We recently replaced a failed drive in a Smart Array P420i and after a day of work, the drive is showing a warning: Physical Drive State: Predictive failure. This physical drive is predicted to fail soon.
Is there anything we can do besides replacing the hard drive? And what is the process to replace it? Can we do it without shutting down the server?
Thank you in advance.
Here is the ACU Diagnostics report:

I assume the report is for the second drive ... the one you installed to replace the first?

It looks like you replaced one old drive with another old drive. Deep down in your report you have one interesting line item.

Power On Hours 0xa992

0xa992 is a hexidecial number. Converting that hexadecimal number to a regular decimal number results in 43,410..

43,410 hours / 24 hours per day / 365 days per year gives you approximately 4.96 years of powered on running time.

Depending on how heavily used that second drive was it could very well be starting to register errors. Now, it may run just fine for much longer but just know it's not a fresh drive.

If the drive is configured to work in a redundant array then you simply swap a third drive in and the array will rebuild that drive. I couldn't find your configuration details in that report. Maybe one of the HPE employees knows how to find it in all that data.

One item I did find is your drive part number, I think.

Product Revision HP EF0600FARNA

Google searching that last bit tells me the drive is capable of being hot swapped. So, I don't think there is a need to power down the server. Again, let's have the HPE professionals chime in.

Re: Physical Drive State: Predictive failure. This physical drive is predicted to fail soon

oneup — Fri, 03 Apr 2020 12:44:36 GMT

Thank you so much for pointing this out. I believe this is the culprit of our problem. I'm replacing the drive today and we'll see if it works afterwards. At least I know how to see how long the drive has been running. Thanks again!

Re: Physical Drive State: Predictive failure. This physical drive is predicted to fail soon

sudhirsingh — Sun, 05 Apr 2020 14:11:22 GMT

Hi,

[ Top ] → [ Smart Array P420i in Embedded Slot ] → [ Internal Drive Cage at Port 1I : Box 1 ] → [ Drive Cage on Port 1I ] → [ Physical Drive (600 GB SAS) 1I:1:2 ] → Monitor and Performance Statistics (Since Reset) >>>>Bay 2 drive

Firmware Revision HPD6 >>>Latest Firmware is HPD9,
https://support.hpe.com/hpsc/swd/public/detail?swItemId=MTX-1846690291f24b09a82750b81c#tab-history

Product Revision HP EF0600FARNA >>> This drive Model has Hot Swap spare part as well as Non-Hot Swap spare part .

Check spare part number on the drive and verify on the below link to determine whether drive is Hotswap/Non-hotswap:
https://support.hpe.com/hpesc/public/docDisplay?docLocale=en_US&docId=emr_na-a00052032en_us

Read Errors Hard 0x0000005e >>>>>>>>>>>>>>>>>>>>>>>>Anything other then 0 indicates an errors,
Read Errors ECC Corrected 0x0000000000000009 >>>>Anything other then 0 indicates an errors,
Predictive Failure Errors 0x00000aad >>>>>>>>>>>>>>>>>>Anything other then 0 indicates an errors,

You should do following:

1. Update drive firmware to latest HPD9(24 Oct 2016) and check the status.
2. Check MNP status of other drives also to know if any other drive also reporting any errors.
Note: Incase multiple drives reporting hardware errors in the array then you may have to replace multiple /all the defective drives together, hence its important to keep complete data backup before removing/replacing any drive.
3. If only Bay 2 drive reporting error then you should replace it.
4. If Bay2 drive is hotswap drive then you can remove and replace it while server is online.
5. If Bay2 drive is non hotswap then shutdown the server then remove and replace bay 2 drive.

6. Also check and update Smart array Controller firmware if its running older firmware.
Latest is 8.32(C)(27 Nov 2018)
https://support.hpe.com/hpsc/swd/public/detail?swItemId=MTX_dc0fa2598792465d8d5eaab1e2

Hope this helps!

Regards,

Sudhir

Re: Physical Drive State: Predictive failure. This physical drive is predicted to fail soon

oneup — Sun, 05 Apr 2020 16:01:41 GMT

Thank you Sudhir!

We replaced the drive on bay 2 and it seems to be working fine. I believe it was a hardware problem. Fortunately it was hotswap and we didn't have to take the server offline.

Thank you for your assistance. It is greately appreciated!

Re: Physical Drive State: Predictive failure. This physical drive is predicted to fail soon

6BQ5 — Sun, 05 Apr 2020 17:03:16 GMT

Great info in your reply, @sudhirsingh !