3Par replcament disk show the failed disk and the replaced disk in different position

[Luke_Y]

Hello.

we tried to replace a failed disk (position 39) and it still shows as failed 
ran the showinvenotory commands and saw that the disk that we replaced in a different position 
and the old disk showing as failed as if still in the system:

39 1:19:0? failed 5000C50068570638 SEAGATE SYJKT0300GBAS15K 6XN3ZJBS 3P01     SAS      Magnetic  2013-09-19 23:00:18 BST

64 1:19:0  normal 5000C5007637CA8C SEAGATE SYJKT0300GBAS15K 6XN6M1EE 3P01     SAS      Magnetic  2021-02-04 07:55:09 GMT

anybody got an idea?

[Torsten.]

Looks normal so far.

Please post

servicemag status -d

[Cali]

The failed Disk should go away, if recovery is complete.

"servicemag status" will show the recovery state

[Luke_Y]

servicemag status -d

Cage 1, magazine 19:
A servicemag resume command failed on this magazine.
The command completed at Thu Feb 4 17:55:44 2021.
The output of the servicemag resume was:
servicemag resume 1 19
... mag 1 19 already onlooped

... checking for valid disks...
... disks in mag : 1 19
... warning: chunklet 64:0 is used
... warning: chunklet 64:1 is used
... warning: chunklet 64:2 is used
... warning: chunklet 64:3 is used
... warning: chunklet 64:4 is used
... warning: chunklet 64:5 is used
... warning: chunklet 64:6 is used
... warning: chunklet 64:7 is used
... warning: chunklet 64:8 is used
... warning: chunklet 64:9 is used
... warning: chunklet 64:10 is used
... warning: chunklet 64:11 is used
... warning: chunklet 64:12 is used
... warning: chunklet 64:13 is used
... warning: chunklet 64:14 is used
... warning: chunklet 64:15 is used
... warning: chunklet 64:16 is used
... warning: chunklet 64:17 is used
... warning: chunklet 64:18 is used
... warning: chunklet 64:19 is used
... warning: chunklet 64:20 is used
... warning: chunklet 64:21 is used
... warning: chunklet 64:22 is used
... warning: chunklet 64:23 is used
... warning: chunklet 64:24 is used
... warning: chunklet 64:25 is used
... warning: chunklet 64:26 is used
... warning: chunklet 64:27 is used
... warning: chunklet 64:28 is used
... warning: chunklet 64:29 is used
... warning: chunklet 64:30 is used
... warning: chunklet 64:31 is used
... warning: chunklet 64:32 is used
... warning: chunklet 64:33 is used
... warning: chunklet 64:34 is used
... warning: chunklet 64:35 is used
... warning: chunklet 64:36 is used
... warning: chunklet 64:37 is used
... warning: chunklet 64:38 is used
... warning: chunklet 64:39 is used
... warning: chunklet 64:40 is used
... warning: chunklet 64:41 is used
... warning: chunklet 64:42 is used
... warning: chunklet 64:43 is used
... warning: chunklet 64:44 is used
... warning: chunklet 64:45 is used
... warning: chunklet 64:46 is used
... warning: chunklet 64:47 is used
... warning: chunklet 64:48 is used
... warning: chunklet 64:49 is used
... warning: chunklet 64:50 is used
... warning: chunklet 64:51 is used
... warning: chunklet 64:52 is used
... warning: chunklet 64:53 is used
... warning: chunklet 64:54 is used
... warning: chunklet 64:55 is used
... warning: chunklet 64:56 is used
... warning: chunklet 64:57 is used
... warning: chunklet 64:58 is used
... warning: chunklet 64:59 is used
... warning: chunklet 64:60 is used
... warning: chunklet 64:61 is used
... warning: chunklet 64:62 is used
... warning: chunklet 64:63 is used
... warning: chunklet 64:64 is used
... warning: chunklet 64:65 is used
... warning: chunklet 64:66 is used
... warning: chunklet 64:67 is used
... warning: chunklet 64:68 is used
... warning: chunklet 64:69 is used
... warning: chunklet 64:70 is used
... warning: chunklet 64:71 is used
... warning: chunklet 64:72 is used
... warning: chunklet 64:73 is used
... warning: chunklet 64:86 is used
... warning: chunklet 64:87 is used
... warning: chunklet 64:88 is used
... warning: chunklet 64:89 is used
... warning: chunklet 64:90 is used
... warning: chunklet 64:91 is used
... warning: chunklet 64:92 is used
... warning: chunklet 64:93 is used
... warning: chunklet 64:94 is used
... warning: chunklet 64:95 is used
... warning: chunklet 64:96 is used
... warning: chunklet 64:97 is used
... warning: chunklet 64:98 is used
... warning: chunklet 64:99 is used
... warning: chunklet 64:100 is used
... warning: chunklet 64:101 is used
... warning: chunklet 64:102 is used
... warning: chunklet 64:103 is used
... warning: chunklet 64:104 is used
... warning: chunklet 64:105 is used
... warning: chunklet 64:106 is used
... warning: chunklet 64:107 is used
... warning: chunklet 64:108 is used
... warning: chunklet 64:109 is used
... warning: chunklet 64:110 is used
... warning: chunklet 64:111 is used
... warning: chunklet 64:112 is used
... warning: chunklet 64:113 is used
... warning: chunklet 64:114 is used
... warning: chunklet 64:115 is used
... warning: chunklet 64:116 is used
... warning: chunklet 64:117 is used
... warning: chunklet 64:118 is used
... warning: chunklet 64:119 is used
... warning: chunklet 64:120 is used
... warning: chunklet 64:121 is used
... warning: chunklet 64:122 is used
... warning: chunklet 64:123 is used
... warning: chunklet 64:124 is used
... warning: chunklet 64:125 is used
... warning: chunklet 64:126 is used
... warning: chunklet 64:127 is used
... warning: chunklet 64:128 is used
... warning: chunklet 64:129 is used
... warning: chunklet 64:130 is used
... warning: chunklet 64:131 is used
... warning: chunklet 64:132 is used
... warning: chunklet 64:133 is used
... warning: chunklet 64:134 is used
... warning: chunklet 64:135 is used
... warning: chunklet 64:136 is used
... warning: chunklet 64:137 is used
... warning: chunklet 64:138 is used
... warning: chunklet 64:139 is used
... warning: chunklet 64:140 is used
... warning: chunklet 64:141 is used
... warning: chunklet 64:142 is used
... warning: chunklet 64:143 is used
... warning: chunklet 64:144 is used
... warning: chunklet 64:145 is used
... warning: chunklet 64:146 is used
... warning: chunklet 64:147 is used
... warning: chunklet 64:148 is used
... warning: chunklet 64:149 is used
... warning: chunklet 64:150 is used
... warning: chunklet 64:151 is used
... warning: chunklet 64:152 is used
... warning: chunklet 64:153 is used
... warning: chunklet 64:154 is used
... warning: chunklet 64:155 is used
... warning: chunklet 64:156 is used
... warning: chunklet 64:157 is used
... warning: chunklet 64:158 is used
... warning: chunklet 64:159 is used
... warning: chunklet 64:160 is used
... warning: chunklet 64:161 is used
... warning: chunklet 64:162 is used
... warning: chunklet 64:163 is used
... warning: chunklet 64:164 is used
... warning: chunklet 64:165 is used
... warning: chunklet 64:166 is used
... warning: chunklet 64:167 is used
... warning: chunklet 64:168 is used
... warning: chunklet 64:169 is used
... warning: chunklet 64:170 is used
... warning: chunklet 64:171 is used
... warning: chunklet 64:172 is used
... warning: chunklet 64:173 is used
... warning: chunklet 64:174 is used
... warning: chunklet 64:175 is used
... warning: chunklet 64:176 is used
... warning: chunklet 64:177 is used
... warning: chunklet 64:178 is used
... warning: chunklet 64:179 is used
... warning: chunklet 64:180 is used
... warning: chunklet 64:181 is used
... warning: chunklet 64:182 is used
... warning: chunklet 64:183 is used
... warning: chunklet 64:184 is used
... warning: chunklet 64:185 is used
... warning: chunklet 64:186 is used
... warning: chunklet 64:187 is used
... warning: chunklet 64:188 is used
... warning: chunklet 64:189 is used
... warning: chunklet 64:190 is used
... warning: chunklet 64:191 is used
... warning: chunklet 64:192 is used
... warning: chunklet 64:193 is used
... warning: chunklet 64:194 is used
... warning: chunklet 64:195 is used
... warning: chunklet 64:199 is used
... warning: chunklet 64:200 is used
... warning: chunklet 64:201 is used
... warning: chunklet 64:202 is used
... warning: chunklet 64:203 is used
... warning: chunklet 64:204 is used
... warning: chunklet 64:205 is used
... warning: chunklet 64:206 is used
... warning: chunklet 64:207 is used
... warning: chunklet 64:208 is used
... warning: chunklet 64:209 is used
... warning: chunklet 64:210 is used
... warning: chunklet 64:211 is used
... warning: chunklet 64:212 is used
... warning: chunklet 64:213 is used
... warning: chunklet 64:214 is used
... warning: chunklet 64:215 is used
... warning: chunklet 64:216 is used
... warning: chunklet 64:217 is used
... warning: chunklet 64:218 is used
... warning: chunklet 64:219 is used
... warning: chunklet 64:220 is used
... warning: chunklet 64:221 is used
... warning: chunklet 64:222 is used
... warning: chunklet 64:223 is used
... warning: chunklet 64:224 is used
... warning: chunklet 64:225 is used
... warning: chunklet 64:226 is used
... warning: chunklet 64:227 is used
... warning: chunklet 64:228 is used
... warning: chunklet 64:229 is used
... warning: chunklet 64:232 is used
... warning: chunklet 64:233 is used
... warning: chunklet 64:234 is used
... warning: chunklet 64:235 is used
... warning: chunklet 64:236 is used
... warning: chunklet 64:269 is used
... warning: chunklet 64:270 is used
... warning: chunklet 64:271 is used
... verifying spare space for disks 64 and 64
... All chunklets played back / relocated.
... cleared logging mode for cage 1 mag 19
... relocating chunklets from spare space
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move
... chunklet 67:257 - move_error,duplicate_dest, failed move
... chunklet 69:257 - move_error,duplicate_dest, failed move
... chunklet 63:253 - move_error,duplicate_dest, failed move
... chunklet 65:258 - move_error,duplicate_dest, failed move

Failed --
giving up after 101 attempt
servicemag resume 1 19 -- Failed

[Luke_Y]

i ran this as well :

showpd -state 39

Id CagePos Type -State- -------------------------Detailed_State------------------------- -SedState-
39 1:19:0? FC failed vacated,missing,invalid_media,smart_threshold_exceeded,servicing unknown
---------------------------------------------------------------------------------------------------

[veeyarvi]

Hello Luke_Y,

It is expected that the replacement disk will take a new ID and the old disk will be in failed state. The old PD ID will be removed automatically once the servicemag resume completes for that position.

Now, in this case, it seems the servicemag resume failing and from the errors, it looks the array is missing some OS updates. What is the Inform OS version and patch level?

Regards,
Veeyaarvi

I work for HPE

[Luke_Y]

Release version 3.2.2 (MU4)
Patches: P56,P59,P60,P74,P80,P85

[veeyarvi]

Hello Luke_Y,

Thank you .

The array should be at a minimum of 3.2.2 MU6 with Patch 149. Without that version we need to do a lot of manual work to get this resolved.

Please reach support if you need help with workaroud if the OS cannot be updated.

[Luke_Y]

Hello.

i opened a ticket with support 

they told me to run :

#servicemag unmark 1 19
#servicemag  clearstatus 1 19
#servicemag resume 1 19

that didnt work  , still got :

Failed --

giving up after 101 attempt

servicemag resume 1 19 -- Failed

waiting on answer from HPE support   on what is the next step.

[veeyarvi]

Hi Luke,

Thank you. I beleive the support will take care of it further.

You may private message me the case ID if you want me to follow this up.