re : fail root disk on rx2620

[Vincent_5]

Hi Guys,
Can somone advice how can I recover my root disk coz one of my internal harddisk fail and currently, my server is running on alt boot disk. I have replace and new disk and doesn't know how to sync back the mirroring. Please advice with steps. Urgent!!!

Thanks in advance

Regards
Vincent

[Kent Ostby · Accepted solution]

Two HP document will help.

If its VxVM, use HP document KBRC00014263.

If its LVM, use HP document KBRC00014036.

[Kent Ostby]

Here are the links for the above documents:

http://www1.itrc.hp.com/service/cki/search.do?category=c0&prevQueryString=&mode=id&searchString=KBRC00014263&searchCrit=allwords&docType=EngineerNotes&dateRange=all&search.x=32&search.y=12

http://www1.itrc.hp.com/service/cki/search.do?category=c0&prevQueryString=&mode=id&searchString=KBRC00014036&searchCrit=allwords&docType=EngineerNotes&dateRange=all&search.x=26&search.y=13

[Robert-Jan Goossens]

Hi Vincent,

http://docs.hp.com/en/5991-1236/When_Good_Disks_Go_Bad.pdf

appendix A page 26

Mirroring the Root Volume on Integrity Servers.

Regards,
Robert-Jan

[Ajitkumar Rane]

Vincent

Refere to the link
http://docs.hp.com/en/5991-1236/When_Good_Disks_Go_Bad.pdf

this should help u the resolve the problem.

All the Best.

Rgds,

Ajit

[Andrew Rutter]

vincent,

did your other post not help you?

http://forums1.itrc.hp.com/service/forums/questionanswer.do?threadId=1021762
my post should have given you all the info needed.
Do you get errors when you try and re- mirror the drive?

you have to remember to partition the drive first. Check the dev files for the replaced disk and you will see you have 3 partitions cxtxdxs1, cxtxdxs2 and cxtxdxs3 and then do the vgcfgrestore specifying the s2 option on the drive.


Andy

[Vincent_5]

Hi Andrew,
The other post did not help much coz after doing the steps, I cannot even pvcreate the disk coz is still existing in /etc/lvmtab also, when I do a vgextend /dev/vg00 /dev/dsk/c2t0d0s2 it says is already existing, below is the output from the server, pls advice

Boot Definitions for Volume Group /dev/vg00:
Physical Volumes belonging in Root Volume Group:
/dev/dsk/c2t1d0s2 (0/1/1/0.1.0) -- Boot Disk
/dev/dsk/c2t0d0s2 (0/1/1/0.0.0)
Boot: lvol1 on: /dev/dsk/c2t1d0s2
Root: lvol3 on: /dev/dsk/c2t1d0s2
Swap: lvol2 on: /dev/dsk/c2t1d0s2
Dump: lvol2 on: /dev/dsk/c2t1d0s2, 0

--- Logical volumes ---
LV Name /dev/vg00/lvol8
VG Name /dev/vg00
LV Permission read/write
LV Status available/stale
Mirror copies 1
Consistency Recovery MWC
Schedule parallel
LV Size (Mbytes) 2512
Current LE 157
Allocated PE 314
Stripes 0
Stripe Size (Kbytes) 0
Bad block on
Allocation strict
IO Timeout (Seconds) default

--- Distribution of logical volume ---
PV Name LE on PV PE on PV
/dev/dsk/c2t1d0s2 157 157
/dev/dsk/c2t0d0s2 157 157

--- Logical extents ---
LE PV1 PE1 Status 1 PV2 PE2
Status 2
00000 /dev/dsk/c2t1d0s2 01165 current /dev/dsk/c2t0d0s2 01165
stale
00001 /dev/dsk/c2t1d0s2 01166 current /dev/dsk/c2t0d0s2 01166
stale
00002 /dev/dsk/c2t1d0s2 01167 current /dev/dsk/c2t0d0s2 01167
stale
00003 /dev/dsk/c2t1d0s2 01168 current /dev/dsk/c2t0d0s2 01168
stale
00004 /dev/dsk/c2t1d0s2 01169 current /dev/dsk/c2t0d0s2 01169
stale
00005 /dev/dsk/c2t1d0s2 01170 current /dev/dsk/c2t0d0s2 01170
stale
00006 /dev/dsk/c2t1d0s2 01171 current /dev/dsk/c2t0d0s2 01171
stale
00007 /dev/dsk/c2t1d0s2 01172 current /dev/dsk/c2t0d0s2 01172
stale
00008 /dev/dsk/c2t1d0s2 01173 current /dev/dsk/c2t0d0s2 01173
stale
00009 /dev/dsk/c2t1d0s2 01174 current /dev/dsk/c2t0d0s2 01174
current
00010 /dev/dsk/c2t1d0s2 01175 current /dev/dsk/c2t0d0s2 01175
current
00011 /dev/dsk/c2t1d0s2 01176 current /dev/dsk/c2t0d0s2 01176
current
00012 /dev/dsk/c2t1d0s2 01177 current /dev/dsk/c2t0d0s2 01177
current
00013 /dev/dsk/c2t1d0s2 01178 current /dev/dsk/c2t0d0s2 01178
current
00014 /dev/dsk/c2t1d0s2 01179 current /dev/dsk/c2t0d0s2 01179
current
00015 /dev/dsk/c2t1d0s2 01180 current /dev/dsk/c2t0d0s2 01180
current
00016 /dev/dsk/c2t1d0s2 01181 current /dev/dsk/c2t0d0s2 01181
current
00017 /dev/dsk/c2t1d0s2 01182 current /dev/dsk/c2t0d0s2 01182
current
00018 /dev/dsk/c2t1d0s2 01183 current /dev/dsk/c2t0d0s2 01183
current
00019 /dev/dsk/c2t1d0s2 01184 current /dev/dsk/c2t0d0s2 01184
current
00020 /dev/dsk/c2t1d0s2 01185 current /dev/dsk/c2t0d0s2 01185
current
00021 /dev/dsk/c2t1d0s2 01186 current /dev/dsk/c2t0d0s2 01186
current
00022 /dev/dsk/c2t1d0s2 01187 current /dev/dsk/c2t0d0s2 01187
current
00023 /dev/dsk/c2t1d0s2 01188 current /dev/dsk/c2t0d0s2 01188
current
00024 /dev/dsk/c2t1d0s2 01189 current /dev/dsk/c2t0d0s2 01189
current
00025 /dev/dsk/c2t1d0s2 01190 current /dev/dsk/c2t0d0s2 01190
current
00026 /dev/dsk/c2t1d0s2 01191 current /dev/dsk/c2t0d0s2 01191
current
00027 /dev/dsk/c2t1d0s2 01192 current /dev/dsk/c2t0d0s2 01192
current
00028 /dev/dsk/c2t1d0s2 01193 current /dev/dsk/c2t0d0s2 01193
current
00029 /dev/dsk/c2t1d0s2 01194 current /dev/dsk/c2t0d0s2 01194
current
00030 /dev/dsk/c2t1d0s2 01195 current /dev/dsk/c2t0d0s2 01195
current
00031 /dev/dsk/c2t1d0s2 01196 current /dev/dsk/c2t0d0s2 01196
current
00032 /dev/dsk/c2t1d0s2 01197 current /dev/dsk/c2t0d0s2 01197
current
00033 /dev/dsk/c2t1d0s2 01198 current /dev/dsk/c2t0d0s2 01198
current
00034 /dev/dsk/c2t1d0s2 01199 current /dev/dsk/c2t0d0s2 01199
current
00035 /dev/dsk/c2t1d0s2 01200 current /dev/dsk/c2t0d0s2 01200
current
00036 /dev/dsk/c2t1d0s2 01201 current /dev/dsk/c2t0d0s2 01201
current
00037 /dev/dsk/c2t1d0s2 01202 current /dev/dsk/c2t0d0s2 01202
current
00038 /dev/dsk/c2t1d0s2 01203 current /dev/dsk/c2t0d0s2 01203
current
00039 /dev/dsk/c2t1d0s2 01204 current /dev/dsk/c2t0d0s2 01204
current
00040 /dev/dsk/c2t1d0s2 01205 current /dev/dsk/c2t0d0s2 01205
current
00041 /dev/dsk/c2t1d0s2 01206 current /dev/dsk/c2t0d0s2 01206
current
00042 /dev/dsk/c2t1d0s2 01207 current /dev/dsk/c2t0d0s2 01207
current
00043 /dev/dsk/c2t1d0s2 01208 current /dev/dsk/c2t0d0s2 01208
current
00044 /dev/dsk/c2t1d0s2 01209 current /dev/dsk/c2t0d0s2 01209
current
00045 /dev/dsk/c2t1d0s2 01210 current /dev/dsk/c2t0d0s2 01210
current
00046 /dev/dsk/c2t1d0s2 01211 current /dev/dsk/c2t0d0s2 01211
current
00047 /dev/dsk/c2t1d0s2 01212 current /dev/dsk/c2t0d0s2 01212
current
00048 /dev/dsk/c2t1d0s2 01213 current /dev/dsk/c2t0d0s2 01213
current
00049 /dev/dsk/c2t1d0s2 01214 current /dev/dsk/c2t0d0s2 01214
current
00050 /dev/dsk/c2t1d0s2 01215 current /dev/dsk/c2t0d0s2 01215
current
00051 /dev/dsk/c2t1d0s2 01216 current /dev/dsk/c2t0d0s2 01216
current
00052 /dev/dsk/c2t1d0s2 01217 current /dev/dsk/c2t0d0s2 01217
current
00053 /dev/dsk/c2t1d0s2 01218 current /dev/dsk/c2t0d0s2 01218
current
00054 /dev/dsk/c2t1d0s2 01219 current /dev/dsk/c2t0d0s2 01219
current
00055 /dev/dsk/c2t1d0s2 01220 current /dev/dsk/c2t0d0s2 01220
current
00056 /dev/dsk/c2t1d0s2 01221 current /dev/dsk/c2t0d0s2 01221
current
00057 /dev/dsk/c2t1d0s2 01222 current /dev/dsk/c2t0d0s2 01222
current
00058 /dev/dsk/c2t1d0s2 01223 current /dev/dsk/c2t0d0s2 01223
current
00059 /dev/dsk/c2t1d0s2 01224 current /dev/dsk/c2t0d0s2 01224
current
00060 /dev/dsk/c2t1d0s2 01225 current /dev/dsk/c2t0d0s2 01225
current
00061 /dev/dsk/c2t1d0s2 01226 current /dev/dsk/c2t0d0s2 01226
current
00062 /dev/dsk/c2t1d0s2 01227 current /dev/dsk/c2t0d0s2 01227
current
00063 /dev/dsk/c2t1d0s2 01228 current /dev/dsk/c2t0d0s2 01228
current
00064 /dev/dsk/c2t1d0s2 01229 current /dev/dsk/c2t0d0s2 01229
current
00065 /dev/dsk/c2t1d0s2 01230 current /dev/dsk/c2t0d0s2 01230
current
00066 /dev/dsk/c2t1d0s2 01231 current /dev/dsk/c2t0d0s2 01231
current
00067 /dev/dsk/c2t1d0s2 01232 current /dev/dsk/c2t0d0s2 01232
current
00068 /dev/dsk/c2t1d0s2 01233 current /dev/dsk/c2t0d0s2 01233
current
00069 /dev/dsk/c2t1d0s2 01234 current /dev/dsk/c2t0d0s2 01234
current
00070 /dev/dsk/c2t1d0s2 01235 current /dev/dsk/c2t0d0s2 01235
current
00071 /dev/dsk/c2t1d0s2 01236 current /dev/dsk/c2t0d0s2 01236
current
00072 /dev/dsk/c2t1d0s2 01237 current /dev/dsk/c2t0d0s2 01237
current
00073 /dev/dsk/c2t1d0s2 01238 current /dev/dsk/c2t0d0s2 01238
stale
00074 /dev/dsk/c2t1d0s2 01239 current /dev/dsk/c2t0d0s2 01239
stale
00075 /dev/dsk/c2t1d0s2 01240 current /dev/dsk/c2t0d0s2 01240
stale
00076 /dev/dsk/c2t1d0s2 01241 current /dev/dsk/c2t0d0s2 01241
current
00077 /dev/dsk/c2t1d0s2 01242 current /dev/dsk/c2t0d0s2 01242
stale
00078 /dev/dsk/c2t1d0s2 01243 current /dev/dsk/c2t0d0s2 01243
stale
00079 /dev/dsk/c2t1d0s2 01244 current /dev/dsk/c2t0d0s2 01244
current
00080 /dev/dsk/c2t1d0s2 01245 current /dev/dsk/c2t0d0s2 01245
current
00081 /dev/dsk/c2t1d0s2 01246 current /dev/dsk/c2t0d0s2 01246
current
00082 /dev/dsk/c2t1d0s2 01247 current /dev/dsk/c2t0d0s2 01247
current
00083 /dev/dsk/c2t1d0s2 01248 current /dev/dsk/c2t0d0s2 01248
current
00084 /dev/dsk/c2t1d0s2 01249 current /dev/dsk/c2t0d0s2 01249
current
00085 /dev/dsk/c2t1d0s2 01250 current /dev/dsk/c2t0d0s2 01250
current
00086 /dev/dsk/c2t1d0s2 01251 current /dev/dsk/c2t0d0s2 01251
current
00087 /dev/dsk/c2t1d0s2 01252 current /dev/dsk/c2t0d0s2 01252
current
00088 /dev/dsk/c2t1d0s2 01253 current /dev/dsk/c2t0d0s2 01253
current
00089 /dev/dsk/c2t1d0s2 01254 current /dev/dsk/c2t0d0s2 01254
stale
00090 /dev/dsk/c2t1d0s2 01255 current /dev/dsk/c2t0d0s2 01255
stale
00091 /dev/dsk/c2t1d0s2 01256 current /dev/dsk/c2t0d0s2 01256
current
00092 /dev/dsk/c2t1d0s2 01257 current /dev/dsk/c2t0d0s2 01257
stale
00093 /dev/dsk/c2t1d0s2 01258 current /dev/dsk/c2t0d0s2 01258
current
00094 /dev/dsk/c2t1d0s2 01259 current /dev/dsk/c2t0d0s2 01259
current
00095 /dev/dsk/c2t1d0s2 01260 current /dev/dsk/c2t0d0s2 01260
current
00096 /dev/dsk/c2t1d0s2 01261 current /dev/dsk/c2t0d0s2 01261
current
00097 /dev/dsk/c2t1d0s2 01262 current /dev/dsk/c2t0d0s2 01262
current
00098 /dev/dsk/c2t1d0s2 01263 current /dev/dsk/c2t0d0s2 01263
current
00099 /dev/dsk/c2t1d0s2 01264 current /dev/dsk/c2t0d0s2 01264
stale
00100 /dev/dsk/c2t1d0s2 01265 current /dev/dsk/c2t0d0s2 01265
stale
00101 /dev/dsk/c2t1d0s2 01266 current /dev/dsk/c2t0d0s2 01266
current
00102 /dev/dsk/c2t1d0s2 01267 current /dev/dsk/c2t0d0s2 01267
stale
00103 /dev/dsk/c2t1d0s2 01268 current /dev/dsk/c2t0d0s2 01268
stale
00104 /dev/dsk/c2t1d0s2 01269 current /dev/dsk/c2t0d0s2 01269
current
00105 /dev/dsk/c2t1d0s2 01270 current /dev/dsk/c2t0d0s2 01270
current
00106 /dev/dsk/c2t1d0s2 01271 current /dev/dsk/c2t0d0s2 01271
current
00107 /dev/dsk/c2t1d0s2 01272 current /dev/dsk/c2t0d0s2 01272
current
00108 /dev/dsk/c2t1d0s2 01273 current /dev/dsk/c2t0d0s2 01273
current
00109 /dev/dsk/c2t1d0s2 01274 current /dev/dsk/c2t0d0s2 01274
stale
00110 /dev/dsk/c2t1d0s2 01275 current /dev/dsk/c2t0d0s2 01275
current
00111 /dev/dsk/c2t1d0s2 01276 current /dev/dsk/c2t0d0s2 01276
current
00112 /dev/dsk/c2t1d0s2 01277 current /dev/dsk/c2t0d0s2 01277
current
00113 /dev/dsk/c2t1d0s2 01278 current /dev/dsk/c2t0d0s2 01278
current
00114 /dev/dsk/c2t1d0s2 01279 current /dev/dsk/c2t0d0s2 01279
stale
00115 /dev/dsk/c2t1d0s2 01280 current /dev/dsk/c2t0d0s2 01280
current
00116 /dev/dsk/c2t1d0s2 01281 current /dev/dsk/c2t0d0s2 01281
current
00117 /dev/dsk/c2t1d0s2 01282 current /dev/dsk/c2t0d0s2 01282
current
00118 /dev/dsk/c2t1d0s2 01283 current /dev/dsk/c2t0d0s2 01283
current
00119 /dev/dsk/c2t1d0s2 01284 current /dev/dsk/c2t0d0s2 01284
current
00120 /dev/dsk/c2t1d0s2 01285 current /dev/dsk/c2t0d0s2 01285
current
00121 /dev/dsk/c2t1d0s2 01286 current /dev/dsk/c2t0d0s2 01286
current
00122 /dev/dsk/c2t1d0s2 01287 current /dev/dsk/c2t0d0s2 01287
current
00123 /dev/dsk/c2t1d0s2 01288 current /dev/dsk/c2t0d0s2 01288
current
00124 /dev/dsk/c2t1d0s2 01289 current /dev/dsk/c2t0d0s2 01289
current
00125 /dev/dsk/c2t1d0s2 01290 current /dev/dsk/c2t0d0s2 01290
current
00126 /dev/dsk/c2t1d0s2 01291 current /dev/dsk/c2t0d0s2 01291
current
00127 /dev/dsk/c2t1d0s2 01292 current /dev/dsk/c2t0d0s2 01292
current
00128 /dev/dsk/c2t1d0s2 01293 current /dev/dsk/c2t0d0s2 01293
current
00129 /dev/dsk/c2t1d0s2 01294 current /dev/dsk/c2t0d0s2 01294
current
00130 /dev/dsk/c2t1d0s2 01295 current /dev/dsk/c2t0d0s2 01295
current
00131 /dev/dsk/c2t1d0s2 01296 current /dev/dsk/c2t0d0s2 01296
current
00132 /dev/dsk/c2t1d0s2 01297 current /dev/dsk/c2t0d0s2 01297
current
00133 /dev/dsk/c2t1d0s2 01298 current /dev/dsk/c2t0d0s2 01298
current
00134 /dev/dsk/c2t1d0s2 01299 current /dev/dsk/c2t0d0s2 01299
current
00135 /dev/dsk/c2t1d0s2 01300 current /dev/dsk/c2t0d0s2 01300
current
00136 /dev/dsk/c2t1d0s2 01301 current /dev/dsk/c2t0d0s2 01301
current
00137 /dev/dsk/c2t1d0s2 01302 current /dev/dsk/c2t0d0s2 01302
current
00138 /dev/dsk/c2t1d0s2 01303 current /dev/dsk/c2t0d0s2 01303
current
00139 /dev/dsk/c2t1d0s2 01304 current /dev/dsk/c2t0d0s2 01304
current
00140 /dev/dsk/c2t1d0s2 01305 current /dev/dsk/c2t0d0s2 01305
current
00141 /dev/dsk/c2t1d0s2 01306 current /dev/dsk/c2t0d0s2 01306
current
00142 /dev/dsk/c2t1d0s2 01307 current /dev/dsk/c2t0d0s2 01307
current
00143 /dev/dsk/c2t1d0s2 01308 current /dev/dsk/c2t0d0s2 01308
current
00144 /dev/dsk/c2t1d0s2 01309 current /dev/dsk/c2t0d0s2 01309
current
00145 /dev/dsk/c2t1d0s2 01310 current /dev/dsk/c2t0d0s2 01310
current
00146 /dev/dsk/c2t1d0s2 01311 current /dev/dsk/c2t0d0s2 01311
current
00147 /dev/dsk/c2t1d0s2 01312 current /dev/dsk/c2t0d0s2 01312
current
00148 /dev/dsk/c2t1d0s2 01313 current /dev/dsk/c2t0d0s2 01313
current
00149 /dev/dsk/c2t1d0s2 01314 current /dev/dsk/c2t0d0s2 01314
current
00150 /dev/dsk/c2t1d0s2 01315 current /dev/dsk/c2t0d0s2 01315
current
00151 /dev/dsk/c2t1d0s2 01316 current /dev/dsk/c2t0d0s2 01316
current
00152 /dev/dsk/c2t1d0s2 01317 current /dev/dsk/c2t0d0s2 01317
current
00153 /dev/dsk/c2t1d0s2 01318 current /dev/dsk/c2t0d0s2 01318
current
00154 /dev/dsk/c2t1d0s2 01319 current /dev/dsk/c2t0d0s2 01319
current
00155 /dev/dsk/c2t1d0s2 01320 current /dev/dsk/c2t0d0s2 01320
current
00156 /dev/dsk/c2t1d0s2 01321 current /dev/dsk/c2t0d0s2 01321
current


Regards
Vincent

[Andrew Rutter]

Vincent,

there should be no need for pvcreate disk or vgextend if the disk was mirrored.

doing the vgcfgrestore, vgchange and vgsync should be enough, followed by the lvlnboot to update the BDRA label.

This should restore the config back to the disk and re-miror the lvolv's

if you have to you may need to do
#pvchange -a N /dev/dsk/cxtxdx

but normally remove failed disk and leave for 2 mins then reinsert new disk.
full ioscan
insf for dev files for replaced disk

then partition disk and continue with vgcfgrestore and so on.

Andy

[Vincent_5]

Hi Andrew,
Appreciate your support, actually this disk a alt boot disk and is mirror to the root disk. But, after doing vgcfgrestore it doesn't restore the configuration for the vg. and apparently I cannot activate the vg as the server is still life and running. The steps perform is without shutdowning down the server. Kindly advice??

Regards
Vincent

[Robert-Jan Goossens]

Vincent,

The rx2620 is an itanium system, you can not use the plain HPUX 11.11 lvm commands to restore/sync your mirror.

Title: Replace failed root and non-root LVM disks on Itanium.
Document ID: KBRC00014036
Last Modified Date: 8/3/05

http://www2.itrc.hp.com/service/cki/docDisplay.do?docLocale=en_US&docId=200000079971585

Regards,
Robert-Jan

[Torsten.]

What error message vgcfgrestore gives you?

If it sounds like

vgcfgrestore: Cannot restore Physical Volume "/dev/dsk/c0t6d0",
Detach the PV or detactivate the VG, before restoring the PV.


the phrase "detactivate the VG" is the key.

In this case you need to
pvchange -a n ...
(replace disk and follow Andrews document)
vgcfgrestore ...
pvchange -a y ...

Just read "when good disks go bad".

[Andrew Rutter]

vincent,

if the disk is still showing as in attached state then you may need to lvreduce the mirror prior to doing the cfgvgrestore

example

#lvreduce -m 0 -A n /dev/vg00/lvolx cxtxdx

do this on all lvols in the root mirror first.

check page 13 in the good disks go bad doc mentioned earlier.

Andy

[Vincent_5]

Hi Guys,
Thanks for all your support, I manage to solve the problem. Is working fine now.

Actually when I run command lvdisplay -v /dev/vg00/lvolx the output shows

--- Distribution of logical volume ---
PV Name LE on PV PE on PV
/dev/dsk/c2t1d0s2 157 157
/dev/dsk/c2t0d0s2 157 157

--- Logical extents ---
LE PV1 PE1 Status 1 PV2 PE2
Status 2
00000 /dev/dsk/c2t1d0s2 01165 current /dev/dsk/c2t0d0s2 01165
stale
00001 /dev/dsk/c2t1d0s2 01166 current /dev/dsk/c2t0d0s2 01166
stale
00002 /dev/dsk/c2t1d0s2 01167 current /dev/dsk/c2t0d0s2 01167
stale
00003 /dev/dsk/c2t1d0s2 01168 current /dev/dsk/c2t0d0s2 01168
stale

it is already saying part of the mirror is already not right.

To resolve this,

I run command ivreduce -m 0 -A n /dev/vg00/lvol* /dev/dsk/c2t0d0s2
reduce the mirroring for all the lvol
next I use vgreduce /dev/vg00 /dev/dsk/c2t0d0s2 to remove the disk from /etc/lvmtab

and finally i do a vgextend to vg00
than a lvextend -m 1 to mirror back all the lvol
and last lvlnboot -R to link the boot disk
and last setboot -a and is resolve.
Thanks again :-) I have learn alot

Regards
Vincent