topic Re: Slow boot after mirroring in Operating System - HP-UX

Slow boot after mirroring

Luigi Berengan — Wed, 14 Apr 2004 07:28:58 GMT

In relationship to my problem I have not received a true solution.
--------------------------------------------
Hi,
I mirrored the system (vg00) to another disk.
when I try to boot from the new disk,
the console print :

HARD Booted.

ISL Revision A.00.43 APR 12, 2000

ISL booting hpux

Boot
: disk(0/12/0/0.6.16.0.0.1.3;0)/stand/vmunix

and then the system sleep 10 minutes.

After boot right.

Could you tell me why ?

Thank you very much
---------------------------------------------
Now I send other information :
1) I am booting from SAN (EMC Symmetrix)
2) The boot is slow only from the alternate path (mirrored disk - 0/12/0/0.6.16.0.0.1.3)
3) The output fron lvlnboot -v is :

lvlnboot -v
Current path "/dev/dsk/c4t1d3" is an alternate link, skip.
Boot Definitions for Volume Group /dev/vg00:
Physical Volumes belonging in Root Volume Group:
/dev/dsk/c6t1d3 (0/12/0/0.6.16.0.0.1.3) -- Boot Disk
/dev/dsk/c4t1d3 (0/10/0/0.5.16.0.0.1.3) -- Boot Disk
Boot: lvol1 on: /dev/dsk/c6t1d3
/dev/dsk/c4t1d3
Root: lvol3 on: /dev/dsk/c6t1d3
/dev/dsk/c4t1d3
Swap: lvol2 on: /dev/dsk/c6t1d3
/dev/dsk/c4t1d3
Dump: lvol2 on: /dev/dsk/c6t1d3, 0

Current path "/dev/dsk/c6t1d4" is an alternate link, skip.
---------------------------------------------

Re: Slow boot after mirroring

Massimo Bianchi — Wed, 14 Apr 2004 09:34:16 GMT

Hi,
i think it could be a problem of mirroring of the swap.

Could you post a "lvdisplay -v" for each of your swap device, cutting out the physical layout ?

Best regards,
Massimo

Re: Slow boot after mirroring

Luigi Berengan — Wed, 14 Apr 2004 09:57:45 GMT

Here the output of the vgdisplay and lvdisplay
I remeber you that the boot disk is not mirrored but is single and seen from two path

Thank you

Luigi

Re: Slow boot after mirroring

Todd McDaniel_1 — Wed, 14 Apr 2004 09:58:51 GMT

Post the commands you used to create the other boot disk...

Booting from the SAN is going to be very slow no matter what.

If you can get that boot disk back to the host, I would recommend it highly. The time could come where you cant boot b/c your fiber is down for some reason after a primary boot disk failure.

Re: Slow boot after mirroring

Massimo Bianchi — Wed, 14 Apr 2004 10:05:48 GMT

Hi,
you said:

mirrored the system (vg00) to another disk

please , can you tell us if you mirrored it or not ?

Massimo

Re: Slow boot after mirroring

Luigi Berengan — Wed, 14 Apr 2004 10:08:21 GMT

pvcreate -f /dev/rdsk/c6t1d3
pvcreate -B /dev/rdsk/c6t1d3
mkboot -l /dev/dsk/c6t1d3
mkboot -a "hpux -lq (;0)/stand/vmunix" /dev/rdsk/c6t1d3

vgextend /dev/vg00 /dev/dsk/c6t1d3

lvextend -m 1 /dev/vg00/lvol3 /dev/dsk/c6t1d3
lvextend -m 1 /dev/vg00/lvol2 /dev/dsk/c6t1d3
lvextend -m 1 /dev/vg00/lvol1 /dev/dsk/c6t1d3
lvextend -m 1 /dev/vg00/lvol8 /dev/dsk/c6t1d3
lvextend -m 1 /dev/vg00/lvol7 /dev/dsk/c6t1d3
lvextend -m 1 /dev/vg00/lvol6 /dev/dsk/c6t1d3
lvextend -m 1 /dev/vg00/lvol5 /dev/dsk/c6t1d3
lvextend -m 1 /dev/vg00/lvol4 /dev/dsk/c6t1d3

lvreduce -m 0 /dev/vg00/lvol3 /dev/dsk/c4t0d1
lvreduce -m 0 /dev/vg00/lvol2 /dev/dsk/c4t0d1
lvreduce -m 0 /dev/vg00/lvol1 /dev/dsk/c4t0d1
lvreduce -m 0 /dev/vg00/lvol8 /dev/dsk/c4t0d1
lvreduce -m 0 /dev/vg00/lvol7 /dev/dsk/c4t0d1
lvreduce -m 0 /dev/vg00/lvol6 /dev/dsk/c4t0d1
lvreduce -m 0 /dev/vg00/lvol5 /dev/dsk/c4t0d1
lvreduce -m 0 /dev/vg00/lvol4 /dev/dsk/c4t0d1

vgreduce /dev/vg00 /dev/dsk/c4t0d1 # Original system

vgextend /dev/vg00 /dev/dsk/c4t1d3 # Alternate path

Re: Slow boot after mirroring

Luigi Berengan — Wed, 14 Apr 2004 10:16:07 GMT

Ok,
excure me.
I have the system in a local disk, my target is transfer the system to a remore LUN disk.

the steps are :

1) mirror the local disk to remote LUN disk
2) reduce the local disk
3) add the alternate path to remote disk.

Above you can see the commands used to do that.

Thank you in advance

p.s.: Di dove sei Massimo ?

Re: Slow boot after mirroring

Massimo Bianchi — Wed, 14 Apr 2004 10:20:34 GMT

Hi,
i'm from Milan (Italy).

So,
you are going to remotize the vg00, and use only the fc disk, right ?

Did you try exchaning primary and alternate boot path, with the command "setboot" ?

Is there any error on the fc card of the alternate path? You can check with

fcmsutil /dev/tdXXX

where XXX is the hba of your fc. Maybe it's only a faulty card..

Massimo

Re: Slow boot after mirroring

Luigi Berengan — Wed, 14 Apr 2004 10:31:50 GMT

Yes, I am remotig the system.
I exchanged the primary with the secondary,
but the boot is slow always from path 0/12/0/0
In runtime, I did a test of disk performance changing the primary with the alternate using:
vgreduce /dev/vg00/ /dev/dsk/c6t1d3
vgextend /dev/vg00/ /dev/dsk/c6t1d3
but I obtainet the same througput (10 mb/sec)
I sed you the output of the commando
setboot
fcmsutil /dev/td0
fcmsutil /dev/td1
----------------------------------
root@hprp01 /> setboot
Primary bootpath : 0/10/0/0.5.16.0.0.0.1
Alternate bootpath : 0/12/0/0.6.16.0.0.0.1

Autoboot is ON (enabled)
Autosearch is ON (enabled)

root@hprp01 /> fcmsutil /dev/td0

Vendor ID is = 0x00103c
Device ID is = 0x001029
XL2 Chip Revision No is = 2.2
PCI Sub-system Vendor ID is = 0x00103c
PCI Sub-system ID is = 0x00128c
Topology = PTTOPT_FABRIC
Link Speed = 1Gb
Local N_Port_id is = 0x051100
N_Port Node World Wide Name = 0x50060b000011223f
N_Port Port World Wide Name = 0x50060b000011223e
Driver state = ONLINE
Hardware Path is = 0/10/0/0
Number of Assisted IOs = 112272
Number of Active Login Sessions = 1
Dino Present on Card = NO
Maximum Frame Size = 960
Driver Version = @(#) PATCH_11.11: libtd.a : Jun 28 2002, 11:08:35, PHSS_26799

root@hprp01 /> fcmsutil /dev/td1

Vendor ID is = 0x00103c
Device ID is = 0x001029
XL2 Chip Revision No is = 2.2
PCI Sub-system Vendor ID is = 0x00103c
PCI Sub-system ID is = 0x00128c
Topology = PTTOPT_FABRIC
Link Speed = 1Gb
Local N_Port_id is = 0x061100
N_Port Node World Wide Name = 0x50060b000011224f
N_Port Port World Wide Name = 0x50060b000011224e
Driver state = ONLINE
Hardware Path is = 0/12/0/0
Number of Assisted IOs = 147613
Number of Active Login Sessions = 1
Dino Present on Card = NO
Maximum Frame Size = 960
Driver Version = @(#) PATCH_11.11: libtd.a : Jun 28 2002, 11:08:35, PHSS_26799

Re: Slow boot after mirroring

Massimo Bianchi — Wed, 14 Apr 2004 10:57:06 GMT

HI,
could you please post

fcmsutil /dev/td0 stat
fcmsutil /dev/td1 stat

output?

Honestly, i do not remember wheter the command should be "... stats", please give it a try.

I want to check if there is an high number of errors in the device.

Anything interesting from "dmesg" ?

Re: Slow boot after mirroring

Luigi Berengan — Wed, 14 Apr 2004 11:11:32 GMT

Here you are:

Re: Slow boot after mirroring

Luigi Berengan — Thu, 15 Apr 2004 04:12:23 GMT

Nobody help me ?

Re: Slow boot after mirroring

Todd McDaniel_1 — Thu, 15 Apr 2004 09:09:36 GMT

HARD Booted.

ISL Revision A.00.43 APR 12, 2000

ISL booting hpux

Boot
: disk(0/12/0/0.6.16.0.0.1.3;0)/stand/vmunix

and then the system sleep 10 minutes.

After boot right.

Could you tell me why ?
__________________________________________________

let me try to sum up your question, correct me where I am wrong.

I see several things here... that can cause the slowness... first, when My box boots I see it stop at the kernel load about 3-5 mins before it boots. So 10 mins from the frame is not that unusual to me. Esp since your frame disks must initialize as mine do wiht PowerPath, you will see some latentcy.

Second, your I/o instead of being local is now going thru your fiber... Depending on your fiber speed, that can slow it down. Is it halfdup or 100fulldup or what?

Third, your system although it has swap on the Local disk half your mirror of vg00 is on a EMC disk.

Fourth, If you have any traffic on that HBA, it is going to bottle neck your mirror syncing while you are trying to initialize those other EMC disks used for DB and other filesystems.

I have /tmp on one box on my EMC frame and I would rather not, but I must for the moment.

_________________________________________________________________
Remind me again, why exactly are you moving vg00 to EMC? can you verbalize that?

Re: Slow boot after mirroring

Luigi Berengan — Thu, 15 Apr 2004 10:25:49 GMT

Hi,
1) from the primary path (0/10/0/0.5.16.0.0.0.1)the box sleep only 1 minute ; from the alternate path (0/12/0/0.6.16.0.0.0.1) the boxsleep 10 minutes

2)the speed via fiber is 1 gigabit full dublex on both path (In runtime, I did a test of disk performance changing the primary with the alternate using:
vgreduce /dev/vg00/ /dev/dsk/c6t1d3
vgextend /dev/vg00/ /dev/dsk/c6t1d3
but I obtainet the same througput (10 mb/sec)
)

3)After the transfer, the system is only on EMC ( I mirrored the local system disk to remote LUN disk, reduced the local disk and add the alternate path to remote disk.

4)On thw switch brocade the traffic is negligible

5) I need the local disk for other use.

Thank you