shadow cost

[John Eerenberg]

for a fibre channel san environment (using dark fibre) and an OpenVMS disaster tolerant cluster both seperated by roughly 10 miles, what values and when would I set the shadow sets for $ set shadow/read_cost. Assume seven 2member shadow sets.

[Robert Brooks_1]

The algorithm used by shadowing to determine which member to read is quite simple -- for each member determine the sum of the read cost and queue length. Read from whichever member has the lowest sum.

If you set the "remote" member to the highest possible read cost value, it'll only be read from if the "local" member is not available.

You can, of course, set a much lower read cost on the remote member and get similar behaviour if the queue length on the "local" member does not get too high.

You can the sample queue length for any device by using $GETDVI with the QLEN item code.

-- Rob

[Robert Gezelter]

John,

A question and a thought. Is this a shadowset of mirrored volumes.

If it is not, it is well worth considering. If you lose the fiber link, you will also lose your protection against HDA failure. Remember, the corrolary to Murphy's law states that "HDAs only fail when the DR site is inaccessible".

- Bob Gezelter, http://www.rlgsc.com

[John Eerenberg]

Each DGA device has a RAID1 behind the scenes. :)

So what are practical values if one wants to localize more then half of the read IO (I know it is app dependent)? Are there guidelines when to localize read IO?

Perhaps the following would work if I want to keep a read queue depth less then one local? Or do the default /read_costs already give me this?

DSA35 has $1$dga1 and $1$dga101.
Node A and EVA4000 A are in datacenter A with $1$dga1.
Node B and EVA4000 B are in datacenter B with $1$dga101.

NodeA$ Set Shadow/read_cost=2 $1$dga1
NodeA$ Set Shadow/read_cost=3 $1$dga101

On the other node
NodeB$ Set Shadow/read_cost=3 $1$dga1
NodeB$ Set Shadow/read_cost=2 $1$dga101

[Volker Halle]

John,

the default read cost algorithm helps, if the system can identify which device is local vs. remote. In case of a FC SAN disk, this is not possible, so you might want to help shadowing with the SET DEVICE/SITE algorithm.

Volker.

[John Eerenberg]

I guess I am trying to get a handle on whether or not the defaults are good enough *or* should I force keeping some/most of the read traffic local to a given datacenter.

Thoughts anyone?

[Jan van den Ende · Accepted solution]

John,

consider the speed of light trough glass: about 200.000 KM/sec, or 5 usec / km
Round trip = 20 KM = 0.1 msec extra latency (assuming the same components in the circuitry to local vs remote).
I very much doubt if that will be significant.
OTOH, IF extra switches or whatever are involved, find out THEIR latency, and calculate again.

hth

Proost (maybe in May in Nashua?).

jpe

[Thomas Ritter]

John, why set any values ? We run a DT cluster which is completely symetric. Same work mix at both sites. Exact same configuration at both sites. Online sessions are exactly split, batch more or less.

Thomas

[Wim Van den Wyngaert]

We define in sylogicals a logical defining the site (def/sys ING_SITE SITE1). Different for each site of course.

After the mount of the shadow set, we do a set device/site=f$tr("ing_site") for the shadow set (so, each building gets its own site for the complete shadow set).

Then for each disk of the shadow set, we do a set dev/site=x with x is being the site where the disk is located.

Normally I would expect no big performance gain unless you only have FDDI between the 2 sites without FC (FDDI is much slower than FC). We do ...

Wim

[Ian Miller.]

Use the site settings as described by Jan and then VMS can tell which are local and which are remote and do the right thing. Reads will then mostly be from the local member disks at each sites.

See Host Base Volume Shadowing in action presentation at
http://www2.openvms.org/kparris/