topic Re: UCX small buffer depletion in Operating System - OpenVMS

UCX small buffer depletion

Bill Hill_1 — Mon, 28 Mar 2005 11:37:16 GMT

In the past we had problems depleting UCX small buffers, then the problem mysteriously disappeared. Peak small buffer usage on one of our VMS servers has been 668 for over a month, with current usage fluctuating somewhere below that number. Last Thursday morning (I check this every morning) it was suddenly up to 1763 (max is 1800). I stopped and restarted UCX and by late afternoon small buffer usage was only up to 287. It became a problem again over the weekend causing the on-call person to stop and restart UCX several times. When I came in this morning I checked the status and small buffer usage was at 963 peak. That was about 8:15 am. Now small buffers are at 1047 peak and 1039 current. Most of those seem to be used for routing, 839. The server is running VMS ver. 6.2, we can't upgrade due to some applications that corporate runs on the partner on this dual host node pair. What does the "routes" in small buffer usage indicate to me? What causes the redirects and is this my real problem? Is there a configuration change I can make that will help alleviate this problem? Can the reappearance of this problem be due to network changes made to our WAN?

Re: UCX small buffer depletion

Steve Nimr — Mon, 28 Mar 2005 14:45:43 GMT

Bill,

In a former life the programmers shipped out a new version of the app. Small buffer useage went from 400 to 3500 immediately and steadily increased. I ended up writing a script that increased small buffers by 10% if the current value was within 10% of the max. It won't fix your problem but it could be a workaround.

Re: UCX small buffer depletion

Bill Hill_1 — Mon, 28 Mar 2005 15:04:27 GMT

Similar "patch" to what I am working on. I intended to simply stop and restart UCX when small buffer usage reaches about 90% of max. That would cause brief interuptions for users so I may try your solution instead. Thanks!

Re: UCX small buffer depletion

Bill Hill_1 — Mon, 28 Mar 2005 15:10:38 GMT

Steve, did you ever discover what the cause of the problem was at your facility? I suspect changes corporate in our WAN routing structure but don't know for sure.

Re: UCX small buffer depletion

Steve Nimr — Mon, 28 Mar 2005 16:05:44 GMT

Bill,

The project was an electronic toll system. The developers rolled out an almost totaly re-written application and had changed how the incoming reads were processed. Of course they never conferred with the sysadmin or gave any heads ups notice.

Steve

Re: UCX small buffer depletion

Ian Miller. — Mon, 28 Mar 2005 16:29:58 GMT

I guess this is UCX V4.2 or similar?

Try setting pmtu_enabled = 0
you can do this in UCX$SYSTARTUP.COM
Parhaps by
UCX SET PROTOCOL command or
syconfig -r inet pmtu_enabled=0

with it enabled (=1) you can get a routing entry for every client.

Re: UCX small buffer depletion

Bill Hill_1 — Tue, 29 Mar 2005 10:00:31 GMT

Ian,
Yes, it is UCX 4.2. This sounds like it could be the culprit. How can I see what the current value of "pmtu_enabled" is? I can't find this setting anywhere in UCX?

Re: UCX small buffer depletion

Ian Miller. — Wed, 30 Mar 2005 05:32:40 GMT

with 4.2 I don't know if pmtu is enabled.
Are there lots of routes shown by
UCX SHOW ROUTE
and is dynamic routing (RIP) enabled?

Re: UCX small buffer depletion

Steve Nimr — Wed, 30 Mar 2005 14:29:55 GMT

Bill,

Another thing you can do is modify the sizes of the buffers. I don't have UCX here so this is from memory. But you can set the small buffers to include packets of size n to o, medium buffers from p to q, large buffers r to s. Doing that you could shift the burden from small buffers.

Steve

Re: UCX small buffer depletion

Ian Miller. — Wed, 30 Mar 2005 15:30:45 GMT

Re-reading your question I notice you mention redirects and network changes on your WAN.
Does this mean that your route table is getting lots of dynamically created host routes?
Can you look at the flags on the route table entries shown by SHOW ROUTE and say how many are dynamic and how many are hosts. Since the WAN changes have you modified the static routes on your VMS system to correspond with the changed WAN?

Re: UCX small buffer depletion

Bill Hill_1 — Wed, 30 Mar 2005 15:56:38 GMT

Forgive my ignorance, I have never had to devote this much attention to UCX and I am learning (more than I intended!). I didn't think I should be creating dynamic routes as dynamic routing is turned off. But if I "show comm/mem" I see small buffers used for routes increasing continually. And "sho com/rout" yields the following:

Route statistics

Created by redirects 1193
Modified by redirects 0
Wildcarded lookups 2484

Invalid redirect calls 73
Failed lookups 628
Maximum routes reached 0

So apparently I have not turned off dynamic routing, have I?

I have three static network routes defined, but one of them is 0.0.0.0. This was apparently added by one of our corporate "help desk" people when they and a contractor were reconfiguring the WAN router and LAN switches. I tried removing that network but then I could not connect to the VMS host (my PC is in a different class C). I think this is getting to the heart of the problem, they have not configured our local LAN switch correctly and we can not connect to the VMS host without going through the WAN router which I assume is where all the ICMP redirects are coming from.

Re: UCX small buffer depletion

Ian Miller. — Thu, 31 Mar 2005 04:56:00 GMT

the route to 0.0.0.0 is the the default route.

What does UCX SHOW ROUTE and SHOW ROUTE /PERM
say?

It does sound like your permenant routes need fixinf.

Re: UCX small buffer depletion

Bill Hill_1 — Thu, 31 Mar 2005 09:42:56 GMT

"sho rout" shows 4 routes, one class c, one class B, the default 0.0.0.0, and the host 127.0.0.1

"sho rout/perm" shows only the default of 0.0.0.0

Re: UCX small buffer depletion

Ian Miller. — Thu, 31 Mar 2005 15:24:00 GMT

$ UCX SHOW CONFIG START ROUTING
should tell you if dynamic routing is
enabled.

Re: UCX small buffer depletion

Bill Hill_1 — Thu, 31 Mar 2005 15:46:35 GMT

Dynamic routing is disabled.

$ ucx sho config start routing
%UCX-E-CONFIGERROR, Error processing CONFIGURATION request
-RMS-E-RNF, record not found

(My go-to-guy at corporate had just told me how to check that)

Re: UCX small buffer depletion

Ian Miller. — Thu, 31 Mar 2005 16:08:45 GMT

It appears that UCX is paying attention to redirects even though dynamic routing is off.
Do you know the routers you should be using?
Parhaps the default route should refer to the WAN router and then add specific routes for other subnets on the LAN?

You can add and remove routes in
UCX using the SET ROUTE command without restarting things then add them permenantly (so they get remembered) using SET ROUTE/PERM