1855316 Members
58826 Online
104109 Solutions
New Discussion

NFS not responding

 
Jon Mattatall
Esteemed Contributor

NFS not responding

Hi there - A devil of a time to get this through today!!!

I have a K370,11.00, 6 Oracle 8.0.5 instances.
A CD was mounted with the usual:
/usr/sbin/pfsd &
/usr/sbin/pfs_mountd &
/usr/sbin/pfs_mount /cdrom
and left mounted, it seems.

Backup fails, hangs. I could still see the process 6-7 hours later, Oracle down, etc.
Logfile indicates it hung on a bdf. Shell now hangs on a bdf, cd /cdrom, etc. with the error:
NFS server svxxxxxx not responding still trying

I understand there's an issue with pfsd or pfs_mountd dying (or being killed)that does this.
I plan to reboot this tonight at midnight(prod box). I also need to change the kernel. Will
cp /stand/vmunix /stand/plsgodno
cp /stand/system /stand/saveme
vi /stand/system (make changes)
mk_kernel -s /stand/system -o /stand/vmunix
/sbin/init.d/oracle stop
umountall -l
sync
sync
sync
reboot

Will this work? I want to avoid shutdown (and the init.d scripts) for fear of a hang.
If Oracle hangs, I will:
su - oracle
ORACLE_SID=dbname
svrmgrl
connect internal
shutdown immediate (or abort if I must)

for each instance.
Is this good practice, or have I missed anything? I cannot mount/unmount the CD
currently, so this is the "safest" thing I can come up with.

8 hours and counting,
Jon
A little knowledge is dangerous - none is absolutely terrifying!!!
4 REPLIES 4
harry d brown jr
Honored Contributor

Re: NFS not responding

Jon,

We probably missed you somehow, anyways, your plan looks good.

I'm also assuming you have 11/64 and not the 11/32, right? Also, I'd like to suggest that you check to make sure you have the latest patches by using the "custom patch manager".


live free or die
harry
Live Free or Die
Bill Hassell
Honored Contributor

Re: NFS not responding

PFS uses NFS and I would not recommend leaving PFS running on a production server. bdf (and logins and a bunch of other things) will hang on NFS mountpoints (aka, PFS too) when things go wrong. If you need PFS, put it on another, less critical system, or use it then bring it back down when you are done.

Another technique is to copy the entire Oracle CD to a hard disk, then export the copy via NFS, again recognizing that NFS can (will) cause hangs due to hundreds of networking and patch issues.


Bill Hassell, sysadmin
Tom Geudens
Honored Contributor

Re: NFS not responding

Hi,
The following sometimes works.
- Kill the pfs-daemons in reverse order (if
they are still running).
- rpcbind -w

This gets you out of the pfs troubles
sometimes ... if that doesn't work ...
reboot :-(

Tom Geudens

A life ? Cool ! Where can I download one of those from ?
Jon Mattatall
Esteemed Contributor

Re: NFS not responding

Thanks, all.
Worked like a charm.
Harry - HPUX64bit, Oracle 32bit (dba's like it that way,
even for 8.1.6). The patches to be installed are determined
by those much further up the food chain than I...
Bill - Yes, I see that now. It's not the type of thing I'll do twice.
Tom - I didn't get to try it, but the pfs deamons were
zombied out - no kill. I'd like to say I'll never get the
chance to try it, but that's just begging for disaster.

Jon
A little knowledge is dangerous - none is absolutely terrifying!!!