Operating System - HP-UX
1828668 Members
2032 Online
109984 Solutions
New Discussion

Ioscan failing to FC SAN disks

 
WADE S
Frequent Advisor

Ioscan failing to FC SAN disks

Hoping someone can help.
I was finding my SAN disk devices just fine. I'm not sure if the system had a panic or what exactly, but now when I run ioscan, it only finds the internal hard drives.

I see all kinds of these messages. Is that the problem, and how do I fix it?

0/3/0/0/0/0: Bus Instance number 256 exceeded the maximum allowed instance number.
wsio_claim init failed isc=0xe00000012542cc00 name=fcd_vbus
0/3/0/0/0/0: Bus Instance number 257 exceeded the maximum allowed instance number.
wsio_claim init failed isc=0xe000000124347400 name=fcd_vbus
0/3/0/0/0/0: Bus Instance number 258 exceeded the maximum allowed instance number.
wsio_claim init failed isc=0xe00000012542fc00 name=fcd_vbus
0/3/0/0/0/0: Bus Instance number 259 exceeded the maximum allowed instance number.
wsio_claim init failed isc=0xe00000012542f800 name=fcd_vbus
0/3/0/0/0/0: Bus Instance number 260 exceeded the maximum allowed instance number.
wsio_claim init failed isc=0xe000000125432400 name=fcd_vbus
0/3/0/0/0/0: Bus Instance number 261 exceeded the maximum allowed instance number.
wsio_claim init failed isc=0xe000000125431800 name=fcd_vbus
0/3/0/0/0/0: Bus Instance number 262 exceeded the maximum allowed instance number.
wsio_claim init failed isc=0xe000000125435400 name=fcd_vbus
0/3/0/0/0/0: Bus Instance number 263 exceeded the maximum allowed instance number.
wsio_claim init failed isc=0xe000000125432c00 name=fcd_vbus
0/3/0/0/0/0: Bus Instance number 264 exceeded the maximum allowed instance number.
wsio_claim init failed isc=0xe000000125436800 name=fcd_vbus
0/3/0/0/0/0: Bus Instance number 265 exceeded the maximum allowed instance number.
wsio_claim init failed isc=0xe000000125435c00 name=fcd_vbus
0/3/0/0/0/0: Bus Instance number 266 exceeded the maximum allowed instance number.
wsio_claim init failed isc=0xe000000125437800 name=fcd_vbus

7 REPLIES 7
Tim Nelson
Honored Contributor

Re: Ioscan failing to FC SAN disks

FC HBA failure
FC HBA driver removed from kernel
FC cable failure
FC Switch failure
FC switch config/zoning removed
Array HBA failure
Array configuration removed

Let's start here.
ioscan -fnC fc
if you get a HW entry with device file then use the fc device file with the fcmsutil /dev/xxxx to check the status of FC HBA should be ONLINE
If you do not get any entry or NO_HW then possible that card failed or driver was unloaded from kernel.

Let us know what you find.
Tim Nelson
Honored Contributor

Re: Ioscan failing to FC SAN disks

Scratch the above.
All the failed instance numbers look like your LUN numbering/presentation was changed on the array.
WADE S
Frequent Advisor

Re: Ioscan failing to FC SAN disks

All of the HBA ports are up. If I look at a Finisar trace, the HBAs log in to the devices, then they log out never to be heard from again.

Re: Ioscan failing to FC SAN disks

Hi,

The problem is that for one reason or another you have exceeded the total number of ext_bus entries you can have on a system (at 11iv1 or 11iv2 - this isn't a limit with 11iv3). This is either because:

a) You have A LOT of LUNs on this system -or-
b) the config of the LUNs has changed several times such that there are now many 'ghost' entries in the /etc/ioconfig file

You can tell which by running 'ioscan -FC ext_bus | wc -l' - if you have more than 255 then you really do need to reorganise the way you present storage to this system to cut down the number of buses they're presented on (what sort of storage do you have?). If its significantly less than 255, you just have a lot of old 'ghost' entries in your ioconfig file.

Either way the ioconfig file now contains over 255 entries for ext_bus, and can't add any more - so you need to get that resolved.

You're gonna have to get a call open with HP support to resolve this, as you will need a utility called ioconfig_dump which can only be provided by a RC engineer. Ask the engineer to reference doc ID emr_na-c01007568-2. Be prepared for some reboots.

If you *don't* have support and you really can't see 255 ext_bus entries in your ioscan, then the only course of action you have available is to go through the risky process of re-creating the ioconfig file from scratch, which would basically involve:

i) shutting down your apps and unmounting all but your root VG.
ii) Creating map files for all your VGs using 'vgexport -p -s -m vgXX.map vgXX'
iii) saving a copy of the output of 'ioscan -fn' so you have a picture of how instance numbers matched to hardware paths before the change.
iv) saving copies of the output of 'lanscan' and 'netstat -in' so you know how LAN instance numbers match up to IP addresses.
v) Moving out the old ioconfig file /etc/ioconfig to a safe location on the root filesystem
vi) running 'ioinit -c' to create a new ioconfig
v) Rebooting 'reboot -rs'
vi) If the disks in the root volume group have had their instance ID changed (a definite possibility), then the boot will probably fail with an LVM problem, which will mean rebootong to LVM maintenance mode and re-creating the root volume group using vgexport/vgimport/lvlnboot.
vii) Once the root volume group is sorted you'll probably be able to get to multi-user mode, then you'll have to sort the other volume groups using vgexport/vgimport.
viii) You'll then need to look and see if your LAN instance numbers have changed - if they have you'll need to adjust /etc/rc.config.d/netconf appropriately to make sure IPs are bourebootingnd to the right LAN cards.
ix) and of course there could be other devices that have changed as a result of this - compare against what the new and old ioscan looked like.

If that doesn't all make immediate sense to you and you know what I'm talking about, I would seriously advise against going down this option.

HTH

Duncan

I am an HPE Employee
Accept or Kudo

Re: Ioscan failing to FC SAN disks

yikes, what did the spell checker do there?

Item viii) should read:

viii) You'll then need to look and see if your LAN instance numbers have changed - if they have you'll need to adjust /etc/rc.config.d/netconf appropriately to make sure IPs are bound to the right LAN cards.


Duncan

I am an HPE Employee
Accept or Kudo
WADE S
Frequent Advisor

Re: Ioscan failing to FC SAN disks

Thanks for the help Duncan. I did a google search on ioconfig_dump, which brought me to a thread from 2006. The last entry in that thread, gives a procedure for creating a new ioconfig file and blowing away the old, which appears to have worked, without doing step II. I've included it below.

I. cd /
ioscan -f | grep -e "DEVICE" -e "INTERFACE" | grep -v "target" | awk '{printf("%-20.20s %-12.12s %3d\n",$3,$1,($2 + 0))}' > devlist # all of this is one line

This creates a file listing HW Path, Class, and Instance Numbers for the devices. It's the Instance Numbers that you want to change.

II. Vi devlist and assign instance numbers 0, 1,2, ... to lan0, lan1, lan2, ... respectively. Leave the disk assignments as they are. Save the file.

III. Now blow away the ioconfig file and reboot:
cd /stand
mv ioconfig ioconfig.old
cd /etc
mv ioconfig ioconfig.old
shutdown -r 0

IV) The system bootup will stop at ioinitrc message:
/sbin/ioinit -c # this will recreate the missing ioconfig files
/sbin/ioinit -f /devlist -r # this will read in your edited file and reboot. You may see error messages like "Input is identical". Pay no attention.

After the box has rebooted, do a lanscan and make sure your assignments are as you expected.
WADE S
Frequent Advisor

Re: Ioscan failing to FC SAN disks

Problem solved as stated above.