- Community Home
- >
- Storage
- >
- Entry Storage Systems
- >
- Disk Enclosures
- >
- Re: MSA2012i iSCSI MPIO + Windows 2008 R2 BXIOS Er...
Categories
Company
Local Language
Forums
Discussions
Forums
- Data Protection and Retention
- Entry Storage Systems
- Legacy
- Midrange and Enterprise Storage
- Storage Networking
- HPE Nimble Storage
Discussions
Discussions
Discussions
Forums
Forums
Discussions
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
- BladeSystem Infrastructure and Application Solutions
- Appliance Servers
- Alpha Servers
- BackOffice Products
- Internet Products
- HPE 9000 and HPE e3000 Servers
- Networking
- Netservers
- Secure OS Software for Linux
- Server Management (Insight Manager 7)
- Windows Server 2003
- Operating System - Tru64 Unix
- ProLiant Deployment and Provisioning
- Linux-Based Community / Regional
- Microsoft System Center Integration
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Community
Resources
Forums
Blogs
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-12-2010 03:38 AM
тАО03-12-2010 03:38 AM
MSA2012i iSCSI MPIO + Windows 2008 R2 BXIOS Errors
We have a number of servers running Windows 2003 and Windows 2008 (x64) using the array and MPIO with no problems whatever. However we have recently introduced the following server:
HP DL360G5
2 x HP NC382T dedicated NICs for iSCSI
Latest firmware applied to NICs
Windows 2008 R2
The current environment:
MSA2012i (dual controller)
2 x Cisco 2560 Gigabit switches (seperate IP subnets)
Latest firmware applied to MSA2012i
The server has been setup exactly the same as the previous Windows 2008 (x64) machine in that one NIC is connected to one switch the other to a different switch. A total of 4 paths are then created manually 2 to Controller A, 2 to Controller B spread over the two subnets available. MPIO is enabled as Round Robin.
Now the problem. With both ports connected the server reports the following errors in the System Event Log every few seconds:
BXIOS, Event ID 20, 3/1/2010 8:59:09pm
"Connection to the target was lost. The initiator will attempt to retry the connection".
BXIOS, Event ID 48, 3/1/2010 8:59:11pm
"Target failed to respond in time to NOP request".
and then an "Information":
BXIOS, Event ID 34, 3/1/2010 8:59:11pm
"A connection to the target was lost, but Intiator sucessfully reconnected to the target. Dump data contains the target name"
<-the dump date then shows the disk on controller A
The server will appear sluggish in Disk Manager and is prone to hanging. Rebooting the server will effectively either hang it on shutting down or when it starts up. Removing one of the network cables used by iSCSI will make the server recover.
All in all it sounds like the issue is defintely MPIO but I at a loss as to what. I've tried removing the entire iSCSI configuration at least twice and also followed HP's document:
http://h20000.www2.hp.com/bizsupport/TechSupport/Document.jsp?lang=en&cc=us&objectID=c01715951&jumpid=reg_R1002_USEN
to the letter (just in case).
Again just to reiterate none of the other servers in this environment are experiencing this problem. All use MPIO and two dedicated network cards.
If anyone can shed any light on this it would be greatly appreciated.
Many thanks.
Anthony
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-13-2010 09:24 AM
тАО03-13-2010 09:24 AM
Re: MSA2012i iSCSI MPIO + Windows 2008 R2 BXIOS Errors
NICs drivers? NICs firmware? (sounds stupid, but anyway...)
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-13-2010 11:42 AM
тАО03-13-2010 11:42 AM
Re: MSA2012i iSCSI MPIO + Windows 2008 R2 BXIOS Errors
Thanks for the reply. Unfortunately the array and the NICs are using the latest firmware available. The NICs are using the latest drivers as well as the latest verion of the HP Network Configuration Utility (NCU).
Any other ideas would be gratefully accepted.
Regards,
Anthony
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-17-2010 07:05 PM
тАО03-17-2010 07:05 PM
Re: MSA2012i iSCSI MPIO + Windows 2008 R2 BXIOS Errors
In my case the issue occurs whether or not MPIO is enabled, so even with a single path. I performed a packet capture which revealed that the HBA stops sending NOP out requests at some point.
The packet capture clearly shows:
- Every NOP out request from initiator is getting a good response from the target within a few mS.
- At some point, the initiator stops sending NOP out requests.
- By the end of the packet capture, the loop is this:
1. Initiator logs into target successfully
2. Initiator DOES NOT put a NOP Out request on the wire at any point
3. Capture shows Initiator resetting the connection, then doing ARP request, then connecting again successfully to the target. Event logs on server claim target did not respond in time to a NOP request. However, after this point the initiator NEVER PUTS A NOP OUT ON THE WIRE so why would it expect a response????
4. Loop repeats. It will go on like this indefinitely without ever sending a NOP out request. I have to break it out of the loop by taking away rights to the storage volume.
Just as in your situation, machine will freeze if I try to shut it down - taking away rights to the volume ends it though.
To me this looks clearly like an issue with the NIC or driver.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-21-2010 01:34 PM
тАО03-21-2010 01:34 PM
Re: MSA2012i iSCSI MPIO + Windows 2008 R2 BXIOS Errors
Thanks for the info although it sounds like your situation is even worse. I've found that if I pull the 2nd path (by disabling the port on the CISCO switch or physically removing patch lead) it brings the server back to life after a few minutes. With 2 paths and MPIO any disk operation (like Disk Manager, formatting the drive, logging on, logging off, shutting down etc) will result in the server hanging until the 2nd path is pulled (or after about approximately 30 minutes).
Did you manage to get anywhere with your configuration? At this rate this server will have to go live with only a single path which is not desirable at all.
Anyone out there from HP shed any light on this?
Regards,
Anthony
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-21-2010 09:56 PM
тАО03-21-2010 09:56 PM
Re: MSA2012i iSCSI MPIO + Windows 2008 R2 BXIOS Errors
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО04-14-2010 02:26 AM
тАО04-14-2010 02:26 AM
Re: MSA2012i iSCSI MPIO + Windows 2008 R2 BXIOS Errors
Haven't had a chance to open the call with HP yet but I have just noticed that there is another version of the controller firmware out
http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareDescription.jsp?lang=en&cc=us&prodTypeId=12169&prodSeriesId=3687128&swItem=MTX-0f8bb8756caa4d3d90cccc829e&prodNameId=3687132&swEnvOID=4024&swLang=13&taskId=135&mode=5
Although there is anything in the "fixes" to suggest this will solve the issues I am seeing I feel it is worth a shot as the previous firmware release was July 2009.
I will update you all later.
Regards,
ACK
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО05-07-2010 07:15 AM
тАО05-07-2010 07:15 AM
Re: MSA2012i iSCSI MPIO + Windows 2008 R2 BXIOS Errors
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО02-07-2011 04:09 AM
тАО02-07-2011 04:09 AM
Re: MSA2012i iSCSI MPIO + Windows 2008 R2 BXIOS Errors
A Solution!!!
Just thought I would bring everyone upto speed on this one. After building a seperate test machine using Windows 2008R2 and different NICs but getting the same error I then embarked on some more in depth troubleshooting as and when I could. This involved different drivers, firmware, Round Robin vs Failover etc etc.
On one of these sessions I noticed that the 2nd switch used in the SAN design (CISCIO 2960G's) was still running the old MTU size (i.e. 1500) despite all the equipment plugged into it trying to use Jumbo packets (ie 9000). After changing this and reloading the switch config all the BXIOS errors vanished.
Have done extensive testing using both failover/round robin and everything is looking good so I can safely say this issue can be CLOSED.
One thing to bear in mind though: Windows 2008R2 is definitely very sensitive to this type of error as (and I checked this again) the other servers running Windows 2008 (64 bit)and Windows 2003 (32 bit) never reported this as a problem (which is why it was never noticed). The other servers had even gone through extensive site acceptance tests (i.e. disconnecting nics, switches , controllers etc) before going live and this error still didn't appear anywhere.
Watch out everyone...
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО02-07-2011 04:13 AM
тАО02-07-2011 04:13 AM
Re: MSA2012i iSCSI MPIO + Windows 2008 R2 BXIOS Errors
See the above for the solution.