HPE Community read-only access December 15, 2018
This is a maintenance upgrade. You will be able to read articles and posts, but not post or reply.
Hours:
Dec 15, 4:00 am to 10:00 am UTC
Dec 14, 10:00 pm CST to Dec 15, 4:00 am CST
Dec 14, 8:00 pm PST to Dec 15, 2:00 am PST
BladeSystem - General
cancel
Showing results for 
Search instead for 
Did you mean: 

Virtual connect Manager showing critical errors. Any advice...

 
SOLVED
Go to solution
Ewen Willox
Occasional Advisor

Virtual connect Manager showing critical errors. Any advice...

Hi,

we have a c7000 with 4 x 1/10GB Ethernet VC modules and 2 x 4GB VC-FC modules. We have a shared uplink configured to use the first two ports on each module, with the link failing over whenever the live one dies. All this was working fine but now I am getting 2 critical errors in the VC Manager. Nothing has been changed, it's just started seemingly by itself.

The first error is beside Stacking Links, where it tells me that there are no stacking links in my setup. There are two linking cables linking the ethernet modules vertically. I have reseated these and the lights on the modules are on and flashing, but no change.

The second error is under the Hardware Overview in the "Unknown" tab. In here all the VC modules installed are listed, with the status of all the links showing "Not Linked 0Mb", whereas before it showed linked 1GB on the live link. Despite this the traffic is getting through and the blades are still on the network.

The update animation at the top of the screen is permanently on as well, with the error "Checkpoint Pending or Not Valid" as well.

Any simple explination or fix for any of this, if it can be done without bringing the whole chassis down then great....
17 REPLIES
cjb_1
Trusted Contributor

Re: Virtual connect Manager showing critical errors. Any advice...

Hi

Be worth posting your firmware levels of both OA and VC. Have seen similar issues on older versions of vc firmware.
The Brit
Honored Contributor

Re: Virtual connect Manager showing critical errors. Any advice...

Hi Ewen,

I assume that you are seeing links on the X0 ports (i.e. the horizontal links between VC1 -> VC2, and VC3 - VC4.

I also assume that you are connected via X1, VC1 -> VC3 and VC2 -> VC4.

I would try power cycling the VC modules them selves, (allowing time for failover between each cycle.) I would probably do this with the virtical links disconnected and then reconnect them after all 4 vc modules have been cycled.
Also, you might try using X2 to link vertically (could be a bad port)

I have a similar setup, however I have not experienced this problem so I will be interested in your resolution.

Have you perhaps, upgraded FW recently?? I have experienced problems with this which required cycling to fix.

Note:: these are just suggestions, based on no actual experience of the specific problem.

Good Luck

Dave.
Ewen Willox
Occasional Advisor

Re: Virtual connect Manager showing critical errors. Any advice...

Hi,

OA is at F/W level: 2.21
VC is not reporting a firmware level, it's showing an unknown hardware state and minimal info. It was updated to the latest version when we installed the modules back in August though.

Thanks
Ewen Willox
Occasional Advisor

Re: Virtual connect Manager showing critical errors. Any advice...

Hi Dave,

I'm not seeing any links on any X port, even X0, the manages is showing everything as not linked. You are correct, I am connecting via X1, VC1 -> VC3 and VC2 -> VC4.

I will try power cycling the VC modules, and try using X2 to link vertically, not a bad idea.

No FW changes since the kit was installed in August.

Will let you know if I get a solution.

Thanks

Ewen
cjb_1
Trusted Contributor

Re: Virtual connect Manager showing critical errors. Any advice...

Agreed, power cycling the modules does seem to resolve this sort of thing. Though i would say it would be nice not to have to do this especially in production environments.

Any details in the system log file? Should alert if components have failed. Saying that, you say things are still ok at the blade end?
Ewen Willox
Occasional Advisor

Re: Virtual connect Manager showing critical errors. Any advice...

Everything is fine according to the OA. It's only when you log into the VC manager that you see any problems.
cjb_1
Trusted Contributor

Re: Virtual connect Manager showing critical errors. Any advice...

Can you get to the system logfile in VC?
Ewen Willox
Occasional Advisor

Re: Virtual connect Manager showing critical errors. Any advice...

Hi,

yes, I can get to the log. Attached it if anyone can make anything out of it then thanks.



cjb_1
Trusted Contributor
Solution

Re: Virtual connect Manager showing critical errors. Any advice...

Assume problem started on the 10th? Seen these type of errors in a previous post on this forum i think? Might want to do a search.

Looks to me like a bounce of the modules to get back functioning then check/upgrade the VC firmware. Check the release notes for the latest FW compatible with your OA version. There have been a number of reported issues and fixes related to this.
Terri Harris
Honored Contributor

Re: Virtual connect Manager showing critical errors. Any advice...

Just to summarize what revisions VC & the related components should be, see this HP web page:

http://h18004.www1.hp.com/products/blades/components/c-class-compmatrix.html#1

It has not yet been updated for OA 2.31. But minimum revs need to be:
VC 1.32: Don't update to 2.00 unless you have the new HP FlexAttach-10 Ethernet module installed.
OA 2.25: or the current 2.31
iLO2 1.61 or higher
The Brit
Honored Contributor

Re: Virtual connect Manager showing critical errors. Any advice...

Terri
Thanks for the (too late) warning. I have already upgraded my VC's to 2.00.

1. Have I created a problem for my self?
2. Should I downgrade back to 1.32?

Dave.

PS. I dont recall any warning at the "download" site/page.
The Brit
Honored Contributor

Re: Virtual connect Manager showing critical errors. Any advice...

Terri,
Also noted that there is a new FW release, 2.01. Should I move to that version?

Dave.
cjb_1
Trusted Contributor

Re: Virtual connect Manager showing critical errors. Any advice...

Predictably, we had the same problem on one of our enclosures this morning.

Things at the server end were fine and problem was solved in our case by bouncing the problematic vcfc module and upgrading to fw 1.32.

We have v2 on another enclosure. Notice the release been erased from the revision history. Fix in 2.01 seems worth upgrading to.

"Fixed an issue where Virtual Connect defined FC WWNs were not being written to the server HBA after upgrading firmware to Virtual Connect 2.00."
Terri Harris
Honored Contributor

Re: Virtual connect Manager showing critical errors. Any advice...

If you have Virtual Connect 2.00 and do not have the HP FlexAttach-10 module installed (1)if you are having any issues with VCM (Virtual Connect Manager) itself or (2) the FC HBA (Qlogic or Emulex) BIOS is not reporting the virtual pWWN addresses as it should, then upgrade to 2.01:

http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareDescription.jsp?lang=en&cc=us&prodTypeId=329290&prodSeriesId=3201263&swItem=MTX-476f7fc031f24133b51b45579d&prodNameId=3201264&swEnvOID=1005&swLang=8&taskId=135&mode=4&idx=3

Otherwise it is ok to be at VC 2.00 and not have the HP FlexAttach (Ethernet) module installed.
Ewen Willox
Occasional Advisor

Re: Virtual connect Manager showing critical errors. Any advice...

Thanks guys, a F/W update of the OA and all the FC modules has cleared the problem. Everything is talking again and looking good.

I notice that others have asked questions in this topic so I don't want to just close it down incase there are further Q/A related.

I will close it in a while unless someone tells me other wise.

Thanks for all the help folks.
Ewen Willox
Occasional Advisor

Re: Virtual connect Manager showing critical errors. Any advice...

A F/W update of the OA and all the FC modules has cleared the problem. Everything is talking again and looking good.