Switches, Hubs, and Modems
cancel
Showing results for 
Search instead for 
Did you mean: 

9300 Gig interface errors

Jonathan Axford
Trusted Contributor

9300 Gig interface errors

Hi Guys,

Had a bit of a strange one today. Three 9300 series switches (2 9308 and 1 9304) started to report more that 1000 errors per second in the traffic monitor in Procurve Manager+. These were all on interface Gigabit 1/1.

This has continued to happen throughout the day, i have had a look at what is going on using ethereal and nothing seems to be out of the ordinary. Also, there is not being anything recorded in the event log at all.

Not quite sure what to look at next.... Any ideas?
Where there is a will there is a way...
16 REPLIES
Mohieddin Kharnoub
Honored Contributor

Re: 9300 Gig interface errors

Hi Jonathan

Can you help us to make it easy, What kind of error you get? All the three switches report the same error? on the same interface?

You said you've tried Ethereal, have you tried port monitor ?

If you can capture a sample screen shot of the PCM Traffic Monitor screen and attach it here, that will be helpfull.

Science for Everyone
Jonathan Axford
Trusted Contributor

Re: 9300 Gig interface errors

Hi,

The actual switch itself does not report any errors in the logs. The PCM+ application reports the errors as part of the traffic monitor process, it doesn;t actually say what the errors are. I will upload a screen shot when it next happens...
Where there is a will there is a way...
Jonathan Axford
Trusted Contributor

Re: 9300 Gig interface errors

Here is a screenshot of what the traffic monitor displays.
Where there is a will there is a way...
Matt Hobbs
Honored Contributor

Re: 9300 Gig interface errors

Ethereal and any packet captures are generally only going to show you well formed packets anyway, so you won't be able to see the errors.

Have you tried: "show interfaces eth 1/1"?

Can you attach the output of that command here?

It's definitely a strange one, are they connected via fibre or copper? I'd usually look at swapping out some cables except that it's happened on 3 products, all on the same port number...
Jonathan Axford
Trusted Contributor

Re: 9300 Gig interface errors

Hi, I have set it up the traffic monitor on another 9300 now, and it has the same! The sho int ethe 1/1 output looks good to me, i have attached it for you to see.

The ports are all connected up with Fibre.

It is happening on 4 switches in total, i do have one 9300 that hasn't reported any errors.

Where there is a will there is a way...
Mohieddin Kharnoub
Honored Contributor

Re: 9300 Gig interface errors

Hi Jonathan

Would you please go the Menu of Top 5 View, click on View, then change to Broadcasts/Sec.

Tell us whats hapenning ???
Science for Everyone
Jonathan Axford
Trusted Contributor

Re: 9300 Gig interface errors

Hi, here is the Broadcasts per second views from all 4 9300 with the errors.
Where there is a will there is a way...
Mohieddin Kharnoub
Honored Contributor

Re: 9300 Gig interface errors

Thats it !

You have a Broadcast Issue, if you compare the output of Show Int that Matt asked for with TOP5 view.

You have to look now for The Broadcast source, from the Top 5 view you can get more details, you can display Top Destinations, Top Connections and Top Protocols.

Good Luck !!!
Science for Everyone
Jonathan Axford
Trusted Contributor

Re: 9300 Gig interface errors

Hi Guys,

I have been looking into this this afternoon, there doesn't seem to be any pattern as to what could be causing the errors. All of the switches are sending data to different places when the errors are recorded.I have been looking at the top 5 view for errors and comparing it with the connections to see if i can determine what is going on when the errors are registered...
Here is a diagram of the tables...
Where there is a will there is a way...
Mohieddin Kharnoub
Honored Contributor

Re: 9300 Gig interface errors

Apprently, you have been Flooded with Microsoft-DS , its like a broadcast reported by PCM+.

This sometimes happens by some kind of Worm Virus associated with AOL IM and IRC, or Malware software.

You can see the sources and destinations fro mthe last picture you attached, check it out and try to isloate this flood from the network then watch the PCM output.

Don;t forget to assign points to any post you got.

Good Luck !!!
Science for Everyone
Jonathan Axford
Trusted Contributor

Re: 9300 Gig interface errors

Good morning everyone!

I have been monitoring this for about 2 1/2 hours today, and so far, it hasn;t happened again.

The main destinations shown in the graphs are my SAN where the students and staff profiles and documents are stored. This is often very busy as at certain points in the day there can be 300 + people logging on at once.

I have checked our anti virus server, which hasn't detetced any unusual AV activity.

I will keep an eye on it a bit longer to see if it crops up again,

Thanks for all your help so far...!!!
Where there is a will there is a way...
Matt Hobbs
Honored Contributor

Re: 9300 Gig interface errors

I've been thinking a bit more about this as well...

What I would do is use a MIB browser and walk those switches.

I like iReasoning's MIB browser:
http://www.ireasoning.com/

Download the ProCurve MIBs:

http://www.hp.com/rnd/software/MIBs.htm

Load the 9300 MIBs into the browser and then walk the switch. You might see some interesting counters there that will hopefully explain exactly what caused those errors to be reported in PCM+.

Jonathan Axford
Trusted Contributor

Re: 9300 Gig interface errors

Hello again,

Thanks for the help, I am not entirely sure how to go about that having never done it before. I have downloaded the free version of Ireasoning and the HP MIBS but it all looks a bit confusing!

I am not sure which ones to load into the application as there are hundreds in the .ZIP file from HP. Anyway, i will give it a go...
Where there is a will there is a way...
Jonathan Axford
Trusted Contributor

Re: 9300 Gig interface errors

Is all a bit confusing. Any links or pointers on how to do this would be much apprecited!

Where there is a will there is a way...
Matt Hobbs
Honored Contributor

Re: 9300 Gig interface errors

Load as many of these MIBs as you can (max is 5 with the free version).

rfc1212.mib*
rfc1213.mib
rfc1215.mib*
rfc1742.mib
rfc2578.mib
rfc2579.mib
h2r07601a.mib

Definitely include the last one.

It is a bit advanced, I can't really give much other guidance except to just play around with it.
Jonathan Axford
Trusted Contributor

Re: 9300 Gig interface errors

Hi again all,

Seems to have dissappeared now... Have had no errors or large amounts of traffic registered on any of the devices today....

Nothing has changed config wise so not sure what happened! Will keep an eye on it though....

Where there is a will there is a way...