HPE EVA Storage

ISL performance issue between 2 site

 
abouasma
Advisor

ISL performance issue between 2 site

Hi All,

i'm wondering if someone can answer :-)
We setup ISL between 2 switch on different site distanced by 5KM. So i'm talking about on Fabric, The Configuration is as follow:
2x2GB/s Port 30/31

More information in attached file saninput

As you can see the max performance pert port reached is 60MB, so Total of 120GB.

My question is, should i expect more as we have a trunk of 4GB/s bandwith.
Then were should be the issue, BB-credit ?
The distance is less tahn 10KM, so ??
15 REPLIES 15
IBaltay
Honored Contributor

Re: ISL performance issue between 2 site

Hi, sure that the trunk is the best option but you need to have trunking license:

Look at this discussion:
http://forums11.itrc.hp.com/service/forums/questionanswer.do?threadId=1287709

and here is the major part of the needed info:

http://h20000.www2.hp.com/bc/docs/support/SupportManual/c00403562/c00403562.pdf?jumpid=reg_R1002_USEN
the pain is one part of the reality
abouasma
Advisor

Re: ISL performance issue between 2 site

Hi IBtalay,

In fact we have ISL trunk of 2 x 2GB/s as i mentionnned in my first message and we have installed ISL trunking installed on all switch, we can see that IO are well balanced through port.
But my question was regarding the throuput of 60MB/s pert port. Is that OK for a 2GB port? I would expect a performance reaching 200MB per port, so a Total of 400MB. No ???

Thanks
IBaltay
Honored Contributor

Re: ISL performance issue between 2 site

Hi,
Yes 2 ISL ports should give 400MB/s.
Look at here in the Exploring Brocade trunking doc:
http://www.hds.com/assets/pdf/brocade_wp_trunking.pdf

and
the 6.10 troubleshooting/diagnostic guide p 61-62:
http://h20000.www2.hp.com/bc/docs/support/SupportManual/c01482877/c01482877.pdf?jumpid=reg_R1002_USEN

for some ideas to troubleshoot/diagnose your ISL/trunked links.

also the ISL oversubscription could be an issue here, from the page 101 in the SAN HA document:
http://h20000.www2.hp.com/bc/docs/support/SupportManual/c00196284/c00196284.pdf?jumpid=reg_R1002_USEN


the pain is one part of the reality
abouasma
Advisor

Re: ISL performance issue between 2 site

HI Ibaltay

I read the document, and unfortunatly this didn't answer my question. I'm not running oversubscrtiption and i don't think having isew with deskew.
I'm now thinking about the nature of IO, as we try to do mirroring between 2 storage, i will try with dd to see if i get the same performance.

Best regards
PP BIJU KRISHNAN
Trusted Contributor

Re: ISL performance issue between 2 site

What's in between the 2 sites??

Do you see errors on the ports or in errdump or errshow??

Can you provide o/p of

portstatsshow
portshow

for the 2 ISL ports.

Also porterrshow for the entire switch.

abouasma
Advisor

Re: ISL performance issue between 2 site

Hi PP BIJU,

No error in errordump, or errshow
The rest of the command can be found in attched file, strange er_bad_os value in portstatshow on port31,

Thank's for your help
abouasma
Advisor

Re: ISL performance issue between 2 site

Hi PP BIJU,

Could you tell me what's mean

"tim_txcrd_z 527422 Time BB credit zero"

Trunking License, and extended Fabric license are installed

B.R
IBaltay
Honored Contributor
RUET
Regular Advisor

Re: ISL performance issue between 2 site

hello all
i also suspect something wrong witha interlink ISL:
What do you think about these values collected :
stat_wtx 673414948 4-byte words transmitted
stat_wrx 2953345 4-byte words received
stat_ftx 2003234271 Frames transmitted
stat_frx 2225058392 Frames received
stat_c2_frx 0 Class 2 frames received
stat_c3_frx 2219943598 Class 3 frames received
stat_lc_rx 2492784 Link control frames received
stat_mc_rx 0 Multicast frames received
stat_mc_to 0 Multicast timeouts
stat_mc_tx 0 Multicast frames transmitted
tim_rdy_pri 189170 Time R_RDY high priority
tim_txcrd_z 2922932550 Time TX Credit Zero (2.5Us ticks)
tim_txcrd_z_vc 0- 3: 6571232 0 2916361318 0
tim_txcrd_z_vc 4- 7: 0 0 0 0
tim_txcrd_z_vc 8-11: 0 0 0 0
tim_txcrd_z_vc 12-15: 0 0 0 0
er_enc_in 1 Encoding errors inside of frames
er_crc 1493 Frames with CRC errors
er_trunc 0 Frames shorter than minimum
er_toolong 0 Frames longer than maximum
er_bad_eof 0 Frames with bad end-of-frame
er_enc_out 106854 Encoding error outside of frames
er_bad_os 45408680 Invalid ordered set
Thanks in advance for any comments