topic Re: Infiniband on 5.4 in Operating System - Linux

Infiniband on 5.4

Qcheck — Thu, 01 Jul 2010 11:56:44 GMT

Does anyone have any issues running infiniband on redhat 5.4. We are able to setup but the ping looses connection when we try to ping one private interconnect ip to the other, but it can ping to itself. It only occurs when we bond ib0 and ib2 as bond0. But when we unbound and use just ib0 or ib2, then it can talk to all other four private interconnect ips, which are on 4 nodes accross. Any idea?

kernel is 2.6.18-164.el5 and running QLogic-IFS.RHEL5-x86_64.6.0.0.2.7

Re: Infiniband on 5.4

Zinky — Thu, 01 Jul 2010 12:10:44 GMT

I suggest you try patching the kernel and even updating your infiniband modules. I recently chanced upon (in a Linux Event) - an Infiniband CLustered system and it was using RHEL 5.5 (2.6.18-194.x). It was likely using Myrinet though.

Re: Infiniband on 5.4

Qcheck — Tue, 06 Jul 2010 11:04:25 GMT

Alzhy, Thank you for the response. However, we can't upgrade the infiniband. We upgraded the OFED driver and that fixed the ib0 bond.

Thank you for your time.

Re: Infiniband on 5.4

Qcheck — Tue, 06 Jul 2010 11:05:19 GMT

Upgraded the OFED driver and that fixed the ib0 bond.

Re: Infiniband on 5.4

Tim Nelson — Tue, 06 Jul 2010 21:01:44 GMT

some curiosities if you are willing to share.

1) version of OFED ?

2) type of bonding ?