topic HPE Broadcom NetXtreme-E RoCE Library for SUSE Linux Enterprise Server 15 SP5 installation in ProLiant Servers (ML,DL,SL)

HPE Broadcom NetXtreme-E RoCE Library for SUSE Linux Enterprise Server 15 SP5 installation

MarioE — Wed, 20 Dec 2023 18:00:01 GMT

ProLiant DL380 Gen11 with SUSE Linux Enterprise Server 15 SP5

I want to install this library "HPE Broadcom NetXtreme-E RoCE Library for SUSE Linux Enterprise Server 15 SP5".

According to Prerequisites i have installed libibverb and rdma-core::

HPE Broadcom NetXtreme-E Drivers for SUSE Linux Enterprise Server 15, version 1.10.2-227.0.130.0 or later, must be installed before installing this product.

The libibverb and rdma-core package must be installed on the target system prior to the installation of the RoCE library. If not already present, the packages can be obtained from the operating system installation media.

S | Name | Summary | Type

---+------------------+------------------------------------------------------------------------------+--------

i+ | libibverbs | Library & drivers for direct userspace use of InfiniBand/iWARP/RoCE hardware | package

i+ | libibverbs-utils | Examples for the libibverbs library | package

i | libibverbs1 | Ibverbs runtime library | package

S | Name | Summary | Type

--+-----------------+---------------------------------------------+--------

i | rdma-core | RDMA core userspace libraries and daemons | package

| rdma-core-devel | RDMA core development libraries and headers | package

Now when I try to install the RPM, I get the following message:

# rpm -ivh libbnxt_re-227.0.130.0-sles12sp5.x86_64.rpm

error: Failed dependencies:

libibverbs.so.1(IBVERBS_PRIVATE_22)(64bit) is needed by libbnxt_re-227.0.130.0-sles12sp5.x86_64

I can't find libibverbs.so.1 in the SLES Repository.

# zypper search libibverbs.so.1
Loading repository data...
Reading installed packages...
No matching items found.

Note: For an extended search including not yet activated remote resources please use 'zypper
search-packages'.

However, I can find the library under /usr/lib64/:

# ll /usr/lib64/libib*

lrwxrwxrwx 1 root root 23 May 3 2023 /usr/lib64/libibverbs.so.1 -> libibverbs.so.1.14.42.0

-rwxr-xr-x 1 root root 133816 May 3 2023 /usr/lib64/libibverbs.so.1.14.42.0

/usr/lib64/libibverbs:

total 448

-rwxr-xr-x 1 root root 26608 May 3 2023 libbnxt_re-rdmav34.so

-rwxr-xr-x 1 root root 26608 May 3 2023 libcxgb3-rdmav34.so

-rwxr-xr-x 1 root root 43016 May 3 2023 libcxgb4-rdmav34.so

lrwxrwxrwx 1 root root 21 May 3 2023 libefa-rdmav34.so -> ../libefa.so.1.1.42.0

-rwxr-xr-x 1 root root 18416 May 3 2023 libhfi1verbs-rdmav34.so

-rwxr-xr-x 1 root root 55272 May 3 2023 libhns-rdmav34.so

-rwxr-xr-x 1 root root 18416 May 3 2023 libipathverbs-rdmav34.so

-rwxr-xr-x 1 root root 42992 May 3 2023 libirdma-rdmav34.so

lrwxrwxrwx 1 root root 22 May 3 2023 libmlx4-rdmav34.so -> ../libmlx4.so.1.0.42.0

lrwxrwxrwx 1 root root 23 May 3 2023 libmlx5-rdmav34.so -> ../libmlx5.so.1.24.42.0

-rwxr-xr-x 1 root root 34800 May 3 2023 libmthca-rdmav34.so

-rwxr-xr-x 1 root root 34800 May 3 2023 libocrdma-rdmav34.so

-rwxr-xr-x 1 root root 47080 May 3 2023 libqedr-rdmav34.so

-rwxr-xr-x 1 root root 26600 May 3 2023 librxe-rdmav34.so

-rwxr-xr-x 1 root root 22504 May 3 2023 libsiw-rdmav34.so

-rwxr-xr-x 1 root root 22512 May 3 2023 libvmw_pvrdma-rdmav34.so

Can anyone help me with this?

Re: HPE Broadcom NetXtreme-E RoCE Library for SUSE Linux Enterprise Server 15 SP5 installation

utnoor — Tue, 19 Dec 2023 16:49:49 GMT

Hi MarioE,

Can we provide the output of the command "#rpm -ivh <kmod>.rpm"

Re: HPE Broadcom NetXtreme-E RoCE Library for SUSE Linux Enterprise Server 15 SP5 installation

utnoor — Tue, 19 Dec 2023 17:52:23 GMT

Hi MarioE,

The OS is SLES 15 SP5 while driver is "libbnxt_re-227.0.130.0-sles12sp5.x86_64.rpm" which means you're trying to install SLES 12 SP5 driver onto SLES 15 SP5, which is not supported while OS vendor would already provide their driver to support the cards by default............

Re: HPE Broadcom NetXtreme-E RoCE Library for SUSE Linux Enterprise Server 15 SP5 installa

MarioE — Tue, 19 Dec 2023 19:03:38 GMT

Hi @utnoor

Many thanks for the tip. I don't even know why I tried with version sles12sp5. I was on the correct HPE page for sles15sp5...
I have now downloaded and installed the correct package again:
Now it worked, but only with force:

# rpm -ivh libbnxt_re-227.0.130.0-sles15sp5.x86_64.rpm
Preparing... ################################# [100%]
file /etc/libibverbs.d/bnxt_re.driver from install of libbnxt_re-227.0.130.0-sles15sp5.x86_64 conflicts with file from package libibverbs-42.0-150500.1.3.x86_64
# rpm -ivh libbnxt_re-227.0.130.0-sles15sp5.x86_64.rpm --force
Preparing... ################################# [100%]
Updating / installing...
1:libbnxt_re-227.0.130.0-sles15sp5 ################################# [100%]
# rpm -qa | grep -i libbnxt
libbnxt_re-227.0.130.0-sles15sp5.x86_64

Re: HPE Broadcom NetXtreme-E RoCE Library for SUSE Linux Enterprise Server 15 SP5 installa

Sunitha_Mod — Thu, 21 Dec 2023 08:55:16 GMT

Hello @MarioE,

Perfect!

We are extremely glad to know the problem has been resolved and we appreciate you for keeping us posted.