Configuring InfiniBand Connectivity

(Updated: Dec 2009)

To configure Infiniband connectivity, follow the procedures appropriate for your system below.

Configuring LNET as an OFED Infiniband Network
To configure LNET as an OFED InfiniBand network, enter:

options lnet networks="o2ib3(ib3)" The node specified is on o2ib network 3 using HCA ib3.

For information about other LNET options, see Section 30.2.1: LNET Options in the Lustre Operations Manual.

Building and Configuring Infiniband Support for Lustre™
The distributed kernels do not yet include 3rd-party Infiniband modules. As a result, our Lustre™ packages can not include IB network drivers for Lustre. However, we do distribute the source code. You will need to build your Infiniband software stack against the supplied kernel and then build new Lustre packages.

Voltaire
To build Lustre with Voltaire Infiniband sources, add the following as an argument to the configure script: --with-vib=

To configure Lustre, use: --nettype vib --nid 

Note: In Lustre v1.4.5, the Voltaire IB module (kvibnal) will not work on the Altix system. This is due to hardware differences in the Altix system.

OpenIB generation 1 / Mellanox Gold
To build Lustre with OpenIB Infiniband sources, add the following as an argument to the configure script: --with-openib=

To configure Lustre, use: --nettype openib --nid 

Silverstorm
A Silverstorm driver for Lustre is available.

To build Silverstorm with Lustre, configure Lustre with: --with-iib=

OpenIB 1.0
An OpenIB 1.0 driver for Lustre is available.