WARNING: This is the _old_ Lustre wiki, and it is in the process of being retired. The information found here is all likely to be out of date. Please search the new wiki for more up to date information.

Configuring InfiniBand Connectivity: Difference between revisions

From Obsolete Lustre Wiki
Jump to navigationJump to search
m (Protected "Configuring InfiniBand Connectivity" ([edit=sysop] (indefinite) [move=sysop] (indefinite)))
Line 11: Line 11:
The node specified is on ''o2ib'' network ''3'' using HCA ''ib3''.
The node specified is on ''o2ib'' network ''3'' using HCA ''ib3''.


For information about other LNET options, see [http://manual.lustre.org/manual/LustreManual18_HTML/ConfigurationFilesModuleParametersMan5.html#50532501_pgfId-1293321 Section 30.2.1: ''LNET Options''] in the [[Lustre Documentation|''Lustre Operations Manual'']].
For information about other LNET options, see [http://wiki.lustre.org/manual/LustreManual18_HTML/ConfigurationFilesModuleParametersMan5.html#50532501_pgfId-1293321 Section 30.2.1: ''LNET Options''] in the [[Lustre Documentation|''Lustre Operations Manual'']].


== Building and Configuring Infiniband Support for Lustre™ ==
== Building and Configuring Infiniband Support for Lustre™ ==

Revision as of 15:46, 11 January 2010

To configure Infiniband connectivity, follow the procedures appropriate for your system below.

Configuring LNET as an OFED Infiniband Network

To configure LNET as an OFED InfiniBand network, enter:

options lnet networks="o2ib3(ib3)"

The node specified is on o2ib network 3 using HCA ib3.

For information about other LNET options, see Section 30.2.1: LNET Options in the Lustre Operations Manual.

Building and Configuring Infiniband Support for Lustre™

The distributed kernels do not yet include 3rd-party Infiniband modules. As a result, our Lustre™ packages can not include IB network drivers for Lustre. However, we do distribute the source code. You will need to build your Infiniband software stack against the supplied kernel and then build new Lustre packages.

Voltaire

To build Lustre with Voltaire Infiniband sources, add the following as an argument to the configure script:

--with-vib=<path-tovoltaire-sources> 

To configure Lustre, use:

--nettype vib --nid <IPoIB address>

Note: In Lustre v1.4.5, the Voltaire IB module (kvibnal) will not work on the Altix system. This is due to hardware differences in the Altix system.

OpenIB generation 1 / Mellanox Gold

To build Lustre with OpenIB Infiniband sources, add the following as an argument to the configure script:

--with-openib=<path_to_openib sources> 

To configure Lustre, use:

--nettype openib --nid <IPoIB address>

Silverstorm

A Silverstorm driver for Lustre is available.

To build Silverstorm with Lustre, configure Lustre with:

--with-iib=<path to silverstorm sources>

OpenIB 1.0

An OpenIB 1.0 driver for Lustre is available.