WARNING: This is the _old_ Lustre wiki, and it is in the process of being retired. The information found here is all likely to be out of date. Please search the new wiki for more up to date information.
Configuring InfiniBand Connectivity: Difference between revisions
No edit summary |
|||
| (18 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
<small>''(Updated: Dec 2009)''</small> | |||
__TOC__ | |||
To configure Infiniband connectivity, follow the procedures appropriate for your system below. | |||
== Configuring LNET as an OFED Infiniband Network == | |||
:<pre> | To configure LNET as an OFED InfiniBand network, enter: | ||
<pre> | |||
options lnet networks="o2ib3(ib3)" | |||
</pre> | </pre> | ||
The node specified is on ''o2ib'' network ''3'' using HCA ''ib3''. | |||
For information about other LNET options, see [http://wiki.lustre.org/manual/LustreManual20_HTML/ConfigurationFilesModuleParameters.html#50438293_pgfId-1293321 35.2.1: ''LNET Options''] in the [http://wiki.lustre.org/manual/LustreManual20_HTML/index.html ''Lustre Operations Manual'']. | |||
== Building and Configuring Infiniband Support for Lustre™ == | |||
The distributed kernels do not yet include 3rd-party Infiniband modules. As a result, | |||
our Lustre™ packages can not include IB network drivers for Lustre. However, | |||
we do distribute the source code. You will need to build your Infiniband software | |||
stack against the supplied kernel and then build new Lustre packages. | |||
====Voltaire==== | |||
To build Lustre with Voltaire Infiniband sources, add the following as an argument to the configure script: | |||
--with-vib=<path-tovoltaire-sources> | |||
To configure Lustre, use: | |||
--nettype vib --nid <IPoIB address> | |||
'''''Note:''''' In Lustre v1.4.5, the Voltaire IB module (''kvibnal'') will not work on the Altix system. This is due to hardware differences in the Altix system. | |||
====OpenIB generation 1 / Mellanox Gold==== | |||
To build Lustre with OpenIB Infiniband sources, add the following as an argument to the configure script: | |||
--with-openib=<path_to_openib sources> | |||
To configure Lustre, use: | |||
--nettype openib --nid <IPoIB address> | |||
====Silverstorm==== | |||
A Silverstorm driver for Lustre is available. | |||
To build Silverstorm with Lustre, configure Lustre with: | |||
--with-iib=<path to silverstorm sources> | |||
====OpenIB 1.0==== | |||
An OpenIB 1.0 driver for Lustre is available. | |||
Latest revision as of 11:57, 20 January 2011
(Updated: Dec 2009)
To configure Infiniband connectivity, follow the procedures appropriate for your system below.
Configuring LNET as an OFED Infiniband Network
To configure LNET as an OFED InfiniBand network, enter:
options lnet networks="o2ib3(ib3)"
The node specified is on o2ib network 3 using HCA ib3.
For information about other LNET options, see 35.2.1: LNET Options in the Lustre Operations Manual.
Building and Configuring Infiniband Support for Lustre™
The distributed kernels do not yet include 3rd-party Infiniband modules. As a result, our Lustre™ packages can not include IB network drivers for Lustre. However, we do distribute the source code. You will need to build your Infiniband software stack against the supplied kernel and then build new Lustre packages.
Voltaire
To build Lustre with Voltaire Infiniband sources, add the following as an argument to the configure script:
--with-vib=<path-tovoltaire-sources>
To configure Lustre, use:
--nettype vib --nid <IPoIB address>
Note: In Lustre v1.4.5, the Voltaire IB module (kvibnal) will not work on the Altix system. This is due to hardware differences in the Altix system.
OpenIB generation 1 / Mellanox Gold
To build Lustre with OpenIB Infiniband sources, add the following as an argument to the configure script:
--with-openib=<path_to_openib sources>
To configure Lustre, use:
--nettype openib --nid <IPoIB address>
Silverstorm
A Silverstorm driver for Lustre is available.
To build Silverstorm with Lustre, configure Lustre with:
--with-iib=<path to silverstorm sources>
OpenIB 1.0
An OpenIB 1.0 driver for Lustre is available.
