WARNING: This is the _old_ Lustre wiki, and it is in the process of being retired. The information found here is all likely to be out of date. Please search the new wiki for more up to date information.

Load Balancing with Infiniband: Difference between revisions

From Obsolete Lustre Wiki
Jump to navigationJump to search
(Created page with 'Load Balancing with InfiniBand There is one OSS with two InfiniBand HCAs. Lustre clients have only one InfiniBand HCA using native Lustre drivers of o2ibind. Load balancing is do...')
 
No edit summary
 
(27 intermediate revisions by 2 users not shown)
Line 1: Line 1:
Load Balancing with InfiniBand
For information about load balancing on an InfiniBand network, see [http://wiki.lustre.org/manual/LustreManual20_HTML/ManagingLNET.html#50438203_pgfId-1290312 Section 15.4: ''Load Balancing with InfiniBand''] and [http://wiki.lustre.org/manual/LustreManual20_HTML/ManagingLNET.html#50438203_pgfId-1289929 Section 15.3: ''Multi-Rail Configurations with LNET''] in the [http://wiki.lustre.org/manual/LustreManual20_HTML/index.html ''Lustre Operations Manual''].
There is one OSS with two InfiniBand HCAs. Lustre clients have only one InfiniBand
 
HCA using native Lustre drivers of o2ibind. Load balancing is done on both HCAs
For information about other LNET options, see [http://wiki.lustre.org/manual/LustreManual20_HTML/ConfigurationFilesModuleParameters.html#50438293_pgfId-1293321 Section 35.2.1: ''LNET Options''] in the [http://wiki.lustre.org/manual/LustreManual20_HTML/index.html ''Lustre Operations Manual''].
on the OSS with the help of LNET.
7.3.1 Modprobe.conf
Lustre users have options available on following networks.
■ Dual HCA OSS server
options lnet ip2nets= "o2ib0(ib0),o2ib1(ib1) 192.168.10.1.[101-102]
■ Client with the odd IP address
options lnet ip2nets=o2ib0(ib0) 192.168.10.[103-253/2]
■ Client with the even IP address
options lnet ip2nets=o2ib1(ib0) 192.168.10.[102-254/2]
7.3.2 Start servers
To start the MGS and MDT server, run:
modprobe lnet
To start MGS and MDT, run:
$ mkfs.lustre --fsname lustre --mdt --mgs /dev/sda
$ mkdir -p /mnt/test/mdt
$ mount -t lustre /dev/sda /mnt/test/mdt
$ mount -t lustre mgs@o2ib0:/lustre /mnt/mdt
To start the OSS, run:
$ mkfs.lustre --fsname lustre --ost --mgsnode=mds@o2ib0 /dev/sda
$ mkdir -p /mnt/test/mdt
$ mount -t lustre /dev/sda /mnt/test/ost
$ mount -t lustre mgs@o2ib0:/lustre /mnt/ost
Chapter 7 More Complicated Configurations 7-7
7.3.3 Start clients
For the IB client, run:
mount -t lustre
192.168.10.101@o2ib0,192.168.10.102@o2ib1:/mds/client /mnt/lustre

Latest revision as of 06:49, 20 January 2011

For information about load balancing on an InfiniBand network, see Section 15.4: Load Balancing with InfiniBand and Section 15.3: Multi-Rail Configurations with LNET in the Lustre Operations Manual.

For information about other LNET options, see Section 35.2.1: LNET Options in the Lustre Operations Manual.