WARNING: This is the _old_ Lustre wiki, and it is in the process of being retired. The information found here is all likely to be out of date. Please search the new wiki for more up to date information.

Load Balancing with Infiniband

From Obsolete Lustre Wiki
Revision as of 14:31, 30 September 2009 by Docadmin (talk | contribs) (Created page with 'Load Balancing with InfiniBand There is one OSS with two InfiniBand HCAs. Lustre clients have only one InfiniBand HCA using native Lustre drivers of o2ibind. Load balancing is do...')
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigationJump to search

Load Balancing with InfiniBand There is one OSS with two InfiniBand HCAs. Lustre clients have only one InfiniBand HCA using native Lustre drivers of o2ibind. Load balancing is done on both HCAs on the OSS with the help of LNET. 7.3.1 Modprobe.conf Lustre users have options available on following networks. ■ Dual HCA OSS server options lnet ip2nets= "o2ib0(ib0),o2ib1(ib1) 192.168.10.1.[101-102] ■ Client with the odd IP address options lnet ip2nets=o2ib0(ib0) 192.168.10.[103-253/2] ■ Client with the even IP address options lnet ip2nets=o2ib1(ib0) 192.168.10.[102-254/2] 7.3.2 Start servers To start the MGS and MDT server, run: modprobe lnet To start MGS and MDT, run: $ mkfs.lustre --fsname lustre --mdt --mgs /dev/sda $ mkdir -p /mnt/test/mdt $ mount -t lustre /dev/sda /mnt/test/mdt $ mount -t lustre mgs@o2ib0:/lustre /mnt/mdt To start the OSS, run: $ mkfs.lustre --fsname lustre --ost --mgsnode=mds@o2ib0 /dev/sda $ mkdir -p /mnt/test/mdt $ mount -t lustre /dev/sda /mnt/test/ost $ mount -t lustre mgs@o2ib0:/lustre /mnt/ost Chapter 7 More Complicated Configurations 7-7 7.3.3 Start clients For the IB client, run: mount -t lustre 192.168.10.101@o2ib0,192.168.10.102@o2ib1:/mds/client /mnt/lustre