|
|
| Line 1: |
Line 1: |
| [[Eric Barton wrote up something a year and a half ago (Bryon)]]. [[Sent email to Sheila 10/6]].
| | For information about load balancing on an InfiniBand network, see Section 7.3: ''Load Balancing with InfiniBand'' in the [[Lustre Documentation|''Lustre Operations Manual'']]. |
|
| |
|
| [[From OM Chapter 7]] 7.3 Load Balancing with InfiniBand
| | For information about other LNET options, see Section 31.2.1: ''LNET Options'' in the [[Lustre Documentation|''Lustre Operations Manual'']]. |
| | |
| There is one OSS with two InfiniBand HCAs. Lustre clients have only one InfiniBand
| |
| HCA using native Lustre drivers of o2ibind. Load balancing is done on both HCAs
| |
| on the OSS with the help of LNET.
| |
| | |
| | |
| Options under modprobe.conf are used to specify the networks available to a
| |
| node. You have the choice of two different options – the networks option, which
| |
| explicitly lists the networks available and the ip2nets option, which provides a listmatching
| |
| lookup. Only one option can be used at any one time. The order of LNET
| |
| lines in modprobe.conf is important when configuring multi-homed servers. If a
| |
| server node can be reached using more than one network, the first network specified
| |
| in modprobe.conf will be used.
| |
| | |
| 7.3.1 Modprobe.conf
| |
| Lustre users have options available on following networks.
| |
| ■ Dual HCA OSS server
| |
| options lnet ip2nets= "o2ib0(ib0),o2ib1(ib1) 192.168.10.1.[101-102]
| |
| ■ Client with the odd IP address
| |
| options lnet ip2nets=o2ib0(ib0) 192.168.10.[103-253/2]
| |
| ■ Client with the even IP address
| |
| options lnet ip2nets=o2ib1(ib0) 192.168.10.[102-254/2]
| |
| | |
| 7.3.2 Start servers
| |
| | |
| To start the MGS and MDT server, run:
| |
| modprobe lnet
| |
| To start MGS and MDT, run:
| |
| $ mkfs.lustre --fsname lustre --mdt --mgs /dev/sda
| |
| $ mkdir -p /mnt/test/mdt
| |
| $ mount -t lustre /dev/sda /mnt/test/mdt
| |
| $ mount -t lustre mgs@o2ib0:/lustre /mnt/mdt
| |
| | |
| To start the OSS, run:
| |
| $ mkfs.lustre --fsname lustre --ost --mgsnode=mds@o2ib0 /dev/sda
| |
| $ mkdir -p /mnt/test/mdt
| |
| $ mount -t lustre /dev/sda /mnt/test/ost
| |
| $ mount -t lustre mgs@o2ib0:/lustre /mnt/ost
| |
| | |
| | |
| 7.3.3 Start clients
| |
| | |
| For the IB client, run:
| |
| mount -t lustre
| |
| 192.168.10.101@o2ib0,192.168.10.102@o2ib1:/mds/client /mnt/lustre
| |
| | |
| | |
| | |
| For more information about othe LNET options, see 31.2.1 LNET OPtions in the Lustre Operations Manual | |
| | |
| For information about "How to build and configure Infiniband support for Lustre" the topic by thi =s nathe Lustre Knowledge Base in Appendix B in the Lustre Operations Manual.
| |
