Architecture - LRE Images

Note: The content on this page reflects the state of design of a Lustre feature at a particular point in time and may contain outdated information.

Definitions

LRE	A Lustre software environment including OS images, Lustre software and partial configurations
LRE Deployment	A fully configured Lustre system using completely configured LRE software with precisely defined and configured hardware.
LRE Certification	The process of adjusting configurations and settings in an LRE Deployment in order for it to pass regression tests which confirm near optimal performance and feature avaialability.
Image	A root file system for an operating system, packaged as: (1) a disk file system image (2) a file system subtree (3) a vmware image (4) a complete archive (e.g. cpio, not tar). An image is a component of an LRE.
Embedded Image	An management or build image that is provided as a subdirectory of the Build OS file system
Bootable image	An image that is provided as a the root file system for a bootable system.
Lustre Image	An image that can run and boot on a Lustre node. It is expected the Deployed LREs will include client systems configured without LRE software, but servers will run LRE software.
Build Image	An image that contains all tools to build Lustre software required by the LRE. The build image will have the tools to produce packages and compiled source trees from downloaded source archives and from source control checkout sources.
Management Image	An image that contains management software for Lustre such as facilities to receive cored dumps and logs and to perform software upgrades. A management image supports NFS PXE booting and install and/or updating of installed disk/flash images on Lustre servers. All updates shall be reversible. A management image can contain tools to analyze core dumps and do remote debugging.
Operations on images	Upgrading kernels and Lustre, possibly other operations.
Desktop OS	When LREs are used for development or training and are running in virtual machines, there is a Desktop OS installation containing VMWare (or equivalent) and Images.

LRE Deployments

Customer and Partners	Customers ideally run a server farm using a certified LRE deployment.
Developers	Lustre developers need an LRE that includes Lustre images, Build images and management images for the LRE's for which they do development.
Training and Exploration	People learning about Lustre need a small LRE suitable for exploring Lustre, including Lustre and a Management Image.
QA	The QA teams need access to all types of LRE Deployments that are actively supported.

Development LREs

Development LREs are configured to be most attractive to developers. The following should be addressed:

1. Sources may reside in the Desktop OS or in a file system in the Build Image
2. The Desktop OS will be used for
   • Editing source
   • Source control
   • Patch management
3. A build environment should be available as:
   • A subdirectory to which a chroot followed by make happens
   • A virtual machine image with a shared file system with the Desktop OS
4. The management software
   • May be integrated with the Desktop OS
   • May reside in the build image or a separate management image.

LRE Availability

The LRE software will provide:

• Downloadable images in all formats (vmware images, cpio archives, fs images)
• A management system to update images to a newer version.
• Trivially usable configuration scripts to combine images into an LRE
• Easily usable scripts to reconstruct images

Initial Goals

• Use Ubuntu 6.10 as Desktop OS
• Use architectures x64_86 and i686
• Provide a development and training LRE based on supported environments for Lustre:
  • RHEL4
  • SLES9
  • SLES10
  • REL3
• The training LRE shall have all images in vmware, essentially in a similar environment as currently available
• The development LRE shall have a build and management image embedded in the desktop OS
• The development LRE shall be able to boot two vmware teams:
  • minimal: everything will run in one system
  • training: the training LRE with separate clients/servers and shared disks
• Acceptance of the work:
  • Demonstrate that the LRE is capable of rebuilding current production kernel and Lustre (1.4 & 1.6) packages for this LRE
  • Demonstrate a reasonable development environment
  • Demonstrate a quick install after download
  • Demonstrate that the class labs can run
  • Demonstrate a download area for images and image updates
  • Provide well written instructions for deploying the training and development LRE