Lustre Design Documents

the designs reflect a certain point in time to the extent that a design finds itself in a feature in a release there will be other pages and assets on the wiki. Some of the information may not be current ... more historical. Latest presentations are current. The rest needs to be in an archive place. Some content may be out of date.

About once a year, the Lustre Engineering team gathers to discuss new features under development and testing efforts.

The Lustre team has prepared several design documents as part of the HPCS program. The DARPA High Productivity Computing Systems (HPCS) project is a program created to ensure that US Government agencies continue to have access to the advanced high-performance computing technologies needed to fulfill their missions. The program objectives include achieving extremely high IO performance and file system scale and reliability. Cray Inc. has partnered with Sun to use Lustre to achieve these goals.

In November 2009, the senior Lustre engineers met in conjunction with the SC'09 event in Portland, Oregon, to discuss designs for upcoming features and implementation status of current development projects.

The following presentations and design documents describe new Lustre features currently under development. They were made available as part of the the DARPA High Productivity Computing Systems (HPCS)project or presented at Supercomputing 2009 (SC'09).

• Kernel DMU Project Review (November 2009) - Alex Zhuravlev
• Size On MDS Project Review (November 2009) - Vitaly Fertman
• FIDs on OST Design Presentation (November 2009) - Mike Pershin
• HSM Project Review(November 2009) - Nathan Rutman
• Server SMP Scaling Project Review (November 2009) - Liang Zhen
• Quota Project Review (November 2009) - Johann Lombardi
• Imperative Recovery Design Presentation(November 2009) - Nicolas
• ZFS, Lustre, End-to-end Data Integrity BOF (November 2009) - Andreas Dilger
• LOV/OSC/llog Redesign Presentation (November 2009) - Alex Zhuravlev
• Clustered Metadata Project Review (November 2009) - Tom Wang
• Simplified Interop (CSS) Design Presentation (November 2009) - Eric Mei

The DARPA High Productivity Computing Systems (HPCS) project is a program created to ensure that US Government agencies continue to have access to the advanced high-performance computing technologies needed to fulfill their missions. The program objectives include achieving extremely high IO performance and file system scale and reliability. Cray Inc. has partnered with Sun to use Lustre to achieve these goals.

The Lustre team has prepared several design documents as part of the HPCS program. These designs are:

• Lustre HPCS Design Overview (June 2009)
• Filesystem Integrity Check Design(June 2009)
• End to End Data Integrity Design(June 2009)
• LNet Channel Bonding Design(June 2009)
• Rebuild Performance Design(June 2009)
• Clustered Metadata Design(June 2009)