WARNING: This is the _old_ Lustre wiki, and it is in the process of being retired. The information found here is all likely to be out of date. Please search the new wiki for more up to date information.

Lustre Design Documents: Difference between revisions

From Obsolete Lustre Wiki
Jump to navigationJump to search
No edit summary
 
(16 intermediate revisions by one other user not shown)
Line 1: Line 1:
About once a year, the Lustre Engineering team gathers to discuss new features under development and testing efforts.  In November 2009, the senior Lustre engineers met in conjunction with the SC'09 event in Portland, Oregon, to discuss designs for upcoming features and implementation status of current development projects.
The Lustre™ team has prepared several design documents as part of the [[Lustre_HPCS_Activities|DARPA High Productivity Computing Systems (HPCS) program]]:


* [[Media:SC09-kDMU-Code.pdf|Kernel DMU Project Review]] - Alex Zhuravlev
*[[Media:JKD_Wiki_V1_2009_08_07_Lustre_HPCS_Overview.pdf|''Lustre HPCS Design Overview'']]
* [[Media:SC09-SOM-Code.pdf|Size On MDS Project Review]] - Vitaly Fertman
*[[Media:FSCK_Design-2009-06-15-09.pdf|''Filesystem Integrity Check Design'']]
* [[Media:SC09-FID-on-OST.pdf|FIDs on OST Design Presentation]] - Mike Pershin
*[[Media:End-to-End-Integrity-2009-06-15.pdf|''End to End Data Integrity Design'']]
* [[Media:SC09-HSM-Code.pdf|HSM Project Review]] - Nathan Rutman
*[[Media:Channel Bonding_06_15_09.pdf|''LNET Channel Bonding Design'']]
* [[Media:SC09-SMP-Scaling.pdf|Server SMP Scaling Project Review]] - Liang Zhen
*[[Media:Rebuild_performance-2009-06-15.pdf|''Rebuild Performance Design'']]
* [[Media:SC09-Quota-Code.pdf|Quota Project Review]] - Johann Lombardi
*[[Media:HPCS_CMD_06_15_09.pdf|''Clustered Metadata Design'']]
* [[Media:SC09-Imperative-Recovery.pdf|Imperative Recovery Design Presentation]] - Nicolas
* [[Media:SC09-ZFS-End-to-End-Integrity.pdf|ZFS, Lustre, End-to-end Data Integrity BOF]] - Andreas Dilger
* [[Media:SC09-LOV-OSC.pdf|LOV/OSC/llog Redesign Presentation]] - Alex Zhuravlev
* [[Media:SC09-CMD-Code.pdf|Clustered Metadata Project Review]] - Tom Wang
* [[Media:SC09-Simplified-Interop.pdf|Simplified Interop (CSS) Design Presentation]] - Eric Mei


In November 2009, the senior Lustre engineers met in conjunction with the SC'09 event in Portland, Oregon, to discuss designs for upcoming features and implementation status of current development projects. The following project reviews and design presentations took place at this meeting:


The DARPA High Productivity Computing Systems (HPCS) project is a program created to ensure that US Government agencies continue to have access to the advanced high-performance computing technologies needed to fulfill their missions. The program objectives include achieving extremely high IO performance and file system scale and reliability. Cray Inc. has partnered with Sun to use Lustre to achieve these goals.  
* [[Media:SC09-kDMU-Code.pdf|''Kernel DMU Project Review'']] - Alex Zhuravlev
* [[Media:SC09-SOM-Code.pdf|''Size On MDS Project Review'']] - Vitaly Fertman
* [[Media:SC09-FID-on-OST.pdf|''FIDs on OST Design Presentation'']] - Mike Pershin
* [[Media:SC09-HSM-Code.pdf|''HSM Project Review'']] - Nathan Rutman
* [[Media:SC09-SMP-Scaling.pdf|''Server SMP Scaling Project Review'']] - Liang Zhen
* [[Media:SC09-Quota-Code.pdf|''Quota Project Review'']] - Johann Lombardi
* [[Media:SC09-Imperative-Recovery.pdf|''Imperative Recovery Design Presentation'']] - Nicolas
* [[Media:SC09-ZFS-End-to-End-Integrity.pdf|''ZFS, Lustre, End-to-end Data Integrity BOF'']] - Andreas Dilger
* [[Media:SC09-LOV-OSC.pdf|''LOV/OSC/llog Redesign Presentation'']] - Alex Zhuravlev
* [[Media:SC09-CMD-Code.pdf|''Clustered Metadata Project Review'']] - Tom Wang
* [[Media:SC09-Simplified-Interop.pdf|''Simplified Interop (CSS) Design Presentation'']] - Eric Mei


The Lustre team has prepared several design documents as part of the HPCS program. These designs are:
The [[Lustre Design Document Archive]] contains older architecture and design documents.
 
    * Lustre HPCS Design Overview
    * Filesystem Integrity Check Design
    * End to End Data Integrity Design
    * LNet Channel Bonding Design
    * Rebuild Performance Design
    * Clustered Metadata Design

Latest revision as of 11:06, 20 January 2011

The Lustre™ team has prepared several design documents as part of the DARPA High Productivity Computing Systems (HPCS) program:

In November 2009, the senior Lustre engineers met in conjunction with the SC'09 event in Portland, Oregon, to discuss designs for upcoming features and implementation status of current development projects. The following project reviews and design presentations took place at this meeting:

The Lustre Design Document Archive contains older architecture and design documents.