WARNING: This is the _old_ Lustre wiki, and it is in the process of being retired. The information found here is all likely to be out of date. Please search the new wiki for more up to date information.

Difference between revisions of "Lustre Center of Excellence at Oak Ridge National Laboratory"

From Obsolete Lustre Wiki
Jump to navigationJump to search
(Created page with 'The Sun Lustre Center of Excellence (LCE) at ORNL advances the state of Lustre for use in large scale HPC environments. As you'll see from the projects below, the ORNL LCE focuse...')
 
Line 3: Line 3:
 
==Current projects and their status==
 
==Current projects and their status==
 
===Applications IO Performance===
 
===Applications IO Performance===
Mike Booth, one of the LCE personnel, is investigating applications IO performance on the Lustre systems at ORNL to identify way to achieve more consistent and higher IO performance. He is also working on enhancing the ADIOS IO layer.  
+
Mike Booth, one of the LCE personnel, is investigating applications IO performance on the Lustre systems at ORNL to identify ways to achieve more consistent and higher IO performance. He is also working on enhancing the ADIOS IO layer.  
 
<p>
 
<p>
 
Feel free to [mailto:Michael.Booth@Sun.COM contact Mike] for more information and status of his work.
 
Feel free to [mailto:Michael.Booth@Sun.COM contact Mike] for more information and status of his work.
Line 16: Line 16:
  
 
===LCE Summit - February 2008===
 
===LCE Summit - February 2008===
*[[Media:LCE_Summit_Summary_Draft_March_14_2008.pdf|LCE Summit February 2008 Meeting Summary]]
+
*[[Media:LCE_Summit_Summary_Draft_March_14_2008.pdf|LCE Summit Meeting Summary]]
*[[Media:LCESummitSlides.pdf|LCE Summit February 2008 Slides and Notes]]
+
*[[Media:LCESummitSlides.pdf|LCE Summit Slides and Notes]]
  
 
===LCE Application I/O Workshop - April 16, 2008===
 
===LCE Application I/O Workshop - April 16, 2008===
*[[Media:April2008ApplicationIOWorkshop.pdf|April 2008 Application IO Workshop, Agenda and Notes]]
+
*[[Media:April2008ApplicationIOWorkshop.pdf|Application IO Workshop, Agenda and Notes]]
 
*[[Media:Lustre_workshop_WangDi.pdf|Lustre and Application IO - Wang Di's Slides]]
 
*[[Media:Lustre_workshop_WangDi.pdf|Lustre and Application IO - Wang Di's Slides]]
*[[Media:Lustre_workshop_Oleg.pdf|Lustre and Apllication IO - Oleg Drokin's Slides]]
+
*[[Media:Lustre_workshop_Oleg.pdf|Lustre and Application IO - Oleg Drokin's Slides]]
  
 
===Lustre Scalability Workshop - Feb 10 & 11, 2009, ORNL===
 
===Lustre Scalability Workshop - Feb 10 & 11, 2009, ORNL===
*[[Media:Notes_on_SW1_Notes.pdf|February Scalability Workshop Notes]]
+
*[[Media:Notes_on_SW1_Notes.pdf|Scalability Workshop Notes]]
 
*[[Media:LustreScalabilityWP_Updated.pdf|Scalability White Paper]]
 
*[[Media:LustreScalabilityWP_Updated.pdf|Scalability White Paper]]
 
*[[Media:Shipman_Feb_lustre_scalability.pdf|Galen Shipman's presentation]]
 
*[[Media:Shipman_Feb_lustre_scalability.pdf|Galen Shipman's presentation]]
Line 65: Line 65:
 
* [http://www.nccs.gov/2009/06/30/ornl-hosts-lustre-part-ii/ ORNL Hosts Lustre Part II]
 
* [http://www.nccs.gov/2009/06/30/ornl-hosts-lustre-part-ii/ ORNL Hosts Lustre Part II]
  
==Lustre internals manual==
+
==Lustre Internals Manual==
 
LCE and ORNL have written a Lustre filesystem internals document the describes the internal operation of Lustre.
 
LCE and ORNL have written a Lustre filesystem internals document the describes the internal operation of Lustre.
 
*[[Media:Understanding_Lustre_Filesystem_Internals.pdf|Understanding Lustre Filesystem Internals]]
 
*[[Media:Understanding_Lustre_Filesystem_Internals.pdf|Understanding Lustre Filesystem Internals]]

Revision as of 10:20, 8 July 2009

The Sun Lustre Center of Excellence (LCE) at ORNL advances the state of Lustre for use in large scale HPC environments. As you'll see from the projects below, the ORNL LCE focuses on both systems and applications aspects of ensuring that Lustre meets the needs of DOE and the HPC community in general.

Current projects and their status

Applications IO Performance

Mike Booth, one of the LCE personnel, is investigating applications IO performance on the Lustre systems at ORNL to identify ways to achieve more consistent and higher IO performance. He is also working on enhancing the ADIOS IO layer.

Feel free to contact Mike for more information and status of his work.

Events

The LCE sponsors events to encourage HPC community involvement in analyzing IO and storage requirements and identifying ways for Lustre to address these requirements.

The next event will be an Applications Workshop this Autumn 2009.

LCE Summit - February 2008

LCE Application I/O Workshop - April 16, 2008

Lustre Scalability Workshop - Feb 10 & 11, 2009, ORNL

Lustre Scalability Workshop - May 19 & 20, 2009, ORNL

The May Lustre Scalability Workshop at ORNL was focused on long term (2015) HPC IO and storage requirements and on presentations on the IO objectives of the DOD HPCS program and how Lustre will achieve them.

White Papers

LCE personnel have written a variety of papers on High Performance IO and potential Lustre features. Links to these documents are below.

Presentations

See the ORNL slides and video from their presentation at LUG 2009.

Press Articles

Lustre Internals Manual

LCE and ORNL have written a Lustre filesystem internals document the describes the internal operation of Lustre.


For more information about computing at Oak Ridge, click here.

If you have questions or comments on this page or the LCE projects, contact John Dawson.