WARNING: This is the _old_ Lustre wiki, and it is in the process of being retired. The information found here is all likely to be out of date. Please search the new wiki for more up to date information.

Metadata Performance Project: Difference between revisions

From Obsolete Lustre Wiki
Jump to navigationJump to search
(Created page with '<big><strong>MetaData Performance Project</strong></big> This is a joint project that the Lustre team, ORNL LCE, and Cray created in early spring of 2009. The project has the f...')
 
No edit summary
 
(25 intermediate revisions by one other user not shown)
Line 1: Line 1:
<big><strong>MetaData Performance Project</strong></big>  
<small>''(Updated: Jan 2010)''</small>


This is a joint project that the Lustre team, ORNL LCE, and Cray created in early spring of 2009. The project has the following primary goals:
The Metadata Performance Project is a joint project of the Lustre™ team, the ORNL LCE, and Cray initiated in early spring of 2009. Current areas of investigation include LNET, ''ptlrpc'', ''libcfs'', and the MDS server. The overall goal is to maximize single MDS performance through optimizations that utilize the multiple cores available in today's MDS machines.  
<ul>
<li>Understand current Lustre 1.6, 1.8, and 2.0 branch performance related to metadata performance
<li>Ensure the Lustre 1.6 branch performs as well as previous Lustre branches with respect to metadata
<li>Double the current average performance of Lustre 1.8 branch metadata performance
<li>Though introduction of clustered metadata early exposure in Lustre 2.0 until the general release of CMD, ensure that Lustre metadata scales and performs as well as, or better than, GPFS
</ul>


The project leader is [mailto:Nirant.Puntambekar@sun.com Nirant Puntambekar]
The project has the following primary goals:
*Understand current Lustre 1.6, 1.8, and 2.0 branch metadata performance characteristics.
*Double the metadata performance in the 2.x branch compared to the 1.6 baseline numbers.
*Investigate SMP scaling improvements for the Lustre metadata stack.


 
Baseline metadata [[Media:MD-perf-comparison.pdf|performance tests]] were completed by the Lustre team on May 11, 2009.
* [http://ornl-lce.clusterfs.com/index.php?title=Main_Page  Lustre Centre of Excellence at Oak Ridge National Laboratory]
<p>
Other Lustre Centers of Excellence are located at: Naval Research Laboratory.
<br>
<br>
Additionally, there are several Lustre Development Centers that work with Sun to make significant code and testing contributions to Lustre and the Lustre Community. These centers are located at CEA, Juelich, LLNL, and Sandia.

Latest revision as of 11:33, 22 February 2010

(Updated: Jan 2010)

The Metadata Performance Project is a joint project of the Lustre™ team, the ORNL LCE, and Cray initiated in early spring of 2009. Current areas of investigation include LNET, ptlrpc, libcfs, and the MDS server. The overall goal is to maximize single MDS performance through optimizations that utilize the multiple cores available in today's MDS machines.

The project has the following primary goals:

  • Understand current Lustre 1.6, 1.8, and 2.0 branch metadata performance characteristics.
  • Double the metadata performance in the 2.x branch compared to the 1.6 baseline numbers.
  • Investigate SMP scaling improvements for the Lustre metadata stack.

Baseline metadata performance tests were completed by the Lustre team on May 11, 2009.

Retrieved from "http://wiki.old.lustre.org/index.php?title=Metadata_Performance_Project&oldid=11215"