WARNING: This is the _old_ Lustre wiki, and it is in the process of being retired. The information found here is all likely to be out of date. Please search the new wiki for more up to date information.

Difference between revisions of "Lustre HPCS Activities"

From Obsolete Lustre Wiki
Jump to navigationJump to search
(First draft os Lustre HPCS page)
 
 
(8 intermediate revisions by 3 users not shown)
Line 1: Line 1:
The DARPA High Productivity Computing Systems project isa  program created to ensure that US Government agencies continue to have access to the advanced high-performance computing technologies needed to fulfill their missions
+
<small>''(Updated: Aug 2009)''</small>
  
Includes a number of “Mission Partners”(DOE, DoD, NSF, NSA, NNSA, etc) who work with DARPA to ensure that the systems developed under the program will meet their current and future needs
+
The DARPA High Productivity Computing Systems (HPCS) project is a  program created to ensure that US Government agencies continue to have access to the advanced high-performance computing technologies needed to fulfill their missions. The program objectives include achieving extremely high IO performance and file system scale and reliability. [http://www.cray.com Cray Inc.] has partnered with Sun to use Lustre™ to achieve these goals.
  
Commercial viability of the resulting system design is a key goal
+
General information on the HPCS program is available at:
  
Online resources
+
*http://www.highproductivity.org/
  
http://www.highproductivity.org/
+
*http://www.darpa.mil/ipto/programs/hpcs/hpcs.asp
  
http://www.darpa.mil/ipto/programs/hpcs/hpcs.asp
+
John Carrier of Cray, Inc. presented an overview of the HPCS IO project at the Lustre User Group meeting in April of 2008. The slides and video of John Carrier's presentation can be found here:
 +
 
 +
*[[Media:LUG08_Cray_HPCS.pdf|''DARPA HPCS Project Slides'']] and *[http://video.google.com/videoplay?docid=-5970693206965456534&hl=en ''Video''] - John Carrier, Cray Inc.
 +
 
 +
There were three presentations on the HPCS IO project at the Scalability Workshop held by the [[Lustre Center of Excellence at Oak Ridge National Laboratory]] in May, 2009.
 +
 
 +
*[[Media:Carrier_2009-05-19_ORNL_LCE_HPCS.pdf|''HPCS IO'' - John Carrier, Cray Inc.]]
 +
*[[Media:Newman_May_Lustre_Workshop.pdf|''What is HPCS and How Does it Impact IO'' - Henry Newman, Instrumental Inc.]]
 +
*[[Media:Dilger_Lustre_HPCS_May_Workshop.pdf|''Lustre HPCS Design Overview'' - Andreas Dilger, Sun Microsystems]]
 +
 
 +
The Lustre team has prepared several design documents as part of the HPCS program. These designs are:
 +
 
 +
*[[Media:JKD_Wiki_V1_2009_08_07_Lustre_HPCS_Overview.pdf|''Lustre HPCS Design Overview'']]
 +
*[[Media:FSCK_Design-2009-06-15-09.pdf|''Filesystem Integrity Check Design'']]
 +
*[[Media:End-to-End-Integrity-2009-06-15.pdf|''End to End Data Integrity Design'']]
 +
*[[Media:Channel Bonding_06_15_09.pdf|''LNet Channel Bonding Design'']]
 +
*[[Media:Rebuild_performance-2009-06-15.pdf|''Rebuild Performance Design'']]
 +
*[[Media:HPCS_CMD_06_15_09.pdf|''Clustered Metadata Design'']]

Latest revision as of 11:02, 20 January 2011

(Updated: Aug 2009)

The DARPA High Productivity Computing Systems (HPCS) project is a program created to ensure that US Government agencies continue to have access to the advanced high-performance computing technologies needed to fulfill their missions. The program objectives include achieving extremely high IO performance and file system scale and reliability. Cray Inc. has partnered with Sun to use Lustre™ to achieve these goals.

General information on the HPCS program is available at:

John Carrier of Cray, Inc. presented an overview of the HPCS IO project at the Lustre User Group meeting in April of 2008. The slides and video of John Carrier's presentation can be found here:

There were three presentations on the HPCS IO project at the Scalability Workshop held by the Lustre Center of Excellence at Oak Ridge National Laboratory in May, 2009.

The Lustre team has prepared several design documents as part of the HPCS program. These designs are: