WARNING: This is the _old_ Lustre wiki, and it is in the process of being retired. The information found here is all likely to be out of date. Please search the new wiki for more up to date information.

Main Page: Difference between revisions

From Obsolete Lustre Wiki
Jump to navigationJump to search
No edit summary
No edit summary
Line 1: Line 1:
=Cluster File Systems=
== What is Lustre®? ==
Cluster File Systemswill host the fourth annual Lustre User Group spring meeting April 18-20, 2006 on Hilton Head Island, SC.
The Lustre User Group was founded by Pacific Northwest National Laboratory and Lawrence Livermore National Laboratory to promote the use of the open source Lustre file system for HPC and scalable I/O. The annual meeting is an opportunity for current and prospective Lustre users to share and develop best practices, provide direct feedback to the development team at CFS, and receive an update on our plans for the coming year.


-------------------------------------------------------------------------------
Lustre® is a scalable, secure, robust, highly-available cluster file system. It is designed, developed and maintained by Cluster File Systems, Inc.


==Conference Schedule==
The central goal is the development of a next-generation cluster file system which can serve clusters with 10,000's of nodes, provide petabytes of storage, and move 100's of GB/sec with state-of-the-art security and management infrastructure.
The target attendees for this meeting are users or administrators of a Lustre file system, and partners/resellers with Lustre offerings. Developers or researchers working with Lustre are also welcome, but should note that there is little content specifically for developers.
To allow for requested topics and submitted presentations, the agenda has several open slots. Please let us know what you would like to see in the program, and we'll do our best to accomodate the most popular requests.
If you would like to make a presentation at the meeting, please send a short proposal to lustre2006-submissions@clusterfs.comThis e-mail address is being protected from spam bots, you need JavaScript enabled to view it . Due to limited availability, please limit your presentation to topics of general interest such as best practices, lessons learned, research projects based on Lustre, or similar. Please do not submit sales presentations, and please submit before March 24.
The last two half-day sessions will provide a structured, organized forum for identifying and clarifying Lustre's future requirements. The goals are to gather input from customers and partners, identify conflicting requirements, and prioritize the rest. This replaces the half-day group discussions of the previous two LUG meetings.
While everyone is welcome to attend the first 1.5 days of the meeting, CFS must ask that organizations designate no more than two representatives for the Lustre Requirements Forum. These individuals are historically the liasons from strategic CFS partners and users who can speak to their organizations' requirements. To help us get an accurate count, please indicate on the registration form whether you will attend the Lustre Requirements Forum.
===Tuesday April 18, 2006 ===


9:00-9:30 a.m. Welcome & Introduction
Lustre runs on many of the largest Linux clusters in the world, and is included by CFS's partners as a core component of their cluster offering (examples include HP StorageWorks SFS, and the Cray XT3 and XD1 supercomputers). Today's users have also demonstrated that Lustre scales down as well as it scales up, and runs in production on clusters as small as 4 and as large as 25,000 nodes.
Dr.Peter Braam - CFS President & CEO 


9:30-10:00 a.m.  CFS Business Overview
The latest version of Lustre is always available from Cluster File Systems, Inc. Public Open Source releases of Lustre are available under the GNU General Public License. These releases are found here, and are used in production supercomputing environments worldwide.
Jeffrey Denworth - CFS Director of Sales
10:00-10:30 a.m. CFS Support & QA Update
Peter Bojanic - CFS Director of Engineering
10:30-11:00 a.m. Break


11:00-12:00 a.m.  Lustre now and future:
To be informed of Lustre releases, subscribe to the lustre-announce mailing list.
architecture & roadmap


12:00-1:00 p.m. Lunch
Lustre development would not have been possible without funding and guidance from many organizations, including several U.S. National Laboratories, early adopters, and product partners.


1:00-1:30 p.m.  Lustre now and future:
== User Resources ==
architecture & roadmap


1:30-2:00 p.m.  Experiences with Lustre in a Seismic Processing Environment
* Lustre Downloads
Chevron Corporation
* Lustre Quick Start
* Mailing Lists
2:00-2:30 p.m.  Evaluating Lustre on DDR & SDR Infiniband
* Lustre Operations Manual
Dr.DK Panda - Ohio State University
* Filing Bugs
* Lustre Knowledge Base
3:00-3:30 p.m.  Break


3:30-3:45 p.m. Lustre - WAN Update
== Advanced User Resources ==
Chris Cribbs - NCSA


3:45-4:10 p.m.  CEA TERA10 100GB/s + Lustre Deployment
* How to build Lustre
Stephane Thiell - CEA DAM
* Kerberos
* Lustre Tuning
4:10-4:30 p.m. Bull Lustre Management Tools for Large Clusters
* LustreProc - A guide on the proc tunable parameters for Lustre and their usage. It describes several of the proc tunables including those that effect the client's RPC behavior and prepare for a substantial reorganization of proc entries.
Johann Lombardi - Bull
* Liblustre HowTo
6:00-9:00 p.m. Lustre Users Reception


===Wednesday April 19, 2006===


9:00-9:30 a.m.  Converged Communications Systems,
== Lustre Centres of Excellence™ ==
Parallel File Systems and Copious IO
Jose Miguel Peleato - Liquid


9:30-10:00 a.m.  Key Issues Deploying Lustre at HP Customer Sites
* ORNL
Fergal Mc Carthy - HP
* CEA
* LLNL
10:00-10:30 a.m.  Indiana University's Data Capacitor
* PSC
Steve Simms - Indiana University
* Tsinghua


10:30-11:00 a.m.  Break


11:00-11:30 a.m. Cray Experiences Deploying Terascale Lustre Environments
== Developer Resources ==
Peter Rigsbee - Cray
* Lustre Architecture
* Contribution Policy
* Developer Mailing List
* CVS usage
** CVS access to Lustre Source
** CVS Branches - How to manage branches with CVS.
** CVS Tips - Helpful things to know while using Lustre CVS.  
* Debugging Lustre - A guide to debugging Lustre.
* ZFS Resources - Learn about ZFS.
* Coding Guidelines - Developer guidelines to avoid problems during Lustre code merges.
* Portals Ping Server Client - Kernel modules used to test basic message passing of ports.


11:30-12:00 a.m.  Storage HW and Petascale I/O
== CFS Development Projects ==
Dave Fellinger - DataDirect Networks


12:00-1:00 p.m.  Lunch
* I/O Performance
* Lustre OSS/MDS with ZFS DMU


1:00-5:00 p.m.  Lustre Requirements Forum
-Requirements Survey
-Prioritization
-Refinement of Specific Requirements
-Break
-Implementation Scenarios
-Review


===Thursday April 20, 2006===  
== Community Development Projects ==
* Networking Development
* Diskless Booting
* DRBD and Lustre
* Bull- Open Source tools for Lustre
* LLNL- Lustre Monitoring Tool


9:00-12:00 a.m.  Lustre Requirements Forum
-Requirements Survey
-Prioritization
-Refinement of Specific Requirements
-Break
-Implementation Scenarios
-Review


-------------------------------------------------------------------------------
== Other Resources ==


==Registration==
* Lustre Publications - Papers and presentations about Lustre
Registration is open to all, however attendance is limited so please register early. While the registration deadline was Friday March 24, 2006, we will continue to accept registrations until the conference is full - however, we can no longer guarantee accommodations.
* Lustre User Group
There is a conference fee of US$300 to cover the costs of hosting the meeting. Payments may be made by purchase order, credit card (all major cards accepted through Paypal), money order, or check.
** Lustre User Group 2008 - coming soon
Click here to register
** Lustre User Group 2007
 
** Lustre User Group 2006
-------------------------------------------------------------------------------
** LUG Requirements Forum - LUG-Requirements-060420-final.pdf | LUG-Requirements-060420-final.xls
 
==Location, Travel, and Hotel==
The meeting will be held at The Westin Resort, Hilton Head Island, 3 miles from the Hilton Head Island Airport (HHH) and about 45 miles from Savannah International Airport (SAV).
CFS has negotiated a special group rate of $199/night, and have reserved a block of rooms for our attendees. In addition, there is a reserved block of Government Per Diem rate rooms at $112/night.
Rooms must be booked before March 24, 2006 to take advantage of this group rate.
We are in the process of completing the reservation arrangements; please check back on Februray 14 for details about how to book these discounted rooms.
 
-------------------------------------------------------------------------------
 
==Contact==
To submit a presentation proposal, please send email to lustre2006-submissions@clusterfs.comThis e-mail address is being protected from spam bots, you need JavaScript enabled to view it .
For all other questions and comments related to the meeting, please send email to lustre2006@clusterfs.comThis e-mail address is being protected from spam bots, you need JavaScript enabled to view it .
   
 
)

Revision as of 03:01, 21 January 2008

What is Lustre®?

Lustre® is a scalable, secure, robust, highly-available cluster file system. It is designed, developed and maintained by Cluster File Systems, Inc.

The central goal is the development of a next-generation cluster file system which can serve clusters with 10,000's of nodes, provide petabytes of storage, and move 100's of GB/sec with state-of-the-art security and management infrastructure.

Lustre runs on many of the largest Linux clusters in the world, and is included by CFS's partners as a core component of their cluster offering (examples include HP StorageWorks SFS, and the Cray XT3 and XD1 supercomputers). Today's users have also demonstrated that Lustre scales down as well as it scales up, and runs in production on clusters as small as 4 and as large as 25,000 nodes.

The latest version of Lustre is always available from Cluster File Systems, Inc. Public Open Source releases of Lustre are available under the GNU General Public License. These releases are found here, and are used in production supercomputing environments worldwide.

To be informed of Lustre releases, subscribe to the lustre-announce mailing list.

Lustre development would not have been possible without funding and guidance from many organizations, including several U.S. National Laboratories, early adopters, and product partners.

User Resources

  • Lustre Downloads
  • Lustre Quick Start
  • Mailing Lists
  • Lustre Operations Manual
  • Filing Bugs
  • Lustre Knowledge Base

Advanced User Resources

  • How to build Lustre
  • Kerberos
  • Lustre Tuning
  • LustreProc - A guide on the proc tunable parameters for Lustre and their usage. It describes several of the proc tunables including those that effect the client's RPC behavior and prepare for a substantial reorganization of proc entries.
  • Liblustre HowTo


Lustre Centres of Excellence™

  • ORNL
  • CEA
  • LLNL
  • PSC
  • Tsinghua


Developer Resources

  • Lustre Architecture
  • Contribution Policy
  • Developer Mailing List
  • CVS usage
    • CVS access to Lustre Source
    • CVS Branches - How to manage branches with CVS.
    • CVS Tips - Helpful things to know while using Lustre CVS.
  • Debugging Lustre - A guide to debugging Lustre.
  • ZFS Resources - Learn about ZFS.
  • Coding Guidelines - Developer guidelines to avoid problems during Lustre code merges.
  • Portals Ping Server Client - Kernel modules used to test basic message passing of ports.

CFS Development Projects

  • I/O Performance
  • Lustre OSS/MDS with ZFS DMU


Community Development Projects

  • Networking Development
  • Diskless Booting
  • DRBD and Lustre
  • Bull- Open Source tools for Lustre
  • LLNL- Lustre Monitoring Tool


Other Resources

  • Lustre Publications - Papers and presentations about Lustre
  • Lustre User Group
    • Lustre User Group 2008 - coming soon
    • Lustre User Group 2007
    • Lustre User Group 2006
    • LUG Requirements Forum - LUG-Requirements-060420-final.pdf | LUG-Requirements-060420-final.xls