WARNING: This is the _old_ Lustre wiki, and it is in the process of being retired. The information found here is all likely to be out of date. Please search the new wiki for more up to date information.

Main Page: Difference between revisions

From Obsolete Lustre Wiki
Jump to navigationJump to search
No edit summary
Line 1: Line 1:
== Links to Lustre resources and knowledge ==
* Lustre Architecture Wiki - http://arch.lustre.org
* Lustre Manual and Documentation - http://manual.lustre.org
* Lustre Centre of Excellence Wiki Sites
** ORNL LCE Wiki - http://ornl-lce.clusterfs.com
* Lustre I/O Performance Project Page - http://wiki.lustre.org/index.php?title=IOPerformanceProject
== What is Lustre®? ==
== What is Lustre®? ==


Lustre® is a scalable, secure, robust, highly-available cluster file system. It is designed, developed and maintained by [http://www.clusterfs.com Cluster File Systems, Inc.]
Lustre® is a scalable, secure, robust, highly-available cluster file system. It is designed, developed and maintained by [http://www.clusterfs.com Cluster File Systems, Inc.]


The central goal is the development of a next-generation cluster file system which can serve clusters with 10,000's of nodes, petabytes of storage, move 100's of GB/sec with state of the art security and management infrastructure.
The central goal is the development of a next-generation cluster file system which can serve clusters with 10,000's of nodes, provide petabytes of storage, and move 100's of GB/sec with state-of-the-art security and management infrastructure.
 
Lustre runs on many of the largest Linux clusters in the world, and is included by CFS's partners as a core component of their cluster offering (examples include HP StorageWorks SFS, and the Cray XT3 and XD1 supercomputers). Today's users have also demonstrated that Lustre scales down as well as it scales up, and runs in production on clusters as small as 4 and as large as 25,000 nodes.


Lustre runs today on many of the largest Linux clusters in the world, and is included by CFS's partners as a core component of their cluster offering (examples include HP StorageWorks SFS, and the Cray XT3 and XD1 supercomputers). Today's users have also demonstrated that Lustre scales down as well as it scales up, and run in production on clusters as small as 4 and as large as 25,000 nodes.
The latest version of Lustre is always available from [http://www.clusterfs.com Cluster File Systems, Inc.] Public Open Source releases of Lustre are available under the GNU General Public License. These releases are [http://www.clusterfs.com/download.html found here], and are used in production supercomputing environments worldwide.


The latest version of Lustre is always available from [http://www.clusterfs.com Cluster File Systems, Inc.] Public Open Source releases of Lustre are made under the GNU General Public License. These releases are [http://www.clusterfs.com/download.html found here], and are used in production supercomputing environments worldwide.
To be informed of Lustre releases, subscribe to the [https://mail.clusterfs.com/mailman/listinfo/lustre-announce lustre-announce mailing list].


You may subscribe to the [https://mail.clusterfs.com/mailman/listinfo/lustre-announce lustre-announce mailing list] to be informed of releases.
Lustre development would not have been possible without funding and guidance from many organizations, including several U.S. National Laboratories, early adopters, and product partners.


Lustre development would not have been possible without funding and guidance from many organizations, including several US National Laboratories, early adopters, and product partners.
== User Resources ==


== Documentation ==
* [http://www.clusterfs.com/download.html Lustre Downloads]
* [http://wiki.lustre.org/index.php?title=Lustre_Quick_Start Lustre Quick Start]
*[http://wiki.lustre.org/index.php?title=Lustre_Documentation Lustre Documentation] - Links to the Lustre Operations Manual and older documents
* [http://wiki.lustre.org/index.php?title=Mailing_Lists Mailing Lists]
* [http://manual.lustre.org Lustre Operations Manual]
* [http://wiki.lustre.org/index.php?title=Bug_Filing Filing Bugs]
* [https://bugzilla.lustre.org/showdependencytree.cgi?id=2374 Lustre Knowledge Base]


== Lustre User Group ==
== Advanced User Resources ==
* How to build Lustre
* [http://wiki.lustre.org/index.php?title=Kerb_Lustre Kerberos]
* Lustre Tuning
* [http://wiki.lustre.org/images/7/78/LustreManual.html#Chapter_III-2._LustreProc LustreProc] - A guide on the '''proc''' tunable parameters for Lustre and their usage. It describes several of the '''proc''' tunables including those that effect the client's RPC behavior and prepare for a substantial reorganization of '''proc''' entries.
* [http://wiki.lustre.org/index.php?title=LibLustre_HowTo Liblustre HowTo]


* LUG Requirements Forum - [http://wiki.lustre.org/images/7/78/LUG-Requirements-060420-final.pdf LUG-Requirements-060420-final.pdf] | [http://wiki.lustre.org/images/7/78/LUG-Requirements-060420-final.xls LUG-Requirements-060420-final.xls]
== Lustre Centres of Excellence™ ==
* Lustre Users Group
* [http://ornl-lce.clusterfs.com/index.php?title=Main_Page ORNL]
** [http://www.clusterfs.com/lustre2007.html Lustre User Group 2007]
* CEA
** [http://www.clusterfs.com/lustre2006.html Lustre User Group 2006]
* LLNL
* Tsinghua


== Lustre Publications ==
== Developer Resources ==


* [http://wiki.lustre.org/index.php?title=Lustre_Publications Lustre Publications] - Papers and presentations about Lustre
* [http://arch.lustre.org Lustre Architecture]
* [http://wiki.lustre.org/index.php?title=Contribution_Policy Contribution Policy]
* [http://wiki.lustre.org/index.php?title=Mailing_List Developer Mailing List]
* CVS usage
** [http://wiki.lustre.org/index.php?title=Cvs_Branches CvsBranches] - How to manage branches with CVS.
** [http://wiki.lustre.org/index.php?title=Cvs_Tips CvsTips] - Helpful things to know while using Lustre CVS.
* [http://wiki.lustre.org/index.php?title=Lustre_Debugging Debugging Lustre] - A guide to Lustre debugging.
* [http://wiki.lustre.org/index.php?title=ZFS_Resources ZFS Resources] - Learn about ZFS.


== Community Development Activities ==
== CFS Development Projects  ==
* [http://wiki.lustre.org/index.php?title=IOPerformanceProject I/O Performance]


== Community Development Projects==
* [http://wiki.lustre.org/index.php?title=Networking_Development NetworkingDevelopment]
* [http://wiki.lustre.org/index.php?title=Networking_Development NetworkingDevelopment]
* [http://wiki.lustre.org/index.php?title=Diskless_Booting DisklessBooting]
* [http://wiki.lustre.org/index.php?title=Diskless_Booting DisklessBooting]
* [http://wiki.lustre.org/index.php?title=Parallel_Io_Enhancements ParallelIoEnhancements]
* [http://wiki.lustre.org/index.php?title=Drbd_And_Lustre DrbdAndLustre]
* [http://wiki.lustre.org/index.php?title=Drbd_And_Lustre DrbdAndLustre]
* Bull- Open Source tools for Lustre http://www.bullopensource.org/lustre
* [http://www.bullopensource.org/lustre Bull- Open Source tools for Lustre]
* LLNL- Lustre Monitoring Tool http://www.sourceforge.net/projects/lmt/
* [http://www.sourceforge.net/projects/lmt LLNL- Lustre Monitoring Tool]
* [http://wiki.lustre.org/index.php?title=Contributed_Patches_And_Code ContributedPatchesAndCode]
* [http://wiki.lustre.org/index.php?title=Contributed_Patches_And_Code ContributedPatchesAndCode]


== Lustre Testing & QA ==
== Other Resources ==
 
* [http://wiki.lustre.org/index.php?title=Lustre_Publications Lustre Publications] - Papers and presentations about Lustre
* [http://wiki.lustre.org/images/7/78/vision-scope.html  Vision & Scope of New Testing System] and [http://wiki.lustre.org/images/7/78/use-cases.html Use Cases]
* [http://wiki.lustre.org/index.php?title=Lustre_User_Group Lustre User Group]
* Buffalo Test Reports (http://buffalo.lustre.org)
** LUG Requirements Forum - [http://wiki.lustre.org/images/7/78/LUG-Requirements-060420-final.pdf LUG-Requirements-060420-final.pdf] | [http://wiki.lustre.org/images/7/78/LUG-Requirements-060420-final.xls LUG-Requirements-060420-final.xls]
* '''[http://wiki.lustre.org/index.php?title=Lustre_Testing LustreTesting]''' - Our QA practices, procedures and support infrastructure.
** [http://www.clusterfs.com/lustre2007.html Lustre User Group 2007]
* '''[http://wiki.lustre.org/index.php?title=Testing_Tools TestingTools]''' - Help on some of available Lustre testing tools.(l2dbench, echo client/server etc..)
** [http://www.clusterfs.com/lustre2006.html Lustre User Group 2006]
 
== Development Practices ==
 
* '''Bugs'''
** '''[http://wiki.lustre.org/index.php?title=Bug_Filing BugFiling]''' - A guide for testers.
** '''[http://wiki.lustre.org/index.php?title=Bug_Management BugManagement]''' - How to accept and manage bug fixings with Bugzilla.
** Lustre Bugzilla (http://bugzilla.lustre.org)
* '''Development'''
** '''[http://wiki.lustre.org/index.php?title=Coding_Guide_lines CodingGuidelines]''' - Formatting and indentation that should strictly be followed for any code checked into any branch.
** '''[http://wiki.lustre.org/index.php?title=Contribution_Policy ContributionPolicy]''' - What to do to get your changes in.
** '''[http://wiki.lustre.org/index.php?title=Cvs_Branches CvsBranches]''' - How to manage branches with CVS.
** '''[http://wiki.lustre.org/index.php?title=Cvs_Tips CvsTips]''' - Helpful things to know while using Lustre CVS.
** '''[http://wiki.lustre.org/index.php?title=Kernel_Patch_Management KernelPatchManagement]''' - How to handle the kernel patches.
** '''[http://wiki.lustre.org/index.php?title=Lustre_Debugging LustreDebugging]''' - A guide to Lustre debugging.
** '''[http://wiki.lustre.org/index.php?title=Lustre_Uml LustreUml]''' - Setting up and running Lustre on UMLs.
** '''[http://wiki.lustre.org/index.php?title=Development_Cluster DevelopmentCluster]''' - Properties of a cluster that offers a good debugging environment.
** '''[http://wiki.lustre.org/index.php?title=Linux_Debugging LinuxDebugging]''' - Debugging tools available for Linux kernel debugging(Kgdb, vmware, netdump, netconsole).
* '''Release Engineering'''
** '''[http://wiki.lustre.org/index.php?title=Release_Planning ReleasePlanning]''' - What QA goals accompany merges and releases.
** '''[http://wiki.lustre.org/index.php?title=Kernel_Patch_Management KernelPatchManagement]''' - How to handle the kernel patches.
** '''[http://wiki.lustre.org/index.php?title=Lustre_Statuson_Linux26 LustreStatusonLinux26]'''  - Contributed patches and debugging hints
 
== Some Design Information ==
 
* '''[http://wiki.lustre.org/index.php?title=Ext3_Development Ext3Development]''' - community ext3 development work
* '''[http://wiki.lustre.org/index.php?title=File_Creation FileCreation]''' - Alternative file create path
* '''[http://wiki.lustre.org/index.php?title=Design_Changes DesignChanges]''' - Design work summary of last 6 months
** '''[http://wiki.lustre.org/index.php?title=Lock_Refinements LockRefinements]''' - Lustre Lite Performance lock refinements
** '''[http://wiki.lustre.org/index.php?title=Import_Statest ImportStates]''' - Refine client import states.
* '''[http://wiki.lustre.org/index.php?title=Recovery_Overview RecoveryOverview]''' - How Lustre recovers from various failure cases.
* '''[http://wiki.lustre.org/index.php?title=Service_Monitors ServiceMonitors]''' - Design for permanent Lustre service monitoring.
* '''[http://wiki.lustre.org/index.php?title=Raid5_Patches Raid5Patches]''' - patches to Linux RAID5 code to improve Lustre performance
 
----

Revision as of 23:44, 4 July 2007

What is Lustre®?

Lustre® is a scalable, secure, robust, highly-available cluster file system. It is designed, developed and maintained by Cluster File Systems, Inc.

The central goal is the development of a next-generation cluster file system which can serve clusters with 10,000's of nodes, provide petabytes of storage, and move 100's of GB/sec with state-of-the-art security and management infrastructure.

Lustre runs on many of the largest Linux clusters in the world, and is included by CFS's partners as a core component of their cluster offering (examples include HP StorageWorks SFS, and the Cray XT3 and XD1 supercomputers). Today's users have also demonstrated that Lustre scales down as well as it scales up, and runs in production on clusters as small as 4 and as large as 25,000 nodes.

The latest version of Lustre is always available from Cluster File Systems, Inc. Public Open Source releases of Lustre are available under the GNU General Public License. These releases are found here, and are used in production supercomputing environments worldwide.

To be informed of Lustre releases, subscribe to the lustre-announce mailing list.

Lustre development would not have been possible without funding and guidance from many organizations, including several U.S. National Laboratories, early adopters, and product partners.

User Resources

Advanced User Resources

  • How to build Lustre
  • Kerberos
  • Lustre Tuning
  • LustreProc - A guide on the proc tunable parameters for Lustre and their usage. It describes several of the proc tunables including those that effect the client's RPC behavior and prepare for a substantial reorganization of proc entries.
  • Liblustre HowTo

Lustre Centres of Excellence™

  • ORNL
  • CEA
  • LLNL
  • Tsinghua

Developer Resources

CFS Development Projects

Community Development Projects

Other Resources