Architecture Descriptions - Revision history

Sbarthel at 19:09, 20 January 2011

2011-01-20T19:09:28Z

← Older revision		Revision as of 12:09, 20 January 2011
Line 53:		Line 53:
	[[Architecture - Interoperability fids zfs\|''Interoperability fids zfs'' ]] (Client, server, network, storage interoperability during migration to clusters based on file identifiers and the ZFS file system)		[[Architecture - Interoperability fids zfs\|''Interoperability fids zfs'' ]] (Client, server, network, storage interoperability during migration to clusters based on file identifiers and the ZFS file system)

	[[Architecture - Interoperability 1.6 / 1.8 / 2.0\|''Interoperability 1.6 1.8 2.0'' ]] (interoperability definitions and QAS summary)		[[Architecture - Interoperability 1.6 1.8 2.0\|''Interoperability 1.6 / 1.8 / 2.0'' ]] (interoperability definitions and QAS summary)

	[[Architecture - IO system\|''IO system'' ]] (Client IO and server I/O request handling)		[[Architecture - IO system\|''IO system'' ]] (Client IO and server I/O request handling)

Sbarthel at 19:08, 20 January 2011

2011-01-20T19:08:44Z

← Older revision		Revision as of 12:08, 20 January 2011
Line 7:		Line 7:
	[[Architecture - Adaptive Timeouts - Use Cases\|''Adaptive Timeouts - Use Cases'' ]] (Network RPC timeouts based on server and network loading)		[[Architecture - Adaptive Timeouts - Use Cases\|''Adaptive Timeouts - Use Cases'' ]] (Network RPC timeouts based on server and network loading)

	[[Architecture - ''~~Backup\|~~Backup'' ]] (File system backup)		[[Architecture - Backup\|''Backup'' ]] (File system backup)

	[[Architecture - Caching OSS\|''Caching OSS'' ]] (Caching on object storage servers)		[[Architecture - Caching OSS\|''Caching OSS'' ]] (Caching on object storage servers)
Line 53:		Line 53:
	[[Architecture - Interoperability fids zfs\|''Interoperability fids zfs'' ]] (Client, server, network, storage interoperability during migration to clusters based on file identifiers and the ZFS file system)		[[Architecture - Interoperability fids zfs\|''Interoperability fids zfs'' ]] (Client, server, network, storage interoperability during migration to clusters based on file identifiers and the ZFS file system)

	[[Architecture - Interoperability 1.6 1.8 2.0\|''Interoperability 1.6 1.8 2.0'' ]] (interoperability definitions and QAS summary)		[[Architecture - Interoperability 1.6 / 1.8 / 2.0\|''Interoperability 1.6 1.8 2.0'' ]] (interoperability definitions and QAS summary)

	[[Architecture - IO system\|''IO system'' ]] (Client IO and server I/O request handling)		[[Architecture - IO system\|''IO system'' ]] (Client IO and server I/O request handling)

Sbarthel at 19:07, 20 January 2011

2011-01-20T19:07:56Z

Show changes

Sbarthel at 13:36, 22 February 2010

2010-02-22T13:36:06Z

← Older revision		Revision as of 06:36, 22 February 2010
Line 1:		Line 1:
	''(Updated: Jan 2010)''		<small>''(Updated: Jan 2010)''</small>

	The architecture descriptions listed below provide information about Lustre architecture and design and are intended to help users better understand the conceptual framework of the Lustre file system.		The architecture descriptions listed below provide information about Lustre architecture and design and are intended to help users better understand the conceptual framework of the Lustre file system.

Sbarthel at 19:33, 21 February 2010

2010-02-21T19:33:38Z

← Older revision		Revision as of 12:33, 21 February 2010
Line 1:		Line 1:
			''(Updated: Jan 2010)''

	The architecture descriptions listed below provide information about Lustre architecture and design and are intended to help users better understand the conceptual framework of the Lustre file system.		The architecture descriptions listed below provide information about Lustre architecture and design and are intended to help users better understand the conceptual framework of the Lustre file system.

Line 136:		Line 138:

	[[Architecture - ZFS TinyZAP\|ZFS TinyZAP ]] (A compact ZFS Attribute Processor format that allows arbitrary values to be stored)		[[Architecture - ZFS TinyZAP\|ZFS TinyZAP ]] (A compact ZFS Attribute Processor format that allows arbitrary values to be stored)

	~~''(Updated 1/10)''~~

Docadmin at 01:10, 10 February 2010

2010-02-10T01:10:33Z

← Older revision		Revision as of 18:10, 9 February 2010
Line 136:		Line 136:

	[[Architecture - ZFS TinyZAP\|ZFS TinyZAP ]] (A compact ZFS Attribute Processor format that allows arbitrary values to be stored)		[[Architecture - ZFS TinyZAP\|ZFS TinyZAP ]] (A compact ZFS Attribute Processor format that allows arbitrary values to be stored)

			''(Updated 1/10)''

Docadmin at 21:28, 22 January 2010

2010-01-22T21:28:55Z

← Older revision		Revision as of 14:28, 22 January 2010
Line 26:		Line 26:

	[[Architecture - DMU OSD\|DMU OSD ]] (An implementation of the Object Storage Device API for a Data Management Unit)		[[Architecture - DMU OSD\|DMU OSD ]] (An implementation of the Object Storage Device API for a Data Management Unit)

	~~[[Architecture - DMU Zerocopy\|DMU Zerocopy ]]~~

	[[Architecture - End-to-end Checksumming\|End-to-end Checksumming ]] (Lustre network checksumming)		[[Architecture - End-to-end Checksumming\|End-to-end Checksumming ]] (Lustre network checksumming)

Docadmin at 20:56, 22 January 2010

2010-01-22T20:56:50Z

Docadmin at 20:52, 22 January 2010

2010-01-22T20:52:40Z

← Older revision		Revision as of 13:52, 22 January 2010
Line 3:		Line 3:
	'''''Note:''''' ''These documents reflect the state of design of a Lustre feature at a particular point in time. They many contain information that is incomplete or obsolete and may not reflect the current architecture, features and functionality of Lustre.''		'''''Note:''''' ''These documents reflect the state of design of a Lustre feature at a particular point in time. They many contain information that is incomplete or obsolete and may not reflect the current architecture, features and functionality of Lustre.''

	[[Architecture - Adaptive Timeouts - Use Cases\|Adaptive Timeouts - Use Cases ]]		[[Architecture - Adaptive Timeouts - Use Cases\|Adaptive Timeouts - Use Cases ]] (Network RPC timeouts based on server and network loading - architecture, use cases)

	[[Architecture - Backup\|Backup ]] (File system backup)		[[Architecture - Backup\|Backup ]] (File system backup)

Docadmin at 20:51, 22 January 2010

2010-01-22T20:51:28Z

← Older revision		Revision as of 13:51, 22 January 2010
Line 135:		Line 135:
	[[Architecture - ZFS for Lustre\|ZFS for Lustre ]] (Architecture and requirements related to Lustre servers using the ZFS Data Management Unit)		[[Architecture - ZFS for Lustre\|ZFS for Lustre ]] (Architecture and requirements related to Lustre servers using the ZFS Data Management Unit)

	[[Architecture - ZFS large dnodes\|ZFS large dnodes ]] (		[[Architecture - ZFS large dnodes\|ZFS large dnodes ]] (Increased dnode size to allow more data in the inode - use cases, implementation constraints)

	[[Architecture - ZFS TinyZAP\|ZFS TinyZAP ]]		[[Architecture - ZFS TinyZAP\|ZFS TinyZAP ]] (A compact ZFS Attribute Processor format that allows arbitrary values to be stored - use cases, implementation constraints)

← Older revision		Revision as of 12:09, 20 January 2011
Line 53:		Line 53:
	[[Architecture - Interoperability fids zfs\|''Interoperability fids zfs'' ]] (Client, server, network, storage interoperability during migration to clusters based on file identifiers and the ZFS file system)		[[Architecture - Interoperability fids zfs\|''Interoperability fids zfs'' ]] (Client, server, network, storage interoperability during migration to clusters based on file identifiers and the ZFS file system)

	[[Architecture - Interoperability 1.6 / 1.8 / 2.0\|''Interoperability 1.6 1.8 2.0'' ]] (interoperability definitions and QAS summary)		[[Architecture - Interoperability 1.6 1.8 2.0\|''Interoperability 1.6 / 1.8 / 2.0'' ]] (interoperability definitions and QAS summary)

	[[Architecture - IO system\|''IO system'' ]] (Client IO and server I/O request handling)		[[Architecture - IO system\|''IO system'' ]] (Client IO and server I/O request handling)

← Older revision		Revision as of 12:08, 20 January 2011
Line 7:		Line 7:
	[[Architecture - Adaptive Timeouts - Use Cases\|''Adaptive Timeouts - Use Cases'' ]] (Network RPC timeouts based on server and network loading)		[[Architecture - Adaptive Timeouts - Use Cases\|''Adaptive Timeouts - Use Cases'' ]] (Network RPC timeouts based on server and network loading)

	[[Architecture - ''~~Backup\|~~Backup'' ]] (File system backup)		[[Architecture - Backup\|''Backup'' ]] (File system backup)

	[[Architecture - Caching OSS\|''Caching OSS'' ]] (Caching on object storage servers)		[[Architecture - Caching OSS\|''Caching OSS'' ]] (Caching on object storage servers)
Line 53:		Line 53:
	[[Architecture - Interoperability fids zfs\|''Interoperability fids zfs'' ]] (Client, server, network, storage interoperability during migration to clusters based on file identifiers and the ZFS file system)		[[Architecture - Interoperability fids zfs\|''Interoperability fids zfs'' ]] (Client, server, network, storage interoperability during migration to clusters based on file identifiers and the ZFS file system)

	[[Architecture - Interoperability 1.6 1.8 2.0\|''Interoperability 1.6 1.8 2.0'' ]] (interoperability definitions and QAS summary)		[[Architecture - Interoperability 1.6 / 1.8 / 2.0\|''Interoperability 1.6 1.8 2.0'' ]] (interoperability definitions and QAS summary)

	[[Architecture - IO system\|''IO system'' ]] (Client IO and server I/O request handling)		[[Architecture - IO system\|''IO system'' ]] (Client IO and server I/O request handling)

← Older revision		Revision as of 14:28, 22 January 2010
Line 26:		Line 26:

	[[Architecture - DMU OSD\|DMU OSD ]] (An implementation of the Object Storage Device API for a Data Management Unit)		[[Architecture - DMU OSD\|DMU OSD ]] (An implementation of the Object Storage Device API for a Data Management Unit)

	~~[[Architecture - DMU Zerocopy\|DMU Zerocopy ]]~~

	[[Architecture - End-to-end Checksumming\|End-to-end Checksumming ]] (Lustre network checksumming)		[[Architecture - End-to-end Checksumming\|End-to-end Checksumming ]] (Lustre network checksumming)

← Older revision		Revision as of 13:51, 22 January 2010
Line 135:		Line 135:
	[[Architecture - ZFS for Lustre\|ZFS for Lustre ]] (Architecture and requirements related to Lustre servers using the ZFS Data Management Unit)		[[Architecture - ZFS for Lustre\|ZFS for Lustre ]] (Architecture and requirements related to Lustre servers using the ZFS Data Management Unit)

	[[Architecture - ZFS large dnodes\|ZFS large dnodes ]] (		[[Architecture - ZFS large dnodes\|ZFS large dnodes ]] (Increased dnode size to allow more data in the inode - use cases, implementation constraints)

	[[Architecture - ZFS TinyZAP\|ZFS TinyZAP ]]		[[Architecture - ZFS TinyZAP\|ZFS TinyZAP ]] (A compact ZFS Attribute Processor format that allows arbitrary values to be stored - use cases, implementation constraints)

← Older revision		Revision as of 13:56, 22 January 2010
Line 3:		Line 3:
	'''''Note:''''' ''These documents reflect the state of design of a Lustre feature at a particular point in time. They many contain information that is incomplete or obsolete and may not reflect the current architecture, features and functionality of Lustre.''		'''''Note:''''' ''These documents reflect the state of design of a Lustre feature at a particular point in time. They many contain information that is incomplete or obsolete and may not reflect the current architecture, features and functionality of Lustre.''

	[[Architecture - Adaptive Timeouts - Use Cases\|Adaptive Timeouts - Use Cases ]] (Network RPC timeouts based on server and network loading ~~- architecture, use cases~~)		[[Architecture - Adaptive Timeouts - Use Cases\|Adaptive Timeouts - Use Cases ]] (Network RPC timeouts based on server and network loading)

	[[Architecture - Backup\|Backup ]] (File system backup)		[[Architecture - Backup\|Backup ]] (File system backup)
Line 87:		Line 87:
	[[Architecture - Open by fid\|Open by fid ]] (Returns a file descriptor based on a file ID - implementation choices, design description, use cases)		[[Architecture - Open by fid\|Open by fid ]] (Returns a file descriptor based on a file ID - implementation choices, design description, use cases)

	[[Architecture - OSS-on-DMU\|OSS-on-DMU ]](Object storage server on the ZFS Data Management Unit ~~- requirements, design constraints, and components~~)		[[Architecture - OSS-on-DMU\|OSS-on-DMU ]](Object storage server on the ZFS Data Management Unit)

	[[Architecture - PAG\|PAG ]] (Process Authentication Groups - Use of Linux keyring, setuid in Lustre, Kerberos credential, use cases)		[[Architecture - PAG\|PAG ]] (Process Authentication Groups - Use of Linux keyring, setuid in Lustre, Kerberos credential, use cases)
Line 93:		Line 93:
	[[Architecture - Pools of targets\|Pools of targets ]] (Use cases, command line definitions of pools of OSTs, implementation constraints)		[[Architecture - Pools of targets\|Pools of targets ]] (Use cases, command line definitions of pools of OSTs, implementation constraints)

	[[Architecture - Profiling Tools for IO\|Profiling Tools for IO ]] (Profiling system based on Ganglia ~~- use cases and implementation constraints~~)		[[Architecture - Profiling Tools for IO\|Profiling Tools for IO ]] (Profiling system based on Ganglia)

	[[Architecture - Proxy Cache\|Proxy Cache ]] (Caching and aggregation used to reduce load on backend server and provide better throughput and latency to clients ~~- requirements and use cases~~)		[[Architecture - Proxy Cache\|Proxy Cache ]] (Caching and aggregation used to reduce load on backend server and provide better throughput and latency to clients)

	[[Architecture - Punch and Extent Migration\|Punch and Extent Migration ]] (Prototypes for ''punch'' and ''migrate'' functionality)		[[Architecture - Punch and Extent Migration\|Punch and Extent Migration ]] (Prototypes for ''punch'' and ''migrate'' functionality)
Line 103:		Line 103:
	[[Architecture - Recovery Failures\|Recovery Failures ]] (Recovery terminology, architectures, and use cases)		[[Architecture - Recovery Failures\|Recovery Failures ]] (Recovery terminology, architectures, and use cases)

	[[Architecture - Request Redirection\|Request Redirection ]] (Allows target OST to redirect client requests to other servers ~~- requirements, use cases, questions~~)		[[Architecture - Request Redirection\|Request Redirection ]] (Allows target OST to redirect client requests to other servers)

	[[Architecture - Scalable Pinger\|Scalable Pinger ]] (Provides peer health information to Lustre clients and servers ~~- requirements~~)		[[Architecture - Scalable Pinger\|Scalable Pinger ]] (Provides peer health information to Lustre clients and servers)

	[[Architecture - Security\|Security ]] (Detailed description of the security architecture for Lustre)		[[Architecture - Security\|Security ]] (Detailed description of the security architecture for Lustre)
Line 111:		Line 111:
	[[Architecture - Server Network Striping\|Server Network Striping ]] (Description of Lustre-level striping of file data over multiple object servers with redundancy)		[[Architecture - Server Network Striping\|Server Network Striping ]] (Description of Lustre-level striping of file data over multiple object servers with redundancy)

	[[Architecture - Simple Space Balance Migration\|Simple Space Balance Migration ]] (A subset of full data migration limited to migrating files that are not currently in use ~~- architecture, use cases, definitions, constraints~~)		[[Architecture - Simple Space Balance Migration\|Simple Space Balance Migration ]] (A subset of full data migration limited to migrating files that are not currently in use)

	[[Architecture - Simplified Interoperation\|Simplified Interoperation ]] (Controlled server shutdown simplifies inter-operation on server upgrades ~~- requirements, description, implementation, interactions~~)		[[Architecture - Simplified Interoperation\|Simplified Interoperation ]] (Controlled server shutdown simplifies inter-operation on server upgrades)

	[[Architecture - Space Manager\|Space Manager ]] (Manages file system free space ~~- use cases, feature description, scenarios, constraints~~)		[[Architecture - Space Manager\|Space Manager ]] (Manages file system free space)

	[[Architecture - Sub Tree Locks\|Sub Tree Locks ]] (A lock on a directory that protects a namespace (or part of a namespace) rooted at that directory ~~- requirements, use cases, quality attribute scenarios, implementation details~~)		[[Architecture - Sub Tree Locks\|Sub Tree Locks ]] (A lock on a directory that protects a namespace (or part of a namespace) rooted at that directory)

	[[Architecture - User Level Access\|User Level Access ]] (LNET userspace API driver that exports the LNET API to userspace ~~- requirements~~)		[[Architecture - User Level Access\|User Level Access ]] (LNET userspace API driver that exports the LNET API to userspace)

	[[Architecture - User Level OSS\|User Level OSS ]] (Functionality related to Lustre client or OSS failure ~~- requirements~~)		[[Architecture - User Level OSS\|User Level OSS ]] (Functionality related to Lustre client or OSS failure)

	[[Architecture - Userspace Servers\|Userspace Servers ]] (Requirements for capability to run a Lustre server in user space)		[[Architecture - Userspace Servers\|Userspace Servers ]] (Requirements for capability to run a Lustre server in user space)
Line 127:		Line 127:
	[[Architecture - Version Based Recovery\|Version Based Recovery ]] (A recovery mechanism allowing clients to recover outside of a strict order or later in time - requirements, use cases, quality attribute scenarios, implementation details)		[[Architecture - Version Based Recovery\|Version Based Recovery ]] (A recovery mechanism allowing clients to recover outside of a strict order or later in time - requirements, use cases, quality attribute scenarios, implementation details)

	[[Architecture - Wide Striping\|Wide Striping ]] (Mechanism to encode striping information compactly to efficiently support striping of files across many devices ~~- APIs required~~)		[[Architecture - Wide Striping\|Wide Striping ]] (Mechanism to encode striping information compactly to efficiently support striping of files across many devices)

	[[Architecture - Wire Level Protocol\|Wire Level Protocol ]] (Wire formats used by Lustre - messages, wire and record packet structures, recovery protocol)		[[Architecture - Wire Level Protocol\|Wire Level Protocol ]] (Wire formats used by Lustre - messages, wire and record packet structures, recovery protocol)

	[[Architecture - Write Back Cache\|Write Back Cache ]] (Allows client meta-data operations to be delayed and batched ~~- requirements, use cases, quality attribute scenarios, issues~~)		[[Architecture - Write Back Cache\|Write Back Cache ]] (Allows client meta-data operations to be delayed and batched)

	[[Architecture - ZFS for Lustre\|ZFS for Lustre ]] (Architecture and requirements related to Lustre servers using the ZFS Data Management Unit)		[[Architecture - ZFS for Lustre\|ZFS for Lustre ]] (Architecture and requirements related to Lustre servers using the ZFS Data Management Unit)

	[[Architecture - ZFS large dnodes\|ZFS large dnodes ]] (Increased dnode size to allow more data in the inode ~~- use cases, implementation constraints~~)		[[Architecture - ZFS large dnodes\|ZFS large dnodes ]] (Increased dnode size to allow more data in the inode)

	[[Architecture - ZFS TinyZAP\|ZFS TinyZAP ]] (A compact ZFS Attribute Processor format that allows arbitrary values to be stored ~~- use cases, implementation constraints~~)		[[Architecture - ZFS TinyZAP\|ZFS TinyZAP ]] (A compact ZFS Attribute Processor format that allows arbitrary values to be stored)