http://wiki.old.lustre.org/index.php?title=Architecture_-_Wide_Striping&feed=atom&action=history
Architecture - Wide Striping - Revision history
2024-03-28T16:51:18Z
Revision history for this page on the wiki
MediaWiki 1.35.5
http://wiki.old.lustre.org/index.php?title=Architecture_-_Wide_Striping&diff=10623&oldid=prev
Docadmin at 21:26, 22 January 2010
2010-01-22T21:26:05Z
<p></p>
<table class="diff diff-contentalign-left diff-editfont-monospace" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 21:26, 22 January 2010</td>
</tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l1" >Line 1:</td>
<td colspan="2" class="diff-lineno">Line 1:</td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>'''''Note:''''' The content on this page reflects the state of design of a Lustre feature at a particular point in time and may contain outdated information. </div></td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>'''''Note:<ins class="diffchange diffchange-inline">''</ins>''' ''The content on this page reflects the state of design of a Lustre feature at a particular point in time and may contain outdated information.<ins class="diffchange diffchange-inline">'' </ins></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>There are several use cases where Lustre wants to write exceptionally many stripes in files:</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>There are several use cases where Lustre wants to write exceptionally many stripes in files:</div></td></tr>
</table>
Docadmin
http://wiki.old.lustre.org/index.php?title=Architecture_-_Wide_Striping&diff=10550&oldid=prev
Docadmin: Protected "Architecture - Wide Striping" ([edit=sysop] (indefinite) [move=sysop] (indefinite))
2010-01-22T19:42:07Z
<p>Protected "<a href="/index.php?title=Architecture_-_Wide_Striping" title="Architecture - Wide Striping">Architecture - Wide Striping</a>" ([edit=sysop] (indefinite) [move=sysop] (indefinite))</p>
<table class="diff diff-contentalign-left diff-editfont-monospace" data-mw="interface">
<tr class="diff-title" lang="en">
<td colspan="1" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td>
<td colspan="1" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 19:42, 22 January 2010</td>
</tr><tr><td colspan="2" class="diff-notice" lang="en"><div class="mw-diff-empty">(No difference)</div>
</td></tr></table>
Docadmin
http://wiki.old.lustre.org/index.php?title=Architecture_-_Wide_Striping&diff=10167&oldid=prev
Docadmin at 00:23, 19 January 2010
2010-01-19T00:23:04Z
<p></p>
<table class="diff diff-contentalign-left diff-editfont-monospace" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 00:23, 19 January 2010</td>
</tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l1" >Line 1:</td>
<td colspan="2" class="diff-lineno">Line 1:</td></tr>
<tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">'''''Note:''''' The content on this page reflects the state of design of a Lustre feature at a particular point in time and may contain outdated information. </ins></div></td></tr>
<tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"></ins></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>There are several use cases where Lustre wants to write exceptionally many stripes in files:</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>There are several use cases where Lustre wants to write exceptionally many stripes in files:</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
</table>
Docadmin
http://wiki.old.lustre.org/index.php?title=Architecture_-_Wide_Striping&diff=9959&oldid=prev
Docadmin: /* APIs required */
2010-01-15T00:09:27Z
<p><span dir="auto"><span class="autocomment">APIs required</span></span></p>
<table class="diff diff-contentalign-left diff-editfont-monospace" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 00:09, 15 January 2010</td>
</tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l24" >Line 24:</td>
<td colspan="2" class="diff-lineno">Line 24:</td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>#* OST(stripe_idx) = FLDB(seq_start + stripe_idx*seq_skip) </div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>#* OST(stripe_idx) = FLDB(seq_start + stripe_idx*seq_skip) </div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>#* OBJ(stripe_idx) = FID{seq_start + stripe_idx*seq_skip,fid_number,obj_version}</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>#* OBJ(stripe_idx) = FID{seq_start + stripe_idx*seq_skip,fid_number,obj_version}</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del style="font-weight: bold; text-decoration: none;"></del></div></td><td colspan="2"> </td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del style="font-weight: bold; text-decoration: none;">[[Category:Architecture|Wide Striping]]</del></div></td><td colspan="2"> </td></tr>
</table>
Docadmin
http://wiki.old.lustre.org/index.php?title=Architecture_-_Wide_Striping&diff=9827&oldid=prev
Docadmin: moved Very Wide Striping to Architecture - Wide Striping
2010-01-14T21:12:40Z
<p>moved <a href="/index.php?title=Very_Wide_Striping&action=edit&redlink=1" class="new" title="Very Wide Striping (page does not exist)">Very Wide Striping</a> to <a href="/index.php?title=Architecture_-_Wide_Striping" title="Architecture - Wide Striping">Architecture - Wide Striping</a></p>
<table class="diff diff-contentalign-left diff-editfont-monospace" data-mw="interface">
<tr class="diff-title" lang="en">
<td colspan="1" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td>
<td colspan="1" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 21:12, 14 January 2010</td>
</tr><tr><td colspan="2" class="diff-notice" lang="en"><div class="mw-diff-empty">(No difference)</div>
</td></tr></table>
Docadmin
http://wiki.old.lustre.org/index.php?title=Architecture_-_Wide_Striping&diff=9720&oldid=prev
Docadmin: 1 revision
2010-01-14T21:01:06Z
<p>1 revision</p>
<table class="diff diff-contentalign-left diff-editfont-monospace" data-mw="interface">
<tr class="diff-title" lang="en">
<td colspan="1" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td>
<td colspan="1" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 21:01, 14 January 2010</td>
</tr><tr><td colspan="2" class="diff-notice" lang="en"><div class="mw-diff-empty">(No difference)</div>
</td></tr></table>
Docadmin
http://wiki.old.lustre.org/index.php?title=Architecture_-_Wide_Striping&diff=9719&oldid=prev
Adilger: add raid parameters to EA, offsete calculations
2007-08-08T14:44:15Z
<p>add raid parameters to EA, offsete calculations</p>
<p><b>New page</b></p><div>There are several use cases where Lustre wants to write exceptionally many stripes in files:<br />
<br />
# Major HPC installations may have many hundreds or thousands of OSTs and we need to be able to stripe files over all of them<br />
# Server Network Striping (SNS) will use parity declustering, resulting in an very large number of objects building up the striped file.<br />
<br />
Therefore, wide striping will be a commonly encountered case. The goal is to encode the striping information in a very compact way.<br />
<br />
== Definitions (see fid-hld) ==<br />
<br />
; A pool: defines an un-ordered sets of OSTs and will be used to describe the striping in a manageable way.<br />
; fid seq number: part of fully specified FID, contains sequence in which object was created<br />
; fid number: part of fully specified FID, contains object id within its sequence<br />
; object version: part of fully specified FID, contains object version number<br />
; FID: fully specified object identification structure: FID = {f-sequence, f-number, f-version}<br />
; FLDB: FID Location DataBase, provides fid sequence to server (OST, MDS) mapping<br />
<br />
== APIs required ==<br />
<br />
# Get a consecutive set of fid sequence numbers from the FLDB<br />
# define an on-disk EA that contains a pool name and other RAID striping parameters, for use as a default directory EA<br />
# define an on-disk EA that contains a RAID type, raid parameters, a starting fid sequence number, a count of objects over which the object may be striped, a sequence skip count, a single fid number used by this file in all specified sequences, the object version, possibly the pool from which this object was allocated (for future reference)<br />
# offsets within the file are {lov_offset, stripe_index} = fn(file_offset, raid_type, raid_parameters}<br />
# individual objects OBJ{0, ..., num_obj - 1} in the file can be located: <br />
#* OST(stripe_idx) = FLDB(seq_start + stripe_idx*seq_skip) <br />
#* OBJ(stripe_idx) = FID{seq_start + stripe_idx*seq_skip,fid_number,obj_version}<br />
<br />
[[Category:Architecture|Wide Striping]]</div>
Adilger