Sparse multi-component files

• US 7,194,579 B2
• Filed: 04/26/2004
• Issued: 03/20/2007
• Est. Priority Date: 04/26/2004
• Status: Active Grant

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Inventors: McDougall, Richard J., Shepler, Spencer, Wong, Brian L., Robinson, David
• Primary Examiner(s): Bragdon; Reginald
• Assistant Examiner(s): Flournoy; Horace L.
• Application Number:
  US10/831,936
• Publication Number:
  US 20050240725A1
• Time in Patent Office: 1,058 Days
• Field of Search: None
• US Class Current: 711/114
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 3/0613 in relation to throughput
• CPC Class Codes: G06F 3/0632 by initialisation or re-initialisation of storage systems
• CPC Class Codes: G06F 3/0643 Management of files
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

A file is striped across multiple filers, file servers or other devices, to create a sparsely striped multi-component file. Each filer stores one sparse component. In particular, each component physically stores only those stripes allocated to that component. The other stripes are represented as holes. Thus, instead of contiguously packing each component'"'"'s stripes at the block level, each component is a file having the same logical structure. A component of a sparsely striped multi-component file can be easily converted to a mirror by filling in its holes. Similarly, a mirror can be easily converted to one component of a sparsely striped multi-component file by removing or ignoring it unallocated stripes. In either case, the layout or logical of the component does not need to be reconfigured.

Claims

1. A method of sparsely striping a file across multiple components, the method comprising:

selecting a file to be sparsely striped across multiple components;

identifying a plurality of chunks in the selected file; and

for each chunk;

identifying a position of said chunk in the selected file;

allocating said chunk to one of the multiple components;

at said position in the one component, writing the content of said chunk; and

creating a hole, corresponding to said chunk, at said position in each of the other components.

2. The method of claim 1, wherein each of the multiple components is a file having the same file name.

3. The method of claim 1, wherein each of the multiple components is stored on a separate file server.

4. The method of claim 1, wherein each said hole has a logical size but occupies no physical storage space.

5. The method of claim 1, further comprising:

at a first component, merging holes corresponding to multiple consecutive chunks allocated to the other components into a single hole.

6. The method of claim 1, further comprising converting a first component to a mirror of the selected file by:

copying the content of one or more chunks allocated to the other components; and

replacing holes in the first component corresponding to the one or more chunks with the copied content.

7. The method of claim 6, further comprising:

converting one or more of the other components to mirrors of the selected file;

receiving an update to the selected file at a first mirror of the selected file; and

asynchronously propagating said update to the other mirrors of the selected file.

8. The method of claim 1, further comprising converting the multiple components to a single file by:

at a first component, for each hole corresponding to a chunk allocated to an other component;

obtaining the content of the chunk; and

overwriting the hole; and

nullifying the other components.

9. The method of claim 1, further comprising:

at a first component, receiving a read request for content of the file included in a first chunk allocated to an other component;

retrieving said content from the other component; and

in response to the read request, returning said content.

10. The method of claim 9, further comprising:

at the first component, storing said content in a hole corresponding to the first chunk.

11. The method of claim 1, further comprising:

at a first component, receiving a write request comprising content of a first chunk allocated to an other component; and

forwarding said content to the other component.

12. The method of claim 11, further comprising:

at the first component, storing said content in a hole corresponding to the first chunk.

13. A computer readable medium storing instructions that, when executed by a computer, cause the computer to perform a method of sparsely striping a file across multiple components, the method comprising:

selecting a file to be sparsely striped across multiple components;

identifying a plurality of chunks in the selected file; and

for each chunk;

identifying a position of said chunk in the selected file;

allocating said chunk to one of the multiple components;

at said position in the one component, writing the content of said chunk; and

creating a hole, corresponding to said chunk, at said position in each of the other components.

14. A method of converting a sparsely striped multi-component file to a mirror, comprising:

at each of one or more file storage devices, maintaining a component of a sparsely striped multi-component file, wherein each component is a sparse file;

at a first file storage device comprising a first component, identifying holes in the first component, wherein each hole corresponds to a chunk of the sparsely striped multi-component file allocated to a component other than the first component; and

for each hole;

obtaining content of the sparsely striped multi-component file

corresponding to said chunk; and

replacing said hole with the content.

15. The method of claim 14, wherein said maintaining comprises:

receiving an update to a first chunk of the sparsely striped multi-component file, wherein the first chunk is allocated to the first component;

updating, at the first component, content of the first chunk; and

updating, at one or more other components, holes corresponding to the first chunk.

16. A computer readable medium storing instructions that, when executed by a computer, cause the computer to perform a method of converting a sparsely striped multi-component file to a mirror, comprising:

at each of one or more file storage devices, maintaining a component of a sparsely striped multi-component file, wherein each component is a sparse file;

at a first file storage device comprising a first component, identifying holes in the first component, wherein each hole corresponds to a chunk of the sparsely striped multi-component file allocated to a component other than the first component; and

for each hole;

obtaining content of the sparsely striped multi-component file corresponding to said chunk; and

replacing said hole with the content.

17. A network-based file storage system for storing a sparsely striped multi-component file, comprising:

multiple file storage devices, each file storage device comprising a component file configured to store one or more chunks of the sparsely striped multi-component file; and

in each file storage device'"'"'s component file;

the contents of one or more chunks allocated to the file storage device; and

one or more holes corresponding to chunks allocated to other file storage devices;

wherein each file storage device'"'"'s component file has a substantially similar logical layout.

18. The network-based file storage system of claim 17, wherein each of the multiple file storage devices is configurable to replace said one or more holes with contents of said chunks allocated to other file storage devices.