File system virtualization

• US 9,785,647 B1
• Filed: 10/02/2012
• Issued: 10/10/2017
• Est. Priority Date: 10/02/2012
• Status: Active Grant

• Current Assignee: eFolder, Inc.
• Original Assignee: Axcient
• Inventors: Petri, Robert, Caputo, Vito
• Primary Examiner(s): Trujillo, James
• Assistant Examiner(s): Morris, John J
• Application Number:
  US13/633,695
• Time in Patent Office: 1,834 Days
• Field of Search: 707649, 707823, 711114, 711170
• CPC Class Codes: G06F 16/188 Virtual file systems
• CPC Class Codes: G06F 16/196 Specific adaptations of the file system to access devices and non-file objects via standard file system access operations, e.g. pseudo file systems dedicated interfaces to storage systems G06F3/0601

Abstract

Systems, methods, and media file system virtualization. Exemplary methods may include rendering a sparse file system and creating a block map for the sparse file system. The block map may include a map record for each file record included in the sparse file system. A map record may include extents for blocks associated with a file record, the map record providing a mapping between allocated block sectors for a file record in the sparse file system and corresponding blocks associated with one or more data sources.

Claims

1. A method, comprising:

storing a backup of a file system in a backup data source;

receiving a request to render a portion of file records of the file system stored in the backup data source;

rendering a sparse file system by allocating block sectors for blocks of the portion of the file records in a formatted sparse file, without having to render the file system entirely; and

creating a block map for the sparse file system, the block map comprising mappings between allocated block sectors of file records of the sparse file system and corresponding disperse blocks stored in all the backup data source, wherein all block sectors for blocks in the formatted sparse file are allocated without writing data associated with the file records into the allocated block sectors.

2. The method according to claim 1, wherein the allocated block sectors are placeholders that represent a location and size of actual block data.

3. The method according to claim 2, wherein block sectors are allocated using metadata that comprises extents for blocks included in the portion of file records.

4. The method according to claim 1, wherein the block map comprises a map record for each file record included in the sparse file system, the map record comprising extents for blocks associated with a file record.

5. The method according to claim 1, further comprising:

receiving a request for blocks within a sector of the sparse file system; and

obtaining the requested blocks by;

reading the block map for the sparse file system to locate the requested blocks in any of a data source or the backup data source;

obtaining the requested blocks from the data source or the backup data source;

for blocks not included in the block map, obtaining blocks not included in the block map from the sparse file system; and

fulfilling the request with the obtained blocks.

6. The method according to claim 1, further comprising fulfilling a request for blocks using a copy on write source if the requested blocks have been partially written.

7. The method according to claim 5, wherein the backup data source comprises a distributed hash table provisioned within a cloud.

8. The method according to claim 5, wherein the backup data source comprises one or more of a mirror, an incremental file, and combinations thereof.

9. The method according to claim 1, further comprising mounting the sparse file system as a virtual disk.

10. The method according to claim 1, wherein rendering a sparse file system comprises formatting a portion of a virtual disk into a sparse file.

11. The method according to claim 1, wherein the sparse file system comprises a virtual sparse file system.

12. A system, the system comprising:

at least one server having a memory that includes executable instructions and a processor executing the instructions, the instructions comprising;

a rendering module that;

receives a request to render a portion of file records of a file system stored in a backup data source; and

renders a sparse file system by allocating block sectors for blocks of the portion of the file records in a formatted sparse file, without having to render the file system entirely;

an extent mapper that creates a block map for the sparse file system, the block map comprising a map record for each file record included in the sparse file system, the map record comprising extents for blocks associated with a file record, the map record providing a mapping between allocated block sectors for a file record and corresponding blocks associated with a data source, wherein all block sectors for blocks in the formatted sparse file are allocated without writing data associated with the file records into the allocated block sectors; and

a block retriever module that;

receives a request for blocks; and

obtains the requested blocks by;

reading the block map for the sparse file system to obtain the requested blocks from any of a data source and the backup data source;

for blocks not included in the block map, obtaining blocks not included in the block map from the sparse file system; and

fulfilling the request with the obtained blocks, wherein the block retriever module fulfills a request for blocks using copy on write source if the requested blocks have been partially written.

13. The system according to claim 12, wherein the rendering module allocates block sectors for blocks of the portion of the file records in a formatted sparse file.

14. The system according to claim 13, wherein the rendering module allocates block sectors using metadata that comprises extents for blocks included in the portion of the file records.

15. The system according to claim 12, wherein the rendering module renders a sparse file system by formatting a portion of a virtual disk into a sparse file, wherein the sparse file system comprises a virtual sparse file system.

16. The system according to claim 12, wherein the rendering module creates a sparse file system using metadata that includes extents for blocks included in the portion of the file records.

17. A method, comprising:

storing a backup of a file system in a backup data source;

receiving a request to render a file of the file system stored in the backup data source;

requesting blocks from a sparse file system by allocating block sectors for blocks of the file in a formatted sparse file, without having to render the file system entirely, the blocks corresponding to a file; and

assembling the file by;

evaluating a block map to obtain the requested blocks from a data source, the block map providing a mapping between allocated block sectors of the sparse file system and corresponding block data in a data source, wherein all block sectors for blocks in the formatted sparse file are allocated without writing data associated with the file into the allocated block sectors;

for blocks not included in the block map, obtaining blocks not included in the block map from the sparse file system; and

assembling the obtained blocks to assemble the file.