Method and system for versioned file system using structured data representations

• US 8,566,362 B2
• Filed: 06/11/2009
• Issued: 10/22/2013
• Est. Priority Date: 01/23/2009
• Status: Active Grant

• Current Assignee: Nasuni Corporation
• Original Assignee: Nasuni Corporation
• Inventors: Mason, Robert S. Jr., Rodriguez, Andres
• Primary Examiner(s): Corrielus, Jean M
• Assistant Examiner(s): ASPINWALL, EVAN S
• Application Number:
  US12/483,030
• Publication Number:
  US 20100191774A1
• Time in Patent Office: 1,594 Days
• Field of Search: 707/639, 707/640, 707/644, 707/648, 707/649, 707/651, 707/755, 707/756, 707/821, 707/822, 707/823, 707/825, 707/828, 707/829, 707/831, 707/956, 707/797
• US Class Current: 707/797
• CPC Class Codes: G06F 11/1446 Point-in-time backing up or restoration of persistent data
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 16/128 Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion use of snapshots for error detection or correction G06F11/14, G06F11/16
• CPC Class Codes: G06F 16/172 Caching, prefetching or hoarding of files
• CPC Class Codes: G06F 16/183 Provision of network file services by network file servers, e.g. by using NFS, CIFS network file access protocols H04L67/1097
• CPC Class Codes: G06F 16/1873 Versioning file systems, temporal file systems, e.g. file system supporting different historic versions of files
• CPC Class Codes: G06F 16/9027 Trees
• CPC Class Codes: G06F 2201/805 Real-time
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data

Abstract

A versioned file system comprises a set of structured data representations. At a first time, an interface creates and exports to a data store a first structured data representation corresponding to a first version of a local file system. The first structured data representation is an XML tree having a root element, one or more directory elements associated with the root element, and one or more file elements associated with a given directory element. Upon a change within the file system (e.g., file creation, file deletion, file modification, directory creation, directory deletion and directory modification), the interface creates and exports a second structured data representation corresponding to a second version of the file system. The second structured data representation differs from the first structured data representation up to and including the root element of the second structured data representation. The data store may comprise a cloud storage service provider.

Claims

1. A non-transitory computer-readable medium having stored thereon instructions that, when executed by a processor, perform a method associated with a local file system, the method comprising:

at a first time, creating and exporting to a cloud-based storage a first structured data representation corresponding to a first version of the local file system, wherein the first structured data representation corresponds to a complete copy of the first version of the local file system at a point-in-time and comprises, for at least one file of the local file system, a tree having a root element that includes all the data from one or more inode or inode-equivalent data structures of the local file system describing the file, and at least one object that contains at least a portion of the file, and one or more directory elements associated with the root element; and

upon a change within the local file system, creating and exporting to the cloud-based storage a second structured data representation corresponding to a complete copy of the second version of the local file system at a point-in-time, the second structured data representation differing from the first structured data representation up to and including the root element of the second structured data representation;

wherein at least one of the first and second structured data representations is self-contained in that it includes or points to all data structures and data needed to reconstruct the local file system at a point-in-time;

wherein the cloud-based storage is a write-once data store.

2. The medium as described in claim 1 wherein the structured data representation is an XML representation.

3. The medium as described in claim 1 wherein a structured data representation comprises a data array that includes a manifest that identifies one or more file chunks that comprise the file as it exists within the local file system.

4. The medium as described in claim 1 wherein the second structured data representation is exported at a given second time.

5. The medium as described in claim 1 wherein the change within the file system is one of:

a file creation, file deletion, file modification, directory creation, directory deletion and directory modification.

6. The medium as described in claim 1 wherein the second structured data representation differs from the first structured data representation in one or more parent elements with respect to the structured data element in which the change within the file system occurred.

7. The medium of claim 1 wherein the structured data representation also is self-describing, in that the structured data representation defines how the data structures and data can be assembled to reconstruct the local file system.

8. The medium as described in claim 2 wherein the root element is a data array that includes a manifest associated with each of the first and second versions of the file system as represented by the first and second structured data representations.

9. The medium as described in claim 2 wherein a directory element is a data array that includes a manifest that identifies one or more directory chunks that comprise a directory within the file system.

10. The medium as described in claim 9 wherein a directory chunk is a data array that includes one or more directory entry elements each associated with a subdirectory in the file system.

11. A computer-readable medium having stored thereon instructions that, when executed by a processor, perform a method associated with a local file system, the method comprising:

at a first time, creating and exporting to a cloud-based storage a first structured data representation corresponding to a first version of the local file system, wherein the first structured data representation corresponds to a complete copy of the first version of the local file system at a point-in-time and comprises, for at least one file of the local file system, a tree having a root element that includes all the data from one or more inode or inode-equivalent data structures of the local file system describing the file, and at least one object that contains at least a portion of the file, and one or more directory elements associated with the root element; and

upon a change within the local file system, creating and exporting to the cloud-based storage a second structured data representation corresponding to a complete copy of the second version of the local file system at a point-in-time, the second structured data representation differing from the first structured data representation up to and including the root element of the second structured data representation;

applying a data transformation to the first and second structured data representations prior to the exporting step, wherein the data transformation is one of;

encryption, compression and duplicate elimination;

wherein at least one of the first and second structured data representations is self-contained in that it includes or points to all data structures and data needed to reconstruct the local file system at a point-in-time.

12. Apparatus, comprising:

a processor;

a data store holding computer instructions that, when executed by the processor, perform a method associated with a local file system, the method comprising;

at a first time, creating and exporting to a cloud-based storage a first structured data representation, wherein the first structured data representation corresponds to a complete copy of the first version of the local file system at a point-in-time and comprises, for at least one file of the local file system, a tree having a root element that includes all the data from one or more inode or inode-equivalent data structures of the local file system describing the file, and at least one object that contains at least a portion of the file; and

upon a change within the local file system, creating and exporting to the cloud-based storage a second structured data representation corresponding to a complete copy of the second version of the local file system at a point-in-time, the second structured data representation differing from the first structured data representation up to and including the root element of the second structured data representation, wherein at least one of the first and second structured data representations is self-contained in that it includes or points to all data structures and data needed to reconstruct the local file system at a point-in-time;

wherein the cloud-based storage is a write-once data store.

13. A method of storing data of a local file system in a cloud-based data store, comprising:

at a first time, and using software executing on hardware associated with the local file system, creating and exporting to the cloud-based data store a first structured data representation corresponding to a first version of the local file system;

upon a given occurrence, and using the software, creating and exporting to the cloud-based data store a second structured data representation corresponding to a second version of the local file system;

wherein, prior to exporting, a data transformation is applied to each the first and second structured data representations, wherein the data transformation is one of;

encryption, compression and duplicate elimination;

each structured data representation corresponding to a complete copy of the respective first or second version of the local file system at a point-in-time and being self-contained in that it includes or points to all data structures and data needed to reconstruct the local file system at a point-in-time;

the second structured data representation differing from the first structured data representation up to and including a given object of the second structured data representation.

14. The method of claim 13 wherein the given structured data representation also is self-describing, in that the given structured data representation defines how the data structures and data can be assembled to reconstruct the associated version of the local file system.