DISPERSED STORAGE NETWORK UTILIZING REVISION SNAPSHOTS

• US 20110184912A1
• Filed: 11/09/2010
• Published: 07/28/2011
• Est. Priority Date: 01/28/2010
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: Cleversafe Incorporated (International Business Machines Corporation)
• Inventors: LEGGETTE, WESLEY, VOLVOVSKI, ILYA, BAPTIST, ANDREW
• Granted Patent: US 8,352,501 B2
• Time in Patent Office: Days
• US Class Current: 707/639
• CPC Class Codes: G06F 11/1008 in individual solid state devices G06F11/1004 takes precedence
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/184 implemented as replicated file system
• CPC Class Codes: G06F 16/1844 Management specifically adapted to replicated file systems
• CPC Class Codes: G06F 2201/805 Real-time
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 2211/1028 Distributed, i.e. distributed RAID systems with parity
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A method begins by a processing module obtaining a directory file and determining a new snapshot identifier (ID) for the directory file. The method continues with the processing module identifying a version of a filename to associate with the new snapshot ID and updating the directory file by associating the snapshot ID to the version of the filename to produce an updated directory file. The method continues with the processing module dispersed storage error encoding the updated directory file to produce a set of encoded updated directory file slices and sending the set of encoded updated directory file slices to a dispersed storage network (DSN) memory for storage.

Claims

1. A method comprises:

obtaining a directory file;

determining a new snapshot identifier (ID) for the directory file;

identifying a version of a filename to associate with the new snapshot ID;

updating the directory file by associating the snapshot ID to the version of the filename to produce an updated directory file;

dispersed storage error encoding the updated directory file to produce a set of encoded updated directory file slices; and

sending the set of encoded updated directory file slices to a dispersed storage network (DSN) memory for storage.

2. The method of claim 1, wherein the determining the new snapshot ID further comprises at least one of:

receiving a command to produce the new snapshot ID;

accessing a lookup table at a given time to produce the new snapshot ID;

producing the new snapshot ID at an expiration of a period of time since producing a previous snapshot ID;

producing the new snapshot ID when a number of changes to the directory file compares favorably to a directory change threshold; and

producing the new snapshot ID when a number of changes to the filename compares favorably to a filename change threshold.

3. The method of claim 1, wherein the directory file comprises at least one of:

a filename;

a directory name;

a path;

a block number;

a size indicator;

a DSN address;

a revision; and

a snapshot ID list.

4. The method of claim 1, wherein obtaining the directory file comprises:

retrieving a set of encoded directory file slices from the DSN memory based on a directory file DSN address; and

dispersed storage error decoding the set of encoded directory file slices to reproduce the directory file.

5. The method of claim 1, wherein the new snapshot ID comprises at least one of:

a predetermined value;

a value based on a previous snapshot ID;

a value based on a user ID; and

a value based on a vault ID.

6. The method of claim 1 further comprises:

updating a vault snapshot file to associate the new snapshot ID with at least one previous snapshot ID to produce an updated vault snapshot file;

dispersed storage error encoding the updated vault snapshot file to produce a set of encoded updated vault snapshot file slices; and

sending the set of encoded updated vault snapshot file slices to the DSN memory for storage.

7. A method comprises:

obtaining a directory file;

identifying an old snapshot ID;

identifying a version of a filename associated with the old snapshot ID;

updating the directory file by deleting an entry of the version of the filename to produce an updated directory file;

dispersed storage error encoding the modified directory file to produce a set of encoded modified directory file slices; and

sending the set of encoded modified directory file slices to a dispersed storage network (DSN) memory for storage at a directory file DSN address.

8. The method of claim 7, wherein the identifying the old snapshot ID comprises at least one of:

receiving a command that includes the old snapshot ID;

accessing a lookup table at a given time to identify the old snapshot ID;

identifying the old snapshot ID when a snapshot size indicator is greater than a size threshold;

identifying the old snapshot ID at an expiration of a period of time since identifying a previous old snapshot ID;

identifying the old snapshot ID when a number of changes to the directory file compares favorably to a directory change threshold; and

identifying the old snapshot ID when a number of changes to the filename compares favorably to a filename change threshold.

9. The method of claim 7 further comprises:

identifying a directory entry that is not associated with a snapshot ID; and

updating the directory file by deleting the directory entry.

10. The method of claim 9 further comprises:

deleting, from the DSN memory, encoded data slices identified by a filename associated with the directory entry.

11. A computer comprises:

an interface; and

a processing module operable to;

obtain a directory file;

determine a new snapshot identifier (ID) for the directory file;

identify a version of a filename to associate with the new snapshot ID;

update the directory file by associating the snapshot ID to the version of the filename to produce an updated directory file;

dispersed storage error encode the updated directory file to produce a set of encoded updated directory file slices; and

send, via the interface, the set of encoded updated directory file slices to a dispersed storage network (DSN) memory for storage.

12. The computer of claim 11, wherein the processing module further functions to determine the new snapshot ID by at least one of:

receiving, via the interface, a command to produce the new snapshot ID;

accessing a lookup table at a given time to produce the new snapshot ID;

producing the new snapshot ID at an expiration of a period of time since producing a previous snapshot ID;

producing the new snapshot ID when a number of changes to the directory file compares favorably to a directory change threshold; and

producing the new snapshot ID when a number of changes to the filename compares favorably to a filename change threshold.

13. The computer of claim 11, wherein the directory file comprises at least one of:

a filename;

a directory name;

a path;

a block number;

a size indicator;

a DSN address;

a revision; and

a snapshot ID list.

14. The computer of claim 11, wherein the processing module further functions to obtain the directory file by:

retrieving, via the interface, a set of encoded directory file slices from the DSN memory based on a directory file DSN address; and

dispersed storage error decoding the set of encoded directory file slices to reproduce the directory file.

15. The computer of claim 11, wherein the new snapshot ID comprises at least one of:

a predetermined value;

a value based on a previous snapshot ID;

a value based on a user ID; and

a value based on a vault ID.

16. The computer of claim 11, wherein the processing module further functions to:

update a vault snapshot file to associate the new snapshot ID with at least one previous snapshot ID to produce an updated vault snapshot file;

dispersed storage error encode the updated vault snapshot file to produce a set of encoded updated vault snapshot file slices; and

send, via the interface, the set of encoded updated vault snapshot file slices to the DSN memory for storage.

17. A computer comprises:

an interface; and

a processing module operable to;

obtain a directory file;

identify an old snapshot ID;

identify a version of a filename associated with the old snapshot ID;

update the directory file by deleting an entry of the version of the filename to produce an updated directory file;

dispersed storage error encode the modified directory file to produce a set of encoded modified directory file slices; and

send, via the interface, the set of encoded modified directory file slices to a dispersed storage network (DSN) memory for storage at a directory file DSN address.

18. The computer of claim 17, wherein the processing module further functions to identify the old snapshot ID by at least one of:

receiving, via the interface, a command that includes the old snapshot ID;

accessing a lookup table at a given time to identify the old snapshot ID;

identifying the old snapshot ID when a snapshot size indicator is greater than a size threshold;

identifying the old snapshot ID at an expiration of a period of time since identifying a previous old snapshot ID;

identifying the old snapshot ID when a number of changes to the directory file compares favorably to a directory change threshold; and

identifying the old snapshot ID when a number of changes to the filename compares favorably to a filename change threshold.

19. The computer of claim 17, wherein the processing module further functions to:

identify a directory entry that is not associated with a snapshot ID; and

update the directory file by deleting the directory entry.

20. The computer of claim 19, wherein the processing module further functions to:

delete, from the DSN memory, encoded data slices identified by a filename associated with the directory entry.