Generating time-ordered globally unique revision numbers

• US 10,489,247 B2
• Filed: 12/04/2017
• Issued: 11/26/2019
• Est. Priority Date: 12/31/2014
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: Pure Storage, Inc.
• Inventors: Gray, Adam M., Dhuse, Greg R., Baptist, Andrew D., Khadiwala, Ravi V., Leggette, Wesley B., Horan, Scott M., Borich, Franco V., Cilfone, Bart R., Scholl, Daniel J., Resch, Jason K.
• Primary Examiner(s): Lamarre, Guy J
• Application Number:
  US15/830,443
• Publication Number:
  US 20180089026A1
• Time in Patent Office: 722 Days
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/1092 Rebuilding, e.g. when physically replacing a failing disk
• CPC Class Codes: G06F 16/1844 Management specifically adapted to replicated file systems
• CPC Class Codes: G06F 16/1873 Versioning file systems, temporal file systems, e.g. file system supporting different historic versions of files
• CPC Class Codes: G06F 2211/1028 Distributed, i.e. distributed RAID systems with parity
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0655 Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A method for execution by one or more processing modules of one or more computing devices of a dispersed storage network (DSN). The method begins by receiving a data object for storage in a plurality of storage vaults. The method continues by encoding the data object in accordance with dispersal parameters of the storage vault to produce a corresponding plurality of sets of encoded data slices. The method continues by generating a unique revision number to associate with the data object. The method continues by facilitating storage of the corresponding plurality of sets of encoded data slices with the unique revision number and facilitating data synchronization between the plurality of storage vaults based on the unique revision numbers of stored data.

Claims

1. A method for execution by processing units of one or more computing devices of a dispersed storage network (DSN), the method comprises:

receiving, by two or more of the processing units, a data object for storage in a plurality of storage vaults, wherein the plurality of storage vaults includes two or more storage vaults for the data object;

for each storage vault of the plurality of storage vaults, encoding the data object in accordance with dispersal parameters of the storage vault to produce a corresponding plurality of sets of encoded data slices;

generating, by each processing unit of the two or more of the processing units, a unique revision number to associate with the data object, wherein the unique revision number is a time-ordered globally unique revision number;

for each storage vault, each processing unit of the two or more of the processing units facilitating storage of the corresponding plurality of sets of encoded data slices with the unique revision number; and

facilitating, by at least one of the two or more of the processing units, data synchronization between the plurality of storage vaults based on the unique revision number of a stored data object.

2. The method of claim 1, wherein the receiving a data object for storage includes receiving a common data object.

3. The method of claim 1, wherein the receiving a data object for storage includes a different data object that share a common data identifier.

4. The method of claim 1, wherein the receiving a data object for storage includes at least one of receiving the data object substantially simultaneously and a first of the processing units generating the data object and a second of the processing units receiving the data object.

5. The method of claim 1, wherein the encoding the data object includes obtaining the dispersal parameters and dispersed storage error encoding the data object to produce the corresponding plurality of sets of encoded data slices.

6. The method of claim 1, wherein the generating the unique revision number includes at least one ever-increasing portion and at least one watermark portion.

7. The method of claim 6, wherein the at least one ever-increasing portion includes one or more of an ever-increasing time portion or an ever-increasing operation portion.

8. The method of claim 6, wherein the watermark portion includes at least one of a random number, a pseudorandom number, or a result of applying a deterministic function to at least a portion of one or more of the data object or a data object identifier.

9. The method of claim 6, wherein the maintaining includes maintaining both revisions of a common data object in accordance with a predetermination when the ever-increasing portion is substantially the same.

10. The method of claim 1, wherein the facilitating storage includes issuing one or more sets of write slice requests to the storage vault, wherein the write slice requests include this corresponding plurality of sets of encoded data slices and a corresponding unique revision number.

11. The method of claim 1, wherein the facilitating data synchronization includes maintaining both unique revision numbers or eliminating unique revision numbers.

12. The method of claim 11, wherein the maintaining includes selecting a revision for elimination by at least one of a random selection, selecting a revision with a highest ever-increasing portion, and selecting a revision with a watermark portion corresponding to a priority revision.

13. A computing device of a group of computing devices of a dispersed storage network (DSN), the computing device comprises:

an interface;

a local memory; and

a processing module operably coupled to the interface and the local memory, wherein the processing module functions to;

receive a data object for storage in a plurality of storage vaults, wherein the plurality of storage vaults includes two or more storage vaults for the data object;

encode the data object in accordance with dispersal parameters of the storage vault to produce a corresponding plurality of sets of encoded data slices;

generate a unique revision number to associate with the data object, wherein the unique revision number includes at least one ever-increasing portion and at least one watermark portion;

facilitate storage of the corresponding plurality of sets of encoded data slices with the unique revision number; and

facilitate data synchronization between the plurality of storage vaults based on the unique revision number of a stored data object.

14. The computing device of claim 13, wherein the at least one ever-increasing portion includes one or more of an ever-increasing time portion or an ever-increasing operation portion.

15. The computing device of claim 13, wherein the watermark portion includes at least one of a random number, a pseudorandom number, or a result of applying a deterministic function to at least a portion of one or more of the data object or a data object identifier.

16. The computing device of claim 13, wherein the facilitate storage includes issuing one or more sets of write slice requests to the storage vault, wherein the write slice requests include this corresponding plurality of sets of encoded data slices and a corresponding unique revision number.

17. A method for execution by processing modules of one or more computing devices of a dispersed storage network (DSN), the method comprises:

receiving a data object for storage in a plurality of storage vaults, wherein the plurality of storage vaults includes two or more storage vaults for the data object;

for each storage vault of the plurality of storage vaults, encoding the data object in accordance with dispersal parameters of the storage vault to produce a corresponding plurality of sets of encoded data slices;

generating a unique revision number to associate with the data object, wherein the unique revision number includes at least one ever-increasing portion and at least one watermark portion;

for each storage vault, facilitating storage of the corresponding plurality of sets of encoded data slices with the unique revision number; and

facilitating data synchronization between the plurality of storage vaults based on the unique revision number of a stored data object.

18. The method of claim 17, wherein the at least one ever-increasing portion includes one or more of an ever-increasing time portion or an ever-increasing operation portion.

19. The method of claim 17, wherein the watermark portion includes at least one of a random number, a pseudorandom number, or a result of applying a deterministic function to at least a portion of one or more of the data object or a data object identifier.

20. The method of claim 17, wherein the facilitating data synchronization includes maintaining both revisions of a common data object in accordance with a predetermination when the ever-increasing portion is substantially the same.