STORING AND RETRIEVING MUTABLE OBJECTS

• US 20170052733A1
• Filed: 11/03/2016
• Published: 02/23/2017
• Est. Priority Date: 01/04/2013
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Smith, Eric G., Vedpathak, Yogesh R., Leggette, Wesley B., Resch, Jason K., Vas, Sebastien
• Granted Patent: US 10,042,577 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1008 in individual solid state devices G06F11/1004 takes precedence
• CPC Class Codes: G06F 11/1044 with specific ECC/EDC distribution
• CPC Class Codes: G06F 11/1068 in sector programmable memories, e.g. flash disk G06F11/1072 takes precedence
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/1092 Rebuilding, e.g. when physically replacing a failing disk
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 2211/1028 Distributed, i.e. distributed RAID systems with parity
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/0644 Management of space entities, e.g. partitions, extents, pools
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

A method for execution by one or more processing modules of one or more computing devices of a dispersed storage network (DSN), the method begins by identifying a data object to access within a DSN. The method continues by identifying a vault ID based on the data object. The method continues by obtaining an object ID based on the data object. The method continues by selecting at least one generation ID based on generation status. The method continues, for each generation ID, by generating at least one set of slice names using the vault ID, the generation ID, and the object ID. The method continues, for each set of slice names, by generating a set of slice access requests that includes the set of slice names and accessing the DSN utilizing the set of slice access requests.

Claims

1. A method for execution by one or more processing modules of one or more computing devices of a dispersed storage network (DSN), the method comprises:

identifying a data object to access within a DSN;

identifying a vault ID based on the data object;

obtaining an object ID based on the data object;

selecting at least one generation ID based on generation status;

for each generation ID, generating at least one set of slice names using the vault ID, the generation ID, and the object ID; and

for each set of slice names, generating a set of slice access requests that includes the set of slice names; and

accessing the DSN utilizing the set of slice access requests.

2. The method of claim 1, wherein the one or more processing modules include a dispersed storage (DS) processing module that identifies a data object access within a dispersed storage network (DSN).

3. The method of claim 1, wherein the identifying a data object to access within a DSN is based on receiving a request that includes one or more of:

a data name, a requester identifier (ID), a vault ID, an object ID, a source name, or data.

4. The method of claim 1, wherein the identifying a vault ID is based on the data object.

5. The method of claim 1, wherein the identifying a vault ID is based on an ID lookup based on a data name.

6. The method of claim 1, wherein the identifying a vault ID is based on a requester ID.

7. The method of claim 1, wherein the obtaining further includes obtaining the object ID based on one or more of:

a request type, data, receiving the object ID, or a data name.

8. The method of claim 7, wherein the obtaining further includes, for a read request, accessing a DSN index to retrieve the object ID based on the data name.

9. The method of claim 7, wherein the obtaining further includes, for a write request, generating the object ID based on a deterministic function applied to the data name.

10. The method of claim 1, wherein the generation status indicates availability of one or more generation IDs.

11. The method of claim 1, wherein the generation status indicates full or not full.

12. The method of claim 1, wherein the selecting further includes selecting the generation ID based on one or more of:

a request type and the generation status.

13. The method of claim 1, wherein the selecting, for a read request, includes selecting each generation ID associated with a generation status that indicates that the generation is full and selects a generation ID that is one greater than a largest generation ID of one or more generation IDs that are full, if any.

14. The method of claim 1, wherein the selecting, for a write request, selecting a lowest generation ID associated with a generation that is not full.

15. The method of claim 1, wherein the generating, for a write request, includes a set of slice names and includes a set of encoded data slices that are encoded, using a dispersed storage error coding function, from a corresponding data segment of the data.

16. The method of claim 1, wherein the generating, for a read request, the processing module includes a set of slice names.

17. The method of claim 1, wherein the accessing includes outputting the set of slice access requests to the DSN.

18. The method of claim 1, wherein the accessing may further be based on a request type wherein, for a read request type, receiving a slice access responses and decoding favorable slice access responses using a dispersed storage error coding function to reproduce one or more data segments of the data and, for a write request type, confirming storage of the data object when receiving a write threshold number of favorable slice access responses from the DSN for each data segment of a plurality of data segments of the data.

19. A computing device of a group of computing devices of a dispersed storage network (DSN), the computing device comprises:

an interface;

a local memory; and

a processing module operably coupled to the interface and the local memory, wherein the processing module functions to;

identify a data object to access within a DSN;

identify a vault ID based on the data object;

obtain an object ID based on the data object;

select at least one generation ID based on generation status;

for each generation ID, generate at least one set of slice names using the vault ID, the generation ID, and the object ID; and

for each set of slice names, generate a set of slice access requests that includes the set of slice names; and

access the DSN utilizing the set of slice access requests.

20. A method for execution by one or more processing modules of one or more computing devices of a dispersed storage network (DSN), the method comprises:

receiving a data name for retrieval from DSN storage units;

identifying each generation that is full for a corresponding source name and a next generation after a last full generation;

generating an object ID based on the data name;

generating slice names;

generating slice access requests to read slices that include the slice names;

outputting the slice access request to a DS (dispersed storage) unit set;

receiving slices; and

decoding the slices.