Standard and non-standard dispersed storage network data access

• US 10,169,149 B2
• Filed: 09/06/2016
• Issued: 01/01/2019
• Est. Priority Date: 09/06/2016
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Baptist, Andrew D., Cilfone, Bart R., Dhuse, Greg R., Leggette, Wesley B., Lester, James L., Mark, Zachary J., Motwani, Manish, Resch, Jason K.
• Primary Examiner(s): Knapp, Justin R
• Application Number:
  US15/257,001
• Publication Number:
  US 20180067807A1
• Time in Patent Office: 847 Days
• Field of Search: None
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

A method includes determining, by a computing device of a dispersed storage network (DSN), whether to utilize a non-standard DSN data accessing protocol or a standard DSN data accessing protocol to access data from the DSN. When the computing device determines to use the non-standard DSN data accessing protocol, the method further includes generating a set of non-standard data access requests. The method further includes sending the set of non-standard data access requests to storage units. The method further includes converting, by a storage unit, the non-standard data access request into one or more DSN slice names. The method further includes determining, by the storage unit, that the one or more DSN slice names are within a slice name range. When the one or more DSN slice names are within the slice name range, the method further includes executing, by the storage unit, the data access function.

Claims

1. A method comprises:

determining, by a computing device of a dispersed storage network (DSN), whether to utilize a non-standard DSN data accessing protocol or a standard DSN data accessing protocol to access data from the DSN, wherein the data is dispersed storage error encoded into one or more sets of encoded data slices and wherein the one or more sets of encoded data slices are stored in a set of storage units of the DSN;

when the computing device determines to use the non-standard DSN data accessing protocol;

generating, by the computing device, a set of non-standard data access requests regarding the data, wherein a non-standard data access request of the set of non-standard data access requests includes a network identifier of a storage unit of the set of storage units, a data identifier corresponding to the data, and a data access function;

sending, by the computing device, the set of non-standard data access requests to at least some storage units of the set of storage units, which includes the storage unit;

converting, by the storage unit, the non-standard data access request into one or more DSN slice names;

determining, by the storage unit, that the one or more DSN slice names are within a slice name range allocated to the storage unit; and

when the one or more DSN slice names are within the slice name range, executing, by the storage unit, the data access function regarding one or more encoded data slices corresponding to the one or more DSN slice names.

2. The method of claim 1 further comprises:

when the computing device determines to use the standard DSN data accessing protocol;

generating, by the computing device, a set of data access requests regarding the data, wherein a data access request of the set of data access requests includes one or more DSN slice names and the data access function, and wherein the one or more DSN slice names provide one or more DSN addresses for the storage unit;

sending, by the computing device, the set of data access requests to the set of storage units; and

executing, by at least some storage units of the set of storage units, the data access function.

3. The method of claim 1, wherein the determining whether to utilize the non-standard DSN data accessing protocol or the standard DSN data accessing protocol comprises one or more of:

determining to utilize the non-standard DSN data accessing protocol when the data includes a plurality of related data objects;

determining to utilize the non-standard DSN data accessing protocol when the data includes different revision levels of a data object;

determining to utilize the standard DSN data accessing protocol when the data includes a specific set of encoded data slices; and

determining to utilize the non-standard DSN data accessing protocol or the standard DSN data accessing protocol based on the data access function.

4. The method of claim 1 further comprises:

the network identifier including, for the storage unit, one or more of;

a uniform record locator (URL), a network port, a network interface, an application program interface (API), a trusted certificate, an authentication authority, and a credential;

the data identifier including one or more of;

a file name, a name embedded in the URL, one or more data object names, one or more data segment names, a name for the data, a name for a collection of data; and

the data access function including one or more of;

a read request, a write request, a delete request, and a list request.

5. The method of claim 4, wherein the sending the set of non-standard data access requests to at least some storage units of the set of storage units comprises:

for each of the at least some storage units;

verifying one or more of the trusted certificate, the authentication authority, and the credential;

when the one or more of the trusted certificate, the authentication authority, and the credential have been verified, determining to address the storage unit via one of the URL, the network port, the network interface, and the API to produce a determined access mechanism; and

sending the set of non-standard data access requests to at least some storage units via the determined access mechanism.

6. The method of claim 1 further comprises:

generating the data identifier to optimize a particular DSN function, wherein the particular DSN function includes one or more of;

locating related encoded data slices, listing related encoded data slices, and listing of translated names regarding encoded data slices.

7. The method of claim 1, wherein the converting the non-standard data access request into one or more DSN slice names comprises:

determining a vault identifier based on identity of a requesting device issuing a data access request;

determining a pillar number based on the vault identifier and the network identifier;

determining a range of segment identifiers based on the data identifier;

determining an object identifier based on the data identifier; and

generating the one or more DSN slice names based on the pillar number, the vault identifier, the range of segment identifiers, and the object identifier.

8. A non-transitory computer readable memory comprises:

a first memory element that stores operational instructions that, when executed by a computing device of a dispersed storage network (DSN), causes the computing device to;

determine whether to utilize a non-standard DSN data accessing protocol or a standard DSN data accessing protocol to access data from the DSN, wherein the data is dispersed storage error encoded into one or more sets of encoded data slices and wherein the one or more sets of encoded data slices are stored in a set of storage units of the DSN;

when the computing device determines to use the non-standard DSN data accessing protocol;

generate a set of non-standard data access requests regarding the data, wherein a non-standard data access request of the set of non-standard data access requests includes a network identifier of a storage unit of the set of storage units, a data identifier corresponding to the data, and a data access function; and

send the set of non-standard data access requests to at least some storage units of the set of storage units, which includes the storage unit; and

a second memory element that stores operational instructions that, when executed by a storage unit of the set of storage units, causes the storage unit to;

convert the non-standard data access request into one or more DSN slice names;

determine that the one or more DSN slice names are within a slice name range allocated to the storage unit; and

when the one or more DSN slice names are within the slice name range, execute the data access function regarding one or more encoded data slices corresponding to the one or more DSN slice names.

9. The non-transitory computer readable memory of claim 8 further comprises:

a third memory element that stores operational instructions that, when executed by the computing device, causes the computing device to;

when the computing device determines to use the standard DSN data accessing protocol;

generate a set of data access requests regarding the data, wherein a data access request of the set of data access requests includes one or more DSN slice names and the data access function, and wherein the one or more DSN slice names provide one or more DSN addresses for the storage unit; and

send the set of data access requests to the set of storage units; and

a fourth memory element that stores operational instructions that, when executed by the storage unit, causes the storage unit to;

execute the data access function of the one of the set of data access requests.

10. The non-transitory computer readable memory of claim 8, wherein the first memory element further stores operational instructions that, when executed by the computing device, causes the computing device to determine whether to utilize the non-standard DSN data accessing protocol or the standard DSN data accessing protocol by one or more of:

determining to utilize the non-standard DSN data accessing protocol when the data includes a plurality of related data objects;

determining to utilize the non-standard DSN data accessing protocol when the data includes different revision levels of a data object;

determining to utilize the standard DSN data accessing protocol when the data includes a specific set of encoded data slices; and

determining to utilize the non-standard DSN data accessing protocol or the standard DSN data accessing protocol based on the data access function.

11. The non-transitory computer readable memory of claim 8 further comprises:

the network identifier including, for the storage unit, one or more of;

a uniform record locator (URL), a network port, a network interface, an application program interface (API), a trusted certificate, an authentication authority, and a credential;

the data identifier including one or more of;

a file name, a name embedded in the URL, one or more data object names, one or more data segment names, a name for the data, a name for a collection of data; and

the data access function including one or more of;

a read request, a write request, a delete request, and a list request.

12. The non-transitory computer readable memory of claim 11, wherein the first memory element further stores operational instructions that, when executed by the computing device, causes the computing device to send the set of non-standard data access requests to at least some storage units of the set of storage units by:

for each of the at least some storage units;

verifying one or more of the trusted certificate, the authentication authority, and the credential;

when the one or more of the trusted certificate, the authentication authority, and the credential have been verified, determining to address the storage unit via one of the URL, the network port, the network interface, and the API to produce a determined access mechanism; and

sending the set of non-standard data access requests to at least some storage units via the determined access mechanism.

13. The non-transitory computer readable memory of claim 8 further comprises:

a third memory element that stores operational instructions that, when executed by the computing device, causes the computing device to;

generate the data identifier to optimize a particular DSN function, wherein the particular DSN function includes one or more of;

locating related encoded data slices, listing related encoded data slices, and listing of translated names regarding encoded data slices.

14. The non-transitory computer readable memory of claim 8, wherein the second memory element that stores operational instructions that, when executed by the storage unit, causes the storage unit to convert the non-standard data access request into one or more DSN slice names by:

determining a vault identifier based on identity of a requesting device issuing a data access request;

determining a pillar number based on the vault identifier and the network identifier;

determining a range of segment identifiers based on the data identifier;

determining an object identifier based on the data identifier; and

generating the one or more DSN slice names based on the pillar number, the vault identifier, the range of segment identifiers, and the object identifier.