Large scale subscription based dispersed storage network

• US 8,688,907 B2
• Filed: 08/25/2010
• Issued: 04/01/2014
• Est. Priority Date: 11/25/2009
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: Cleversafe Incorporated (International Business Machines Corporation)
• Inventors: Grube, Gary W., Markison, Timothy W.
• Primary Examiner(s): Bradley, Matthew
• Assistant Examiner(s): Mercado, Ramon A
• Application Number:
  US12/862,878
• Publication Number:
  US 20110126060A1
• Time in Patent Office: 1,315 Days
• Field of Search: None
• US Class Current: 711/114
• CPC Class Codes: G06F 11/1088 Reconstruction on already foreseen single or plurality of spare disks
• CPC Class Codes: G06F 16/182 Distributed file systems

Abstract

A method begins with a processing module identifying data for storage and sending a subscription request message regarding the data for storage. The method continues with the processing module receiving a subscription response message. The method continues with the processing module obtaining error coding dispersal storage function parameters when a dispersal method of the subscription response message indicates direct dispersal. The method continues with the processing module encoding at least a portion of the data in accordance with the error coding dispersal storage function parameters to produce a set of encoded data slices. The method continues with the processing module determining a plurality of storage locations and performing a dispersed storage write function to store the set of encoded data slices in the plurality of storage locations.

Claims

1. A method for execution by a subscribing computing device comprises:

identifying data for storage;

determining to store the data in local memory of the computing device or to store the data as encoded data slices;

when the data is to be stored as encoded data slices, sending, to a unit of a distributed storage network (DSN), a subscription request message regarding the data for storage;

receiving, from the unit, a subscription response message which indicates a type of dispersal storage allowed, wherein allowed types of dispersal storage include;

direct dispersal storage where the subscribing computing device encodes the data into the encoded data slices and sends the encoded data slices to storage units of the DSN for storage therein,

indirect dispersal storage where a dispersed storage processing unit encodes the data and sends the encoded data slices to the storage units of the DSN for storage therein, and targeted dispersed storage where the subscribing computing device encodes the data into the encoded data slices and sends the encoded data slices to other subscribing computing devices for storage therein; and

when the subscription response message indicates the direct dispersal storage;

obtaining, from the unit, error coding dispersal storage function parameters;

encoding at least a portion of the data in accordance with the error coding dispersal storage function parameters to produce the encoded data slices; and

performing a dispersed storage write function to store the encoded data slices in the storage units of the DSN.

2. The method of claim 1 further comprises:

when the subscription response indicates the targeted dispersed storage;

encoding the at least a portion of the data in accordance with the error coding dispersal storage function parameters to produce the encoded data slices; and

performing a dispersed storage write function to store the encoded data slices in targeted other subscribing computing devices.

3. The method of claim 1, wherein the subscription request message comprises one or more of:

a subscription request, a user device identifier, a data type, a data size, a security indicator, a performance requirement, a cost requirements, a preference, storage location type, and a command.

4. The method of claim 1 further comprises:

when the subscription response indicates the indirect dispersal storage;

sending the data to the dispersed storage processing unit, wherein the dispersed storage processing unit encodes the data and sends the encoded data slices to the storage units of the DSN for storage therein; and

receiving information regarding storage of the data via the indirect dispersal storage.

5. The method of claim 1 further comprises at least one of:

when the subscription response message indicates that a subscription is invalid, storing the data in local memory of the computing device.

6. The method of claim 1, wherein the performing the dispersed storage write function further comprises:

outputting a plurality of write messages to the storage units;

receiving a negative response to one of the plurality of write messages from one of the storage units; and

selecting another storage unit of the DSN.

7. A computer comprises:

an interface;

a local memory; and

a processing module operable to;

identify data for storage;

determine to store the data in local memory of the computing device or to store the data as encoded data slices;

when the data is to be stored as encoded data slices, send, to a unit of a distributed storage network (DSN), a subscription request message regarding the data for storage;

receive, from the unit, a subscription response message which indicates a type of dispersal storage allowed, wherein allowed types of dispersal storage include;

direct dispersal storage where the subscribing computing device encodes the data into the encoded data slices and sends the encoded data slices to storage units of the DSN for storage therein,

indirect dispersal storage where a dispersed storage processing unit encodes the data and sends the encoded data slices to the storage units of the DSN for storage therein, and

targeted dispersed storage where the subscribing computing device encodes the data into the encoded data slices and sends the encoded data slices to other subscribing computing devices for storage therein; and

when the subscription response message indicates the direct dispersal storage;

obtain, from the unit, error coding dispersal storage function parameters;

encode at least a portion of the data in accordance with the error coding dispersal storage function parameters to produce the encoded data slices; and

perform a dispersed storage write function to store the encoded data slices in the storage units of the DSN.

8. The computer of claim 7, wherein the processing module is further operable to:

when the subscription response indicates the targeted dispersed storage;

encode the at least a portion of the data in accordance with the error coding dispersal storage function parameters to produce the encoded data slices; and

perform a dispersed storage write function to store the encoded data slices in targeted other subscribing computing devices.

9. The computer of claim 7, wherein the subscription request message comprises one or more of:

a subscription request, a user device identifier, a data type, a data size, a security indicator, a performance requirement, a cost requirements, a preference, storage location type, and a command.

10. The computer of claim 7, wherein the processing module further functions to:

when the subscription response indicates the indirect dispersal storage;

send the data to the dispersed storage processing unit, wherein the dispersed storage processing unit encodes the data and sends the encoded data slices to the storage units of the DSN for storage therein; and

receive information regarding storage of the data via the indirect dispersal storage.

11. The computer of claim 7, wherein the processing module further functions to:

store the data in the local memory when the subscription response message indicates that a subscription is invalid.

12. The computer of claim 7, wherein the processing module further functions to perform the dispersed storage write function by:

outputting, via the interface, a plurality of write messages to the storage units;

receiving, via the interface, a negative response to one of the plurality of write messages from one of the storage units; and

selecting another storage unit of the DSN.