Distributed storage network for storing a data object based on storage requirements

• US 9,785,351 B2
• Filed: 06/30/2014
• Issued: 10/10/2017
• Est. Priority Date: 10/30/2009
• Status: Expired due to Fees

• Current Assignee: Pure Storage, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Resch, Jason K., Leggette, Wesley, Gladwin, S. Christopher, Dhuse, Greg, Baptist, Andrew
• Primary Examiner(s): Zhang, Shirley
• Application Number:
  US14/318,790
• Publication Number:
  US 20140317224A1
• Time in Patent Office: 1,198 Days
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/1092 Rebuilding, e.g. when physically replacing a failing disk
• CPC Class Codes: G06F 2211/1028 Distributed, i.e. distributed RAID systems with parity
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04N 21/20 Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
• CPC Class Codes: H04N 21/218 Source of audio or video content , e.g. local disk arrays details of retrieval in video databases G06F16/739

Abstract

A distributed storage network (DSN) includes a user device and a plurality of DSN memories, wherein each of the DSN memories includes a plurality of storage units. The user device includes at least one network interface to the plurality of DSN memories and at least one processing module that is operable to determine one of the plurality of DSN memories for storing a data object based on a comparison of one or more storage requirements of the data object and one or more DSN attributes of the plurality of DSN memories.

Claims

1. A method comprises:

selecting, by a user device of a distributed storage network (DSN), one of a plurality of distributed storage (DS) processing units based on one or more DS processing attributes to produce a selected DS processing unit;

selecting, by the user device, a set of storage units of a plurality of sets of storage units based on one or more storage attributes to produce a selected set of storage units by;

determining, by the user device, one or more desired processing requirements of a data object and a data object priority level;

receiving, by the user device, the one or more storage attributes from a plurality of sets of storage units of one or more DSNs;

comparing, by the user device, the one or more desired processing requirements with the one or more storage attributes; and

assigning, by the user device, a priority level to each of the one or more desired processing requirements based on the data object priority level, wherein a first storage requirement of one or more desired storage requirements has a first higher priority level and a second storage requirement of the one or more desired storage requirements has a second lower priority level;

allocating, by the user device, a greater weight to a first favorable comparison between a first storage attribute of the one or more storage attributes and the first storage requirement with the first higher priority level; and

allocating, by the user device, a lesser weight to a second favorable comparison between a second storage attribute of the one or more storage attributes and the second storage requirement with the second lower priority level;

selecting, by the user device, the selected set of storage units based on a weighted favorable comparison of the one or more desired processing requirements and the one or more storage attributes; and

sending, by the user device, a storage request message regarding storage of a data object to the selected DS processing unit, wherein the storage request message includes identity of the selected set of storage units;

dispersed storage error encoding, by the selected DS processing unit, the data object into a plurality of sets of encoded data slices; and

sending, by the selected DS processing unit, the plurality of sets of encoded data slices to the selected set of storage units.

2. The method of claim 1, wherein the selecting the one of the plurality of DS processing units based on the one or more DS processing attributes comprises:

determining, by the user device, one or more desired processing requirements of the data object;

receiving, by the user device, the one or more DS processing attributes from one or more DS processing units of one or more DSNs;

comparing, by the user device, the one or more desired processing requirements with the one or more DS processing attributes; and

selecting, by the user device, the selected DS processing unit based on a favorable comparison of the one or more desired processing requirements and the one or more DS processing attributes.

3. The method of claim 1, wherein the one or more storage attributes include one or more of:

cost, geographic location, geographic diversity, performance, reliability, latency, capacity, load, and availability.

4. The method of claim 1, wherein the one or more DS processing attributes include one or more of:

availability, reliability, performance history, link speed, link latency, service provider, capacity, capabilities, cost, data ownership, and contractual service obligations.

5. The method of claim 1, further comprises:

transmitting, by the user device, an address update message to a DS managing unit of the DSN to update a user vault with the selected set of storage units for the data object.

6. A storage device comprises:

a first storage element that stores operational instructions that, when executed by a user device of a distributed storage network (DSN), causes the user device to select one of a plurality of distributed storage (DS) processing units based on one or more DS processing attributes to produce a selected DS processing unit;

a second storage element that stores operational instructions that, when executed by the user device, causes the user device to select a set of storage units of a plurality of sets of storage units based on one or more storage attributes to produce a selected set of storage units by;

determining one or more desired processing requirements of a data object and a data object priority level;

receiving the one or more storage attributes from the plurality of sets of storage units of one or more DSNs;

comparing the one or more desired processing requirements with the one or more storage attributes; and

assigning a priority level to each of the one or more desired processing requirements based on the data object priority level, wherein a first storage requirement of one or more desired storage requirements has a first higher priority level and a second storage requirement of the one or more desired storage requirements has a second lower priority level;

allocating a greater weight to a first favorable comparison between a first storage attribute of the one or more storage attributes and the first storage requirement with the first higher priority level; and

allocating a lesser weight to a second favorable comparison between a second storage attribute of the one or more storage attributes and the second storage requirement with the second lower priority level; and

selecting the selected set of storage units based on a favorable weighted comparison of the one or more desired processing requirements and the one or more storage attributes; and

a third storage element that stores operational instructions that, when executed by the user device, causes the user device to send a storage request message regarding storage of a data object to the selected DS processing unit, wherein the storage request message includes identity of the selected set of storage units;

a fourth storage element that stores operational instructions that, when executed by the selected DS processing unit, causes the selected DS processing unit to dispersed storage error encode the data object into a plurality of sets of encoded data slices; and

a fifth storage element that stores operational instructions that, when executed by the selected DS processing unit, causes the selected DS processing unit to send the plurality of sets of encoded data slices to the selected set of storage units.

7. The storage device of claim 6, wherein the first storage element further stores operational instructions that, when executed by the user device, causes the user device to select the one of the plurality of DS processing units based on the one or more DS processing attributes by:

determining one or more desired processing requirements of the data object;

receiving the one or more DS processing attributes from one or more DS processing units of one or more DSNs;

comparing the one or more desired processing requirements with the one or more DS processing attributes; and

selecting the selected DS processing unit based on a favorable comparison of the one or more desired processing requirements and the one or more DS processing attributes.

8. The storage device of claim 6, wherein the one or more storage attributes include one or more of:

cost, geographic location, geographic diversity, performance, reliability, latency, capacity, load, and availability.

9. The storage device of claim 6, wherein the one or more DS processing attributes include one or more of:

availability, reliability, performance history, link speed, link latency, service provider, capacity, capabilities, cost, data ownership, and contractual service obligations.