Mapping storage of data in a dispersed storage network

• US 9,558,067 B2
• Filed: 11/25/2013
• Issued: 01/31/2017
• Est. Priority Date: 01/04/2013
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Resch, Jason K., Dhuse, Greg
• Primary Examiner(s): Guyton, Philip
• Application Number:
  US14/088,897
• Publication Number:
  US 20140195846A1
• Time in Patent Office: 1,163 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/1092 Rebuilding, e.g. when physically replacing a failing disk
• CPC Class Codes: G06F 2211/1028 Distributed, i.e. distributed RAID systems with parity
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0629 Configuration or reconfiguration of storage systems
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/0643 Management of files
• CPC Class Codes: G06F 3/0644 Management of space entities, e.g. partitions, extents, pools
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

A method begins by a dispersed storage (DS) processing module receiving data for storage in a dispersed storage network (DSN) memory and ascertaining dispersed storage error encoding parameters for encoding the data. The method continues with the DS processing module ascertaining storage units of the DSN memory for the storing an encoded version of the data and ascertaining a storage mapping that maps encoded data slices to storage units for storing the encoded version of the data. The method continues with the DS processing module encoding the data in accordance with the dispersed storage error encoding parameters to produce sets of encoded data slices. The method continues with the DS processing module generating a plurality of write requests for storing, in accordance with the storage mapping, encoded data slices of the sets of encoded data slices in a pattern across the storage units.

Claims

1. A method for execution by one or more processing modules of one or more computing devices of a dispersed storage network (DSN), the method comprises:

receiving a data object for storage in DSN memory;

ascertaining dispersed storage error encoding parameters for encoding the data object;

ascertaining “

p”

number of storage units of the DSN memory for storing an encoded version of the data object;

ascertaining a storage mapping that maps encoded data slices to storage units for storing the encoded version of the data object;

segmenting the data object into a plurality of data segments;

encoding the plurality of data segments in accordance with the dispersed storage error encoding parameters to produce a plurality of sets of encoded data slices, wherein a set of the plurality of sets of encoded data slices includes “

n”

number of encoded data slices, wherein “

n”

is less than “

p”

; and

on a data segment by data segment basis, generating a set of write requests for storing, in accordance with the storage mapping, encoded data slices of a corresponding set of the plurality of sets of encoded data slices, wherein encoded data slices of the plurality of sets of encoded data slices are stored in a pattern across the “

p”

number of storage units, wherein less than the “

p”

number of storage units stores an encoded data slice of the corresponding set of the plurality of sets of encoded data slices or a subset thereof; and

wherein the storage mapping includes, from set to set, the “

n”

number of encoded data slices of the plurality of sets of encoded data slices being stored in a fixed sub-set of the “

p”

number of storage units.

2. The method of claim 1 further comprises:

ascertaining the dispersed storage error encoding parameters and the “

p”

number of storage units such that “

n”

is equal to or less than “

p”

; and

ascertaining the storage mapping such that, from set to set, a fixed sub-set of the “

n”

number of encoded data slices of the plurality of sets of encoded data slices are stored in the fixed sub-set of the “

p”

number of storage units.

3. The method of claim 1 further comprises:

ascertaining the dispersed storage error encoding parameters and the “

p”

number of storage units such that “

n”

is equal to or less than “

p”

; and

ascertaining the storage mapping such that, from set to set, a varying sub-set of the “

n”

number of encoded data slices of the plurality of sets of encoded data slices are stored in the fixed sub-set of the “

p”

number of storage units.

4. A dispersed storage (DS) module of a dispersed storage network (DSN), the DS module comprises:

a first processing module, when operable within a computing device, causes the computing device to;

receive a data object for storage in DSN memory;

ascertain dispersed storage error encoding parameters for encoding the data object;

ascertain “

p”

number of storage units of the DSN memory for storing an encoded version of the data object; and

ascertain a storage mapping that maps encoded data slices to storage units for storing the encoded version of the data object;

a second processing module, when operable within the computing device, causes the computing device to;

segment the data object into a plurality of data segments;

encode the plurality of data segments in accordance with the dispersed storage error encoding parameters to produce a plurality of sets of encoded data slices, wherein a set of the plurality of sets of encoded data slices includes “

n”

number of encoded data slices, wherein “

n”

is less than “

p”

; and

a third processing module, when operable within the computing device, causes the computing device to;

on a data segment by data segment basis, generate a set of write requests for storing, in accordance with the storage mapping, encoded data slices of a corresponding set of the plurality of sets of encoded data slices, wherein encoded data slices of the plurality of sets of encoded data slices are stored in a pattern across the “

p”

number of storage units, wherein less than the “

p”

number of storage units stores an encoded data slice of the corresponding set of the plurality of sets of encoded data slices or a subset thereof; and

wherein the storage mapping included, from set to set, the “

n”

number of encoded data slices of the plurality of sets of encoded data slices being stored in a fixed sub-set of the “

p”

number of storage units.

5. The DS module of claim 4 further comprises:

the first processing module, when operable within the computing device, further causes the computing device to;

ascertain the dispersed storage error encoding parameters and the “

p”

number of storage units such that “

n”

is equal to or less than “

p”

; and

ascertain the storage mapping such that, from set to set, a fixed sub-set of the “

n”

number of encoded data slices of the plurality of sets of encoded data slices are stored in the fixed sub-set of the “

p”

number of storage units.

6. The DS module of claim 4 further comprises:

the first processing module, when operable within the computing device, further causes the computing device to;

ascertain the dispersed storage error encoding parameters and the “

p”

number of storage units such that “

n”

is equal to or less than “

p”

; and

ascertain the storage mapping such that, from set to set, a varying sub-set of the “

n”

number of encoded data slices of the plurality of sets of encoded data slices are stored in the fixed sub-set of the “

p”

number of storage units.

7. A method for execution by one or more processing modules of one or more computing devices of a dispersed storage network (DSN), the method comprises:

receiving a data object for storage in DSN memory;

ascertaining dispersed storage error encoding parameters for encoding the data object;

ascertaining “

p”

number of storage units of the DSN memory for storing an encoded version of the data object;

ascertaining a storage mapping that maps encoded data slices to storage units for storing the encoded version of the data object;

segmenting the data object into a plurality of data segments;

encoding the plurality of data segments in accordance with the dispersed storage error encoding parameters to produce a plurality of sets of encoded data slices, wherein a set of the plurality of sets of encoded data slices includes “

n”

number of encoded data slices, wherein “

n”

is less than “

p”

; and

on a data segment by data segment basis, generating a set of write requests for storing, in accordance with the storage mapping, encoded data slices of a corresponding set of the plurality of sets of encoded data slices, wherein encoded data slices of the plurality of sets of encoded data slices are stored in a pattern across the “

p”

number of storage units, wherein less than the “

p”

number of storage units stores an encoded data slice of the corresponding set of the plurality of sets of encoded data slices or a subset thereof; and

wherein the storage mapping includes, from set to set, the “

n”

number of encoded data slices of the plurality of sets of encoded data slices being stored in a varying sub-set of the “

p”

number of storage units.

8. The method of claim 7 further comprises:

ascertaining the dispersed storage error encoding parameters and the “

p”

number of storage units such that “

n”

is equal to or less than “

p”

; and

ascertaining the storage mapping such that, from set to set, a fixed sub-set of the “

n”

number of encoded data slices of the plurality of sets of encoded data slices are stored in the varying sub-set of the “

p”

number of storage units.

9. The method of claim 7 further comprises:

ascertaining the dispersed storage error encoding parameters and the “

p”

number of storage units such that “

n”

is equal to or less than “

p”

; and

ascertaining the storage mapping such that, from set to set, a varying sub-set of the “

n”

number of encoded data slices of the plurality of sets of encoded data slices are stored in the varying sub-set of the “

p”

number of storage units.