DISPERSED STORAGE NETWORK VIRTUAL ADDRESS SPACE

• US 20140019711A1
• Filed: 09/13/2013
• Published: 01/16/2014
• Est. Priority Date: 07/30/2009
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: Cleversafe Incorporated (International Business Machines Corporation)
• Inventors: Leggette, Wesley, Dhuse, Greg, Baptist, Andrew, Gladwin, S. Christopher
• Granted Patent: US 8,972,692 B2
• Time in Patent Office: Days
• US Class Current: 711/208
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 12/0246 in block erasable memory, e.g. flash memory
• CPC Class Codes: G06F 12/1009 using page tables, e.g. page table structures
• CPC Class Codes: G06F 16/113 Details of archiving lifecycle management in storage systems G06F3/0649; backup systems G06F11/1446
• CPC Class Codes: G06F 2211/1028 Distributed, i.e. distributed RAID systems with parity

Abstract

A dispersed storage network utilizes a virtual address space to store data. The dispersed storage network includes a dispersed storage device for receiving a request relating to a data object stored in the dispersed storage network and determining a virtual memory address assigned to the data object. The virtual memory address is within a virtual memory address range of the virtual address space that is allocated to a vault associated with a user of the data object. The virtual memory address is further assigned to a data slice of a plurality of data slices of the data object. The dispersed storage device uses the virtual memory address to determine an identifier of a storage unit within the dispersed storage network that has the data slice stored therein.

Claims

1. A dispersed storage device for use within a dispersed storage network, comprising:

an interface;

a directory including a virtual address space;

a storage unit table; and

a processing module operable to;

receive a request relating to a data object stored within the dispersed storage network via the interface, the request including an object name of the data object and a user identifier of a user associated with the data object;

index into the directory using the object name and the user identifier to determine a virtual memory address assigned to the data object, the virtual memory address being within a virtual memory address range of the virtual address space allocated to a vault associated with the user, the virtual memory address further being assigned to a data slice of a plurality of data slices of the data object; and

index into the storage unit table using the virtual memory address to determine an identifier of a storage unit within the dispersed storage network that has the data slice stored therein.

2. The dispersed storage device of claim 1, wherein the data object includes data segments, a number of data slices within each of the data segments corresponding to a number of pillars per data segment for the data object, the number of pillars per data segment being constant for the vault associated with the user.

3. The dispersed storage device of claim 2, wherein the virtual memory address range of the vault includes discrete address ranges, one for each of the pillars of the vault, each of the discrete address ranges being separated from other ones of the discrete address ranges by a predetermined amount.

4. The dispersed storage device of claim 3, wherein the discrete address ranges for the vault are equidistant from one another within the virtual address space.

5. The dispersed storage device of claim 3, wherein each of the discrete address ranges includes a plurality of virtual memory addresses, each containing a plurality of most significant bits, the most significant bits remaining constant within each of the discrete address ranges.

6. The dispersed storage device of claim 3, wherein each pillar within the vault has a pillar number, and the same pillar numbers for each vault are assigned discrete address ranges within the virtual address space near one another.

7. The dispersed storage device of claim 2, wherein each of the pillars is stored on a separate one of a plurality of storage units.

8. The dispersed storage device of claim 2, wherein at least one of the pillars is stored on two or more of a plurality of storage units.

9. The dispersed storage device of claim 1, wherein the virtual memory address corresponds to a slice name of the data slice.

10. The dispersed storage device of claim 1, wherein the data object includes at least one of a data file, a data block and a real time data stream.

11. The dispersed storage device of claim 1, wherein the processing module is further operable to dynamically alter the virtual memory address range allocated to the vault based on a trigger.

12. The dispersed storage device of claim 11, wherein the trigger includes one or more of a command, a schedule and a detected security breach.

13. The dispersed storage device of claim 1, wherein the virtual memory address is encrypted.

14. The dispersed storage device of claim 1, wherein the processing module is further operable to dynamically update the storage unit table when the data slice is moved to another storage unit.

15. A method for managing a data object stored within a dispersed storage network, the method comprising:

receiving a request relating to the data object, the request including an object name of the data object and a user identifier of a user associated with the data object;

determining a virtual memory address assigned to the data object using the object name and the user identifier, the virtual memory address being within a virtual memory address range of a virtual address space allocated to a vault associated with the user, the virtual memory address further being assigned to a data slice of a plurality of data slices of the data object; and

determining an identifier of a storage unit within the dispersed storage network that has the data slice stored therein using the virtual memory address.

16. The method of claim 15, wherein the data object includes data segments, a number of data slices within each of the data segments corresponding to a number of pillars per data segment for the data object, the number of pillars per data segment being constant for the vault associated with the user.

17. The method of claim 16, wherein the virtual memory address range of the vault includes discrete address ranges, one for each of the pillars of the vault, each of the discrete address ranges being separated from other ones of the discrete address ranges by a predetermined amount.

18. The method of claim 15, further comprising:

dynamically altering the virtual memory address range allocated to the vault based on a trigger.

19. The method of claim 18, wherein the trigger includes one or more of a command, a schedule and a detected security breach.

20. The method of claim 15, further comprising:

dynamically updating a storage unit table maintaining storage unit identifiers and associated data slice names when the data slice is moved to another storage unit.