ERASURE CODED DATA STORAGE CAPACITY AND POWER MANAGEMENT

• US 20110029729A1
• Filed: 07/30/2009
• Published: 02/03/2011
• Est. Priority Date: 07/30/2009
• Status: Abandoned Application

• Current Assignee: LSI Corporation (Broadcom, Inc.)
• Original Assignee: LSI Corporation (Broadcom, Inc.)
• Inventors: McKean, Brian, Zwisler, Ross E., Kidney, Kevin
• Application Number:
  US12/512,642
• Publication Number:
  US 20110029729A1
• Time in Patent Office: Days
• US Class Current: 711/114
• CPC Class Codes: G06F 11/1008 in individual solid state devices G06F11/1004 takes precedence
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0632 by initialisation or re-initialisation of storage systems
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

A set of data is allocated into a plurality of data chunks, wherein the plurality of data chunks is thinly provisioned and erasure coded. A plurality of storage devices is divided into a first and a second set of storage devices, wherein the first set of storage devices is powered up and the second set of storage devices is powered down. The data chunks are distributed on the first set of storage devices to equally load each of the first set of storage devices. A storage device from the second set of storage devices is powered up to reassign the storage device from the second set of storage devices to the first set of storage devices. Data chunks are migrated to a reassigned storage device until the data chunks are evenly distributed on the first set of storage devices and the reassigned storage device.

Claims

1. A method, comprising:

allocating a set of data into a plurality of data chunks, wherein the plurality of data chunks is thinly provisioned and erasure coded;

dividing a plurality of storage devices into a first and a second set of storage devices, wherein the first set of storage devices is powered up and the second set of storage devices is powered down;

distributing the plurality of data chunks on the first set of storage devices to equally load each of the first set of storage devices;

powering up a storage device from the second set of storage devices to reassign the storage device from the second set of storage devices to the first set of storage devices; and

migrating data chunks of the plurality of data chunks to a reassigned storage device until the plurality of data chunks is evenly distributed on the first set of storage devices and the reassigned storage device.

2. The method of claim 1, wherein the plurality of data chunks is encoded utilizing a Redundant Array of Independent Disks (RAID) 5 or RAID 6 encoding.

3. The method of claim 1, the distributing the plurality of data chunks on the first set of storage devices to equally load each of the first set of storage devices further includes:

distributing the plurality of data chunks on the first set of storage devices to equally load each of the first set of storage devices utilizing Controlled Replication Under Scalable Hashing (CRUSH) algorithms.

4. The method of claim 1, wherein the first set of storage devices includes a minimum number of storage devices.

5. The method of claim 4, wherein the minimum number of storage devices is determined by the requirements of the erasure coding scheme utilized to encode the plurality of data chunks and the amount of data stored on the first set of storage devices

6. The method of claim 1, wherein the powering up a storage device from the second set of storage devices to reassign the storage device from the second set of storage devices to the first set of storage devices further includes:

monitoring the capacity of the first set of storage devices to determine whether additional storage capacity is required.

7. The method of claim 1, wherein the migrating data chunks of the plurality of data chunks occurs upon the storage device from the second set of storage devices becoming fully active.

8. A system, comprising:

means for allocating a set of data into a plurality of data chunks, wherein the plurality of data chunks is thinly provisioned and erasure coded;

means for dividing a plurality of storage devices into a first and a second set of storage devices, wherein the first set of storage devices is powered up and the second set of storage devices is powered down;

means for distributing the plurality of data chunks on the first set of storage devices to equally load each of the first set of storage devices;

means for powering up a storage device from the second set of storage devices to reassign the storage device from the second set of storage devices to the first set of storage devices; and

means for migrating data chunks of the plurality of data chunks to a reassigned storage device until the plurality of data chunks is evenly distributed on the first set of storage devices and the reassigned storage device.

9. The system of claim 8, wherein the plurality of data chunks is encoded utilizing a Redundant Array of Independent Disks (RAID) 5 or RAID 6 encoding.

10. The system of claim 8, wherein the plurality of data chunks is distributed on the first set of storage devices to equally load each of the first set of storage devices utilizing Controlled Replication Under Scalable Hashing (CRUSH) algorithms.

11. The system of claim 8, wherein the first set of storage devices includes a minimum number of storage devices

12. The system of claim 11, wherein the minimum number of storage devices is determined by the requirements of the erasure coding scheme utilized to encode the plurality of data chunks and the amount of data stored on the first set of storage devices.

13. The system of claim 8, wherein the means for powering up a storage device from the second set of storage devices to move the storage device from the second set of storage devices to the first set of storage devices further includes:

means for monitoring the capacity of the first set of storage devices to determine whether additional storage capacity is required.

14. The system of claim 8, wherein the means for migrating data chunks of the plurality of data chunks performs the migrating upon the storage device from the second set of storage devices becoming fully active.

15. A mass storage system, comprising:

a processor for allocating a set of data into a plurality of data chunks, wherein the plurality of data chunks is thinly provisioned and erasure coded;

a plurality of storage devices communicatively coupled to the processor for storing the plurality of data chunks, the plurality of storage devices divided into a first and a second set of storage devices, wherein the first set of storage devices in powered up and the second set of storage devices is powered down; and

a controller communicatively coupled to the plurality of storage devices configured for controlling the operation of the plurality of storage devices;

wherein the controller loads the plurality of data chunks on the first set of storage devices to equally load the first set of storage devices, powers up a storage device from the second set of storage devices to reassign the storage device from the second set of storage devices to the first set of storage devices, and migrates data chunks of the plurality of data chunks to a reassigned storage device until the plurality of data chunks is evenly distributed on the first set of storage devices and the reassigned storage device.

16. The system of claim 15, wherein the plurality of data chunks is distributed utilizing Controlled Replication Under Scalable Hashing (CRUSH) algorithms.

17. The system of claim 15, wherein the first set of storage devices contains a minimum number of storage devices.

18. The system of claim 17, wherein the controller determines the minimum number of storage devices based on the requirements of the erasure coding scheme utilized to encode the plurality of data chunks and the amount of data stored on the first set of storage devices.

19. The system of claim 15, wherein the controller further monitors the capacity of the first set of storage devices to determine whether additional storage capacity is required.

20. The system of claim 15, wherein the controller migrates data chunks upon the reassigned storage device becoming fully active.