SELF-PROTECTING MASS STORAGE SYSTEMS AND METHODS

• US 20130282976A1
• Filed: 04/22/2013
• Published: 10/24/2013
• Est. Priority Date: 04/22/2012
• Status: Abandoned Application

• Current Assignee: 9LIVESDATA CEZARY DUBNICKI
• Original Assignee: 9livesdata Cezary Dubnicki
• Inventors: Dubnicki, Cezary
• Application Number:
  US13/867,672
• Publication Number:
  US 20130282976A1
• Time in Patent Office: Days
• US Class Current: 711/112
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1453 using de-duplication of the data
• CPC Class Codes: G06F 11/1456 Hardware arrangements for backup
• CPC Class Codes: G06F 12/00 Accessing, addressing or allocating within memory systems or architectures digital input from, or digital output to record carriers, e.g. to disk storage units, G06F3/06

Abstract

Method and systems directed to implementing a primary storage scheme and a secondary storage scheme on a common storage system are disclosed. One such system includes at least one storage device, a primary data storage module and a secondary data storage module. Each of the storage devices includes a plurality of storage mediums. Further, the primary data storage module is configured to store primary data in the storage device(s) in accordance with a primary storage method employing a first resiliency scheme. In addition, the secondary storage module is configured to store secondary data based on the primary data in the storage device(s) in accordance with a secondary storage method employing a second resiliency scheme such that a resiliency of recovering information composed by the primary data is at least cumulative of a resiliency of the first resiliency scheme and a resiliency of the second resiliency scheme.

Claims

1. A storage system comprising:

at least one storage device including a plurality of storage mediums;

a primary data storage module configured to store primary data in said at least one storage device in accordance with a primary storage method employing a first resiliency scheme; and

a secondary storage module configured to store secondary data based on said primary data in said at least one storage device in accordance with a secondary storage method employing a second resiliency scheme such that a resiliency of recovering information composed by said primary data is at least cumulative of a resiliency of said first resiliency scheme and a resiliency of said second resiliency scheme.

2. The system of claim 1, wherein the secondary storage module is configured to store said secondary data such that any fragment of said secondary data and a corresponding data block of said primary data from which the fragment of said secondary data is based are stored on different storage mediums of said plurality of storage mediums.

3. The system of claim 1, wherein said at least one storage device is one storage node and wherein said at least one storage medium is a plurality of disks.

4. The system of claim 1, wherein said plurality of storage mediums is a plurality of disks, wherein said at least one storage device is a cluster of storage nodes and wherein each of said storage nodes includes a different set of disks of said plurality of disks.

5. The system of claim 4, wherein the secondary storage module is configured to store said secondary data such that any fragment of said secondary data and a corresponding data block of said primary data from which the fragment of said secondary data is based are stored on different nodes of said cluster of storage nodes.

6. The system of claim 1, wherein at least one of said storage mediums consists of one partition and wherein at least a portion of said secondary data and at least a portion of said primary data are stored in the partition.

7. The system of claim 1, wherein at least a portion of said secondary data is stored in a partition of a given storage medium of said storage mediums allocated for secondary storage data and wherein at least a portion of said primary data is stored in a partition of said given storage medium allocated for primary storage data.

8. The system of claim 7, wherein said given storage medium further includes at least one free partition.

9. The system of claim 8, further comprising:

a controller configured to allocate a partition of said at least one free partition to primary storage data in response to determining that said partition of said given storage medium allocated for primary storage data exceeds a storage threshold or to allocate said partition of said at least one free partition to secondary storage data in response to determining that said partition of said given storage medium allocated for secondary storage data exceeds said storage threshold.

10. The system of claim 1, wherein said secondary storage module is further configured to store at least one copy of said primary data and to generate said secondary data from said at least one copy.

11. A storage system comprising:

a plurality of storage devices, each of the storage devices including a plurality of storage mediums;

a primary data storage module configured to store primary data in said storage devices in accordance with a primary storage method employing a first resiliency scheme, wherein the primary data storage module is configured store a first primary data block of said primary data by distributing different fragments of said first primary data block across at least a subset of the storage mediums of a first storage device of said plurality of storage devices and to store a second primary data block of said primary data by distributing different fragments of said second primary data block across at least a subset of the storage mediums of a second storage device of said plurality of storage devices; and

a secondary storage module configured to store secondary data based on said primary data in accordance with a secondary storage method employing a second resiliency scheme, wherein the secondary storage module is configured to compute secondary data fragments from at least a subset of the fragments of said first primary data block and from at least a subset of the fragments of said second primary data block and to recover information in said first primary data block by computing at least one lost fragment directly from at least one fragment of said subset of fragments of said second primary data block and from at least one of said secondary data fragments.

12. The system of claim 11, wherein the resiliency of said first resiliency scheme is different from the resiliency of said second resiliency scheme.

13. The system of claim 11, wherein the secondary storage module is configured to store said secondary data such that any given fragment of said secondary data and corresponding fragments of said primary data from which the given fragment of said secondary data is based are stored on different storage mediums of said plurality of storage mediums.

14. The system of claim 11, wherein said plurality of storage mediums is a plurality of disks, wherein said at least one storage device is a cluster of storage nodes and wherein each of said storage nodes includes a different set of disks of said plurality of disks.

15. The system of claim 14, wherein the secondary storage module is configured to store said secondary data such that any given fragment of said secondary data and corresponding fragments of said primary data from which the given fragment of said secondary data is based are stored on different nodes of said cluster of storage nodes.

16. The system of claim 11, wherein at least one of said storage mediums consists of one partition and wherein at least a portion of said secondary data and at least a portion of said primary data is stored in the partition.

17. The system of claim 11, wherein at least a portion of said secondary data is stored in a partition of a given storage medium of said storage mediums allocated for secondary storage data and wherein at least a portion of said primary data is stored in a partition of said given storage medium allocated for primary storage data.

18. The system of claim 17, wherein said given storage medium further includes at least one free partition.

19. The system of claim 18, further comprising:

a controller configured to allocate a partition of said at least one free partition to primary storage data in response to determining that an amount of data stored in said partition of said given storage medium allocated for primary storage data exceeds a storage threshold or to allocate said partition of said at least one free partition to secondary storage data in response to determining that an amount of data stored in said partition of said given storage medium allocated for secondary storage data exceeds said storage threshold.

20. A storage system comprising:

a plurality of storage device nodes, wherein each of said nodes includes a plurality of different storage mediums;

a primary data storage module configured to store a first primary data block of primary data on a first node of said plurality of storage device nodes in accordance with a primary storage method by distributing different fragments of said first primary data block across the storage mediums of said first node and to store a second primary data block of the primary data on a second node of said plurality of storage device nodes by distributing different fragments of said second primary data block across the storage mediums of said second node; and

a secondary storage module configured to store secondary storage data including data that is redundant of said first primary data block in accordance with a secondary storage method by distributing fragments of said secondary storage data across different storage device nodes of said plurality of storage device nodes, wherein at least a portion of said secondary storage data is stored on one of the storage mediums of said second node on which at least a portion of said second primary data block is stored or is stored on one of the storage mediums of said first node on which at least a portion of said first primary data block is stored.

21. The system of claim 20, wherein the primary storage method employs a first resiliency scheme, wherein the secondary storage method employs a second resiliency scheme that is different from the first resiliency scheme, and wherein the secondary storage module is further configured to store the secondary storage data such that a resiliency of recovering information in said primary data is cumulative of a resiliency of said first resiliency scheme and a resiliency of said second resiliency scheme.

22. The system of claim 21, wherein the secondary storage module is constrained to store said secondary storage data such that any given fragment of the fragments of said secondary storage data and any portion of a corresponding data block of said primary data from which the given fragment of said secondary storage data is based are stored on different storage mediums of said plurality of storage mediums.

23. The system of claim 22, wherein the secondary storage module is further constrained to store said secondary storage data such that the given fragment of said secondary storage data and any portion of the corresponding data block of said primary data from which the given fragment of said secondary data is based are stored on different storage device nodes of said plurality of storage device nodes.