Flexible data storage system

• US 7,958,303 B2
• Filed: 04/28/2008
• Issued: 06/07/2011
• Est. Priority Date: 07/24/2007
• Status: Active Grant

• Current Assignee: Stripe, Inc.
• Original Assignee: Gary S. Shuster
• Inventors: Shuster, Gary Stephen
• Primary Examiner(s): Bragdon, Reginald G
• Assistant Examiner(s): Ruiz, Aracelis
• Application Number:
  US12/111,063
• Publication Number:
  US 20080275928A1
• Time in Patent Office: 1,135 Days
• Field of Search: None
• US Class Current: 711/114
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/1096 Parity calculation or recalculation after configuration or reconfiguration of the system
• CPC Class Codes: G06F 2211/1004 Adaptive RAID, i.e. RAID system adapts to changing circumstances, e.g. RAID1 becomes RAID5 as disks fill up
• CPC Class Codes: G06F 3/0607 by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/0644 Management of space entities, e.g. partitions, extents, pools
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

Methods and systems for managing and locating available storage space in a system comprising data files stored in a plurality of storage devices and configured in accordance with various data storage schemes (mirroring, striping and parity-striping). A mapping table associated with each of the plurality of storage devices is used to determine the available locations and amount of available space in the storage devices. The data storage schemes for one or more of the stored data files are changed to a basic storage mode when the size of a new data file configured in accordance with an assigned data storage scheme exceeds the amount of available space. The configured new data file is stored in accordance with the assigned data storage scheme in one or more of the available locations and the locations of the new data file are recorded.

Claims

1. A method for managing available storage space in a plurality of storage devices comprising stored data files configured in accordance with one or more data storage schemes, the method comprising:

determining, by reference to a mapping table associated with each of the plurality of storage devices, the available locations and amount of available space in the storage devices;

changing the one or more data storage schemes for one or more of the stored data files to a basic storage mode when a size of a new data file configured in accordance with an assigned data storage scheme exceeds the amount of available space in the storage devices;

storing the new data file configured in accordance with the assigned data storage scheme in one or more of the available locations in the storage devices; and

recording the locations of the new data file in the mapping table in each of the plurality of storage devices;

wherein the one or more data storage schemes are selected from the group consisting of mirroring, striping and parity-striping.

2. The method of claim 1 further comprising prompting a user to confirm the step of changing the data storage scheme for the one or more stored data files before the changing step.

3. The method of claim 1 further comprising changing the one or more data storage schemes for additional stored data files to the basic storage mode until the size of the new data file configured in accordance with the assigned data storage scheme does not exceed the amount of available space in the storage devices.

4. The method of claim 3 further comprising updating the mapping table after each changing step to reflect a changed data storage scheme for the stored data files.

5. The method of claim 1 further comprising updating the mapping table after each storing step to reflect the locations of the new data files and the amount of available space in the plurality of storage devices.

6. The method of claim 1, wherein the mapping table is provided in each of the plurality of storage devices.

7. The method of claim 1, further comprising converting the one or more data storage schemes to the basic storage mode for one or more stored data files based on one or more file characteristics.

8. The method of claim 7, wherein the one or more file characteristics is any one or more selected from the group consisting of:

importance, size, bandwidth requirements, frequency of read access, frequency of write access and frequency of file back-up.

9. The method of claim 8, wherein the importance of the file is designated by a user.

10. The method of claim 1 further comprising assigning the one or more data storage schemes to the new data file.

11. The method of claim 10, wherein the one or more data storage schemes are automatically assigned based desired performance, fault tolerance, and redundancy for the new data file.

12. The method of claim 10 comprising the step of prompting the user to assign the one or more data storage schemes for the new data file.

13. A dynamic data storage system comprising:

a plurality of storage devices;

a plurality of data files stored in the storage devices, the plurality of data files configured in accordance with one or more of a data storage scheme selected from the group consisting of;

striping, mirroring and parity-striping; and

a mapping table associated with each of the plurality of storage devices, the mapping table comprising locations of data files, fragments and parity information associated with the data files, and locations and amount of available space in the storage devices;

wherein the data storage scheme for one or more stored data files is changed to a basic storage mode when a size of a new data file configured in accordance with an assigned data storage scheme exceeds the amount of available space in the storage devices.

14. The system of claim 13, wherein the plurality of storage devices do not have identical available space.

15. The system of claim 13, wherein one or more of the storage devices is located in one or more remotely located device.

16. The system of claim 13, wherein data files configured in accordance with mirroring comprise an original data file and an identical copy of the original data file.

17. The system of claim 16, wherein the original data file and the identical copy are stored on storage devices having different memory capacities.

18. The system of claim 13, wherein data files configured in accordance with striping or parity-striping are segmented into logically sequential data across multiple physical devices.

19. The system of claim 18, wherein for data files configured in accordance with parity-striping further comprises providing parity bit.