Virtual disk drive system and method

• US 8,473,776 B2
• Filed: 12/06/2010
• Issued: 06/25/2013
• Est. Priority Date: 08/14/2003
• Status: Active Grant

• Current Assignee: Dell International LLC (Dell Technologies Inc.)
• Original Assignee: Compellent Technologies Incorporated (Dell Technologies Inc.)
• Inventors: Soran, Philip E., Guider, John P., Aszmann, Lawrence E., Klemm, Michael J.
• Primary Examiner(s): Iqbal, Nadeem
• Application Number:
  US12/960,657
• Publication Number:
  US 20110078119A1
• Time in Patent Office: 932 Days
• Field of Search: 714/6.11, 714/6.12, 714/6.13, 714/6.2, 714/6.21, 714/6.22, 714/6.23, 714/6.24, 714/6.3, 714/6.31, 714/6.32, 714/42
• US Class Current: 714/5.1
• CPC Class Codes: G06F 11/108 Parity data distribution in semiconductor storages, e.g. in SSD
• CPC Class Codes: G06F 11/1435 using file system or storage system metadata
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 11/2089 Redundant storage control functionality
• CPC Class Codes: G06F 12/02 Addressing or allocation; Relocation program address sequencing G06F9/00; arrangements for selecting an address in a digital store G11C8/00
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0611 in relation to response time
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0683 Plurality of storage devices
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

A disk drive system and method capable of dynamically allocating data is provided. The disk drive system may include a RAID subsystem having a pool of storage, for example a page pool of storage that maintains a free list of RAIDs, or a matrix of disk storage blocks that maintain a null list of RAIDs, and a disk manager having at least one disk storage system controller. The RAID subsystem and disk manager dynamically allocate data across the pool of storage and a plurality of disk drives based on RAID-to-disk mapping. The RAID subsystem and disk manager determine whether additional disk drives are required, and a notification is sent if the additional disk drives are required. Dynamic data allocation and data progression allow a user to acquire a disk drive later in time when it is needed. Dynamic data allocation also allows efficient data storage of snapshots/point-in-time copies of virtual volume pool of storage, instant data replay and data instant fusion for data backup, recovery etc., remote data storage, and data progression, etc.

Claims

1. A method of data fusion, comprising the steps of:

generating at least one virtual volume of disk space from a plurality of data storage devices;

allocating the disk space of the at least one virtual volume;

writing data to the allocated disk space;

automatically generating a snapshot point-in-time-copy (PITC) for each of the at least one virtual volumes at predetermined time intervals, each snapshot PITC comprising a table of pointers to data pages, the pointers used to map the contents of the corresponding virtual volume as of the point in time the snapshot PITC was generated; and

storing an address index of each snapshot PITC such that each snapshot PITC of the at least one virtual volume can be instantly located via the stored address index.

2. The method of claim 1, wherein each snapshot PITC comprises a record of write operations to an associated virtual volume.

3. The method of claim 2, wherein each snapshot PITC comprises only the changes to the data in an associated virtual volume that have taken place since a previous snapshot PITC taken at a previous time interval.

4. The method of claim 1, wherein the step of automatically generating a snapshot PITC for each of the at least one virtual volumes at predetermined time intervals includes automatically generating a snapshot PITC for each of the at least one virtual volumes at a user defined time interval.

5. The method of claim 4, wherein the time intervals are in a range of every few minutes to every few hours.

6. The method of claim 1, wherein the snapshot PITCs are stored at a local RAID subsystem.

7. The method of claim 1, wherein the snapshot PITCs are stored at a remote RAID subsystem such that if a major system crash occurs, integrity of data is not affected, and the data can be instantly recovered.

8. The method of claim 1, further comprising generating a snapshot PITC for at least one virtual volume upon user request.

9. The method of claim 1, further comprising generating at least one parallel chain of snapshot PITCs for at least one virtual volume.

10. The method of claim 9, wherein the at least one parallel chain of snapshot PITCs for at least one virtual volume is generated upon user request.

11. The method of claim 1, further comprising coalescing two or more snapshot PITCs for an associated virtual volume.

12. The method of claim 11, wherein automatically generating a snapshot PITC comprises committing the snapshot PITC as read-only.

13. A method of data fusion, comprising the steps of:

defining a default size of disk space of a data storage subsystem which forms a pool of storage;

automatically generating a snapshot point-in-time-copy (PITC) of the pool of storage at predetermined time intervals, the snapshot PITC comprising a table of pointers to data pages, the pointers used to map the contents of the pool of storage as of the point in time the snapshot PITC was generated; and

storing an address index of the snapshot PITC such that the snapshot PITC of the pool of storage can be instantly located via the stored address index.

14. The method of claim 13, wherein the snapshot PITC comprises a record of write operations to the pool of storage.

15. The method of claim 13, wherein the step of automatically generating a snapshot PITC for the pool of storage at predetermined time intervals includes automatically generating a snapshot PITC for the pool of storage at a user defined time interval.

16. The method of claim 13, wherein the snapshot PITCs are stored at a remote data storage subsystem such that if a major system crash occurs, integrity of data is not affected, and the data can be instantly recovered.

17. The method of claim 13, further comprising generating a snapshot PITC for the pool of storage upon user request.

18. The method of claim 13, further comprising generating at least one parallel chain of snapshot PITCs for the pool of storage.

19. The method of claim 18, wherein the at least one parallel chain of snapshot PITCs for the pool of storage is generated upon user request.

20. A disk drive system, capable of fusing data, comprising:

a data storage subsystem having a pool of storage;

at least one virtual volume of disk space from a plurality of data storage devices of the data storage subsystem; and

a disk manager having at least one disk storage system controller, the system controller automatically generating a snapshot point-in-time-copy (PITC) for each of the at least one virtual volumes at predetermined time intervals and storing an address index of each snapshot PITC in the associated virtual volume such that the snapshot PITC of the virtual volume can be instantly located via the stored address index;

wherein each snapshot PITC comprises a table of pointers to data pages, the pointers used to map the contents of the corresponding virtual volume as of the point in time the snapshot PITC was generated.

21. The disk drive system of claim 20, wherein the data storage devices comprise RAID devices.

22. A disk drive system, capable of fusing data, comprising:

abstract means for generating at one least abstraction of disk space from a plurality of data storage devices;

allocating means for allocating the disk space of the at least one abstraction;

writing means for writing data to the allocated disk space;

fusing means for automatically generating a snapshot point-in-time-copy (PITC) for each of the at least one abstractions at predetermined time intervals, each snapshot PITC comprising a table of pointers to data pages, the pointers used to map the contents of the corresponding abstraction as of the point in time the snapshot PITC was generated; and

storing means for storing an address index of each snapshot PITC such that each snapshot PITC can be instantly located via the stored address index.