Method and system for managing storage systems containing multiple data storage devices

• US 6,728,831 B1
• Filed: 04/16/2002
• Issued: 04/27/2004
• Est. Priority Date: 10/23/1998
• Status: Expired due to Term

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Bridge, William
• Primary Examiner(s): Verbrugge, Kevin
• Application Number:
  US10/124,310
• Time in Patent Office: 742 Days
• Field of Search: 711/111, 711/112, 711/114
• US Class Current: 711/112
• CPC Class Codes: G06F 11/1096 Parity calculation or recalculation after configuration or reconfiguration of the system
• CPC Class Codes: G06F 11/1662 the resynchronized component or unit being a persistent storage device re-synchronization of failed mirror storage G06F11/2082; rebuild or reconstruction of parity RAID storage G06F11/1008
• CPC Class Codes: G06F 11/2069 Management of state, configuration or failover
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0644 Management of space entities, e.g. partitions, extents, pools
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD
• CPC Class Codes: G06F 9/5016 the resource being the memory

Abstract

A system and method for managing storage from multiple data storage devices are disclosed. The system and method provide improved load balancing, reduction or elimination of fragmentation, and efficient changes in hardware configurations. I/O load and data are spread relatively evenly across many data storage devices in the storage system. Dynamic reorganization can be performed for the data stored on the data storage devices.

Claims

1. A data storage system comprising:

a plurality of data storage devices, each of said plurality of data storage devices divided into a plurality of fixed size pieces, each of said fixed size pieces comprising two or more data storage device blocks;

data extents formed from said fixed size pieces, in which said data extents are allocated on boundaries related to the number of said fixed size pieces within an allocated data extent;

one or more logical volumes, said one or more logical volumes corresponding to particular ones of said data extents; and

storage space on said plurality of data storage devices allocated in units of said fixed size pieces.

2. The data storage system of claim 1 in which said plurality of data storage devices comprise disk drives.

3. The data storage system of claim 1 in which said fixed sized pieces are sized as a power of two multiple of a data storage device block size.

4. The data storage system of claim 1 in which said data extents for a particular logical volume are of a fixed size.

5. The data storage system of claim 1 in which each of said data storage devices comprises at least 1,000 fixed size pieces.

6. The data storage system of claim 1 in which said fixed size pieces for at least one of said one or more logical volumes are spread over a plurality of said data storage devices.

7. The data storage system of claim 1 in which address space for said one or more logical volumes is striped across multiple ones of said fixed size pieces over said data storage devices.

8. The data storage system of claim 1 further comprising:

sets of pointers to data extents, each of said sets of pointers corresponding to a particular logical volume.

9. The data storage system of claim 8 in which said sets of pointers are stored in a logical volume directory, said logical volume directory comprising entries corresponding to said one or more logical volumes.

10. The data storage system of claim 1 further comprising:

sets of pointers to pointer extents, said pointer extents comprising pointers to one or more data extents which correspond to a particular logical volume.

11. The data storage system of claim 10 in which said sets of pointers are stored in a logical volume directory, said logical volume directory comprising entries corresponding to said one or more logical volumes.

12. The data storage system of claim 1 in which said fixed size pieces are sized to be large enough for I/O operations of one of said fixed sized pieces to be near the maximum efficiency of one of said data storage devices.

13. The data storage system of claim 1 in which each of said plurality of data storage devices further comprises an allocation table, said allocation table containing an entry for each of said fixed size pieces on a particular data storage device associated with said allocation table.

14. A method for storing data in a data storage system having an array of data storage devices, the method comprising:

dividing data storage devices into a plurality of fixed size allocation units, each of the allocation units comprising a plurality of data storage device blocks;

creating a logical volume;

forming data extents from the allocation units, each of the data extents formed from an allocated set of one or more contiguous allocation units, in which the data extents are allocated along boundaries related to the number of allocation units within an allocated data extent; and

configuring the logical volume to correspond to one or more of the data extents.

15. The method of claim 14 further comprising:

mirroring the data extents on the data storage devices.

16. The method of claim 15 wherein mirroring is performed for a subset of the data extents in the logical volume.

17. The method of claim 14 further comprising:

maintaining a parity extent, the parity extent corresponding to a set of data extents, any data extent from the set of data extents recoverable from information in the parity extent utilized in combination with the remainder of data extents from the set of data extents.

18. The method of claim 14 wherein a single data storage device is configured to comprise both mirrored and parity protected data.

19. The method of claim 14 wherein each of the data storage devices is divided into at least 1,000 allocation units.

20. The method of claim 14 wherein the logical volume is striped over a plurality of the data storage devices.

21. The method of claim 14 wherein the data extents forming the logical volume is spread over a plurality of the data storage devices.

22. The method of claim 14 further comprising:

relocating the data extents, wherein the logical volume is not locked in its entirety during the relocation of the data extents.

23. The method of claim 14 wherein creating a logical volume automatically selects unused space on multiple ones of the data storage devices to form data extents.

24. The method of claim 14 further comprising adding a new data storage device, wherein adding a new data storage device comprises:

moving data extents from the existing data storage devices to the new data storage device, wherein only the data extents being moved are locked during the move.

25. A computer program product that includes a computer readable medium, the computer readable medium having stored thereon a sequence of instructions which, when executed by a processor, causes the processor to execute a process for storing data in a data storage system having an array of data storage devices, the process comprising:

dividing data storage devices into a plurality of fixed size allocation units, each of the allocation units comprising a plurality of data storage device blocks;

creating a logical volume;

forming data extents from the allocation units, each of the data extents formed from an allocated set of one or more contiguous allocation units, in which the data extents are allocated along boundaries related to the number of allocation units within an allocated data extent; and

configuring the logical volume to correspond to one or more of the data extents.

26. The computer program product of claim 25, wherein the process further comprises:

mirroring the data extents on the data storage devices.

27. The computer program product of claim 26 wherein mirroring is performed for a subset of the data extents in the logical volume.

28. The computer program product of claim 25, wherein the process further comprises:

maintaining a parity extent, the parity extent corresponding to a set of data extents, any data extent from the set of data extents recoverable from information in the parity extent utilized in combination with the remainder of data extents from the set of data extents.

29. The computer program product of claim 25 wherein a single data storage device is configured to comprise both mirrored and parity protected data.

30. The computer program product of claim 25 wherein each of the data storage devices is divided into at least 1,000 allocation units.

31. The computer program product of claim 25 wherein the logical volume is striped over a plurality of the data storage devices.

32. The computer program product of claim 25 wherein the data extents forming the logical volume is spread over a plurality of the data storage devices.

33. The computer program product of claim 25, wherein the process further comprises:

relocating the data extents, wherein the logical volume is not locked in its entirety during the relocation of the data extents.

34. The computer program product of claim 25 wherein creating a logical volume automatically selects unused space on multiple ones of the data storage devices to form data extents.

35. The computer program product of claim 25, wherein the process further comprises adding a new data storage device, wherein adding a new data storage device comprises:

moving data extents from the existing data storage devices to the new data storage device, wherein only the data extents being moved is locked during the move.