Distributing data across multiple data storage devices in a data storage system

• US 6,405,284 B1
• Filed: 10/23/1998
• Issued: 06/11/2002
• Est. Priority Date: 10/23/1998
• Status: Expired due to Term

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle Corporation
• Inventors: Bridge, William
• Primary Examiner(s): Verbrugge, Kevin
• Application Number:
  US09/177,916
• Time in Patent Office: 1,327 Days
• Field of Search: 711/111, 711/112, 711/114, 711/165, 711/170
• US Class Current: 711/114
• CPC Class Codes: G06F 11/1096 Parity calculation or recalculation after configuration or reconfiguration of the system
• CPC Class Codes: G06F 11/1662 the resynchronized component or unit being a persistent storage device re-synchronization of failed mirror storage G06F11/2082; rebuild or reconstruction of parity RAID storage G06F11/1008
• CPC Class Codes: G06F 11/2069 Management of state, configuration or failover
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0644 Management of space entities, e.g. partitions, extents, pools
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD
• CPC Class Codes: G06F 9/5016 the resource being the memory

Abstract

A system and method for managing storage from multiple data storage devices are disclosed. The system and method provide improved load balancing, reduction or elimination of fragmentation, and efficient changes in hardware configurations. I/O load and data are spread relatively evenly across many data storage devices in the storage system. Dynamic reorganization can be performed for the data stored on the data storage devices.

Claims

1. A method for managing a storage system having a plurality of data storage devices comprising:

spreading data evenly across a first set of data locations within a first plurality of data storage devices in the storage system;

reconfiguring the storage system to establish a second plurality of data storage devices, the second plurality of data storage devices having a different combination of storage devices than the fist plurality of data storage devices; and

dynamically moving the data in response to a change in the configuration of the storage system to reestablish an even spread of the data across the second plurality of data storage devices, the amount of data moved being approximately proportional to the change in storage capacity of the storage system as a result of the change in configuration, wherein dynamically moving the data changes at least part of the first set of data locations to form a second set of data locations for the data within the second plurality of data storage devices.

2. The method of claim 1 in which the change in configuration of the storage system comprises the addition of one or more new data storage devices.

3. The method of claim 1 in which the change in configuration of the storage system comprises the removal of one or more of the plurality of data storage devices.

4. The method of claim 1 in which reestablishing an even spread of data is performed on a periodic basis to the storage system.

5. The method of claim 1 in which dynamically moving the data is triggered by a manual command by an administrator of the storage system.

6. The method of claim 1 in which dynamically moving the data comprises the identification of one or more select pieces of data to be moved without manual administration steps by an administrator of the storage system.

7. The method of claim 1 in which dynamically moving the data comprises the placement of the data to be moved without maintaining statistics of past I/O loads on the plurality of data storage devices.

8. The method of claim 1 in which dynamically moving the data is automatically triggered by detecting changes in the configuration of the storage system.

9. The method of claim 1 further comprising:

locking a piece of data to be moved;

reading information from the piece of data to be moved; and

writing the information to a new piece of data.

10. A computer program product that includes a computer-usable medium having a sequence of instructions which, when executed by a processor, causes said processor to execute a process for managing a storage system having a plurality of data storage devices, said process comprising:

spreading data evenly across a first set of data locations within a first plurality of data storage devices in the storage system;

reconfiguring the storage system to establish a second plurality of data storage devices, the second plurality of data storage devices having a different combination of storage devices than the first plurality of data storage devices; and

dynamically moving the data in response to a change in the configuration of the storage system to reestablish an even spread of the data across the second plurality of data storage devices, the amount of data moved being approximately proportional to the change in storage capacity of the storage system as a result of the change in configuration, wherein dynamically moving the data changes at least part of the first set of data locations to form a second set of data locations for the data within the second plurality of data storage devices.

11. The computer program product of claim 10 in which the change in configuration of the storage system comprises the addition of one or more new data storage devices.

12. The computer program product of claim 10 in which the change in configuration of the storage system comprises the removal of one or more of the plurality of data storage devices.

13. The computer program product of claim 10 which reestablishing an even spread of data is performed on a periodic basis to the storage system.

14. The computer program product of claim 10 in which dynamically moving the data is triggered by a manual command by an administrator of the storage system.

15. The computer program product of claim 10 in which dynamically moving the data comprises the identification of one or more select pieces of data to be moved without manual administration steps by an administrator of the storage system.

16. The computer program product of claim 10 in which dynamically moving the data comprises the placement of the data to be moved without maintaining statistics of past I/O loads on the plurality of data storage devices.

17. The computer program product of claim 10 in which dynamically moving the data is automatically triggered by detecting changes in the configuration of the storage system.

18. The computer program product of claim 10 further comprising:

locking a piece of data to be moved;

reading information from the piece of data to be moved; and

writing the information to a new piece of data.

19. A system for managing a storage system having a plurality of data storage devices, comprising:

means for spreading data evenly across a first set of data locations within a first plurality of data storage devices in the storage system;

means for reconfiguring the storage system to establish a second plurality of data storage devices, the second plurality of data storage devices having a different combination of storage devices than the first plurality of data storage devices; and

means for dynamically moving the data in response to a change in the configuration of the storage system to reestablish an even spread of the data across the second plurality of data storage devices, the amount of data moved being approximately proportional to the change in storage capacity of the storage system as a result of the change in configuration, wherein dynamically moving the data changes at least part of the first set of data locations to form a second set of data locations for the data within the second plurality of data storage devices.

20. The system of claim 19 in which the change in configuration of the storage system comprises the addition of one or more new data storage devices.

21. The system of claim 19 in which the change in configuration of the storage system comprises the removal of one or more of the data storage devices.

22. The system of claim 19 in which reestablishing an even spread of data is performed on a periodic basis to the storage system.

23. The system of claim 19 in which dynamically moving the data is triggered by a manual command by an administrator of the storage system.

24. The system of claim 19 in which dynamically moving the data comprises the identification of one or more select pieces of data to be moved without manual administration steps by an administrator of the storage system.

25. The system of claim 19 in which dynamically moving the data comprises the placement of the data to be moved without maintaining statistics of past I/O loads on the plurality of data storage devices.

26. The system of claim 19 in which dynamically moving the data is automatically triggered by detecting changes in the configuration of the storage system.

27. The system of claim 19 further comprising:

means for locking a piece of data to be moved;

means for reading information from the piece of data to be moved; and

means for writing the information to a new piece of data.

28. A method for managing a storage system having a plurality of data storage devices, comprising:

spreading data evenly across a first set of data locations within a first plurality of data storage devices in the storage system, in which pieces of the data are mapped to specific locations in the first plurality of data storage devices using a set of pointers;

reconfiguring the storage system to establish a second plurality of data storage devices, the second plurality of data storage devices having a different combination of storage devices than the first plurality of data storage devices;

dynamically moving the data in response to a change in the configuration of the storage system to reestablish an even spread of the data across the second plurality of data storage devices, the amount of data moved being approximately proportional to the change in storage capacity of the storage system as a result of the change in configuration, wherein dynamically moving the data changes at least part of the first set of data locations to form a second set of data locations for the data within the second plurality of data storage devices; and

remapping the set of pointers to correspond to the pieces of the data that are dynamically moved among the second pluralize of data storage devices.

29. The method of claim 28 in which each of the data storage devices are divided into fixed sized pieces and storage space is allocated in units of the fixed sized pieces.

30. The method of claim 29 in which a data extent is formed from one or more of the fixed sized pieces.

31. The method of claim 30 in which a logical volume corresponds to one or more data extents.

32. The method of claim 31 in which the one or more data extents for a logical volume are spread over multiple data storage devices.

33. The method of claim 28 in which the set of pointers is stored in a logical volume directory.

34. The method of claim 28 in which the change in configuration of the storage system comprises the addition of one or more new data storage devices.

35. The method of claim 28 which the change in configuration of the storage system comprises the removal of one or more of the data storage devices.

36. The method of claim 28 in which reestablishing an even spread of data is performed on a periodic basis to the storage system.

37. The method of claim 28 in which dynamically moving the data is triggered by a manual command by an administrator of the storage system.

38. The method of claim 28 in which dynamically moving the data comprises the identification of one or more select pieces of data to be moved without manual administration steps by an administrator of the storage system.

39. The method of claim 28 in which dynamically moving the data comprises the placement of the data to be moved without maintaining statistics of past I/O loads on the plurality of data storage devices.

40. The method of claim 28 in which dynamically moving the data is automatically triggered by detecting changes in the configuration of the storage system.

41. The method of claim 28 further comprising:

locking a piece of data to be moved;

reading information from the piece of data to be moved; and

writing the information to a new piece of data.