Data reallocation among storage systems

• US 6,766,430 B2
• Filed: 04/12/2001
• Issued: 07/20/2004
• Est. Priority Date: 07/06/2000
• Status: Expired due to Fees

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Mogi, Kazuhiko, Arakawa, Hiroshi, Eguchi, Yoshiaki, Arai, Kouji
• Primary Examiner(s): Padmanabhan, Mano
• Assistant Examiner(s): Namazi, Mehdi
• Application Number:
  US09/835,073
• Publication Number:
  US 20020004857A1
• Time in Patent Office: 1,195 Days
• Field of Search: 711/165, 711/154, 711/114, 711/161, 707/10, 707/204, 707/205, 709/201, 709/231, 709/238, 709/213, 714/6
• US Class Current: 711/165
• CPC Class Codes: G06F 11/1096 Parity calculation or recalculation after configuration or reconfiguration of the system
• CPC Class Codes: G06F 11/2087 with a common controller
• CPC Class Codes: G06F 12/0866 for peripheral storage systems, e.g. disk cache
• CPC Class Codes: G06F 3/0605 by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0613 in relation to throughput
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0635 by changing the path, e.g. traffic rerouting, path reconfiguration
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 61/457 containing identifiers of data entities on a computer, e.g. file names
• CPC Class Codes: Y10S 707/99953 Recoverability
• CPC Class Codes: Y10S 707/99955 Archiving or backup

Abstract

The present invention provides techniques, including a method and system, for relocating data between storage systems. In one embodiment of the present invention a host collects usage information from a plurality of storage systems, and determines the relocation destination LU for data stored in the LU to be relocated. The host alters an LU logical position name table that determines matching between the logical position names of data and LUs. It also carries out data relocation between storage subsystems by shifting data stored in an origin LU to be relocated to a destination LU. In another embodiment relocation of files is provided.

Claims

1. A computer system comprising:

a computer including an application, a file system, and a manager;

a plurality of storage systems each including at least one logical storage area, usage information of the at least one logical storage area, and a control unit coupled with the at least one logical storage area;

a storage device to be accessed by the computer, the storage device configured to store correlation information between a first ID used by the application for accessing target data and a second ID designating a logical storage area storing the target data; and

a network coupled with the computer and the storage systems;

wherein the file system of the computer is configured to receive an access request including a first ID from the application, to acquire a second ID corresponding to the received first ID by referring to the correlation information stored in the storage device, and to issue an access command including the acquired second ID to one of the storage systems which includes a logical storage area designated by the acquired second ID;

wherein the storage system which receives the access command from the file system of the computer is configured to access the logical storage area designated by the acquired second ID and to update usage information of the logical storage area of the storage system according to the access command; and

wherein the manager of the computer is configured to acquire usage information from each of the plurality of storage systems, to issue a data reallocation command for copying data stored in a source logical storage area in a source storage system of the plurality of storage systems to a target logical storage area in a target storage system of the plurality of storage systems according to the acquired usage information, and to update the correlation information in the storage device according to the data reallocation.

2. The computer system of claim 1 wherein the usage information includes one of occupation duration of logical storage areas and occupation rate of logical storage areas.

3. The computer system of claim 1 wherein the control unit of the target storage system is configured, when the data reallocation command is received, to copy data stored in the source logical storage area in the source logical storage system to the target logical storage area in the target storage system according to the received data reallocation command.

4. The computer system of claim 1 wherein the manager is configured, prior to issuing the data reallocation command, to instruct the file system to lock the source logical storage area of the source logical storage system, to suspend acceptance of read/write requests to the source logical storage area, to flush a cache with respect to the source logical storage area, and to write into the source logical storage area any data which is cached in a memory of the computer and which has not yet been written into the source logical storage area.

5. The computer system of claim 1 wherein the manager is configured, after updating the correlation information in the storage device, to unlock the source logical storage area of the source logical storage system, to update information by re-reading the updated correlation information, and to permit acceptance of read/wrist requests to the source logical storage area.

6. The computer system of claim 1 wherein the manager is configured to issue the data reallocation command for load distribution among the plurality of storage systems.

7. The computer system of claim 1 wherein the network comprises a Fibre channel network.

8. The computer system of claim 1 wherein the storage systems comprise disk array systems each for providing the computer with at least one logical unit.

9. The computer system of claim 1 wherein the usage information comprises parity group usage information.

10. A computer system comprising:

a computer including an application, a file system, and a manager;

a plurality of storage systems each including at least one logical storage area, usage information of the at least one logical storage area, meta data to be accessed by the file system, and a control unit coupled with the at least one logical storage area, the meta data including correlation information between a file ID used by the application and a first ID designating a logical location storing file data;

a storage device to be accessed by the computer, the storage device configured to store correlation information between the first ID and a second ID designating a logical storage area storing the file data; and

a switch coupled with the computer and the storage systems;

wherein the file system of the computer is configured to receive an access request including a file ID from the application, to acquire a second ID corresponding to the received file ID by referring to a meta data and the storage device, and to issue an access command including the acquired second ID to one of the storage systems which includes a logical storage area designated by the acquired second ID;

wherein the storage system which receives the access command from the file system of the computer is configured to access file data stored in a logical storage area designated by the acquired second ID included in the received access command, and to update usage information of the logical storage area of the storage system according to the access command; and

wherein the manager of the computer is configured to acquire usage information from each of the plurality of storage systems, to issue to the switch a data reallocation command for copying file data stored in a source logical storage area in a source storage system of the plurality of storage systems to a target logical storage area in a target storage system of the plurality of storage systems according to the acquired usage information, and to update the meta data according to the data reallocation.

11. The computer system of claim 10 wherein the usage information includes one of occupation duration of logical storage areas and occupation rate of logical storage areas.

12. The computer system of claim 10 wherein the switch is configured to receive the data reallocation command, and to copy file data stored in the source logical storage area in the source logical storage system to the target logical storage area in the target storage system according to the received data reallocation command.

13. The computer system of claim 10 wherein the manager is configured to issue the data reallocation command for load distribution among the plurality of storage systems according to the acquired usage information.

14. The computer system of claim 10 wherein the control unit of the target storage system is configured, when the data reallocation command is received, to copy data stored in the source logical storage area in the source logical storage system to the target logical storage area of the target storage system according to the received data reallocation command.

15. The computer system of claim 10 wherein the switch comprises a Fibre channel switch.

16. The computer system of claim 10 wherein the storage systems comprise disk array systems each for providing the computer with at least one logical unit.

17. The computer system of claim 10 wherein the usage information comprises parity group usage information.

18. A method for data reallocation among a plurality of storage systems by a computer, the storage systems each including at least one logical storage area, usage information of the at least one logical storage area, and a control unit coupled with the at least one logical storage area, the method comprising:

receiving an access request including a first ID;

accessing a storage device, which stores correlation information between a first ID for accessing target data and a second ID designating a logical storage area storing the target data, to acquire a second ID corresponding to the received first ID;

issuing an access command including the acquired second ID to one of the storage systems which includes a logical storage area designated by the acquired second ID, wherein the storage system which receives the access command is configured to access the logical storage area designated by the acquired second ID and to update usage information of the logical storage area of the storage system according to the access command;

acquiring usage information from each of the plurality of storage systems;

issuing a data reallocation command for copying data stored in a source logical storage area in a source storage system of the plurality of storage systems to a target logical storage area in a target storage system of the plurality of storage systems according to the acquired usage information; and

updating the correlation information in the storage device according to the data reallocation.

19. The method of claim 18 wherein the usage information includes one of occupation duration of logical storage areas and occupation rate of logical storage areas.

20. The method of claim 18 wherein the control unit of the target storage system is configured, when the data reallocation command is received, to copy data stored in the source logical storage area in the source logical storage system to the target logical storage area of the target storage system according tote received data reallocation command.

21. The method of claim 18 further comprising, prior to issuing the data reallocation command:

locking the source logical storage area of the source logical storage system;

suspending acceptance of read/write requests to the source logical storage area;

flushing a cache with respect to the source logical storage area; and

writing into the source logical storage area any data which is cached in a memory of the computer and which has not yet been written into the source logical storage area.

22. The method of claim 18 further comprising, after updating the correlation information in the storage device:

unlocking the source logical storage area of the source logical storage system;

updating information by re-reading the updated correlation information; and

permitting acceptance of read/wrist requests to the source logical storage area.

23. The method of claim 18 wherein the data reallocation command is issued for load distribution among the plurality of storage systems.

24. The method of claim 18 further comprising coupling the computer with the storage systems by a network.

25. The method of claim 24 wherein the network comprises a Fibre channel network.

26. The method of claim 18 wherein the storage systems comprise disk array systems each for providing the computer with a east one logical unit.

27. The method of claim 18 wherein the usage information comprises parity group usage information.

28. A method for data reallocation among a plurality of storage systems by a computer, the storage systems each including at least one logical storage area, usage information of the at least one logical storage area, meta data including correlation information between a file ID and a first ID designating a logical location storing file data, and a control unit coupled with the at least one logical storage area, the method comprising:

receiving an access request including a file ID;

accessing a storage device which stores correlation information between a first ID for accessing target data and a second ID designating a logical storage area storing the target data;

acquiring a second ID corresponding to the received file ID by referring to a meta data and the storage device;

issuing an access command including the acquired second ID to one of the storage systems which includes a logical storage area designated by the acquired second ID, wherein the storage system which receives the access command is configured to access file data stored in a logical storage area designated by the acquired second ID and to update usage information of the logical storage area of the storage system according to the access command;

acquiring usage information from each of the plurality of storage systems;

issuing a data reallocation command for copying data stored in a source logical storage area in a source storage system of the plurality of storage systems to a target logical storage area in a target storage system of the plurality of storage systems according to the acquired usage information; and

updating the meta data according to the data reallocation.

29. The method of claim 28 wherein the usage information includes one of occupation duration of logical storage areas a occupation rate of logical storage areas.

30. The method of claim 28 wherein the control unit of the target storage system is configured, when the data reallocation command is received, to copy data stored in the source logical storage area in the source logical storage system to the target logical storage area of the target storage system according to the received data reallocation command.

31. The method of claim 28 the data reallocation command is issued for load distribution among the plurality of storage systems.

32. The method of claim 28 further comprising coupling the computer and the storage systems with a switch.

33. The method of claim 32 wherein the switch comprises a Fibre channel switch.

34. The method of claim 32 wherein the switch is configured to receive the data reallocation command, and to copy file data stored in the source logical storage area in the source logical storage system to the target logical storage area in the target storage system according to the received data reallocation command.

35. The method of claim 28 wherein the storage systems comprise disk array systems each for providing the computer with at east one logical unit.

36. The method of claim 28 wherein the usage information comprises parity group usage information.

37. A computer program product stored on a computer readable medium for data reallocation among a plurality of storage systems by a computer, the storage systems each including at least one logical storage area, usage information of the at least one logical storage area, and a control unit coupled with the at least one logical storage area, the computer program product comprising:

code for receiving an access request including a first ID;

code for accessing a storage device, which stores correlation information between a first ID for accessing target data and a second ID designating a logical storage area storing the target data, to acquire a second ID corresponding to the received first ID;

code for issuing an access command including the acquired second ID to one of the storage systems which includes a logical storage area designated by the acquired second ID, wherein the storage system which receives the access command is configured to access the logical storage area designated by the acquired second ID and to update usage information of the logical storage area of the storage system according to the access command;

code for acquiring usage information from each of the plurality of storage systems;

code for issuing a data reallocation command for copying data stored in a source logical storage area in a source storage system of the plurality of storage systems to a target logical storage area in a target storage system of the plurality of storage systems according to the acquired usage information; and

code for updating the correlation information in the storage device according to the data reallocation.

38. The computer program product of claim 37 wherein the usage information includes one of occupation duration of logical storage areas and occupation rate of logical storage areas.

39. The computer program product of claim 37 further comprising, prior to issuing the data reallocation command:

code for locking the source logical storage area of the source logical storage system;

code for suspending acceptance of read/write requests to the source logical storage area;

code for flushing a cache with respect to the source logical storage area; and

code for writing into the source logical storage area any data which is cached in a memory of the computer and which has not yet been written into the source logical storage area.

40. The computer program product of claim 37 further comprising, after updating the correlation information in the storage device:

code for unlocking the source logical storage area of the source logical storage system;

code for updating information by re-reading the updated correlation information; and

code for permitting acceptance of read/wrist requests to the source logical storage area.

41. A computer program product stored on a computer readable medium for data reallocation among a plurality of storage systems by a computer, the storage systems each including at least one logical storage area, usage information of the at least one logical storage area, meta data including correlation information between a file ID and a first ID designating a logical location storing file data, and a control unit coupled with the at least one logical storage area, the method comprising:

code for receiving an access request including a file ID;

code for accessing a storage device which stores correlation information between a first ID for accessing target data and a second ID designating a logical storage area storing the target data;

code for acquiring a second ID corresponding to the received file ID by referring to a meta data and the storage device;

code for issuing an access command including the acquired second ID to one of the storage systems which includes a logical storage area designated by the acquired second ID, wherein the storage system which receives the access command is configured to access file data stored in a logical storage area designated by the acquired second ID and to update usage information of the logical storage area of the storage system according to the access command;

code for acquiring usage information from each of the plurality of storage systems;

code for issuing a data reallocation command for copying data stored in a source logical storage area in a source storage system of the plurality of storage systems to a target logical storage area in a target storage system of the plurality of storage systems according to the acquired usage information; and

code for updating the meta data according to the data reallcation.

42. The computer program product of claim 41 wherein the usage information includes one of occupation duration of logical storage areas and occupation rate of logical storage areas.