Data replication among storage systems

• US 7,152,079 B2
• Filed: 08/27/2003
• Issued: 12/19/2006
• Est. Priority Date: 06/27/2003
• Status: Active Grant

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Soto, Takao, Arakawa, Hiroshi, Hirakawa, Yusuke, Takeda, Takahito
• Primary Examiner(s): PANNALA, SATHYANARAYA R
• Application Number:
  US10/650,338
• Publication Number:
  US 20040267829A1
• Time in Patent Office: 1,210 Days
• Field of Search: 707/200, 707/1, 707/204, 714/6, 711/162
• US Class Current: 707/610
• CPC Class Codes: G06F 11/2064 while ensuring consistency
• CPC Class Codes: G06F 11/2071 using a plurality of controllers
• CPC Class Codes: G06F 11/2082 Data synchronisation
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 2201/855 Details of asynchronous mirroring using a journal to transfer not-yet-mirrored changes
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: Y10S 707/99955 Archiving or backup

Abstract

A first storage system stores information relating to the updating of data stored in that system as a journal. More specifically, the journal is composed of a copy of data that was used for updating and update information such as a write command used during updating. Furthermore, the second storage system acquires the journal via a communication line between the first storage system and the second storage system. The second storage system holds a duplicate of the data held by the first storage system and updates the data corresponding to the data of the first storage system in the data update order of the first storage system by using the journal.

Claims

1. A system for storing data comprising:

a first storage system to be coupled to a host device executing an operation using data stored in the first storage system wherein the first storage system includes a plurality of first disk drives, a first controller coupled to the first disk drives, a first storage area configured in the first disk drives, and a second storage area configured in the first disk drives; and

a second storage system coupled to the first storage system, wherein the second storage system includes a plurality of second disk drives, a second controller coupled to the second disk drives, a third storage area, and a fourth storage area configured in the second disk drives;

wherein the first controller is configured to receive data to the first storage area from the host device, and write the data received from the host device in the first storage area,

wherein if the first storage area is defined as an original storage area, whose data is replicated in the fourth storage area, the first controller is configured to write the data received from the host device and information relating to a write order of the data in the second storage area,

wherein when a request for transmission of the data and the information relating to the write order of the data is received from the second storage system, the first controller is configured to transmit the data and the information relating to the write order of the data from the second storage area to the second storage system in response to the request from the second storage system, and

wherein the second controller is configured to transmit the request for transmission of the data and the information relating to the write order of the data, write the data and the information relating to the write order of the data, which are received from the first storage system in response to the request, in the third storage area, and write the data received from the first storage system in the fourth storage area according to the information related to the write order of the data, which is stored in the third storage area.

2. A system according to claim 1,

wherein the second storage area includes a first region for storing the information relating to the write order of the data and a second region for storing the data received from the host device.

3. A system according to claim 1,

wherein the second controller is configured to transmit the request for transmission of the data and the information relating to the write order of the data repeatedly, and decide a timing of transmission of the request according to data traffic between the first storage system and the second storage system.

4. A system according to claim 1,

wherein the second controller is configured to transmit the request for transmission of the data and the information relating to the write order of the data repeatedly, and decide a timing of transmission of the request according to a storage capacity of the third storage area.

5. A system according to claim 1,

wherein the second controller is configured to transmit the request for transmission of the data and the information relating to the write order of the data repeatedly, and decide a timing of transmission of the request according to a processing load of the second storage system.

6. A system according to claim 1,

wherein the second controller is configured to transmit the request for transmission of the data and the information relating to the write order of the data repeatedly, and

wherein the second controller is configured to read from the first storage system information relating to a storage capacity of the second storage area in the first storage system, and decide a timing of transmission of the request according to the information relating to the storage capacity of the second storage area.

7. A system according claim 1,

wherein the second controller is configured to transmit the request for transmission of the data and the information relating to the write order of the data repeatedly,

wherein the first storage system is configured to hold management information relating to the second storage area, and

wherein the second controller is configured to read the management information relating to the second storage area from the first storage system, and decide a timing of transmission of the request according to the management information.

8. A system according to claim 1,

wherein a plurality of first storage areas are configured in the first disk drives, and a plurality of fourth storage areas are configured in the second disk drives,

wherein if the plurality of first storage areas are defined as original storage areas corresponding to the plurality of fourth storage areas, the first controller is configured to write data to be stored in the plurality of first storage areas and information relating to a write order of the data to be stored in the plurality of first storage areas in the second storage area, and

wherein the second controller is configured to write the data received from the first storage system in the plurality of fourth storage areas according to the information related to the write order of the data, which is stored in the third storage area.

9. A system according to claim 1,

wherein the second controller is configured to control the timing of writing data in the fourth storage area according to a processing load of the second storage system.

10. A system according to claim 1,

wherein the first controller includes a host adapter for sending data to and receiving data from the host device, a cache for temporarily storing data received by the host adapter, and a disk adapter for transferring data stored in the cache to the plurality of first disk drives, and

wherein a plurality of logical volumes are configured in the first disk drives, and both the first storage area and the second storage area are selected from the plurality of logical volumes.

11. A system according to claim 1,

wherein the second controller includes a host adapter for receiving data from the first storage system, a cache for temporarily storing data received by the host adapter, and a disk adapter for transferring data stored in the cache to the plurality of second disk drives, and

wherein a plurality of logical volumes are configured in the plurality of second disk drives, and both the third storage area and the fourth storage area are selected from the plurality of logical volumes.

12. A system according to claim 1,

wherein the third storage area in the second storage system is configured in the second disk drives.

13. A system according to claim 1,

wherein the first storage system further comprises a cache memory, and when the first controller receives data to the first storage area from the host device, the first controller is configured to store the data received from the host device in the cache memory, write the data stored in the cache memory in the first storage area, and write the data stored in the cache memory and the information relating to the write order of the data in the second storage area if the first storage area is defined as the original storage area.

14. A system according to claim 1,

wherein the second storage system is configured to instruct the first storage system to release a part of storage area in the second storage area by transmitting information indicating the part of storage area to be released.

15. A system according to claim 1,

wherein the information indicating the part of storage area to be released is included in the request for transmission of the data and the information relating to the write order of the data, and transmitted from the second storage system to the first storage system.

16. A system according to claim 1, wherein

if the first storage area is defined as the original storage area, whose data is replicated in the fourth storage area, the first controller is configured to transmit a completion report of writing the data to the host device after preparing to write the data and the information relating to the write order of the data in the second storage area, and

if the first storage area is not defined as the original storage area, the first controller is configured to transmit a completion report of writing the data to the host device after preparing to write the data in the first storage area.

28. A system according to claim 1,

wherein the first storage system includes a plurality of first storage areas, the second storage system includes a plurality of fourth storage areas, and wherein a plurality of copy pairs are defined, each of which includes one of the plurality of first storage areas and one of the plurality of fourth storage areas,

wherein at least one group including at least one copy pair is defined in order to maintain consistency of data in the at least one group in case of stop operations for replicating data of the first storage area in the fourth storage area, and

wherein the first controller and the second controller are configured to hold information relating to the group.

29. A system according to claim 28,

wherein the second controller is configured to transmit the request for transmission of the data and the information relating to the write order of the data according to the information relating to the at least one group.

30. A system according to claim 1,

wherein the second controller is configured to start to transmit the request for transmission of the data and the information relating to the write order of the data, when the second controller receives an instruction to initiate remote copy operations.

31. A system according to claim 30,

wherein the first controller is configured to transmit the instruction to initiate remote copy operations to the second storage system, when the first controller receives an instruction to initiate remote copy operation, the instruction including identification related to the fourth storage area, from the host device.

32. A system according to claim 1,

wherein the second controller is configured to determine whether or not retransmission of the data and the information relating to the write order of the data is needed, and when the retransmission is needed, the second controller is configured to transmit the request for retransmission of the data and the information relating to the write order of the data to the first storage system.

33. A system according to claim 1,

wherein the second controller is configured to write the data received from the first storage system in the fourth storage area according to the information related to the write order of the data, so that the write order of the data in the fourth storage area is maintained after an operation for replicating data of the first storage area in the fourth storage area is stopped.

17. A system for storing data comprising:

a first storage system coupled to a host device executing an operation using data stored in the first storage system, wherein the first storage system has a plurality of first disk drives, a first controller coupled to the first disk drives, and a first storage area configured in the first disk drives;

a second storage system coupled to the first storage system, wherein the second storage system has a plurality of second disk drives, a second controller coupled to the second disk drives, a second storage area configured in the second disk drives, and a third storage area configured in the second disk drives; and

a third storage system coupled to the second storage system, wherein the third storage system has a plurality of third disk drives, a third controller coupled to the third disk drives, a fourth storage area, and a fifth storage area configured in the third disk drives;

wherein the first controller is configured to write data received from the host device in the first storage area and transmit the data received from the host devices to the second storage system,

wherein the second controller is configured to write data received from the first storage system in the second storage area, and if the second storage area is defined as an original storage area, data stored in which is copied in the fifth storage area of the third storage system, the second controller is configured to write the data received from the first storage system and information regarding to write order of the data in the third storage area,

wherein when a command for requesting transmission of the data and the information regarding to the write order of the data, which are stored in the third storage area, is received from the third storage system, the second controller is configured to transmit the data and the information regarding to the write order of the data from the third storage area to the third storage system in response to the command, and

wherein the third controller is configured to transmit the command for requesting transmission of the data and the information regarding to the write order of the data, which are stored in the third storage area, to the second storage system, write the data and the information regarding to the write order of the data, which are received from the second storage system in response to the command, in the fourth storage area, and write the data stored in the fourth storage area in the fifth storage area by using information regarding to the write order of the data, which is stored in the fourth storage area.

18. A system according to claim 17,

wherein the third controller is configured to transmit the command to the second storage system repeatedly, and the third controller is configured to decide a timing of transmission of the command according to amount of the data and the information regarding to the write order of the data received from the second storage system.

19. A system according to claim 17,

wherein the third controller is configured to transmit the command to the second storage system repeatedly, and decide a timing of transmission of the command according to data traffic between the second storage system and the third storage system.

20. A system according to claim 17,

wherein the third controller is configured to transmit the command to the second storage system repeatedly, and decide a timing of transmission of the command according to a capacity of the fourth storage area.

21. A system according to claim 17,

wherein the third controller is configured to transmit the command to the second storage system repeatedly, and decide a timing of transmission of the command according to processing load of the third storage system.

22. A system according to claim 17,

wherein the third controller is configured to transmit the command to the second storage system repeatedly, read from the second storage system the information relating to a storage capacity of the third storage area in the second storage system, and decide a timing of transmission of the command according to the information relating to the storage capacity of the third storage area.

23. A system according to claim 17,

wherein the third controller is configured to transmit the command to the second storage system repeatedly, read from the second storage system management information relating to amount of the data and the information regarding to the write order of the data, which are stored in the third storage area, and decide a timing of transmission of the command according to the management information read from the second storage system.

24. A system according to claim 17,

wherein the third controller is configured to transmit the command to the second storage system repeatedly.

25. A system according to claim 17,

wherein the third controller is configured to control a timing of writing data stored in the fourth storage area to the fifth storage area according to a processing load of the third storage system.

26. A system according to claim 17,

wherein the fourth storage area in the third storage system is configured in the third disk drives.

27. A system according to claim 17,

wherein the second storage system further comprises a cache memory, and when the second controller receives data from the first storage system, the second controller is configured to store the data received from the first storage system in the cache memory, write the data stored in the cache memory in the second storage area, and write the data stored in the cache memory and the information relating to a write order of the data in the third storage area if the second storage area is defined as the original storage area.

34. A system according to claim 17,

wherein the third controller is configured to write the data stored in the fourth storage area in the fifth storage area by using the information regarding the write order of the data, so that write order of the data in the fifth storage area is maintained after an operation for copying data of the second storage area in the fifth storage area is stopped.