System and method for managing data logging memory in a storage area network

• US 6,928,513 B2
• Filed: 03/26/2002
• Issued: 08/09/2005
• Est. Priority Date: 03/26/2002
• Status: Expired due to Term

• Current Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Hess, Randy, Lubbers, Clark, Leveille, Jason, Korgaonkar, Anuja, Elkington, Susan, McCarty, James, Sicola, Stephen J.
• Primary Examiner(s): Nguyen, T
• Application Number:
  US10/106,814
• Publication Number:
  US 20030188229A1
• Time in Patent Office: 1,232 Days
• Field of Search: 714/6, 714/19, 714/20, 714/5, 714/15, 711/161, 711/162, 711112-114
• US Class Current: 711/114
• CPC Class Codes: G06F 11/2064 while ensuring consistency
• CPC Class Codes: G06F 11/2074 Asynchronous techniques
• CPC Class Codes: G06F 11/2082 Data synchronisation
• CPC Class Codes: G06F 16/221 Column-oriented storage; Management thereof

Abstract

A data storage system adapted to maintain redundant data storage sets at a destination location(s) is disclosed. The data storage system establishes a copy set comprising a source volume and a destination volume. Data written to a source volume is automatically copied to the destination volume. The data storage system maintains a data log that may be activated when the destination volume is inaccessible due to, for example, a malfunction in the destination storage system or in the communication link between the source system and the destination system. I/O commands and the data associated with those commands are written to the data log, and after a destination system becomes available the information in the data log is merged into the destination volume to conform the data in the destination volume to the data in the source volume. The data log competes for disk capacity with other volumes on the system, and log memory is allocated as needed. Command entries and data entries are stored in distinct areas of the data log, and the command entries include information identifying the memory offset of the associated data entries.

Claims

1. A method for logging data written by a host computer to a source virtual disk, the method comprising the steps of:

storing, in a command region of a data logging logical unit, command information for I/O transactions that occur between the host computer and the source virtual disk; and

storing, in a data region of the data logging logical unit, the data associated with commands stored in the command region of the logical unit;

wherein the command information includes information identifying the logical address of the associated data.

2. The method of claim 1, wherein the command region defines the beginning of the logical unit.

3. The method of claim 1, wherein the information identifying the logical address of the data associated with command information is the logical block address offset.

4. The method of claim 1, further comprising the steps of:

transmitting the logging data to a destination virtual disk connected to the source virtual disk by at least one communication link

continuing to write said data from the host computer to the log unit while a merging is being performed;

pausing write operations from the host computer to the log unit to allow said merging to catch up with the write operations; and

terminating the merging of said data when read operations from said merging catch up with said write operations from the host computer to the log unit.

5. A method for logging data written by a host computer to a source virtual disk, wherein the data is replicated on a destination virtual disk connected to the source virtual disk by at least one link, the method comprising the step of:

storing, on a log unit, the data and associated command information for every transaction that occurs between the host computer and the source virtual disk while the destination virtual disk is unavailable, wherein the command information includes information identifying a logical address of the data associated with the command.

6. The method of claim 5, including the additional step of performing a transaction-order merging of the data on the log unit with the data previously stored on the destination virtual disk to synchronize the data states of the source virtual disk and the destination virtual disk.

7. A method for managing data logging in a storage system in which write I/O transactions by a host computer are directed to a source virtual disk, and a backup copy of the write I/O transaction information is directed to at least one destination virtual disk, the method comprising the steps of:

receiving write I/O transactions from the host computer at the source virtual disk; and

storing data and command information associated with write I/O transactions that occur when the destination virtual disk is inaccessible, in a log unit associated with the source virtual disk;

wherein the data and command information are stored in separate write buffers prior to being written to the log unit, and wherein burp data is inserted into one or more of the write buffers prior to saving the data and command information in the log unit.

8. The method of claim 7, wherein the step of storing data and command information associated with write I/O transactions comprises storing command information in a command region of the data log and storing data associated with the command in a data region, separate from the command region.

9. The method of claim 8, wherein entries in the command region include pointers to the logical memory address of the data associated with the command.

10. The method of claim 7, including the additional steps of:

when the destination virtual disk becomes available, merging the data stored on said log unit with the backup copy in the source virtual disk by using the stored command information to write the data associated therewith to the destination virtual disk in the order in which each said write transaction originally occurred.

11. A computer program product for use in connection with a processor for processing I/O transactions received from a host computer, and for logging data written by a host computer to a source virtual disk, comprising:

logic instructions, executable on a processor for storing, in a command region of a data logging logical unit command information for I/O transactions that occur between the host computer and the source virtual disk; and

logic instructions for storing, in a data region of the data logging logical unit comprising part of the source virtual disk, the data associated with commands stored in the command region of the logical unit;

wherein the command information includes information identifying the logical address of the associated data.

12. The computer program product of claim 11, wherein, wherein the command region defines the beginning of the logical unit.

13. The computer program product of claim 11, wherein the information identifying the logical address of the data associated with command information is the logical block address offset.

14. A data storage network, comprising:

a host computer for receiving I/O transactions from users of the storage systems and forwarding the I/O transactions to a primary data storage system;

a primary data storage system including at least one array controller communicatively coupled with the host computer for receiving write I/O transactions from the host computer, and a source virtual disk for storing write I/O transactions from the host computer;

at least one remote data storage system communicatively coupled with the host computer and the primary data storage system, and including at least one array controller receiving write I/O transactions and a destination virtual disk for storing write I/O transactions; and

a communication fabric coupling the primary data storage system and the remote data storage system;

wherein the primary data storage system includes a log unit for storing write I/O transactions received when the remote data storage system is inaccessible, and wherein the log unit includes a command region for storing write I/O commands and a data region for storing data associated with the write I/O commands, and wherein each write I/O command entry includes information identifying the logical memory address of the write data associated with the entry.

15. The data storage network of claim 14, wherein the data storage array associated with the primary data storage system stores data in a virtualized format.

16. A data storage network according to claim 14, wherein an array controller associated with the primary storage system includes logic instructions for writing write I/O instructions from the host computer to a data log, and command write buffers for storing write commands and data write buffers for storing data associated with the write I/O commands.

17. The system of claim 16, wherein the logic instructions are operational to insert burp data blocks into the write buffers.

18. The system of claim 16, wherein the log unit includes a storage set selected from the group consisting of RAID level 1, RAID level 0+1 and RAID level 5.