Method and system for mirroring and archiving mass storage

• US 6,609,183 B2
• Filed: 05/28/2002
• Issued: 08/19/2003
• Est. Priority Date: 02/23/1999
• Status: Expired due to Term

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Legato Systems, Inc. (Dell Technologies Inc.)
• Inventors: Ohran, Richard S.
• Primary Examiner(s): BRAGDON, REGINALD GLENWOOD
• Application Number:
  US10/157,427
• Publication Number:
  US 20020144068A1
• Time in Patent Office: 448 Days
• Field of Search: 711/161, 711/162, 707/202, 707/203, 707/204
• US Class Current: 711/161
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/2064 while ensuring consistency
• CPC Class Codes: G06F 11/2066 Optimisation of the communication load
• CPC Class Codes: G06F 11/2074 Asynchronous techniques
• CPC Class Codes: G06F 2201/82 Solving problems relating to consistency
• CPC Class Codes: Y10S 707/99953 Recoverability

Abstract

A method and system for mirroring and archiving mass storage. A primary mass storage and a secondary mass storage are synchronized to contain the same data. Thereafter, a primary system tracks changes made to the primary mass storage. These changes are consolidated periodically into update files, the consolidations representing changes made to the primary mass storage during a time interval that ends when the primary mass storage is in a logically consistent state. These update files contain only those changes necessary to represent the modified state of the primary mass storage at the time of the update. The primary system then transfers the update files to a secondary system to bring the secondary mass storage current with the primary mass storage. The consolidation minimizes the amount of information that must be transferred and therefore allows for a relatively low band width communication channel. In addition, update files may be cached by the primary system so that requests for mirrored or archived data may be fulfilled by the primary system cache rather than requiring access to the secondary system.

Claims

1. In a primary system that has a primary mass storage and is in communication with a secondary system that has a secondary mass storage, a method for mirroring and archiving the primary mass storage on the secondary mass storage, the method comprising:

synchronizing the secondary mass storage with the primary mass storage;

tracking changes to the primary mass storage during a time interval;

identifying an end of the time interval by identifying when the primary mass storage is in a logically consistent state;

consolidating the tracked changes by retaining any tracked changes necessary to represent the state of the primary mass storage at the end of the time interval, so as to create an update that includes the retained changes but does not include tracked changes that represent an intermediate state of the primary mass storage; and

transferring the update to the secondary mass storage, the update including only the changes that are required for bringing the secondary mass storage device current with the logically consistent state of the primary mass storage device.

2. The method of claim 1, wherein transferring the update to the secondary mass storage results in the update being stored at the secondary mass storage such that the logically consistent state of the primary mass storage is determinable from the update stored at the secondary mass storage.

3. The method of claim 1, wherein consolidating the tracked changes comprises retaining, for each storage location of the primary mass storage that has changed during the time interval, information representing the most recent change to the particular storage location, with the information representing any previous changes to the particular storage location being discarded, such that the update includes only the changes that are required for bringing the secondary mass storage device current with the logically consistent state of the primary mass storage device.

4. The method of claim 1, further comprising:

storing a copy of the update in a cache holding area associated with the primary system; and

providing access to data included in a mirrored and archived version of the primary mass storage by first determining whether the data is included in the update stored in the cache holding area and then providing access to the data from the secondary mass storage if the data is not included in the update in the cache holding area.

5. The method of in claim 1, wherein tracking changes to the primary mass storage during the time interval and consolidating the tracked changes are conducted independently of any particular file structure associated with the primary mass storage or the secondary mass storage.

6. The method of claim 1, wherein tracking the changes to the primary mass storage during the time interval comprises storing information representing all changes, wherein the changes are tracked at a disk level of the primary mass storage.

7. The method of claim 1, wherein consolidating the tracked changes is conducted in an ongoing manner during the time interval.

8. The method of claim 1, wherein consolidating the tracked changes is conducted at or after the end of the corresponding time interval.

9. The method of claim 1, further comprising encrypting data transferred between the primary system and the secondary system by:

exchanging values between the primary system and the secondary system, the values being subject to change from one moment to the next;

manipulating, by the primary system, a first value exchanged from the secondary system to the primary system to generate a primary system key seed;

manipulating, by the secondary system, a second value exchanged from the primary system to the secondary system to generate a secondary system key seed, the primary system key seed and the secondary system key seed being equal;

using the primary key seed at the primary system to generate a primary encryption key;

using the secondary key seed at the secondary system to generate a secondary encryption key, the primary encryption key and the secondary encryption being equal, as if they had been generated using a single key seed; and

encrypting and decrypting data transmitted between the primary system and the secondary system using the primary encryption key and the secondary encryption key.

10. The method of claim 1, wherein the primary mass storage is subdivided and comprises a first subdivision that includes storage locations in which said data is stored and further comprises a second subdivision that includes a cache holding area in which is stored information representing all changes that have been made in the storage locations during the time interval.

11. A computer program product for implementing, in a primary system that has a primary mass storage and is in communication with a secondary system that has a secondary mass storage, a method for mirroring and archiving the primary mass storage on the secondary mass storage, the computer program product comprising:

a computer-readable medium carrying computer-executable instructions for implementing the method, the computer-executable instructions, when executed, causing the primary system to;

synchronize the secondary mass storage with the primary mass storage;

track changes to the primary mass storage during a time interval;

identify an end of the time interval by identifying when the primary mass storage is in a logically consistent state;

consolidate the tracked changes by retaining any tracked changes necessary to represent the state of the primary mass storage at the end of the time interval, so as to create an update that includes the retained changes but does not include tracked changes that represent an intermediate state of the primary mass storage; and

transfer the update to the secondary mass storage, the update including only the changes that are required for bringing the secondary mass storage device current with the logically consistent state of the primary mass storage device.

12. The computer program product of claim 11, wherein transferring the update to the secondary mass storage results in the update being stored at the secondary mass storage such that the logically consistent state of the primary mass storage is determinable from the update stored at the secondary mass storage.

13. The computer program product of claim 11, wherein consolidating the tracked changes comprises retaining, for each storage location of the primary mass storage that has changed during the time interval, information representing the most recent change to the particular storage location, with the information representing any previous changes to the particular storage location being discarded, such that the update includes only the changes that are required for bringing the secondary mass storage device current with the primary mass storage device as the data in the primary mass storage device exists at the end of the time interval.

14. The computer program product of claim 11, wherein the computer-executable instructions, when executed, further cause the primary system to:

store a copy of the update in a cache holding area associated with the primary system; and

provide access to data included in a mirrored and archived version of the primary mass storage by first determining whether the data is included in the update stored in the cache holding area and then providing access to the data from the secondary mass storage if the data is not included in the update in the cache holding area.

15. The computer program product of claim 11, wherein tracking changes to the primary mass storage during the time interval and consolidating the tracked changes are conducted independently of any particular file structure associated with the primary mass storage or the secondary mass storage.

16. The computer program product of claim 11, wherein tracking the changes to the primary mass storage during the time interval comprises storing information representing all changes, wherein the changes are tracked at a disk level of the primary mass storage.

17. The computer program product of claim 11, wherein consolidating the tracked changes is conducted in an ongoing manner during the time interval.

18. The computer program product of claim 11, wherein consolidating the tracked changes is conducted at or after the end of the corresponding time interval.

19. The computer program product of claim 11, wherein the primary mass storage is subdivided and comprises a first subdivision that includes storage locations in which said data is stored and further comprises a second subdivision that includes a cache holding area in which is stored information representing all changes that have been made in the storage locations during the time interval.

20. A computer program product for implementing, in a primary system that has a primary mass storage and is in communication with a secondary system having a secondary mass storage, a method for mirroring and archiving the primary mass storage by transmitting to the secondary mass storage only those changes to the primary mass storage that are necessary to bring the secondary mass storage current with the primary mass storage while representing a plurality of logically consistent states of the primary mass storage, the computer program product comprising:

a computer-readable medium carrying computer-executable instructions that, when executed, cause the primary system to perform;

initiating synchronization of the secondary mass storage with the primary mass storage; and

for each of a plurality of distinct time intervals;

changing data stored in storage locations of the primary mass storage;

identifying when the primary mass storage is in a logically consistent state, so as to identify an end of a current time interval of the plurality of distinct time intervals;

as the data is changed, storing information representing all changes that have been made in the storage locations during the each of the plurality of time intervals in updates that correspond to the plurality of time intervals;

consolidating the stored information in each update by retaining, for each storage location that has changed during the corresponding time interval, the information representing the most recent change to the particular storage location for that update, with the information representing any previous changes to the particular storage location being discarded for that update, such that each update includes only the changes that are required for bringing the secondary mass storage device current with the primary mass storage device as the data in the primary mass storage device exists at the end of the corresponding time interval; and

transferring each update to the secondary mass storage at the end of the corresponding time interval, wherein each update is stored at the secondary mass storage such that the plurality of logically consistent states of the primary mass storage are determinable from the plurality of updates stored at the secondary mass storage.