Administration of a differential backup system in a client-server environment

• US 20010034737A1
• Filed: 01/10/2001
• Published: 10/25/2001
• Est. Priority Date: 01/10/2000
• Status: Active Grant

• Current Assignee: Micro Focus LLC (Open Text Corporation)
• Original Assignee: Connected Corporation (Iron Mountain Incorporated)
• Inventors: Babich, Wayne, Council, Chad, Runkel, Troy, Filatov, Leonid, Vaitzblit, Lev, Cane, David A., Freidin, Jonathan F., Speare, Philip A.
• Granted Patent: US 6,629,110 B2
• Time in Patent Office: Days
• US Class Current: 707/204
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1458 Management of the backup or restore process
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: Y10S 707/99931 Database or file accessing
• CPC Class Codes: Y10S 707/99953 Recoverability
• CPC Class Codes: Y10S 707/99955 Archiving or backup

Abstract

A method for the administration of a differential file backup system in a client-server system is disclosed in which the various component files that comprise a backup file are read from a first memory device of the file backup system to a second memory device and processed by the server. The server processes the various file components, or archive files in which the various file components reside, to reduce the number of access points across the first memory device to enhance the efficiency of the file retrieval, file reconstruction, and file restore operations of the backup file system.

Claims

1. A method for administration of a differential file backup system on a client-server system wherein the server includes a first memory storage device and a second memory device coupled thereto, and wherein a backup file comprises a plurality of component files that include a base file and at least one delta file, and wherein the base file and at least one delta file are stored on the first memory device in a first arrangement having a first number of access points on the first memory device, the method comprising the steps of:

reading, by the server from the first memory device, a first plurality of data including at least one base and at least one delta files;

writing, by the server to the second memory device, the first plurality of data;

processing, by the server the first plurality of data in the second memory device, to rearrange the first plurality of data into a second arrangement such that the plurality of components of the backup file have a second number of access points that are less than the first number of access points of the first arrangement; and

writing, by the server to the first memory device, the first plurality of data in the second arrangement.

2. The method of

claim 1

wherein the step of processing the first plurality of data includes:

reconfiguring the placement of the plurality of component files associated with the backup file wherein a subset of the plurality of component files are adjacent to one another when written to the first memory device.

3. The method of

claim 1

wherein each file contained within the plurality of data includes a date indicative of the last change, the step of processing the first plurality of data includes:

reconfiguring the placement of the plurality of files contained within the plurality of data according to the date indicative of the last change.

4. The method of

claim 1

wherein the delta file is one of a plurality of delta files, and wherein the step of processing the first plurality of data includes;

selecting from the plurality of component files associated with the backup file a base file and a subset of the plurality of delta files based on a predetermined criteria; and

coalescing the selected base file and the subset of the plurality of delta files into a new base file.

5. The method of

claim 4

wherein the step of selecting includes selecting the subset of the plurality of delta files according to one or more expiration rules.

6. The method of

claim 5

wherein the step of selecting includes selecting the subset of the plurality of delta files according to one or more expiration rules that include a number of days beyond which as previously stored file is deleted.

7. The method of

claim 6

wherein the step of selecting includes selecting the subset of the plurality of delta files that have exceeded the number of days beyond which files are deleted.

8. The method of

claim 4

wherein the step of selecting includes selecting the subset of the plurality of delta files according to the predetermined criteria that includes the base file and the subsequent N delta files.

9. The method of

claim 4

further including the steps of:

detecting if the coalesced file contains corrupted data;

in the event that the coalesced file contains corrupted data;

posting, by the server, a message to the client that the coalesced file contains corrupted data;

receiving by the client the posted message;

searching by the client on a storage device coupled to the client, for an uncorrupted copy of the corrupted file contained on the server, that has a creation data at or later than the corrupted file on the server; and

transferring by the client a copy of the uncorrupted file contained on a storage device coupled to the client, to the server.

10. The method of

claim 4

wherein the step of coalescing includes:

determining a first size of the base file and the subset of the plurality of delta files to be coalesced;

estimating a second size of the new base file;

determining a difference in size between the first size and the second size;

in the event that the difference in size between the first size and the second size is greater than or equal to a predetermined threshold;

coalescing the base file and the subset of the plurality of delta files; and

in the event that the difference in size between the first size and the second size is less than a predetermined threshold;

not coalescing the base file and the subset of the plurality of delta files.

11. The method of

claim 4

wherein the step of selecting includes selecting the base file and the subset of delta files using a file database accessible by the server.

12. A method for administration of a differential file back up system on a client-server system wherein the server includes a first memory storage device and a second memory device coupled thereto, the first memory device storing a plurality of archive files, each archive file storing at least a portion of a backup file, wherein the backup file comprises a plurality of component files that include a base file and at least one delta file, and wherein the plurality of component files associated with the backup file are stored in a first arrangement among one or more archive files, the first arrangement having a first number of access points associated with the backup file of interest on the first memory device, the method comprising the steps of:

selecting a subset of the plurality of archive files that contain one or more components of a backup file of interest;

reading, by the server, the selected archive files;

writing, by the server, the selected archive files into the second memory device;

processing, by the server, the components of the backup file of interest to enable the components of the backup file of interest to be arranged such that a second number of access points associated with the backup file of interest is less than the first number of access points associated with the backup file of interest; and

writing, by the server, the processed components of the backup file of interest into a new archive file on the first memory device.

13. The method of

claim 12

wherein the step of processing the first plurality of data includes:

rearranging the placement of the plurality of component files associated with the backup file wherein a subset of the plurality of component files are adjacent to one another and in the same archive file when written to the first memory device.

14. The method of

claim 12

wherein the delta file is one of a plurality of delta files, and wherein the step of processing the components of the backup file of interest includes;

selecting from the plurality of component files associated with the backup file a base file and a subset of the plurality of delta files based on a predetermined criteria; and

coalescing the selected base file and the subset of the plurality of delta files into a new base file.

15. The method of

claim 14

wherein the step of selecting includes selecting the subset of the plurality of delta files according to one or more expiration rules.

16. The method of

claim 15

wherein the step of selecting includes selecting the subset of the plurality of delta files according to one or more expiration rules that include a number of days beyond which as previously stored file is deleted.

17. The method of

claim 16

wherein the step of selecting includes selecting the subset of the plurality of delta files that have exceeded the number of days beyond which files are deleted.

18. The method of

claim 14

wherein the step of selecting includes selecting the subset of the plurality of delta files according to the predetermined criteria that includes the base file and the subsequent N delta files.

19. The method of

claim 14

further including the steps of:

detecting if the coalesced file contains corrupted data;

in the event that the coalesced file contains corrupted data;

posting, by the server, a message to the client that the coalesced file contains corrupted data;

receiving by the client the posted message;

searching by the client on a storage device coupled to the client, for an uncorrupted copy of the corrupted file contained on the server, that has a creation data at or later than the corrupted file on the server; and

transferring by the client a copy of the uncorrupted file contained on a storage device coupled to the client, to the server.

20. The method of

claim 14

wherein the step of coalescing includes:

determining a first size of the base file and the subset of the plurality of delta files to be coalesced;

determining a second size of the new base file;

estimating a difference in size between the first size and the second size;

in the event that the difference in size between the first size and the second size is greater than or equal to a predetermined threshold;

coalescing the base file and the subset of the plurality of delta files; and

in the event that the difference in size between the first size and the second size is less than a predetermined threshold;

not coalescing the base file and the subset of the plurality of delta files.

21. The method of

claim 14

wherein the step of selecting includes selecting the base file and the subset of delta files using a file database accessible by the server.

22. The method of

claim 12

wherein each file contained within the plurality of data includes a date indicative of the last change, the step of processing the first plurality of data includes:

reconfiguring the placement of the plurality of files contained within each archive file according to the date indicative of the last change.

23. A method for self healing a differential file back up system on a client-server system wherein the server includes a first memory storage device and a second memory device coupled thereto, and wherein a backup file comprises a plurality of component files that include a base file having a first creation data and a plurality of delta files having a plurality of creation dates later than the first creation date, and wherein the base file and at least one delta file are stored on the first memory device in a first arrangement having a first number of access points on the first memory device, the method comprising the steps of:

selecting a backup file of interest from the first memory device having a predetermined number of delta files after the creation date of the base file;

reading from the first memory device, the components of the selected backup file of interest;

writing the components of the selected backup file of interest to the second memory device;

reconstructing by the server the most recent version of the backup file from the file components in the second memory device;

detecting if the reconstruction failed;

in the event that the reconstruction failed

requesting the client retransmit the most recent version of the file corresponding of the backup file of interest;

retransmitting by the client the most recent version of the file corresponding of the backup file of interest;

receiving by the server the retransmitted file from the client;

replacing the components of the selected backup file of interest in the second memory device with the received file; and

writing the received file from the second memory device to the first memory device in place of the components of the selected backup file of interest.

24. A method for self healing a differential file back up system on a client-server system including a client, a first server, and a second server, wherein the first server includes a first memory storage device and a second memory device coupled thereto and the mirror server includes first and second memory devices coupled thereto, and wherein both the first and mirror server are coupled to one another and to the client, and wherein a backup file comprises a plurality of component files that include a base file having a first creation data and a plurality of delta files having a plurality of creation dates later than the first creation date, and wherein the base file and at least one delta file are stored on the first memory device in a first arrangement having a first number of access points on the first memory device of both the first server and the mirror server respectively, the method comprising the steps of:

selecting a backup file of interest from the first memory device having a predetermined number of delta files after the creation date of the base file;

reading from the first memory device, the components of the selected backup file of interest;

writing the components of the selected backup file of interest to the second memory device;

reconstructing by the server the most recent version of the backup file from the file components in the second memory device;

detecting if the reconstruction failed;

in the event that the reconstruction failed

requesting the mirror server retransmit the most recent version of the file corresponding of the backup file of interest;

retransmitting by the mirror server the most recent version of the file corresponding of the backup file of interest;

receiving by the server the retransmitted file from the client;

replacing the components of the selected backup file of interest in the second memory device with the received file; and

writing the received file from the second memory device to the first memory device in place of the components of the selected backup file of interest.

25. A method for administration of a differential file back up system on a client-server system including a first server, a mirror server, and a client all coupled together, and wherein the first server and the mirror server both include a first memory storage device, a second memory device and a disk database coupled thereto, and wherein a backup file comprises a plurality of component files that include a base file and at least one delta file, and wherein each component file has a corresponding plurality of data stored within the disk database, and wherein the base file and at least one delta file are stored on the first memory device of both the first server and the mirror server in a first arrangement having a first number of access points on the first memory device, the method comprising the steps of:

reading by the first server of the plurality of data contained within the disk database coupled thereto;

reading by the mirror server of the plurality of data contained within the disk database coupled thereto;

sorting by the first server the plurality of data according to a predetermined key;

sorting by the mirror server the plurality of data according to a predetermined key;

comparing the sorted plurality of data of the first server and the mirror server;

in the event that a component of a backup file is present on the mirror server and not on the first server, transmitting by the mirror server to the first server the missing component; and

in the event that a component of a backup file is present on the first server and not on the mirror server, transmitting by the mirror server to the first server the missing component.

26. A method for administration of a differential file back up system on a client-server system wherein the server includes a first memory storage device and a second memory device coupled thereto, the first memory device storing a plurality of archive files, each archive file being associated with one of a plurality of accounts and each archive file storing at least a portion of a backup file associated with the one of the plurality of accounts, wherein the plurality of archive files are stored in a first arrangement and each of the plurality of accounts have a first number of access points associated therewith on the first memory device, the method comprising the steps of:

selecting a subset of the plurality of archive files that are associated with one or more accounts;

reading, by the server, the selected archive files;

writing, by the server, the selected archive files into the second memory device;

processing, by the server, the archive files to be arranged such that a second number of access points associated with the plurality of archive files associated with an account of interest is less than the first number of access points associated with account of interest; and

writing, by the server, the processed plurality of archive files on the first memory device.

27. A method for administration of a differential file backup system on a client-server system wherein the server includes a memory storage device coupled thereto, and wherein a backup file comprises a plurality of component files that include a base file and at least one delta file, and wherein the base file and at least one delta file are stored on the memory device in a first arrangement having a first number of access points on the first memory device, the method comprising the steps of:

reading, by the server from the memory device, a first plurality of data including at least one base and at least one delta files;

processing, by the server the first plurality of data in the second memory device, to rearrange the first plurality of data into a second arrangement such that the plurality of components of the backup file have a second number of access points that are less than the first number of access points of the first arrangement; and

writing, by the server to the memory device, the first plurality of data in the second arrangement.

28. The method of

claim 27

wherein the delta file is one of a plurality of delta files, and wherein the step of processing the first plurality of data includes;

selecting from the plurality of component files associated with the backup file a base file and a subset of the plurality of delta files based on a predetermined criteria; and

coalescing the selected base file and the subset of the plurality of delta files into a new base file.

29. The method of

claim 28

wherein the step of selecting includes selecting the subset of the plurality of delta files according to one or more expiration rules.

30. The method of

claim 29

wherein the step of selecting includes selecting the subset of the plurality of delta files according to one or more expiration rules that include a number of days beyond which as previously stored file is deleted.

31. The method of

claim 30

wherein the step of selecting includes selecting the subset of the plurality of delta files that have exceeded the number of days beyond which files are deleted.

32. The method of

claim 30

wherein the step of selecting includes selecting the subset of the plurality of delta files according to the predetermined criteria that includes the base file and the subsequent N delta files.

33. The method of

claim 30

further including the steps of:

detecting if the coalesced file contains corrupted data;

in the event that the coalesced file contains corrupted data;

posting, by the server, a message to the client that the coalesced file contains corrupted data;

receiving by the client the posted message;

searching by the client on a storage device coupled to the client, for an uncorrupted copy of the corrupted file contained on the server, that has a creation data at or later than the corrupted file on the server; and

transferring by the client a copy of the uncorrupted file contained on a storage device coupled to the client, to the server.

34. The method of

claim 30

wherein the step of coalescing includes:

determining a first size of the base file and the subset of the plurality of delta files to be coalesced;

estimating a second size of the new base file;

determining a difference in size between the first size and the second size;

in the event that the difference in size between the first size and the second size is greater than or equal to a predetermined threshold;

coalescing the base file and the subset of the plurality of delta files; and

in the event that the difference in size between the first size and the second size is less than a predetermined threshold;

not coalescing the base file and the subset of the plurality of delta files.

35. The method of

claim 30

wherein the step of selecting includes selecting the base file and the subset of delta files using a file database accessible by the server.