High performance backup via selective file saving which can perform incremental backups and exclude files and uses a changed block signature list

• US 5,765,173 A
• Filed: 01/11/1996
• Issued: 06/09/1998
• Est. Priority Date: 01/11/1996
• Status: Expired due to Term

• Current Assignee: Autonomy Incorporated (HP Inc.)
• Original Assignee: Connected Corporation (Iron Mountain Incorporated)
• Inventors: Cane, David, Hirschman, David
• Primary Examiner(s): Black, Thomas G.
• Assistant Examiner(s): RONES, CHARLES
• Application Number:
  US08/585,273
• Time in Patent Office: 880 Days
• Field of Search: 395/489, 395/601, 395/616, 395/404, 395/619, 395/621, 395/182.04, 395/181, 395/620, 395/180, 395/101, 380/4, 707/205, 707/204
• US Class Current: 707/640
• CPC Class Codes: G06F 11/1453 using de-duplication of the data
• CPC Class Codes: G06F 2201/83 the solution involving signatures

Abstract

High performance backup of a computer system includes backing up changed portions of files and selectively choosing files for backup. Files are treated as a collection of blocks, and only those blocks which have changed since a previous backup are transmitted to a backup system. Prior to selecting blocks for backup, files are selectively chosen by excluding previously archived files such as commercial software, and excluding other non-critical applications and data based on, inter alia, commonality, modification date and a list of files which are already present in the backup system. Files may also be pre-loaded into a backup system in anticipation of their presence in the computer system to be backed up.

Claims

1. A method for backing up a user system having one or more storage media to a backup system with a backup media, the user system being in communication with the backup system, where at least one previous backup has been made including storing a version T1 target file in the backup system, the method comprising the steps of:

determining which files are present in the backup system;

defining a critical file selection criteria to identify files within the scope of backup;

defining a list of unique file identifier descriptors to specifically identify files already stored on said backup system;

excluding from backup those files which are already stored in the backup system, whereby a file which is common to two or more storage media is backed up only once; and

wherein said excluding is based on comparing files to said list of unique file identifier descriptors;

determining from said user system storage media target files which have changed since the previous backup;

selecting target files which have changed since the previous backup;

eliminating, from said group of target files, entries which are not within the range of files included in said critical file selection criteria;

transmitting the particular selected target file from the user system to the backup system; and

storing the changed files on the backup system.

2. The method of claim 1 wherein said reducing step further includes computing a digital signature for each block.

3. The method of claim 1 further including producing a reverse changed block file by performing a recovery operation to a target file along with each backup, said recovery operation resulting in a "most recent" version of the target file and said reverse changed block file, said reverse changed block file storing changes to said "most recent" file such that said target version;

is reconstructed by updating the "most recent" version target file with said forward changed block file.

4. The method of claim 3 wherein earlier versions of the target file are produced by recursively de-updating the most recent version target file with said reverse changed block files.

5. The method of claim 4 further including restoring a desired version of the target file in the backup system and transmitting the desired version of the complete target file to the user system.

6. The method of claim 5 wherein a digital signature of said desired version target file is computed in said backup system and transmitted to said user system, and a digital signature of the received desired version target file is computed in the user system and compared with the received digital signature to verify accuracy of said restoring step.

7. The method of claim 1 further including excluding files which are part of a commercial software program, said commercial software program files being identified by scanning for files with similar file modification dates.

8. The method of claim 7 wherein said scanning for files with similar file modification dates includes considering only files located in a discrete and enumerable location and sub-directories thereof.

9. The method of claim 8 wherein said scanning for files with similar file modification dates includes considering only groups of files with a predetermined minimum number of files.

10. The method of claim 9 wherein said scanning for files with similar modification dates includes considering only groups of files wherein at least one file in the group contains computer instructions.

11. The method of claim 1 including recognizing files which contain computer instructions, and which have differing patches, wherein a patch distinguishes instantiations of similar applications by comprising non-instruction data areas and excluding such files from backup.

12. The method of claim 11 further including recognizing files which contain computer instructions, and which have differing patches, and backing up only the patches.

13. The method of claim 1 wherein said selecting files as candidates for backup further includes excluding groups of files with common modification dates.

14. The method of claim 13 wherein said groups of files are required to contain a predetermined minimum number of files before being excluded from backup.

15. The method of claim 14 wherein each said group of files is required to contain at least one file which contains computer instructions before said group is excluded from backup.

16. A computer system with improved backup and restoration capability comprising:

a user system having one or more storage media with files, said files having attributes and said user system having ability to make changes to said files;

a backup system having backup media, said backup system connected to said user system by a link, said backup system having a version T1 target file and at least one changed block file, said changed block file comprising enumeration of said changes to said files on said storage media, said link having ability to transport said changed block files;

said backup system having a changed block signature list from a previous backup;

a new changed block signature list created during backup, and wherein said new list is compared to said previous list to identify changed blocks;

a forward changed block file created from said identified changed blocks for each selected changed file in said user system wherein said forward changed block files are transmitted from said user system to said backup system;

said version T1 target file updated with said forward changed block files in said backup system to produce a desired version file which is transmitted to the user system during a recovery operation;

a digital signature of the desired version file is computed independently in both said user system and said backup system, and the signatures are compared to verify error-free transfer;

a subset of said files on said user system excluded from backup prior to generating said new changed block signature list, said subset comprised of files for which alternate backup copies exist; and

a list which indicates files already present in said backup system, copies of said already present files in said user system being excluded from backup.

17. The computer system of claim 16 where files with identical modification dates are excluded.

18. The computer system of claim 17 wherein said files with common modification dates are selected from common directories, and subdirectories thereof, and arranged in groups, said groups required to include a predetermined minimum number of files and include at least one file having computer instructions before any file in the group is excluded from backup.

19. The computer system of claim 18 wherein said forward changed block files are compressed prior to being transmitted.

20. The computer system of claim 19 wherein said forward changed block files are encrypted prior to being transmitted.