Methods and apparatus for backing up and restoring data portions stored in client computer systems

• US 6,865,655 B1
• Filed: 07/30/2002
• Issued: 03/08/2005
• Est. Priority Date: 07/30/2002
• Status: Active Grant

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Inventors: Andersen, Bryon Scott
• Primary Examiner(s): Sparks, Donald
• Assistant Examiner(s): Truong, Bao Q
• Application Number:
  US10/208,066
• Time in Patent Office: 952 Days
• Field of Search: 711/161, 711/162, 707/202, 707/203, 707/204, 714/2, 714/6, 714/15
• US Class Current: 711/162
• CPC Class Codes: G06F 11/1453 using de-duplication of the data
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 2201/83 the solution involving signatures
• CPC Class Codes: Y10S 707/99953 Recoverability

Abstract

Mechanisms and techniques operate in a computerized device to perform backup and restore operations on data portions such that if a backup server already has a copy of the content of a data portion, no client computer systems need to transfer a copy of the data portion to the backup server, even if the data portion in those clients has a different name, location, or other attributes. A backup client produces an identification of a data portion stored within a first computerized device to be backed up. The backup client conveys, to a backup server, the identification of the data portion stored within the computerized device and receives, over the communications interface, a transfer indication from the backup server. The backup client determines if the transfer indication indicates that the backup server already contains a copy of the data portion identified by the identification, and if not, the backup client transfers a copy of the data portion from the local storage device to the backup server over the communications interface.

Claims

1. A method for backing up data portions stored within a computerized device, the method comprising the steps of:

discovering a plurality of data portions stored within the computerized device; and

for each data portion in the plurality of data portions, performing the steps of;

(i) producing an identification of a data portion stored within the computerized device;

(ii) conveying, to a backup server, the identification of the data portion stored within the computerized device;

(iii) receiving a transfer indication from the backup server, the transfer indication indicating whether the backup server already contains a backed-up copy of the data portion based on the identification;

(iv) determining if the transfer indication indicates that the backup server already contains a copy of the data portion identified by the identification, and if not, transferring a copy of the data portion to the backup server, such that the computerized device only provides a copy of the data portion to the backup server if the backup server does not already have a copy of the data portion; and

(v) maintaining a catalog containing a catalog entry for each instance of the data portion stored within the computerized device, the catalog entry containing metadata specifying attributes associated with each instance of the data portion stored within the computerized device including the identification of the data portion.

2. The method of claim 1 comprising the step of transferring the catalog to the backup server.

3. The method of claim 2 wherein the steps of:

i) discovering a plurality of data portions,

ii) for each data portion in the plurality of data portions, producing an identification, conveying the identification, receiving a transfer indication and determining if the transfer indication indicates that the backup server already contains a copy of the data portion, and if not, transferring a copy of the data portion to the backup server;

iii) maintaining a catalog; and

iv) transferring the catalog to the backup server;

 

are performed as a first backup sequence within the computerized device for a first plurality of data portions to produce a first catalog associated with the first backup sequence and are performed as a second backup sequence within the computerized device for a second plurality of data portions to produce a second catalog associated with the second backup sequence; and

 

wherein the first and second catalogs identify, for each instance of a data portion discovered in the respective backup sequence associated with that catalog, metadata required to restore that instance of the data portion to a storage location associated with the at least one computerized device.

4. The method of claim 3 wherein during performance of the steps i through iv of the second backup sequence, the method comprises the step of:

after the step of discovering a plurality of data portions, determining if the identification of the data portion is contained within the first catalog maintained by the computerized device thus indicating that the data portion has been previously backed up at least once by the backup server, and if so, bypassing step ii in the second backup sequence such that only data portions for which an identification is not contained within the first catalog have their identification sent to the backup server during the second backup sequence.

5. The method of claim 3 wherein the first and second catalogs include computerized device attribute information relating to a data and time of performance of the backup sequence associated with that catalog and an identity of the computerized device to which that catalog is associated, and wherein the method comprises the steps of:

comparing the first and second catalogs to determine differences between the state of stored data portions in the computerized device between a time of performance of the first and second backup sequences.

6. The method of claim 3 wherein the computerized device is a first computerized devices, and wherein the first and a second computerized device each stores at least one instance of the same data portion;

and

wherein each of the first and second computerized devices performs at least one of the first and second backup sequences, such that if, during one of the first and second backup sequences being performed in one of the first and second computerized devices, the transfer indication indicates that the backup server already maintains a copy of the data portion, the computerized device performing that backup sequence does not transfer a copy of the data portion to the backup server.

7. The method of claim 6 wherein:

the first computerized device performs the first backup sequence to transfer a first data portion to the backup server; and

wherein the second computerized device stores an instance of the first data portion and performs the first backup sequence during which the transfer indication received from the backup server indicates that backup server already maintains a copy of the first data portion such that the step of determining the second computerized device does not transfer a copy of the data portion to the backup server during the step of determining.

8. The method of claim 7 wherein the step of maintaining a catalog, performed during the first and second backup sequences on the first and second computerized devices comprises the step of

creating a catalog entry containing metadata specifying attributes associated with the data portion that are specific to the instance of the data portion in the first and second computerized devices, respectively.

9. The method of claim 1 wherein the identification of a data portion is a fingerprint of the data portion that uniquely identifies the data portion and that is equivalent for each instance of a same data portion that may be stored in multiple locations within the at least one computerized device.

10. The method of claim 9 wherein the computerized device is a first computerized device, and wherein the first and a second computerized device each respectively store at least one instance of the same data portion, and wherein the identification produced in the step of producing an identification is that same for each instance of the same data portion when performed on each of the first and second computerized devices.

11. The method of claim 9, wherein the fingerprint of the data portion that uniquely identifies the data portion is selected from the group consisting of (a checksum, a hash, and a message digest) of the data portion.

13. A method for backing up and restoring data portions to a computerized device, the method comprising the steps of:

performing the backup method of claim 1;

providing an identification of a data portion to be restored to the backup server to obtain a single copy of the data portion from the backup server;

restoring the single copy of the data portion to multiple locations within the computerized device; and

updating each copy of the data portion restored to each of the multiple locations with attribute information specific to that copy of the data portion restored at that location.

14. The method of claim 13 further comprising the steps of:

receiving, based on the catalog of instances of data portions available for restoration to the computerized device, a selection of a plurality of instances of the data portion to be restored to the computerized device, each selected instance having a catalog instance entry defining a location within the computerized device at which the data portion is to be restored to the computerized device and defining the attribute information specific to that instance of that data portion restored at that location.

12. A method for backing up data portions stored within a computerized device, the method comprising the steps of:

discovering a plurality of data portions stored within the computerized device; and

for each data portion in the plurality of data portions, performing the steps of;

(i) producing an identification of a data portion stored within the computerized device;

(ii) determining if the identification of the data portion is contained within a preexisting catalog maintained by the computerized device thus indicating that the data portion has been previously backed up at least once by the backup server;

if the identification of the data portion is not contained within the pre-existing catalog, then performing the steps of;

(iii) conveying, to a backup server, the identification of the data portion stored within the computerized device;

(iv) receiving a transfer indication from the backup server, the transfer indication indicating whether the backup server already contains a backed-up copy of the data portion based on the identification; and

(v) determining if the transfer indication indicates that the backup server already contains a copy of the data portion identified by the identification, and if not, transferring a copy of the data portion to the backup server, such that the computerized device only provides a copy of the data portion to the backup server if the backup server does not already have a copy of the data portion; and

if the identification of the data portion is contained within the pre-existing catalog, then (vi) bypassing the steps of conveying the identification to the backup server, receiving a transfer indication from the backup server and determining if the transfer indication indicates that the backup server already contains a copy of the data portion, such that a copy of the data portion is not transferred to the backup server.

15. A computerized device comprising:

a memory;

a processor;

a communications interface;

a local storage device containing a plurality of data portions;

an interconnection mechanism coupling the memory the processor, the local storage device and the communications interface;

wherein the memory is encoded with logic instructions that form a backup client application that, when executed by the processor, performs a backup client process that causes the computerized device to back up the data portions stored within the local storage device to a backup server by performing the steps of;

discovering a plurality of data portions stored within the computerized device; and

for each data portion in the plurality of data portions, performing the steps of;

(i) producing, in the memory, an identification of the data portion;

(ii) conveying, to a backup server over the communications interface, the identification of the data portion stored within the computerized device;

(iii) receiving, over the communications interface, a transfer indication from the backup server, the transfer indication indicating whether the backup server already contains a backed-up copy of the data portion based on the identification; and

(iv) determining if the transfer indication indicates that the backup server already contains a copy of the data portion identified by the identification, and if not, transferring a copy of the data portion from the local storage device to the backup server over the communications interface, such that the computerized device only provides a copy of the data portion to the backup server if the backup server does not already have a copy of the data portion; and

(v) maintaining a catalog containing a catalog entry for each instance of the data portion stored within the computerized device, the catalog entry containing metadata specifying attributes associated with each instance of the data portion stored within the computerized device including the identification of the data portion.

16. The computerized device of claim 15 wherein the backup server process causes the computerized device to perform the step of transferring the catalog to the backup server.

17. The computerized device of claim 16 wherein the steps of:

i) discovering a plurality of data portions,

ii) for each data portion in the plurality of data portions, producing an identification, conveying the identification, receiving a transfer indication and determining if the transfer indication indicates that the backup server already contains a copy of the data portion, and if not, transferring a copy of the data portion to the backup server;

iii) maintaining a catalog; and

iv) transferring the catalog to the backup server;

 

are performed by the backup client process as a first backup sequence within the computerized device for a first plurality of data portions to produce a first catalog associated with the first backup sequence and are performed as a second backup sequence within the computerized device for a second plurality of data portions to produce a second catalog associated with the second backup sequence; and

 

wherein the first and second catalogs identify, for each instance of a data portion discovered in the respective backup sequence associated with that catalog, metadata required to restore that instance of the data portion to a storage location associated with the computerized device.

18. The computerized device of claim 17 wherein during performance of the steps i through iv of the second backup sequence, the backup server process causes the computerized device to perform the step of:

after the step of discovering a plurality of data portions, determining if the identification of the data portion is contained within the first catalog maintained by the computerized device thus indicating that the data portion has been previously backed up at least once by the backup server, and if so, bypassing step ii in the second backup sequence such that only data portions for which an identification is not contained within the first catalog have their identification sent to the backup server during the second backup sequence.

19. The computerized device of claim 17 wherein the first and second catalogs include computerized device attribute information relating to a data and time of performance of the backup sequence associated with that catalog and an identity of the computerized device to which that catalog is associated, and wherein the backup server process causes the computerized device to perform the step of:

comparing the first and second catalogs to determine differences between the state of stored data portions in the computerized device between a time of performance of the first and second backup sequences.

20. The computerized device of claim 17 wherein the computerized device is a first computerized device, and operates in parallel with a second computerized device, each computerized device storing at least one instance of the same data portion;

and

wherein each of the first and second computerized devices performs at least one of the first and second backup sequences, such that if, during one of the first and second backup sequences being performed in one of the first and second computerized devices, the transfer indication indicates that the backup server already maintains a copy of the data portion, the computerized device performing that backup sequence does not transfer a copy of the data portion to the backup server.

21. The computerized device of claim 20 wherein:

the first computerized device performs the first backup sequence to transfer a first data portion to the backup server; and

wherein the second computerized device stores an instance of the first data portion and performs the first backup sequence during which the transfer indication received from the backup server indicates that backup server already maintains a copy of the first data portion such that the step of determining the second computerized device does not transfer a copy of the data portion to the backup server during the step of determining.

22. The computerized device of claim 21 wherein when the backup client causes each of the computerized devices to perform the step of maintaining a catalog, performed during the first and second backup sequences on the first and second computerized devices, the backup client causes the computerized device to perform the step of:

creating a catalog entry containing metadata specifying attributes associated with the data portion that are specific to the instance of the data portion in the first and second computerized devices, respectively.

23. The computerized device of claim 15 wherein the identification of a data portion is a fingerprint of the data portion that uniquely identifies the data portion and that is equivalent for each instance of a same data portion that may be stored in multiple locations within the computerized device.

24. The computerized device of claim 23 wherein the computerized device is a first computerized device, and each of the first and a second computerized devices respectively store at least one instance of the same data portion, and wherein the identification produced in the step of producing an identification is that same for each instance of the same data portion when performed on each of the first and second computerized devices.

25. The computerized device of claim 23, wherein the fingerprint of the data portion that uniquely identifies the data portion is selected from the group consisting of (a checksum, a hash, and a message digest) of the data portion.

27. A computerized device comprising:

a memory;

a processor;

a communications interface;

a local storage device containing a plurality of data portions;

an interconnection mechanism coupling the memory, the processor, the local storage device and the communications interface;

wherein the memory is encoded with logic instructions that form a backup client application that, when executed by the processor, performs a backup client process that causes the computerized device to backup and restore data portions to the local storage device within the computerized device by performing the steps of;

performing the steps of backing up the data portions of claim 18;

providing an identification of the data portion to a backup server to obtain a single copy of the data portion from the backup server;

restoring the single copy of the data portion to multiple locations within the computerized device; and

updating each copy of the data portion restored to each of the multiple locations with attribute information specific to that copy of the data portion restored that location.

28. The computerized device of claim 27 wherein the backup client process causes the computerized device to perform the steps of:

receiving, based on the catalog of instances of data portions available for restoration to the computerized device, a selection of a plurality of instances of the data portion to be restored to the computerized device, each selected instance having a catalog instance entry defining a location within the computerized device at which the data portion is to be restored to the computerized device and defining the attribute information specific to that instance of that data portion restored at that location.

26. A computerized device comprising:

a memory;

a processor;

a communications interface;

a local storage device containing a plurality of data portions; and

an interconnection mechanism coupling the memory, the processor, the local storage device and the communications interface;

wherein the memory is encoded with logic instructions that form a backup client application that, when executed by the processor, performs a backup client process that causes the computerized device to back up the data portions stored within the local storage device to a backup server by performing the steps of;

discovering a plurality of data portions stored within the computerized device; and

for each data portion in the plurality of data portions, performing the steps of;

(i) producing, in the memory, an identification of the data portion;

(ii) determining if the identification of the data portion is contained within a preexisting catalog maintained by the computerized device thus indicating that the data portion has been previously backed up at least once by the backup server;

if the identification of the data portion is not contained within the pre-existing catalog, then performing the steps of;

(iii) conveying, to a backup server over the communications interface, the identification of the data portion stored within the computerized device;

(iv) receiving, over the communications interface, a transfer indication from the backup server, the transfer indication indicating whether the backup server already contains a backed-up copy of the data portion based on the identification; and

(v) determining if the transfer indication indicates that the backup server already contains a copy of the data portion identified by the identification, and if not, transferring a copy of the data portion from the local storage device to the backuD server over the communications interface, such that the computerized device only provides a copy of the data portion to the backup server if the backuD server does not already have a copy of the data portion; and

if the identification of the data portion is contained within the pre-existing catalog, then (vi) bypassing the steps of conveying the identification to the backup server, receiving a transfer indication from the backup server and determining if the transfer indication indicates that the backup server already contains a copy of the data portion, such that a copy of the data portion is not transferred to the backup server.

29. A computer program product having a computer-readable medium including computer program logic encoded thereon that, when performed in a computerized device having a coupling of a memory and a processor, programs the processor to perform a backup technique by performing the operations of:

discovering a plurality of data portions stored within the computerized device; and

for each data portion in the plurality of data portions, performing the steps of;

(i) producing, in the memory, an identification of a data portion stored within a computerized device;

(ii) conveying, to a backup server over the communications interface, the identification of the data portion stored within the computerized device;

(iii) receiving, over the communications interface, a transfer indication from the backup server, the transfer indication indicating whether the backup server already contains a backed-up copy of the data portion based on the identification;

(iv) determining if the transfer indication indicates that the backup server already contains a copy of the data portion identified by the identification, and if not, transferring a copy of the data portion from the local storage device to the backup server over the communications interface, such that the computerized device only provides a copy of the data portion to the backup server if the backuD server does not alreadv have a copy of the data portion; and

(v) maintaining a catalog containing a catalog entry for each instance of the data portion stored within the computerized device, the catalog entry containing metadata specifying attributes associated with each instance of the data portion stored within the computerized device including the identification of the data portion.