Eliminating duplicate blocks during backup writes

• US 7,472,242 B1
• Filed: 02/14/2006
• Issued: 12/30/2008
• Est. Priority Date: 02/14/2006
• Status: Active Grant

• Current Assignee: Network Appliance Incorporated (NetApp, Inc.)
• Original Assignee: Network Appliance Incorporated (NetApp, Inc.)
• Inventors: Komatsu, Kiyoshi, Manley, Stephen, Deshmukh, Vijay, Park, Collin
• Primary Examiner(s): Nguyen; Hiep T
• Application Number:
  US11/354,393
• Time in Patent Office: 1,050 Days
• Field of Search: None
• US Class Current: 711/162
• CPC Class Codes: G06F 11/1451 by selection of backup contents

Abstract

Embodiments of the present invention include creating a subsequent backup copy of a data set by storing a full backup copy of the data set to reflect a state of a data set including blocks of data, at a first point in time. At a second point in time, after the first point in time, changes to the data set are identified. Next, as part of the subsequent backup copy, only each block of the data set which has been changed or added since the first point in time is stored.

Claims

1. A computerized method comprising:

storing first blocks of data of a first file of a first backup image, the first file of the first backup image including only the first blocks of data; and

storing only second blocks of data of the first file of a second backup image, the first file of the second backup image including only the second blocks of data and third blocks of data;

wherein the second blocks of data are only blocks of data including data different than data in the first blocks of data and wherein the first backup image and second backup image are both distinct backup images.

2. The computerized method of claim 1, wherein each of the second blocks of data is either a block of data added to the first blocks of data, or is a block of data having a corresponding block of data in the first blocks of data and including data different than the corresponding blocks of data.

3. The computerized method of claim 1, wherein the second blocks of data are only blocks of data not included in the first blocks of data, and updated blocks of data of the first blocks of data.

4. The computerized method of claim 3, further comprising creating a file system including a first set of pointers to the first blocks of data;

and

updating the first set of pointers to point to the second blocks of data and not to point to blocks of data of the first blocks of data for which updated blocks of data are stored.

5. The computerized method of claim 4, wherein storing only second blocks of data comprises:

storing only second blocks of data of the first file in real time during receipt of the second backup image;

comparing meta-data of the second blocks of data and meta-data of the third blocks of data to data in the file system for the first blocks of data to;

identify new blocks of data; and

identify blocks of data of the second blocks of data and the third blocks of data that correspond to blocks of data of the first blocks of data.

6. The computerized method of claim 5, wherein storing comprises comparing bytes of data of the second blocks of data, and bytes of data of the third blocks of data to bytes of data of corresponding ones of the first blocks of data to identify changed blocks of data.

7. The computerized method of creating a subsequent backup copy of a data set, the method comprising:

storing a full backup copy of the data set to reflect a state of the data set at a first point in time, the data set including a plurality of blocks;

identifying changes in the data set from the first point in time to a second point in time; and

storing, as part of said subsequent backup copy, only each block of the data set which has been changed or added.

8. The computerized method of claim 7, further comprising, for each block of the data set which is unchanged, using a reference to the corresponding block in the full backup copy of the data set for said subsequent backup copy, without creating a new copy of said block.

9. The computerized method of claim 8, wherein using the reference includes pointing to an address of each unchanged block and each block of the data set which has been changed or added.

10. The computerized method of claim 8, wherein pointing includes creating a file system.

11. A machine-accessible storage medium storing instructions that when executed cause a machine to:

store in a storage space first blocks of data of a first file of a first computer data backup image, the first file of the first computer data backup image including only the first blocks of data; and

store in the storage space only second blocks of data of the first file of a second computer data backup image received after the first computer data backup image, the first file of the second computer data backup image including only the second blocks of data and third blocks of data;

wherein the second blocks of data are only blocks of data including data different than data in the first blocks of data and wherein the first computer data backup image and the second computer data backup image are both distinct computer data backup images.

12. The machine-accessible storage medium of claim 11, wherein the instructions, when executed cause a machine not to store in the storage space the third blocks of data.

13. The machine-accessible storage medium of claim 11, wherein the third blocks of data are only blocks of data that have a volume block number (VBN) and data equal to a VBN and data of the first blocks of data.

14. The machine-accessible storage medium of claim 11, wherein the instructions, when executed cause a machine to:

create a file system including a first set of pointers to the first blocks of data; and

update the first set of pointers to point to the second blocks of data, not to point to the third blocks of data, and not to point to blocks of data of the first blocks of data for which updated blocks of data are stored.

15. The machine-accessible storage medium of claim 14, wherein updating the file system comprises comparing time of storage data from the meta-data of the first blocks of data, time of storage data from the meta-data of the second blocks of data, and time of storage data from the meta-data of the third blocks of data.

16. A storage server comprising:

a processor coupled to a memory through a bus;

the memory to store an application program that when executed by the processor causes the processor to write to a mass storage device;

first blocks of data of a first file of a first computer data backup image, the first file of the first computer data backup image including only the first blocks of data; and

only second blocks of data of the first file of a second computer data backup image received after the first computer data backup image, the first file of the second computer data backup image including only the second blocks of data and third blocks;

wherein the second blocks of data are only blocks of data including data different than data in the first blocks of data and wherein the first computer data backup image and the second computer data backup image are both distinct computer backup images.

17. The storage server of claim 16, wherein the mass storage device only stores the first blocks of data and the second blocks of data for the first file.

18. The storage server of claim 16, wherein the second blocks of data are only blocks of data having a different VBN than the first blocks of data, and blocks of data having a same VBN as the first blocks of data but having updated data.

19. The storage server of claim 16, wherein the mass storage device further comprises:

a plurality of read-only, persistent point-in-time images pointing to addresses in the mass storage device at which the first blocks of data and the second blocks of data are stored.