System and method for managing data deduplication of storage systems utilizing persistent consistency point images

• US 8,296,260 B2
• Filed: 10/26/2010
• Issued: 10/23/2012
• Est. Priority Date: 06/29/2006
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Ting, Daniel, Zheng, Ling, Manley, Stephen L., DeStefano, John Frederick
• Primary Examiner(s): HASAN, SYED HAROON
• Application Number:
  US12/912,333
• Publication Number:
  US 20110035357A1
• Time in Patent Office: 728 Days
• Field of Search: None
• US Class Current: 707/610
• CPC Class Codes: G06F 11/1435 using file system or storage system metadata
• CPC Class Codes: G06F 11/1453 using de-duplication of the data
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data

Abstract

A system and method for managing data deduplication of a storage system utilizing persistent consistency point images (PCPIs). Once a target PCPI of a data transfer is generated, a backup management module of the storage system alerts a data deduplication module to begin deduplication of the data contained within the target PCPI. Once the deduplication procedure has been completed, the active file system of the storage system has been deduplicated, however, the target PCPI remains un-deduplicated. In response, the backup management module generates and exports a revised target PCPI. The previous target PCPI may then be deleted, thereby transitioning the exported PCPI'"'"'s image of the state of the file system to a deduplicated state.

Claims

1. A method for managing data deduplication, comprising:

receiving data at a storage system;

generating a persistent consistency point image (PCPI) of the received data on the storage system, the PCPI comprising a pointer referencing duplicate data in an active file system of the storage system;

performing data deduplication on the active file system while the pointer references the duplicate data;

receiving additional data at the storage system prior to completing the data deduplication;

completing the data deduplication on the received data;

performing a second data deduplication on the received additional data;

completing the second data deduplication and generating a second PCPI of the received data and the received additional data in response to completing the second data deduplication;

storing the second PCPI at the storage system; and

deleting the first PCPI in response to storing the second PCPI.

2. The method of claim 1 wherein receiving the data comprises receiving a data stream associated with a data collection.

3. The method of claim 2 wherein the data collection comprises a volume.

4. The method of claim 2 wherein the data collection comprises a file system.

5. The method of claim 1 further comprising generating a second PCPI of the received data in response to performing the data deduplication on the active file system, wherein the second PCPI lacks the pointer referencing the duplicate data.

6. The method of claim 5 further comprising:

storing the second PCPI at the storage system; and

deleting the first PCPI in response to storing the second PCPI.

7. The method of claim 1 further comprising exporting the first PCPI to a client.

8. The method of claim 1 further comprising initiating a backup data transfer of the received data during the data deduplication.

9. A system configured to manage data deduplication, comprising:

a processor configured to execute a storage operating system of a storage system, the storage system configured to receive data from a source;

a backup management module of the storage operating system configured to cooperate with the storage system to generate a persistent consistency point image (PCPI) of the received data on the storage system, the PCPI comprising a pointer referencing duplicate data in an active file system of the storage system;

a deduplication module of the storage operating system configured to perform data deduplication on the active file system while the pointer references the duplicate data;

the storage system further configured to receive additional data prior to the deduplication module completing the data deduplication;

in response to completing the data deduplication on the received data, the deduplication module further configured to perform a second data deduplication on the received additional data;

in response to completing the second data deduplication, the backup management further configured to cooperate with the storage system to generate a second PCPI of the received data and the received additional data; and

the storage operating system further configured to store the second PCPI, and further configured to delete the first PCPI in response to storing the second PCPI.

10. The system of claim 9 wherein the deduplication module is further configured to yield to an operation of the backup management module.

11. The system of claim 9 wherein the received data comprises a data stream associated with a data collection.

12. The system of claim 11 wherein the data collection comprises a volume.

13. The system of claim 11 wherein the data collection comprises a file system.

14. The system of claim 9 wherein the backup management module is further configured to cooperate with the storage system to generate a second PCPI of the received data in response to performing the data deduplication on the active file system, wherein the second PCPI lacks the pointer referencing the duplicate data.

15. The system of claim 14 wherein the storage operating system is further configured to store the second PCPI, and in response to storing the second PCPI, to delete the first PCPI.

16. The system of claim 9 wherein the storage operating system is further configured to export the first PCPI to a client.

17. The system of claim 9 the backup management is further configured to initiate a backup data transfer of the received data during the data deduplication.

18. A computer-readable storage medium containing executable program instructions executed by a processor, the computer-readable storage medium comprising:

program instructions that receive data at a storage system;

program instructions that generate a persistent consistency point image (PCPI) of the received data on the storage system, the PCPI comprising a pointer referencing duplicate data in an active file system of the storage system;

program instructions that perform data deduplication on the active file system while the pointer references the duplicate data;

program instructions that receive additional data at the storage system prior to completing the data deduplication;

program instructions that complete the data deduplication on the received data;

program instructions that perform a second data deduplication on the received additional data;

program instructions that complete the second data deduplication and generate a second PCPI of the received data and the received additional data in response to completing the second data deduplication;

program instructions that store the second PCPI at the storage system; and

program instructions that delete the first PCPI in response to storing the second PCPI.

19. The computer-readable storage medium of claim 18 further comprising program instructions that generate a second PCPI of the received data in response to performing the data deduplication on the active file system, wherein the second PCPI lacks the pointer referencing the duplicate data.

20. The computer-readable storage medium of claim 19 further comprising:

program instructions that store the second PCPI at the storage system; and

program instructions that delete the first PCPI in response to storing the second PCPI.