Dynamic rewrite of files within deduplication system

• US 8,818,965 B2
• Filed: 04/03/2013
• Issued: 08/26/2014
• Est. Priority Date: 12/01/2010
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Aronovich, Lior, Krikler, Samuel, Levy, Asaf, Schreiber, Amit
• Primary Examiner(s): Btit, Jacob F
• Assistant Examiner(s): BUCKINGHAM, KELLYE DEE
• Application Number:
  US13/855,926
• Publication Number:
  US 20130218850A1
• Time in Patent Office: 510 Days
• Field of Search: None
• US Class Current: 707/692
• CPC Class Codes: G06F 16/1748 De-duplication implemented within the file system, e.g. based on file segments de-duplication techniques in storage systems for the management of data blocks G06F3/0641

Abstract

An original deduplication file system (DFS) file is partitioned into a first set of sections being sections including data affected by rewrite operations and a second set of sections being sections including data unaffected by rewrite operations. A new DFS file to be stored as part of a plurality of user files is created, the plurality of user files including the original DFS file and being accessible by a sequential DFS and a dynamic non-DFS, the dynamic non-DFS including a plurality of dynamic metadata files having entries pointing to corresponding sections of the original DFS files. The first set of sections of the original DFS file including data affected by rewrite operations is directly written into the new DFS file. The second set of sections from the original DFS file including data unaffected by rewrite operations is quoted into the new DFS file. The original DFS file is deleted.

Claims

1. A method for rewriting data in a deduplication storage environment by a processor device, comprising:

partitioning an original deduplication file system (DFS) file into a first set of sections being sections including data affected by rewrite operations and a second set of sections being sections including data unaffected by rewrite operations;

creating a new DFS file to be stored as part of a plurality of user files, the plurality of user files including the original DFS file and being accessible by a sequential deduplication file system and a dynamic non-deduplicated file system, the dynamic non-deduplicated file system including a plurality of dynamic metadata files having entries pointing to corresponding sections of the original DFS files;

directly writing the first set of sections of the original DFS file including data affected by rewrite operations into the new DFS file;

quoting the second set of sections from the original DFS file including data unaffected by rewrite operations into the new DFS file; and

deleting the original DFS file.

2. The method of claim 1, wherein quoting the second set of sections of the original DFS file including the data unaffected by rewrite operations is performed into an additional new DFS file.

3. The method of claim 1, wherein the deduplication file system is static.

4. The method of claim 1, wherein the entries of one of the dynamic metadata files are modified to reflect a new layout of one of the user files over the new DFS file.

5. The method of claim 1, further comprising replacing entries in a dynamic metadata file associated with the deleted original DFS file with a new entry pointing to the new DFS file.

6. The method of claim 1, further comprising using a dynamic file system layer to implement the sequential deduplication file system and the dynamic non-deduplicated file system to create and maintain the user files.

7. The method of claim 1, further comprises using a dynamic file system layer to sequentially compose the new DFS file.

8. A system for rewriting data in a deduplication storage environment, comprising:

a processor;

a memory including instructions that when executed by the processor cause the processor to perform;

partitioning an original deduplication file system (DFS) file into a first set of sections being sections including data affected by rewrite operations and a second set of sections being sections including data unaffected by rewrite operations;

creating a new DFS file to be stored as part of a plurality of user files, the plurality of user files including the original DFS file and being accessible by a sequential deduplication file system and a dynamic non-deduplicated file system, the dynamic non-deduplicated file system including a plurality of dynamic metadata files having entries pointing to corresponding sections of the original DFS files;

directly writing the first set of sections of the original DFS file including data affected by rewrite operations into the new DFS file;

quoting the second set of sections from the original DFS file including data unaffected by rewrite operations into the new DFS file; and

deleting the original DFS file.

9. The system of claim 8, wherein the processing device is further adapted for quoting the second set of sections of the original DFS file including the data unaffected by rewrite operations is performed into an additional new DFS file.

10. The system of claim 8, wherein the deduplication file system is static.

11. The system of claim 8, wherein the entries of one of the dynamic metadata files are modified to reflect a new layout of one of the user files over the new DFS file.

12. The system of claim 8, wherein the processing device is further adapted for replacing entries in a dynamic metadata file associated with the deleted original DFS file with a new entry pointing to the new DFS file.

13. The system of claim 8, wherein the processing device is further adapted for using a dynamic file system layer to implement the sequential deduplication file system and the dynamic non-deduplicated file system to create and maintain the user files.

14. The system of claim 8, wherein the processing device is further adapted for using a dynamic file system layer to sequentially compose the new DFS file.

15. A computer program product for rewriting data in a deduplication storage environment by a processor device, the computer program product comprising a non-transitory computer-readable storage medium having computer-readable program code portions stored therein comprising:

a first executable portion for partitioning an original deduplication file system (DFS) file into a first set of sections being sections including data affected by rewrite operations and a second set of sections being sections including data unaffected by rewrite operations;

a second executable portion for creating a new DFS file to be stored as part of a plurality of user files, the plurality of user files including the original DFS file and being accessible by a sequential deduplication file system and a dynamic non-deduplicated file system, the dynamic non-deduplicated file system including a plurality of dynamic metadata files having entries pointing to corresponding sections of the original DFS files;

a third executable portion for directly writing the first set of sections of the original DFS file including data affected by rewrite operations into the new DFS file;

a fourth executable portion for quoting the second set of sections from the original DFS file including data unaffected by rewrite operations into the new DFS file; and

a fifth executable portion for deleting the original DFS file.

16. The computer program product of claim 15, wherein quoting the second set of sections of the original DFS file including the data unaffected by rewrite operations is performed into an additional new DFS file.

17. The computer program product of claim 15, wherein the entries of one of the dynamic metadata files are modified to reflect a new layout of one of the user files over the new DFS file.

18. The computer program product of claim 15, further comprising a sixth executable portion for replacing entries in a dynamic metadata file associated with the deleted original DFS file with a new entry pointing to the new DFS file.

19. The computer program product of claim 15, further comprising a sixth executable portion using a dynamic file system layer to implement the sequential deduplication file system and the dynamic non-deduplicated file system to create and maintain the user files.

20. The computer program product of claim 15, further comprising a sixth executable portion using a dynamic file system layer to sequentially compose the new DFS file.