Managing redundant immutable files using deduplication in storage clouds

• US 9,514,145 B2
• Filed: 07/16/2015
• Issued: 12/06/2016
• Est. Priority Date: 12/02/2011
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Ramanthan, Sri, Chhaunker, Gaurav, Jain, Bhushan P., Patil, Sandeep R., Trevathan, Matthew B.
• Primary Examiner(s): Ho, Binh V
• Application Number:
  US14/800,788
• Publication Number:
  US 20150317328A1
• Time in Patent Office: 509 Days
• Field of Search: 707/654
• US Class Current: 1/1
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/162 Delete operations erasing in storage systems G06F3/0652
• CPC Class Codes: G06F 16/174 Redundancy elimination performed by the file system management of the data involved in backup or backup restore using de-duplication of the data G06F11/14
• CPC Class Codes: G06F 16/1748 De-duplication implemented within the file system, e.g. based on file segments de-duplication techniques in storage systems for the management of data blocks G06F3/0641
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/2379 Updates performed during online database operations; commit processing
• CPC Class Codes: G06F 7/00 Methods or arrangements for processing data by operating upon the order or content of the data handled logic circuits H03K19/00
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]

Abstract

A method includes receiving a request to save a first file as immutable. The method also includes searching for a second file that is saved and is redundant to the first file. The method further includes determining the second file is one of mutable and immutable. When the second file is mutable, the method includes saving the first file as a master copy, and replacing the second file with a soft link pointing to the master copy. When the second file is immutable, the method includes determining which of the first and second files has a later expiration date and an earlier expiration date, saving the one of the first and second files with the later expiration date as a master copy, and replacing the one of the first and second files with the earlier expiration date with a soft link pointing to the master copy.

Claims

1. A method for file deduplication implemented in hardware and comprising:

receiving, by at least one computer device, a request to save a first file as immutable;

determining, by the at least one computer device, a plurality of second files that are redundant to the first file;

determining, by the at least one computer device, each one of the plurality of second files is immutable;

identifying, by the at least one computer device, a file having a latest expiration date from a group comprising the first file and the plurality of second files;

saving, by the at least one computer device, the file having the latest expiration date as a master copy; and

replacing, by the at least one computer device, each file in the group, except for the file having the latest expiration date, with a respective data structure pointing to the master copy.

2. The method of claim 1, wherein the respective data structure comprises an immutability expiration date.

3. The method of claim 1, wherein the respective data structure comprises a soft link comprising an immutability expiration date.

4. The method of claim 1, wherein the request to save the first file comprises a request or instruction to save the first file in a shared storage.

5. The method of claim 4, wherein:

the request to save the first file is received from a local computing device;

the shared storage is in a cloud environment remote from the local computing device; and

the master copy is saved in the shared storage.

6. The method of claim 1, wherein the determining the plurality of second files that are redundant to the first file comprises comparing a hash value of the first file to hash values of other saved files.

7. The method of claim 1, further comprising one of deleting the master copy and marking the master copy as mutable upon reaching the latest expiration date.

8. The method of claim 7, further comprising:

determining a soft link having a new latest expiration date from a plurality of soft links pointing to the master copy; and

promoting the soft link having the new latest expiration date as a new master copy; and

updating the plurality of soft links, other than the soft link having the new latest expiration date, to point to the new master copy.

9. The method of claim 1, wherein the at least one computer device comprises:

one or more computer processors;

a computer readable hardware storage device; and

program instructions stored on the computer readable hardware storage device for execution by the one or more computer processors.

10. The method of claim 1, wherein the steps of claim 1 are provided in a cloud environment.

11. The method of claim 1, further comprising deleting all redundant copies to the first copy and setting a pointer to the master copy.

12. The method of claim 1, wherein the first file is marked as immutable and further comprising proactively searching for other files that are redundant to the immutable file.

13. The method of claim 12, wherein then a mutable redundant file is found the method further comprises deleting the mutable file and pointing it to the immutable file which is saved as the master copy.

14. The method of claim 1, further comprising retaining immutability attributes of the immutable file with a soft link.