Preserving redundancy in data deduplication systems by encryption

• US 9,824,228 B2
• Filed: 02/09/2015
• Issued: 11/21/2017
• Est. Priority Date: 04/23/2012
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Fiske, Rahul M., Jones, Carl E., Roy, Subhojit
• Primary Examiner(s): SHAW, PETER C
• Application Number:
  US14/617,105
• Publication Number:
  US 20150154411A1
• Time in Patent Office: 1,016 Days
• Field of Search: 713189
• CPC Class Codes: G06F 16/1748 De-duplication implemented within the file system, e.g. based on file segments de-duplication techniques in storage systems for the management of data blocks G06F3/0641
• CPC Class Codes: G06F 21/602 Providing cryptographic facilities or services
• CPC Class Codes: G06F 21/604 Tools and structures for managing or administering access control systems
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0623 in relation to content
• CPC Class Codes: G06F 3/0641 De-duplication techniques
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

A system and non-transitory computer program product for preserving data redundancy in a data deduplication system in a computing environment is provided. A selected data segment, to be written through the data deduplication system, is encrypted such that the selected data segment is not subject to a deduplication operation. Copies of the data segment that are to be precluded from data deduplication are determined and identified. A unique encryption key is used to encrypt the selected data segment to be written through the data deduplication system such that the selected data segment is not subject to a deduplication operation. The data deduplication system is tricked to recognize the encrypted, selected data segment as new, undeduplicated data by the encrypting thereby skipping steps of the deduplication operation that includes fingerprint generation and matching. The encrypted, selected data segment is directly written to a new physical storage location.

Claims

1. A system for preserving data redundancy in a data deduplication system in a computing environment, comprising:

at least one processor device implemented in computing hardware;

a file system module controlled by the processor device; and

a storage controller, controlled by the at least one processor, in operable communication with the file system module, wherein;

for adhering to requirements of an application for allocating a plurality of copies of a selected data segment to a plurality of physical storage locations, the file system module is configured to;

in a two-way mirrored storage pool, determine and identify the plurality of copies of the selected data segment that are to be precluded from data deduplication, the selected data segment comprising a superblock associated with a segment of metadata describing characteristics of a file system;

encrypt with a unique encryption key, by the application, the selected data segment to be written through the data deduplication system such that the selected data segment is not subject to a deduplication operation, wherein the unique encryption key is a weak and predictable encryption key and does not require additional metadata storage space of the selected data segment;

trick the data deduplication system to recognize the encrypted, selected data segment as new, undeduplicated data by the encrypting thereby skipping steps of the deduplication operation that includes fingerprint generation and matching, wherein the encrypted, selected data segment is not matched with identical data previously written;

directly write the encrypted, selected data segment to a new physical storage location even if there are earlier instances of identical data of the encrypted, selected data segment being stored on the storage controller, system such that multiple, redundant copies of the selected data segment comprising the superblock are stored in the plurality of physical storage locations in the computing environment;

wherein encrypting the selected data segment includes choosing multiple selected data segments written as a unit such that each of the multiple selected data segments are decrypted as the unit; and

requesting the superblock of data segments and subsequently decrypting the data segments with the weak and predictable key.

2. The system of claim 1, wherein the storage controller is further configured to process the encrypted, selected data segment through the computing environment such that the deduplication operation is withheld from being performed on the selected data segment.

3. The system of claim 2, wherein the file system module is further configured to:

select the unique encryption key to be associated with a data segment for a deduplication operation; and

encrypt the selected data segment with the unique encryption key for an associated virtual device in advance of issuing a write request to the storage controller.

4. The system of claim 3, wherein the unique encryption key is selected to be associated with one of a start of a logical block address (LBA) for the selected data segment, and an offset of the selected data segment within a file wherein an encryption function is chosen to retain a size of the encrypted, selected data segment.

5. The system of claim 4, wherein the file system module is further configured to choose multiple selected data segments written as the unit such that decrypting each of the multiple selected data segments returns original data for each segment.

6. The system of claim 1, further including a data deduplication engine associated with the storage controller and controlled by the at least one processor;

wherein the file system module is further configured to issue a write request for the encrypted, selected data segment through the data deduplication engine.

7. The system of claim 1, wherein the file system module is further configured to, on a subsequent read operation of the selected data segment, decrypt the selected data segment.

8. The system of claim 7, wherein the selected data segment is decrypted with the weak, unique, and predictable encryption key.

9. A computer program product for preserving data redundancy in a data deduplication system in a computing environment by a processor, the computer program product comprising a non-transitory computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions comprising:

for adhering to requirements of an application for allocating a plurality of copies of a selected data segment to a plurality of physical storage locations;

a first executable portion that, in a two-way mirrored storage pool, determines and identifies the plurality of copies of the selected data segment that are to be precluded from data deduplication, the selected data segment comprising a superblock associated with a segment of metadata describing characteristics of a file system;

a second executable portion that, before a write of the selected data segment is issued, encrypts with a unique encryption key, by the application, the selected data segment to be written through the data deduplication system such that the selected data segment is not subject to a deduplication operation, wherein the unique encryption key is a weak and predictable encryption and does not require additional metadata storage space of the selected data segment;

a third executable portion that tricks the data deduplication system to recognize the encrypted, selected data segment as new, undeduplicated data by the encrypting thereby skipping steps of the deduplication operation that includes fingerprint generation and matching, wherein the encrypted, selected data segment is not matched with identical data previously written;

a fourth executable portion that directly writes the encrypted, selected data segment to a new physical storage location even if there are earlier instances of identical data of the encrypted, selected data segment being stored on a storage controller, such that multiple, redundant copies of the selected data segment comprising the superblock are stored in the plurality of physical storage locations in the computing environment;

wherein encrypting the selected data segment includes choosing multiple selected data segments written as a unit such that each of the multiple selected data segments are decrypted as the unit; and

a fifth execution portion that requests the superblock of data segments and subsequently decrypts the data segments with the weak and predictable key.

10. The computer program product of claim 9, further including a fifth executable portion that processes the encrypted, selected data segment through the computing environment such that the deduplication operation is withheld from being performed on the selected data segment.

11. The computer program product of claim 10, further including a sixth executable portion that encrypts the selected data segment with the unique encryption key for an associated virtual device in advance of issuing a write request to the storage controller.

12. The computer program product of claim 11, further including a seventh executable portion that selects the encryption key to be associated with one of a start of a logical block address (LBA) for the selected data segment, and an offset of the selected data segment within a file, wherein an encryption function is chosen to retain a size of the encrypted, selected data segment processed through the encryption function.

13. The computer program product of claim 12, further including an eighth executable portion that chooses multiple selected data segments written as a unit such that decrypting each of the multiple selected data segments returns original data for each segment.

14. The computer program product of claim 10, further including a sixth executable portion that issues a write request for the encrypted, selected data segment through a deduplication engine in the storage controller.

15. The computer program product of claim 14, wherein during execution of the write request for the encrypted, selected data segment, the data deduplication engine recognizes the encrypted, selected data segment as a new segment of data and withholds performing the deduplication operation.

16. The computer program product of claim 9, further including a fifth executable portion that, on a subsequent read operation of the selected data segment, decrypts the selected data segment.

17. The computer program product of claim 16, wherein decrypting the selected data segment includes decrypting the selected data segment with the weak, unique, and predictable encryption key.

18. The computer program product of claim 9, further including a fifth executable portion that selects the unique encryption key to be associated with a data segment for a deduplication operation.