PRESERVING REDUNDANCY IN DATA DEDUPLICATION SYSTEMS BY DESIGNATION OF VIRTUAL ADDRESS

• US 20160124985A1
• Filed: 01/12/2016
• Published: 05/05/2016
• Est. Priority Date: 04/23/2012
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: FISKE, Rahul M., JONES, Carl E., ROY, Subhojit
• Granted Patent: US 9,767,113 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/1748 De-duplication implemented within the file system, e.g. based on file segments de-duplication techniques in storage systems for the management of data blocks G06F3/0641
• CPC Class Codes: G06F 16/188 Virtual file systems
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0641 De-duplication techniques

Abstract

Various embodiments for preserving data redundancy of identical data in a data deduplication system in a computing environment are provided. In one embodiment, a method for such preservation is disclosed. A selected range of virtual addresses of a virtual storage device in the computing environment is designated as not subject to a deduplication operation. Other system and computer program product embodiments are disclosed and provide related advantages.

Claims

1. A method for preserving data redundancy of identical data in a data deduplication system comprising a storage device coupleable to a host computing device including a host application, the storage device comprising a virtual storage device comprising a plurality of virtual addresses, and a storage controller coupled to the storage device and operable in a computing environment, comprising:

implementing, by the storage controller, a general storage policy including a deduplication operation for preventing multiple copies of the same data from being stored;

designating, by the storage controller, a first range of virtual addresses as not being subject to the deduplication operation;

designating, by the storage controller, a remainder of virtual addresses in the virtual storage device as being subject to the deduplication operation;

generating, by the host application, a plurality of data blocks; and

implementing, by the host application, a specific storage policy for each respective data block generated by the host application so that at least a portion of the data blocks generated by the host application are not subject to the deduplication operation in the general storage policy.

2. The method of claim 1, further comprising processing first data to be written to the first range of virtual addresses to bypass the data deduplication operation such that the deduplication operation is withheld from being performed on the first data.

3. The method of claim 2, wherein processing the first data comprises issuing a write command to an allocated portion of the first range of virtual addresses.

4. The method of claim 2, further comprising processing second data to be written to the remainder of the virtual addresses such that the deduplication operation is performed on the second data.

5. The method of claim 2, further comprising, pursuant to processing the first data, performing at least one of:

discovering the first range of virtual addresses, and

conveying the discovered first range of virtual addresses to an application operational in the computing environment via a write command.

6. The method of claim 5, wherein designating the first range of virtual addresses comprises specifying a size of the first range of virtual addresses by an application operating in the computing environment.

7. The method of claim 1, further comprising intelligently determining, by the storage controller, whether the first range of virtual addresses and the remainder of the virtual addresses are contiguous or dis-contiguous, the intelligent determination based on internal knowledge of how portions of the virtual addresses are allocated across differing physical storage media.

8. A system for preserving data redundancy of identical data in a data deduplication system operable in a computing environment, comprising:

a storage device coupleable to a host computing device including a host application, the storage device comprising a virtual storage device comprising a plurality of virtual addresses; and

a storage controller coupled to the storage device, wherein the storage econtroller is configured for;

implementing general storage policy including a deduplication operation for preventing multiple copies of the same data from being stored,

designating a first range of virtual addresses as not being subject to the deduplication operation, and

designating a remainder of virtual addresses in the virtual storage device as being subject to the deduplication operation,

wherein the host application is configured for;

generating a plurality of data blocks, and

implementing specific storage policy for each respective data block generated by the host application so that at least a portion of the data blocks generated by the host application are not subject to the deduplication operation in the general storage policy.

9. The system of claim 8, wherein the storage controller is further configured for processing first data to be written to the first range of virtual addresses to bypass the data deduplication operation such that the deduplication operation is withheld from being performed on the first data.

10. The system of claim 9, wherein when processing the first data, the storage controller is configured for issuing a write command to an allocated portion of the first range of virtual addresses.

11. The system of claim 9, wherein the storage controller is further configured for processing second data to be written to the remainder of the virtual addresses such that the deduplication operation is performed on the second data.

12. The system of claim 9, wherein the storage controller, when processing the first data, is configured for performing at least one of:

discovering the first range of virtual addresses, and

conveying the discovered first range of virtual addresses to an application operational in the computing environment via a write command.

13. The system of claim 12, wherein, when designating the first range of virtual addresses, the storage controller is configured for specifying a size of the first range of virtual addresses.

14. The system of claim 8, wherein the storage controller is further configured for intelligently determining whether the first range of virtual addresses and the remainder of the virtual addresses are contiguous or dis-contiguous, the intelligent determination based on internal knowledge of how portions of the virtual addresses are allocated across differing physical storage media.

15. A computer program product for preserving data redundancy of identical data in a data deduplication system comprising a storage device coupleable to a host computing device including a host application, the storage device comprising a plurality of physical disks and a virtual storage device comprising a plurality of virtual addresses, and a storage controller coupled to the storage device and operable in a computing environment, the computer program product comprising a non-transitory computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions comprising:

computer code for implementing, by the storage controller, a general storage policy including a deduplication operation for preventing multiple copies of the same data from being stored;

computer code for designating, by the storage controller, a first range of virtual addresses as not being subject to the deduplication operation;

computer code for designating, by the storage controller, a remainder of virtual addresses in the virtual storage device as being subject to the deduplication operation;

computer code for generating, by the host application, a plurality of data blocks; and

computer code for implementing, by the host application, a specific storage policy for each respective data block generated by the host application so that at least a portion of the data blocks generated by the host application are not subject to the deduplication operation in the general storage policy.

16. The computer program product of claim 15, further comprising computer code for processing first data to be written to the first range of virtual addresses to bypass the data deduplication operation such that the deduplication operation is withheld from being performed on the first data.

17. The computer program product of claim 16, further comprising computer code for processing second data to be written to the remainder of the virtual addresses such that the deduplication operation is performed on the second data.

18. The computer program product of claim 16, further comprising, pursuant to the computer code for processing the first data, computer code for performing at least one of:

discovering the first range of virtual addresses, and

conveying the discovered first range of virtual addresses to an application operational in the computing environment via a write command.

19. The computer program product of claim 18, wherein the computer code for designating the first range of virtual addresses comprises computer code for specifying a size of the first range of virtual addresses by an application operating in the computing environment.

20. The computer program product of claim 15, further comprising computer code for intelligently determining, by the storage controller, whether the first range of virtual addresses and the remainder of the virtual addresses are contiguous or dis-contiguous, the intelligent determination based on internal knowledge of how portions of the virtual address are allocated across differing physical storage media.