Preserving redundancy in data deduplication systems

• US 9,779,103 B2
• Filed: 04/23/2012
• Issued: 10/03/2017
• Est. Priority Date: 04/23/2012
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Fiske, Rahul M., Jones, Carl Evan, Roy, Subhojit
• Primary Examiner(s): Trujillo, James
• Assistant Examiner(s): CHEUNG, HUBERT G
• Application Number:
  US13/453,252
• Publication Number:
  US 20130282669A1
• Time in Patent Office: 1,989 Days
• CPC Class Codes: G06F 16/1748 De-duplication implemented within the file system, e.g. based on file segments de-duplication techniques in storage systems for the management of data blocks G06F3/0641
• CPC Class Codes: G06F 16/2282 Tablespace storage structures; Management thereof
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/2379 Updates performed during online database operations; commit processing
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0641 De-duplication techniques
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

Various embodiments for preserving data redundancy in a data deduplication system in a computing environment are provided. An indicator is configured. The indicator is provided with a selected data segment to be written through the data deduplication system to designate that the selected data segment must not be subject to a deduplication operation, such that repetitive data can be written and stored on physical locations despite being identical.

Claims

1. A system for preserving data redundancy in a data deduplication system in a computing environment, comprising:

a file system module;

a storage controller in communication with the file system module, wherein the file system module;

receives a write command for writing a selected data segment to a physical storage location, wherein the selected data segment is at least one of a Superblock and file system metadata required to be stored repetitively on physical storage;

determines whether the write command includes an indicator including at least one of a bit and a flag, the indicator designating that the selected data segment must not be subject to a deduplication operation;

if the write command does not include the indicator, generates a fingerprint for the selected data segment and performing a deduplication operation on the selected data segment; and

if the write command does include the indicator, bypasses the generating the fingerprint and the deduplication operation; and

an application, operationally communicative with the file system module, wherein the application;

provides a system call with an extended attribute indicating that the selected data segment must memory notwithstanding the selected data segment matching data written to the physical memory earlier in time.

2. The system of claim 1, wherein the storage controller processes the indicator such that the deduplication operation is withheld from being performed on the selected data segment.

3. The system of claim 2, further including a storage driver in communication between the file system module and the storage controller, wherein the storage driver, pursuant to processing the indicator, prepares the write command and incorporates the indicator into the write command to be provided to the storage controller.

4. The system of claim 3, wherein the storage controller, pursuant to processing the indicator:

receives the write command, and

directly writes the selected data segment to a new physical storage location.

5. The system of claim 1, wherein the at least one of the bit and the flag are associated with the selected data segment using an adapted small computer system interface (SCSI) write command.

6. A computer program product for preserving data redundancy in a data deduplication system in a computing environment by a processor, the computer program product comprising a non-transitory computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions comprising:

a first executable portion for;

receiving a write command for writing a selected data segment to a physical storage location, wherein the selected data segment is at least one of a Superblock and file system metadata required to be stored repetitively on physical storage;

determining whether the write command includes an indicator including at least one of a bit and a flag, the indicator designating that the selected data segment must not be subject to a deduplication operation;

if the write command does not include the indicator, generating a fingerprint for the selected data segment and performing a deduplication operation on the selected data segment;

if the write command does include the indicator, bypassing the generating the fingerprint and the performing the deduplication operation; and

pursuant to configuring computing environment, providing a system call with an extended attribute indicating that the selected data segment must be written to physical memory notwithstanding the selected data segment matching data written to the physical memory earlier in time.

7. The computer program product of claim 6, further including a second executable portion for processing the indicator such that the deduplication operation is withheld from being performed on the selected data segment.

8. The computer program product of claim 7, further including a third executable portion for, pursuant to processing the indicator, preparing the write command, and incorporating the indicator into the write command to be provided to a storage controller in the computing environment.

9. The computer program product of claim 8, further including a fourth executable portion for, pursuant to processing the indicator:

receiving the write command by the storage controller, and

directly writing the selected data segment to a new physical storage location.