Preserving redundancy in data deduplication systems by indicator

• US 9,798,734 B2
• Filed: 03/01/2013
• Issued: 10/24/2017
• Est. Priority Date: 04/23/2012
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Fiske, Rahul M., Jones, Carl E., Roy, Subhojit
• Primary Examiner(s): Trujillo, James
• Assistant Examiner(s): CHEUNG, HUBERT G
• Application Number:
  US13/782,293
• Publication Number:
  US 20130282673A1
• Time in Patent Office: 1,698 Days
• CPC Class Codes: G06F 16/1748 De-duplication implemented within the file system, e.g. based on file segments de-duplication techniques in storage systems for the management of data blocks G06F3/0641
• CPC Class Codes: G06F 16/2282 Tablespace storage structures; Management thereof
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/2379 Updates performed during online database operations; commit processing
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0641 De-duplication techniques
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

Various embodiments for preserving data redundancy in a data deduplication system in a computing environment are provided. In one embodiment, a method for such preservation is disclosed. An indicator is configured. The indicator is provided with a selected data segment to be written through the data deduplication system to designate that the selected data segment must not be subject to a deduplication operation, such that repetitive data can be written and stored on physical locations despite being identical.

Claims

1. A method for preserving data redundancy in a data deduplication system in a computing environment by a processor, comprising:

receiving a write command for writing a selected data segment to a physical storage location, wherein the selected data segment is at least one of a Superblock and file system metadata required to be stored repetitively on physical storage;

determining whether the write command includes an indicator including at least one of a bit and a flag, the indicator designating that the selected data segment must not be subject to a deduplication operation;

if the write command does not include the indicator, generating a fingerprint for the selected data segment and performing a deduplication operation on the selected data segment; and

if the write command does include the indicator, bypassing the generating the fingerprint and the performing the deduplication operation;

wherein configuring an indicator further includes, for an application operational in the computing environment, providing a system call with an extended attribute indicating that the selected data segment must be written to physical memory notwithstanding the selected data segment matching data written to the physical memory earlier in time.

2. The method of claim 1, further including processing the indicator such that the deduplication operation is withheld from being performed on the selected data segment.

3. The method of claim 2, wherein processing the indicator includes preparing the write command, and incorporating the indicator into the write command to be provided to a storage controller in the computing environment.

4. The method of claim 3, wherein processing the indicator includes:

receiving the write command by the storage controller, and

directly writing the selected data segment to a new physical storage location.