METHOD AND APPARATUS FOR DEDUPLICATION OF REPLICATED FILE

• US 20140297603A1
• Filed: 06/26/2013
• Published: 10/02/2014
• Est. Priority Date: 03/27/2013
• Status: Abandoned Application

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: KIM, Hong Yeon, KIM, Young Kyun, KIM, Young-Chang
• Application Number:
  US13/927,520
• Publication Number:
  US 20140297603A1
• Time in Patent Office: Days
• US Class Current: 707/692
• CPC Class Codes: G06F 16/1752 based on file chunks

Abstract

A replicated file deduplication apparatus generates a hash key of a requested data block, determines whether the same data block as the requested data block exists in data blocks of a replicated image file that is derived from the same golden image file as the requested data block using the hash key of the requested data block, and records, if the same data block as the requested data block exists, information of a chunk in which the same data block as the requested data block is stored at a layout of the requested data block.

Claims

1. A deduplication apparatus of a replicated image file that is derived from a golden image file of a virtual machine, the deduplication apparatus comprising:

a deduplication table that maps a chunk identifier and a hash key of replicated image files on a golden image file basis; and

a deduplication controller that searches for whether the same data block as the requested data block exists in a data block of replicated image files of the same golden image file as a data block in which writing is requested with reference to the deduplication table, and that performs a deduplication processing if the same data block as the requested data block exists.

2. The apparatus of claim 1, wherein the deduplication table comprises:

a sharing image identifier table that stores a sharing image identifier representing a golden image file; and

a plurality of hash key tables that map a chunk identifier and a hash key of each data block of replicated image files on a sharing image identifier basis,

wherein the deduplication controller determines that the same file block as a requested file block exists when a chunk identifier that is mapped to a hash key of the requested file block exists with reference to a hash key table corresponding to a sharing image identifier of the requested data block.

3. The apparatus of claim 2, further comprising a metadata controller that manages metadata of the golden image file and the replicated image file,

wherein the metadata comprises a sharing image identifier for identifying the golden image file and a data block layout representing a chunk of each data block of the golden image file and the replicated image file, and

the deduplication controller acquires a sharing image identifier of the requested data block from the metadata controller.

4. The apparatus of claim 3, wherein the metadata is generated when the golden image file and the replicated image file are generated.

5. The apparatus of claim 3, wherein the deduplication controller acquires a position of a layout of the requested data block from the metadata controller if the same data block as the requested data block exists, and records a chunk identifier that is mapped to the hash key of the requested data block at a position of the acquired layout.

6. The apparatus of claim 3, wherein the deduplication controller maps a new chunk identifier to a hash key of the requested data block if the same data block as the requested data block does not exist, and registers the new chunk identifier at the deduplication table.

7. The apparatus of claim 6, wherein the deduplication controller acquires a new chunk identifier from the metadata controller if the same data block as the requested data block does not exist and forwards the new chunk identifier and the requested data block to a chunk server, and

the requested data block is stored to correspond to the new chunk identifier by the chunk server.

8. The apparatus of claim 2, further comprising a hash key generator that generates a hash key of the requested file block using hardware acceleration.

9. A method in which a deduplication apparatus of a replicated file deduplicates a replicated image file that is derived from a golden image file of a virtual machine, the method comprising:

generating a hash key of a data block in which writing is requested;

determining whether the same data block as the requested data block exists in data blocks of replicated image files that are derived from the same golden image file as the requested data block using a hash key of the requested data block; and

performing deduplication processing if the same data block as the requested data block exists.

10. The method of claim 9, wherein the determining of whether the same data block as the requested data block exists comprises:

acquiring a sharing image identifier of a golden image file corresponding to the requested data block;

determining whether a chunk identifier that is mapped to a hash key of the requested data block exists with reference to a hash key table corresponding to the acquired sharing image identifier in a plurality of hash key tables that map a chunk identifier and a hash key of each data block of replicated image files on a sharing image identifier basis; and

determining, if a chunk identifier that is mapped to a hash key of the requested data block exists, that the same data block as the requested data block exists.

11. The method of claim 10, wherein the performing of a deduplication processing comprises:

acquiring a position of a layout of the requested data block; and

recording a chunk identifier that is mapped to a hash key of the requested data block at the position of a layout of the requested data block.

12. The method of claim 10, wherein the determining of whether the same data block as the requested data block exists further comprises determining, if a chunk identifier that is mapped to the hash key of the requested data block does not exist, that the same data block as the requested data block does not exist.

13. The method of claim 9, further comprising mapping, if the same data block as the requested data block does not exist, a new chunk identifier to the hash key of the requested data block and registering the new chunk identifier at the hash key table.

14. The method of claim 13, further comprising forwarding, if the same data block as the requested data block does not exist, a new chunk identifier and the requested data block to a chunk server,

wherein the requested data block is stored to correspond to the new chunk identifier by the chunk server.

15. The method of claim 9, wherein the generating of a hash key comprises generating a hash key of the requested file block using hardware acceleration.