Storage device and deduplication method

• US 8,156,279 B2
• Filed: 10/15/2010
• Issued: 04/10/2012
• Est. Priority Date: 09/28/2007
• Status: Active Grant

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Tanaka, Katsuya, Nakamura, Shuji, Mizuno, Makio
• Primary Examiner(s): Bragdon, Reginald
• Assistant Examiner(s): Faal, Baboucarr
• Application Number:
  US12/905,566
• Publication Number:
  US 20110035541A1
• Time in Patent Office: 543 Days
• Field of Search: None
• US Class Current: 711/103
• CPC Class Codes: G06F 12/0246 in block erasable memory, e.g. flash memory
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0616 in relation to life time, e.g. increasing Mean Time Between Failures [MTBF]
• CPC Class Codes: G06F 3/0641 De-duplication techniques
• CPC Class Codes: G06F 3/0688 Non-volatile semiconductor memory arrays
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

This storage device performs deduplication of eliminating duplicated data by storing a logical address of one or more corresponding logical unit memory areas in a prescribed management information storage area of a physical unit memory area defined in the storage area provided by the flash memory chip, and executes a reclamation process of managing a use degree as the total number of the logical addresses used stored in the management information storage area and a duplication degree as the number of valid logical addresses corresponding to the physical unit memory area for each of the physical unit memory areas, and returning the physical unit memory area to an unused status when the difference of the use degree and the duplication degree exceeds a default value in the physical unit memory area.

Claims

1. A flash memory controller for use in a flash memory module,

wherein the flash memory module includes at least one flash memory chip for providing a storage area, wherein the storage area includes a physical unit memory area, and wherein the physical unit memory area includes a prescribed management information storage area,

wherein the flash memory controller controls reading and writing of data from and into the at least one flash memory chip,

wherein the flash memory controller performs deduplication processing by storing logical addresses of one or more corresponding logical unit memory areas in the prescribed management information storage area, wherein the one or more logical unit memory areas are associated with the physical unit memory area, and

wherein the number of said physical unit memory areas storing identical data is defined as X, the total number of valid logical addresses stored in the management information storage areas of the physical unit memory areas storing the identical data is defined as Y, the maximum number of said logical addresses that can be stored in the management information storage area is defined as n, and the smallest integer not less than (Y/n) is defined as Z,

wherein if a difference of X and Z is equal or greater than a prescribed value, the flash memory controller eliminates duplicated data by storing the identical data to unused physical unit memory areas, in which a number of the unused physical unit memory areas is equal to Z.

2. The flash memory controller according to claim 1,

wherein the physical unit memory area is a unit for collectively erasing data;

and

wherein the flash memory controller performs the deduplication processing with the physical unit memory area as the unit.

3. The flash memory controller according to claim 1,

wherein the flash memory controller overwrites a logical address that was invalidated among the logical addresses stored in the management information storage area with 0.

4. The flash memory controller according to claim 1,

wherein the physical unit memory area is a sub block configured from at least one page as a unit for reading and writing data in a physical block as a unit for collectively erasing data.

5. The flash memory controller according to claim 1,

wherein the flash memory controller executes a reclamation process that includes:

managing a use degree as the total number of the logical addresses stored in the prescribed management information storage area and a duplication degree as the number of valid logical addresses stored in the prescribed management information storage area, and

returning the physical unit memory area to an unused status when a difference of the use degree and the duplication degree exceeds a prescribed value in the physical unit memory area.

6. A flash memory controller for use in a flash memory module,

wherein the flash memory module includes at least one flash memory chip for providing a storage area, wherein the storage area includes a physical unit memory area, and wherein the physical unit memory area includes a prescribed management information storage area,

wherein the flash memory controller controls reading and writing of data from and into the at least one flash memory chip,

wherein the flash memory controller performs deduplication processing by storing logical addresses of one or more corresponding logical unit memory areas in the prescribed management information storage area, wherein the one or more logical unit memory areas are associated with the physical unit memory area, and

wherein the flash memory controller eliminates duplicated data by

selecting a first physical unit memory area with the largest unused management information storage area for the logical address and

selecting a second physical unit memory area with the smallest unused management information storage area for the logical address and the smallest number of valid logical addresses stored in the management information storage area among a plurality of the physical unit memory areas storing identical data, and

copying valid logical addresses stored in the management information storage area of the second physical unit memory area to an unused area of the management information storage area of the first physical unit memory area when the number of unused management information storage areas for the logical address of the first physical unit memory area is equal or greater than the number of the valid logical addresses stored in the management information storage area of the second physical unit memory area.

7. The flash memory controller according to claim 6,

wherein the flash memory controller executes a reclamation process that includes:

managing a use degree as the total number of the logical addresses stored in the prescribed management information storage area and a duplication degree as the number of valid logical addresses stored in the prescribed management information storage area, and

returning the physical unit memory area to an unused status when a difference of the use degree and the duplication degree exceeds a prescribed value in the physical unit memory area.

8. A method for use in a flash memory controller in a flash memory module,

wherein the flash memory module includes at least one flash memory chip for providing a storage area, wherein the storage area includes a physical unit memory area, and wherein the physical unit memory area includes a prescribed management information storage area,

wherein the method comprises:

the flash memory controller performing deduplication processing by storing logical addresses of one or more corresponding logical unit memory areas in the prescribed management information storage area, wherein the one or more logical unit memory areas are associated with the physical unit memory area;

wherein the number of said physical unit memory areas storing identical data is defined as X, the total number of valid logical addresses stored in the management information storage areas of the physical unit memory areas storing the identical data is defined as Y, the maximum number of said logical addresses that can be stored in the management information storage area is defined as n, and the smallest integer not less than (Y/n) is defined as Z,

wherein if a difference of X and Z is equal or greater than a prescribed value, the flash memory controller eliminates duplicated data by storing the identical data to unused physical unit memory areas, in which a number of the unused physical unit memory areas is equal to Z.

9. The method according to claim 8,

wherein the physical unit memory area is a unit for collectively erasing data;

and

wherein the deduplication processing is performed with the physical unit memory area as the unit.

10. The method according to claim 8,

wherein, a logical address that was invalidated among the logical addresses stored in the management information storage area is overwritten with 0.

11. The method according to claim 8,

wherein the physical unit memory area is a sub block configured from at least one page as a unit for reading and writing data in a physical block as a unit for collectively erasing data.

12. The method according to claim 8, further comprising

a second step of the flash memory controller executing a reclamation process that includes:

managing a use degree as the total number of the logical addresses used stored in the prescribed management information storage area;

managing a duplication degree as the number of valid logical addresses stored in the prescribed management information storage area; and

returning the physical unit memory area to an unused status when a difference of the use degree and the duplication degree exceeds a prescribed value in the physical unit memory area.

13. A method for use in a flash memory controller in a flash memory module,

wherein the flash memory module includes at least one flash memory chip for providing a storage area, wherein the storage area includes a physical unit memory area, and wherein the physical unit memory area includes a prescribed management information storage area,

wherein the method comprises:

a step of the flash memory controller performing deduplication processing by storing logical addresses of one or more corresponding logical unit memory areas in the prescribed management information storage area, wherein the one or more logical unit memory areas are associated with the physical unit memory area;

wherein at the step, duplicated data is eliminated by

selecting a first physical unit memory area with the largest unused management information storage area for the logical address,

selecting a second physical unit memory area with the smallest unused management information storage area for the logical address and the smallest number of valid logical addresses stored in the management information storage area among a plurality of the physical unit memory areas storing identical data, and

copying valid logical addresses stored in the management information storage area of the second physical unit memory area to an unused area of the management information storage area of the first physical unit memory area when the number of unused management information storage areas for the logical address of the first physical unit memory area is equal or greater than the number of the valid logical addresses stored in the management information storage area of the second physical unit memory area.

14. The method according to claim 13,

wherein the flash memory controller executes a reclamation process that includes:

managing a use degree as the total number of the logical addresses stored in the prescribed management information storage area and a duplication degree as the number of valid logical addresses stored in the prescribed management information storage area, and

returning the physical unit memory area to an unused status when a difference of the use degree and the duplication degree exceeds a prescribed value in the physical unit memory area.