Cache management including solid state device virtualization

• US 9,323,659 B2
• Filed: 08/10/2012
• Issued: 04/26/2016
• Est. Priority Date: 08/12/2011
• Status: Active Grant

• Current Assignee: SanDisk Technologies LLC (Western Digital Corporation)
• Original Assignee: SanDisk Enterprise IP LLC (Western Digital Corporation)
• Inventors: Shats, Serge, Sanford, Steven Ted
• Primary Examiner(s): BRAGDON, REGINALD GLENWOOD
• Assistant Examiner(s): Knight, Paul
• Application Number:
  US13/572,486
• Publication Number:
  US 20130042056A1
• Time in Patent Office: 1,355 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 12/0246 in block erasable memory, e.g. flash memory
• CPC Class Codes: G06F 12/0804 with main memory updating G06F12/0806 takes precedence
• CPC Class Codes: G06F 12/0871 Allocation or management of cache space
• CPC Class Codes: G06F 2212/1016 Performance improvement
• CPC Class Codes: G06F 2212/1044 Space efficiency improvement
• CPC Class Codes: G06F 2212/222 Non-volatile memory
• CPC Class Codes: G06F 2212/7201 Logical to physical mapping or translation of blocks or pages
• CPC Class Codes: G06F 2212/7204 Capacity control, e.g. partitioning, end-of-life degradation
• CPC Class Codes: G06F 2212/7207 management of metadata or control data

Abstract

A method of caching data is performed by a respective computer having one or more processors storing one or more storage management programs for execution by the one or more processors, non-volatile secondary storage and non-volatile cache memory. The method includes receiving from the non-volatile cache memory information identifying an amount of available storage in the non-volatile cache memory, and identifying a size of the management units in the non-volatile cache memory. The method further includes identifying write requests to write data to the non-volatile cache memory, sequentially writing to the non-volatile cache memory the write data for the identified write requests, to sequentially arranged locations in an address space of the non-volatile cache memory, and storing in memory metadata that maps the addresses or storage offsets of the write data to respective locations in the address space of the non-volatile cache memory.

Claims

1. A method of caching data in a computer system having one or more processors, memory storing one or more storage management programs for execution by the one or more processors, non-volatile cache memory, and an interface to a non-volatile secondary storage, the method comprising:

identifying two or more write requests to write data, wherein each write request of the two or more identified write requests includes an address or storage offset in the non-volatile secondary storage and write data;

sequentially writing the write data for the two or more identified write requests to sequential locations in the non-volatile cache memory; and

storing metadata, in the memory of the computer system, that maps the addresses or storage offsets in the non-volatile secondary storage for the write data corresponding to the two or more identified write requests to the sequential locations in the non-volatile cache memory;

wherein the memory of the computer system is distinct from the non-volatile secondary storage and distinct from the non-volatile cache memory, and the non-volatile secondary storage is distinct from the non-volatile cache memory,

the method further comprising;

maintaining, at the computer system, a write pointer corresponding to a boundary of an unused region of the non-volatile cache memory, a clean pointer corresponding to a boundary of a clean region of the non-volatile cache memory, the clean region storing data that has been flushed to the non-volatile secondary storage and that can be read from the non-volatile cache memory by the computer system, and a flush pointer corresponding to a boundary between the clean region and a dirty region of the non-volatile cache memory, the dirty region storing data that has not been flushed to the non-volatile secondary storage and that can be read from the non-volatile cache memory by the computer system, wherein the, write, clean, and flush pointers identify distinct locations in the non-volatile cache memory; and

wherein maintaining the write pointer includes advancing the write pointer as write data is sequentially written to the non-volatile cache memory,

the method further including;

receiving information identifying an amount of available storage in the non-volatile cache memory and information identifying a size of the address space of the non-volatile cache memory and an amount of said address space corresponding to unavailable management units in the non-volatile cache memory;

wherein

the size of said address space of the non-volatile cache memory remains fixed throughout performance of the method; and

said maintaining further comprises maintaining said pointers so as to maintain said unused region at a size that is greater than an amount of said address space corresponding to unavailable management units in the non-volatile cache memory.

2. The method of claim 1, wherein identifying write requests to write data to the non-volatile cache memory comprises:

receiving write requests to write data to non-volatile storage, each write request including an address or storage offset and write data; and

identifying a subset of the received write requests in accordance with caching criteria.

3. The method of claim 1, wherein sequentially writing comprises sending write commands to a controller of the non-volatile cache memory identifying the sequential locations within the non-volatile cache memory, without regard to the addresses or storage offsets in the non-volatile secondary storage that are associated with the write data.

4. The method of claim 1, wherein said maintaining includes sending commands to the non-volatile cache memory to flush data in the dirty region of the non-volatile cache memory to said non-volatile secondary storage, and to advance the flush pointer, thereby moving a shared boundary of the clean and dirty regions.

5. The method of claim 1, wherein said maintaining includes sending commands to the non-volatile cache memory to invalidate data in the clean region of the non-volatile cache memory, and to advance the clean pointer, thereby moving a shared boundary of the clean and unused regions.

6. The method of claim 5, wherein the commands to invalidate data in the clean region comprise commands to erase corresponding management units in the non-volatile cache memory.

7. The method of claim 1, wherein the address space of the non-volatile cache memory comprises a contiguous virtual address space that is mapped by the non-volatile cache memory to physical memory in the non-volatile cache memory.

8. The method of claim 1, wherein the address space of the non-volatile cache memory comprises a virtual address space, and the address or storage offset in said identified write requests comprises addresses or offsets in an address space of the non-volatile secondary storage.

9. The method of claim 1, wherein the non-volatile cache memory comprises solid state storage.

10. The method of claim 1, wherein the non-volatile cache memory comprises flash memory.

11. The method of claim 1, wherein the non-volatile secondary storage comprises one or more hard disk storage devices.

12. A computer system, comprising:

memory storing one or more programs, the one or more programs including one or more storage management programs;

one or more processors for executing instructions in the one or more programs stored in memory;

an interface to non-volatile secondary storage; and

non-volatile cache memory, the non-volatile cache memory including a controller responsive to commands sent by the one or more processors of the computer system;

the one or more storage management programs comprising instructions that, when executed by the one or more processors, cause the computer system to;

identify two or more write requests to write data, wherein each write request of the two or more identified write requests includes an address or storage offset in the non-volatile secondary storage and write data;

sequentially write the write data for the two or more identified write requests to sequential locations in the non-volatile cache memory; and

store metadata, in the memory of the computer system, that maps the addresses or storage offsets in the non-volatile secondary storage for the write data corresponding to the two or more identified write requests to the sequential locations in the non-volatile cache memory;

wherein the memory of the computer system is distinct from the non-volatile secondary storage and distinct from the non-volatile cache memory, and the non-volatile secondary storage is distinct from the non-volatile cache memory,

the one or more storage management programs further comprising instructions that, when executed by the one or more processors, cause the computer system to;

maintain, at the computer system, a write pointer corresponding to a boundary of an unused region of the non-volatile cache memory, a clean pointer corresponding to a boundary of a clean region of the non-volatile cache memory, the clean region storing data that has been flushed to the non-volatile secondary storage and that can be read from the non-volatile cache memory by the computer system, and a flush pointer corresponding to a boundary between the clean region and a dirty region of the non-volatile cache memory, the dirty region storing data that has not been flushed to the non-volatile secondary storage and that can be read from the non-volatile cache memory by the computer system, wherein the, write, clean, and flush pointers identify distinct locations in the non-volatile cache memory; and

wherein maintaining the write pointer includes advancing the write pointer as write data is sequentially written to the non-volatile cache memory,

the one or more storage management programs further including instructions that, when executed by the one or more processors, cause the computer system to

receive information identifying an amount of available storage in the non-volatile cache memory and information identifying a size of the address space of the non-volatile cache memory and an amount of said address space corresponding to unavailable management units in the non-volatile cache memory;

wherein

the size of said address space of the non-volatile cache memory remains fixed; and

said maintaining further comprises maintaining said pointers so as to maintain said unused region at a size that is greater than an amount of said address space corresponding to unavailable management units in the non-volatile cache memory.

13. The computer system of claim 12, wherein identifying write requests to write data to the non-volatile cache memory comprises:

receiving write requests to write data to non-volatile storage, each write request including an address or storage offset and write data; and

identifying a subset of the received write requests in accordance with caching criteria.

14. The computer system of claim 12, wherein sequentially writing comprises sending write commands to the controller of the non-volatile cache memory identifying the sequential locations within the non-volatile cache memory, without regard to the addresses or storage offsets in the non-volatile secondary storage that are associated with the write data.

15. A non-volatile computer readable storage medium storing one or more storage management programs comprising instructions that, when executed by one or more processors of a computer system that includes the one or more processors, non-volatile secondary storage and non-volatile cache memory, the non-volatile cache memory including a controller responsive to commands sent by the one or more processors of the computer system, cause the computer system to:

identify two or more write requests to write data, wherein each write request of the two or more identified write requests includes an address or storage offset in the non-volatile secondary storage and write data;

sequentially write the write data for the two or more identified write requests to sequential locations in the non-volatile cache memory; and

store metadata, in the memory of the computer system, that maps the addresses or storage offsets in the non-volatile secondary storage for the write data corresponding to the two or more identified write requests to the sequential locations in the non-volatile cache memory;

wherein the memory of the computer system is distinct from the non-volatile secondary storage and distinct from the non-volatile cache memory, and the non-volatile secondary storage is distinct from the non-volatile cache memory,

the one or more storage management programs further comprising instructions that, when executed by the one or more processors, cause the computer system to;

maintain, at the computer system, a write pointer corresponding to a boundary of an unused region of the non-volatile cache memory, a clean pointer corresponding to a boundary of a clean region of the non-volatile cache memory, the clean region storing data that has been flushed to the non-volatile secondary storage and that can be read from the non-volatile cache memory by the computer system, and a flush pointer corresponding to a boundary between the clean region and a dirty region of the non-volatile cache memory, the dirty region storing data that has not been flushed to the non-volatile secondary storage and that can be read from the non-volatile cache memory by the computer system, wherein the, write, clean, and flush pointers identify distinct locations in the non-volatile cache memory; and

wherein maintaining the write pointer includes advancing the write pointer as write data is sequentially written to the non-volatile cache memory,

the one or more storage management programs further including instructions that, when executed by the one or more processors, cause the computer system to

receive information identifying an amount of available storage in the non-volatile cache memory and information identifying a size of the address space of the non-volatile cache memory and an amount of said address space corresponding to unavailable management units in the non-volatile cache memory;

wherein

the size of said address space of the non-volatile cache memory remains fixed; and

said maintaining further comprises maintaining said pointers so as to maintain said unused region at a size that is greater than an amount of said address space corresponding to unavailable management units in the non-volatile cache memory.

16. The non-volatile computer readable storage medium of claim 15, wherein identifying write requests to write data to the non-volatile cache memory comprises:

receiving write requests to write data to non-volatile storage, each write request including an address or storage offset and write data; and

identifying a subset of the received write requests in accordance with caching criteria.

17. The non-volatile computer readable storage medium of claim 15, wherein sequentially writing comprises sending write commands to the controller of the non-volatile cache memory identifying the sequential locations within the non-volatile cache memory, without regard to the addresses or storage offsets in the non-volatile secondary storage that are associated with the write data.