System and method for optimized management of operation data in a solid-state memory

• US 9,268,646 B1
• Filed: 12/21/2010
• Issued: 02/23/2016
• Est. Priority Date: 12/21/2010
• Status: Active Grant

• Current Assignee: JP Morgan Chase Bank, N.A. (JP Morgan Chase & Co)
• Original Assignee: Western Digital Technologies Incorporated (Western Digital Corporation)
• Inventors: Chiu, Lyndon S., Lo, Jerry
• Primary Examiner(s): Li, Aimee
• Assistant Examiner(s): Simonetti, Nicholas
• Application Number:
  US12/974,234
• Time in Patent Office: 1,890 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1435 using file system or storage system metadata
• CPC Class Codes: G06F 11/1438 Restarting or rejuvenating
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/0685 Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays

Abstract

Embodiments of the invention are directed to optimizing reconstruction of operation data in volatile memory of solid-state storage subsystems. In various embodiments, operation data is stored in the volatile memory with persistent backup data of the operation data in the non-volatile memory. In one embodiment, operation data includes a superblock table that is used to identify most or all groups of blocks (superblocks) within the storage device that certain firmware components operate on. Sometimes operation data in the volatile memory is lost or corrupted due to a power interruption or system shutdown. To optimize the reconstruction of the superblock table or other similar operation data in the volatile memory, embodiments of the invention use a “snapshot entry” to identify the latest entry information, allowing the controller to quickly identify the most updated physical locations of the operation data portions and complete the reconstruction in an efficient manner.

Claims

1. A method of managing operation data in a non-volatile solid-state storage subsystem, the method comprising:

maintaining a data table in a volatile memory of the solid-state storage subsystem, the data table including information related to a plurality of logical groupings of memory blocks in a non-volatile memory array of the solid-state storage subsystem, the data table used by a controller of the solid-state storage subsystem to control memory access operations;

storing a first plurality of portions of the data table in the non-volatile memory array, at least one portion reflecting an update to the data table that renders outdated a previous update to a portion of the data table;

creating a plurality of snapshots of the data table portions stored in the non-volatile memory array, a snapshot of the plurality of snapshots comprising information related to a plurality of physical memory locations in which the updated data table portions are stored at a time of creation of the snapshot, wherein the snapshot is stored in a separate memory location in the non-volatile memory array from the data table portions and does not comprise data of the data table portions;

storing a second plurality of portions of the data table in the non-volatile memory array, the second plurality of portions of the data table reflecting updates to the data table that occurred after the time of creation of a most recently created snapshot; and

following an intervening power loss event that causes the data table to be lost from the volatile memory;

using the most recently created snapshot to locate at least some data table portions of the first plurality of portions of the data table in the non-volatile memory array,

traversing from the most recently updated snapshot forward to locate the second plurality of portions of the data table, and

using the located at least some data table portions and the second plurality of portions of the data table to reconstruct the data table in the volatile memory.

2. The method of claim 1, wherein information in the snapshot comprises:

data related to a physical location for each portion of the data table stored in the non-volatile memory array; and

a data signature for the physical location data, wherein the data signature is configured to identify the data related to the physical location for each portion of the data table as snapshot data to be used for reconstructing the data table following the loss of the data table from the volatile memory.

3. The method of claim 1, wherein the portions of the data table are stored in a superblock.

4. The method of claim 1, wherein data indicating a most recently created snapshot is stored in a master boot record of the non-volatile memory array.

5. The method of claim 1, wherein the plurality of snapshots are created periodically after a pre-defined number of data table portions are stored in the non-volatile memory array.

6. The method of claim 5, wherein the pre-defined number of stored data table portions is determined based at least in part on a desired amount of write amplification.

7. The method of claim 1, wherein the portions of the data table are stored in a first superblock, the first superblock comprising current and outdated portions of the data table, the method further comprising:

recreating an updated copy of the data table in a second superblock, the recreating comprises using a most recently created one of the snapshots to locate the current portions of the data table; and

releasing the first superblock for garbage collection.

8. A storage subsystem comprising:

a non-volatile memory array;

a volatile memory configured to store a data table, the data table including information related to a plurality of logical groupings of memory blocks in the non-volatile memory array of the storage subsystem;

a controller configured to;

store a first plurality of portions of the data table in the non-volatile memory array, at least one portion reflecting an update to the data table that renders outdated a previous update to a portion of the data table;

create a plurality of snapshots of the data table portions stored in the non-volatile memory array, a snapshot of the plurality of snapshots comprising information related to a plurality of physical memory locations in which the updated data table portions are stored at a time of creation of the snapshot, wherein the snapshot is stored in a separate memory location in the non-volatile memory array from the data table portions and does not comprise data of the data table;

store a second plurality of portions of the data table in the non-volatile memory array, the second plurality of portions of the data table reflecting updates to the data table that occurred after the time of creation of a most recently created snapshot; and

reconstruct, as part of a recovery process, the data table in the volatile memory by at least;

using the most recently created snapshot to locate at least some data table portions of the first plurality of portions of the data table in the non-volatile memory array,

traversing from the most recently updated snapshot forward to locate the second plurality of portions of the data table, and

using the located at least some data table portions and the second plurality of portions of the data table to reconstruct the data table in the volatile memory.

9. The storage subsystem of claim 8, wherein information in the snapshot comprises:

data related to a physical location for each portion of the data table stored in the non-volatile memory array; and

a data signature for the physical location data, wherein the data signature is configured to identify the data related to the physical location for each portion of the data table as snapshot data to be used for reconstructing the data table during the recovery process.

10. The storage subsystem of claim 8, wherein the portions of the data table are stored in a superblock.

11. The storage subsystem of claim 8, wherein data indicating the most recently created snapshot is stored in a master boot record of the non-volatile memory array.

12. The storage subsystem of claim 8, wherein the controller is further configured to create the plurality of snapshots periodically after a pre-defined number of data table portions are stored in the non-volatile memory array.

13. The storage subsystem of claim 12, wherein the pre-defined number of stored data table portions is determined based at least in part on a desired amount of write amplification.

14. The storage subsystem of claim 8, wherein the portions of the data table are stored in a first superblock, the first superblock comprising current and outdated portions of the data table, and wherein the controller is further configured to:

recreate an updated copy of the data table in a second superblock using a most recently created one of the snapshots to locate the current portions of the data table; and

release the first superblock for garbage collection.

15. A method of managing operation data in a non-volatile solid-state storage subsystem, the method comprising:

maintaining a data table in a volatile memory of the solid-state storage subsystem, the data table including operation data for the solid-state storage subsystem;

moving a first plurality of portions of the data table to a non-volatile memory of the solid-state storage subsystem, at least one portion reflecting an update to the data table that renders outdated a previous update to a portion of the data table;

storing a plurality of location data, wherein a location data of the plurality of location data is related to a plurality of physical memory locations in which portions of the updated data table are stored, the location data not comprising data of the data table, the location data stored in a single memory location of the non-volatile memory and in a separate data entry from the data of the data table;

moving a second plurality of portions of the data table to the non-volatile memory, the second plurality of portions of the data table reflecting updates to the data table that occurred after the time of creation of a most recently stored location data; and

using the physical memory location data to reconstruct the data table in the volatile memory, the reconstruction comprising;

using the most recently stored location data to locate at least some data table portions of the first plurality of portions of the data table in the non-volatile memory,

traversing from the most recently stored location data forward to locate the second plurality of portions of the data table, and

using the located at least some data table portions and the second plurality of portions of the data table to reconstruct the data table in the volatile memory.

16. A storage subsystem comprising:

a non-volatile memory array;

a volatile memory configured to store a data table that comprises operation data for the storage subsystem;

a controller configured to;

store a first plurality of portions of the data table to the non-volatile memory array, at least one portion reflecting an update to the data table that renders outdated a previous update to a portion of the data table;

store a plurality of location data, wherein a location data of the plurality of location data is related to a plurality of physical memory locations in which portions of the updated data table are stored, the location data not comprising data of the data table, the location data stored in a single memory location of the non-volatile memory array and in a separate data entry from the data of the data table;

store a second plurality of portions of the data table to the non-volatile memory array, the second plurality of portions of the data table reflecting updates to the data table that occurred after the time of creation of a most recently stored location data; and

use the location data to reconstruct the data table in the volatile memory, the controller further configured to;

use the most recently stored location data to locate at least some data table portions of the first plurality of portions of the data table in the non-volatile memory array,

traverse from the most recently stored location data forward to locate the second plurality of portions of the data table, and

use the located at least some data table portions and the second plurality of portions of the data table to reconstruct the data table in the volatile memory.