Transaction log acceleration

• US 10,009,438 B2
• Filed: 06/06/2015
• Issued: 06/26/2018
• Est. Priority Date: 05/20/2015
• Status: Active Grant

• Current Assignee: SanDisk Technologies LLC (Western Digital Corporation)
• Original Assignee: SanDisk Technologies LLC (Western Digital Corporation)
• Inventors: Das, Dhananjoy
• Primary Examiner(s): Truong, Lan-Dai T
• Application Number:
  US14/732,675
• Publication Number:
  US 20160344834A1
• Time in Patent Office: 1,116 Days
• Field of Search: 709213, 709212, 709223, 709224, 709216
• CPC Class Codes: G06F 11/14 Error detection or correction of the data by redundancy in operation G06F11/16 takes precedence
• CPC Class Codes: G06F 11/1441 Resetting or repowering
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 11/1474 in transactions G06F16/20 takes precedence
• CPC Class Codes: G06F 11/16 Error detection or correction of the data by redundancy in hardware
• CPC Class Codes: G06F 11/2015 Redundant power supplies power supply failure G06F1/30
• CPC Class Codes: G06F 11/3006 where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems multiprogramming arrangements G06F9/46; allocation of resources G06F9/50
• CPC Class Codes: G06F 11/3034 where the computing system component is a storage system, e.g. DASD based or network based digital input from or digital output to record carriers G06F3/06; digital recording or reproducing G11B20/18; for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: G06F 11/3072 where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting
• CPC Class Codes: G06F 11/3476 Data logging G06F11/14, G06F11/2205 take precedence
• CPC Class Codes: G06F 2201/87 Monitoring of transactions
• CPC Class Codes: G06F 9/466 Transaction processing
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

Apparatuses, systems, methods, and computer program products are disclosed for transaction log acceleration. A log module is configured to determine transaction log records indicating a sequence of operations performed on data. A commit module is configured to send transaction log records to one or more volatile memory pages accessible over a network. Volatile memory pages are configured to ensure persistence of transaction log records. A storage module is configured to send transaction log records to a non-volatile storage device in response to an acknowledgment that one or more volatile memory pages store the transaction log records.

Claims

1. A system comprising:

a non-volatile storage device configured to be in communication with a storage client executing on a host computing device, wherein the non-volatile storage device comprises;

a non-volatile storage medium; and

a volatile memory buffer configured to;

receive transaction log entries of the storage client over the network,

store the transaction log entries in the non-volatile storage medium in response to a trigger,

retrieve one or more of the transaction log entries from the non-volatile storage medium in response to receiving an identifier from the storage client after the trigger,

facilitate sending the retrieved one or more of the transaction log entries to the storage client, and

facilitate sending the retrieved one or more of the transaction log entries from the storage client to a second non-volatile storage device over the network; and

a controller for the non-volatile storage device, the controller configured to;

execute on the host computing device,

filter the transaction log entries sent to a different location, and

re-route the transaction log entries to the volatile memory buffer.

2. The system of claim 1, wherein the controller is further configured to send the transaction log entries to the second non-volatile storage device in response to the transaction log entries being received by the volatile memory buffer.

3. The system of claim 1, wherein the storage client is configured to send the transaction log entries to the different location, the different location comprising the second non-volatile storage device.

4. The system of claim 1, wherein the non-volatile storage device is further configured to clear the transaction log entries from the non-volatile storage device in response to the second non-volatile storage device receiving the transaction log entries.

5. The system of claim 1, wherein:

the host computing device comprises no non-volatile storage; and

the transaction log entries are sent to the volatile memory buffer of the non-volatile storage device from volatile memory of the host computing device.

6. The system of claim 1, wherein:

the host computing device comprises local non-volatile storage; and

storing data in the volatile memory buffer of the non-volatile storage device over the network has a lower latency than storing data in the local non-volatile storage.

7. The system of claim 1, further comprising a secondary power source for the non-volatile storage device, wherein:

the secondary power source is configured to provide a power hold-up time to the non-volatile storage device after the trigger; and

the volatile memory buffer is further configured to store the transaction log entries in the non-volatile storage medium during the power hold-up time.

8. The system of claim 1, wherein the volatile memory buffer is further configured to:

receive different transaction log entries of multiple different storage clients over the network; and

associate the different transaction log entries in the volatile memory buffer and in the non-volatile storage medium with identifiers of the multiple different storage clients.

9. The system of claim 1, wherein the trigger comprises electrical power for the non-volatile storage device failing to satisfy a threshold.

10. An apparatus comprising:

a non-volatile storage device configured to be in communication, over a network, with a storage client executing on a host device, wherein the non-volatile storage device comprises;

a non-volatile storage medium; and

a volatile memory buffer configured to;

receive transaction log entries of the storage client over the network,

store the transaction log entries in the non-volatile storage medium in response to a trigger,

retrieve one or more of the transaction log entries from the non-volatile storage medium in response to receiving an identifier from the storage client after the trigger,

facilitate sending the retrieved one or more of the transaction log entries to the storage client, and

facilitate sending the retrieved one or more of the transaction log entries from the storage client to a second non-volatile storage device over the network,

wherein;

the host computing device comprises local non-volatile storage, and

storing data in the volatile memory buffer of the non-volatile storage device over the network has a lower latency than storing data in the local non-volatile storage.

11. The apparatus of claim 10, wherein the non-volatile storage device is further configured to clear the transaction log entries from the non-volatile storage device in response to the second non-volatile storage device receiving the transaction log entries.

12. The apparatus of claim 10, further comprising a secondary power source for the non-volatile storage device, wherein:

the secondary power source is configured to provide a power hold-up time to the non-volatile storage device after the trigger; and

the volatile memory buffer is further configured to store the transaction log entries in the non-volatile storage medium during the power hold-up time.

13. The apparatus of claim 10, wherein the volatile memory buffer is further configured to:

receive different transaction log entries of multiple different storage clients over the network; and

associate the different transaction log entries in the volatile memory buffer and in the non-volatile storage medium with identifiers of the multiple different storage clients.

14. The apparatus of claim 10, wherein the trigger comprises electrical power for the non-volatile storage device failing to satisfy a threshold.

15. An apparatus comprising:

a non-volatile storage device configured to be in communication with a storage client over a network, wherein the non-volatile storage device comprises;

a non-volatile storage medium; and

a volatile memory buffer configured to;

receive transaction log entries of the storage client over the network,

store the transaction log entries in the non-volatile storage medium in response to a trigger,

retrieve one or more of the transaction log entries from the non-volatile storage medium in response to receiving an identifier from the storage client after the trigger,

facilitate sending the retrieved one or more of the transaction log entries to the storage client, and

facilitate sending the retrieved one or more of the transaction log entries from the storage client to a second non-volatile storage device over the network; and

a secondary power source for the non-volatile storage device, the secondary power source configured to provide a power hold-up time to the non-volatile storage device after the trigger,

wherein the volatile memory buffer is further configured to store the transaction log entries in the non-volatile storage medium during the power hold-up time.

16. The apparatus of claim 15, wherein the non-volatile storage device is further configured to clear the transaction log entries from the non-volatile storage device in response to the second non-volatile storage device receiving the transaction log entries.

17. The apparatus of claim 15, wherein:

a host computing device configured to execute the storage client comprises no non-volatile storage; and

the transaction log entries are sent to the volatile memory buffer of the non-volatile storage device from volatile memory of the host computing device.

18. The apparatus of claim 15, wherein:

a host computing device configured to execute the storage client comprises local non-volatile storage; and

storing data in the volatile memory buffer of the non-volatile storage device over the network has a lower latency than storing data in the local non-volatile storage.

19. The apparatus of claim 15, wherein the volatile memory buffer is further configured to:

receive different transaction log entries of multiple different storage clients over the network; and

associate the different transaction log entries in the volatile memory buffer and in the non-volatile storage medium with identifiers of the multiple different storage clients.

20. The apparatus of claim 15, wherein the trigger comprises electrical power for the non-volatile storage device failing to satisfy a threshold.