TRANSACTION ENCODING AND TRANSACTION PERSISTENCE ACCORDING TO TYPE OF PERSISTENT STORAGES

• US 20190325048A1
• Filed: 04/20/2018
• Published: 10/24/2019
• Est. Priority Date: 04/20/2018
• Status: Active Grant

• Current Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Original Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Inventors: WATKINS, Glenn S., Czerkowicz, John Michael
• Granted Patent: US 10,997,153 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/2358 Change logging, detection, and notification replication G06F16/27
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/9024 Graphs; Linked lists G06F16/9027 takes precedence

Abstract

In example implementations, a system may receive an input/output (I/O) operation in an object store storing a first object, determine objects represented in the object store affected by storing the first object, transcode the I/O operation into a transaction including the linked list of updates to objects represented in the object store, determine a persistent storage for storing the transaction and persist the transaction to the persistent storage according to a data structure determined by the type of persistent storage.

Claims

1. A non-transitory computer-readable medium comprising instructions executable by a processor to:

receive an input/output (I/O) operation in an object store storing a first object;

determine objects represented in the object store affected by storing the first object;

transcode the I/O operation into a transaction including a linked list of updates to the determined objects;

determine a persistent storage for storing the transaction;

determine a type of the persistent storage; and

persist the transaction to the persistent storage according to a data structure determined by the type of the persistent storage.

2. The non-transitory computer-readable medium of claim 1, wherein the instructions to persist the transaction to the persistent storage comprise:

decode the transaction to determine from the linked list of updates an update to an associated object represented in the object store;

determine whether a prior transaction affects the associated object;

based on a determination that the prior transaction affects the associated object, determine a sequence for persisting the transaction and the prior transaction; and

persist the transaction and the prior transaction based on the determined sequence.

3. The non-transitory computer-readable medium of claim 1, wherein the instructions to persist the transaction to the persistent storage comprise:

decode the transaction to determine from the linked list of updates an update to an associated object represented in the object store;

determine whether a prior transaction affects the associated object in the linked list of objects; and

based on a determination that the prior transaction affects the associated object, delay persisting the transaction to the persistent storage until the prior transaction is persisted.

4. The non-transitory computer-readable medium of claim 1, wherein the instructions to persist the transaction to the persistent storage comprise:

store a log of containing the transaction and a prior transaction in a buffer; and

persist the log to the persistent storage.

5. The non-transitory computer-readable medium of claim 4, wherein the buffer is distinct from the persistent storage.

6. The non-transitory computer-readable medium of claim 1, wherein the instructions to persist the transaction to the persistent storage comprise:

determine a log that represents changes between the transaction and a prior transaction stored in the persistent storage;

store the log in a buffer; and

persist the log to the persistent storage.

7. The non-transitory computer-readable medium of claim 1, wherein the instructions to persist the transaction comprise:

store the linked list of updates in a temporary staging area in the persistent storage;

determine changes between the linked list of updates and a prior linked list of updates in the persistent storage; and

persist the determined changes in the persistent storage.

8. The non-transitory computer-readable medium of claim 1, wherein a transaction comprises:

an indivisible set of updates to objects represented in the object store to maintain Atomicity, Consistency, Isolation, Durability (ACID) properties in the object store.

9. The non-transitory computer-readable medium of claim 1, comprising instructions executable by a processor to:

determine whether the transaction is called back before the transaction is persisted on the determined persistent storage; and

in response to a determination that the transaction is called back before the transaction is persisted, rollback any updates to the persistent storage.

10. A method executed by a processor comprising:

receiving an I/O operation in an object store;

determining a linked list of updates affected by the I/O operation;

transcoding the I/O operation into a transaction including the linked list of updates;

determining a persistent storage for storing the transaction;

determining a type of the persistent storage; and

persisting the linked list of updates in the transaction to the determined persistent storage according to the type of the persistent storage.

11. The method of claim 10, comprising:

decoding the transaction to determine from the linked list of updates an update to an associated object represented in the object store;

determining whether a prior transaction affects the associated object;

based on a determination that the prior transaction affects the associated object, determining a sequence for persisting the transaction and the prior transaction; and

persisting the transaction and the prior transaction based on the determined sequence.

12. The method of claim 10, comprising:

decoding the transaction to determine from the linked list of updates an update to an associated object represented in the object store;

determining whether a prior transaction affects the associated object; and

based on a determination that the prior transaction affects the associated object, delay persisting the transaction to the persistent storage until the prior transaction is persisted.

13. The method of claim 10 comprising:

store one or more transactions in a buffer;

determine a log that represents changes between the one or more transactions in the buffer and a prior log stored in the persistent storage; and

persist the log to the persistent storage.

14. The method of claim 10 comprising:

storing the linked list of updates in a temporary staging area;

determining changes between the linked list of updates and updates in the persistent storage; and

persisting the determined changes in the persistent storage.

15. The method of claim 10 comprising:

decode the transaction to determine from the linked list of updates an update to an associated object represented in the object store;

determine whether a prior transaction affects the associated object;

based on a determination that the prior transaction affects the associated object in the linked list of updates, determine a sequence for persisting the transaction and the prior transaction; and

persist the transaction and the prior transaction based on the determined sequence.

16. A system comprising:

a plurality of network nodes, wherein each node comprises;

a processor;

an object store to store updates; and

a memory to store machine readable instructions, wherein the processor is to execute the machine-readable instructions to;

receive an I/O operation;

determine a linked list of updates in the object store affected by the I/O operation, wherein the I/O stores a first object in the object store;

transcode the I/O operation into a transaction including the linked list of updates affected by storing the first object;

determine a persistent storage for storing the transaction;

determine a type of the persistent storage; and

persist the transaction to the persistent storage according to a data structure determined by the type of the persistent storage.

17. The system of claim 16, wherein the instructions to persist the transaction comprise:

decode the transaction to determine from the linked list of updates an update to an associated object represented in the object store;

determine whether a prior transaction affects the associated object; and

based on a determination that the prior transaction affects the object in the linked list of updates, delay persisting the transaction to the persistent storage until the prior transaction is persisted.

18. The system of claim 16, wherein the instructions to persist the transaction comprise:

decode the transaction to determine from the linked list of updates an update to an associated object represented in the object store;

determine whether a prior transaction affects the associated object in the linked list of updates;

based on a determination that the prior transaction affects the associated object, determine a sequence for persisting the transaction and the prior transaction; and

persist the transaction and the prior transaction based on the determined sequence.

19. The system of claim 16, wherein the instructions to persist the transaction comprise:

store one or more transactions in a buffer;

determine a log that represents changes between the one or more transactions in the buffer and a prior log stored in the persistent storage; and

persist the log to the persistent storage.

20. The system of claim 16, wherein the instructions to persist the transaction comprise:

storing the linked list of updates in a temporary staging area;

determining changes between the linked list of updates and prior updates stored on the persistent storage; and

persisting the determined changes in the persistent storage.