ZONE STORAGE - RESILIENT AND EFFICIENT STORAGE TRANSACTIONS

• US 20190320023A1
• Filed: 06/28/2019
• Published: 10/17/2019
• Est. Priority Date: 02/20/2017
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Baptist, Andrew D., Dhuse, Greg R., Khadiwala, Ravi V., Motwani, Manish, Viraraghavan, Praveen, Volvovski, Ilya
• Granted Patent: US 10,904,337 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 12/0802 Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
• CPC Class Codes: G06F 2212/60 Details of cache memory
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0644 Management of space entities, e.g. partitions, extents, pools
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H03M 13/1515 Reed-Solomon codes
• CPC Class Codes: H03M 13/616 Matrix operations, especially for generator matrices or check matrices, e.g. column or row permutations
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A distributed storage network (DSN) includes a DSN memory and a distributed storage (DS) processing unit. The DS processing unit determines a particular revision of source data for persistence, and generates a protocol message associated with the particular revision of source data. The protocol message is generated based on a balance between durability and persistence associated with the particular revision. The protocol message is transmitted from the DS processing unit to the DSN memory, and indicates to the DSN memory a particular persistence protocol. The DSN memory process data slices corresponding to the particular revision of source data in accordance with the particular persistence protocol.

Claims

1. A method for use in a distributed storage network (DSN) including a DSN memory and a distributed storage (DS) processing unit, the method comprising:

receiving, at the DSN memory, a protocol message transmitted by the DS processing unit, the protocol message indicating a particular persistence protocol to be applied to a particular revision of source data, wherein the particular persistence protocol is selected from among of a plurality of different persistence protocols implementing different balances between durability and persistence;

obtaining, at the DSN memory, write data having the particular revision of source data indicated by the protocol message; and

storing the write data using the particular persistence protocol as indicated by the protocol message.

2. The method of claim 1, wherein the particular persistence protocol includes:

information instructing the DSN memory to make the particular revision of source data visible to subsequent requests without guaranteeing persistence of the particular revision of source data.

3. The method of claim 1, wherein the protocol message includes:

a dispersal encoded data slice associated with the particular revision of source data.

4. The method of claim 1, wherein the particular persistence protocol includes:

information instructing the DSN memory to make the particular revision of source data fully durable.

5. The method of claim 4, wherein the protocol message includes:

a versioned slice name of a dispersal encoded data slice associated with the particular revision of source data; and

information instructing the DSN memory to transmit an acknowledgement message to the DS processing unit indicating that the particular revision of source data has been flushed to persistent storage.

6. The method of claim 5, wherein the protocol message further includes:

information instructing the DSN memory to remove data slices associated with other revisions of the source data, wherein the other revisions have been stored in a cache memory.

7. The method of claim 1, wherein the particular persistence protocol includes:

information instructing the DSN memory to;

remove previously stored versions of the source data, other than the particular revision of source data; and

clean up temporary transactions related to the particular revision of source data.

8. A distributed storage network (DSN) memory comprising:

a processor;

memory operably associated with the processor;

a program of instructions configured to be stored in the memory and executed by the processor, the program of instructions including;

at least one instruction to receive, at the DSN memory, a protocol message transmitted by a distributed storage (DS) processing unit, the protocol message indicating a particular persistence protocol to be applied to a particular revision of source data, wherein the particular persistence protocol is selected from among of a plurality of different persistence protocols implementing different balances between durability and persistence;

at least one instruction to obtain, at the DSN memory, write data having the particular revision of source data indicated by the protocol message; and

at least one instruction to store the write data using the particular persistence protocol as indicated by the protocol message.

9. The DSN memory of claim 8, wherein the particular persistence protocol includes:

information instructing the DSN memory to make the particular revision of source data visible to subsequent requests without guaranteeing persistence of the particular revision of source data.

10. The DSN memory of claim 8, wherein the protocol message includes:

a dispersal encoded data slice associated with the particular revision of source data.

11. The DSN memory of claim 8, wherein the particular persistence protocol includes:

information instructing the DSN memory to make the particular revision of source data fully durable.

12. The DSN memory of claim 11, wherein the protocol message includes:

a versioned slice name of a dispersal encoded data slice associated with the particular revision of source data; and

information instructing the DSN memory to transmit an acknowledgement message to the DS processing unit indicating that the particular revision of source data has been flushed to persistent storage.

13. The DSN memory of claim 12, wherein the protocol message further includes:

information instructing the DSN memory to remove data slices associated with other revisions of the source data, wherein the other revisions have been stored in a cache memory.

14. The DSN memory of claim 8, wherein the particular persistence protocol includes:

information instructing the DSN memory to;

remove previously stored versions of the source data, other than the particular revision of source data; and

clean up temporary transactions related to the particular revision of source data.

15. A distributed storage network (DSN) comprising:

a DSN memory including a plurality of storage units and a first computing core;

a distributed storage (DS) processing unit coupled to the DSN memory via a communications network, and configured transmit, to the DSN memory, a protocol message indicating a particular persistence protocol to be applied to a particular revision of source data, wherein the particular persistence protocol is selected from among of a plurality of different persistence protocols implementing different balances between durability and persistence;

the DSN memory configured to;

receive the protocol message;

obtain write data having the particular revision of source data indicated by the protocol message; and

store the write data using the particular persistence protocol as indicated by the protocol message.

16. The DSN of claim 15, wherein the particular persistence protocol includes:

information instructing the DSN memory to make the particular revision of source data visible to subsequent requests without guaranteeing persistence of the particular revision of source data.

17. The DSN of claim 15, wherein the protocol message includes:

a dispersal encoded data slice associated with the particular revision of source data.

18. The DSN of claim 15, wherein the particular persistence protocol includes:

information instructing the DSN memory to make the particular revision of source data fully durable.

19. The DSN of claim 18, wherein the protocol message includes:

a versioned slice name of a dispersal encoded data slice associated with the particular revision of source data; and

information instructing the DSN memory to transmit an acknowledgement message to the DS processing unit indicating that the particular revision of source data has been flushed to persistent storage.

20. The DSN of claim 19, wherein the protocol message further includes:

information instructing the DSN memory to remove data slices associated with other revisions of the source data, wherein the other revisions have been stored in a cache memory.