Cache for file-based dispersed storage

• US 9,811,405 B2
• Filed: 07/08/2014
• Issued: 11/07/2017
• Est. Priority Date: 12/29/2009
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Motwani, Manish, Volvovski, Ilya
• Primary Examiner(s): Thammavong, Prasith
• Application Number:
  US14/325,425
• Publication Number:
  US 20140325305A1
• Time in Patent Office: 1,218 Days
• Field of Search: 711147
• CPC Class Codes: G06F 11/0745 in an input/output transactions management context input/output processing in general G06F13/00
• CPC Class Codes: G06F 11/1064 in cache or content addressable memories
• CPC Class Codes: G06F 11/1092 Rebuilding, e.g. when physically replacing a failing disk
• CPC Class Codes: G06F 11/1443 Transmit or communication errors
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 12/0813 with a network or matrix configuration
• CPC Class Codes: G06F 12/0815 Cache consistency protocols
• CPC Class Codes: G06F 21/10 Protecting distributed programs or content, e.g. vending or licensing of copyrighted material protection in video systems or pay television H04N7/16 ; Digital rights management [DRM]
• CPC Class Codes: G06F 2211/1028 Distributed, i.e. distributed RAID systems with parity
• CPC Class Codes: G06F 2211/1057 Parity-multiple bits-RAID6, i.e. RAID 6 implementations
• CPC Class Codes: G06F 9/467 Transactional memory G06F9/528 takes precedence

Abstract

A method obtains at least part of a file from a dispersed storage network (DSN) memory, and stores it in a data object cache. When the file is changed, a determination is made about where to store the changed file portions: in the data object cache or in the DSN. The changed file portions, for example a new copy of the part of the file obtained from the DSN, are encoded utilizing an error coding dispersal storage function, and stored in either the data object cache, or in the DSN memory.

Claims

1. A method for execution by a computing device of a dispersed storage network (DSN), the method comprising:

retrieving, by the computing device, a first set of a decode threshold number of encoded data slices of a first set of encoded data slices in accordance with a read function regarding a file, wherein a first portion of the file is dispersed storage error encoded to produce the first set of encoded data slices;

decoding, by the computing device, the first set of a decode threshold number of encoded data slices to recover the first portion;

outputting, by the computing device, the recovered first portion in accordance with the read function;

performing, by the computing device, a read ahead operation regarding the file to identify a second portion of the file, wherein the second portion is dispersed storage error encoded into a second set of encoded data slices;

determining, by the computing device, to retrieve a second set of the decode threshold number of encoded data slices of the second set of encoded data slices from storage units of the DSN;

when determined to retrieve the second set of the decode threshold number of encoded data slices;

retrieving, by the computing device, the second set of the decode threshold number of encoded data slices; and

temporarily storing, by the computing device, the second set of the decode threshold number of encoded data slices;

determining, by the computing device, whether to output the second portion in accordance with the read function; and

when determined to output the second portion in accordance with the read function;

retrieving, by the computing device, the second set of the decode threshold number of encoded data slices from temporary storage;

decoding, by the computing device, the second set of the decode threshold number of encoded data slices to recover the second portion; and

outputting, by the computing device, the recovered second portion in accordance with the read function.

2. The method of claim 1, further comprises:

determining to retrieve the second set of the decode threshold number of encoded data slices when the computing device is not currently storing the second portion and is not currently storing the second set of the decode threshold number of encoded data slices.

3. The method of claim 1, wherein the outputting the recovered first portion comprises one of:

outputting the recovered first portion to another computing device of the DSN;

outputting the recovered first portion to a video graphics processing unit; and

outputting the recovered firsts portion to an input/output interface for playback.

4. The method of claim 1, wherein the read function comprises one of:

a read operation;

a file editing operation;

a file replication operation; and

a file moving operation.

5. The method of claim 1 further comprises:

outputting the recovered first portion during a first timeframe; and

outputting the recovered second portion during a second timeframe, wherein the second timeframe is subsequent to the first timeframe.

6. A computing device comprises:

an interface;

a memory; and

a processing module that is operably coupled to the memory and the interface, wherein the processing module is operable to;

retrieve, via the interface, a first set of a decode threshold number of encoded data slices of a first set of encoded data slices in accordance with a read function regarding a file, wherein a first portion of the file is dispersed storage error encoded to produce the first set of encoded data slices;

decode the first set of a decode threshold number of encoded data slices to recover the first portion;

output the recovered first portion in accordance with the read function;

perform a read ahead operation regarding the file to identify a second portion of the file, wherein the second portion is dispersed storage error encoded into a second set of encoded data slices;

determine to retrieve a second set of the decode threshold number of encoded data slices of the second set of encoded data slices from storage units of the DSN;

when determined to retrieve the second set of the decode threshold number of encoded data slices;

retrieving, via the interface, the second set of the decode threshold number of encoded data slices; and

temporarily storing the second set of the decode threshold number of encoded data slices;

determine whether to output the second portion in accordance with the read function; and

when determined to output the second portion in accordance with the read function;

retrieving the second set of the decode threshold number of encoded data slices from temporary storage;

decoding the second set of the decode threshold number of encoded data slices to recover the second portion; and

outputting, via the interface, the recovered second portion in accordance with the read function.

7. The computing device of claim 6, wherein the processing module is further operable to:

determine to retrieve the second set of the decode threshold number of encoded data slices when the computing device is not currently storing the second portion in the memory and is not currently storing the second set of the decode threshold number of encoded data slices in the memory.

8. The computing device of claim 6 wherein the processing module is operable to output the recovered first portion by one of:

outputting, via the interface, the recovered first portion to another computing device of the DSN;

outputting, via the interface, the recovered first portion to a video graphics processing unit; and

outputting, via the interface, the recovered firsts portion to an input/output interface for playback.

9. The computing device of claim 6, wherein the processing module is operable to perform the read function by performing one of:

a read operation;

a file editing operation;

a file replication operation; and

a file moving operation.

10. The computing device of claim 6, wherein the processing module is operable to:

output, via the interface, the recovered first portion during a first timeframe; and

output, via the interface, the recovered second portion during a second timeframe, wherein the second timeframe is subsequent to the first timeframe.