Segmented cloud storage

• US 10,534,667 B2
• Filed: 10/31/2016
• Issued: 01/14/2020
• Est. Priority Date: 10/31/2016
• Status: Active Grant

• Current Assignee: Storj Labs International SEZC (Storj Labs, Inc.)
• Original Assignee: Vivint Incorporated (NRG Energy, Inc.)
• Inventors: Olds, J. T., Peacock, Alen, Harding, Andrew, Wendling, Jeff
• Primary Examiner(s): Decady, Albert
• Assistant Examiner(s): Alshack, Osman M
• Application Number:
  US15/339,228
• Publication Number:
  US 20180121285A1
• Time in Patent Office: 1,170 Days
• Field of Search: 714763, 714764, 714784
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 3/0613 in relation to throughput
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H03M 13/1515 Reed-Solomon codes

Abstract

A computer system for optimizing bandwidth usage within a cloud storage system receives a request, through an application program interface (API), to store a digital file. The computer system then encodes the digital file into a set of multiple distinct blocks of data. The system also transmits the set of multiple distinct blocks of data to multiple remote storage nodes. The multiple distinct blocks of data are divided among at least a portion of the remote storage nodes. The system generates a log that comprises identification information associated with the digital file and an address for each respective block of data within each respective remote storage node. The system then transmits the log to a remote directory server. The directory server comprises multiple different logs that map multiple different digital files to the remote storage nodes.

Claims

1. A computer system for optimizing bandwidth usage within a cloud storage system, comprising:

one or more processors; and

one or more non-transitory computer-readable media having stored thereon executable instructions that when executed by the one or more processors configure the computer system to perform at least the following;

receive a request, through an application program interface (API), to store a digital file;

encode the digital file into a set of multiple distinct blocks of data, wherein the multiple distinct blocks of data each comprise a retrievable portion of the digital file and the set of multiple distinct blocks of data comprises parity information;

transmit the set of multiple distinct blocks of data to multiple remote storage nodes, wherein the multiple distinct blocks of data are divided among at least a portion of the remote storage nodes;

generate a log that comprises identification information associated with the digital file and an address for each respective block of data within each respective remote storage node; and

transmit the log to a remote directory server, wherein;

the remote directory server comprises multiple different logs that map multiple different digital files to the remote storage nodes, and

the remote directory server tracks outdated blocks of data that are stored at one or more remote storage nodes selected from the multiple storage nodes, wherein the outdated blocks are excluded from a request for a file that is associated with the outdated blocks.

2. The computer system as recited in claim 1, wherein the digital file is encoded using a Reed-Solomon algorithm.

3. The computer system as recited in claim 1, wherein the executable instructions include instructions that are executable to configure the computer system to:

before encoding the digital file, encrypt the digital file, and

store an associated encryption key locally.

4. The computer system as recited in claim 1, wherein the executable instructions include instructions that are executable to configure the computer system to:

before transmitting the set of multiple distinct blocks of data to multiple remote storage nodes, request from the remote directory server a set of nodes available for storage and internet protocol addresses associated with each available remote storage node, and

wherein the set of nodes available for storage comprises the multiple remote storage nodes.

5. The computer system as recited in claim 4, wherein the remote directory server selects a particular subset of remote storage nodes from a larger set of remote storage nodes based upon a predetermined segregation of a first user'"'"'s data from a second user'"'"'s data.

6. The computer system as recited in claim 4, wherein the executable instructions include instructions that are executable to configure the computer system to:

communicate an authentication credential to an account management server, and

after being authenticated at the account management server, receiving a credential necessary for accessing the remote directory server.

7. The computer system as recited in claim 1, wherein the digital file is encoded by a processor within a mobile computing device.

8. The computer system as recited in claim 7, wherein at least a portion of the remote storage nodes comprise home-based computing devices that are each disposed within different respective houses.

9. A computer-based method for optimizing data integrity within a cloud storage system, comprising:

receiving a request, through an application program interface (API), to store a digital file;

loading the digital file into local memory space;

encoding the digital file into a set of multiple distinct blocks of data, wherein the multiple distinct blocks of data each comprise a retrievable portion of the digital file and the set of multiple distinct blocks of data comprises parity information;

transmitting the set of multiple distinct blocks of data to multiple remote storage nodes, wherein;

the multiple distinct blocks of data are divided among at least a portion of the remote storage nodes, and

the multiple distinct blocks of data are divided among a particular subset of remote storage nodes selected from a larger set of remote storage nodes based upon a predetermined segregation of a first user'"'"'s data from a second user'"'"'s data, wherein the predetermined segregation is such that the particular subset of remote storage nodes, which is associated with the first user'"'"'s data, has fewer than a minimum recovery threshold of overlapping remote storage nodes, as defined by the parity information, with another subset of remote storage nodes that are associated with the second tier'"'"'s data;

generating a log that comprises identification information associated with the digital file and an address for each respective block of data within each respective remote storage node; and

transmitting the log to a remote directory server, wherein the remote directory server comprises multiple different logs that map multiple different digital files to the remote storage nodes.