Implementing a storage system using a personal user device and a data distribution device

• US 10,412,168 B2
• Filed: 02/14/2017
• Issued: 09/10/2019
• Est. Priority Date: 02/17/2016
• Status: Active Grant

• Current Assignee: Latticework, Inc.
• Original Assignee: Latticework, Inc.
• Inventors: Sutardja, Pantas
• Primary Examiner(s): Katsikis, Kostas J
• Application Number:
  US15/432,785
• Publication Number:
  US 20170237812A1
• Time in Patent Office: 938 Days
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0635 by changing the path, e.g. traffic rerouting, path reconfiguration
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 9/5061 Partitioning or combining of resources
• CPC Class Codes: H04L 63/10 for controlling access to devices or network resources
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/563 Data redirection of data network streams

Abstract

A storage system is implemented using a personal user device and a data distribution device. A personal user device stores a particular content item and transmits the particular content item to a data distribution device for storage. A client device transmits a request for the particular content item to the personal user device. The personal user device determines a characteristic associated with the personal user device, the data distribution device, the client device, and/or the particular content item. Based on the characteristic, the personal user device determines whether to serve the particular content item, or to redirect the client device to the data distribution device to obtain the particular content item. If the client device is redirected, then the client device transmits a request for the particular content item to the data distribution device. The data distribution device transmits the particular content item to the client device.

Claims

1. One or more non-transitory computer readable media comprising instructions which, when executed by one or more hardware processors, cause performance of operations comprising:

storing, by a personal user device, a set of one or more content items;

responsive to determining that a level of similarity across the set of content items is above a specified threshold;

selecting only a subset of the set of content items for transmission to a data distribution device, wherein the subset of content items includes a first content item;

transmitting, by the personal user device to a data distribution device, the subset of content items;

receiving, by the personal user device from a client device, a request for the first content item;

identifying a set of one or more characteristics associated with one or more of;

the personal user device, the data distribution device, the client device, the request, and the first content item;

based on the set of characteristics, determining whether the request should be served by the personal user device or the data distribution device;

performing one of;

responsive to determining that the request should be served by the personal user device;

transmitting, by the personal user device to the client device, the first content item; and

responsive to determining that the request should be served by the data distribution device;

redirecting, by the personal user device, the client device to the data distribution device for obtaining the first content item.

2. The media of claim 1, wherein the set of characteristics comprises at least one of:

a bandwidth of the personal user device or the data distribution device;

a load of the personal user device or the data distribution device;

a speed at which the personal user device or the data distribution device may serve the request;

a priority level associated with the request or the client device; and

a geographical location or network of the personal user device, the data distribution device, or the client device.

3. The media of claim 1, wherein the set of characteristics comprises whether the data distribution device stores a current version of the first content item.

4. The media of claim 1, wherein the operations further comprise:

further responsive to determining that the request should be served by the data distribution device;

refraining, by the personal user device, from serving the first content item stored by the personal user device.

5. The media of claim 1, wherein transmitting at least the first content item to the data distribution device is responsive to determining that access to the first content item has been granted by a first user to a second user.

6. The media of claim 5, wherein the operations further comprise:

selecting the data distribution device, from a plurality of data distribution devices, for transmission of the first content item based on a geographical proximity between the data distribution device and the second user.

7. The media of claim 1, wherein the operations further comprise:

receiving, by the data distribution device from the client device, the request for the first content item; and

transmitting, by the data distribution device to the client device, the first content item.

8. The media of claim 1, wherein transmitting at least the first content item to the data distribution device is based on a number of users that are granted access to the first content item.

9. The media of claim 1, wherein redirecting the client device to the data distribution device comprises:

transmitting an identifier or address of the data distribution device to the client device.

10. The media of claim 1, wherein redirecting the client device to the data distribution device comprises:

transmitting an identifier or address of the first content item, on the data distribution device, to the client device.

11. The media of claim 1, wherein transmitting at least the first content item to the data distribution device comprises:

identifying, by the personal user device, a plurality of content items stored on the data distribution device;

selecting, by the personal user device, a second content item of the plurality of content items; and

transmitting, by the personal user device to the data distribution device, an instruction to overwrite or delete the second content item.

12. The media of claim 11, wherein selecting the second content item from the plurality of content items is based on a date on which a particular user granted access to the second content item to another user.

13. The media of claim 1, wherein the personal user device is included within a private cloud infrastructure and the data distribution device is included within a public cloud infrastructure.

14. The media of claim 1, wherein the operations further comprise:

establishing a persistent connection between the personal user device and the data distribution device;

transmitting, by the personal user device to the data distribution device, a second content item of the set of content items;

receiving, by the personal user device from the client device, a request for the second content item that is communicated through the persistent connection between the personal user device and the data distribution device; and

transmitting, by the personal user device to the data distribution device, a request to transmit the second content item from the data distribution device to the client device.

15. The media of claim 1, wherein the request for the first content item is received, by the personal user device, via a direct connection between the personal user device and the client device.

16. One or more non-transitory computer readable media comprising instructions which, when executed by one or more hardware processors, cause performance of operations comprising:

storing, by a data distribution device, a content item received from a personal user device;

subsequent to authenticating, by the data distribution device, a client device requesting the content item;

establishing a first connection between the data distribution device and the client device;

providing, by the data distribution device via the first connection, information to the client device and the personal user device to establish a direct connection that does not include the data distribution device;

serving, by the data distribution device via the first connection, at least a first portion of the content item to the client device while the client device and the personal device establish the direct connection that does not involve the data distribution device;

responsive to the client device using the first connection with the data distribution device, from a group comprising (a) the first connection with the data distribution device and (b) the direct connection with the personal user device, for obtaining at least a second portion of the content item;

serving, by the data distribution device via the first connection, the second portion of the content item to the client device.

17. The medium of claim 16, wherein the client device obtains at least a third portion of the content item from the personal user device.

18. One or more non-transitory computer readable media comprising instructions which, when executed by one or more hardware processors, cause performance of operations comprising:

storing, by a personal user device, a set of one or more data files;

transmitting, by the personal user device to a data distribution device, at least a data file of the set of data files, wherein the data file comprises a first content item and a second content item;

receiving, by the personal user device from a client device, a request for the data file;

identifying a first set of one or more characteristics associated with one or more of;

the personal user device, the data distribution device, the client device, the request, the data file, the first content item, and the second content item;

based on the first set of characteristics, determining whether the first content item should be returned by the personal user device or the data distribution device;

responsive to determining that the first content item should be returned by the personal user device;

transmitting, by the personal user device to the client device, the first content item;

identifying a second set of one or more characteristics associated with one or more of;

the personal user device, the data distribution device, the client device, the request, the data file, the first content item, and the second content item;

based on the second set of characteristics, determining whether the second content item should be returned by the personal user device or the data distribution device;

responsive to determining that the second content item should be returned by the data distribution device;

redirecting, by the personal user device, the client device to the data distribution device for obtaining the second content item.

19. One or more non-transitory computer readable media comprising instructions which, when executed by one or more hardware processors, cause performance of operations comprising:

transmitting, by a client device to a personal user device, a first request to obtain a first content item, wherein the personal user device stores the first content item;

receiving, by the client device from the personal user device, a first message indicating that at least a first portion of the first content item may be obtained from a data distribution device;

selecting, by the client device, the data distribution device for obtaining at least the first portion of the first content item;

transmitting, by the client device to the data distribution device, a second request for at least the first portion of the first content item; and

receiving, by the client device from the data distribution device, at least the first portion of the first content item.

20. The media of claim 19, wherein selecting the data distribution device for obtaining at least the first portion of the first content item is responsive to:

attempting to obtain a second portion of the first content item from the personal user device and failing to receive the second portion of the first content item in a manner that meets a quality-of-service criteria.

21. The media of claim 19, wherein the first message includes an identifier or address of the data distribution device.

22. The media of claim 19, wherein the operations further comprise:

transmitting, by the client device to the personal user device, a third request for a second portion of the first content item; and

receiving, by the client device from the personal user device, the second portion of the first content item.

23. The media of claim 19, wherein the client device selects the data distribution device for obtaining at least the first portion of the first content item based on a set of one or more characteristics associated with one or more of:

the personal user device, the data distribution device, the client device, and the first content item.

24. The media of claim 19, wherein the personal user device determines that the first portion of the first content item may be obtained from the data distribution device based on determining that the data distribution device stores a current version of the first portion of the first content item.

25. One or more non-transitory computer readable media comprising instructions which, when executed by one or more hardware processors, cause performance of operations comprising:

storing, by a personal user device in a private cloud infrastructure, a set of one or more content items;

transmitting, by the personal user device to a data distribution device, at least a first content item and a second content item of the set of content items;

receiving, by the personal user device from a client device, a first request for the first content item;

wherein the first request for the first content item is associated with an indicator indicating that the client device selects the data distribution device as a source for the first content item;

identifying a first set of one or more characteristics associated with one or more of;

the personal user device, the data distribution device, the client device, the first request, and the first content item;

based on the first set of characteristics;

determining, by the personal user device, whether the first request should be served by the personal user device or the data distribution device;

based at least on the indicator;

determining that the first request should be served by the data distribution device;

responsive to determining that the first request should be served by the data distribution device;

redirecting, by the personal user device, the client device to the data distribution device for obtaining the first content item;

receiving, by the personal user device from the client device, a second request for the second content item;

identifying a second set of one or more characteristics associated with one or more of;

the personal user device, the data distribution device, the client device, the second request, and the second content item;

based on the second set of characteristics;

determining, by the personal user device, whether the second request should be served by the personal user device or the data distribution device;

responsive to determining that the request should be served by the personal user device;

transmitting, by the personal user device to the client device, the second content item.