Stateless technique for distributing data uploads

• US 9,860,322 B2
• Filed: 04/21/2015
• Issued: 01/02/2018
• Est. Priority Date: 04/08/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Bashir, Ahmed M., Hong, Theodore
• Primary Examiner(s): Nguyen, Kim T
• Application Number:
  US14/692,661
• Publication Number:
  US 20160301619A1
• Time in Patent Office: 987 Days
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/142 Managing session states for stateless protocols; Signalling session states; State transitions; Keeping-state mechanisms

Abstract

The embodiments set forth a technique for providing a stateless technique for distributing uploads. According to some embodiments, a system can include various computing devices, authorization servers, and storage destinations. Within the system, an authorization server assigns weight properties to each storage destination, and generates a set of tokens for subsequent assignment to the different storage destinations in accordance with their weight properties. More specifically, the authorization server is configured to perform an initial token drafting process that involves assigning the tokens to different storage destinations. As the current health of each storage destination changes over time, the authorization server is also configured to periodically perform (e.g., at a set interval) a supplemental token drafting process that involves updating the weight properties of each storage destination and redistributing the tokens in view of the updated weight properties.

Claims

1. A method for distributing data uploads, the method comprising:

at an authorization server configured to interface with a plurality of computing devices and a plurality of storage destinations;

generating a plurality of tokens, wherein each token includes (i) a unique token identifier (ID), and (ii) a reference to a storage destination of the plurality of storage destinations, and the reference to the storage destination is initially unassigned; and

for each storage destination of the plurality of storage destinations;

assigning, to the storage destination, a weight property that is commensurate with an initial performance capability of the storage destination, and

assigning, to the storage destination, a first group of tokens from the plurality of tokens, wherein the first group of tokens corresponds to the weight property.

2. The method of claim 1, wherein, for each storage destination of the plurality of storage destinations, assigning the first group of tokens comprises:

updating, for each token in the first group of tokens, the reference to point to the storage destination.

3. The method of claim 1, further comprising:

receiving, from a computing device of the plurality of computing devices, a data upload request, wherein the data upload request includes a unique computing device ID;

identifying, among the plurality of tokens, a token that corresponds to the unique computing device ID; and

providing, to the computing device, the reference to the storage destination in accordance with the token.

4. The method of claim 3, wherein the computing device can utilize the reference to the storage destination to directly upload data to the storage destination.

5. The method of claim 3, wherein identifying the token that corresponds to the unique computing device ID comprises:

performing a mathematical function on the unique computing device ID to produce a result; and

matching the result to the unique token ID included in the token.

6. The method of claim 5, wherein the mathematical function comprises a hash function.

7. The method of claim 1, further comprising:

at a predetermined interval, and for each storage destination of the plurality of storage destinations;

unassigning each token of the plurality of tokens from their corresponding storage destination;

updating the weight property of the storage destination to reflect a current health score of the storage destination; and

assigning, to the storage destination, a second group of tokens from the plurality of tokens, wherein the second group of tokens corresponds to the weight property.

8. The method of claim 7, wherein, for each storage destination, updating the weight property further comprises:

normalizing the weight property against weight properties of other storage destinations; and

dampening the weight property in accordance with a dampening value.

9. A system for distributing data uploads, the system comprising:

a plurality of computing devices;

a plurality of storage destinations; and

at least one authorization server, configured to carry out steps that include;

generating a plurality of tokens, wherein each token includes (i) a unique token identifier (ID), and (ii) a reference to a storage destination of the plurality of storage destinations, and the reference to the storage destination is initially unassigned; and

for each storage destination of the plurality of storage destinations;

assigning, to the storage destination, a weight property that is commensurate with an initial performance capability of the storage destination, and

assigning, to the storage destination, a first group of tokens from the plurality of tokens, wherein the first group of tokens corresponds to the weight property.

10. The system of claim 9, wherein, for each storage destination of the plurality of storage destinations, assigning the first group of tokens comprises:

updating, for each token in the first group of tokens, the reference to point to the storage destination.

11. The system of claim 9, wherein the at least one authorization server is further configured to carry out steps that include:

receiving, from a computing device of the plurality of computing devices, a data upload request, wherein the data upload request includes a unique computing device ID;

identifying, among the plurality of tokens, a token that corresponds to the unique computing device ID; and

providing, to the computing device, the reference to the storage destination in accordance with the token.

12. The system of claim 11, wherein the computing device can utilize the reference to the storage destination to directly upload data to the storage destination.

13. The system of claim 11, wherein identifying the token that corresponds to the unique computing device ID comprises:

performing a mathematical function on the unique computing device ID to produce a result; and

matching the result to the unique token ID included in the token.

14. The system of claim 9, wherein the at least one authorization server is further configured to carry out steps that include:

at a predetermined interval, and for each storage destination of the plurality of storage destinations;

unassigning each token of the plurality of tokens from their corresponding storage destination;

updating the weight property of the storage destination to reflect a current health score of the storage destination; and

assigning, to the storage destination, a second group of tokens from the plurality of tokens, wherein the second group of tokens corresponds to the weight property.

15. At least one non-transitory computer readable storage medium configured to store instructions that, when executed by at least one processor included in an authorization server configured to interface with a plurality of computing devices and a plurality of storage destinations, cause the authorization server to distribute data uploads, by carrying out steps that include:

generating a plurality of tokens, wherein each token includes (i) a unique token identifier (ID), and (ii) a reference to a storage destination of the plurality of storage destinations, and the reference to the storage destination is initially unassigned; and

for each storage destination of the plurality of storage destinations;

assigning, to the storage destination, a weight property that is commensurate with an initial performance capability of the storage destination, and

assigning, to the storage destination, a first group of tokens from the plurality of tokens, wherein the first group of tokens corresponds to the weight property.

16. The at least one non-transitory computer readable storage medium of claim 15, wherein, for each storage destination of the plurality of storage destinations, assigning the first group of tokens comprises:

updating, for each token in the first group of tokens, the reference to point to the storage destination.

17. The at least one non-transitory computer readable storage medium of claim 15, wherein the steps further include:

receiving, from a computing device of the plurality of computing devices, a data upload request, wherein the data upload request includes a unique computing device ID;

identifying, among the plurality of tokens, a token that corresponds to the unique computing device ID; and

providing, to the computing device, the reference to the storage destination in accordance with the token.

18. The at least one non-transitory computer readable storage medium of claim 17, wherein identifying the token that corresponds to the unique computing device ID comprises:

performing a mathematical function on the unique computing device ID to produce a result; and

matching the result to the unique token ID included in the token.

19. The at least one non-transitory computer readable storage medium of claim 15, wherein the steps further include:

at a predetermined interval, and for each storage destination of the plurality of storage destinations;

unassigning each token of the plurality of tokens from their corresponding storage destination;

updating the weight property of the storage destination to reflect a current health score of the storage destination; and

assigning, to the storage destination, a second group of tokens from the plurality of tokens, wherein the second group of tokens corresponds to the weight property.

20. The at least one non-transitory computer readable storage medium of claim 19, wherein, for each storage destination, updating the weight property further comprises:

normalizing the weight property against weight properties of other storage destinations; and

dampening the weight property in accordance with a dampening value.