Systems and methods for prioritizing file downloads

• US 10,114,836 B1
• Filed: 11/20/2017
• Issued: 10/30/2018
• Est. Priority Date: 04/24/2014
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Meyer, Cayden, Kilpatrick, Ian
• Primary Examiner(s): Singh, Amresh
• Application Number:
  US15/818,533
• Time in Patent Office: 344 Days
• Field of Search: None
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

Systems and methods are disclosed herein for downloading data from a cloud system. A plurality of files on the cloud system is identified for downloading to a client system, where the plurality of files is associated with metadata. A respective score for each file in the plurality of files is evaluated by applying a ranking scheme to the metadata, where the ranking scheme is based on at least two features of the metadata. A download process is initiated for at least some files in the plurality of files based on each file'"'"'s respective score.

Claims

1. A method comprising:

evaluating a first respective score for each file in a plurality of first files by applying a first ranking scheme to first metadata associated with the first files to generate a first ranking of the first files, wherein the first ranking scheme is based on weights of at least two features of the first metadata;

initiating a first download process for at least some files in the first files from a cloud system to a client system based on the first ranking of the first files;

refining, by at least one processor, the first ranking scheme based on training data to generate a second ranking scheme, wherein the training data comprises one or more changes to the first files, wherein the changes comprise at least an addition, a replacement, a deletion, a modification, or an access of at least one first file in the first files, wherein refining the first ranking scheme comprises generating a predicted access frequency of the first file and comparing the predicted access frequency to an actual access frequency of the first file, and wherein the second ranking scheme is generated in response to a result of the comparison exceeding a threshold;

evaluating a second respective score for each file in a plurality of second files by applying the second ranking scheme to second metadata associated with the second files to generate a second ranking of the second files; and

initiating a second download process for each file in the second files from the cloud system to the client system based on the second ranking of the second files.

2. The method of claim 1, further comprising selecting the at least some files in the first files based on the first respective score of each file in the first files and an amount of storage availability on the client system.

3. The method of claim 1, further comprising downloading the first files to the client system in an order defined by the first respective score of each file in the first files.

4. The method of claim 1, wherein the first respective score for each file in the first files is indicative of a likelihood that the file will be accessed on the client system.

5. The method of claim 1, wherein the first ranking scheme is trained using a machine learning system on existing cloud data in the cloud system.

6. The method of claim 5, further comprising separating the existing cloud data into at least a first group of cloud data comprising the first files and a second group of the cloud data comprising a plurality of third files, wherein the first group is associated with a plurality of first users and the second group is associated with a plurality of second users, wherein the first users and the second users are grouped based on types of the first files and the third files, and wherein the method further comprises applying the machine learning system on the cloud data to generate the first ranking scheme for the first files and the third ranking scheme for the third files.

7. The method of claim 1, wherein the first metadata comprises at least two of:

file size, file type, file history, time of last write, time of last access, time of initial creation, folder depth, or user specific data.

8. The method of claim 1, wherein the first metadata comprises a set of binary features that describe each file in the first files.

9. A system comprising:

at least one memory that stores instructions; and

at least one processor configured to execute the instructions to;

evaluate a first respective score for each file in a plurality of first files by applying a first ranking scheme to first metadata associated with the first files to generate a first ranking of the first files, wherein the first ranking scheme is based on weights of at least two features of the first metadata;

initiate a first download process for at least some files in the first files from a cloud system to a client system based on the first ranking of the first files;

refine the first ranking scheme based on training data to generate a second ranking scheme, wherein the training data comprises one or more changes to the first files, wherein the changes comprise at least an addition, a replacement, a deletion, a modification, or an access of at least one first file in the first files, wherein, to the refine the first ranking scheme, the processor is further configured to execute the instructions to generate a predicted access frequency of the first file and comparing the predicted access frequency to an actual access frequency of the first file, and wherein the second ranking scheme is generated in response to a result of the comparison exceeding a threshold;

evaluate a second respective score for each file in a plurality of second files by application of the second ranking scheme to second metadata associated with the second files to generate a second ranking of the second files; and

initiate a second download process for each file in the second files from the cloud system to the client system based on the second ranking of the second files.

10. The system of claim 9, wherein the processor is further configured to execute the instructions to select the at least some files in the first files based on the first respective score of each file in the first files and an amount of storage availability on the client system.

11. The system of claim 9, wherein the processor is further configured to execute the instructions to download the first files to the client system in an order defined by the first respective score of each file in the first files.

12. The system of claim 9, wherein the first respective score for each file in the first files is indicative of a likelihood that the file will be accessed on the client system.

13. The system of claim 9, wherein the first ranking scheme is trained using a machine learning system on existing cloud data in the cloud system.

14. The system of claim 13, wherein the processor is further configured to execute the instructions to separate the existing cloud data into at least a first group of cloud data comprising the first files and a second group of the cloud data comprising a plurality of third files, wherein the first group is associated with a plurality of first users and the second group is associated with a plurality of second users, wherein the first users and the second users are grouped based on types of the first files and the third files, and wherein the processor is further configured to execute the instructions to apply the machine learning system on the cloud data to generate the first ranking scheme for the first files and the third ranking scheme for the third files.

15. The system of claim 9, wherein the first metadata comprises at least two of:

file size, file type, file history, time of last write, time of last access, time of initial creation, folder depth, or user specific data.

16. The system of claim 9, wherein the first metadata comprises a set of binary features that describe each file in the first files.

17. A non-transitory computer-readable memory having instructions stored therein that, when executed by at least one processor, cause the processor to:

evaluate a first respective score for each file in a plurality of first files by applying a first ranking scheme to first metadata associated with the first files to generate a first ranking of the first files, wherein the first ranking scheme is based on weights of at least two features of the first metadata;

initiate a first download process for at least some files in the first files from a cloud system to a client system based on the first ranking of the first files;

refine, by the processor, the first ranking scheme based on training data to generate a second ranking scheme, wherein the training data comprises one or more changes to the first files, wherein the changes comprise at least an addition, a replacement, a deletion, a modification, or an access of at least one first file in the first files, wherein, to the refine the first ranking scheme, the instructions are further to cause the processor to generate a predicted access frequency of the first file and comparing the predicted access frequency to an actual access frequency of the first file, and wherein the second ranking scheme is generated in response to a result of the comparison exceeding a threshold;

evaluate a second respective score for each file in a plurality of second files by application of the second ranking scheme to second metadata associated with the second files to generate a second ranking of the second files; and

initiate a second download process for each file in the second files from the cloud system to the client system based on the second ranking of the second files.

18. The computer-readable memory of claim 17, wherein the instructions are further to cause the processor to download the first files to the client system in an order defined by the first respective score of each file in the first files.

19. The computer-readable memory of claim 17, wherein the first metadata comprises at least two of:

file size, file type, file history, time of last write, time of last access, time of initial creation, folder depth, or user specific data.

20. The computer-readable memory of claim 17, wherein the first metadata comprises a set of binary features that describe each file in the first files.