Method, system and program product for optimized concurrent data download within a grid computing environment
First Claim
1. A method in a grid computing infrastructure for optimized data download, the method comprising the steps of:
- a. obtaining a download plan from a management service the download plan comprising an optimized list of a plurality of download servers, having a desired download data, the plurality of download servers deployed in a grid infrastructure;
b. contacting two or more of the download servers specified in the download plan;
c. assigning chunks of the download data to respective download servers of the two or more of the download servers specified in the download plan for concurrent downloading respective chunks of download data;
d. starting a parallel download of the chunks of the download data from download servers of the two or more download servers contacted, wherein the chunks are downloaded concurrently from the download servers;
e. monitoring download performance of the two or more download servers downloading the chunks;
f. during the parallel download of the chunks, adjusting the number of chunks being downloaded by a download server based on the monitored download performance of the two or more download servers; and
g. reporting to the management service, the monitored download performance of the two or more download servers.
1 Assignment
0 Petitions
Accused Products
Abstract
In a Grid computer system having a plurality of download servers in network communication with client computers and a download management system, a client requests a download plan from the download management system for downloading data in parallel from the plurality of download servers to a client. The client requests chunks of data from download servers identified by the download plan. The client monitors the performance of the download servers downloading the chunks and reassigns portions of chunks amongst the download servers in order to improve the performance of completing the download of the chunks. A chunk of download data is a plurality of files, a file or a portion of file of data.
133 Citations
62 Claims
-
1. A method in a grid computing infrastructure for optimized data download, the method comprising the steps of:
-
a. obtaining a download plan from a management service the download plan comprising an optimized list of a plurality of download servers, having a desired download data, the plurality of download servers deployed in a grid infrastructure;
b. contacting two or more of the download servers specified in the download plan;
c. assigning chunks of the download data to respective download servers of the two or more of the download servers specified in the download plan for concurrent downloading respective chunks of download data;
d. starting a parallel download of the chunks of the download data from download servers of the two or more download servers contacted, wherein the chunks are downloaded concurrently from the download servers;
e. monitoring download performance of the two or more download servers downloading the chunks;
f. during the parallel download of the chunks, adjusting the number of chunks being downloaded by a download server based on the monitored download performance of the two or more download servers; and
g. reporting to the management service, the monitored download performance of the two or more download servers. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A method for uploading, distributing, managing and controlling download data in a download grid infrastructure, the method comprising the steps of:
-
accepting the download data from a content provider;
distributing the download data into an infrastructure, the infrastructure comprising a plurality of download servers;
receiving a request from a client for a download plan for downloading the download data to the client;
creating a download plan, the download plan comprising a list of two or more download servers having the download data and further comprising performance information of the two or more download servers;
sending the created download plan to the client;
then receiving new download performance information of the two or more download servers from the client, the new download performance information indicating download server performance of the two or more download servers achieved by the client in performing a download according to the download plan; and
then, updating the performance information of the two or more download servers based on the new download performance information. - View Dependent Claims (15, 16, 17, 18, 19, 20)
-
-
21. A service for downloading download data from a plurality of download servers comprising the steps of:
-
assigning the download of a first chunk of the download data to a first server of the plurality of servers, the first chunk comprising a first portion and a second portion;
assigning the download of a second chunk of the download data to a second server of the plurality of servers;
starting the download of the first portion of the first chunk of the download data and the second chunk of the download data from the respective first and second servers;
determining that the second server is completing the download of the second chunk ahead of the first server completing the download of the first chunk;
assigning the second portion of the first chunk to the second server for downloading while the first server is downloading the first chunk; and
starting the download of the second portion of the first chunk from the second server while the first server is downloading the first portion of the first chunk.
-
-
22. A service for uploading, distributing, managing and controlling download data in a download grid infrastructure, the service comprising the steps of:
-
accepting the download data from a content provider;
distributing the download data into an infrastructure, the infrastructure comprising a plurality of download servers;
receiving a request from a client for a download plan for downloading the download data to the client;
creating a download plan, the download plan comprising a list of two or more download servers having the download data and further comprising performance information of the two or more download servers;
sending the created download plan to the client;
then receiving new download performance information of the two or more download servers from the client, the new download performance information indicating download server performance of the two or more download servers achieved by the client in performing a download according to the download plan; and
then, updating the performance information of the two or more download servers based on the new download performance information.
-
-
23. A computer program product in a grid computing infrastructure for optimized data download, the computer program product comprising:
-
a storage medium readable by a processing circuit and storing instructions for execution by a processing circuit for performing a method comprising the steps of;
a. obtaining a download plan from a management service the download plan comprising an optimized list of a plurality of download servers, having a desired download data, the plurality of download servers deployed in a grid infrastructure;
b. contacting two or more of the download servers specified in the download plan;
c. assigning chunks of the download data to respective download servers of the two or more of the download servers specified in the download plan for concurrent downloading respective chunks of download data;
d. starting a parallel download of the chunks of the download data from download servers of the two or more download servers contacted, wherein the chunks are downloaded concurrently from the download servers;
e. monitoring download performance of the two or more download servers downloading the chunks;
f. during the parallel download of the chunks, adjusting the number of chunks being downloaded by a download server based on the monitored download performance of the two or more download servers; and
g. reporting to the management service, the monitored download performance of the two or more download servers. - View Dependent Claims (24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35)
-
-
36. A computer program product for uploading, distributing, managing and controlling download data in a download grid infrastructure, the computer program product comprising:
-
a storage medium readable by a processing circuit and storing instructions for execution by a processing circuit for performing a method comprising the steps of;
accepting the download data from a content provider;
distributing the download data into an infrastructure, the infrastructure comprising a plurality of download servers;
receiving a request from a client for a download plan for downloading the download data to the client;
creating a download plan, the download plan comprising a list of two or more download servers having the download data and further comprising performance information of the two or more download servers;
sending the created download plan to the client;
then receiving new download performance information of the two or more download servers from the client, the new download performance information indicating download server performance of the two or more download servers achieved by the client in performing a download according to the download plan; and
then, updating the performance information of the two or more download servers based on the new download performance information. - View Dependent Claims (37, 38, 39, 40, 41, 42)
-
-
43. A system in a grid computing infrastructure for optimized data download, the system comprising:
-
a network;
a first computer system in communication with the network wherein the computer system includes instructions to execute a method comprising;
a. obtaining a download plan from a management service the download plan comprising an optimized list of a plurality of download servers, having a desired download data, the plurality of download servers deployed in a grid infrastructure;
b. contacting two or more of the download servers specified in the download plan;
c. assigning chunks of the download data to respective download servers of the two or more of the download servers specified in the download plan for concurrent downloading respective chunks of download data;
d. starting a parallel download of the chunks of the download data from download servers of the two or more download servers contacted, wherein the chunks are downloaded concurrently from the download servers;
e. monitoring download performance of the two or more download servers downloading the chunks;
f. during the parallel download of the chunks, adjusting the number of chunks being downloaded by a download server based on the monitored download performance of the two or more download servers; and
g. reporting to the management service, the monitored download performance of the two or more download servers. - View Dependent Claims (44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55)
-
-
56. A system for uploading, distributing, managing and controlling download data in a download grid infrastructure, the system comprising:
-
a network;
a first computer system in communication with the network wherein the computer system includes instructions to execute a method comprising;
accepting the download data from a content provider;
distributing the download data into an infrastructure, the infrastructure comprising a plurality of download servers;
receiving a request from a client for a download plan for downloading the download data to the client;
creating a download plan, the download plan comprising a list of two or more download servers having the download data and further comprising performance information of the two or more download servers;
sending the created download plan to the client;
then receiving new download performance information of the two or more download servers from the client, the new download performance information indicating download server performance of the two or more download servers achieved by the client in performing a download according to the download plan; and
then, updating the performance information of the two or more download servers based on the new download performance information. - View Dependent Claims (57, 58, 59, 60, 61, 62)
-
Specification