Method and device for downloading file

• US 10,484,468 B2
• Filed: 02/18/2015
• Issued: 11/19/2019
• Est. Priority Date: 08/28/2012
• Status: Active Grant

• Current Assignee: Tencent Technology Company Limited (Tencent Holdings Limited)
• Original Assignee: Tencent Technology Company Limited (Tencent Holdings Limited)
• Inventors: Wu, Haijun, Li, Rui, Zou, Yongqiang, Dong, Shengyu, Que, Taifu, Wang, Lei, Yang, Shaopeng, Zhang, Shuxin, Zhao, Dayong, Liu, Chang, Chen, Xiaodong, Zhang, Yinfeng
• Primary Examiner(s): Bates, Kevin T
• Assistant Examiner(s): Huang, Chen-Liang
• Application Number:
  US14/624,647
• Publication Number:
  US 20150163280A1
• Time in Patent Office: 1,735 Days
• Field of Search: 709217
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/108 characterised by resources being split in blocks or fragments

Abstract

Disclosed are a method and a device for downloading a file. The method includes: when receiving a download request of a file, acquiring attribute information about the file, and learning information about the length of the file according to the attribute information about the file; when the length of the file goes beyond a preset value, segmenting the download request into at least two fragments of download requests; sending the at least two fragments of download requests to at least two data nodes to request to download corresponding fragments, and obtaining the at least two fragments; and according to the at least two fragments obtained by download, obtaining the file. By segmenting the download request into a plurality of fragments of requests, the present invention achieves the parallel download of the plurality of fragments of requests, thereby greatly improving the download efficiency of a file.

Claims

1. A method for downloading a file to a device, the method comprising:

when receiving a download request a file,

acquiring, by the device, attribute information about the file from a name node of at least two data nodes,

learning information, by the device, about the length of the file according to the attribute information about the file, and

when the length of the file goes beyond a preset value,

segmenting, by the device, the download request into at least two fragments of download requests, the at least two fragments of download requests comprising a first fragment download request and a second fragment download request,

sending the at least two fragments of download requests from the device to the at least two data nodes to request to download corresponding fragments,

receiving, by the device, information returned by each data node, and

identifying, by the device, whether the information is a downloaded fragment or download failure information,

wherein, when the downloaded information corresponding to the first fragment download request that is received from one data node is identified as the download failure information,

excluding, by the device, the data node from the at least two data nodes; and

when the downloaded information corresponding to the second fragment download request is also identified as the download failure information, sending, by the device, the second fragment download request to another data node of the at least two data nodes;

wherein, when the downloaded information corresponding to the first fragment download request that is received from one data node is identified as the downloaded fragment and the downloaded information corresponding to the second fragment download request is identified as the download failure information,

sending, by the device, the second fragment download request to the data node; and

wherein, when downloaded fragments corresponding to fragments of download requests are received from data nodes,

obtaining, by the device, the file according to the at least two fragments obtained by download.

2. The method according to claim 1, wherein, the step of segmenting the download request into at least two fragments of download requests, comprises:

obtaining a check value of the file according to the attribute information about the tile; and

segmenting the download request into at least two fragments of download requests according to the check value, wherein, the length of at least one fragment among all the fragments obtained by segmenting the download request is equal to the check value.

3. The method according to claim 1, the method further comprising:

obtaining a check value of the file according to the attribute information about the file; and

wherein, when the length of the file goes beyond a preset value, segmenting the download request into at least two fragments of download requests, comprises;

when the length of the file goes beyond a preset value, segmenting the download request into at least two fragments of download requests according to the check value, wherein the lengths of all the fragments obtained by segmenting the download request at least except the last fragment are equal to the check value.

4. The method according to claim 3, wherein the preset value is the check value.

5. The method according to claim 1, wherein, when the downloaded information of the download request that is received from one data node is identified as the downloaded fragment, storing the downloaded fragment.

6. The method according to claim 5, the method further comprising:

if the information is identified as the download failure information, sending fragments of download request which fail to download fragments to other data nodes except the data node which send the download failure information, to request to download corresponding fragments, and obtaining fragments downloaded from the other data nodes.

7. The method according to claim 5, after the step of receiving information returned by each data node, the method further comprising:

if the information is identified as the downloaded fragment, recording information that the fragments are downloaded successfully from current data node; and

if the information is identified as the download failure information, recording information that the fragments are unable to be downloaded from the current data node,

wherein the sending the other unprocessed fragments of download requests to the data node to request to download the corresponding fragments is based on the recorded information.

15. The method according to claim 6, after the step of receiving information returned by each data node, the method further comprising:

if the information is identified as the downloaded fragment, recording information that the fragments are downloaded successfully from current data node; and

if the information is identified as the download failure information, recording information that the fragments are unable to be downloaded from the current data node,

wherein the sending the other unprocessed fragments of download requests to the data node to request to download the corresponding fragments is based on the recorded information.

8. A device for downloading a file, comprising:

a processor;

a memory storing a plurality of instructions, the plurality of instructions being executed by the processor and causing the processor to;

acquire attribute information about a file from a name node of at least two data nodes when receiving a download request of the file;

learn information about the length of the file according to the attribute information about the file;

download the file directly when the length of the file is less than or equal to a preset value; and

when the length of the file goes beyond the preset value,

segment the download request into at least two fragments of download requests, the at least two fragments of download requests comprising a first fragment download request and a second fragment download request;

send the at least two fragments of download requests to the at least two data nodes to request to download corresponding fragments,

receive information returned by each data node; and

identify whether the information is a downloaded fragment or download failure information,

wherein, when the downloaded information corresponding to the first fragment download request that is received from one data node is identified as the download failure information,

exclude the data node from the at least two data nodes; and

when the downloaded information corresponding to the second fragment download request is also identified as the download failure information, send the second fragment download request to another data node of the at least two data nodes;

wherein, when the downloaded information corresponding to the first fragment download request that is received from one data node is identified as the downloaded fragment and the downloaded information corresponding to the second fragment download request is identified as the download failure information,

send the second fragment download request to the data node; and

wherein, when downloaded fragments corresponding to fragments of download requests are received from data nodes,

obtain the file according to the at least two fragments obtained by download.

9. The device according to claim 8, wherein, to segment the download request into at least two fragments of download requests according to a check value, the plurality of instructions further causing the processor to:

obtain the check value of the file according to the attribute information about the file; and

segment the download request into at least two fragments of download requests according to the check value, wherein, the length of at least one fragment among all the fragments obtained by segmenting the download request is equal to the check value.

10. The device according to claim 8, wherein the plurality of instructions further causing the processor to:

when the length of the file goes beyond a preset value,

obtain a check value of the file according to the attribute information about the file; and

segment the download request into at least two fragments of download requests according to the check value, wherein the lengths of all the fragments obtained by segmenting the download request at least except the last fragment are equal to the check value.

11. The device according to claim 10, wherein the preset value is the check value.

12. The device according to claim 8, wherein, when the downloaded information of the download request that is received from one data node is identified as the downloaded fragment, store the downloaded fragment.

13. The device according of claim 12, wherein the plurality of instructions further causing the processor to:

if the information is identified as the download failure information, send fragments of download request which fail to download fragments to other data nodes except the data node which sent the download failure information, to request to download corresponding fragments,

and obtain fragments downloaded from the other data nodes.

14. The device according to claim 12, wherein the plurality of instructions further causing the processor to:

record information that the fragments are downloaded successfully from current data node after receiving the information returned by each data node and if the information is identified as the downloaded fragment, and if the information is identified as the download failure information, record information that the fragments are unable to be downloaded from the current data node,

wherein the other unprocessed fragments of download requests are sent to the data node to request to download the corresponding fragments based on the recorded information.

16. The device according to claim 13, wherein the plurality of instructions further causing the processor to:

record information that the fragments are downloaded successfully from current data node after receiving the information returned by each data node and if the information is identified as the downloaded fragment, and if the information is identified as the download failure information, record information that the fragments are unable to be downloaded from the current data node,

wherein the other unprocessed fragments of download requests are sent to the data node to request to download the corresponding fragments based on the recorded information.

17. A non-transitory computer readable storage medium, storing one or more programs for execution by one or more processors of a computer having a display, the one or more programs comprising instructions for performing:

when receiving a download request of a file,

acquiring, by the computer, attribute information about the file from a name node of at least two data nodes,

learning information, by the computer, about the length of the file awarding to the attribute information about the file, and

when the length of the file goes beyond a preset value,

segmenting, by the computer, the download request into at least two fragments of download requests, the at least two fragments of download requests comprising a first fragment download request and a second fragment download request,

sending the at least two fragments of download requests from the computer to the at least two data nodes to request to download corresponding fragments,

receiving, by the computer, information returned by each data node, and

identifying, by the computer, whether the information is a downloaded fragment or download failure information,

wherein, when the downloaded information corresponding to the first fragment download request that is received from one data node is identified as the download failure information,

excluding, by the computer, the data node from the at least two data nodes; and

when the downloaded information corresponding to the second fragment download request is also identified as the download failure information, sending, by the computer, the second fragment download request to another data node of the at least two data nodes;

wherein, when the downloaded information corresponding to the first fragment download request that is received from one data node is identified as the downloaded fragment and the downloaded information corresponding to the second fragment download request is identified as the download failure information,

sending, by the computer, the second fragment download request to the data node; and

wherein, when downloaded fragment fragments corresponding to fragments of download requests are received from data nodes,

obtaining, by the computer, the file according to the at least two fragments obtained by download.

18. The non-transitory computer readable storage medium according to claim 17, wherein, the step of segmenting the download request into at least two fragments of download requests, comprises:

obtaining a check value of the tile according to the attribute information about the file; and

segmenting the download request into at least two fragments of download requests according to the check value, wherein, the length of at least one fragment among all the fragments obtained by segmenting the download request is equal to the check value.

19. The non-transitory computer readable storage medium according to claim 17, further comprising:

obtaining a check value of the file according to the attribute information about the file; and

wherein, when the length of the file goes beyond a preset value, segmenting the download request into at least two fragments of download requests, comprises;

when the length of the file goes beyond a preset value, segmenting the download request into at least two fragments of download requests according to the check value,

wherein the lengths of all the fragments obtained by segmenting the download request at least except the last fragment are equal to the check value.

20. The non-transitory computer readable storage medium according to claim 17, wherein, the step of sending the at least two fragments of download requests to the at least two data nodes to request to download corresponding fragments, and obtaining the at least two fragments, comprises:

sending the at least two fragments of download requests to the at least two data nodes to request to download corresponding fragments; and

receiving information returned by each data node, and if the information is a downloaded fragment, storing the downloaded fragment, sending other unprocessed fragments of down load requests to the data node to request to download corresponding fragments, and obtaining the at least two fragments.