Cloud file processing method and apparatus

• US 10,382,551 B2
• Filed: 10/28/2016
• Issued: 08/13/2019
• Est. Priority Date: 10/30/2015
• Status: Active Grant

• Current Assignee: Alibaba Group Holding Ltd.
• Original Assignee: Alibaba Group Holding Ltd.
• Inventors: Yang, Yehui
• Primary Examiner(s): Tran, Philip B
• Application Number:
  US15/338,178
• Publication Number:
  US 20170126806A1
• Time in Patent Office: 1,019 Days
• Field of Search: 709217, 709203
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/60 Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources admission control or resource allocation H04L47/70

Abstract

Apparatuses and methods are disclosed for cloud file processing. An exemplary method may include acquiring a position of a first data packet read by the client in the target file as a reading position when a target file that a client intends to read from a cloud server is divided into a plurality of data packets. The method may also include acquiring a state of a second data packet not at the reading position in the target file as a peripheral state. The peripheral state is a read-completed state or an unread state. When the reading position and the peripheral state meet a preset condition, the method may further include sending, by the client, a data pre-fetch request to the cloud server. The data pre-fetch request is used to request to read, from the cloud server, a preset amount of data packets whose peripheral states are unread states in the target file.

Claims

1. A method for processing cloud files containing a target file, the method comprising:

when the target file that a client intends to read from a cloud server is divided into a plurality of data packets;

acquiring a position of a first data packet read by the client in the target file as a reading position;

acquiring a state of a second data packet not at the reading position in the target file as a peripheral state, wherein the peripheral state is a read-completed state or an unread state; and

sending a data pre-fetch request by the client to the cloud server when the reading position and the peripheral state meet a preset condition,

wherein the data pre-fetch request is used to request to read, from the cloud server, a preset amount of data packets whose peripheral states are unread states in the target file.

2. The method of claim 1, wherein:

the target file is divided into a plurality of data packets of equal size.

3. The method of claim 2, further comprising:

establishing, before the client reads from the cloud server the target file, an information database of data packets, wherein the information database includes state information of the data packets of the target file and position information of the data packets of the target file that have been sorted in a preset order, and

wherein acquiring the position of the first data packet includes acquiring the position of the first data packet according to the position information of the first data packet in the information database, and acquiring the state of the second data packet includes acquiring the state of the second data packet according to the state information of the second data packet in the information database.

4. The method of claim 1, wherein the preset condition includes:

the reading position is the first position of the target file; and

the peripheral states of all the data packets are unread states.

5. The method of claim 4, further comprising:

acquiring the amount of data packets in the target file that are read by the client from the cloud server each time as a reading amount, and

setting the preset amount to be a value that is double the reading amount.

6. The method of claim 1, wherein the preset condition includes:

the reading position is not the first position of the target file; and

the peripheral states of all data packets located in front of the reading position are read-completed states.

7. The method of claim 6, wherein:

a double of the amount of pre-fetched data packets in a previous data pre-fetch request is used as the preset amount.

8. The method of claim 1, wherein the preset condition includes:

the reading position is not the first position of the target file; and

the peripheral states of a part of data packets located in front of the reading position are read-completed states.

9. The method of claim 8, wherein:

the amount of the data packets which are located in front of the reading position and of which the peripheral states are read-completed states is used as the preset amount.

10. The method of claim 1, further comprising,

controlling the client to read the pre-fetched data packets from the cloud server after sending the data pre-fetch request by the client to the cloud server;

and

caching the pre-fetched data packets locally at the client.

11. The method of claim 10, wherein caching the pre-fetched data packets locally at the client includes:

sorting the pre-fetched data packets according to the access order of the pre-fetched data packets; and

caching the sorted pre-fetched data packets locally at the client.

12. An apparatus for processing cloud files, comprising:

a memory storing a set of instructions; and

one or more processors configured to execute the set of instructions to cause the apparatus to perform operations including;

when a target file that a client intends to read from a cloud server is divided into a plurality of data packets;

acquiring a position of a first data packet read by the client in the target file as a reading position;

acquiring a state of a second data packet not at the reading position in the target file as a peripheral state, wherein the peripheral state is a read-completed state or an unread state; and

sending a data pre-fetch request by the client to the cloud server when the reading position and the peripheral state meet a preset condition,

wherein the data pre-fetch request is used to request to read, from the cloud server, a preset amount of data packets whose peripheral states are unread states in the target file.

13. The apparatus of claim 12, wherein:

the target file is divided into a plurality of data packets of equal size.

14. The apparatus of claim 12, wherein the one or more processors are configured to execute the set of instructions to cause the apparatus to further perform operations including:

establishing an information database of data packets, wherein the information database includes state information of the data packets of the target file and position information of the data packets of the target file that have been sorted in a preset order, and

wherein the operation of acquiring the position of the first data packet includes acquiring the position of the first data packet according to the position information of the first data packet in the information database, and the operation of acquiring the state of the second data packet includes acquiring the state of the second data packet according to the state information of the second data packet in the information database.

15. The apparatus of claim 12, wherein the preset condition includes:

the reading position is the first position of the target file; and

the peripheral states of all the data packets are unread states.

16. The apparatus of claim 15, wherein the one or more processors are configured to execute the set of instructions to cause the apparatus to further perform operations including:

acquiring the amount of data packets in the target file that are read by the client from the cloud server each time as a reading amount, and

setting the present amount to be a value that is double the reading amount.

17. The apparatus of claim 12, wherein the preset condition includes:

the reading position is not the first position of the target file; and

the peripheral states of all data packets located in front of the reading position are read-completed states.

18. The apparatus of claim 17, wherein:

a double of the amount of pre-fetched data packets in a previous data pre-fetch request is used as the preset amount.

19. The apparatus of claim 12, wherein the preset condition includes:

the reading position is not the first position of the target file; and

the peripheral states of a part of data packets located in front of the reading position are read-completed states.

20. The apparatus of claim 19, wherein:

the amount of the data packets which are located in front of the reading position and of which the peripheral states are read-completed states is used as the preset amount.

21. The apparatus of claim 12, wherein the one or more processors are configured to execute the set of instructions to cause the apparatus to further perform operations including:

controlling the client to read the pre-fetched data packets from the cloud server after sending the data pre-fetch request by the client to the cloud server; and

caching the pre-fetched data packets locally at the client.

22. The apparatus of claim 21, wherein the operation of caching the pre-fetched data packets includes:

sorting the pre-fetched data packets according to the access order of the pre-fetched data packets; and

caching the sorted pre-fetched data packets locally at the client.

23. A non-transitory computer-readable storage medium that stores a set of instructions that is executable by at least one processor of an apparatus to cause the apparatus to perform a method for processing cloud files containing a target file, the method comprising:

when the target file that a client intends to read from a cloud server is divided into a plurality of data packets;

acquiring a position of a first data packet read by the client in the target file as a reading position;

acquiring a state of a second data packet not at the reading position in the target file as a peripheral state, wherein the peripheral state is a read-completed state or an unread state; and

sending a data pre-fetch request by the client to the cloud server when the reading position and the peripheral state meet a preset condition,

wherein the data pre-fetch request is used to request to read, from the cloud server, a preset amount of data packets whose peripheral states are unread states in the target file.