Optimized Prefetching of Compound Data

• US 20130086264A1
• Filed: 09/29/2011
• Published: 04/04/2013
• Est. Priority Date: 09/29/2011
• Status: Active Grant

• Current Assignee: Riverbed Technology, LLC (Riverbed Technology Incorporated)
• Original Assignee: Riverbed Technology Incorporated
• Inventors: Kini, Adityashankar, Perneti, Vinay
• Granted Patent: US 8,549,108 B2
• Time in Patent Office: Days
• US Class Current: 709/225
• CPC Class Codes: H04L 47/803 Application aware
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/5681 Pre-fetching or pre-delivering data based on network characteristics

Abstract

Access to compound data over a wide-area network is optimized by analyzing metadata within compound data to identify internal and external data streams to be prefetched. Upon receiving or intercepting a network packet including an access request for a data resource, metadata in this data resource is analyzed to identify associated data streams and their storage locations within and/or outside of the data resource. Data streams may be proactively or reactively prefetched. Proactive prefetching identifies and retrieves data streams or portions thereof likely to be accessed by a client based on attributes associated with the data resource. Reactive prefetching identifies portions of data streams associated with received access requests and retrieves additional portions of these data streams. Prefetched data streams or portions thereof are stored in a data storage on the same local network or near to the local network including the client.

Claims

1. A method of optimizing access to a data resource via a wide area network, the method comprising:

receiving a network packet from a client on a first local network, wherein the network packet includes a request for access to a first portion of a data resource, wherein the data resource is stored in a data storage accessible via a wide-area network;

accessing metadata associated with the data resource to identify at least a first data stream corresponding with the first portion of the data resource;

selecting a second portion of at least one data stream based at least in part on the first data stream;

retrieving the second portion of at least one data stream via the wide area network; and

storing a copy of the second portion of at least one data stream in a second data storage connected with the first local network.

2. The method of claim 1, wherein the second portion of at least one data stream includes an additional portion of the first data stream.

3. The method of claim 1, wherein the second portion of at least one data stream includes a second data stream.

4. The method of claim 3, wherein the first and second data streams are included in the data resource.

5. The method of claim 3, wherein the first data stream is included in the data resource and the second data stream is included in a second data resource.

6. The method of claim 2, wherein the additional portion of at least one data stream is logically contiguous with the first portion of the first data stream.

7. The method of claim 6, wherein the data resource includes first storage locations corresponding with the first portion of the first data stream and second storage locations corresponding with the additional portion of the first data stream, wherein the first and second storage locations are not contiguous.

8. The method of claim 1, wherein selecting the second portion of at least one data stream based at least in part on the first data stream comprises:

predicting at least one future access request from the client; and

identifying the second portion of at least one data stream based on the predicted future access request.

9. The method of claim 8, wherein the predicted future access request is determined at least in part by analyzing the metadata to identify an attribute associated with the data resource.

10. The method of claim 9, wherein the attribute includes a type associated with the data resource.

11. The method of claim 9, wherein the attribute includes an application associated with the data resource.

12. The method of claim 9, wherein the attribute includes at least one user associated with the data resource.

13. The method of claim 1, wherein receiving the network packet from the client on a first local network comprises:

intercepting the network packet in transit to the data storage.

14. The method of claim 13, wherein the network packet is intercepted on the first local network.

15. The method of claim 13, wherein the network packet is intercepted on a second local network connected with the wide-area network, wherein the second local network includes the data storage.

16. The method of claim 1, wherein the request for access to the data resource uses a network file protocol.

17. The method of claim 1, wherein the data resource includes a first file including the first data stream, wherein selecting the second portion of at least one data stream based on the first data stream comprises:

determining if a second file associated with the second portion of at least one data stream exists in the data storage;

in response to the determination that the second file does not exist, creating the second file in the data storage;

wherein the second portion of at least one data stream retrieved via the wide area network includes an access parameter for the second file.

20. The method of claim 1, wherein storing the second portion is performed by a WAN optimization device in the first local network.

21. The method of claim 1, wherein storing the second portion is performed by a WAN optimization application executed by the client.

22. The method of claim 1, wherein the selecting of the second portion of at least one data stream is further based at least in part on an access parameter associated with a request for access to a first portion of a data resource.

18. The method of 17, comprising:

receiving a second network packet from the client, wherein the second network packet includes a request to create the second file; and

in response to the second network packet, retrieving the stored copy of the second portion including the access parameter from the second data storage and communicating it to the client.

19. The method of 17, comprising:

receiving a second network packet from the client, wherein the second network packet includes an access request for the second portion of at least one data stream; and

in response to the second network packet, retrieving the stored copy of the second portion from the second data storage and communicating it to the client.