Balancing caching load in a peer-to-peer based network file system

• US 8,463,788 B2
• Filed: 08/29/2011
• Issued: 06/11/2013
• Est. Priority Date: 09/03/2010
• Status: Expired due to Fees

• Current Assignee: Toshiba Corporation
• Original Assignee: Marvell World Trade Limited (Marvell Technology Group Limited)
• Inventors: Bandyopadhyay, Somenath, Gole, Abhijeet P., Bhatt, Jayesh
• Primary Examiner(s): Beausoliel, Jr., Robert
• Assistant Examiner(s): Arjomandi, Noosha
• Application Number:
  US13/220,200
• Publication Number:
  US 20120059864A1
• Time in Patent Office: 652 Days
• Field of Search: 707/737, 707/827, 718/105
• US Class Current: 707/737
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

Systems and techniques relating to network file systems for balancing caching load in peer-to-peer based network file systems are described. In one aspect, a method includes maintaining, by a cluster containing two or more computer systems, information about files cached at a network that includes three or more computer systems configured to cache data associated with a file server system. The method also includes receiving, from one of the computer systems of the network, a request to identify at least one computer system of the network that caches a specified file. Further, the method includes identifying, by the cluster in response to the received request, one or more computer systems of the network that cache the specified file based on the maintained information. Furthermore, the method includes providing, by the cluster to the requesting computer system, information referencing at least the identified one or more computer systems of the network.

Claims

1. A device comprising:

memory and circuit electronics,

the device being configured to connect with a network that includes a caching load balancer and three or more devices, which include the device, configured to cache data associated with a file server system, such that the devices have respective connections with the file server system, the circuit electronics being configured to

detect that a specified file is not cached on the memory of the device,

request, from the caching load balancer in response to the detection, information that identifies at least one of the three or more devices of the network that cache the specified file,

receive from the caching load balancer a response including information identifying one or more devices of the three or more devices of the network that cache the specified file,

communicate with at least one device of the one or more devices referenced by the response received from the caching load balancer to retrieve the specified file,

retrieve and cache the specified file based on the communication with the at least one device referenced by the response received from the caching load balancer,

provide the caching load balancer a notification including an identity of the at least one device referenced by the response received from the caching load balancer with which the device has communicated to retrieve the specified file, and a confirmation that the specified file is cached on the memory of the device,

store the information included in the response received from the caching load balancer identifying the one or more devices of the three or more devices of the network that cache the specified file,

detect a cache miss upon an attempt to locally re-access the specified file, and

determine, responsive to having detected the cache miss, whether the stored information identifying the one or more devices of the three or more devices of the network that cache the specified file is fresh or stale, prior to using the stored information to re-obtain the specified file,

wherein the stored information identifying the one or more devices of the three or more devices of the network that cache the specified file is fresh if the information was stored for a time interval shorter than a predefined duration, and is stale if the information was stored for a time interval longer than or equal to the predefined duration.

2. The device of claim 1, where the information included in the response received from the caching load balancer includes permission information associated with an instance of the specified file that is cached at the identified one or more devices of the network, and the circuit electronics are further configured to

prior to detecting that the specified file is not cached on the memory of the device, request to access the specified file to perform a given action, and

select the at least one device for communication based on a permission associated with an instance of the specified file cached at the at least one device meeting a permission corresponding to the given action.

3. The device of claim 2, where

the information included in the response received from the caching load balancer identifies multiple devices, and

includes respective caching loads of the identified multiple devices, and

the circuit electronics are further configured to carry out the communication with the at least one device of the identified multiple devices in an order based on criteria including

a predefined quantity of network hops between the device and the identified multiple devices, and

a predefined caching load level of the identified multiple devices.

4. The device of claim 1, where

the communication with the at least one device referenced by the response received from the caching load balancer includes

a request transmitted to a first device referenced by the response received from the caching load balancer to provide the specified file, and

a response received from the first device including the specified file, and

the notification to the caching load balancer includes the identity of the first device.

5. The device of claim 1, where

the communication with the at least one device referenced by the response received from the caching load balancer includes

a request transmitted to a first device referenced by the response received from the caching load balancer to provide the specified file,

a response received from first device to notify the device that the specified file is missing at the first device, and

a request transmitted, upon receipt of the response from the first device, to a second device referenced by the response received from the caching load balancer to provide the specified file, and

the notification to the caching load balancer includes the identities of the first and second devices and information that the specified file is missing at the first device.

6. The device of claim 5, where the communication with the at least one device referenced by the response received from the caching load balancer further includes a response received from the second device including the specified file.

7. The device of claim 5, where

the information included in the response received from the caching load balancer identifies the first and second devices as being the only devices of the network that cache the specified file,

the communication with the at least one of the devices referenced by the response received from the caching load balancer further includes a response received from the second device to notify the device that the specified file is missing at the second device, and

the notification to the caching load balancer further includes information that the specified file is missing at the second device, and

the circuit electronics are further configured to

in response to having determined that the specified file is missing at the devices referenced by the response received from the caching load balancer, request the specified file from the file server system, and

receive from the file server system a response including the specified file.

8. The device of claim 1, where

responsive to a result of the determination being that the stored information is stale, the circuit electronics are configured to

discard the stored information, and

request, from the caching load balancer, information that identifies at least one of the three or more devices of the network that currently cache the specified file, and

responsive to a result of the determination being that the stored information is fresh, the circuit electronics are configured to communicate with at least one device referenced by the stored information identifying the one or more devices of the three or more devices of the network that cache the specified file to retrieve the specified file.

9. The device of claim 8, where the device communicates with only one device referenced by the stored information, and the circuit electronics are configured to, responsive to the communication conveying that the specified file is missing at the one device,

discard the stored information, and

request, from the caching load balancer, information that identifies at least one of the three or more devices of the network that currently cache the specified file.

10. A method comprising:

detecting, by a device connected with a network that includes a caching load balancer and three or more devices, which include the device, configured to cache data associated with a file server system, such that the devices have respective connections with the file server system, that a specified file is not cached on memory of the device;

requesting, by the device from the caching load balancer in response to the detecting, information that identifies at least one of the three or more devices of the network that cache the specified file;

receiving, by the device from the caching load balancer, a response including information identifying one or more devices of the three or more devices of the network that cache the specified file;

communicating, by the device, with at least one device of the one or more devices referenced by the response received from the caching load balancer to retrieve the specified file;

retrieving and caching, by the device, the specified file based on the communication with the at least one device referenced by the response received from the caching load balancer;

providing, by the device to the caching load balancer, a notification including an identity of the at least one device referenced by the response received from the caching load balancer with which the device has communicated to retrieve the specified file, and a confirmation that the specified file is cached on the memory of the device;

storing, by the device, the information included in the response received from the caching load balancer identifying the one or more devices of the three or more devices of the network that cache the specified file;

detecting, by the device, a cache miss upon an attempt to locally re-access the specified file; and

determine, by the device responsive to having detected the cache miss, whether the stored information identifying the one or more devices of the three or more devices of the network that cache the specified file is fresh or stale, prior to using the stored information to re-obtain the specified file,

wherein the stored information identifying the one or more devices of the three or more devices of the network that cache the specified file is fresh if the information was stored for a time interval shorter than a predefined duration, and is stale if the information was stored for a time interval longer than or equal to the predefined duration.

11. The method of claim 10, wherein

the information included in the response received from the caching load balancer includes permission information associated with an instance of the specified file that is cached at the identified one or more devices of the network, and

the method further comprises

prior to detecting that the specified file is not cached on the memory of the device, requesting, by the device, to access the specified file to perform a given action;

and

selecting, by the device, the at least one device for communication based on a permission associated with an instance of the specified file cached at the at least one device meeting a permission corresponding to the given action.

12. The method of claim 11, wherein

the information included in the response received from the caching load balancer identifies multiple devices, and

includes respective caching loads of the identified multiple devices, and

the method further comprising carrying out the communication with the at least one device of the identified multiple devices in an order based on criteria including

a predefined quantity of network hops between the device and the identified multiple devices, and

a predefined caching load level of the identified multiple devices.

13. The method of claim 10, wherein

the communicating with the at least one device referenced by the response received from the caching load balancer includes

requesting, from a first device referenced by the response received from the caching load balancer, to provide the specified file, and

receiving, from the first device, a response including the specified file, and

the providing the notification to the caching load balancer includes transmitting the identity of the first device.

14. The method of claim 10, wherein

the communicating with the at least one device referenced by the response received from the caching load balancer includes

requesting provision of the specified file from a first device referenced by the response received from the caching load balancer,

receiving from the first device a response to notify the device that the specified file is missing at the first device, and

transmitted, upon receipt of the response from the first device, a request to a second device referenced by the response received from the caching load balancer to provide the specified file, and

the providing the notification to the caching load balancer includes transmitting the identities of the first and second devices and information that the specified file is missing at the first device.

15. The method of claim 14, wherein the communicating with the at least one device referenced by the response received from the caching load balancer further includes receiving from the second device a response including the specified file.

16. The method of claim 14, wherein

the information included in the response received from the caching load balancer identifies the first and second devices as being the only devices of the network that cache the specified file,

the communicating with the at least one of the devices referenced by the response received from the caching load balancer further includes receiving from the second device a response to notify the device that the specified file is missing at the second device,

the providing the notification to the caching load balancer further includes transmitting information that the specified file is missing at the second device, and

the method further comprises

in response to having determined that the specified file is missing at the devices referenced by the response received from the caching load balancer, requesting, by the device, the specified file from the file server system;

and

receiving, by the device from the file server system, a response including the specified file.

17. The method of claim 10, further comprising:

responsive to a result of the determination being that the stored information is stale,

discarding the stored information by the device, and

requesting, by the device from the caching load balancer, information that identifies at least one of the three or more devices of the network that currently cache the specified file; and

responsive to a result of the determination being that the stored information is fresh, communicating, by the device, with at least one device referenced by the stored information identifying the one or more devices of the three or more devices of the network that cache the specified file to retrieve the specified file.

18. The method of claim 17, wherein

the device communicates with only one device referenced by the stored information, and

responsive to the communication conveying that the specified file is missing at the one device, the method further comprises

discarding the stored information by the device, and

requesting, by the device from the caching load balancer, information that identifies at least one of the three or more devices of the network that currently cache the specified file.