Efficient use of peer cache space in large scale file distributions

• US 8,219,632 B2
• Filed: 05/27/2009
• Issued: 07/10/2012
• Est. Priority Date: 05/27/2009
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Jarvis, Steven Armand, Orozco, Liliana, Vassberg, Brian George, Ledden, Douglas
• Primary Examiner(s): TRUONG, LAN DAI T
• Application Number:
  US12/472,788
• Publication Number:
  US 20100306252A1
• Time in Patent Office: 1,140 Days
• Field of Search: 709/213, 709/201, 709/202, 709/203, 709/232
• US Class Current: 709/213
• CPC Class Codes: G06F 16/172 Caching, prefetching or hoarding of files
• CPC Class Codes: G06F 16/1837 Management specially adapted to peer-to-peer storage networks topology management mechanisms of peer-to-peer networks H04L67/1042
• CPC Class Codes: H04L 67/104 Peer-to-peer [P2P] networks
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A mechanism for providing efficient use of peer cache space in large scale file distributions. A peer computer receives a download plan for a requested file. The download plan specifies a number of peer servers where the file is stored, a minimum number of peer servers required to store the file, and a saturation level for the file in the zone. When the peer computer downloads the file from one or more peer servers listed in the download plan, the peer computer determines whether the file is required to be cached at the peer computer by comparing the minimum number of peer servers in the plan required to store the file against the number of peer servers listed in the plan. If the minimum number required to store the file is greater the number of peer servers listed in the plan, the peer computer caches the file.

Claims

1. A computer implemented method for managing file caching in a peer-to-peer file distribution environment, the computer implemented method comprising:

receiving, at a peer computer in the file distribution environment, a download plan for a file, wherein the download plan comprises a number of peer servers within the file distribution environment where the file is stored and a minimum number of peer servers in the file distribution environment required to store the file;

responsive to downloading the file from one or more of the peer servers listed in the download plan, determining at the peer computer whether the file is required to be cached at the peer computer by comparing the minimum number of peer servers in the download plan required to store the file against the number of peer servers listed in the download plan; and

responsive to a determination that the minimum number of peer servers required to store the file in the download plan is greater than the number of peer servers listed in the download plan, caching the file at the peer computer.

2. The computer implemented method of claim 1, further comprising:

responsive to a determination that the minimum number of peer servers required to store the file in the download plan is not greater than the number of peer servers listed in the download plan, determining whether to cache the file at the peer computer by comparing a random number generated at the peer computer against a saturation level for the file as specified in the download plan;

responsive to a determination that the random number generated at the peer computer is equal to or less than the saturation level for the file in the download plan, caching the file at the peer computer; and

responsive to a determination that the random number generated at the peer computer is greater than the saturation level for the file in the download plan, refraining from caching the file at the peer computer.

3. The computer implemented method of claim 2, wherein the saturation level is a percentage value indicating a desired saturation percentage for the file in the file distribution environment.

4. The computer implemented method of claim 2, wherein the minimum number of peer servers and the saturation level for each file in the file distribution environment are set on one of an individual file basis, a file per zone basis, or a global basis.

5. The computer implemented method of claim 1, further comprising:

responsive to caching the file at the peer computer, sending a notification to a central management center that the peer computer has a copy of the file available for sharing among other peer computers in the file distribution environment.

6. An apparatus comprising:

a bus;

a storage device connected to the bus, wherein the storage device contains computer usable codes;

at least one managed device connected to the bus;

a communications unit connected to the bus; and

a processing unit connected to the bus, wherein the processing unit executes the computer usable codes to receive, at a peer computer in a file distribution environment, a download plan for a file, wherein the download plan comprises a number of peer servers within the file distribution environment where the file is stored, a minimum number of peer servers in the file distribution environment required to store the file;

determine at a peer computer, in response to downloading the file from one or more of the peer servers listed in the download plan, whether the file is required to be cached at the peer computer by comparing the minimum number of peer servers in the download plan required to store the file against the number of peer servers listed in the download plan; and

cache, in response to a determination that the minimum number of peer servers required to store the file in the download plan is greater than the number of peer servers listed in the download plan, the file at the peer computer.

7. The apparatus of claim 6, wherein the processing unit further executes the computer usable codes to determine, in response to a determination that the minimum number of peer servers required to store the file in the download plan is not greater than the number of peer servers listed in the download plan, whether to cache the file at the peer computer by comparing a random number generated at the peer computer against a saturation level for the file as specified in the download plan;

cache, in response to a determination that the random number generated at the peer computer is equal to or less than the saturation level for the file in the download plan, the file at the peer computer; and

refrain, in response to a determination that the random number generated at the peer computer is greater than the saturation level for the file in the download plan, from caching the file at the peer computer.

8. The apparatus of claim 7, wherein the saturation level is a percentage value indicating a desired saturation percentage for the file in the file distribution environment.

9. The apparatus of claim 7, wherein the minimum number of peer servers and the saturation level for each file in the file distribution environment are set on one of an individual file basis, a file per zone basis, or a global basis.

10. The apparatus of claim 6, wherein the processing unit further executes the computer usable code to send, in response to caching the file at the peer computer, a notification to a central management center that the peer computer has a copy of the file available for sharing among other peer computers in the file distribution environment.

11. A computer program product for managing file caching in a peer-to-peer file distribution environment, the computer program product comprising:

a computer usable storage device having computer usable program codes tangibly stored thereon, the computer usable program codes comprising;

computer usable program codes for receiving, at a peer computer in the file distribution environment, a download plan for a file, wherein the download plan comprises a number of peer servers within the file distribution environment where the file is stored, a minimum number of peer servers in the file distribution environment required to store the file;

computer usable program codes for determining at the peer computer, in response to downloading the file from one or more of the peer servers listed in the download plan, whether the file is required to be cached at the peer computer by comparing the minimum number of peer servers in the download plan required to store the file against the number of peer servers listed in the download plan; and

computer usable program codes for caching, in response to a determination that the minimum number of peer servers required to store the file in the download plan is greater than the number of peer servers listed in the download plan, the file at the peer computer.

12. The computer program product of claim 11, further comprising:

computer usable program code for determining in response to a determination that the minimum number of peer servers required to store the file in the download plan is not greater than the number of peer servers listed in the download plan, whether to cache the file at the peer computer by comparing a random number generated at the peer computer against a saturation level for the file as specified in the download plan;

computer usable program code for caching, in response to a determination that the random number generated at the peer computer is equal to or less than the saturation level for the file in the download plan, the file at the peer computer; and

computer usable program code for refraining, in response to a determination that the random number generated at the peer computer is greater than the saturation level for the file in the download plan, from caching the file at the peer computer.

13. The computer program product of claim 12, wherein the saturation level is a percentage value indicating a desired saturation percentage for the file in the file distribution environment.

14. The computer program product of claim 12, wherein the minimum number of peer servers and the saturation level for each file in the file distribution environment are set on one of an individual file basis, a file per zone basis, or a global basis.

15. The computer program product of claim 11, further comprising:

computer usable program code for sending, in response to caching the file at the peer computer, a notification to a central management center that the peer computer has a copy of the file available for sharing among other peer computers in the file distribution environment.

16. The computer program product of claim 11, wherein the computer usable program code is stored in a computer readable storage device in a data processing system, and wherein the computer usable program code is downloaded over a network from a remote data processing system.

17. The computer program product of claim 11, wherein the computer usable program code is stored in a computer readable storage device in a server data processing system, and wherein the computer usable program code is downloaded over a network from a remote data processing system for use in a computer readable storage device with the remote data processing system.