Apparatus, system, and method for selecting optimal replica sources in a grid computing environment

• US 20060031266A1
• Filed: 08/03/2004
• Published: 02/09/2006
• Est. Priority Date: 08/03/2004
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Xu, Jian, Colbeck, Scott Joseph, Gupta, Vandana
• Granted Patent: US 8,521,687 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/1844 Management specifically adapted to replicated file systems

Abstract

An apparatus, system, and method are disclosed for selecting optimal replica sources in a grid computing environment. As disclosed, the present invention overcomes shortcomings in the art involving location and selection of replica sources. In particular, the present invention selects an optimal replica source based on current and historical network statistics, as well as user-defined policies. The user-defined policies allow for customization of the replica source search, and the option of obtaining multiple ranked sources for parallel data transfer.

Claims

1. An apparatus to select an optimal replica source in a grid computing environment, the apparatus comprising:

a search module configured to locate existing replica source information including a mapping of logical replica source names to physical locations;

a collection module configured to collect current network statistics for candidate replica sources; and

a determination module configured to determine an identifier for an optimal replica source in response to historical network statistics and current network statistics.

2. The apparatus of claim 1, wherein the apparatus further comprises a user policy module configured to determine the identifier of the optimal replica source in response to one or more user-defined policies, the policies establishing rules for preferred attributes of the optimal replica source.

3. The apparatus of claim 2, wherein the user-defined policies are selected from the group consisting of file size, membership of the replica source in a preferred set of replica sources, proximity of the replica source, network response time, workload of a host for the replica source, and bandwidth of the connection to the replica source.

4. The apparatus of claim 2, wherein the user-defined policy rules are weighted according to at least one preferred attribute.

5. The apparatus of claim 2, wherein the user policy module is further configured to define a desired number of replica sources to identify, the number of replica source ordered from an optimal replica source to a less optimal replica source, the multiple replica sources utilized in a parallel data transfer to create a replica.

6. The apparatus of claim 1, wherein the determination module is further configured to calculate network congestion between a replica destination and candidate replica sources, the calculation including both historical network statistics and current network statistics, the network statistics including statistics on grid traffic and statistics on other network traffic.

7. The apparatus of claim 1, wherein the search module is configured to communicate directly with a Replica Location Service.

8. An apparatus to select an optimal replica source in a grid computing environment, the apparatus comprising:

a receiving module configured to receive a request for an optimal replica source location from a requesting file system;

a search module configured to locate existing replica source information including a mapping of logical replica source names to physical locations;

a collection module configured to collect current network statistics for candidate replica sources;

a determination module configured to determine an identifier for an optimal replica source in response to historical network statistics and current network statistics; and

a sending module configured to send the identifier of the optimal replica source to the requesting file system.

9. The apparatus of claim 8, wherein the apparatus further comprises a user policy module configured to determine the identifier of the optimal replica source in response to one or more user-defined policies, the policies establishing rules for preferred attributes of the optimal replica source as defined by the requesting file system.

10. The apparatus of claim 9, wherein the user-defined policies are selected from the group consisting of file size, membership of the replica source in a preferred set of replica sources, proximity of the replica source to the requesting file system, network response time, workload of a host for the replica source, and bandwidth of the connection to the replica source.

11. The apparatus of claim 9, wherein the user-defined policy rules are weighted according to at least one preferred attribute.

12. The apparatus of claim 9, wherein the user policy module is further configured to define a desired number of replica sources to identify, the number of replica source ordered from an optimal replica source to a less optimal replica source, the multiple replica sources utilized in a parallel data transfer to create a replica on the requesting file system.

13. The apparatus of claim 8, wherein the determination module is further configured to calculate network congestion between the requesting file system and candidate replica sources, the calculation including both historical network statistics and current network statistics, the network statistics including statistics on grid traffic and statistics on other network traffic.

14. The apparatus of claim 8, wherein the search module is configured to communicate directly with a Replica Location Service.

15. A system to select an optimal replica source in a grid computing environment, the system comprising:

at least one replica destination;

at least one replica source;

an optimal source selector comprising;

a search module configured to locate existing replica source information including a mapping of logical replica source names to physical locations;

a collection module configured to collect current network statistics for candidate replica sources; and

a determination module configured to determine an identifier for an optimal replica source in response to historical network statistics and current network statistics; and

an interface to the replica source selection device.

16. The system of claim 15, wherein the replica source selection device further comprises a user policy module configured to determine the identifier of the optimal replica source in response one or more to user-defined policies, the policies establishing rules for preferred attributes of the optimal replica source.

17. The system of claim 16, wherein the user policy module is further configured to define a desired number of replica sources to identify, the number of replica source ordered from an optimal replica source to a less optimal replica source, the multiple replica sources utilized in a parallel data transfer to create a replica.

18. The system of claim 17, wherein the user-defined policies are selected from the group consisting of file size, membership of the replica source in a preferred set of replica sources, proximity of the replica source, network response time, workload of a host for the replica source, and bandwidth of the connection to the replica source.

19. The system of claim 18, wherein the user-defined policy rules are weighted according to at least one preferred attribute.

20. The system of claim 19, wherein the determination module is further configured to calculate network congestion between a replica destination and candidate replica sources, the calculation including both historical network statistics and current network statistics, the network statistics including statistics on grid traffic and statistics on other network traffic.

21. The System of claim 20, wherein the search module is configured to communicate directly with a Replica Location Service.

22. A signal bearing medium tangibly embodying a program of machine-readable instructions executable by a digital processing apparatus to perform operations to select an optimal replica source in a grid computing environment, the operations comprising:

an operation to search existing replica source information including a mapping of logical replica source names to physical locations;

an operation to collect current network statistics for candidate replica sources; and

an operation to determine an identifier for an optimal replica source in response to historical network statistics and current network statistics.

23. The signal bearing medium of claim 22, wherein the instructions further comprises an operation to determine the identifier of the optimal replica source in response to one or more user-defined policies, the policies establishing rules for preferred attributes of the optimal replica source.

24. The signal bearing medium of claim 23, wherein the user-defined policies are selected from the group consisting of file size, membership of the replica source in a preferred set of replica sources, proximity of the replica source, network response time, workload of a host for the replica source, and bandwidth of the connection to the replica source.

25. The signal bearing medium of claim 23, wherein the user-defined policy rules are weighted according to at least one preferred attribute.

26. The signal bearing medium of claim 22, wherein the instructions further comprise an operation to calculate network congestion between a replica destination and candidate replica sources, the calculation including both historical network statistics and current network statistics, the network statistics including statistics on grid traffic and statistics on other network traffic.

27. The signal bearing medium of claim 22, wherein the instructions further comprise an operation to communicate directly with a Replica Location Service.

28. The signal bearing medium of claim 22, wherein the instructions further comprise an operation to define a desired number of replica sources to identify, the number of replica source ordered from an optimal replica source to a less optimal replica source, the multiple replica sources utilized in a parallel data transfer to create a replica.

29. A method for selecting an optimal replica source in a grid computing environment, the method comprising:

searching existing replica source information including a mapping of logical replica source names to physical locations;

collecting current network statistics for candidate replica sources; and

determining an identifier for an optimal replica source in response to historical network statistics and current network statistics.

30. An apparatus to select an optimal replica source in a grid computing environment, the apparatus comprising:

means for searching existing replica source information including a mapping of logical replica source names to physical locations;

means for collecting current network statistics for candidate replica sources; and

means for determining an identifier for an optimal replica source in response to historical network statistics and current network statistics.