System and method for submitting and performing computational tasks in a distributed heterogeneous networked environment

• US 7,395,536 B2
• Filed: 11/14/2002
• Issued: 07/01/2008
• Est. Priority Date: 11/14/2002
• Status: Active Grant

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Inventors: Ruetsch, Gregory R., Sharapov, Ilya A., Verbeke, Jerome M., Vernik, Michael J., Nadgir, Neelakanth M., Trang, Vu
• Primary Examiner(s): An; Meng-Ai
• Assistant Examiner(s): Vo; Lilian
• Application Number:
  US10/294,073
• Publication Number:
  US 20040098447A1
• Time in Patent Office: 2,056 Days
• Field of Search: 718/100, 718/102, 718/104, 718/105, 709/200, 709/201, 709/202, 709/204, 709/205, 709/203
• US Class Current: 718/100
• CPC Class Codes: G06F 2209/509 Offload
• CPC Class Codes: G06F 9/5055 considering software capabilities, i.e. software resources associated or available to the machine
• CPC Class Codes: G06F 9/5072 Grid computing
• CPC Class Codes: H04L 12/185 with management of multicast group membership

Abstract

System and method for submitting and performing computational tasks in a distributed heterogeneous networked environment. Embodiments may allow tasks to be submitted and run in parallel on a network of heterogeneous computers implementing a variety of operating environments. In one embodiment, a user on an originating node may advertise code on the network. Peer nodes that respond to the advertisement may receive the code. A job to be executed by the code may be split into separate tasks to distributed to the peer nodes that received the code. These tasks may be advertised on the network. Tasks may be assigned to peer nodes that respond to the task advertisements. The peer nodes may then work on the assigned tasks. Once a peer node'"'"'s work on a task is completed, the peer node may return the results of the task to the originating node.

Claims

1. A peer-to-peer network system, comprising:

a plurality of peer nodes coupled to a network, wherein the plurality of peer nodes are configured to participate in a distributed computing framework on the network for submitting computational tasks in a distributed heterogeneous networked environment that utilizes peer groups to decentralize task dispatching and post-processing functions and enables a plurality of jobs to be managed and run simultaneously;

one of the plurality of peer nodes configured to;

broadcast a code advertisement for computer-executable code on the network;

provide the computer-executable code to each of the plurality of peer nodes that responds to the code advertisement with a request for code;

broadcast a task advertisement on the network for each of a plurality of tasks, wherein each of the tasks is configured to be executed by the code to perform a portion of a job; and

assign a different one of the plurality of tasks to each of the plurality of peer nodes that responds to the task advertisement such that two or more of the plurality of tasks are performed on two or more of the plurality of peer nodes in parallel to perform the job;

wherein each of the plurality of peer nodes assigned tasks is configured to;

perform the particular task assigned by the one of the plurality of peer nodes in accordance with the code received from the one of the plurality of peer nodes; and

return results of the task to the one of the plurality of peer nodes after completion of the task.

2. The peer-to-peer network system as recited in claim 1, wherein each of the plurality of peer nodes assigned tasks is further configured to:

store the code received from the one of the plurality of peer nodes to a local storage; and

load at least a portion of the code from the local storage into execution memory to perform the particular task assigned by the one of the plurality of peer nodes.

3. The peer-to-peer network system as recited in claim 1, wherein, to provide the code to each of the plurality of peer nodes that responds to the code advertisement with a request for the code, the one of the plurality of peer nodes is further configured to transmit the code to each of the plurality of peer nodes that responds to the code advertisement with a request for the code over the network according to a network information transfer protocol.

4. The peer-to-peer network system as recited in claim 3, wherein the network information transfer protocol is HTTP.

5. The peer-to-peer network system as recited in claim 1, wherein the plurality of peer nodes assigned tasks are member peers in a peer group according to a peer-to-peer platform.

6. The peer-to-peer network system as recited in claim 1, wherein, to assign a different one of the plurality of tasks to each of the plurality of peer nodes that responds to the task advertisements, the one of the plurality of peer nodes is further configured to provide an indication of the particular task to be performed to each of the plurality of peer nodes that responds to the task advertisement, wherein the indication of the particular task to be performed includes one or more parameters specifying the particular task.

7. The peer-to-peer network system as recited in claim 1, wherein, to assign a different one of the plurality of tasks to each of the plurality of peer nodes that responds to the task advertisements, the one of the plurality of peer nodes is further configured to transmit a specification of the particular task to be performed to each of the plurality of peer nodes that responds to the task advertisement over the network according to a network information transfer protocol.

8. The peer-to-peer network system as recited in claim 7, wherein the network information transfer protocol is HTTP.

9. The peer-to-peer network system as recited in claim 1, wherein the code is in a bytecode computer language.

10. The peer-to-peer network system as recited in claim 1, wherein the code is Java code.

11. The peer-to-peer network system as recited in claim 1, wherein the one of the plurality of peer nodes and at least one of the plurality of peer nodes assigned tasks are on opposite sides of a firewall.

12. The peer-to-peer network system as recited in claim 1, wherein the plurality of peer nodes are configured to participate in a peer-to-peer environment on the network in accordance with one or more peer-to-peer platform protocols for enabling the peer nodes to discover each other, communicate with each other, and cooperate with each other to form peer groups in the peer-to-peer environment.

13. A peer-to-peer network system, comprising:

a plurality of peer nodes coupled to a network, wherein the plurality of peer nodes are configured to participate in a distributed computing framework on the network for submitting computational tasks in a distributed heterogeneous networked environment that utilizes peer groups to decentralize task dispatching and post-processing functions and enables a plurality of jobs to be managed and run simultaneously;

a subset of the plurality of peer nodes, wherein each of the subset of the plurality of peer nodes is configured to;

receive a code advertisement for computer-executable code from one of the plurality of peer nodes on the network;

send a request for code to the one of the plurality of peer nodes on the network in response to the code advertisement;

receive the code from the one of the plurality of peer nodes on the network in response to the request for code;

access a task advertisement from the one of the plurality of peer nodes on the network, wherein the task advertisement specifies one of a plurality of tasks configured to be executed in parallel by the code on the subset of the plurality of peer nodes, and wherein the one of the plurality of tasks is configured to perform a portion of a job;

send a request for the task to the one of the plurality of peer nodes in response to the task advertisement;

receive a task assignment from the one of the plurality of peer nodes in response to the request for the task;

perform the particular task assigned by the one of the plurality of peer nodes in accordance with the code; and

return results of the task to the one of the plurality of peer nodes when the task is completed.

14. The peer-to-peer network system as recited in claim 13, wherein each of the a subset of the plurality of peer nodes is further configured to:

store the code in a local storage; and

load at least a portion of the code from the local storage into execution memory to perform the particular task received from the one of the plurality of peer nodes.

15. The peer-to-peer network system as recited in claim 13, wherein each of the subset of the plurality of peer nodes is further configured to receive the code from the one of the plurality of peer nodes in response to the request for the code over the network according to a network information transfer protocol.

16. The peer-to-peer network system as recited in claim 15, wherein the network information transfer protocol is HTTP.

17. The peer-to-peer network system as recited in claim 13, wherein the subset of the plurality of peer nodes are member peers in a peer group according to a peer-to-peer platform.

18. The peer-to-peer network system as recited in claim 13, wherein each task assignment includes one or more parameters specifying a particular task.

19. The peer-to-peer network system as recited in claim 13, wherein, to receive a task assignment from the one of the plurality of peer nodes in response to the request for the task, each of the subset of the plurality of peer nodes is further configured to receive a specification of the particular task to be performed from the one of the plurality of peer nodes over the network according to a network information transfer protocol.

20. The peer-to-peer network system as recited in claim 19, wherein the network information transfer protocol is HTTP.

21. The peer-to-peer network system as recited in claim 13, wherein the code is in a bytecode computer language.

22. The peer-to-peer network system as recited in claim 13, wherein the code is Java code.

23. The peer-to-peer network system as recited in claim 13, wherein the one of the plurality of peer nodes and at least one of the subset of the plurality of peer nodes are on opposite sides of a firewall.

24. The peer-to-peer network system as recited in claim 13, wherein the plurality of peer nodes are configured to participate in a peer-to-peer environment on the network in accordance with one or more peer-to-peer platform protocols for enabling the peer nodes to discover each other, communicate with each other, and cooperate with each other to form peer groups in the peer-to-peer environment.

25. A peer-to-peer network system, comprising:

means for broadcasting an advertisement of computer-executable code on a network;

means for providing the computer-executable code to each of a plurality of peer nodes that responds to said advertisement of computer-executable code with a request for code on a network, wherein the plurality of peer nodes are configured to participate in a distributed computing framework on the network for submitting computational tasks in a distributed heterogeneous networked environment that utilizes peer groups to decentralize task dispatching and post-processing functions and enables a plurality of jobs to be managed and run simultaneously;

means for broadcasting an advertisement of the plurality of tasks on the network;

means for assigning a different one of the plurality of tasks to each of a group of peer nodes that responds to said advertisement of the plurality of tasks; and

means for executing the plurality of tasks in parallel on the group of peer nodes in accordance with the code received to perform the job.

26. A method, comprising:

a peer node on a network broadcasting a code advertisement for computer-executable code on a network;

the peer node receiving requests for code sent from other peer nodes on the network in response to the code advertisement;

the peer node providing the computer-executable code to each of said other peer nodes on the network;

the peer node broadcasting a task advertisement on the network for each of a plurality of tasks, wherein each of the tasks is configured to be executed by the code to perform a portion of a job;

the peer node receiving responses to the task advertisement from a plurality of peer nodes on the network, wherein the plurality of peer nodes are configured to participate in a distributed computing framework on the network for submitting computational tasks in a distributed heterogeneous networked environment that utilizes peer groups to decentralize task dispatching and post-processing functions and enables a plurality of jobs to be managed and run simultaneously;

the peer node assigning a different one of the plurality of tasks to each of the plurality of peer nodes that responds to the task advertisement such that two or more of the plurality of tasks are performed on two or more of the plurality of peer nodes in parallel to perform the job;

each of the plurality of peer nodes assigned tasks performing the particular task assigned by the peer node in accordance with the code received from the one of the plurality of peer nodes; and

each of the plurality of peer nodes assigned tasks returning results of the task to the peer node after completion of the task.

27. The method as recited in claim 26, further comprising:

each of said other peer nodes storing the code received from the one of the plurality of peer nodes to a local storage; and

each of said other peer nodes loading at least a portion of the code from the local storage into execution memory to perform the particular task assigned by the one of the plurality of peer nodes.

28. The method as recited in claim 26, wherein said providing the code to each of the plurality of peer nodes that responds to the code advertisement with a request for the code comprises the one of the plurality of peer nodes transmitting the code to each of the plurality of peer nodes that responds to the code advertisement with a request for the code over the network according to a network information transfer protocol.

29. The method as recited in claim 28, wherein the network information transfer protocol is HTTP.

30. The method as recited in claim 26, wherein the plurality of peer nodes assigned tasks are member peers in a peer group according to a peer-to-peer platform.

31. The method as recited in claim 26, wherein said assigning a different one of the plurality of tasks to each of the plurality of peer nodes that responds to the task advertisements comprises the one of the plurality of peer nodes providing an indication of the particular task to be performed to each of the plurality of peer nodes that responds to the task advertisement, wherein the indication of the particular task to be performed includes one or more parameters specifying the particular task.

32. The method as recited in claim 26, wherein said assigning a different one of the plurality of tasks to each of the plurality of peer nodes that responds to the task advertisements comprises the one of the plurality of peer nodes transmitting a specification of the particular task to be performed to each of the plurality of peer nodes that responds to the task advertisement over the network according to a network information transfer protocol.

33. The method as recited in claim 32, wherein the network information transfer protocol is HTTP.

34. The method as recited in claim 26, wherein the code is in a bytecode computer language.

35. The method as recited in claim 26, wherein the code is Java code.

36. The method as recited in claim 26, wherein the one of the plurality of peer nodes and at least one of the plurality of peer nodes assigned tasks are on opposite sides of a firewall.

37. The method as recited in claim 26, wherein the plurality of peer nodes are configured to participate in a peer-to-peer environment on the network in accordance with one or more peer-to-peer platform protocols for enabling the peer nodes to discover each other, communicate with each other, and cooperate with each other to form peer groups in the peer-to-peer environment.

38. A tangible computer readable storage medium, comprising program instructions, wherein the program instructions are configured to implement:

a peer node on a network broadcasting a code advertisement for computer-executable code on a network;

the peer node receiving requests for code sent from other peer nodes on the network in response to the code advertisement;

the peer node providing the computer-executable code to each of said other peer nodes on the network;

the peer node broadcasting a task advertisement on the network for each of a plurality of tasks, wherein each of the tasks is configured to be executed by the code to perform a portion of the job;

the peer node receiving responses to the task advertisements from a plurality of peer nodes on the network, wherein the plurality of peer nodes are configured to participate in a distributed computing framework on the network for submitting computational tasks in a distributed heterogeneous networked environment that utilizes peer groups to decentralize task dispatching and post-processing functions and enables a plurality of jobs to be managed and run simultaneously;

the peer node assigning a different one of the plurality of tasks to each of the plurality of peer nodes that responds to the task advertisements such that two or more of the plurality of tasks are performed on two or more of the plurality of peer nodes in parallel to perform the job;

each of the plurality of peer nodes assigned tasks performing the particular task assigned by the peer node in accordance with the code received from the one of the plurality of peer nodes; and

each of the plurality of peer nodes assigned tasks returning results of the task to the peer node after completion of the task.

39. The tangible computer readable storage medium as recited in claim 38, wherein the program instructions are further configured to implement:

each of said other peer nodes storing the code received from the one of the plurality of peer nodes to a local storage; and

each of said other peer nodes loading at least a portion of the code from the local storage into execution memory to perform the particular task assigned by the one of the plurality of peer nodes.

40. The tangible computer readable storage medium as recited in claim 38, wherein, in said providing the code to each of the plurality of peer nodes that responds to the code advertisement with a request for the code, the program instructions are further configured to implement the one of the plurality of peer nodes transmitting the code to each of the plurality of peer nodes that responds to the code advertisement with a request for the code over the network according to a network information transfer protocol.

41. The tangible computer readable storage medium as recited in claim 40, wherein the network information transfer protocol is HTTP.

42. The tangible computer readable storage medium as recited in claim 38, wherein the plurality of peer nodes assigned tasks are member peers in a peer group according to a peer-to-peer platform.

43. The tangible computer readable storage medium as recited in claim 38, wherein, in said assigning a different one of the plurality of tasks to each of the plurality of peer nodes that responds to the task advertisements, the program instructions are further configured to implement the one of the plurality of peer nodes providing an indication of the particular task to be performed to each of said other peer nodes, wherein the indication of the particular task to be performed includes one or more parameters specifying the particular task.

44. The tangible computer readable storage medium as recited in claim 38, wherein, in said assigning a different one of the plurality of tasks to each of the plurality of peer nodes that responds to the task advertisements, the program instructions are further configured to implement the one of the plurality of peer nodes transmitting a specification of the particular task to be performed to each of said other peer nodes over the network according to a network information transfer protocol.

45. The tangible computer readable storage medium as recited in claim 44, wherein the network information transfer protocol is HTTP.

46. The tangible computer readable storage medium as recited in claim 38, wherein the code is in a bytecode computer language.

47. The tangible computer readable storage medium as recited in claim 38, wherein the code is Java code.

48. The tangible computer readable storage medium as recited in claim 38, wherein the one of the plurality of peer nodes and at least one of the plurality of peer nodes assigned tasks are on opposite sides of a firewall.

49. The tangible computer readable storage medium as recited in claim 38, wherein the plurality of peer nodes are configured to participate in a peer-to-peer environment on the network in accordance with one or more peer-to-peer platform protocols for enabling the peer nodes to discover each other, communicate with each other, and cooperate with each other to form peer groups in the peer-to-peer environment.