System and method for processing data over a distributed network

• US 20030220960A1
• Filed: 05/21/2002
• Published: 11/27/2003
• Est. Priority Date: 05/21/2002
• Status: Abandoned Application

• Current Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Original Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Inventors: Wolff, Alan S., Demoff, Jeff S., Harrisville-Wolff, Carol
• Application Number:
  US10/152,667
• Publication Number:
  US 20030220960A1
• Time in Patent Office: Days
• US Class Current: 718/104
• CPC Class Codes: G06F 9/5072 Grid computing

Abstract

A system and method for processing data over a distributed network is disclosed. The distributed network includes a plurality of nodes and a central machine coupled to the nodes. The central machine receives a data space and partitions the data space into data blocks. The data blocks are sent to the nodes. Each node analyzes a received data block using an optimization algorithm forwarded by the central machine. Results that may be of interest to other data blocks are detected during the analysis and forwarded from the nodes to the central machine at an interval. The central machine forwards the results to the other nodes within the distributed network in order to update their processing of the data blocks. The updating activity continues until the data blocks have been processed.

Claims

1. A system for processing a data workspace over a distributed network, comprising:

a central machine to partition said data workspace into data blocks;

a plurality of nodes to receive said data blocks, wherein said plurality of nodes are coupled to said central machine; and

a plurality of optimization algorithms on said plurality of nodes, wherein said plurality of optimization algorithms executes against said data blocks and reports results to said central machine at periodic intervals.

2. The system of claim 1, further comprising an optimization agent on said central machine to exchange information between said central machine and said plurality of optimization algorithms.

3. The system of claim 1, wherein said plurality of optimization algorithms is sent to said plurality of nodes with said data blocks.

4. The system of claims 1, wherein said central machine updates said nodes with said results from said plurality of optimization algorithms.

5. The system of claim 1, wherein said plurality of optimization algorithms is copied from an optimization algorithm on said central machine.

6. The system of claim 1, further comprising a plurality of node optimization agents on said plurality of nodes, wherein said plurality of node optimization agents are coupled to said central machine.

7. The system of claim 1, wherein said plurality of nodes includes at least two node.

8. The system of claim 1, wherein said results are forwarded to said plurality of nodes for processing said data blocks.

9. A system for analyzing a data space within a distributed network having a plurality of nodes coupled to a central machine, comprising:

a first node from said plurality of nodes to process a data block partitioned from said data space;

an optimization algorithm received from said central machine to execute on said first node in correlation with said data block;

a node optimization agent on said first node to report to said central machine a result of said optimization algorithm and to update said plurality of nodes with said result.

10. The system of claim 9, wherein said result is a data packet from said first node.

11. The system of claim 9, further comprising a second node from said plurality of nodes, wherein said second node receives said result from said central machine.

12. The system of claim 11, wherein said second node updates another optimization algorithm with said result such that an analysis of another data block on said second node accounts for said result.

13. The system of claim 12, wherein said another optimization algorithm is received from said central machine.

14. The system of claim 12, wherein said another optimization algorithm is a copy of said optimization algorithm.

15. The system of claim 9, further comprising an optimization agent on said central machine to coordinate data exchange from said central machine to said plurality of nodes.

16. A method for processing a data space over a distributed network having a plurality of nodes, comprising:

partitioning said data space into a plurality of data blocks on a central machine;

sending said plurality of data blocks to said plurality of nodes;

analyzing said plurality of data blocks at said plurality of nodes;

executing a plurality of optimization algorithms at said plurality of nodes, wherein each of said plurality of optimization algorithms correlate to each of said plurality of data blocks; and

updating said plurality of optimization algorithms at an interval from said central machine.

17. The method of claim 16, further comprising detecting optimization information from said plurality of optimization algorithms.

18. The method of claim 16, further comprising receiving said data space at said distributed network.

19. The method of claim 16, further comprising sending said plurality of optimization algorithms to said plurality of nodes from said central machine.

20. The method of claim 16, further comprising updating said central machine at another interval with results from said plurality of optimization algorithms.

21. The method of claim 16, further comprising determining whether said analyzing step is complete.

22. The method of claim 21, further comprising returning computation results to said central machine.

23. The method of claim 21, further comprising returning optimization results to said central machine.

24. A method for updating an optimization algorithm on a node within a distributed network, comprising:

receiving an update from a central machine coupled to said node, wherein said node analyzes a data block according to said optimization algorithm;

determining whether said update is applicable to said data block; and

modifying the order of analysis of said data block in accordance with said update.

25. The method of claim 24, further comprising forwarding a result from said optimization algorithm to said central machine.

26. The method of claim 25, wherein said forwarding includes forwarding at an interval.

27. The method of claim 24, further comprising receiving said optimization algorithm at said node from said central machine.

28. The method of claim 24, further comprising receiving said data block at said node from said central machine.

29. The method of claim 24, wherein said distributed network includes a plurality of nodes.

30. A method for processing data over a distributed network, comprising:

partitioning a data space into data blocks;

distributing said data blocks to nodes within said distributed network;

receiving optimization algorithms at said nodes from a central machine within said distributed network;

analyzing said data blocks at said nodes using said optimization algorithms;

forwarding results from said analyzing to said central machine; and

updating said optimization algorithms according to said results.

31. The method of claim 30, further comprising copying said optimization algorithms from a stored optimization algorithm on said central machine.

32. The method of claim 30, further comprising executing said optimization algorithms on said nodes.

33. The method of claim 30, further comprising indicating to said central machine when said analyzing is complete.

34. A system for processing a data space over a distributed network having a plurality of nodes, comprising:

means for partitioning said data space into a plurality of data blocks on a central machine;

means for sending said plurality of data blocks to said plurality of nodes;

means for analyzing said plurality of data blocks at said plurality of nodes;

means for executing a plurality of optimization algorithms at said plurality of nodes, wherein each of said plurality of optimization algorithms correlate to each of said plurality of data blocks; and

means for updating said plurality of optimization algorithms at an interval from said central machine.

35. A computer program product comprising a computer useable medium having computer readable code embodied therein for processing a data space over a distributed network having a plurality of nodes, the computer program product adapted when run on a computer to execute steps, including:

processing a data space over a distributed network having a plurality of nodes, comprising;

partitioning said data space into a plurality of data blocks on a central machine;

sending said plurality of data blocks to said plurality of nodes;

analyzing said plurality of data blocks at said plurality of nodes;

executing a plurality of optimization algorithms at said plurality of nodes, wherein each of said plurality of optimization algorithms correlate to each of said plurality of data blocks; and

updating said plurality of optimization algorithms at an interval from said central machine.

36. A system for updating an optimization algorithm on a node within a distributed network, comprising:

means for receiving an update from a central machine coupled to said node, wherein said node analyzes a data block according to said optimization algorithm;

means for determining whether said update is applicable to said data block; and

means for modifying the order of analysis of said data block in accordance with said update.

37. A computer program product comprising a computer useable medium having computer readable code embodied therein for updating an optimization algorithm on a node within a distributed network, the computer program product adapted when run on a computer to execute steps, including:

updating an optimization algorithm on a node within a distributed network, comprising;

receiving an update from a central machine coupled to said node, wherein said node analyzes a data block according to said optimization algorithm;

determining whether said update is applicable to said data block; and

modifying the order of analysis of said data block in accordance with said update.

38. A system for processing data over a distributed network, comprising:

means for partitioning a data space into data blocks;

means for distributing said data blocks to nodes within said distributed network;

means for receiving optimization algorithms at said nodes from a central machine within said distributed network;

means for analyzing said data blocks at said nodes using said optimization algorithms;

means for forwarding results from said analyzing to said central machine; and

means for updating said optimization algorithms according to said results.

39. A computer program product comprising a computer useable medium having computer readable code embodied therein for processing data over a distributed network, the computer program product adapted when run on a computer to execute steps, including:

processing data over a distributed network, comprising;

partitioning a data space into data blocks;

distributing said data blocks to nodes within said distributed network;

receiving optimization algorithms at said nodes from a central machine within said distributed network;

analyzing said data blocks at said nodes using said optimization algorithms;

forwarding results from said analyzing to said central machine; and

updating said optimization algorithms according to said results.