System and method for territory-based processing of information

• US 8,200,746 B2
• Filed: 11/10/2011
• Issued: 06/12/2012
• Est. Priority Date: 09/07/2002
• Status: Expired due to Fees

• Current Assignee: Appistry Incorporated
• Original Assignee: Appistry Incorporated
• Inventors: Hinni, Aaron Louis, Semones, Guerry Anderson, Groner, Michael Scott, Lozano, Roberto Raul
• Primary Examiner(s): WASEL, MOHAMED A
• Application Number:
  US13/293,527
• Publication Number:
  US 20120059870A1
• Time in Patent Office: 215 Days
• Field of Search: 709201-203, 709/223, 709/224
• US Class Current: 709/202
• CPC Class Codes: H04L 41/00 Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
• CPC Class Codes: H04L 41/046 comprising network management agents or mobile agents therefor
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/51 Discovery or management thereof, e.g. service location protocol [SLP] or web services
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
• CPC Class Codes: H04L 69/163 In-band adaptation of TCP data exchange; In-band control procedures

Abstract

A system and method for processing information leverages territory-based processing capabilities to provide efficient distributed processing of processing jobs. For example, hive engines can be organized into territories based on their physical locations to support the distributed processing of processing jobs within particular territories.

Claims

1. A system for processing information, the system comprising:

a plurality of networked hive engines, a plurality of the hive engines being grouped into a plurality of territories;

wherein at least one of the hive engines is configured to receive a service request for a processing job, the processing job comprising a plurality of processing tasks for execution by a plurality of hive engines within at least one territory;

wherein a plurality of the hive engines within the at least one territory are configured to perform the processing job in a distributed manner such that the processing tasks of the processing job are distributed to a plurality of hive engines within the at least one territory for execution thereby; and

wherein the plurality of hive engines within the at least one territory that execute the processing tasks are further configured to return state information corresponding to the processing tasks for delivery of a processing result in response to the service request.

2. The system of claim 1 wherein a plurality of the hive engines have an associated physical location, and wherein the plurality of the hive engines having an associated physical location are grouped into the territories based on their associated physical locations such that each territory comprises a plurality of hive engines having an associated physical location within that territory.

3. The system of claim 2 wherein the hive engines are configured to perform distributed processing of the processing tasks of the processing job via a plurality of hive engines within a plurality of different territories.

4. The system of claim 2 wherein the hive engines are configured to perform distributed processing of the processing tasks of the processing job via a plurality of hive engines within the same territory.

5. The system of claim 4 wherein the at least one of the hive engines is configured to receive a service request for a processing job from a client computer.

6. The system of claim 5 wherein the territory within which the processing tasks are performed comprises a territory corresponding to a selection received from the client computer.

7. The system of claim 6 wherein the hive engines comprise a plurality of request handlers, a plurality of process handlers, and a plurality of task handlers, and wherein each territory comprises a plurality of the request handlers, a plurality of the process handlers, and a plurality of the task handlers.

8. The system of claim 7 wherein at least one of the request handlers is configured to (1) receive the service request from the client computer, (2) select at least one of the process handlers within the selected territory to process the processing job, and (3) provide data corresponding to the processing job to the selected process handler.

9. The system of claim 8 wherein the selected process handler is configured to (1) receive data corresponding to the processing job, (2) select a plurality of the task handlers within the selected territory to execute the processing tasks of the processing job, and (3) manage the selected task handlers with respect to execution by the selected task handlers of the processing tasks of the processing job.

10. The system of claim 9 wherein the at least one request handler is further configured to select at least one of the processing handlers to process the processing job based on the territory within which each process handler resides.

11. The system of claim 10 wherein the at least one request handler is further configured to (1) send a processing job request to a plurality of process handlers,(2) receive a plurality of responses to the processing job request from a plurality of process handlers, and (3) select at least one of the responsive processing handlers based on the territory within which each responsive process handler resides.

12. The system of claim 11 wherein the at least one request handler is further configured to send the processing job request to a multicast address associated with a plurality of process handlers.

13. The system of claim 11 wherein the selected process handler is further configured to (1) send a processing task request to a plurality of task handlers, (2) receive a plurality of responses to the processing task request from a plurality of task handlers, and (3) select at least one of the responsive task handlers based on the territory within which each responsive task handler resides.

14. The system of claim 13 wherein the selected process handler is further configured to send the processing job request to a multicast address associated with a plurality of task handlers.

15. The system of claim 9 wherein the at least one request handler, the selected process handlers, and the selected task handlers are configured to process the process job according to a process definition file corresponding to the processing job, the process definition file being configured to define a process flow for the processing job, the process flow comprising the plurality of processing tasks, a plurality of state variables before and after each processing task for storing state information, and a definition of a sequence for the processing tasks.

16. The system of claim 15 wherein the process definition file further comprises a recovery procedure for a plurality of the processing tasks.

17. The system of claim 15 wherein the process definition file comprises an XML process definition file.

18. The system of claim 9 wherein the selected process handler is further configured to (1) progressively receive state information from the selected task handlers in response to the selected task handlers completing their processing tasks, (2) progressively provide the received state information to the at least one request handler, and (3) notify the at least one request handler when all of the selected task handlers have executed their processing tasks to thereby inform the at least one request handler that the processing job is complete and that the processing result can be delivered to the client computer.

19. The system of claim 7 wherein a plurality of the networked hive engines comprise both a process handler and a task handler.

20. The system of claim 6 wherein the plurality of hive engines comprise a plurality of request handlers, the plurality of request handlers being within a plurality of the territories, the system further comprising the client computer, the client computer configured to select at least one request handler based on the territory within which the selected at least one request handler resides, and wherein the selected at least one request handler is configured to initiate a plurality of the hive engines within the selected territory to perform the processing job in the distributed manner.

21. The system of claim 6 wherein at least one of the networked hive engines that is within a territory other than the selected territory is configured to redundantly store the state information.

22. The system of claim 4 wherein the hive engines are configured to store state recover information for processing jobs in the hive engines of a different territory.

23. The system of claim 1 wherein a plurality of the hive engines have an associated quality, and wherein the plurality of the hive engines having an associated quality are grouped into the territories based on their associated qualities.

24. A method for processing information, the method comprising:

grouping a plurality of networked hive engines into a plurality of territories;

receiving, by a hive engine, a service request for a processing job, the processing job comprising a plurality of processing tasks for execution by a plurality of hive engines within at least one territory;

performing the processing job in a distributed manner by a plurality of the hive engines within the at least one territory such that the processing tasks of the processing job are distributed to a plurality of hive engines within the at least one territory for execution thereby; and

the plurality of hive engines within the at least one territory (1) executing the processing tasks, (2) and returning state information corresponding to the processing tasks for delivery of a processing result in response to the service request.

25. The method of claim 24 wherein a plurality of the hive engines have an associated physical location, and wherein the grouping step further comprises grouping the plurality of the hive engines having an associated physical location into the territories based on their associated physical locations such that each territory comprises a plurality of hive engines having an associated physical location within that territory.

26. The method of claim 25 wherein the performing step comprises performing the processing job in a distributed manner by a plurality of the hive engines within a plurality of different territories such that the processing tasks of the processing job are distributed to a plurality of hive engines within the plurality of different territories for execution thereby.

27. The method of claim 25 wherein the performing step comprises performing the processing job in a distributed manner by a plurality of the hive engines within the same territory such that the processing tasks of the processing job are distributed to a plurality of hive engines within the same territory for execution thereby.

28. A system for processing information, the system comprising:

a request region comprising a plurality of request handlers; and

a plurality of processing regions, each processing region belonging to a territory and comprising a plurality of process handlers, wherein the plurality of processing regions belong to a plurality of territories;

wherein the request region is configured to (1) receive a service request from a computer, the service request comprising a request to perform a processing job, (2) in response to the received service request, inform the computer of a plurality of the request handlers that are available to service the service request, and (3) receive a selection from the computer of a request handler from among the plurality of request handlers that are available to service the service request;

wherein the selected request handler is further configured to select a processing region to process the processing job based on the territories to which the processing regions belong; and

wherein a plurality of process handlers within the selected processing region are configured to each process a portion of the processing job to thereby provide a distributed processing of the processing job by a plurality of process handlers belonging to the same territory; and

wherein the request handlers and process handlers are resident on a plurality of processing elements that are arranged as a processing network.

29. The system of claim 28 wherein the plurality of processing regions are within the request region.

30. The system of claim 29 wherein the selected request handler is further configured to send a processing request corresponding to the processing job to a plurality of the processing regions, and wherein the plurality of processing regions to which the processing request was sent are configured to (1) receive the processing request from the selected request handler, and (2) in response to the received processing request, inform the selected request handler of their availability to process the processing request, and wherein the selected request handler is further configured to select, from among the available processing regions, the processing region to process the processing job based on the territories to which the available processing regions belong.

31. The system of claim 30 wherein the processing regions further comprise a plurality of task handlers, the task handlers being resident on a plurality of the processing elements, and wherein a process handler within the selected processing region is further configured to distribute a plurality of processing tasks of the processing job to a plurality of the task handlers within the selected processing region for execution of the processing tasks in a distributed manner.

32. The system of claim 29 further comprising a plurality of the request regions, each request region having a plurality of the processing regions therewithin.

33. The system of claim 28 wherein the processing elements reside in a plurality of physical locations, and wherein the territories are organized based on the physical locations of the processing elements.

34. The system of claim 28 wherein the processing elements reside in a plurality of physical locations, and wherein the territories are organized based on a quality of the processing elements other than their physical locations.