Processing information using a hive of computing engines including request handlers and process handlers

• US 7,379,959 B2
• Filed: 09/07/2002
• Issued: 05/27/2008
• Est. Priority Date: 09/07/2002
• Status: Expired due to Fees

• Current Assignee: Appistry Incorporated
• Original Assignee: Appistry Incorporated
• Inventors: Groner, Michael Scott, Hinni, Aaron Louis, Lozano, Roberto Raul, Semones, Guerry Anderson
• Primary Examiner(s): Flynn; Nathan
• Assistant Examiner(s): WASEL, MOHAMED A
• Application Number:
  US10/236,784
• Publication Number:
  US 20070011226A1
• Time in Patent Office: 2,089 Days
• Field of Search: 709217-219, 709/212, 709/216, 709201-203, 709/223, 709/224
• US Class Current: 709/202
• CPC Class Codes: H04L 41/00 Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
• CPC Class Codes: H04L 41/046 comprising network management agents or mobile agents therefor
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/51 Discovery or management thereof, e.g. service location protocol [SLP] or web services
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
• CPC Class Codes: H04L 69/163 In-band adaptation of TCP data exchange; In-band control procedures

Abstract

A hive of computing engines, typically including request handlers and process handlers, is used to process information. One implementation includes a request region including multiple request handlers and multiple processing regions, each typically including multiple process handlers. Each request handler is configured to respond to a client service request of a processing job, and if identified to handle the processing job: to query one or more of the processing regions to identify and assign a particular process handler to service the processing job, and to receive a processing result from the particular process handler. Each of the process handlers is configured to respond to such a query, and if identified as the particular process handler: to service the processing job, to process the processing job, to update said identified request handler with state information pertaining to partial processing of said processing job, and to communicate the processing result to the identified request handler.

Claims

1. A method for processing information, the method comprising:

receiving a service request message for a processing job from a client;

responding to the service request message including sending a service response message to the client;

receiving from the client a processing job message for the processing job;

sending a processing request message based on the processing job to a plurality of process handlers;

receiving processing responses from a subset of the plurality of process handlers;

selecting a first process handler of the subset of the plurality of process handlers;

initiating the processing job on the first process handler;

receiving a first set of state information from the first process handler for the processing job;

sending a second processing request message based on the processing job to a second plurality of process handlers;

receiving second processing responses from a subset of the second plurality of process handlers;

selecting a second process handler of the subset of the second plurality of process handlers;

forwarding the first set of state information to the second process handler;

receiving a final set of state information from the second process handler; and

sending a result message based on the final set of state information to the client.

2. The method of claim 1, comprising identifying a timeout or error condition after receiving the first set of state information;

wherein said sending the second processing request message is performed in response to said identifying the timeout or error condition.

3. The method of claim 1, wherein said selecting the first particular process handler is performed based on a territory identified with the first particular process handler.

4. The method of claim 1, wherein said sending the processing request message based on the processing job to the plurality of process handlers comprises sending a multicast message including the processing request message.

5. The method of claim 1, wherein said initiating the processing job on the first process handler includes sending a message to the first process handler.

6. The method of claim 1, comprising:

receiving a first acknowledgement message from the first process handler after said initiating the processing job on the first process handler; and

in response to said receiving the job received acknowledgement message, sending a second acknowledgement message to the client.

7. The method of claim 1, comprising:

receiving a result received acknowledgement message from the client; and

in response to said receiving the result received acknowledgement message, sending a client received result acknowledgement message to the second process handler.

8. A computer-readable storage medium containing computer-executable instruction for performing steps comprising:

receiving a service request message for a processing job from a client;

responding to the service request message including sending a service response message to the client;

receiving from the client a processing job message for the processing job;

sending a processing request message based on the processing job to a plurality of process handlers;

receiving processing responses from a subset of the plurality of process handlers;

selecting a first process handler of the subset of the plurality of process handlers;

initiating the processing job on the first process handler;

receiving a first set of state information from the first process handler for the processing job;

sending a second processing request message based on the processing job to a second plurality of process handlers;

receiving second processing responses from a subset of the second plurality of process handlers;

selecting a second process handler of the subset of the second plurality of process handlers;

forwarding the first set of state information to the second process handler;

receiving a final set of state information from the second process handler; and

sending a result message based on the final set of state information to the client.

9. The computer-readable medium of claim 8, wherein said steps include identifying a timeout or error condition after receiving the first set of state information;

wherein said sending the second processing request message is performed in response to said identifying the timeout or error condition.

10. The computer-readable medium of claim 8, wherein said selecting the first particular process handler is performed based on a territory identified with the first particular process handler.

11. The computer-readable medium of claim 8, wherein said sending the processing request message based on the processing job to the plurality of process handlers comprises sending a multicast message including the processing request message.

12. The computer-readable medium of claim 8, wherein said initiating the processing job on the first process handler includes sending a message to the first process handler.

13. An apparatus for processing information, the apparatus comprising:

means for receiving a service request message for a processing job from a client;

means for responding to the service request message including sending a service response message to the client;

means for receiving from the client a processing job message for the processing job;

means for sending a processing request message based on the processing job to a plurality of process handlers;

means for receiving processing responses from a subset of the plurality of process handlers;

means for selecting a first process handler of the subset of the plurality of process handlers;

means for initiating the processing job on the first process handler;

means for receiving a first set of state information from the first process handler for the processing job;

means for sending a second processing request message based on the processing job to a second plurality of process handlers;

means for receiving second processing responses from a subset of the second plurality of process handlers;

means for selecting a second process handler of the subset of the second plurality of process handlers;

means for forwarding the first set of state information to the second process handler;

means for receiving a final set of state information from the second process handler; and

means for sending a result message based on the final set of state information to the client.

14. The apparatus of claim 13, wherein said means for selecting the first particular process handler includes means for identifying a territory identified with the first particular process handler.

15. A method for processing applications, the method comprising:

a client communicating a service request to a plurality of request handlers;

a subset of the plurality of request handlers responding to the service request, said responding including communicating a response to the client;

the client receiving one or more of said responses;

the client selecting a particular request handler of the subset of the plurality of request handlers based on said received one or more of said responses;

the client submitting a processing job to the particular request handler;

the particular request handler generating a processing request based on the processing job;

the particular request handler communicating the processing request to a plurality of process handlers;

a subset of the plurality of process handlers responding to the processing request, said responding including communicating a processing request response to the particular request handler;

the particular request handler receiving one or more of said processing request responses;

the particular request handler selecting a particular process handler of the plurality of process handlers based on said received one or more of processing request responses;

the particular request handler submitting the processing job to the particular process handler;

the particular process handler updating the particular request handler with a first set of state information corresponding to a first subset of processing of the processing job;

the particular request handler sending to a second process handler a completion job request of the processing job from the state indicated in the first set of state information;

the second process handler completing the processing job;

the second process handler returning a result of after said completing the processing job to the particular request handler; and

the particular request handler sending the result to the client.

16. The method of claim 15, comprising:

the particular process handler updating the particular request handler with a first set of state information corresponding to a first subset of processing of the processing job;

the particular process handler returning a result of after completion of processing the processing job to the particular request handler; and

the particular request handler sending the result to the client.

17. A system for processing information, the system comprising one or more computers including:

a client configured to cause the processing of a processing job in order to determine a processing result;

a plurality of request handlers;

a plurality of process handlers; and

a plurality of task handlers;

wherein the client is configured to perform operations comprising;

(a) sending to each of the plurality of request handlers a client service request message for the processing job;

(b) receiving a plurality of responses to said sent client service request message;

(c) selecting a particular request handler of the plurality of request handlers based on said received responses to said sent client service request message; and

(d) receiving the processing result from the particular request handler;

wherein each of the plurality of request handlers is configured to perform operations comprising;

(a) sending a client service response message to a received said client service request message for the processing job; and

(b) if selected by the client to be the particular request handler to handle the processing job;

(1) querying the plurality of process handlers to determine a particular process handler of the plurality of process handlers to service the processing job based on a received plurality of responses from different process handlers, including the particular process handler, of the plurality of process handlers;

(3) receiving the processing result from the particular process handler; and

(4) forwarding said processing result to the client;

wherein each of the plurality of process handlers is configured to perform operations comprising;

(a) responding to said query from the particular request handler; and

(b) if identified as the particular process handler by the particular request handler;

(1) assigning one or more tasks of the processing job to a particular task handler of the plurality of task handlers;

(2) receiving one or more task results from the particular task handler; and

(3) communicating the processing result identified based on said one or more task results to the particular request handler; and

wherein the particular task handler is configured to perform operations comprising;

processing one or more tasks identified in the processing job in order to determine said one or more task results; and

communicating said one or more task results to the particular process handler.

18. The system of claim 17, wherein the particular process handler is configured to perform operations including:

sending a task request to each of the plurality of task handlers;

receiving one or more responses to said task requests including receiving a response from the particular task handler; and

selecting the particular task handler based on said on said one or more response to said task requests; and

wherein each of the plurality of task handlers are configured to perform operations including responding to the task request received from the particular process handler.

19. The system of claim 18, wherein less than all of the plurality of task handlers is permitted to process the processing job;

wherein said task handlers not permitted to process the processing job are configured to not to send a task response message in response to said task request messages corresponding to the processing job received from the particular process handler.

20. The system of claim 17, wherein the particular task handler is configured to perform operations including updating the particular process handler with state information pertaining to partial processing of the processing job;

wherein the particular process handler is configured to perform operations including;

receiving said state information pertaining to the partial processing of the processing job;

updating a data structure with said state information; and

updating the particular request handler with state information pertaining to partial processing of the processing job; and

wherein the particular request handler is configured to perform operations including;

receiving said state information pertaining to the partial processing of the processing job;

updating a data structure with said state information; and

in response to a detected error condition, assigning the processing of the processing job to identify the processing result starting from a partial processing state identified from said state information to one of the plurality of process handlers different from the particular process handler.

21. The system of claim 17, where the processing job includes a reference or identification of a process flow, the process flow identifies a plurality of processing sets, each of the plurality of processing sets identifying a beginning state, a task, and one or more ending states.

22. The system of claim 21, wherein the particular process handler is configured to perform operations including updating the particular request handler with state information pertaining to partial processing of the processing job at the completion of each of one or more of the plurality of processing sets;

and

wherein the particular request handler is configured to perform operations including;

receiving said state information pertaining to the partial processing of the processing job;

updating a data structure with said state information; and

in response to a detected error condition, assigning the processing of the processing job to identify the processing result starting from a partial processing state identified from said state information to one of the plurality of process handlers different from the particular process handler.

23. The system of claim 17, where the processing job includes a reference or identification of a process flow;

wherein the particular process handler is configured to perform operations including updating the particular request handler with state information pertaining to partial processing of the processing job at one or more points identified by the process flow; and

wherein the particular request handler is configured to perform operations including;

receiving said state information pertaining to the partial processing of the processing job;

updating a data structure with said state information; and

in response to a detected error condition, assigning the processing of the processing job to identify the processing result starting from a partial processing state identified from said state information to one of the plurality of process handlers different from the particular process handler.

24. The system of claim 17, wherein the particular process handler is configured to perform operations including updating the particular request handler with state information pertaining to partial processing of the processing job at a plurality of different intermediate processing points;

and

wherein the particular request handler is configured to perform operations including;

receiving said state information pertaining to the partial processing of the processing job;

updating a data structure with said state information; and

in response to a detected error condition, assigning the processing of the processing job to identify the processing result starting from a partial processing state identified from said state information to one of the plurality of process handlers different from the particular process handler.

25. The system of claim 17, including a plurality of computing devices, wherein each of the plurality of computing devices includes a different one of said plurality of process handlers, and each of said plurality of request handlers is included in a different one of the plurality of computing devices.

26. A networked system for processing information, the system comprising:

a client computer including a client; and

a plurality of computers, including a plurality of request handlers, a plurality of process handlers and a plurality of task handlers such that each of the plurality of computers includes one or more handlers from a group consisting of;

a request handler of the plurality of request handlers, a process handler of the plurality of process handlers, and a task handler of the plurality of task handlers;

wherein each of the plurality of request handlers is configured to;

send a response to a client service request received from the client if it determines it is available to handle a processing job corresponding to said client service request received from the client for the processing job, and if identified by the client as the selected request handler to handle the processing job;

to send one or more query messages to the plurality of process handlers, to receive responses from said process handlers;

to select among said received responses to identify and assign a particular process handler to service the processing job, to receive a processing result from the particular process handler, and to send a result corresponding to the processing result to the client;

wherein each of the plurality of process handlers is configured to;

respond to said one or more query messages if it is available to handle the processing job; and

if identified as the particular process handler by the particular request handler;

to assign one or more tasks of the processing job to one or more particular task handlers of the plurality of task handlers;

to identify the processing result based on processing results of said one or more tasks of the processing job by said one or more particular task handlers; and

to communicate the processing result to the particular request handler;

wherein each of said one or more particular task handlers is configured to process one or more of said one or more tasks assigned to it to determine one or more task results; and

to communicate said one or more task results to the particular process handler; and

wherein the client is configured to;

receive a plurality of said responses to the client service request;

to select the selected request handler based on said received responses to the client service request; and

to receive the processing result from the selected request handler.

27. The networked system of claim 26, wherein at least one of said one or more particular task handlers is selected by the particular process handler based on a limited number of tasks on one or more of the plurality of computers.

28. The networked system of claim 26, wherein the particular process handler requests a volunteer task handler from the plurality of task handlers, receives a plurality of responses from a plurality of the plurality of task handlers;

and selects said one or more particular task handlers based on the plurality of responses; and

wherein each of the plurality of task handlers are configured to volunteer to the particular process handler in response to said volunteer task handler request if the task handler is available to process the processing job.

29. The networked system of claim 28, wherein at least one of said one or more particular task handlers is selected by the particular process handler based on a limited number of tasks on one or more of the plurality of computers.

30. The networked system of claim 28, wherein each of said one or more particular task handlers is configured to respond to said volunteer task handler request only if it is available based on a number of other processing jobs being performed on the computer of the plurality of computers on which it resides.

31. The networked system of claim 28, wherein said volunteer task handler request relates to accessing a particular resource with a restricted access;

and wherein each of said one or more particular task handlers is configured to respond to said volunteer task handler request only if it is available to access the particular resource in light of the restricted access to the particular resource.

32. A method for processing information in a networked hive of computing engines, the method comprising:

each of a plurality of request handlers receiving a client service request message for a particular job from a client;

a plurality of the plurality of request handlers responding to the client request message by sending a response message to the client;

a selected request handler of said request handlers said responding to client request message receiving instructions from the client to process the job, wherein the client is external to the computing engine on which the selected request handler resides;

the selected request handler sending a processing request message for the particular job to a plurality of process handlers;

a plurality of the plurality of process handlers responding to the processing request message by sending a response message to the selected request handler;

the selected request handler selecting a selected process handler from said process handlers said responding to the processing request message and assigning the particular job to the selected process handler;

the selected process handler, in response to said assignment by the selected request handler, assigning the processing job to a particular task handler of a plurality of task handlers;

the particular task handler performing one or more tasks of the particular the job to generate a processing result, and sending the processing result to the selected process handler;

the selected process handler, in response to receiving the processing result, sending the processing result to the selected request handler; and

the selected request handler, in response to receiving the processing result, sending the processing result to the client; and

wherein the selected request handler and the selected process handler are on different computing engines.

33. The method of claim 32, wherein the particular task handler is on the same computing engine as the selected process handler.

34. The method of claim 32, wherein the particular task handler is on a different computing engine than the selected process handler.

35. The method of claim 32, wherein the particular task handler is on a different computing engine than the selected process handler and on a different computing engine than the selected request handler.

36. The method of claim 32, comprising:

the selected process handler performing a volunteer operation to select the particular task handler based on received responses from a plurality of the plurality of task handlers including the particular task handler.

37. A system for processing information, the system comprising one or more computers including:

a request region including a plurality of request handlers, each of said request handlers being a separate process; and

a plurality of processing regions, each of the plurality of processing regions including a plurality of process handlers, each of the process handlers being a separate process;

wherein each of the plurality of request handlers is configured to send a response if it determines it is available to handle a processing job identified in a client service request received from a client for the processing job, and if identified by the client to handle the processing job;

to send one or more query messages to one or more of the processing regions, to receive responses from said processing regions; and

to select among said received responses to identify and assign a particular process handler to service the processing job, and to receive a processing result from the particular process handler;

wherein each of the process handlers within said one or more of the processing regions is configured to respond to one of said one or more query messages if it is available to handle the processing job, and if identified as the particular process handler by the particular process handler to assign the processing job to one or more task handlers to determine the processing result and to receive the processing result, and to communicate the processing result to said identified request handler;

wherein the client is configured to receive a plurality of said responses from the client service request, and to receive the processing result from the particular process handler; and

wherein said operation of being identified by the client to handle the processing job includes the client selecting the particular process handler based on said received responses to the client service request.

38. The system of claim 37, wherein the plurality of process handlers are different processes than the plurality of request handlers.

39. A system for processing information, the system comprising one or more computers including:

a plurality of request handlers, each of said request handlers being a separate process; and

a plurality of process handlers, each of the process handlers being a separate process;

wherein each of the plurality of request handlers is configured to send a response to a client service request received from a client if it determines it is available to handle a processing job identified in said client service request received from the client for the processing job, and if identified by the client to handle the processing job;

to send one or more query messages to the plurality of process handlers, to receive responses from said process handlers; and

to select among said received responses to identify and assign a particular process handler to service the processing job, to receive a processing result from the particular process handler, and to send the processing result to the client;

wherein each of the process handlers is configured to respond to said one or more query messages if it is available to handle the processing job, and if identified as the particular process handler by the particular process handler;

to assign the processing job to one or more task handlers to determine the processing result and to receive the processing result, and to communicate the processing result to said identified request handler; and

wherein the client is configured to receive a plurality of said responses from the client service request, to select the particular process handler based on said received responses from the client service request, and to receive the processing result from said the particular process handler assigned to service the processing job.

40. The system of claim 39, wherein the plurality of process handlers are different processes than the plurality of request handlers.

41. A method for processing information in a networked hive of computing engines, the method comprising:

a request handler of a plurality of request handlers receiving instructions from a client to process the particular job, wherein the client is external to the computing engine on which the request handler resides;

the request handler sending a processing request message for the particular job to a plurality of process handlers;

a plurality of the plurality of process handlers responding to the processing request message by sending a response message to the request handler;

the request handler selecting a selected process handler from said process handlers said responding to the processing request message and assigning the particular job to the selected process handler;

the selected process handler, in response to said assignment by the request handler, assigning the processing job to a particular task handler of a plurality of task handlers;

the particular task handler performing one or more tasks of the particular the job to generate a processing result, and sending the processing result to the selected process handler;

the selected process handler, in response to receiving the processing result, sending the processing result to the request handler; and

the request handler, in response to receiving the processing result, sending the processing result to the client;

wherein the request handler and the selected process handler are on different computing engines.

42. The method of claim 41, wherein the particular task handler is on the same computing engine as the selected process handler.

43. The method of claim 41, wherein the particular task handler is on a different computing engine than the selected process handler.

44. The method of claim 41, wherein the particular task handler is on a different computing engine than the selected process handler and on a different computing engine than the request handler.

45. The method of claim 41, comprising:

the selected process handler performing a volunteer operation to select the particular task handler based on received responses from a plurality of the plurality of task handlers including the particular task handler.

46. A system for processing information, the system comprising one or more computers including:

a client configured to cause the processing of a processing job in order to determine a processing result;

a plurality of request handlers; and

a plurality of process handlers;

wherein the client is configured to perform operations comprising;

(a) sending to each of the plurality of request handlers a client service request message for the processing job;

(b) receiving a plurality of responses to said sent client service request message;

(c) selecting a particular request handler of the plurality of request handlers based on said received responses to said sent client service request message; and

(d) receiving the processing result from the particular request handler;

wherein each of the plurality of request handlers is configured to perform operations comprising;

(a) sending a client service response message to a received said client service request message for the processing job; and

(b) if selected by the client to be the particular request handler to handle the processing job;

(1) querying the plurality of process handlers to determine a particular process handler of the plurality of process handlers to service the processing job based on a received plurality of responses from different process handlers, including the particular process handler, of the plurality of process handlers;

(3) receiving the processing result from the particular process handler; and

(4) forwarding said processing result to the client; and

wherein each of the plurality of process handlers is configured to perform operations comprising;

(a) responding to said query from the particular request handler; and

(b) if identified as the particular process handler by the particular request handler;

(1) performing the processing job to determine the processing result; and

(2) communicating the processing result to the particular request handler.

47. The system of claim 46, wherein the particular process handler is configured to perform operations including updating the particular request handler with state information pertaining to partial processing of the processing job;

and

wherein the particular request handler is configured to perform operations including;

receiving said state information pertaining to the partial processing of the processing job;

updating a data structure with said state information; and

in response to a detected error condition, assigning the processing of the processing job to identify the processing result starting from a partial processing state identified from said state information to one of the plurality of process handlers different from the particular process handler.

48. The system of claim 46, where the processing job includes a reference or identification of a process flow, the process flow identifies a plurality of processing sets, each of the plurality of processing sets identifying a beginning state, a task, and one or more ending states.

49. The system of claim 48, wherein the particular process handler is configured to perform operations including updating the particular request handler with state information pertaining to partial processing of the processing job at the completion of each of one or more of the plurality of processing sets;

and

wherein the particular request handler is configured to perform operations including;

receiving said state information pertaining to the partial processing of the processing job;

updating a data structure with said state information; and

in response to a detected error condition, assigning the processing of the processing job to identify the processing result starting from a partial processing state identified from said state information to one of the plurality of process handlers different from the particular process handler.

50. The system of claim 46, where the processing job includes a reference or identification of a process flow;

wherein the particular process handler is configured to perform operations including updating the particular request handler with state information pertaining to partial processing of the processing job at one or more points identified by the process flow; and

wherein the particular request handler is configured to perform operations including;

receiving said state information pertaining to the partial processing of the processing job;

updating a data structure with said state information; and

in response to a detected error condition, assigning the processing of the processing job to identify the processing result starting from a partial processing state identified from said state information to one of the plurality of process handlers different from the particular process handler.

51. The system of claim 46, wherein the particular process handler is configured to perform operations including updating the particular request handler with state information pertaining to partial processing of the processing job at a plurality of different intermediate processing points;

and

wherein the particular request handler is configured to perform operations including;

receiving said state information pertaining to the partial processing of the processing job;

updating a data structure with said state information; and

in response to a detected error condition, assigning the processing of the processing job to identify the processing result starting from a partial processing state identified from said state information to one of the plurality of process handlers different from the particular process handler.

52. The system of claim 46, including a plurality of computing devices, wherein each of the plurality of computing devices includes a different one of said plurality of process handlers, and each of said plurality of request handlers is included in a different one of the plurality of computing devices.

53. A networked system for processing information, the system comprising:

a client computer including a client; and

a plurality of computers, each of the plurality of computers including a request handler, a process handler, or both a request handler and a process handler;

wherein each of said request handlers is configured to;

send a response to a client service request received from the client if it determines it is available to handle a processing job identified in said client service request received from the client for the processing job, and if identified by the client as the selected request handler to handle the processing job;

to send one or more query messages to the plurality of process handlers, to receive responses from said process handlers;

to select among said received responses to identity and assign a particular process handler to service the processing job, to receive a processing result from the particular process handler, and to send a result corresponding to the processing result to the client;

wherein each of the process handlers is configured to;

respond to said one or more query messages if it is available to handle the processing job, and if identified as the particular process handler by the particular request handler;

to process the processing job and to communicate the processing result to said identified request handler; and

wherein the client is configured to;

receive a plurality of said responses to the client service request;

to select the selected request handler based on said received responses to the client service request; and

to receive the processing result from the selected request handler.

54. The system of claim 53, wherein the plurality of process handlers are different processes than the plurality of request handlers.

55. A system for processing information, the system comprising one or more computers including:

a request region including a plurality of request handlers, each of said request handlers being a separate process; and

a plurality of processing regions, each of the plurality of processing regions including a plurality of process handlers, each of the process handlers being a separate process;

wherein each of the plurality of request handlers is configured to send a response if it determines it is available to handle a processing job identified in a client service request received from a client for the processing job, and if identified by the client to handle the processing job;

to send one or more query messages to one or more of the processing regions, to receive responses from said processing regions; and

to select among said received responses to identify and assign a particular process handler to service the processing job, and to receive a processing result from the particular process handler;

wherein each of the process handlers within said one or more of the processing regions is configured to respond to one of said one or more query messages if it is available to handle the processing job, and if identified as the particular process handler by the particular process handler to process the processing job to determine the processing result, and to communicate the processing result to said identified request handler;

wherein the client is configured to receive a plurality of said responses from the client service request, and to receive the processing result from the particular process handler; and

wherein said operation of being identified by the client to handle the processing job includes the client selecting the particular process handler based on said received responses to the client service request.

56. The system of claim 55, wherein the plurality of process handlers are different processes than the plurality of request handlers.

57. A system for processing information, the system comprising one or more computers including:

a plurality of request handlers, each of said request handlers being a separate process; and

a plurality of process handlers, each of the process handlers being a separate process;

wherein each of the plurality of request handlers is configured to send a response to a client service request received from a client if it determines it is available to handle a processing job identified in said client service request received from the client for the processing job, and if identified by the client to handle the processing job;

to send one or more query messages to the plurality of process handlers, to receive responses from said process handlers; and

to select among said received responses to identify and assign a particular process handler to service the processing job, to receive a processing result from the particular process handler, and to send the processing result to the client;

wherein each of the process handlers is configured to respond to said one or more query messages if it is available to handle the processing job, and if identified as the particular process handler by the particular process handler;

to process the processing job and to communicate the processing result to said identified request handler; and

wherein the client is configured to receive a plurality of said responses from the client service request, to select the particular process handler based on said received responses from the client service request, and to receive the processing result from said the particular process handler assigned to service the processing job.

58. The system of claim 57, wherein the plurality of process handlers are different processes than the plurality of request handlers.

59. A method for processing information in a networked hive of computing engines, the method comprising:

each of a plurality of request handlers receiving a client service request message for a particular job from a client;

a plurality of the plurality of request handlers responding to the client request message by sending a response message to the client;

a selected request handler of said request handlers said responding to client request message receiving instructions from the client to process the particular job, wherein the client is external to the computing engine on which the selected request handler resides;

the selected request handler sending a processing request message for the particular job to a plurality of process handlers;

a plurality of the plurality of process handlers responding to the processing request message by sending a response message to the selected request handler;

the selected request handler selecting a selected process handler from said process handlers said responding to the processing request message and assigning the particular job to the selected process handler;

the selected process handler, in response to said assignment by the selected request handler, performing one or more tasks of the particular job to generate a processing result, and sending the processing result to the selected request handler; and

the selected request handler receiving the processing result and sending the processing result to the client;

wherein the selected request handler and the selected process handler are on different computing engines.

60. A method for processing information in a networked hive of computing engines, the method comprising:

each of a plurality of request handlers receiving a client service request message for a particular job from a client;

a plurality of the plurality of request handlers responding to the client request message by sending a response message to the client;

a selected request handler of said request handlers said responding to client request message receiving instructions from the client to process the particular job, wherein the client is external to the computing engine on which the selected request handler resides;

the selected request handler sending a processing request message for the particular job to a plurality of process handlers;

a plurality of the plurality of process handlers responding to the processing request message by sending a response message to the selected request handler;

the selected request handler selecting a selected process handler from said process handlers said responding to the processing request message and assigning the particular job to the selected process handler;

the selected process handler, in response to said assignment by the selected request handler, performing partial processing of the particular job to generate state information, and sending the state information to the selected request handler;

the selected request handler, subsequent to receiving said state information, assigning the particular job to a second process handler of the plurality of process handlers and communicating said state information to the second process handler;

the second process handler completing processing of the particular job from its partially processed state identified from said state information to generate a processing result, and sending the processing result to the selected request handler; and

the selected request handler receiving the processing result and sending the processing result to the client;

wherein the selected request handler, the selected process handler, and the second process handler are on different computing engines.

61. The method of claim 60, wherein said operation by the selected request handler of assigning the particular job to the second process handler is performed in response to the selected request handler detecting an error.

62. The method of claim 60, comprising:

the selected request handler performing a volunteer operation to select the second process handler based on received responses from a plurality of the plurality of process handlers including the second process handler.

63. The method of claim 62, wherein said operation by the selected request handler of assigning the particular job to the second process handler is performed in response to the selected request handler detecting an error.

64. The system of claim 63, where the particular job includes a reference or identification of a process flow, the process flow identifies a plurality of processing sets, each of the plurality of processing sets identifying a beginning state, a task, and one or more ending states;

wherein said state information identifies the state of the particular job at one of said ending states.

65. The system of claim 60, where the particular job includes a reference or identification of a process flow, the process flow identifies a plurality of processing sets, each of the plurality of processing sets identifying a beginning state, a task, and one or more ending states;

wherein said state information identifies the state of the particular job at one of said ending states.