System and method for message processing and routing

• US 8,255,471 B2
• Filed: 01/24/2011
• Issued: 08/28/2012
• Est. Priority Date: 05/01/2003
• Status: Active Grant

• Current Assignee: Goldman Sachs & Co. LLC (Goldman Sachs Group Incorporated)
• Original Assignee: Goldman Sachs & Company (Goldman Sachs Group Incorporated)
• Inventors: Kanayama, Tomozumi, Beguin, Julien George, Reed, Carl J, Marzo, Michael R, Krasheninnikov, Konstantin A
• Primary Examiner(s): Walsh, John B.
• Application Number:
  US13/012,352
• Publication Number:
  US 20110125859A1
• Time in Patent Office: 582 Days
• Field of Search: None
• US Class Current: 709/206
• CPC Class Codes: G06F 9/542 Event management; Broadcasting; Multicasting; Notifications
• CPC Class Codes: G06F 9/546 Message passing systems or structures, e.g. queues
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/63 Routing a service request depending on the request content or context
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]

Abstract

A message routing system that allows applications at either end of the system to run as-is without modification. The system functions in a multithreaded environment and is capable of handling complex routing rules and message transformation. It is also capable of learning and executing new routing rules and message transformations in formats previously unrecognized by the system. The system enables precise and reliable logging of messages throughout processing and supports publication of enterprise-wide broadcast messages. The system further preferably employs cooperating inbound and outbound transport processes for consuming, routing, processing, safely storing and publishing messages in batches of logical units of work to ensure that the logical units of work are not lost in system transactions. The system also preferably utilizes a replay server for preserving and replaying messages that might otherwise fail to reach their intended destinations.

Claims

1. A computerized message routing system comprising:

at least one inbound transport node in communication with at least one consumer process that runs via a processor at least one consumer thread for each inbound message topic; and

at least one outbound transport node in communication with at least one publisher process that runs via the processor at least one publisher thread for each inbound message topic,

wherein the at least one consumer process communicates with the at least one publisher process via at least one message file,

wherein the at least one consumer process communicates with at least one inbound messaging bus,

wherein the at least one publisher process communicates with at least one outbound messaging bus,

wherein the at least one consumer process includes a message handler for performing message and routing transformations,

wherein the number of consumer processes equals the number of inbound transport nodes,

wherein the number of publisher processes equals the number of outbound transport nodes,

wherein the maximum number of consumer threads equals the number of inbound message topics,

wherein the maximum number of publisher threads equals the number of inbound message topics, and

wherein the number of message files equals the number of inbound topics times the number of outbound transport nodes.

3. The system of claim 1, wherein the at least one consumer process consumes messages via an IBM MQ messaging platform.

4. The system of claim 1, wherein the at least one consumer process consumes messages via a TIBCO ETX messaging platform.

5. The system of claim 1, wherein the at least one publisher process consumes messages via an IBM MQ messaging platform.

6. The system of claim 1, wherein the at least one publisher process consumes messages via a TIBCO ETX messaging platform.

7. The system of claim 1, wherein the at least one consumer process passes the at least one message file to a file system maintained by a relational database management system.

2. A method for operating a computerized message routing system, comprising:

providing at least one inbound transport node in communication with at least one consumer process that runs via a processor at least one consumer thread for each inbound message topic;

providing at least one outbound transport node in communication with at least one publisher process that runs via the processor at least one publisher thread for each inbound message topic; and

communicating with the at least one consumer process with the at least one publisher process via at least one message file,

wherein the at least one consumer process communicates with at least one inbound messaging bus,

wherein the at least one publisher process communicates with at least one outbound messaging bus,

wherein the at least one consumer process includes a message handler for performing message and routing transformations,

wherein the number of consumer processes equals the number of inbound message transport nodes,

wherein the number of publisher processes equals the number of outbound message transport nodes,

wherein the maximum number of consumer threads equals the number of inbound message topics,

wherein the maximum number of publisher threads equals the number of inbound message topics, and

wherein the number of message files equals the number of inbound topics times the number of outbound transport nodes.

8. The method of claim 2, wherein the at least one consumer process consumes messages via an IBM MQ messaging platform.

9. The method of claim 2, wherein the at least one consumer process consumes messages via a TIBCO ETX messaging platform.

10. The method of claim 2, wherein the at least one publisher process consumes messages via an IBM MQ messaging platform.

11. The method of claim 2, wherein the at least one publisher process consumes messages via a TIBCO ETX messaging platform.

12. The method of claim 2, wherein the at least one consumer process passes the at least one message file to a file system maintained by a relational database management system.