Reliable messaging using redundant message streams in a high speed, low latency data communications environment

• US 8,122,144 B2
• Filed: 06/27/2006
• Issued: 02/21/2012
• Est. Priority Date: 06/27/2006
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Borgendale, Kenneth W., Dekel, Eliezer, Duigenan, John J., Gershinsky, Gidon, Krits, Alexander, Naaman, Nir, Okunseinde, Foluso O., Pike, Hilary A., Wright, Cornell G. Jr.
• Primary Examiner(s): Moore, Ian N
• Assistant Examiner(s): Nguyen, Thai
• Application Number:
  US11/426,849
• Publication Number:
  US 20070299973A1
• Time in Patent Office: 2,065 Days
• Field of Search: 709/227, 709217-219, 709/228, 709/229, 719313-317, 714 1- 15
• US Class Current: 709/232
• CPC Class Codes: G06F 9/546 Message passing systems or structures, e.g. queues
• CPC Class Codes: H04L 12/1859 adapted to provide push services, e.g. data channels
• CPC Class Codes: H04L 67/55 Push-based network services

Abstract

Methods, apparatus, and products are disclosed for reliable messaging using redundant message streams in a high speed, low latency data communications environment that include brokering, by a stream administration server, establishment of an active message stream to a subscribing client device from an active feed adapter, the active message stream capable of communicating active application messages; brokering, by the server, establishment of a backup message stream to the subscribing client device from a backup feed adapter, the backup message stream capable of communicating backup application messages representing duplicates of the active messages; receiving the active messages in messaging middleware of the subscribing client device; receiving, in response to a failover, the backup messages in the messaging middleware; and administering, by the messaging middleware, the backup messages in dependence upon an active stream source identifier, an active stream source sequence number, a backup stream source identifier, and a backup stream source sequence number.

Claims

1. A method of reliable messaging using redundant message streams in a data communications environment, the method comprising:

brokering, by a stream administration server, establishment of an active message stream to a subscribing client device from an active feed adapter, the active message stream capable of communicating active application messages, each active application message characterized by an active source stream identifier, an active source stream sequence number, and an active message sequence number;

brokering, by the stream administration server, establishment of a backup message stream to the subscribing client device from a backup feed adapter, the backup message stream capable of communicating backup application messages representing duplicates of the active application messages, each backup application message characterized by a backup source stream identifier, a backup source stream sequence number, and a backup message sequence number;

receiving the active application messages in messaging middleware of the subscribing client device from the active feed adapter;

receiving, in response to a failover from the active feed adapter to the backup feed adapter, the backup application messages in the messaging middleware of the subscribing client device from the backup feed adapter;

administering, by the messaging middleware of the subscribing client device, the backup application messages in dependence upon the active stream source identifier, the active stream source sequence number, the backup stream source identifier, and the backup stream source sequence number, wherein each feed adapter comprises a device configured to convert messages on a feed adapter source stream having a first format to messages on a feed adapter output stream having a second format and transmit the messages on the feed adapter output stream to subscribing client devices;

receiving, in the backup feed adapter from the active feed adapter, an administrative application message and an active message sequence number that specifies a point in a transmission sequence when the active feed adapter will transmit the administrative application message to the subscribing client device;

identifying, by the backup feed adapter, a backup message sequence number of a most recent backup application message processed in the backup feed adapter prior to receiving the administrative application message; and

determining, by the backup feed adapter, whether the backup feed adapter is capable of synchronizing transmission of the administrative application message to the subscribing client device on the backup message stream in dependence upon the received active message sequence number, the backup sequence number of the most recent message transmitted to the client device, and a predetermined synchronization sequence number threshold.

2. The method of claim 1 wherein at least some of the backup application messages represent duplicates of active application messages previously received in the messaging middleware of the subscribing client device.

3. The method of claim 1 wherein the data communications environment comprises a data communications network, the network further comprising the active feed adapter, the backup feed adapter, the stream administration server, at least one subscribing client device, and no router.

4. The method of claim 1 further comprising:

receiving, in the active feed adapter, active source stream messages on a plurality of feed adapter source streams, each feed adapter source stream identified in the active feed adapter by an active source stream identifier, each active source stream message characterized by an active source stream sequence number for the feed adapter source stream on which the active source stream message was received; and

converting, by the active feed adapter, each active source stream message to an active application message, including adding to the contents of each active source stream message the active source stream identifier for the feed adapter source stream on which the active source stream message was received in the active feed adapter and an active message sequence number.

5. The method of claim 1 further comprising:

receiving, in the backup feed adapter, backup source stream messages on a plurality of feed adapter source streams, each feed adapter source stream identified in the backup feed adapter by a backup source stream identifier, each backup source stream message characterized by a backup source stream sequence number for the feed adapter source stream on which the backup source stream message was received; and

converting, by the backup feed adapter, each backup source stream message to a backup application message, including adding to the contents of each backup source stream message the backup source stream identifier for the feed adapter source stream on which the backup source stream message was received in the backup feed adapter and a backup message sequence number.

6. The method of claim 1 wherein the backup feed adapter is capable of synchronizing transmission of the administrative application message to the subscribing client device on the backup message stream, and the method further comprises:

adding, by the backup feed adapter, a backup message sequence number to the contents of the administrative application message having a value that matches the value of the active message sequence number; and

transmitting, by the backup feed adapter to the subscribing client device, the administrative application message in sequence with the other backup application messages.

7. The method of claim 1 wherein the backup feed adapter is not capable of synchronizing transmission of the administrative application message to the subscribing client device on the backup message stream, and the method further comprises:

slowing down, by the backup feed adapter, the transmission rate at which the backup feed adapter transmits the backup application messages to the subscribing client device; and

negotiating, by the backup feed adapter with the active feed adapter, another message sequence number for synchronizing transmission of the administrative application messages to the subscribing client device.

12. The method of claim 1 further comprising:

receiving, in the active feed adapter, an administrative source stream message on a feed adapter source stream;

converting, by the active feed adapter, the administrative source stream message into an administrative application message, including identifying an active message sequence number that specifies a point in a transmission sequence when the active feed adapter will transmit the administrative application message to the subscribing client device;

transmitting, by the active feed adapter to the backup feed adapter, the administrative application message and the identified active message sequence number; and

transmitting, by the active feed adapter to the subscribing client device, the administrative application message on the active message stream at the point in the transmission sequence identified by the active message sequence number.

8. Apparatus for reliable messaging using redundant message streams in a data communications environment:

a system administration server configured to,

broker establishment of an active message stream to a subscribing client device from an active feed adapter, the active message stream capable of communicating active application messages, each active application message characterized by an active source stream identifier, an active source stream sequence number, and an active message sequence number;

broker establishment of a backup message stream to the subscribing client device from a backup feed adapter, the backup message stream capable of communicating backup application messages representing duplicates of the active application messages, each backup application message characterized by a backup source stream identifier, a backup source stream sequence number, and a backup message sequence number;

receive the active application messages in messaging middleware of the subscribing client device from the active feed adapter;

receive, in response to a failover from the active feed adapter to the backup feed adapter, the backup application messages in the messaging middleware of the subscribing client device from the backup feed adapter;

subscribing client device configured to administer, by the messaging middleware, the backup application messages in dependence upon the active stream source identifier, the active stream source sequence number, the backup stream source identifier, and the backup stream source sequence number, wherein each feed adapter comprises a device configured to convert messages on a feed adapter source stream having a first format to messages on a feed adapter output stream having a second format and transmit the messages on the feed adapter output stream to subscribing client devices;

the backup feed adapter configured to,

receive, from the active feed adapter, an administrative application message and an active message sequence number that specifies a point in a transmission sequence when the active feed adapter will transmit the administrative application message to the subscribing client device;

identify a backup message sequence number of a most recent backup application message processed in the backup feed adapter prior to receiving the administrative application message; and

determine whether the backup feed adapter is capable of synchronizing transmission of the administrative application message to the subscribing client device on the backup message stream in dependence upon the received active message sequence number, the backup sequence number of the most recent message transmitted to the client device, and a predetermined synchronization sequence number threshold.

9. The apparatus of claim 8 further comprising:

the active feed adapter configured to,

receive, in the active feed adapter, active source stream messages on a plurality of feed adapter source streams, each feed adapter source stream identified in the active feed adapter by an active source stream identifier, each active source stream message characterized by an active source stream sequence number for the feed adapter source stream on which the active source stream message was received; and

convert, by the active feed adapter, each active source stream message to an active application message, including adding to the contents of each active source stream message the active source stream identifier for the feed adapter source stream on which the active source stream message was received in the active feed adapter and an active message sequence number.

13. The apparatus of claim 8, wherein the active feed adapter is further configured to:

receive, in the active feed adapter, an administrative source stream message on a feed adapter source stream;

convert, by the active feed adapter, the administrative source stream message into an administrative application message, including identifying an active message sequence number that specifies a point in a transmission sequence when the active feed adapter will transmit the administrative application message to the subscribing client device;

transmit, by the active feed adapter to the backup feed adapter, the administrative application message and the identified active message sequence number; and

transmit, by the active feed adapter to the subscribing client device, the administrative application message on the active message stream at the point in the transmission sequence identified by the active message sequence number.

10. A computer program product for reliable messaging using redundant message streams in a data communications environment, the computer program product disposed upon a non-transitory computer readable recordable medium, the computer program product comprising computer program instructions configured to:

broker, by a stream administration server, establishment of an active message stream to a subscribing client device from an active feed adapter, the active message stream capable of communicating active application messages, each active application message characterized by an active source stream identifier, an active source stream sequence number, and an active message sequence number;

broker, by the stream administration server, establishment of a backup message stream to the subscribing client device from a backup feed adapter, the backup message stream capable of communicating backup application messages representing duplicates of the active application messages, each backup application message characterized by a backup source stream identifier, a backup source stream sequence number, and a backup message sequence number;

receive the active application messages in messaging middleware of the subscribing client device from the active feed adapter;

receive, in response to a failover from the active feed adapter to the backup feed adapter, the backup application messages in the messaging middleware of the subscribing client device from the backup feed adapter;

administer, by the messaging middleware of the subscribing client device, the backup application messages in dependence upon the active stream source identifier, the active stream source sequence number, the backup stream source identifier, and the backup stream source sequence number, wherein each feed adapter comprises a device configured to convert messages on a feed adapter source stream having a first format to messages on a feed adapter output stream having a second format and transmit the messages on the feed adapter output stream to subscribing client devices;

receive, in the backup feed adapter from the active feed adapter, an administrative application message and an active message sequence number that specifies a point in a transmission sequence when the active feed adapter will transmit the administrative application message to the subscribing client device;

identify, by the backup feed adapter, a backup message sequence number of a most recent backup application message processed in the backup feed adapter prior to receiving the administrative application message; and

determine, by the backup feed adapter, whether the backup feed adapter is capable of synchronizing transmission of the administrative application message to the subscribing client device on the backup message stream in dependence upon the received active message sequence number, the backup sequence number of the most recent message transmitted to the client device, and a predetermined synchronization sequence number threshold.

11. The computer program product of claim 10 further comprising computer program instructions configured to:

receive, in the active feed adapter, active source stream messages on a plurality of feed adapter source streams, each feed adapter source stream identified in the active feed adapter by an active source stream identifier, each active source stream message characterized by an active source stream sequence number for the feed adapter source stream on which the active source stream message was received; and

convert, by the active feed adapter, each active source stream message to an active application message, including adding to the contents of each active source stream message the active source stream identifier for the feed adapter source stream on which the active source stream message was received in the active feed adapter and an active message sequence number.

14. The computer program product of claim 10 further comprising computer program instructions configured to:

receive, in the active feed adapter, an administrative source stream message on a feed adapter source stream;

convert, by the active feed adapter, the administrative source stream message into an administrative application message, including identifying an active message sequence number that specifies a point in a transmission sequence when the active feed adapter will transmit the administrative application message to the subscribing client device;

transmit, by the active feed adapter to the backup feed adapter, the administrative application message and the identified active message sequence number; and

transmit, by the active feed adapter to the subscribing client device, the administrative application message on the active message stream at the point in the transmission sequence identified by the active message sequence number.