Retrieving messages in order in a distributed publish/subscribe system

• US 9,288,168 B2
• Filed: 03/25/2014
• Issued: 03/15/2016
• Est. Priority Date: 03/29/2013
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Zhang, Kai, Wei, Jia R., Zhang, Jing G., Zhang, Jun J.
• Primary Examiner(s): Gilles, Jude Jean
• Application Number:
  US14/224,307
• Publication Number:
  US 20140297769A1
• Time in Patent Office: 721 Days
• Field of Search: 709201-206, 709/228, 709/233, 709/207, 709/232
• US Class Current: 1/1
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]

Abstract

A method retrieves in order a plurality of specific topic-based messages in a distributed publish/subscribe system, the distributed publish/subscribe system comprising at least one message transit server, the method comprising: determining an order of a plurality of to-be retrieved messages; recording, in message transit server sequence information, message transit servers where the plurality of messages are located, respectively, an order of the message transit servers in the message transit server sequence information corresponding to the determined order of the plurality of messages; and retrieving in order the plurality of messages from corresponding message transit servers using the message transit server sequence information.

Claims

1. A method for retrieving, in order, a plurality of specific topic-based messages in a distributed publish/subscribe system, the distributed publish/subscribe system comprising at least one message transit server, the method comprising:

determining, by one or more processors, an order of a plurality of messages that are planned for retrieval, wherein the order describes a time order in which each message, from the plurality of messages, is planned for retrieval compared to other messages from the plurality of messages;

recording, by one or more processors, message transit server sequence information for message transit servers where each of the plurality of messages is respectively located, wherein the message transit server sequence information describes an order, of the message transit servers, that corresponds to a determined time order of the plurality of messages; and

retrieving, by one or more processors and in said order of the message transit servers, the plurality of messages from corresponding message transit servers using the message transit server sequence information.

2. The method according to claim 1, wherein the recording, in the message transit server sequence information, of the order of the message transit servers where the plurality of messages are respectively located comprises:

querying, by one or more processors, identifiers of message transit servers where the plurality of messages are respectively located; and

recording, by one or more processors, queried identifiers at respective and corresponding locations in the message transit server sequence information.

3. The method according to claim 1, further comprising:

for each message of the plurality of messages, determining, from each of a plurality of subscribers, a subscriber responsible for recording, in the message transit server sequence information, an identity of a message transit server where said each message is located.

4. The method according to claim 3, wherein the retrieving, in order, the plurality of messages from corresponding message transit servers using the message transit server sequence information comprises:

directly using, by other subscribers from the plurality of subscribers but who are not predefined as responsible subscribers who are responsible for recording where each message is located, current message transit server sequence information to retrieve, in order, one or more of the plurality of messages from one or more corresponding message transit servers.

5. The method according to claim 2, further comprising:

determining, by one or more processors, whether or not an other message that is not from the plurality of messages, but is based on a same topic as the plurality of messages, exists in a queried message transit server;

in response to a determination that the other message based on the same topic as the plurality of messages exists in the queried message transit server, recording in the message transit server sequence information, by one or more processors, a location of a queried message transit server at a location corresponding to the other message.

6. The method according to claim 3, further comprising:

using, by one or more processors, lock contention to determine, for each message of the plurality of messages, the subscriber responsible for recording in the message transit server sequence information the message transit server where said each message is located.

7. The method according to claim 1, further comprising:

determining, by one or more processors, whether or not a current message transit server sequence information contains a message transit server corresponding to a specific message of the plurality of messages; and

in response to determining that the current message transmit server sequence information does not contain the message transit server corresponding to the specific message of the plurality of messages, recording, by one or more processors, in the message transit server sequence information the message transit server where the specific message is located;

and wherein the retrieving, in order, the plurality of messages from corresponding message transit servers using the message transit server sequence information comprises;

in response to determining that the current message transmit server sequence information does contain the message transit server corresponding to the specific message of the plurality of messages, retrieving, by one or more processors, in order the specific message from a corresponding message transit server using the current message transit server sequence information.

8. A system for retrieving, in order, a plurality of specific topic-based messages in a distributed publish/subscribe environment, the distributed publish/subscribe environment comprising at least one message transit server, the system comprising:

order determining hardware means configured to determine an order of a plurality of messages that are planned for retrieval, wherein the order describes a time order in which each message, from the plurality of messages, is planned for retrieval compared to other messages from the plurality of messages;

recording hardware means configured to record message transit server sequence information for message transit servers where each of the plurality of messages is respectively located, wherein the message transit server sequence information describes an order, of the message transit servers, that corresponds to a determined time order of the plurality of messages; and

message retrieving hardware means configured to retrieve in said order of the message transit servers, the plurality of messages from corresponding message transit servers using the message transit server sequence information.

9. The system according to claim 8, wherein the recording means is configured to:

query identifiers of message transit servers where the plurality of messages are respectively located; and

record queried identifiers at respective and corresponding locations in the message transit server sequence information.

10. The system according to claim 8, further comprising:

subscriber determining means configured to, for each message of the plurality of messages, determine, from each of a plurality of subscribers, a subscriber responsible for recording, in the message transit server sequence information, an identity of a message transit server where said each message is located.

11. The system according to claim 10, wherein the message retrieving means is further configured to:

directly use, by other subscribers from the plurality of subscribers but who are not predefined as responsible subscribers who are responsible for recording where each message is located, current message transit server sequence information to retrieve, in order, one or more of the plurality of messages from one or more corresponding message transit servers.

12. The system according to claim 9, further comprising:

first determining means configured to;

determine whether or not an other message that is not from the plurality of messages, but is based on a same topic as the plurality of messages, exists in a queried message transit server;

in response to a determination that the other message based on the same topic as the plurality of messages exists in the queried message transit server, recording in the message transit server sequence information a location of a queried message transit server at a location corresponding to the other message.

13. The system according to claim 10, wherein a subscriber responsible for recording, in the message transit server sequence information, a message transit server where the each message is located, is determined using lock contention.

14. The system according to claim 8, wherein the recording means is further configured to:

determine whether or not current message transit server sequence information contains a message transit server corresponding to a specific message of the plurality of messages; and

in response to a determination result being no, record in the message transit server sequence information the message transit server where the specific message is located;

and wherein the message retrieving means is further configured to;

in response to a determination result being yes, retrieve, in order, the specific message from a corresponding message transit server using the current message transit server sequence information.

15. A computer program product for retrieving, in order, a plurality of specific topic-based messages in a distributed publish/subscribe system, the distributed publish/subscribe system comprising at least one message transit server, the computer program product comprising a computer readable storage medium having program code embodied therewith, the program code readable and executable by a processor to perform a method comprising:

determining an order of a plurality of messages that are planned for retrieval, wherein the order describes a time order in which each message, from the plurality of messages, is planned for retrieval compared to other messages from the plurality of messages;

recording message transit server sequence information for message transit servers where each of the plurality of messages is respectively located, wherein the message transit server sequence information describes an order, of the message transit servers, that corresponds to a determined time order of the plurality of messages; and

retrieving, in said order of the message transit servers, the plurality of messages from corresponding message transit servers using the message transit server sequence information.

16. The computer program product according to claim 15, wherein the recording, in the message transit server sequence information, of the order of the message transit servers where the plurality of messages are respectively located comprises:

querying identifiers of message transit servers where the plurality of messages are respectively located; and

recording queried identifiers at respective and corresponding locations in the message transit server sequence information.

17. The computer program product of claim 15, wherein the method further comprises:

for each message of the plurality of messages, determining, from each of a plurality of subscribers, a subscriber responsible for recording, in the message transit server sequence information, an identity of a message transit server where said each message is located.

18. The computer program product of claim 17, wherein the retrieving, in order, the plurality of messages from corresponding message transit servers using the message transit server sequence information comprises:

directly using, by other subscribers from the plurality of subscribers but who are not predefined as responsible subscribers who are responsible for recording where each message is located, current message transit server sequence information to retrieve, in order, one or more of the plurality of messages from one or more corresponding message transit servers.

19. The computer program product of claim 16, wherein the method further comprises:

determining whether or not an other message that is not from the plurality of messages, but is based on a same topic as the plurality of messages, exists in a queried message transit server;

in response to a determination that the other message based on the same topic as the plurality of messages exists in the queried message transit server, recording, in the message transit server sequence information, a location of a queried message transit server at a location corresponding to the other message.

20. The computer program product of claim 17, wherein the method further comprises:

using lock contention to determine, for each message of the plurality of messages, the subscriber responsible for recording in the message transit server sequence information the message transit server where said each message is located.