SYSTEM AND METHOD FOR FLOW CONTROL IN A MESSAGING SUBSYSTEM BASED ON MESSAGE-IN/OUT RATES

• US 20120324000A1
• Filed: 06/17/2011
• Published: 12/20/2012
• Est. Priority Date: 06/17/2011
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Kang, Amy H., Bratt, Edward J.
• Granted Patent: US 9,110,745 B2
• Time in Patent Office: Days
• US Class Current: 709/204
• CPC Class Codes: G06F 9/546 Message passing systems or structures, e.g. queues

Abstract

Systems and methods are provided, for use in a messaging subsystem, which supports flow control of messages between producers and consumers. A system can include at least one producer that is operable to send messages in a batch to one or more consumers via at least one destination; and one or more consumers that are operable to process messages received from the at least one producer via the at least one destination. The system can also include a message broker which includes the at least one destination and which manages communications between the at least one producer and the one or more consumers. The message broker includes a flow controller that is operable to monitor a producing rate and a consuming rate, and dynamically adjust a batch size of the batch at the at least one producer based on the producing rate and the consuming rate to communicate the messages more efficiently.

Claims

1. A system for use in a messaging subsystem, which supports flow control of messages between producers and consumers, comprising:

a computer, including a computer readable medium and processor;

at least one producer that is operable to send messages in a batch to one or more consumers via at least one destination;

one or more consumers that are operable to process messages received from the at least one producer via the at least one destination; and

a message broker which includes the at least one destination and which manages communications between the at least one producer and the one or more consumers, wherein the message broker includes a flow controller that is operable to

monitor a producing rate and a consuming rate, and

dynamically adjust a batch size of the batch at the at least one producer based on the producing rate and the consuming rate.

2. The system of claim 1, wherein the batch size is dynamically adjusted at the at least one producer when an instruction to resume flow is received at the at least one producer from the message broker.

3. The system of claim 2, wherein the batch size at the at least one producer is dynamically adjusted each time the instruction to resume flow is received at the at least one producer.

4. The system of claim 1, wherein:

the producing rate is determined for the at least one destination based on how many messages have been produced by the at least one producer over a configurable time period; and

the consuming rate is determined for the at least one destination based on how many messages have been consumed by the one or more consumers over the configurable time period.

5. The system of claim 1, wherein the flow controller is further operable to dynamically adjust a batch size by:

calculating a ratio of the consuming rate to the producing rate; and

dynamically adjusting the batch size, based on the calculated ratio, to a new batch size, so that subsequent messages from the particular message producer are sent according to the new batch size.

6. The system of claim 5, wherein the new batch size is determined by multiplying the batch size by the calculated ratio.

7. A method for use in a messaging subsystem, which supports flow control of messages between producers and consumers, the method comprising:

providing a message broker, executing on a computer including a computer readable medium and processor, wherein the message broker includes at least one destination and a flow controller;

receiving, at the at least one destination, messages in a batch from at least one producer;

sending the messages to one or more consumers that are operable to process the messages received from the at least one producer via the at least one destination;

managing communications between the at least one producer and the one or more consumers, including

monitoring a producing rate and a consuming rate, and

dynamically adjusting a batch size of the batch at the at least one producer based on the producing rate and the consuming rate.

8. The method of claim 7, wherein the step of dynamically adjusting the batch size comprises:

sending an instruction to resume flow to the at least one producer from the message broker; and

wherein the instruction to resume flow includes a new batch size.

9. The method of claim 8, wherein the batch size at the at least one producer is dynamically adjusted each time the instruction to resume flow is received at the at least one producer.

10. The method of claim 7, wherein:

the producing rate is determined for the at least one destination based on how many messages have been produced by the at least one producer over a configurable time period; and

the consuming rate is determined for the at least one destination based on how many messages have been consumed by the one or more consumers over the configurable time period.

11. The method of claim 7, wherein the step of managing communications between the at least one producer and the one or more consumers further comprises:

calculating a ratio of the consuming rate to the producing rate; and

dynamically adjusting the batch size, based on the calculated ratio, to a new batch size, so that subsequent messages from the particular message producer are sent according to the new batch size.

12. The method of claim 11, wherein the new batch size is determined by multiplying the batch size by the calculated ratio.

13. A non-transitory computer readable storage medium including instructions stored thereon which, when executed by one or more computers, causes the one or more computers to perform the steps of:

providing a message broker, executing on a computer including a computer readable medium and processor, wherein the message broker includes at least one destination and a flow controller;

receiving, at the at least one destination, messages in a batch from at least one producer;

sending the messages to one or more consumers that are operable to process the messages received from the at least one producer via the at least one destination;

managing communications between the at least one producer and the one or more consumers, including

monitoring a producing rate and a consuming rate, and

dynamically adjusting a batch size of the batch at the at least one producer based on the producing rate and the consuming rate.

14. The non-transitory computer readable storage medium of claim 13, wherein the step of dynamically adjusting the batch size comprises:

sending an instruction to resume flow to the at least one producer from the message broker; and

wherein the instruction to resume flow includes a new batch size.

15. The non-transitory computer readable storage medium of claim 14, wherein the batch size at the at least one producer is dynamically adjusted each time the instruction to resume flow is received at the at least one producer.

16. The non-transitory computer readable storage medium of claim 13, wherein:

the producing rate is determined for the at least one destination based on how many messages have been produced by the at least one producer over a configurable time period; and

the consuming rate is determined for the at least one destination based on how many messages have been consumed by the one or more consumers over the configurable time period.

17. The non-transitory computer readable storage medium of claim 13, wherein the step of managing communications between the at least one producer and the one or more consumers further comprises:

calculating a ratio of the consuming rate to the producing rate; and

dynamically adjusting the batch size, based on the calculated ratio, to a new batch size, so that subsequent messages from the particular message producer are sent according to the new batch size.

18. The non-transitory computer readable storage medium of claim 17, wherein the new batch size is determined by multiplying the batch size by the calculated ratio.