Method of optimizing propagation of non-persistent messages from a source database management system to a destination database management system

• US 7,895,600 B2
• Filed: 06/19/2006
• Issued: 02/22/2011
• Est. Priority Date: 05/10/2006
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Surlaker, Kapil, Arora, Nimar Singh
• Primary Examiner(s): Ho; Andy
• Assistant Examiner(s): Yun; Carina
• Application Number:
  US11/471,167
• Publication Number:
  US 20070266393A1
• Time in Patent Office: 1,709 Days
• Field of Search: 719/314, 707/104.1
• US Class Current: 719/314
• CPC Class Codes: G06F 9/544 Buffers; Shared memory; Pipes

Abstract

A method of optimizing propagation of non-persistent messages from a source database management system (DBMS) to a destination database management system (DBMS) is described and provided. The method comprises receiving one or more nonpersistent messages from a source non-persistent message queue of the source DBMS at a destination non-persistent message queue of the destination DBMS. The nonpersistent messages are consumed from the destination non-persistent message queue such that consumed non-persistent messages are removed from the destination non-persistent message queue. Further, at least a portion of the non-persistent messages are spilled from the destination non-persistent message queue to a destination persistent message queue of the destination DBMS based on at least one parameter selected from a group consisting of a sparseness factor, number of nonpersistent messages in the destination non-persistent message queue, and amount of memory resources utilized by the destination non-persistent message queue. Moreover, to the source DBMS is sent an acknowledgment including a watermark indication of consumed non-persistent messages from the destination non-persistent message queue. Spilled non-persistent messages are characterized as consumed.

Claims

1. A method of optimizing propagation of non-persistent messages from a source database management system (DBMS) to a destination database management system (DBMS), said method comprising:

receiving, by said destination DBMS, one or more non-persistent messages from a source non-persistent message queue of said source DBMS at a destination non-persistent message queue of said destination DBMS;

consuming, by said destination DBMS, said non-persistent messages from said destination non-persistent message queue such that consumed non-persistent messages are removed from said destination non-persistent message queue;

generating, by said destination DBMS, a sparseness factor based at least in part on a number of non-persistent messages in said destination non-persistent message queue, the highest non-persistent message number of said destination non-persistent message queue, and the lowest non-persistent message number of said destination non-persistent message queue;

selectively spilling, by said destination DBMS, at least a portion of said non-persistent messages from said destination non-persistent message queue to a destination persistent message queue of said destination DBMS based on at least one parameter selected from a group consisting of;

said sparseness factor, said number of non-persistent messages in said destination non-persistent message queue, and an amount of memory resources utilized by said destination non-persistent message queue; and

sending, by said destination DBMS to said source DBMS, an acknowledgment including a watermark indication of consumed non-persistent messages from said destination non-persistent message queue, wherein spilled non-persistent messages that have not yet been consumed are characterized in the watermark indication as consumed.

2. The method as recited in claim 1 further comprising:

in response to said acknowledgment, removing from said source non-persistent message queue one or more non-persistent messages based on said watermark indication of consumed non-persistent messages and based on no longer needed non-persistent messages in said source non-persistent message queue.

3. The method as recited in claim 1 wherein said sending to said source DBMS an acknowledgment, comprises:

receiving a request for said acknowledgment from said source DBMS; and

computing said acknowledgment.

4. The method as recited in claim 1 further comprising:

sending additional non-persistent messages from said source non-persistent message queue of said source DBMS to said destination non-persistent message queue of said destination DBMS; and

receiving said additional non-persistent messages at destination non-persistent message queue.

5. The method as recited in claim 1 wherein a quality of service of said propagation of non-persistent messages is at least once delivery guarantee.

6. The method as recited in claim 1 further comprising:

setting threshold values for said sparseness factor, said number of non-persistent messages in said destination non-persistent message queue, and said amount of memory resources utilized by said destination non-persistent message queue.

7. The method as recited in claim 6 wherein said spilling at least a portion of said non-persistent messages is performed to reduce values of said sparseness factor, said number of non-persistent messages in said destination non-persistent message queue, and said amount of memory resources utilized by said destination non-persistent message queue below said threshold values.

8. A non-transitory computer-readable medium comprising computer-executable instructions stored therein for optimizing propagation of non-persistent messages from a source database management system (DBMS) to a destination database management system (DBMS), the computer-executable instructions comprising:

instructions that cause said destination DBMS to receive one or more non-persistent messages from a source non-persistent message queue of said source DBMS at a destination non-persistent message queue of said destination DBMS;

instructions that cause said destination DBMS to consume said non-persistent messages from said destination non-persistent message queue such that consumed non-persistent messages are removed from said destination non-persistent message queue;

instructions that cause said destination DBMS to generate a sparseness factor based at least in part on a number of non-persistent messages in said destination non-persistent message queue, the highest non-persistent message number of said destination non-persistent message queue, and the lowest non-persistent message number of said destination non-persistent message queue;

instructions that cause the destination DBMS to spill at least a portion of said non-persistent messages from said destination non-persistent message queue to a destination persistent message queue of said destination DBMS based on at least one parameter selected from a group consisting of said sparseness factor, said number of non-persistent messages in said destination non-persistent message queue, and an amount of memory resources utilized by said destination non-persistent message queue; and

instructions that cause the destination DBMS to send to said source DBMS an acknowledgment including a watermark indication of consumed non-persistent messages from said destination non-persistent message queue, wherein spilled non-persistent messages that have not yet been consumed are characterized in the watermark indication as consumed.

9. The non-transitory computer-readable medium as recited in Claim 8 wherein said computer-executable instructions further comprise:

instructions that cause the destination DBMS to, in response to said acknowledgment, remove from said source non-persistent message queue one or more non-persistent messages based on said watermark indication of consumed non-persistent messages and based on no longer needed non-persistent messages in said source non-persistent message queue.

10. The non-transitory computer-readable medium as recited in claim 8 wherein said sending to said source DBMS an acknowledgment, comprises:

receiving a request for said acknowledgment from said source DBMS; and

computing said acknowledgment.

11. The non-transitory computer-readable medium as recited in claim 8 wherein said computer-executable instructions further comprise:

instructions that cause the destination DBMS to send additional non-persistent messages from said source non-persistent message queue of said source DBMS to said destination non-persistent message queue of said destination DBMS; and

instructions that cause the destination DBMS to receive said additional non-persistent messages at said destination non-persistent message queue.

12. The non-transitory computer-readable medium as recited in claim 8 wherein a quality of service of said propagation of non-persistent messages is at least once delivery guarantee.

13. The non-transitory computer-readable medium as recited in claim 8 wherein said computer-executable instructions further comprise:

instructions that cause the destination DBMS to set threshold values for said sparseness factor, said number of non-persistent messages in said destination non-persistent message queue, and said amount of memory resources utilized by said destination non-persistent message queue.

14. The non-transitory computer-readable medium as recited in claim 13 wherein said spilling at least a portion of said non-persistent messages is performed to reduce values of said sparseness factor, said number of non-persistent messages in said destination non-persistent message queue, and said amount of memory resources utilized by said destination non-persistent message queue below said threshold values.

15. An apparatus comprising:

a memory comprising instructions stored therein; and

a processor for executing said instructions to optimize propagation of non-persistent messages from a source database management system (DBMS) to a destination database management system (DBMS), the processor being configured to;

receive one or more non-persistent messages from a source non-persistent message queue of said source DBMS at a destination non-persistent message queue of said destination DBMS;

consume said non-persistent messages from said destination non-persistent message queue such that consumed non-persistent messages are removed from said destination non-persistent message queue;

generate a sparseness factor based at least in part on a number of non-persistent messages in said destination non-persistent message queue, the highest non-persistent message number of said destination non-persistent message queue, and the lowest non-persistent message number of said destination non-persistent message queue;

selectively spill at least a portion of said non-persistent messages from said destination non-persistent message queue to a destination persistent message queue of said destination DBMS based on at least one parameter selected from a group consisting of;

said sparseness factor, said number of non-persistent messages in said destination non-persistent message queue, and an amount of memory resources utilized by said destination non-persistent message queue; and

send to said source DBMS an acknowledgment including a watermark indication of consumed non-persistent messages from said destination non-persistent message queue, wherein spilled non-persistent messages that have not yet been consumed are characterized in the watermark indication as consumed.

16. The apparatus as recited in claim 15 wherein said processor is further configured to:

in response to said acknowledgment, remove from said source non-persistent message queue one or more non-persistent messages based on said watermark indication of consumed non-persistent messages and based on no longer needed non-persistent messages in said source non-persistent message queue.

17. The apparatus as recited in claim 15 wherein said sending to said source DBMS an acknowledgment, comprises:

receiving a request for said acknowledgment from said source DBMS; and

computing said acknowledgment.

18. The apparatus as recited in claim 15 wherein said processor is further configured to:

send additional non-persistent messages from said source non-persistent message queue of said source DBMS to said destination non-persistent message queue of said destination DBMS; and

receive said additional non-persistent messages at destination non-persistent message queue.

19. The apparatus as recited in claim 15 wherein a quality of service of said propagation of non-persistent messages is at least once delivery guarantee.

20. The apparatus as recited in claim 15 wherein said processor is further configured to:

set threshold values for said sparseness factor, said number of non-persistent messages in said destination non-persistent message queue, and said amount of memory resources utilized by said destination non-persistent message queue.

21. The apparatus as recited in claim 20 wherein said spilling at least a portion of said non-persistent messages is performed to reduce values of said sparseness factor, said number of non-persistent messages in said destination non-persistent message queue, and said amount of memory resources utilized by said destination non-persistent message queue below said threshold values.