Method of optimizing propagation of non-persistent messages from a source database management system to a destination database management system

• US 20070266393A1
• Filed: 06/19/2006
• Published: 11/15/2007
• Est. Priority Date: 05/10/2006
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Surlaker, Kapil, Arora, Nimar Singh
• Granted Patent: US 7,895,600 B2
• Time in Patent Office: Days
• US Class Current: 719/314
• CPC Class Codes: G06F 9/544 Buffers; Shared memory; Pipes

Abstract

A method of optimizing propagation of non-persistent messages from a source database management system (DBMS) to a destination database management system (DBMS) is described and provided. The method comprises receiving one or more non-persistent messages from a source non-persistent message queue of the source DBMS at a destination non-persistent message queue of the destination DBMS. The non-persistent messages are consumed from the destination non-persistent message queue such that consumed non-persistent messages are removed from the destination non-persistent message queue. Further, at least a portion of the non-persistent messages are spilled from the destination non-persistent message queue to a destination persistent message queue of the destination DBMS based on at least one parameter selected from a group consisting of a sparseness factor, number of non-persistent messages in the destination non-persistent message queue, and amount of memory resources utilized by the destination non-persistent message queue. Moreover, to the source DBMS is sent an acknowledgment including a watermark indication of consumed non-persistent messages from the destination non-persistent message queue. Spilled non-persistent messages are characterized as consumed.

Claims

1. A method of optimizing propagation of non-persistent messages from a source database management system (DBMS) to a destination database management system (DBMS), said method comprising:

receiving one or more non-persistent messages from a source non-persistent message queue of said source DBMS at a destination non-persistent message queue of said destination DBMS;

consuming said non-persistent messages from said destination non-persistent message queue such that consumed non-persistent messages are removed from said destination non-persistent message queue;

spilling at least a portion of said non-persistent messages from said destination non-persistent message queue to a destination persistent message queue of said destination DBMS based on at least one parameter selected from a group consisting of a sparseness factor, number of non-persistent messages in said destination non-persistent message queue, and amount of memory resources utilized by said destination non-persistent message queue; and

sending to said source DBMS an acknowledgment including a watermark indication of consumed non-persistent messages from said destination non-persistent message queue, wherein spilled non-persistent messages are characterized as consumed.

2. The method as recited in claim 1 further comprising:

in response to said acknowledgment, removing from said source non-persistent message queue one or more non-persistent messages based on said watermark indication of consumed non-persistent messages and based on no longer needed non-persistent messages in said source non-persistent message queue.

3. The method as recited in claim 1 wherein said sending to said source DBMS an acknowledgment, comprises:

receiving a request for said acknowledgment from said source DBMS; and

computing said acknowledgment.

4. The method as recited in claim 1 further comprising:

sending additional non-persistent messages from said source non-persistent message queue of said source DBMS to said destination non-persistent message queue of said destination DBMS; and

receiving said additional non-persistent messages at destination non-persistent message queue.

5. The method as recited in claim 1 wherein a quality of service of said propagation of non-persistent messages is at least once delivery guarantee.

6. The method as recited in claim 1 further comprising:

setting threshold values for said sparseness factor, said number of non-persistent messages in said destination non-persistent message queue, and said amount of memory resources utilized by said destination non-persistent message queue.

7. The method as recited in claim 6 wherein said spilling at least a portion of said non-persistent messages is performed to reduce values of said sparseness factor, said number of non-persistent messages in said destination non-persistent message queue, and said amount of memory resources utilized by said destination non-persistent message queue below said threshold values.

8. A computer-readable medium comprising computer-executable instructions stored therein for performing a method of optimizing propagation of non-persistent messages from a source database management system (DBMS) to a destination database management system (DBMS), said method comprising:

receiving one or more non-persistent messages from a source non-persistent message queue of said source DBMS at a destination non-persistent message queue of said destination DBMS;

consuming said non-persistent messages from said destination non-persistent message queue such that consumed non-persistent messages are removed from said destination non-persistent message queue;

spilling at least a portion of said non-persistent messages from said destination non-persistent message queue to a destination persistent message queue of said destination DBMS based on at least one parameter selected from a group consisting of a sparseness factor, number of non-persistent messages in said destination non-persistent message queue, and amount of memory resources utilized by said destination non-persistent message queue; and

sending to said source DBMS an acknowledgment including a watermark indication of consumed non-persistent messages from said destination non-persistent message queue, wherein spilled non-persistent messages are characterized as consumed.

9. The computer-readable medium as recited in claim 8 wherein said method further comprises:

in response to said acknowledgment, removing from said source non-persistent message queue one or more non-persistent messages based on said watermark indication of consumed non-persistent messages and based on no longer needed non-persistent messages in said source non-persistent message queue.

10. The computer-readable medium as recited in claim 8 wherein said sending to said source DBMS an acknowledgment, comprises:

receiving a request for said acknowledgment from said source DBMS; and

computing said acknowledgment.

11. The computer-readable medium as recited in claim 8 wherein said method further comprises:

sending additional non-persistent messages from said source non-persistent message queue of said source DBMS to said destination non-persistent message queue of said destination DBMS; and

receiving said additional non-persistent messages at destination non-persistent message queue.

12. The computer-readable medium as recited in claim 8 wherein a quality of service of said propagation of non-persistent messages is at least once delivery guarantee.

13. The computer-readable medium as recited in claim 8 wherein said method further comprises:

setting threshold values for said sparseness factor, said number of non-persistent messages in said destination non-persistent message queue, and said amount of memory resources utilized by said destination non-persistent message queue.

14. The computer-readable medium as recited in claim 13 wherein said spilling at least a portion of said non-persistent messages is performed to reduce values of said sparseness factor, said number of non-persistent messages in said destination non-persistent message queue, and said amount of memory resources utilized by said destination non-persistent message queue below said threshold values.

15. An apparatus comprising:

a memory comprising instructions stored therein; and

a processor for executing said instructions to perform a method of optimizing propagation of non-persistent messages from a source database management system (DBMS) to a destination database management system (DBMS), said method comprising;

receiving one or more non-persistent messages from a source non-persistent message queue of said source DBMS at a destination non-persistent message queue of said destination DBMS;

consuming said non-persistent messages from said destination non-persistent message queue such that consumed non-persistent messages are removed from said destination non-persistent message queue;

spilling at least a portion of said non-persistent messages from said destination non-persistent message queue to a destination persistent message queue of said destination DBMS based on at least one parameter selected from a group consisting of a sparseness factor, number of non-persistent messages in said destination non-persistent message queue, and amount of memory resources utilized by said destination non-persistent message queue; and

sending to said source DBMS an acknowledgment including a watermark indication of consumed non-persistent messages from said destination non-persistent message queue, wherein spilled non-persistent messages are characterized as consumed.

16. The apparatus as recited in claim 15 wherein said method further comprises:

in response to said acknowledgment, removing from said source non-persistent message queue one or more non-persistent messages based on said watermark indication of consumed non-persistent messages and based on no longer needed non-persistent messages in said source non-persistent message queue.

17. The apparatus as recited in claim 15 wherein said sending to said source DBMS an acknowledgment, comprises:

receiving a request for said acknowledgment from said source DBMS; and

computing said acknowledgment.

18. The apparatus as recited in claim 15 wherein said method further comprises:

sending additional non-persistent messages from said source non-persistent message queue of said source DBMS to said destination non-persistent message queue of said destination DBMS; and

receiving said additional non-persistent messages at destination non-persistent message queue.

19. The apparatus as recited in claim 15 wherein a quality of service of said propagation of non-persistent messages is at least once delivery guarantee.

20. The apparatus as recited in claim 15 wherein said method further comprises:

setting threshold values for said sparseness factor, said number of non-persistent messages in said destination non-persistent message queue, and said amount of memory resources utilized by said destination non-persistent message queue.

21. The apparatus as recited in claim 20 wherein said spilling at least a portion of said non-persistent messages is performed to reduce values of said sparseness factor, said number of non-persistent messages in said destination non-persistent message queue, and said amount of memory resources utilized by said destination non-persistent message queue below said threshold values.