Method and mechanism for efficient processing of remote-mapped queries

• US 7,389,284 B1
• Filed: 05/10/2002
• Issued: 06/17/2008
• Est. Priority Date: 02/29/2000
• Status: Expired due to Term

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Surlaker, Kapil, Saha, Debashis, Gollapudi, Sreenivas, Chidambaran, Lakshminarayanan
• Primary Examiner(s): ALAM, SHAHID AL
• Application Number:
  US10/144,382
• Time in Patent Office: 2,230 Days
• Field of Search: 707/2, 707/3, 707/10, 707/102, 707/103.R, 707/100, 707/5, 707/6, 711/133, 711/213, 341/87, 709/203, 709/247
• US Class Current: 707/714
• CPC Class Codes: G06F 16/2471 Distributed queries
• CPC Class Codes: Y10S 707/966 Distributed
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99934 Query formulation, input preparation, or translation

Abstract

A method and mechanism for reducing the expense of data transmissions and storage between a first node and a second for a remote-mapped query or a query involving a distributed join operation is disclosed. Data prefetching can be utilized to predictably retrieve information. Data redundancy management can be employed to reduce the expense of transmitting and storing redundant data.

Claims

1. A process for increasing the efficiency of processing a query, comprising:

receiving a request to execute a remote-mapped query;

identifying data to transmit between a first node and a second node to process the remote-mapped query;

identifying prefetch data, said prefetch data comprising a portion of the data not immediately requested by a user for transmission to process the remote-mapped query;

determining an existence of data redundancies in said prefetch data, wherein said prefetch data comprises a portion of a table; and

transmitting a reduced set of prefetch data, said reduced set containing fewer data redundancies than said prefetch data;

wherein the act of determining said existence of data redundancies in said prefetch data comprises identifying at least two prefetch items in said table that have a same value.

2. The process of claim 1 in which determining the existence of said data redundancies is performed by calculating row differences between successive rows in said prefetch data.

3. The process of claim 2 in which calculating said row differences between successive rows in said prefetch data is performed by identifying identical column values for said successive rows.

4. The process of claim 2 in which determining the existence of said data redundancies in said prefetch data is performed by consulting a bitmap corresponding to changes between a first row and a second row of a database table.

5. The process of claim 4 in which consulting said bitmap is performed by evaluating each bit in said bitmap to determine changes between said first row and said second row.

6. The process of claim 2 in which determining the existence of said data redundancies in said prefetch data is performed by creating a bitmap corresponding to changes between a first row and a second row of a database table, said bitmap containing bit values for differences in column values between said first and said second rows.

7. The process of claim 6 in which said first and said second rows are not consecutive rows of prefetch data.

8. The process of claim 7 in which said bitmap is a multidimensional bitmap.

9. The process of claim 1 in which determining the existence of said data redundancies in said prefetch data is performed by identifying multiple copies of an item of information in said prefetch data;

and

the act of transmitting a reduced set of prefetch data comprises sending a single copy of said item that has not changed between a first row and a second row.

10. The process of claim 9 further comprising:

maintaining pointers at said client corresponding to said prefetch data;

pointing multiple ones of said pointers to said single copy in a client cache.

11. The process of claim 1 wherein said remote-mapped query corresponds to a distributed join operation.

12. The process of claim 1 in which said first node and said second node are both server nodes.

13. The method of claim 1, further comprising determining an existence of data redundancies in a portion of said data that are explicitly requested by said user.

14. A computer program product that includes a storage medium usable by a processor, the medium comprising a volatile or non-volatile medium, the medium comprising a sequence of instructions which, when executed by said processor, causes said processor to execute a process for efficiently processing a query, said process comprising:

receiving a request to execute a remote-mapped query;

identifying data to transmit between a first node and a second node to process the remote-mapped query;

identifying prefetch data, said prefetch data comprising a portion of the data not immediately requested by a user for transmission to process the remote-mapped query;

determining an existence of data redundancies in said prefetch data, wherein said prefetch data comprises a portion of a table; and

transmitting a reduced set of prefetch data, said reduced set containing fewer data redundancies than said prefetch data;

wherein said act of determining said existence of data redundancies in said prefetch data comprises identifying at least two prefetch items in said table that have a same value.

15. The computer program product of claim 14 in which determining the existence of said data redundancies is performed by calculating row differences between successive rows in said prefetch data.

16. The computer program product of claim 15 in which calculating said row differences between successive rows in said prefetch data is performed by identifying identical column values for said successive rows.

17. The computer program product of claim 15 in which determining the existence of said data redundancies in said prefetch data is performed by consulting a bitmap corresponding to changes between a first row and a second row of a database table.

18. The computer program product of claim 17 in which consulting said bitmap is performed by evaluating each bit in said bitmap to determine changes between said first row and said second row.

19. The computer program product of claim 15 in which determining the existence of said data redundancies in said prefetch data is performed by creating a bitmap corresponding to changes between a first row and a second row of a database table, said bitmap containing bit values for differences in column values between said first and said second rows.

20. The computer program product of claim 19 in which said first and said second rows are not consecutive rows of prefetch data.

21. The computer program product of claim 20 in which said bitmap is a multidimensional bitmap.

22. The computer program product of claim 14 in which determining the existence of said data redundancies in said prefetch data is performed by identifying multiple copies of an item of information in said prefetch data;

and

the act of transmitting a reduced set of prefetch data comprises sending a single copy of said item that has not changed between a first row and a second row.

23. The computer program product of claim 22 further comprising:

maintaining pointers at said client corresponding to said prefetch data;

pointing multiple ones of said pointers to said single copy in a client cache.

24. The computer program product of claim 14 wherein said remote-mapped query corresponds to a distributed join operation.

25. The computer program product of claim 14 in which said first node and said second node are both server nodes.

26. The computer program product of claim 14, wherein said process further comprises determining an existence of data redundancies in a portion of said data that are explicitly requested by said user.

27. A system implemented using a processor for efficiently processing a query, comprising:

means for receiving a request to execute a remote-mapped query;

means for identifying data to transmit between a first node and a second node to process the remote-mapped query;

means for identifying prefetch data, said prefetch data comprising a portion of the data not immediately requested by a user for transmission to process the remote-mapped query;

means for determining an existence of data redundancies in said prefetch data, wherein said prefetch data comprises a portion of a table; and

means for transmitting a reduced set of prefetch data, said reduced set containing fewer data redundancies than said prefetch data;

wherein said means for determining said existence of data redundancies in said prefetch data configured to identify at least two prefetch items in said table that have a same value.

28. The system of claim 27 in which the means for determining the existence of said data redundancies is performed using means for calculating row differences between successive rows in said prefetch data.

29. The system of claim 28 in which the means for calculating said row differences between successive rows in said prefetch data is performed using means for identifying identical column values for said successive rows.

30. The system of claim 28 in which the means for determining the existence of said data redundancies in said prefetch data is implemented by consulting a bitmap corresponding to changes between a first row and a second row of a database table.

31. The system of claim 30 in which consulting said bitmap is performed by evaluating each bit in said bitmap to determine changes between said first row and said second row.

32. The system of claim 28 in which the means for determining the existence of said data redundancies in said prefetch data is performed using means for creating a bitmap corresponding to changes between a first row and a second row of a database table, said bitmap containing bit values for differences in column values between said first and said second rows.

33. The system of claim 32 in which said first and said second rows are not consecutive rows of prefetch data.

34. The system of claim 33 in which said bitmap is a multidimensional bitmap.

35. The system of claim 27 in which the means for determining the existence of said data redundancies in said prefetch data is performed by identifying multiple copies of an item of information in said prefetch data;

and

the means for transmitting a reduced set of prefetch data comprises means for sending a single copy of said item that has not changed between a first row and a second row.

36. The system of claim 35 further comprising:

means for maintaining pointers at said client corresponding to said prefetch data;

means for pointing multiple ones of said pointers to said single copy in a client cache.

37. The system of claim 27 wherein said remote-mapped query corresponds to a distributed join operation.

38. The system of claim 27 in which said first node and said second node are both server nodes.

39. The system of claim 27, further comprising means for determining an existence of data redundancies in a portion of said data that are explicitly requested by said user.