Mechanism for efficient maintenance of XML index structures in a database system

• US 8,566,300 B2
• Filed: 11/22/2005
• Issued: 10/22/2013
• Est. Priority Date: 07/02/2004
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Murthy, Ravi, Chandrasekar, Sivasankaran, Sedlar, Eric, Agarwal, Nipun
• Primary Examiner(s): Alam, Hosain
• Assistant Examiner(s): JOHNSON, JOHNESE T
• Application Number:
  US11/286,873
• Publication Number:
  US 20060080345A1
• Time in Patent Office: 2,891 Days
• Field of Search: 707/705
• US Class Current: 707/705
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/81 Indexing, e.g. XML tags; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/8373 Query execution
• CPC Class Codes: G06F 16/86 Mapping to a database
• CPC Class Codes: G06F 40/123 Storage facilities
• CPC Class Codes: G06F 40/131 Fragmentation of text files, e.g. creating reusable text-blocks; Linking to fragments, e.g. using XInclude; Namespaces
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]

Abstract

A method and apparatus for efficiently maintaining XML index structures in a database system is provided. Instead of immediately synchronizing the XML index structures for every change submitted to the database, the changes are stored in a PENDING table. The XML index structures are periodically synchronized, based on certain criteria or at a user'"'"'s discretion. Between synchronizations, the XML index structures may be in stale mode or current mode. If in stale mode, a request to access indexed information will use the XML index structures to find the desired indexed information without checking the PENDING table. If in current mode, a request to access indexed information will search the XML index structures and also check the PENDING table to determine 1) whether the indexed information has been updated or deleted, and 2) whether information relevant to the request has been inserted or updated.

Claims

1. A method comprising:

when changes are made to indexed information, storing one or more indications that an index has to be changed, wherein the step of storing one or more indications is performed in a first operation that is synchronous relative to the changes, wherein the index is not changed during said first operation;

in response to detecting that certain conditions have been satisfied, performing a second operation that updates the index and removes the one or more indications that the index has to be changed, wherein the second operation is performed asynchronously relative to the changes made to the indexed information; and

after the first operation has been completed and before the second operation is performed;

receiving a request to access the indexed information; and

in response to receiving the request;

obtaining accessed information by using the index to access the indexed information even though the changes are not yet reflected in the index;

reading data to determine whether the index is maintained in asynchronous stale mode or in asynchronous current mode;

if the index is maintained in asynchronous stale mode, then using the index to return the accessed information; and

if the index is maintained in asynchronous current mode, then;

determining, from the one or more indications, whether any portion of the accessed information has been deleted or updated,

if a portion of the accessed information has been deleted or updated, responding to the request after removing said portion of the accessed information from the accessed information; and

examining the one or more indications for inserted and updated information that relates to the request.

2. The method as in claim 1, wherein said certain conditions are satisfied by a user providing user input that specifies that the index is to be updated to reflect the changes.

3. The method as in claim 1, wherein the indexed information is XML.

4. The method as in claim 1, wherein:

a pending table stores the indications,

the indexed information is information in one or more documents, and

the certain conditions include at least one of;

the size of all documents, corresponding to pending changes stored in the pending table, exceeds a specified size, or

resource utilization has reached a specified level.

5. The method as in claim 1, wherein each indication is associated with:

an opcode number, which identifies an operation being performed; and

a document identifier, which identifies a document affected by the operation.

6. The method as in claim 5, wherein each indication is also associated with an order key value, which identifies a particular node or subtree in the document affected by the operation.

7. The method as in claim 1, wherein the second operation comprises the steps of:

disabling the index and any secondary indexes,

for each indication,

if the operation associated with the indication is a deletion, deleting the index entries corresponding to the indication;

if the operation associated with the indication is an insertion, generating and inserting index entries corresponding to the indication; and

if the operation associated with the indication is an update, deleting the index entries corresponding to the indication, and generating and inserting index entries corresponding to the indication;

enabling the index and any secondary indexes; and

deleting all indications.

8. The method as in claim 1, further comprising storing data that indicates whether the index is to be maintained asynchronously or synchronously, wherein if the data is changed to indicate that the index is to be maintained synchronously, then changes made to the indexed information during a subsequent operation causes the index to be changed during the subsequent operation.

9. The method as in claim 1, further comprising, in response to user input, storing data that indicates whether the index is to be maintained in asynchronous stale mode or asynchronous current mode.

10. The method as in claim 1, wherein:

the index is one of a plurality of related indexes;

the plurality of related indexes include the index and one or more secondary indexes; and

a subset of the plurality of related indexes is synchronized more frequently than a different subset of the plurality of related indexes based on a second set of certain conditions.

11. One or more non-transitory machine-readable media storing instructions which, when executed by one or more processors, cause:

when changes are made to indexed information, storing one or more indications that an index has to be changed, wherein the step of storing one or more indications is performed in a first operation that is synchronous relative to the changes, wherein the index is not changed during said first operation;

in response to detecting that certain conditions have been satisfied, performing a second operation that updates the index and removes the one or more indications that the index has to be changed, wherein the second operation is performed asynchronously relative to the changes made to the indexed information; and

after the first operation has been completed and before the second operation is performed;

receiving a request to access the indexed information; and

in response to receiving the request;

obtaining accessed information by using the index to access the indexed information even though the changes are not yet reflected in the index;

reading data to determine whether the index is maintained in asynchronous stale mode or in asynchronous current mode;

if the index is maintained in asynchronous stale mode, then using the index to return the accessed information; and

if the index is maintained in asynchronous current mode, then;

determining, from the one or more indications, whether any portion of the accessed information has been deleted or updated,

if a portion of the accessed information has been deleted or updated, responding to the request after removing said portion of the accessed information from the accessed information; and

examining the one or more indications for inserted and updated information that relates to the request.

12. The one or more machine-readable media of claim 11, wherein said certain conditions are satisfied by a user providing user input that specifies that the index is to be updated to reflect the changes.

13. The one or more machine-readable media of claim 11, wherein the indexed information is XML.

14. The one or more machine-readable media of claim 11, wherein:

a pending table stores the indications,

the indexed information is information in one or more documents, and

the certain conditions include at least one of;

the size of all documents, corresponding to pending changes stored in the pending table, exceeds a specified size, or

resource utili7ation has reached a specified level.

15. The one or more machine-readable media of claim 11, wherein each indication is associated with:

an opcode number, which identifies an operation being performed; and

a document identifier, which identifies a document affected by the operation.

16. The one or more machine-readable media of claim 15, wherein each indication is also associated with an order key value, which identifies a particular node or subtree in the document affected by the operation.

17. The one or more machine-readable media of claim 11, wherein the second operation comprises:

disabling the index and any secondary indexes,

for each indication,

if the operation associated with the indication is a deletion, deleting the index entries corresponding to the indication;

if the operation associated with the indication is an insertion, generating and inserting index entries corresponding to the indication; and

if the operation associated with the indication is an update, deleting the index entries corresponding to the indication, and generating and inserting index entries corresponding to the indication;

enabling the index and any secondary indexes; and

deleting all indications.

18. The one or more machine-readable media of claim 11, wherein the instructions, when executed by the one or more processors, further cause storing data that indicates whether the index is to be maintained asynchronously or synchronously, wherein if the data is changed to indicate that the index is to be maintained synchronously, then changes made to the indexed information during a subsequent operation causes the index to be changed during the subsequent operation.

19. The one or more machine-readable media of claim 11, wherein the instructions, when executed by the one or more processors, further cause, in response to user input, storing data that indicates whether the index is to be maintained in asynchronous stale mode or asynchronous current mode.

20. The one or more machine-readable media of claim 11, wherein:

the index is one of a plurality of related indexes;

the plurality of related indexes include the index and one or more secondary indexes; and

a subset of the plurality of related indexes is synchronized more frequently than a different subset of the plurality of related indexes based on a second set of certain conditions.