Method and system for flexible sectioning of XML data in a database system

• US 7,461,074 B2
• Filed: 03/18/2005
• Issued: 12/02/2008
• Est. Priority Date: 04/09/2004
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Sedlar, Eric, Thusoo, Ashish, Chandrasekar, Sivasankaran, Murthy, Ravi, Agarwal, Nipun, Mukkamalla, Sreedhar
• Primary Examiner(s): Wong; Leslie
• Application Number:
  US11/083,828
• Publication Number:
  US 20050228818A1
• Time in Patent Office: 1,355 Days
• Field of Search: 707/3, 707/101, 707/E17.124, 715/234
• US Class Current: 1/1
• CPC Class Codes: G06F 16/81 Indexing, e.g. XML tags; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/86 Mapping to a database
• CPC Class Codes: G06F 40/123 Storage facilities
• CPC Class Codes: G06F 40/131 Fragmentation of text files, e.g. creating reusable text-blocks; Linking to fragments, e.g. using XInclude; Namespaces
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99942 Manipulating data structure, e.g. compression, compaction, compilation

Abstract

A method and system are provided for flexibly sectioning XML documents stored in a relational database system. The method includes obtaining a set of sectioning rules; receiving an XML document that is to be stored in the relational database system; and identifying a storage location for each node in the XML document based on the set of sectioning rules. The sectioning rules can also be used to determine which tables in the relational database should be queried when a query is received, and to determine which tables in the relational database should be updated when a command to update stored XML data is received.

Claims

1. A method of sectioning an XML document having one or more nodes, said method comprising the computer-implemented steps of:

obtaining a set of sectioning rules;

wherein each sectioning rule in the set of sectioning rules comprises matching criteria and a table identifier that identifies a database table in which a fragment of the XML document that matches the matching criteria is to be persistently stored;

receiving an XML document to be stored in a relational database system;

based on the set of sectioning rules, identifying one or more database tables in the relational database system in which to store fragments of the XML document;

storing the fragments of the XML document in the one or more database tables, wherein storing the fragments of the XML document comprises selectively sectioning the XML document based on the set of sectioning rules by performing steps that include;

for each particular fragment of the XML document that matches particular matching criteria included in a particular sectioning rule;

determining a particular database table of the one or more database tables that is identified by a particular table identifier included in the particular sectioning rule; and

storing the particular fragment in the particular database table.

2. The method of claim 1 wherein the step of identifying is performed within a database server of the relational database system.

3. The method of claim 1, wherein the XML document does not conform to a defined schema.

4. The method of claim 1, further comprising storing a fragment identifier with each fragment in the identified database table for the fragment.

5. The method of claim 1, wherein the matching criteria in said each sectioning rule comprises a path expression.

6. The method of claim 1, wherein matching criteria in a first sectioning rule comprises a first path expression and a first table identifier, and matching criteria in a second sectioning rule comprises a second path expression and the first table identifier.

7. The method of claim 1, wherein the step of identifying the one or more database tables comprises:

identifying a rule containing matching criteria that matches a node as a matching rule; and

identifying a storage location for the node as the database table associated with the table identifier in the matching rule.

8. The method of claim 7, wherein the step of identifying a rule as a matching rule comprises:

determining that a rule, in the set of sectioning rules, matches a node if the matching criteria in the rule includes a path expression that is a superset of the node'"'"'s path.

9. The method of claim 7, wherein the matching criteria comprises a path expression, said method additionally comprising the step of:

initializing a finite state machine to represent path expressions in the set of sectioning rules; and

wherein the step of identifying a rule as a matching rule comprises traversing the finite state machine to identify a rule that includes a path expression that matches the node'"'"'s path.

10. The method of claim 1, wherein the set of sectioning rules are ordered, and the step of identifying the one or more database tables comprises the steps of:

(a) setting a first rule in the set of sectioning rules as a current rule;

(b) determining whether matching criteria in the current rule matches a node'"'"'s path;

(c) if matching criteria in the current rule does not match the node'"'"'s path, then setting the current rule to a next rule in the set of sectioning rules, and repeating steps (b) and (c); and

(d) if matching criteria in the current rule matches the node'"'"'s path, then identifying the storage location for the node as the database table associated with the table identifier in the current rule.

11. The method of claim 1, wherein the received XML document is an updated version of an XML document already stored in the relational database system, the method additionally comprising the steps of:

receiving an update command, said command comprised of at least one path-based expression;

based on the set of sectioning rules, generating a list of database tables that correspond to the at least one path-based expression in the update command; and

executing the update command using only the database tables in the generated list of database tables.

12. The method of claim 1, wherein the step of obtaining a set of sectioning rules comprises receiving the set of sectioning rules from a user.

13. The method of claim 1, wherein the step of obtaining a set of sectioning rules comprises obtaining the set of sectioning rules from annotations in an XML schema.

14. A method of evaluating a query in a relational database system that stores XML data sectioned from XML documents in one or more section tables of a relational database according to a set of sectioning rules, said method comprising the computer-implemented steps of:

receiving a query, said query comprised of at least one path expression;

generating a list of section table identifiers that identify section tables in the relational database, each said section table identifier coffesponding to at least one rule in the set of sectioning rules that matches the at least one path expression; and

evaluating the query using only section tables identified in the generated list;

wherein said set of sectioning rules are rules that were used to determine where to store said XML data sectioned from said XML documents when said XML documents were initially selectively sectioned based on said set of sectioning rules and stored in the one or more section tables of the relational database;

wherein each sectioning rule in said set of sectioning rules comprises matching criteria and a table identifier that identifies a section table in which a fragment of an XML document that matched the matching criteria was persistently stored by;

determining the section table based on the table identifier included in the sectioning rule; and

storing the fragment of the XML document in the section table.

15. The method of claim 14 wherein the at least one path expression is an XPath query.

16. The method of claim 14 wherein the step of generating a list of section table identifiers comprises the steps of:

identifying at least one matching rule that includes matching criteria that matches the at least one path expression;

identifying the section table for each identified matching rule; and

generating the list comprised of identifiers for each identified section table.

17. The method of claim 16, further comprising the step of:

initializing a finite state machine to represent path expressions in the set of sectioning rules; and

wherein the step of identifying at least one matching rule comprises traversing the finite state machine to identify at least one rule that includes matching criteria that matches the at least one path expression.

18. A computer-readable storage medium storing one or more sequences of instructions for sectioning an XML document having one or more nodes, wherein the one or more sequences of instructions when executed by one or more processors cause the one or more processors to perform the steps of:

obtaining a set of sectioning rules;

wherein each sectioning rule in the set of sectioning rules comprises matching criteria and a table identifier that identifies a database table in which a fragment of the XML document that matches the matching criteria is to be persistently stored;

receiving an XML document to be stored in a relational database system;

based on the set of sectioning rules, identifying one or more database tables in the relational database system in which to store fragments of the XML document;

storing the fragments of the XML document in the one or more database tables, wherein storing the fragments of the XML document comprises selectively sectioning the XML document based on the set of sectioning rules by performing steps that include;

for each particular fragment of the XML document that matches particular matching criteria included in a particular sectioning rule;

determining a particular database table of the one or more database tables that is identified by a particular table identifier included in the particular sectioning rule; and

storing the particular fragment in the particular database table.

19. The computer-readable storage medium of claim 18, wherein the instructions that cause the one or more processors to perform the step of identifying are included within the executable code of a database server of the relational database system.

20. The computer-readable storage medium of claim 18, wherein the XML document does not conform to a defined schema.

21. The computer-readable storage medium of claim 18, wherein the one or more sequences of instructions further comprises instructions which, when executed by the one or more processors, cause the one or more processors to perform the step of storing a fragment identifier with each fragment in the identified database table for the fragment.

22. The computer-readable storage medium of claim 18, wherein the matching criteria in said each sectioning rule comprises a path expression.

23. The computer-readable storage medium of claim 18, wherein matching criteria in a first sectioning rule comprises a first path expression and a first table identifier, and matching criteria in a second sectioning rule comprises a second path expression and the first table identifier.

24. The computer-readable storage medium of claim 18, wherein the instructions that cause the one or more processors to perform the step of identifying the one or more database tables comprise instructions which, when executed by the one or more processors, cause the one or more processors to perform the steps of:

identifying a rule containing matching criteria that matches a node as a matching rule; and

identifying a storage location for the node as the database table associated with the table identifier in the matching rule.

25. The computer-readable storage medium of claim 24, wherein the instructions that cause the one or more processors to perform the step of identifying a rule as a matching rule further comprise instructions which, when executed by the one or more processors, cause the one or more processors to perform the step of:

determining that a rule, in the set of sectioning rules, matches a node if the matching criteria in the rule includes a path expression that is a superset of the node'"'"'s path.

26. The computer-readable storage medium of claim 24, wherein the matching criteria comprises a path expression, and wherein the one or more sequences of instructions further comprise instructions which, when executed by the one or more processors, cause the one or more processors to perform the step of:

initializing a finite state machine to represent path expressions in the set of sectioning rules; and

wherein the instructions that cause the one or more processors to perform the step of identifying a rule as a matching rule comprise instructions which, when executed by the one or more processors, cause the one or more processors to perform the step of traversing the finite state machine to identify a rule that includes a path expression that matches the node'"'"'s path.

27. The computer-readable storage medium of claim 18, wherein the set of sectioning rules are ordered, and wherein the instructions that cause the one or more processors to perform the step of identifying the one or more database tables comprise instructions which, when executed by the one or more processors, cause the one or more processors to perform the steps of:

(a) setting a first rule in the set of sectioning rules as a current rule;

(b) determining whether matching criteria in the current rule matches a node'"'"'s path;

(c) if matching criteria in the current rule does not match the node'"'"'s path, then setting the current rule to a next rule in the set of sectioning rules, and repeating steps (b) and (c); and

(d) if matching criteria in the current rule matches the node'"'"'s path, then identifying the storage location for the node as the database table associated with the table identifier in the current rule.

28. The computer-readable storage medium of claim 18, wherein the received XML document is an updated version of an XML document already stored in the relational database system, and wherein the one or more sequences of instructions further comprise instructions which, when executed by the one or more processors, cause the one or more processors to perform the steps of:

receiving an update command, said command comprised of at least one path-based expression;

based on the set of sectioning rules, generating a list of database tables that correspond to the at least one path-based expression in the update command; and

executing the update command using only the database tables in the generated list of database tables.

29. The computer-readable storage medium of claim 18, wherein the instructions that cause the one or more processors to perform the step of obtaining a set of sectioning rules comprise instructions which, when executed by the one or more processors, cause the one or more processors to perform the step of receiving the set of sectioning rules from a user.

30. The computer-readable storage medium of claim 18, wherein the instructions that cause the one or more processors to perform the step of obtaining a set of sectioning rules comprise instructions which, when executed by the one or more processors, cause the one or more processors to perform the step of obtaining the set of sectioning rules from annotations in an XML schema.

31. A computer-readable storage medium storing one or more sequences of instructions for evaluating a query in a relational database system that stores XML data sectioned from XML documents in one or more section tables of a relational database according to a set of sectioning rules, wherein the one or more sequences of instructions when executed by one or more processors cause the one or more processors to perform the steps of:

receiving a query, said query comprised of at least one path expression;

generating a list of section table identifiers that identify section tables in the relational database, each said section table identifier coffesponding to at least one rule in the set of sectioning rules that matches the at least one path expression; and

evaluating the query using only section tables identified in the generated list;

wherein said set of sectioning rules are rules that were used to determine where to store said XML data sectioned from said XML documents when said XML documents were initially selectively sectioned based on said set of sectioning rules and stored in the one or more section tables of the relational database;

wherein each sectioning rule in said set of sectioning rules comprises matching criteria and a table identifier that identifies a section table in which a fragment of an XML document that matched the matching criteria was persistently stored by;

determining the section table based on the table identifier included in the sectioning rule; and

storing the fragment of the XML document in the section table.

32. The computer-readable storage medium of claim 31, wherein the at least one path expression is an XPath query.

33. The computer-readable storage medium of claim 31, wherein the instructions that cause the one or more processors to perform the step of generating a list of section table identifiers comprise instructions which, when executed by the one or more processors, cause the one or more processors to perform the steps of:

identifying at least one matching rule that includes matching criteria that matches the at least one path expression;

identifying the section table for each identified matching rule; and

generating the list comprised of identifiers for each identified section table.

34. The computer-readable storage medium of claim 33, wherein the one or more sequences of instructions further comprise instructions which, when executed by the one or more processors, cause the one or more processors to perform the step of:

initializing a finite state machine to represent path expressions in the set of sectioning rules; and

wherein the instructions that cause the one or more processors to perform the step of identifying at least one matching rule comprise instructions which, when executed by the one or more processors, cause the one or more processors to perform the step of traversing the finite state machine to identify at least one rule that includes matching criteria that matches the at least one path expression.