Mechanism for mapping XML schemas to object-relational database systems

• US 7,096,224 B2
• Filed: 09/27/2002
• Issued: 08/22/2006
• Est. Priority Date: 09/28/2001
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Krishnamurthy, Viswanathan, Sedlar, Eric, Chandrasekar, Sivasankaran, Murthy, Ravi, Krishnaprasad, Muralidhar, Agarwal, Nipun
• Primary Examiner(s): Robinson, Greta
• Assistant Examiner(s): Veillard, Jacques
• Application Number:
  US10/259,278
• Publication Number:
  US 20030140308A1
• Time in Patent Office: 1,425 Days
• Field of Search: 707 2- 6, 707/10, 707100-103 R, 707/104.1, 709202-203, 709/219, 709/246, 715513-514, 715516-517
• US Class Current: 707/763
• CPC Class Codes: G06F 16/284 Relational databases
• CPC Class Codes: G06F 16/86 Mapping to a database
• CPC Class Codes: Y10S 707/99931 Database or file accessing
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99942 Manipulating data structure, e.g. compression, compaction, compilation
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing

Abstract

A method and system are provided for allowing users to register XML schemas in a database system. The database system determines, based on a registered XML schema, how to store within the database system XML documents that conform to the XML schema. This determination involves mapping constructs defined in the XML schema to constructs supported by the database system. Such constructs may include datatypes, hierarchical relationship between elements, constraints, inheritances, etc. Once the mapping has been determined, it is stored and used by the database system to determine how to store subsequently received XML documents that conform to the registered XML schema.

Claims

1. A method for managing data in a database server, the method comprising the steps of:

determining, within the database server, an appropriate database representation for storing within said database server documents that conform to an XML schema;

generating mapping data that indicates correlations between elements of said XML schema and elements of said appropriate database representation;

wherein the step of determining an appropriate database representation includes mapping datatypes associated with elements in said XML schema to datatypes supported by said database server;

creating structures within a database based on said appropriate database representation;

storing in said structures data from XML documents that conform to said XML schema; and

wherein the step of storing in said structures data from XML documents includes the steps of;

receiving an XML document at said database server,

identifying certain data, from said XML document, that is associated with individual elements of said XML schema, and

storing the certain data that is associated with individual elements at locations within said structures based on the individual elements associated with the certain data, and the mapping data.

2. The method of claim 1 wherein:

the step of determining an appropriate database representation includes determining, based on user-specified information, that an element of said XML schema is to be mapped to a single CLOB without generating other object types within said database server for said element; and

the step of generating mapping data includes generating data that maps said element to said single CLOB.

3. The method of claim 2 further comprising the step of receiving said user-specified information in the form of user-specified annotations to said XML schema.

4. The method of claim 1 wherein:

the step of determining an appropriate database representation includes determining, based on user-specified information, that a first set of subelements of an element of said XML schema is to be mapped to a single CLOB; and

the step of generating mapping data includes generating data that maps said first set of subelements to said single CLOB, and generating data that maps a second set of subelements of said element to one or more objects other than said CLOB.

5. The method of claim 1 wherein the step of determining an appropriate database representation includes defining an SQL object type that includes attributes that correspond to elements in said XML schema.

6. The method of claim 1 wherein the step of mapping datatypes includes the steps of:

if a particular datatype associated with an element in said XML schema is associated with a first length, then mapping said particular datatype to a first database datatype; and

if said particular datatype is associated with a second length, then mapping said particular datatype to a second database datatype, wherein the first database datatype is different than said second database datatype.

7. The method of claim 1 wherein the step of determining an appropriate database representation includes mapping a particular element of said XML schema to a collection type supported by the database server if the particular element is defined to have a maximum number of occurrences greater than one.

8. The method of claim 7 wherein the collection type is an array type, wherein the cardinality of the array type is selected based on the maximum number of occurrences specified for said particular database element.

9. The method of claim 1 wherein the step of determining an appropriate database representation includes defining a constraint in said appropriate database representation based upon a constraint specified in said XML schema for an element of said XML schema.

10. The method of claim 9 wherein the step of defining a constraint includes defining a constraint from a set consisting of:

a uniqueness constraint, a referential constraint, and a not null constraint.

11. The method of claim 1 wherein:

a first datatype is associated with an element in the XML schema;

the XML schema specifies that said first datatype inherits from a second datatype; and

the step of determining an appropriate database representation includes defining within said database server a subtype of an object type, wherein said object type corresponds to said second datatype.

12. The method of claim 1 wherein the step of determining an appropriate database representation includes:

mapping a first set of elements in said XML schema to database structures that maintain each element in the first set separate from the other elements in the first set; and

mapping a second set of elements in said XML schema to a database structure in which all elements in said second set of elements are combined as a single undifferentiated database element.

13. The method of claim 12 wherein the database server determines membership of said first set and membership of said second set based on directives associated with said XML schema.

14. The method of claim 12 wherein elements in the first set of elements are selected to be in said first set based on a likelihood that said elements will be accessed more frequently than the elements selected to be in said second set of elements.

15. The method of claim 1 wherein:

the steps of determining an appropriate database representation and generating mapping data are preformed as part of an XML schema registration operation that causes modifications within said database server; and

the method further comprises the step of automatically removing all modifications caused by said XML schema registration operation in response to encountering a particular error during said XML schema registration operation.

16. The method of claim 1 wherein the step of determining an appropriate database representation includes determining how to break cycles in said XML schema.

17. The method of claim 1 wherein:

said XML schema includes a cyclic definition involving a plurality of components; and

the step of determining how to break cycles includes causing each component of the cyclic definition to hold pointers to all of its children components.

18. The method of claim 1 wherein the step of determining how to break cycles includes causing an entire cyclic definition to be mapped for storage as a single CLOB within the database server.

19. The method of claim 1 wherein the step of generating mapping data includes adding annotations to said XML schema, and storing said annotated XML schema within said database server.

20. The method of claim 1 further comprising the step of validating, within said database server, said XML schema to determine whether the XML schema conforms to an XML schema for XML schemas.

21. The method of claim 1 wherein the step of determining is performed as part of an XML schema registration operation that is initiated in response to receiving, at said database server, said XML schema.

22. The method of claim 21 wherein:

the XML schema includes user-specified annotations that indicate how the database server should map at least one element of the XML schema; and

at least a portion of the mapping data reflects said user-specified annotations.

23. The method of claim 1 wherein the step of determining is performed as part of an XML schema registration operation that is initiated in response to receiving, at said database server, an XML document that conforms to said XML schema.

24. A method for executing database commands that involve operations on extensible markup language (XML) constructs, comprising the steps of:

a database server receiving a database command that includes an XML component operation that operates on an XML construct that is based on a first set of one or more relational database constructs;

said database server determining whether to transform the XML component operation to a relational database operation that does not involve the XML component operation and that operates on a particular set of one or more relational database constructs of the first set of one or more relational database constructs; and

in response to said database server determining to transform the XML component operation to a relational database operation that does not involve the XML component operation, said database server;

rewriting the XML component operation as a particular relational database operation that does not involve the XML component operation, and

evaluating the particular relational database operation on the particular set of one or more relational database constructs.

25. The method of claim 24, wherein the first set of one or more relational database constructs are XML types based on a XML schema stored in the relational database.

26. The method of claim 24, said step of determining whether to transform the XML component operation-to a relational database operation further comprising determining whether an included XPath expression in the XML component operation is at least one of:

a simple XPath expression that steps along only XML nodes on child axes and attribute axes, wherein each XML node corresponds to an object type column or a scalar type column;

a collection traversal expression that steps along only XML nodes on child axes and attribute axes, wherein at least one XML node corresponds to a collection type column;

a wildcard axis expression that results in XML nodes that can all be coerced to a same data type; and

a descendent axis expression that results in XML nodes that can all be coerced to a same data type.

27. The method of claim 26, said step of determining whether to transform the XML component operation-to a relational database operation further comprising determining whether the included XPath expression is used by a structured query language (SQL)/XML function.

28. The method of claim 27, wherein the SQL/XML function is at least one of EXISTSNODE, EXTRACT, and EXTRACT VALUE.

29. The method of claim 27, said step of determining whether to transform the XML component operation to a relational database operation further comprising determining whether the included XPath expression is used by the SQL/XML function in an SQL query in at least one of a SELECT list, a WHERE clause predicate, a GROUP BY expression, an ORDER BY expression, a FROM clause, and a HAVING clause.

30. The method of claim 27, said step of determining whether to transform the XML component operation to a relational database operation further comprising determining whether the included XPath expression is used by the SQL/XML function in an INDEX clause of an SQL CREATE INDEX command.

31. The method of claim 26, said step of rewriting the XML component operation further comprising rewriting a simple XPath traversal as at least one of an SQL object type accessor and an SQL scalar type accessor.

32. The method of claim 24, said step of rewriting the XML operation further comprising rewriting a predicate in an included XPath expression as a predicate in an SQL WHERE clause.

33. The method of claim 24, said step of rewriting the XML component operation further comprising rewriting an EXISTSNODE function of an XPath expression in the database command as an IS NOT NULL test on an object type corresponding to a target of the XPath expression.

34. The method of claim 24, said step of rewriting the XML component operation further comprising rewriting a XPath traversal of a collection as a sub-query on a collection table corresponding to the collection.

35. The method of claim 34, said step of rewriting the XML component operation further comprising adding a predicate in the XPath traversal of the collection to a WHERE clause of the sub-query on the collection table.

36. The method of claim 24, said step of determining whether to transform the XML component operation to a relational database operation further comprising expanding the XML component operation to a tree of XPath operators that each represent one location step in an XPath expression included in the XML component operation.

37. A computer-readable storage medium carrying one or more sequences of instructions for managing data in a database server, wherein execution of the one or more sequences of instructions by one or more processors causes the one or more processors to perform the steps of:

determining, within the database server, an appropriate database representation for storing within said database server documents that conform to an XML

generating mapping data that indicates correlations between elements of said XML schema and elements of said appropriate database representation

wherein the step of determining an appropriate database representation includes mapping datatypes associated with elements in said XML schema to datatypes supported by said database server;

creating structures within a database based on said appropriate database representation;

storing in said structures data from XML documents that conform to said XML schema; and

wherein the step of storing in said structures data from XML documents includes the steps of;

receiving an XML document at said database server,

identifying certain data, from said XML document, that is associated with individual elements of said XML schema, and

storing the certain data that is associated with individual elements at locations within said structures based on the individual elements associated with the certain data, and the mapping data.

38. The computer-readable storage medium of claim 37 wherein:

the step of determining an appropriate database representation includes determining, based on user-specified information, that an element of said XML schema is to be mapped to a single CLOB without generating other object types within said database server for said element; and

the step of generating mapping data includes generating data that maps said element to said single CLOB.

39. The computer-readable storage medium of claim 38 the steps further comprising the step of receiving said user-specified information in the form of user-specified annotations to said XML schema.

40. The computer-readable storage medium of claim 37 wherein:

the step of determining an appropriate database representation includes determining, based on user-specified information, that a first set of subelements of an element of said XML schema is to be mapped to a single CLOB; and

the step of generating mapping data includes generating data that maps said first set of subelements to said single CLOB, and generating data that maps a second set of subelements of said element to one or more objects other than said CLOB.

41. The computer-readable storage medium of claim 37 wherein the step of determining an appropriate database representation includes defining an SQL object type that includes attributes that correspond to elements in said XML schema.

42. The computer-readable storage medium of claim 37 wherein the step of mapping datatypes includes:

if a particular datatype associated with an element in said XML schema is associated with a first length, then mapping said particular datatype to a first database datatype; and

if said particular datatype is associated with a second length, then mapping said particular datatype to a second database datatype, wherein the first database datatype is different than said second database datatype.

43. The computer-readable storage medium of claim 37 wherein the step of determining an appropriate database representation includes mapping a particular element of said XML schema to a collection type supported by the database server if the particular element is defined to have a maximum number of occurrences greater than one.

44. The computer-readable storage medium of claim 43 wherein the collection type is an array type, wherein the cardinality of the array type is selected based on the maximum number of occurrences specified for said particular database element.

45. The computer-readable storage medium of claim 37 wherein the step of determining an appropriate database representation includes defining a constraint in said appropriate database representation based upon a constraint specified in said XML schema for an element of said XML schema.

46. The computer-readable storage medium of claim 45 wherein the step of defining a constraint includes defining a constraint from a set consisting of:

a uniqueness constraint, a referential constraint, and a not null constraint.

47. The computer-readable storage medium of claim 37 wherein:

a first datatype is associated with an element in the XML schema;

the XML schema specifies that said first datatype inherits from a second datatype; and

the step of determining an appropriate database representation includes defining within said database server a subtype of an object type, wherein said object type corresponds to said second datatype.

48. The computer-readable storage medium of claim 37 wherein the step of determining an appropriate database representation includes:

mapping a first set of elements in said XML schema to database structures that maintain each element in the first set separate from the other elements in the first set; and

mapping a second set of elements in said XML schema to a database structure in which all elements in said second set of elements are combined as a single undifferentiated database element.

49. The computer-readable storage medium of claim 48 wherein the database server determines membership of said first set and membership of said second set based on directives associated with said XML schema.

50. The computer-readable storage medium of claim 48 wherein elements in the first set of elements are selected to be in said first set based on a likelihood that said elements will be accessed more frequently than the elements selected to be in said second set of elements.

51. The computer-readable storage medium of claim 37 wherein:

the steps of determining an appropriate database representation and generating mapping data are preformed as part of an XML schema registration operation that causes modifications within said database server; and

the steps further comprise the step of automatically removing all modifications caused by said XML schema registration operation in response to encountering a particular error during said XML schema registration operation.

52. The computer-readable storage medium of claim 37 wherein the step of determining an appropriate

database representation includes determining how to break cycles in said XML schema.

53. The computer-readable storage medium of claim 37 wherein:

said XML schema includes a cyclic definition involving a plurality of components; and

the step of determining how to break cycles includes causing each component of the cyclic definition to hold pointers to all of its children components.

54. The computer-readable storage medium of claim 37 wherein the step of determining how to break cycles includes causing an entire cyclic definition to be mapped for storage as a single CLOB within the database server.

55. The computer-readable storage medium of claim 37 wherein the step of generating mapping data includes adding annotations to said XML schema, and storing said annotated XML schema within said database server.

56. The computer-readable storage medium of claim 37 the steps further comprising the step of validating, within said database server, said XML schema to determine whether the XML schema conforms to an XML schema for XML schemas.

57. The computer-readable storage medium of claim 37 wherein the step of determining is performed as part of an XML schema registration operation that is initiated in response to receiving, at said database server, said XML schema.

58. The computer-readable storage medium of claim 57 wherein:

the XML schema includes user-specified annotations that indicate how the database server should map at least one element of the XML schema; and

at least a portion of the mapping data reflects said user-specified annotations.

59. The computer-readable storage medium of claim 37 wherein the step of determining is performed as part of an XML schema registration operation that is initiated in response to receiving, at said database server, an XML document that conforms to said XML schema.

60. A computer-readable storage medium carrying one or more sequences of instructions for executing database commands that involve operations on extensible markup language (XML) constructs, wherein execution of the one or more sequences of instructions by one or more processors causes the to perform the steps of:

database server receiving a database command that includes an XML component operation that operates on an XML construct that is based on a first set of one or more relational database constructs;

said database server determining whether to transform the XML component operation to a relational database operation that does not involve the XML component operation and that operates on a particular set of one or more relational database constructs of the first set of one or more relational database constructs; and

in response to said database server determining to transform the XML component operation to a relational database operation that does not involve the XML component operation, said database server;

rewriting the XML component operation as a particular relational database operation that does not involve the XML component operation, and

evaluating the particular relational database operation on the particular set of one or more relational database constructs.

61. The computer-readable storage medium of claim 60, wherein the first set of one or more relational database constructs are XML types based on a XML schema stored in the relational database.

62. The computer-readable storage medium of claim 60, said step of determining whether to transform the XML component operation-to a relational database operation further comprising determining whether an included XPath expression in the XML component operation is at least one of:

simple XPath expression that steps along only XML nodes on child axes and attribute axes, wherein each XML node corresponds to an object type column or a scalar type column;

a collection traversal expression that steps along only XML nodes on child axes and attribute axes, wherein at least one XML node corresponds to a collection type column;

a wildcard axis expression that results in XML nodes that can all be coerced to a same data type; and

a descendent axis expression that results in XML nodes that can all be coerced to a same data type.

63. The computer-readable storage medium of claim 62, said step of determining whether to transform the XML component operation to a relational database operation further comprising determining whether the included XPath expression is used by a structured query language (SQL)/XML function.

64. The computer-readable storage medium of claim 63, wherein the SQL/XML function is at least one of EXISTSNODE, EXTRACT, and EXTRACTVALUE.

65. The computer-readable storage medium of claim 63, said step of determining whether to transform the XML component operation to a relational database operation further comprising determining whether the included XPath expression is used by the SQL/XML function in an SQL query in at least one of a SELECT list, a WHERE clause predicate, a GROUP BY expression, an ORDER BY expression, a FROM clause, and a HAVING clause.

66. The computer-readable storage medium OF claim 63, said step of determining whether to transform the XML component operation to a relational database operation further comprising determining whether the included XPath expression is used by the SQL/XML function in an INDEX clause of an SQL CREATE INDEX command.

67. The computer-readable storage medium of claim 62, said step of rewriting the XML component operation further comprising rewriting a simple XPath traversal as at least one of an SQL object type accessor and an SQL scalar type accessor.

68. The computer-readable storage medium of claim 60, said step of rewriting the XML operation further comprising rewriting a predicate in an included XPath expression as a predicate in an SQL WHERE clause.

69. The computer-readable storage medium of claim 60, said step of rewriting XML component operation further comprising rewriting an EXISTSNODE function of an XPath expression in the database command as an IS NOT NULL test on an object type corresponding to a target of the XPath expression.

70. The computer-readable storage medium of claim 60, said step of rewriting the XML component operation further comprising rewriting a XPath traversal of a collection as a sub-query on a collection table corresponding to collection.

71. The computer-readable storage medium of claim 70, said step of rewriting the XML component operation further comprising adding a predicate in the XPath traversal of the collection to a WHERE clause of the sub-query on the collection table.

72. The computer-readable storage medium of claim 60, said step of determining whether to transform the XML component operation to a relational database operation further comprising expanding the XML component operation to a tree of XPath operators that each represent one location step in an XPath expression included in the XML component operation.