Efficient replication of XML data in a relational database management system

• US 7,853,573 B2
• Filed: 05/03/2006
• Issued: 12/14/2010
• Est. Priority Date: 05/03/2006
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Arora, Nimar S., Wong, Lik, Warner, James W., Chandrasekar, Sivasankaran, Murthy, Ravi, Krishnaprasad, Muralidhar, Liu, Zhen Hua, Arora, Geeta, Abraham, Sundeep
• Primary Examiner(s): Le; Uyen T.
• Application Number:
  US11/416,835
• Publication Number:
  US 20070260650A1
• Time in Patent Office: 1,686 Days
• Field of Search: None
• US Class Current: 707/693
• CPC Class Codes: G06F 16/80 of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML content-based retrieval of web data G06F16/95

Abstract

Efficiently replicating XML data among databases includes techniques for (a) replicating XML data involved with an insert operation; (b) replicating XML data involved with an update operation; (c) leveraging existing relational replication techniques for XML data stored in shredded form using object-relational constructs; and (d) replicating XQuery Data Model sequences. Each technique reduces the amount of information that would otherwise need to be transmitted over a network for XML data replication purposes.

Claims

1. A method comprising:

for XML data that is subject to an update operation in a source database, one or more computing devices automatically generating, from one or more DML (data manipulation language) commands involved with said update operation, XML difference operations to be applied to XML data in a destination database, wherein XML data in said destination database has elements in a different order than in said source database; and

transmitting said XML difference operations for reception by said destination database for updating said XML data at said destination database.

2. The method of claim 1, further comprising:

determining whether to generate said XML difference operations based on a cost of generating said XML difference operations.

3. The method of claim 1, further comprising:

including in said XML difference operations a column identifier that identifies a column in which said XML data is stored at said destination database; and

wherein transmitting said XML difference operations for reception by said destination database includes transmitting said XML difference operations with said column identifier to said destination database.

4. A method comprising the steps of:

if first XML data is inserted into a source database, then one or more computing devices determining whether to encode said first XML data into a compressed format prior to transmitting said XML data for reception by said destination database;

wherein said determining is based on an analysis that is based on the size of said first XML data and the form in which said first XML data is stored in said source database; and

if determined to encode said first XML data into a compressed format, then encoding said first XML data into said compressed format and transmitting said encoded first XML data for reception by said destination database;

if said first XML data is subject to an update operation in said source database, then generating XML difference operations to be applied to XML data in a destination database, wherein XML data in said destination database has elements in a different order than in said source database;

transmitting said XML difference operations for reception by said destination database for updating said first XML data at said destination database;

if part of said first XML data is replicated from said source database to said

destination database using relational data replication, and wherein said part of said first XML data is stored as a large object (LOB) in a column of a relational table in said source and destination databases, then transmitting from said source database for reception by said destination database a pointer to said relationally replicated large object (LOB) in said destination database, for inclusion, at said destination database, of said relationally replicated large object (LOB) into a first XML document of which said first XML data is part;

if an XQuery Data Model sequence is subject to replication from said source database to said destination database, then generating a second XML document that represents said sequence, wherein said second XML document identifies boundaries between items in said sequence and identifies data types for corresponding items in said sequence.

5. The method of claim 4, wherein if part of said first XML data is

replicated from said source database to said destination database using relational data replication, and wherein said part of said first XML data is stored as a large object (LOB) in a column of a relational table in said source and destination databases, then transmitting said relationally replicated large object (LOB) from said source database for reception by said destination database for inclusion, at said destination database, of said relationally replicated large object (LOB) into said first XML document;

wherein said relationally replicated large object (LOB) is transmitted from said source database separately from said pointer.

6. The method of claim 4, wherein generating said XML difference operations includes automatically generating said XML difference operations based on one or more DML (data manipulation language) commands involved with said update operation.

7. The method of claim 4, further comprising:

including in said XML difference operations a column identifier that identifies a column in which said first XML data is stored at said destination database; and

wherein transmitting said XML difference operations for reception by said destination database includes transmitting said XML difference operations with said column identifier for reception by said destination database.

8. The method of claim 4, wherein

if determined not to encode said first XML data into said compressed format based at least in part on a need for said first XML data to be constructed using one or more construction functions, then transmitting said one or more construction functions for reception by said destination database for construction of said first XML data at said destination database.

9. A method comprising the steps of:

one or more computing devices determining whether to encode XML data inserted into a source database into a compressed format prior to transmitting said XML data for reception by said destination database over a network;

wherein said determining is based on an analysis that is based on;

a) the size of said XML data being inserted; and

b) whether the XML data needs to be constructed from underlying base data constructs in said source database;

if determined to encode said XML data into a compressed format, then encoding said XML data into said compressed format and transmitting said encoded XML data for reception by said destination database.

10. The method of claim 9, wherein said determining whether to encode said XML data comprises determining a degree of compression that would result from encoding said XML data into said compressed format, and wherein determining said degree of compression is based on a schema to which said XML data conforms.

11. The method of claim 9, further comprising

if determined not to encode said XML data into said compressed format based at least in part on a need for said XML data to be constructed from underlying base data constructs in said source database, determining not to construct said XML data from said source database and not to transmit said XML data;

and

transmitting said one or more construction functions for reception by said destination database for construction of said XML data at said destination database.

12. A method for replicating XML data from a source database to a destination database comprising:

one or more computing devices replicating from said source database to said destination database, using relational data replication, first XML data from an XML document, wherein said first XML data is stored as a large object (LOB) in a column of a relational table in said source and destination databases; and

transmitting from said source database for reception by said destination database a pointer to said relationally replicated large object (LOB);

wherein said relationally replicated large object (LOB) is stored in said destination database, and included into said XML document at said destination database.

13. The method of claim 12, further comprising:

transmitting said relationally replicated large object (LOB) from said source database for reception by said destination database, for inclusion of said relationally replicated large object (LOB) into said XML document at said destination database;

wherein said relationally replicated large object (LOB) is transmitted from said source database separately from said pointer.

14. The method of claim 12, further comprising:

transmitting from said source database for reception by said destination database second XML data from said XML document, wherein said second XML data comprises XML data, from said XML document, other than said first XML data; and

wherein said second XML data includes said pointer to said relationally replicated large object (LOB) at a location within said second data that indicates where within said XML document said first XML data is to be included.

15. A computer-readable volatile or non-volatile medium storing one or more sequences of instructions which, when executed by one or more processors, causes the one or more processors to perform:

for XML data that is subject to an update operation in a source database, one or more computing devices automatically generating, from one or more DML (data manipulation language) commands involved with said update operation, XML difference operations to be applied to XML data in a destination database, wherein XML data in said destination database has elements in a different order than in said source database; and

transmitting said XML difference operations for reception by said destination database for updating said XML data at said destination database.

16. The computer-readable volatile or non-volatile medium of claim 15, further comprising instructions for:

determining whether to generate said XML difference operations based on a cost of generating said XML difference operations.

17. The computer-readable volatile or non-volatile medium of claim 15, further comprising instructions for:

including in said XML difference operations a column identifier that identifies a column in which said XML data is stored at said destination database; and

wherein transmitting said XML difference operations for reception by said destination database includes transmitting said XML difference operations with said column identifier to said destination database.

18. A computer-readable volatile or non-volatile medium storing one or more sequences of instructions which, when executed by one or more processors, causes the one or more processors to perform:

if first XML data is inserted into a source database, then one or more computing devices determining whether to encode said first XML data into a compressed format prior to transmitting said XML data for reception by said destination database;

wherein said determining is based on an analysis that is based on the size of said first XML data and the form in which said first XML data is stored in said source database; and

if determined to encode said first XML data into a compressed format, then encoding said first XML data into said compressed format and transmitting said encoded first XML data for reception by said destination database;

if said first XML data is subject to an update operation in said source database, then generating XML difference operations to be applied to XML data in a destination database, wherein XML data in said destination database has elements in a different order than in said source database;

transmitting said XML difference operations for reception by said destination database for updating said first XML data at said destination database;

if part of said first XML data is replicated from said source database to said

destination database using relational data replication, and wherein said part of said first XML data is stored as a large object (LOB) in a column of a relational table in said source and destination databases, then transmitting from said source database for reception by said destination database a pointer to said relationally replicated large object (LOB) in said destination database, for inclusion, at said destination database, of said relationally replicated large object (LOB) into a first XML document of which said first XML data is part;

if an XQuery Data Model sequence is subject to replication from said source database to said destination database, then generating a second XML document that represents said sequence, wherein said second XML document identifies boundaries between items in said sequence and identifies data types for corresponding items in said sequence.

19. The computer-readable volatile or non-volatile medium of claim 18,

wherein if part of said first XML data is replicated from said source database to said destination database using relational data replication, and wherein said part of said first XML data is stored as a large object (LOB) in a column of a relational table in said source and destination databases, then transmitting said relationally replicated large object (LOB) from said source database for reception by said destination database for inclusion, at said destination database, of said relationally replicated large object (LOB) into said first XML document;

wherein said relationally replicated large object (LOB) is transmitted from said source database separately from said pointer.

20. The computer-readable volatile or non-volatile medium of claim 18,

wherein generating said XML difference operations includes automatically generating said XML difference operations based on one or more DML (data manipulation language) commands involved with said update operation.

21. The computer-readable volatile or non-volatile medium of claim 18, further comprising instructions for:

including in said XML difference operations a column identifier that identifies a column in which said first XML data is stored at said destination database; and

wherein transmitting said XML difference operations for reception by said destination database includes transmitting said XML difference operations with said column identifier for reception by said destination database.

22. The computer-readable volatile or non-volatile medium of claim 18,

wherein if determined not to encode said first XML data into said compressed format based at least in part on a need for said first XML data to be constructed using one or more construction functions, then transmitting said one or more construction functions for reception by said destination database for construction of said first XML data at said destination database.

23. A computer-readable volatile or non-volatile medium storing one or more sequences of instructions which, when executed by one or more processors, causes the one or more processors to perform:

one or more computing devices determining whether to encode XML data inserted into a source database into a compressed format prior to transmitting said XML data for reception by said destination database over a network;

wherein said determining is based on an analysis that is based on;

a) the size of said XML data being inserted; and

b) whether the XML data needs to be constructed from underlying base data constructs in said source database;

if determined to encode said XML data into a compressed format, then encoding said XML data into said compressed format and transmitting said encoded XML data for reception by said destination database.

24. The computer-readable volatile or non-volatile medium of claim 23,

wherein said determining whether to encode said XML data comprises determining a degree of compression that would result from encoding said XML data into said compressed format, and wherein determining said degree of compression is based on a schema to which said XML data conforms.

25. The computer-readable volatile or non-volatile medium of claim 23, further comprising instructions for:

if determined not to encode said XML data into said compressed format based at least in part on a need for said XML data to be constructed from underlying base data constructs in said source database, determining not to construct said XML data from said source database and not to transmit said XML data; and

transmitting said one or more construction functions for reception by said destination database for construction of said XML data at said destination database.

26. A computer-readable volatile or non-volatile medium storing one or more sequences of instructions which, when executed by one or more processors, causes the one or more processors to perform:

one or more computing devices replicating from said source database to said destination database, using relational data replication, first XML data from an XML document, wherein said first XML data is stored as a large object (LOB) in a column of a relational table in said source and destination databases; and

transmitting from said source database for reception by said destination database a pointer to said relationally replicated large object (LOB);

wherein said relationally replicated large object (LOB) is stored in said destination database, and included into said XML document at said destination database.

27. The computer-readable volatile or non-volatile medium of claim 26, further comprising instructions for:

transmitting said relationally replicated large object (LOB) from said source database for reception by said destination database, for inclusion of said relationally replicated large object (LOB) into said XML document at said destination database;

wherein said relationally replicated large object (LOB) is transmitted from said source database separately from said pointer.

28. The computer-readable volatile or non-volatile medium of claim 26, further comprising instructions for:

transmitting from said source database for reception by said destination database second XML data from said XML document, wherein said second XML data comprises XML data, from said XML document, other than said first XML data; and

wherein said second XML data includes said pointer to said relationally replicated large object (LOB) at a location within said second data that indicates where within said XML document said first XML data is to be included.