Method and mechanism for loading XML documents into memory

• US 20070150432A1
• Filed: 12/22/2005
• Published: 06/28/2007
• Est. Priority Date: 12/22/2005
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Jain, Namit, Chandrasekar, Sivasankaran, Murthy, Ravi, Agarwal, Nipun
• Granted Patent: US 7,933,928 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/80 of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML content-based retrieval of web data G06F16/95
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]

Abstract

A method and apparatus for loading an XML document into memory is provided. A client loads one or more array elements into a first partition of an array that is maintained in memory. Each array element represents an XML element of an XML document. Upon determining that an amount of data maintained in the first partition exceeds a first threshold, the client subsequently loads array elements into a new partition of the array. Upon determining that an amount of data maintained in the memory of the client exceeds a second threshold, the array elements of the least recently used partition are persistently stored in a database without persistently storing the entire XML document. When the last XML element of the XML document is loaded into a partition of the array, that partition is persistently stored in the database, thereby causing the entire XML document to be stored in the database.

Claims

1. A method comprising performing a machine-executed operation involving instructions, wherein the machine-executed operation is at least one of:

A) sending said instructions over transmission media;

B) receiving said instructions over transmission media;

C) storing said instructions onto a machine-readable storage medium; and

D) executing the instructions;

wherein said instructions are instructions which, when executed by one or more processors, cause;

at a client, storing data representing at least one XML element in a partition maintained in memory, said at least one XML element corresponding to only part of an XML document; and

upon determining that an amount of data maintained in the memory of the client exceeds a threshold, transmitting a request to a database server to store data in the partition in the database.

2. The method of claim 1, wherein the partition is a first partition, wherein the threshold is a first threshold, and wherein execution of said instructions further cause:

upon determining that an amount of data maintained in the first partition exceeds a second threshold, (a) creating a new partition of the array that is different than the first partition, and (b) subsequently loading array elements into the new partition of the array.

3. The method of claim 1, wherein execution of said instructions further cause:

determining a size of said partition based on, at least in part, (a) the available memory of the client or (b) a location within the database where the array elements of said partition are to be stored.

4. The method of claim 1, wherein execution of said instructions further cause:

determining a size of said partition based on, at least in part, a number of repeating XML elements within said XML document.

5. The method of claim 1, wherein said request specifies to store a data stream that conforms to a datablock format of a database managed by said database server.

6. The method of claim 1, wherein persistently storing the array elements, of the partition, is performed using a single batch INSERT SQL operation.

7. The method of claim 1, wherein persistently storing the array elements, of the partition further comprises:

determining that the partition is a least recently partition in a set of partitions maintained in the memory of the client.

8. The method of claim 1, wherein execution of said instructions further cause:

after persistently storing the array elements of the partition, ceasing to maintain the partition in the memory of the client.

9. A method comprising performing a machine-executed operation involving instructions, wherein the machine-executed operation is at least one of:

A) sending said instructions over transmission media;

B) receiving said instructions over transmission media;

C) storing said instructions onto a machine-readable storage medium; and

D) executing the instructions;

wherein said instructions are instructions which, when executed by one or more processors, cause;

at a client, loading one or more array elements into a partition of an array maintained in memory, wherein each array element, of the one or more array elements, represents an XML element of an XML document; and

upon determining that an amount of data maintained in the memory of the client exceeds a threshold, persistently storing the array elements, of the partition, in a database without persistently storing the entire XML document.