EXTENSIBLE INDEXING FRAMEWORK USING DATA CARTRIDGES

• US 20110161352A1
• Filed: 10/27/2010
• Published: 06/30/2011
• Est. Priority Date: 12/28/2009
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: de Castro Alves, Alexandre, Deshmukh, Unmesh, Mishra, Shailendra, Park, Hoyong, Srinivasan, Anand
• Granted Patent: US 9,305,057 B2
• Time in Patent Office: Days
• US Class Current: 707/769
• CPC Class Codes: G06F 16/24568 Data stream processing; Continuous queries
• CPC Class Codes: G06F 16/25 Integrating or interfacing systems involving database management systems

Abstract

A framework or infrastructure (extensibility framework/infrastructure) for extending the indexing capabilities of an event processing system. The capabilities of an event processing system may be extended to support indexing schemes, including related data types and operations, which are not natively supported by the event processing system. The extensibility is enabled by one or more plug-in extension components called data cartridges.

Claims

1. A system comprising:

a memory; and

a processor coupled to the memory, the processor configured to;

compile a query using information provided by a data cartridge to generate executable code, the executable code comprising an index instance generated using the information provided by the data cartridge, the index instance being generated for evaluation of a first function occurring in the query; and

execute the executable code, wherein the execution causes execution of a function provided by the data cartridge related to the index instance.

2. The system of claim 1 wherein the processor is configured to:

determine an occurrence of a link definition in the query, the link definition identifying the first function and the data cartridge;

determine a list of input arguments to the first function, wherein the list of input arguments comprises a collection;

determine whether the data cartridge provides an index for evaluation of the first function with the set of input arguments.

3. The system of claim 2 wherein the processor is configured to:

communicate, to the data cartridge, information identifying the first function;

communicate, to the data cartridge, a position of the collection in the list of input arguments;

receive metadata information from the data cartridge, the metadata information identifying an index type to be used for evaluating the first function for the collection; and

generate the index instance based upon the index type.

4. The system of claim 3 wherein:

the metadata information comprises context information, the context information comprising information identifying the function provided by the data cartridge; and

the processor is configured to communicate the information identifying the function to the data cartridge during execution of the executable code.

5. The system of claim 1 wherein the processor is configured to:

categorize the first function into one of a first category, a second category, or a third category, wherein categorization of the first function into the first category indicates that the system provides an index for evaluation of the first function, wherein categorization of the first function into the second category indicates that the data cartridge provides an index for evaluation of the first function, and wherein categorization of the first function into the third category indicates that no index is provided for evaluation of the first function.

6. The system of claim 1 wherein the processor is configured to:

use the index instance to evaluate a second function, wherein a collection is provided as an input argument for both the first function and the second function and the index instance is generated for the collection.

7. The system of claim 1 wherein:

a collection comprising a plurality of elements is provided as an input argument to the first function;

the function provided by the data cartridge is an index scan function using the index instance; and

the processor is configured to receive a result set from execution of the function provided by the data cartridge, the result set resulting from evaluation of the first function and comprising a set of items from the collection.

8. The system of claim 1 wherein:

a collection comprising a plurality of elements is provided as an input argument to the first function;

the function provided by the data cartridge is an index scan function using the index instance;

the processor is configured to;

receive a result set from execution of the function provided by the data cartridge, the result set comprising a set of items from the collection resulting from evaluation of the first function and also additional one or more items from the collection; and

determine the set of items resulting from evaluation of the first function from the result set.

9. The system of claim 1 wherein the processor is configured to:

execute the executable code upon receiving an event via an event stream, the event comprising data and a time stamp.

10. A computer-readable storage medium storing a plurality of instructions for controlling a computer system, the plurality of instructions comprising:

instructions that cause the computer system to compile a query using information provided by a data cartridge to generate executable code, the executable code comprising an index instance generated using the information provided by the data cartridge, the index instance being generated for evaluation of a first function occurring in the query; and

instructions that cause the computer system to execute the executable code, wherein the execution causes execution of a function provided by the data cartridge related to the index instance.

11. The computer-readable storage medium of claim 10 wherein the instructions that cause the computer system to compile the query comprise:

instructions that cause the computer system to determine an occurrence of a link definition in the query, the link definition identifying the first function and the data cartridge;

instructions that cause the computer system to determine a list of input arguments to the first function, wherein the list of input arguments comprises a collection;

instructions that cause the computer system to determine whether the data cartridge provides an index for evaluation of the first function with the set of input arguments.

12. The computer-readable storage medium of claim 11 wherein the instructions that cause the computer system to compile the query comprise:

instructions that cause the computer system to communicate information to the data cartridge identifying the first function;

instructions that cause the computer system to communicate to the data cartridge a position of the collection in the list of input arguments;

instructions that cause the computer system to receive metadata information from the data cartridge, the metadata information identifying an index type to be used for evaluating the first function for the collection; and

instructions that cause the computer system to generate the index instance based upon the index type.

13. The computer-readable storage medium of claim 12 wherein:

the metadata information comprises context information, the context information comprising information identifying the function provided by the data cartridge; and

instructions that cause the computer system to execute the execute code comprise instructions that cause the computer system to communicate the information identifying the function provided by the data cartridge to the data cartridge during execution of the executable code.

14. The computer-readable storage medium of claim 10 wherein the instructions that cause the computer system to compile the query comprise:

instructions that cause the computer system to categorize the first function into one of a first category, a second category, or a third category, wherein categorization of the first function into the first category indicates that the system provides an index for evaluation of the first function, wherein categorization of the first function into the second category indicates that the data cartridge provides an index for evaluation of the first function, and wherein categorization of the first function into the third category indicates that no index is provided for evaluation of the first function.

15. The computer-readable storage medium of claim 10 wherein the instructions that cause the computer system to execute the executable code comprise:

instructions that cause the computer system to use the index instance to evaluate a second function, wherein a collection is provided as an input argument for both the first function and the second function and the index instance is generated for the collection.

16. The computer-readable storage medium of claim 10 wherein:

a collection comprising a plurality of elements is provided as an input argument to the first function;

the function provided by the data cartridge is an index scan function using the index instance; and

the instructions that cause the computer system to execute the executable code comprise instructions that cause the computer system to receive a result set from execution of the function provided by the data cartridge, the result set resulting from evaluation of the first function and comprising a set of items from the collection.

17. The computer-readable storage medium of claim 10 wherein:

a collection comprising a plurality of elements is provided as an input argument to the first function;

the function provided by the data cartridge is an index scan function using the index instance;

the instructions that cause the computer system to execute the executable code comprise instructions that cause the computer system to;

receive a result set from execution of the function provided by the data cartridge, the result set comprising a set of items from the collection resulting from evaluation of the first function and also additional one or more items from the collection; and

determine the set of items resulting from evaluation of the first function from the result set.

18. The computer-readable storage medium of claim 10 wherein the instructions that cause the computer system to execute the executable code comprise:

instructions that cause the computer system to execute the executable code upon receiving an event via an event stream, the event comprising data and a time stamp.

19. A method comprising:

compiling, by a computer system, a query using information provided by a data cartridge to generate executable code, the executable code comprising an index instance generated using the information provided by the data cartridge, the index instance being generated for evaluation of a first function occurring in the query; and

executing, by the computer system, the executable code, wherein the execution causes execution of a function provided by the data cartridge related to the index instance.

20. The method of claim 19 wherein:

compiling the query comprises;

communicating information to the data cartridge identifying the first function and a position of a collection in a list of input arguments for the first function;

receiving metadata information from the data cartridge, the metadata information identifying an index type to be used for evaluating the first function for the collection and identifying the function provided by the data cartridge;

generating the index instance based upon the index type; and

executing the executable code comprises;

communicating the information identifying the function provided by the data cartridge to the data cartridge during execution of the executable code; and

executing the executable code upon receiving an event via an event stream, the event comprising data and a time stamp.