EFFICIENCY IN PROCESSING QUERIES DIRECTED TO STATIC DATA SETS

• US 20100191730A1
• Filed: 04/06/2010
• Published: 07/29/2010
• Est. Priority Date: 04/08/2005
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Mishra, Amulya
• Granted Patent: US 7,925,617 B2
• Time in Patent Office: Days
• US Class Current: 707/736
• CPC Class Codes: G06F 16/245 Query processing

Abstract

Data is maintained indicating which conditions match which data items (e.g., rows) of a data set (e.g., table(s) in a database). When a query is later received, the maintained data is quickly examined to determine the matching data items, thereby enhancing the throughput performance in processing queries directed to the data set.

Claims

1. A computer readable storage medium carrying one or more sequences of instructions causing a server to process queries directed to a static data set already stored in the form of a plurality of tables in a data warehouse, wherein each table contains a corresponding set of columns and a corresponding set of rows, wherein each data item is stored in one row of the table, wherein execution of said one or more sequences of instructions by one or more processors contained in said server causes said server to perform the actions of:

receiving a plurality of queries directed to said static data set stored in said data warehouse, wherein each of said plurality of queries contains a set of conditions, wherein processing of said plurality of queries requires retrieval of at least some portions of said static data set matching said set of conditions from said data warehouse;

identifying a plurality of conditions commonly occurring in said received plurality of queries, wherein each of said plurality of conditions occurs more number of times in said plurality of queries than conditions not included in said plurality of conditions;

determining which of said plurality of conditions match which of said data items in said static data set by retrieving and inspecting said static data set stored in the form of said plurality of tables in said data warehouse,

wherein a match for a condition is determined to be present when a data item retrieved from said data warehouse has a first value for the same column as the condition, and applying said comparison operation on said first value and said comparison value produces a true result;

maintaining data indicating which of said plurality of conditions match which data items in said static data set according to said determining;

receiving a query containing a first condition included in said plurality of conditions;

examining said data to determine a first set of data items contained in said static data set and matching said first condition received in said query, without having to inspect again said static data set stored in said data warehouse, wherein said examining is performed in response to receiving said query; and

generating a response to said query, said response containing said first set of data items,

wherein said identifying, said determining and said maintaining are performed before said query is received such that said response can be generated quickly after receiving said query.

2. The computer readable storage medium of claim 1, wherein said data indicates a corresponding set of data items matching each of said plurality of conditions based on a plurality of row identifiers, with each row identifier uniquely identifying a corresponding row in one of said plurality of tables and is not formed based on said plurality of data items.

3. The computer readable storage medium of claim 2, wherein said data comprises a plurality of entries, with each entry corresponding to a single data item and indicating a corresponding set of conditions matching the single data item, whereby said data indicates a corresponding subset of conditions contained in said set of conditions matching each of said plurality of data items,

wherein said examining comprises inspecting said plurality of entries for entries containing said first condition to determine said first set of data items matching said first condition.

4. The computer readable storage medium of claim 2,

wherein said data comprises a plurality of entries, with each entry corresponding to a single condition and indicating a set of rows matching the corresponding condition, whereby said data indicates which of said set of conditions match which of said plurality of data items using said row identifiers,

wherein said examining first determines a first set of row identifiers corresponding to said first set of data items matching said first condition based on identifying the entry corresponding to said first condition in said data,

said computer readable medium comprising additional instructions for retrieving only said first set of data items in all of the data items in said data set from said data warehouse, wherein each of said first set of data items is retrieved using a corresponding one of said first set of row identifiers.

5. The computer readable medium of claim 2, wherein said plurality of queries are received over a duration.

6. A method of processing queries directed to a static data set stored in the form of a plurality of tables in on a storage server, wherein each table contains a corresponding set of columns and a corresponding set of rows, wherein each data item is stored in one row of the table, said static data set containing a plurality of data items which are unlikely to change, wherein each data item is identified by a corresponding one of a plurality of identifiers, said method comprising:

receiving a plurality of queries directed to said static data set stored in said storage server, wherein each of said plurality of queries contains a set of conditions, wherein processing of said plurality of queries requires retrieval of at least some portions of said static data set matching said set of conditions from said storage server;

identifying a plurality of conditions commonly occurring in said received plurality of queries, wherein each of said plurality of conditions occurs more number of times in said plurality of queries than conditions not included in said plurality of conditions;

determining which of said plurality of conditions match which of said data items in said static data set by examining retrieving and inspecting said static data set stored in the form of said plurality of tables in said data warehouse,

wherein a match for a condition is determined to be present when a data item retrieved from said data warehouse has a first value for the same column as the condition, and applying said comparison operation on said first value and said comparison value produces a true result;

maintaining data external to said static data set, said data specifying individual identifiers associated with each of said plurality of conditions to indicate which of said plurality of conditions match which of said plurality of data items in said static data set;

receiving a query containing a first condition included in said plurality of conditions, wherein said query is received after said maintaining;

examining said data to determine a first set of individual identifiers matching said first condition received in said query, without having to inspect again said static data set stored in said data warehouse, wherein said first set of individual identifiers are contained in said plurality of identifiers;

retrieving only a first set of data items from said storage server, wherein said first set of data items are identified by said first set of individual identifiers; and

generating a response to said query, said response containing said first set of data items identified by said first set of individual identifiers.

7. The method of claim 6, wherein said data indicates a corresponding set of data items matching each of said plurality of conditions based on a plurality of row identifiers, with each row identifier uniquely identifying a corresponding row in one of said plurality of tables and is not formed based on said plurality of data items.

8. The method of claim 7, wherein said data comprises a plurality of entries, with each entry corresponding to a single data item and indicating a corresponding set of conditions matching the single data item, whereby said data indicates a corresponding subset of conditions contained in said set of conditions matching each of said plurality of data items,

wherein said examining comprises inspecting said plurality of entries for entries containing said first condition to determine said first set of data items matching said first condition.

9. The method of claim 7, wherein said data comprises a plurality of entries, with each entry corresponding to a single condition and indicating a set of rows matching the corresponding condition, whereby said data indicates which of said set of conditions match which of said plurality of data items using said row identifiers,

wherein said examining first determines a first set of row identifiers corresponding to said first set of data items matching said first condition based on identifying the entry corresponding to said first condition in said data,

wherein each of said first set of data items is retrieved using a corresponding one of said first set of row identifiers.

10. The method of claim 7, wherein said plurality of queries are received over a duration.

11. The method of claim 10, wherein said storage server comprises a data warehouse and said method is performed in a warehouse server designed to access said data warehouse.

12. A computing system comprising:

a database storage to store a data set containing a plurality of data items;

a database client to send a plurality of transaction requests to be performed on said data set;

a database server to receive each of said plurality of transaction requests and to accordingly alter said data set stored in said data storage;

a data warehouse to store said data set in the form of a static data set in a plurality of tables after said data set is determined to not require further alterations, wherein each table contains a corresponding set of columns and a corresponding set of rows, wherein each data item is stored in one row of the table;

a warehouse client to send a plurality of queries to be performed on said static data set; and

a warehouse server being operable to;

receive a subset of said plurality of queries containing a corresponding set of conditions, wherein processing of said subset of said plurality of queries requires retrieval of at least some portions of said static data set matching said set of conditions from said data warehouse;

identify a plurality of conditions commonly occurring in said received subset of said plurality of queries, wherein each of said plurality of conditions occurs more number of times in said subset of plurality of queries than conditions not included in said plurality of conditions;

determine which of said plurality of conditions match which of said plurality of data items in said static data set by examining said static data set in said data warehouse, wherein a match for a condition is determined to be present when a data item retrieved from said data warehouse has a first value for the same column as the condition, and applying said comparison operation on said first value and said comparison value produces a true result;

maintain data indicating which of said plurality of conditions match which of said plurality of data items in said static data set;

receive a query contained in said plurality of queries, wherein said query contains a first condition included in said plurality of conditions;

examine said data to determine, without having to inspect again said static data stored in said data warehouse, a first set of data items contained in said static data set and matching said first condition;

retrieve only said first set of data items in said static data set from said data warehouse; and

generate a response to said query, said response containing said first set of data items.

13. The computing system of claim 12, wherein said warehouse server is implemented external to said data warehouse as a separate unit.

14. The computing system of claim 13, wherein said data indicates a corresponding set of data items matching each of said plurality of conditions based on a plurality of row identifiers, with each row identifier uniquely identifying a corresponding row in one of said plurality of tables and is not formed based on said plurality of items.

15. The computing system of claim 14, wherein said data comprises a plurality of entries, with each entry corresponding to a single data item and indicating a corresponding set of conditions matching the single data item, whereby said data indicates a corresponding subset of conditions contained in said set of conditions matching each of said plurality of data items,

wherein to examine said data said warehouse server is operable to inspect said plurality of entries for entries containing said first condition to determine said first set of data items matching said first condition.

16. The computing system of claim 14, wherein said data comprises a plurality of entries, with each entry corresponding to a single condition and indicating a set of rows matching the corresponding condition, whereby said data indicates which of said set of conditions match which of said plurality of data items using said row identifiers,

wherein to examine said data said warehouse server is operable to first determine a first set of row identifiers corresponding to said first set of data items matching said first condition based on identifying the entry corresponding to said first condition in said data,

said warehouse server further operable to retrieve only said first set of data items in all of the data items in said data set from said data warehouse, wherein each of said first set of data items is retrieved using a corresponding one of said first set of row identifiers.

17. The computing system of claim 14, wherein said plurality of queries are received over a duration.