System and method for adaptive query identification and acceleration

• US 7,596,560 B2
• Filed: 12/23/2004
• Issued: 09/29/2009
• Est. Priority Date: 12/23/2004
• Status: Expired due to Fees

• Current Assignee: Raytheon Company (Rtx Corporation)
• Original Assignee: Raytheon Company (Rtx Corporation)
• Inventors: Rosengard, Phillip I.
• Primary Examiner(s): Fleurantin; Jean B.
• Application Number:
  US11/021,687
• Publication Number:
  US 20060155697A1
• Time in Patent Office: 1,741 Days
• Field of Search: 707 1- 10, 707100-1041, 707200-206
• US Class Current: 1/1
• CPC Class Codes: G06F 16/2255 Hash tables
• CPC Class Codes: G06F 16/24539 using cached or materialised query results
• CPC Class Codes: G06F 16/2454 Optimisation of common expressions
• CPC Class Codes: G06F 16/285 Clustering or classification
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99936 Pattern matching access
• CPC Class Codes: Y10S 707/99937 Sorting

Abstract

A data management system and method. The system is adapted to analyze a plurality of data queries and provide a metric with respect thereto. The system then orders the queries based on the metric to improve a performance parameter of the system or estimate an execution time with respect to the query. In a more specific implementation, the system includes code for analyzing a signature of each of the queries, comparing the signature to a calibrated signature and providing a signature score in response thereto. The system further includes code for estimating an execution time of at least one of the queries. The signature may be a cluster of statements in an appropriate language such as SQL (standard query language). As an alternative, the signature may be a set of features extracted from a plurality of statements.

Claims

1. A computer-implemented data management system, comprising:

an application server, including computer readable storage media comprising;

software, when executed by a computer performs an operation of;

collecting a plurality of realtime queries requiring execution;

software, when executed by a computer performs an operation of;

providing an ordered vector space of data attributes;

providing, from available data, a query data attribute extent vector space;

executing a plurality of predefined queries and providing a query signature for each query, each query signature including a data attribute component;

executing each query of the plurality of predefined queries without using cache and recording an uncached execution time;

executing each query of the plurality of predefined queries using cache and recording a cached execution time;

creating, for each query, a time estimate coefficient and estimated time for query coefficient;

calculating, for each query, a similarity score with respect to each other query; and

providing metrics including the similarity score for each one of the plurality of predefined queries; and

software, when executed by a computer performs an operation of;

ordering realtime queries based on said metrics of corresponding similar predefined queries to improve performance of said system.

2. The system of claim 1 wherein said signature is a cluster of statements.

3. The system of claim 2 wherein said statements are standard query language (SQL) statements.

4. The system of claim 1 wherein said signature is a set of features extracted from said data attribute component.

5. A computer readable storage media comprising:

software, when executed by a computer performs an operation of;

providing an ordered vector space of data attributes;

providing, from available data, a query data attribute extent vector space;

executing a plurality of predefined queries and providing a query signature for each query, each query signature including a data attribute component;

executing each query of the plurality of predefined queries without using cache and recording an uncached execution time;

executing each query of the plurality of predefined queries using cache and recording a cached execution time;

creating, for each query, a time estimate coefficient and estimated time for query coefficient; and

calculating, for each query, a similarity score with respect to each other query.

6. The storage media of claim 5 wherein said query signature is a cluster of statements.

7. The storage media of claim 6 wherein said statements are standard query language (SQL) statements.

8. The storage media of claim 5 wherein said signature is a set of features extracted from said data attribute component.

9. A computer-implemented data management system, comprising:

computer-readable storage media comprising a database;

a processor coupled to said database;

a communications interface for supplying a plurality of queries to said database via said processor; and

computer readable storage media including computer-readable instructions for execution by said processor for analyzing a plurality of said queries and organizing said queries to optimize a performance parameter with respect to a retrieval thereof and output results for the queries to a user;

said computer-readable instructions when executed by a computer performs an operation of;

providing an ordered vector space of data attributes;

providing, from available data, a query data attribute extent vector space;

executing a plurality of predefined queries and providing a query signature for each query, each query signature including a data attribute component;

executing each query of the plurality of predefined queries without using cache and recording an uncached execution time;

executing each query of the plurality of predefined queries using cache and recording a cached execution time;

creating, for each query, a time estimate coefficient and estimated time for query coefficient;

calculating, for each query, a similarity score with respect to each other query; and

providing metrics including the similarity score for each one of the plurality of predefined queries.

10. The system of claim 9 wherein said signature is a cluster of statements.

11. The system of claim 10 wherein said statements are standard query language (SQL) statements.

12. The system of claim 9 wherein said signature is a set of features extracted from said data attribute component.

13. The system of claim 9 further including software, when executed by a computer performs an operation of:

organizing said plurality of queries based on said metrics of similar corresponding predefined queries to improve performance of said system.

14. A data management method for implementing by a computer including computer-implemented steps of:

collecting a plurality of realtime queries requiring execution;

providing an ordered vector space of data attributes;

providing, from available data, a query data attribute extent vector space;

executing a plurality of predefined queries and providing a query signature for each query, each query signature including a data attribute component;

executing each query of the plurality of predefined queries without using cache and recording an uncached execution time;

executing each query of the plurality of predefined queries using cache and recording a cached execution time;

creating, for each query, a time estimate coefficient and estimated time for query coefficient; and

calculating, for each query, a similarity score with respect to each other query;

providing metrics including the similarity score for each one of the plurality of predefined queries; and

ordering the realtime queries based on said metrics associated with similar corresponding predefined queries; and

outputting results of the realtime queries.