QUERY PROCESSING PIPELINES WITH SINGLE-ITEM AND MULTIPLE-ITEM QUERY OPERATORS

• US 20090319498A1
• Filed: 06/24/2008
• Published: 12/24/2009
• Est. Priority Date: 06/24/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Hejlsberg, Anders, Warren, Matthew J., Kulkarni, Dinesh Chandrakant, Bolognese, Luca, Zabokritski, Evgueni, Meijer, Erik
• Granted Patent: US 8,375,044 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/2452 Query translation

Abstract

Queries against data sources (such as language-integrated queries to be applied against relational databases) may be prepared for processing by a query processing pipeline. This pipeline performs services including transforming the query into a form more easily applied by the data source, e.g., into SQL, by matching query terms with query operators configured to handle various query operations. Many query processing pipelines include single-item query operators that perform individual operations (e.g., an updating query operator that specifies an updating of individual records of a table.) An integrated query pipeline may be devised that includes both single-item query operators and multiple-item query operators that specify operations on sets of data items. An integrated query processing pipeline may analyze the query to determine whether a single-item or multiple-item operation is specified in order to select an appropriate query operator, which may improve the efficiency and performance of the data source querying.

Claims

1. A method of issuing a query comprising at least one data source reference to a data source using a set of data source mappings and a set of query operators comprising at least one single-item query operator and at least one multiple-item query operator, the method comprising:

transforming the query into an expression tree;

identifying the query as one of a single-item query and a multiple-item query;

upon identifying a single-item query, selecting at least one single-item query operator invoked by the query;

upon identifying a multiple-item query, selecting at least one multiple-item query operator invoked by the query;

invoking selected query operators to;

map the data source references of the expression tree to respective aspects of the data source using the data source mappings, and

translate the expression tree into a translated query in a query language; and

sending the translated query to the data source.

2. The method of claim 1, the query comprising a language-integrated query.

3. The method of claim 1, the query comprising a data source altering query.

4. The method of claim 1, the set of data source mappings comprising at least one of:

a schema definition, and

a set of metadata associated with respective aspects of the data source.

5. The method of claim 1:

the query referencing at least one local object, and

the sending comprising;

serializing the at least one local object, and

sending a serialized representation of the at least one local object to the data source.

6. The method of claim 1, comprising:

receiving a query result from the data source in response to the query.

7. The method of claim 6, comprising:

deserializing at least one local object from at least one aspect of the query result.

8. The method of claim 6, comprising:

storing at least one aspect of the query result in at least one of;

at least one primitive variable, and

at least one field of at least one local object.

9. The method of claim 6, the receiving comprising:

caching at least one data source aspect of the query result in a data source cache.

10. The method of claim 9, the sending comprising:

identifying the query as one of an altering query and a non-altering query; and

upon identifying an altering query, caching at least one data source aspect set by the altering query in the data source cache.

11. The method of claim 10, the sending comprising:

identifying the query as one of a selecting query and a non-selecting query;

upon identifying a selecting query, querying the data source cache to identify at least one cached data source aspect referenced by the selecting query; and

upon identifying at least one cached data source aspect referenced by the selecting query, returning the cached data source aspect in response to the query; and

upon failing to identify at least one cached data source aspect referenced by the selecting query, sending the translated query to the data source.

12. A system for issuing a query comprising at least one data source reference to a data source, the system comprising:

a set of data source mappings;

a set of query operators comprising at least one single-item query operator and at least one multiple-item query operator;

a query transforming component configured to transform the query into an expression tree;

a query identifying component configured to identify the query as one of a single-item query and a multiple-item query;

a query operator selecting component configured to select at least one of;

at least one single-item query operator invoked by a single-item query, and

at least one multiple-item query operator invoked by a multiple-item query;

a query translating component configured to invoke the selected query operators to;

map the data source references of the expression tree to respective aspects of the data source using the data source mappings, and

translate the expression tree into a translated query in a query language; and

a query sending component configured to send the translated query to the data source.

13. The system of claim 12, the set of data source mappings comprising at least one of:

a schema definition, and

a set of metadata associated respective aspects of the data source.

14. The system of claim 12:

the query referencing at least one local object, and

the query sending component configured to;

serialize the at least one local object, and

send a serialized representation of the at least one local object to the data source.

15. The system of claim 12, comprising:

a query result receiving component configured to receive a query result from the data source in response to the query.

16. The system of claim 15, the query result receiving component configured to deserialize at least one local object from at least one aspect of the query result.

17. The system of claim 15, comprising:

at least one data source cache configured to cache at least one aspect of the data source upon sending a query and upon receiving a query result.

18. The system of claim 17, the query sending component configured to:

identify the query as one of an altering query and a non-altering query; and

upon identifying an altering query, cache at least one data source aspect set by the altering query in the data source cache.

19. The system of claim 18, the query sending component configured to:

identify the query as one of a selecting query and a non-selecting query;

upon identifying a selecting query, query the data source cache to identify at least one cached data source aspect referenced by the selecting query;

upon identifying at least one cached data source aspect referenced by the selecting query, return the cached data source aspect in response to the query; and

upon failing to identify at least one cached data source aspect referenced by the selecting query, send the translated query to the data source.

20. A system for issuing a data source altering query comprising at least one data source reference to a data source and referencing at least one local object, the system comprising:

a set of data source mappings comprising at least one of;

a schema definition, and

a set of metadata associated respective aspects of the data source;

a set of query operators comprising at least one single-item query operator and at least one multiple-item query operator;

a query transforming component configured to transform the query into an expression tree;

a query identifying component configured to identify the query as one of a single-item query and a multiple-item query;

a query operator selecting component configured to select at least one of;

at least one single-item query operator invoked by a single-item query, and

at least one multiple-item query operator invoked by a multiple-item query;

a query translating component configured to invoke the selected query operators to;

map the data source references of the expression tree to respective aspects of the data source using the data source mappings, and

translate the expression tree into a translated query in a query language;

at least one data source cache configured to cache at least one aspect of the data source upon sending a query and upon receiving a query result;

a query sending component configured to;

serialize the at least one local object,

identify the query as one of an altering query and a non-altering query;

upon identifying an altering query, cache at least one data source aspect set by the altering query in the data source cache;

upon identifying a non-altering query;

query the data source cache to identify at least one cached data source aspect referenced by the non-altering query;

upon identifying at least one cached data source aspect referenced by the non-altering query, return the cached data source aspect in response to the query; and

upon failing to identify at least one cached data source aspect referenced by the non-altering query;

send the translated query to the data source, and

send a serialized representation of the at least one local object to the data source; and

a query result receiving component configured to;

receive a query result from the data source in response to the query, and

deserialize at least one local object from at least one aspect of the query result.