AUTOMATED CLIENT/SERVER OPERATION PARTITIONING

• US 20090327220A1
• Filed: 06/25/2008
• Published: 12/31/2009
• Est. Priority Date: 06/25/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Hejlsberg, Anders, Warren, Matthew J., Kulkarni, Dinesh Chandrakant, Meijer, Erik
• Granted Patent: US 8,364,751 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/2455 Query execution
• CPC Class Codes: G06F 16/252 between a Database Management System and a front-end application
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]

Abstract

An operation (such as a relational query) may be processed on a processing engine (such as a relational database server) on behalf of a client. A conventional processing involves the delivery of the operation to the processing engine, which executes the entire operation to completion and returns a result data set. It may be more efficient to allocate part of the operation to be performed on the client, but a developer may be unable or unavailable to rewrite the operation in a distributed manner. Instead, the operation may be automatically partitioned into a pre-engine client portion, a processing engine portion, and a client portion, and the instructions of each portion may be automatically allocated respectively to the client, the server, and the client. The partitioning may be adjusted to conserve computing resources, such as bandwidth and storage, and the instructions may be reordered to improve the processing of the operation.

Claims

1. A computer-implemented method of evaluating an operation comprising instructions to be processed by a processing engine for a client, the method comprising:

partitioning the operation into a partitioned operation having a pre-engine portion executed by the client, a processing engine portion executed by the processing engine, and a post-engine portion executed by the client;

executing the pre-engine portion at the client to produce a pre-engine partially executed operation;

sending the pre-engine partially executed operation to the processing engine;

receiving a processing engine partially executed operation from the processing engine after sending the pre-engine partially executed operation; and

executing the post-engine portion of the computing engine partially executed operation at the client to complete the operation execution.

2. The method of claim 1:

the processing engine comprising a relational data query processor, and

the operation comprising a relational query targeting data accessible to the relational data query processor.

3. The method of claim 1, the operation comprising a language integrated query specified in a programming language.

4. The method of claim 1, comprising:

before the partitioning, transforming the operation into an expression tree.

5. The method of claim 1, the partitioning configured to expand portions of the partitioned query executed by one of the client and the processing engine, and to equivalently compact portions of the partitioned query executed by the other of the client and the processing engine.

6. The method of claim 5, the partitioning between the client and the processing engine related to at least one of:

processing capacity of the processing engine;

processing capacity of the client;

computational load of the processing engine;

computational load of the client;

storage capacity of the processing engine;

storage capacity of the client; and

communications capacity between the processing engine and the client.

7. The method of claim 1, the partitioning configured to reduce the size of at least one of the pre-engine partially executed operation and the processing engine partially executed operation.

8. The method of claim 1, comprising:

after the partitioning and before executing the pre-engine portion, adjusting the partitioned operation according to at least one instruction adjusting rule.

9. The method of claim 8, an instruction adjusting rule comprising:

identifying a compacting instruction in the post-engine portion that compacts the post-engine portion and can be equivalently executed in the processing engine portion, and

upon identifying the compacting instruction, moving the compacting instruction to the processing engine portion.

10. The method of claim 8, an instruction adjusting rule comprising:

identifying a compacting instruction in the processing engine portion that compacts the processing engine portion and can be equivalently executed in the pre-engine portion, and

upon identifying the compacting instruction, moving the compacting instruction to the pre-engine portion.

11. The method of claim 8, an instruction adjusting rule comprising:

identifying a compacting instruction that;

compacts the operation,

follows a computationally intensive instruction, and

can be equivalently executed before the computationally intensive instruction; and

upon identifying the compacting instruction, moving the compacting instruction before the computationally intensive instruction.

12. The method of claim 8, an instruction adjusting rule comprising:

identifying a relocatable instruction in the processing engine component that;

is preferably executed by the client,

follows an unrelocatable instruction that is preferably executed by the processing engine, and

can be equivalently executed in the pre-engine portion; and

upon identifying the relocatable instruction, moving the relocatable instruction into the pre-engine portion.

13. The method of claim 8, an instruction adjusting rule comprising:

identifying a relocatable instruction in the processing engine component that;

is preferably executed by the client,

is preceded by an unrelocatable instruction that is preferably executed by the processing engine, and

can be equivalently executed in the post-engine portion; and

upon identifying the relocatable instruction, moving the relocatable instruction into the post-engine portion.

14. The method of claim 8, an instruction adjusting rule comprising:

identifying a relocatable instruction in the pre-engine component that;

is preferably executed by the processing engine,

precedes an unrelocatable instruction that is preferably executed by the client, and

can be equivalently executed in the processing engine portion; and

upon identifying the relocatable instruction, moving the relocatable instruction into the processing engine portion.

15. The method of claim 8, an instruction adjusting rule comprising:

identifying a relocatable instruction in the post-engine component that;

is preferably executed by the processing engine,

follows an unrelocatable instruction that is preferably executed by the client, and

can be equivalently executed in the processing engine portion; and

upon identifying the relocatable instruction, moving the relocatable instruction into the processing engine portion.

16. A system for evaluating an operation comprising instructions to be processed by a processing engine for a client, the system comprising:

an operation partitioning component configured to partition the operation into a partitioned operation having a pre-engine portion executed by the client, a processing engine portion executed by the processing engine, and a post-engine portion executed by the client;

a client portion execution component configured to;

execute the pre-engine portion at the client to produce a pre-engine partially executed operation, and

execute the post-engine portion of a processing engine partially executed operation at the client to complete the operation execution; and

a processing engine communications component configured to;

send the pre-engine partially executed operation produced by the client portion execution component to the processing engine, and

receive the processing engine partially executed operation from the processing engine after sending the pre-engine partially executed operation.

17. The system of claim 16, the operation comprising a language integrated query specified in a programming language.

18. The system of claim 16, comprising:

an instruction adjusting rule store configured to store at least one instruction adjusting rule, and

an instruction adjusting component configured to adjust the partitioned operation according to the at least one instruction adjusting rule.

19. The system of claim 16, comprising:

an expression tree transforming component configured to transform the operation into an expression tree before the partitioning.

20. A computer-implemented method of evaluating an operation comprising a language-integrated query to be processed by a processing engine comprising a relational data query processor for a client, the method comprising:

transforming the operation into an expression tree;

partitioning the operation into a partitioned operation having a pre-engine portion executed by the client, a processing engine portion executed by the processing engine, and a post-engine portion executed by the client;

expanding at least one portion of the partitioned query executed by one of the client and the processing engine, and equivalently compacting portions of the partitioned query executed by the other of the client and the processing engine, related to at least one of;

processing capacity of the processing engine,

processing capacity of the client,

computational load of the processing engine,

computational load of the client,

storage capacity of the processing engine,

storage capacity of the client, and

communications capacity between the processing engine and the client;

adjusting the partitioned operation according to instruction adjusting rules comprising at least one of;

upon identifying a compacting instruction in the post-engine portion that compacts the post-engine portion and can be equivalently executed in the processing engine portion, moving the compacting instruction to the processing engine portion;

upon identifying a compacting instruction in the processing engine portion that compacts the processing engine portion and can be equivalently executed in the pre-engine portion, moving the compacting instruction to the pre-engine portion;

upon identifying a compacting instruction that compacts the operation, follows a computationally intensive instruction, and can be equivalently executed before the computationally intensive instruction, moving the compacting instruction before the computationally intensive instruction;

upon identifying a relocatable instruction in the processing engine component that is preferably executed by the client, follows an unrelocatable instruction that is preferably executed by the processing engine, and can be equivalently executed in the pre-engine portion, moving the relocatable instruction into the pre-engine portion;

upon identifying a relocatable instruction in the processing engine component that is preferably executed by the client, is preceded by an unrelocatable instruction that is preferably executed by the processing engine, and can be equivalently executed in the post-engine portion, moving the relocatable instruction into the post-engine portion;

upon identifying a relocatable instruction in the pre-engine component that is preferably executed by the processing engine, precedes an unrelocatable instruction that is preferably executed by the client, and can be equivalently executed in the processing engine portion, moving the relocatable instruction into the processing engine portion; and

upon identifying a relocatable instruction in the post-engine component that is preferably executed by the processing engine, follows an unrelocatable instruction that is preferably executed by the client, and can be equivalently executed in the processing engine portion, moving the relocatable instruction into the processing engine portion;

executing the pre-engine portion at the client to produce a pre-engine partially executed operation;

sending the pre-engine partially executed operation to the processing engine;

receiving a processing engine partially executed operation from the processing engine after sending the pre-engine partially executed operation; and

executing the post-engine portion of the computing engine partially executed operation at the client to complete the operation execution.