Query routing of federated information systems for fast response time, load balance, availability, and reliability
First Claim
1. A system for optimizing query processing in a federated information system, said system comprising:
- a calibrator in communication with said federated information system and adapted to intercept queries to said federated information system;
a simulator in communication with said calibrator and adapted to derive alternative query plans for each of said queries, wherein each of said query plans comprises a plurality of query fragment plans associated with at least one data source, wherein said simulator is further adapted to determine first query fragment cost estimates for each of said query fragment plans, wherein said calibrator is further adapted to calibrate source-specific cost factors for each data source in said federated information system based on workload associated with said corresponding data source, and wherein said simulator is further adapted to calculate second query fragment cost estimates by multiplying each of said first query fragment cost estimates times a corresponding one of said source-specific cost factors.
1 Assignment
0 Petitions
Accused Products
Abstract
Disclosed are embodiments of a system for optimizing query processing in a federated information system. The system may be used to identify alternative query plans in a simulated environment and to calculate cost estimates associated with the alternative query plans, based not only on database statistics and query statements, but also based on workload and processing latencies associated with specific data source and with the federated information system as a whole. In addition the calculated cost estimates may also factor in data source availability and reliability. The system may use the alternative query plans and the associated cost estimates to influence query processing in a federated information system by feeding to the federated information system query plans that allow for cost-efficient query plan-level load distribution, cost-efficient query fragment plan-level load distribution, and load distribution based upon quality of service cost constraints.
-
Citations
20 Claims
-
1. A system for optimizing query processing in a federated information system, said system comprising:
-
a calibrator in communication with said federated information system and adapted to intercept queries to said federated information system;
a simulator in communication with said calibrator and adapted to derive alternative query plans for each of said queries, wherein each of said query plans comprises a plurality of query fragment plans associated with at least one data source, wherein said simulator is further adapted to determine first query fragment cost estimates for each of said query fragment plans, wherein said calibrator is further adapted to calibrate source-specific cost factors for each data source in said federated information system based on workload associated with said corresponding data source, and wherein said simulator is further adapted to calculate second query fragment cost estimates by multiplying each of said first query fragment cost estimates times a corresponding one of said source-specific cost factors. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A system for optimizing query processing in a federated information system, said system comprising:
-
a calibrator in communication with said federated information system and adapted to intercept queries to said federated information system; and
a simulator in communication with said calibrator and adapted to derive alternative query plans for each of said queries and to determine a first query cost estimate for each of said query plans, wherein said calibrator is adapted to calibrate a system cost factor for said federated information system based on workload associated with said federated information system, and wherein said simulator is further adapted to calculate second query cost estimates for each of said query plans by multiplying each of said first query cost estimate times said system cost factor and to balance workload distribution by select a plurality of query plans based on said second query cost estimates, and each time said query is requested, submitting any one of said plurality of query plans to said federated information system. - View Dependent Claims (11, 12, 13, 14)
-
-
15. A system for optimizing query processing in a federated information system, said system comprising:
-
a calibrator in communication with said federated information system and adapted to intercept queries to said federated information system; and
a simulator in communication with said calibrator and adapted to derive alternative query plans for each of said queries and to determine first query fragment cost estimates for each query fragment plan within each of said query plans;
wherein said calibrator is further adapted to calibrate source-specific cost factors for each data source associated with each of said query fragment plans based on workload, wherein said simulator is further adapted to calculate second query fragment cost estimates for each of said query fragment plans by multiplying each of said first query fragment cost estimates times a corresponding one of said source-specific cost factors, and wherein said simulator is further adapted to balance workload distribution by selecting one of said query plans for submission to said federated information system each time said query is requested and each time said one query plan is submitted to said federated information system interchanging at least one query fragment plan within said one query plan with other identical query fragment plans based on said second query fragment costs. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification