PERSISTENT QUERYING IN A FEDERATED DATABASE SYSTEM

• US 20110131242A1
• Filed: 11/23/2010
• Published: 06/02/2011
• Est. Priority Date: 11/27/2009
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Bent, Graham, Dantressangle, Patrick, Gibson, Christopher R., Vyvyan, David R.
• Granted Patent: US 8,386,515 B2
• Time in Patent Office: Days
• US Class Current: 707/770
• CPC Class Codes: G06F 16/2471 Distributed queries

Abstract

Methods and systems are provided, for persistent querying in a federated database system. A federated database system has a plurality of connectable database management system nodes, each database node having at least one database. Persistent querying includes: receiving a query at a first database node and propagating the query from the first database node to other database nodes in the federated database system. A responding database node satisfying the query: obtains a query results set; defines a topic identifier for the query; and publishes subsequent messages relating to the topic identifier when data updates are available. The first database node receives query results sets from one or more responding nodes and the first database node subscribes to topic identifiers for publications of subsequent messages from the responding database nodes. Subsequent messages are published relating to the query along the connection through which the query is returned.

Claims

1. A method for persistent querying in a federated database system having a plurality of connectable database management system nodes, each database node having at least one database, the method comprising:

receiving a query at a first database node;

propagating the query from the first database node to other database nodes in the federated database system;

receiving, by the first database node, query results sets from at least one responding node, wherein at least one responding node satisfying the query;

obtains a query results set;

defines a topic identifier for the query; and

publishes subsequent messages relating to the topic identifier when data updates are available; and

subscribing, by the first database node, to topic identifiers for publications of subsequent messages from the responding database nodes.

2. The method as claimed in claim 1, further comprising:

publishing the subsequent messages relating to the query along the connection through which the query is returned.

3. The method as claimed in claim 1, wherein:

receiving query results sets further comprises receiving, by the first database node, the query results sets from an intermediate responding node that aggregates query results sets and topic identifiers from lower responding database nodes in the propagation.

4. The method as claimed in claim 1, further comprising:

decomposing the query into sub-queries before propagation to other database nodes;

wherein a corresponding topic identifier relates to an associated sub-query.

5. The method as claimed in claim 1, further comprising:

defining the query as a persistent query to inform the database nodes that publication of subsequent messages is required.

6. The method as claimed in claim 1, further comprising:

instructing a message broker to subscribe to messages on its topic identifier and to publish subsequent message to other database nodes.

7. The method as claimed in claim 1, further comprising:

enabling a network of message brokers on aggregated topic identifiers in a route of returned query results from database nodes.

8. The method as claimed in claim 7, further comprising:

recording return routes of topic identifiers; and

enabling message brokers on the optimum return routes.

9. The method as claimed in claim 1, further comprising repeating the propagation of the same query to establish additional return routes from database nodes.

10. The method as claimed in claim 1, further comprising:

receiving by a select one responding database node, the same query from another node; and

identifying existing topic identifiers that satisfy the query.

11. The method as claimed in claim 1, further comprising:

storing topic identifiers locally on a database node for use with future queries.

12. The method as claimed in claim 11, further comprising:

storing meta-data with topic identifiers to aid discoverability of a topic identifier for a query.

13. A computer software product for persistent querying in a federated database system having a plurality of connectable database management system nodes, each database node having at least one database , the computer program product comprising a computer-readable storage medium, storing computer code comprising computer-executable instructions , which instructions, when read and executed by a computer, perform the following:

receiving a query at a first database node;

propagating the query from the first database node to other database nodes in the federated database system;

receiving, by the first database node, query results sets from at least one responding node, wherein at least one responding node satisfying the query;

obtains a query results set;

defines a topic identifier for the query; and

publishes subsequent messages relating to the topic identifier when data

updates are available; and

subscribing, by the first database node, to topic identifiers for publications of subsequent messages from the responding database nodes.

14. A system for persistent querying in a federated database system with a plurality of connectable database management system nodes, each database node having at least one database, comprising:

a processor coupled to a memory such that the processor is programmed to implement;

a query mechanism for receiving a query at a first database node;

a propagating mechanism for propagating the query from the first database node to other database nodes in the federated database system;

a responding database node including;

a query results set obtaining component; and

a topic identifier defining component for the query; and

a publisher application for publishing subsequent messages relating to the topic identifier when data updates are available;

wherein;

the first database node includes a results receiving component for query results sets from one or more responding nodes; and

the first database node includes a subscriber application for subscribing to topic identifiers for publications of subsequent messages from the responding database nodes.

15. The system as claimed in claim 14, wherein:

an intermediate responding node includes an aggregating component to aggregate query results sets and topic identifiers from lower responding database nodes in the propagation.

16. The system as claimed in claim 14, wherein:

the first database node includes a query decomposition component for decomposing a query into sub-queries before propagation to other database nodes and the topic identifier relates to the sub-query.

17. The system as claimed in claim 14, including a definition that the query is a persistent query to inform the database nodes that publication of subsequent messages is required.

18. The system as claimed in claim 14, wherein:

a database node instructs a message broker to subscribe to messages on its topic identifier and to publish subsequent message to other database nodes.

19. The system as claimed in claim 14, wherein:

a network of message brokers is enabled on the aggregated topic identifiers in a route of returned query results from database nodes.

20. The system as claimed in claim 14, including a route manager component wherein return routes of topic identifiers are recorded and message brokers enabled on the optimum return routes.

21. The system as claimed in claim 14, wherein:

a responding database node includes an existing topic identifier component for identifying existing topic identifiers that satisfy a query received from another node.

22. The system as claimed in claim 14, wherein:

a database node includes a table for storing topic identifiers locally for use with future queries.

23. The system as claimed in claim 22, wherein:

the table includes meta-data stored with topic identifiers to aid discoverability of a topic identifier for a query.