Method and apparatus for supporting distributed deductive closures using multidimensional result cursors

• US 9,959,325 B2
• Filed: 06/18/2010
• Issued: 05/01/2018
• Est. Priority Date: 06/18/2010
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Oliver, Ian Justin, Lassila, Ora, Mannermaa, Mika Juhani, Boldyrev, Sergey
• Primary Examiner(s): Kim, Taelor
• Application Number:
  US12/818,867
• Publication Number:
  US 20110314002A1
• Time in Patent Office: 2,874 Days
• Field of Search: 707722, 707769, 717114
• CPC Class Codes: G06F 16/2471 Distributed queries
• CPC Class Codes: G06F 16/283 Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP

Abstract

A method comprises selecting at least a first data set and a second data set on which to apply a query. The method also comprises causing generating of a first cursor based and a second cursor based on a first application of the query on the first data set and a second cursor based on a second application of the query on the second data set. A third cursor based on a combination of a result set returned by the first cursor and second cursor is then generated in response to the query.

Claims

1. A method comprising:

selecting at least a first data set and a second data set within a distributed database environment on which to apply a query, wherein the first data set, the second data set, or a combination thereof comprise data types including local data, cached local data, remote data, cached remote data, or a combination thereof;

generating a first cursor based, at least in part, on a first application of the query on the first data set;

generating a second cursor based, at least in part, on a second application of the query on the second data set, wherein the first cursor and the second cursor point to respective query result sets within the first data set and the second data set;

determining the data types of the respective query result sets;

generating a third cursor based, at least in part, on the first cursor and the second cursor, wherein the third cursor represents a combined result set for the query, the first cursor, the second cursor, the third cursor, or a combination thereof is further based on the determined data types of the respective query result sets;

causing, at least in part, modification of the query based, at least in part, on one or more characteristics of the first data set, the second data set, or a combination thereof,

wherein the first application of the query, the second application of the query, or a combination thereof is further based on the modification and the modification includes distributing the query into separate individual queries for use concurrently amongst the first data set, the second data set, or a combination thereof;

applying at least two deductive closures over the respective query result sets or the combined results set to generate a final result set, wherein each application of the at least two deductive closures requires a separate thread of execution performed at least one of (i) locally to the query or (ii) by a deductive closure engine; and

causing to present the final result set.

2. A method of claim 1, further comprising:

causing, at least in part, modification of the query based, at least in part, on the data types of the first data set, the second data set, or a combination thereof,

wherein the first application of the query, the second application of the query, or a combination thereof is further based on the modification of the query based, at least in part, on the data types of the first data set, the second data set, or a combination thereof.

3. A method of claim 1, further comprising:

applying the one or more deductive closures over the respective query result sets,

wherein the generating of the first cursor, the second cursor, the third cursor, or a combination thereof is further based on the one or more deductive closures.

4. A method of claim 1, further comprising:

receiving the respective query result sets in real-time as one or more streams;

causing, at least in part, traversal of the first cursor, the second cursor, the third cursor, or a combination thereof as the one or more streams are received; and

updating the traversal based, at least in part, on receipt of additional portions of the one or more streams.

5. A method of claim 1, further comprising:

detecting overlap among the respective query result sets,

wherein the generating of the third cursor further comprises compacting the respective result sets associated with the third cursor based, at least in part, on the overlap.

6. A method of claim 1, further comprising:

selecting a third data set on which to apply the query; and

causing, at least in part, generating of a fourth cursor based, at least in part, on a third application of the query on the third data set, the fourth cursor pointing to the respective query results sets within the third data set,

wherein the generating of the third cursor is further based on the fourth cursor.

15. The method of claim 1, wherein the final result set is based on common or fundamental characteristics amongst the respective query result sets or the combined results.

16. The method of claim 1, further comprising:

determining status information with respect to the first application, the second application, or a combination thereof, wherein the status information provides information about the respective query result sets or the combined results set, said information comprising whether the respective query result sets or the combined results set is complete relative to query constraints, an amount of data of the result set responsive to the query, an extent of available data, a completion time, an error resulting from lack of data access or availability, or a combination thereof; and

associating the status information of the respective query result sets or the combined results set with the first cursor, the second cursor, the third cursor, or a combination thereof.

7. An apparatus comprising:

at least one processor; and

at least one memory including computer program code,

wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to perform at least the following;

select at least a first data set and a second data set within a distributed database environment on which to apply a query, wherein the first data set, the second data set, or a combination thereof comprise data types including local data, cached local data, remote data, cached remote data, or a combination thereof;

generate a first cursor based, at least in part, on a first application of the query on the first data set;

generate a second cursor based, at least in part, on a second application of the query on the second data set, wherein the first cursor and the second cursor point to respective query result sets within the first data set and the second data set;

determine the data types of the respective query result sets;

generate a third cursor based, at least in part, on the first cursor and the second cursor, wherein the third cursor represents a combined result set for the query, the first cursor, the second cursor, the third cursor, or a combination thereof is further based on the determined data types of the respective query result sets;

cause, at least in part, modification of the query based, at least in part, on one or more characteristics of the first data set, the second data set, or a combination thereof,

wherein the first application of the query, the second application of the query, or a combination thereof is further based on the modification and the modification includes distributing the query into separate individual queries for use concurrently amongst the first data set, the second data set, or a combination thereof;

apply at least two deductive closures over the respective query result sets or the combined results set to generate a final result set, wherein each application of the at least two deductive closures requires a separate thread of execution performed at least one of (i) locally to the query or (ii) by a deductive closure engine; and

cause to present the final result set.

8. An apparatus of claim 7, wherein the apparatus is further caused to:

cause, at least in part, modification of the query based, at least in part, on the data types of the first data set, the second data set, or a combination thereof,

wherein the first application of the query, the second application of the query, or a combination thereof is further based on the modification of the query based, at least in part, on the data types of the first data set, the second data set, or a combination thereof.

9. An apparatus of claim 7, wherein the apparatus is further caused to:

apply the one or more deductive closures over the respective query result sets,

wherein the generating of the first cursor, the second cursor, the third cursor, or a combination thereof is further based on the one or more deductive closures.

10. An apparatus of claim 7, wherein the apparatus is further caused to:

receive the respective query result sets in real-time as one or more streams;

cause, at least in part, traversal of the first cursor, the second cursor, the third cursor, or a combination thereof as the one or more streams are received; and

update the traversal based, at least in part, on receipt of additional portions of the one or more streams.

11. An apparatus of claim 7, wherein the apparatus is further caused to:

detect overlap among the respective query result sets,

wherein the generating of the third cursor further comprises compacting the respective result sets associated with the third cursor based, at least in part, on the overlap.

12. An apparatus of claim 7, wherein the apparatus is further caused to:

select a third data set on which to apply the query; and

cause, at least in part, generating of a fourth cursor based, at least in part, on a third application of the query on the third data set, the fourth cursor pointing to the respective query results sets within the third data set,

wherein the generating of the third cursor is further based on the fourth cursor.

17. The apparatus of claim 7, wherein the final result set is based on common or fundamental characteristics amongst the respective query result sets or the combined results.

18. The apparatus of claim 7, wherein the apparatus is further caused to:

determine status information with respect to the first application, the second application, or a combination thereof, wherein the status information provides information about the respective query result sets or the combined results set, said information comprising whether the respective query result sets or the combined results set is complete relative to query constraints, an amount of data of the result set responsive to the query, an extent of available data, a completion time, an error resulting from lack of data access or availability, or a combination thereof; and

associate the status information of the respective query result sets or the combined results set with the first cursor, the second cursor, the third cursor, or a combination thereof.

13. A non-transitory computer-readable storage medium carrying one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to perform at least the following:

selecting at least a first data set and a second data set within a distributed database environment on which to apply a query, wherein the first data set, the second data set, or a combination thereof comprise data types including local data, cached local data, remote data, cached remote data, or a combination thereof;

generating a first cursor based, at least in part, on a first application of the query on the first data set;

generating a second cursor based, at least in part, on a second application of the query on the second data set, wherein the first cursor and the second cursor point to respective query result sets within the first data set and the second data set;

determining the data types of the respective query result sets;

generating a third cursor based, at least in part, on the first cursor and the second cursor, wherein the third cursor represents a combined result set for the query, the first cursor, the second cursor, the third cursor, or a combination thereof is further based on the determined data types of the respective query result sets;

causing, at least in part, modification of the query based, at least in part, on one or more characteristics of the first data set, the second data set, or a combination thereof,

wherein the first application of the query, the second application of the query, or a combination thereof is further based on the modification and the modification includes distributing the query into separate individual queries for use concurrently amongst the first data set, the second data set, or a combination thereof;

applying at least two deductive closures over the respective query result sets or the combined results set to generate a final result set, wherein each application of the at least two deductive closures requires a separate thread of execution performed at least one of (i) locally to the query or (ii) by a deductive closure engine; and

causing to present the final result set.

14. A non-transitory computer-readable storage medium of claim 13, wherein the apparatus is caused to further perform:

causing, at least in part, modification of the query based, at least in part, on the data types of the first data set, the second data set, or a combination thereof,

wherein the first application of the query, the second application of the query, or a combination thereof is further based on the modification of the query based, at least in part, on the data types of the first data set, the second data set, or a combination thereof.