Method and system for creation and dynamic updating of best data arrangement in digital data store system

• US 8,364,697 B2
• Filed: 06/24/2009
• Issued: 01/29/2013
• Est. Priority Date: 06/26/2008
• Status: Active Grant

• Current Assignee: Tamiras Per Pte Ltd LLC (Intellectual Ventures LLC)
• Original Assignee: Yanicklo Technology LLC (Intellectual Ventures LLC)
• Inventors: Matias, Yossi, Shaked, Guy, Braverman, Vladimir, Belyaev, Victor, Golan, Shahar, Sadetsky, Marina
• Primary Examiner(s): Singh, Amresh
• Application Number:
  US12/490,981
• Publication Number:
  US 20090327217A1
• Time in Patent Office: 1,315 Days
• Field of Search: 707/769, 707/758, 707/705, 707/813, 707/779, 707/999.1, 707/999.102, 707/999.003, 707/999.001
• US Class Current: 707/769
• CPC Class Codes: G06F 16/245 Query processing

Abstract

The current invention is a method and a system for analyzing templates of queries, with different levels of precision. When the system of the current invention takes a decision to arrange data, these templates are used, and a single data arrangement object (HRBlob) is designed which may serve a single template or several templates and not just a single query. This approach has an important impact on data arrangement performance and on queries performance, since this approach may help many more queries to be handled using less data arrangement objects.

Claims

1. A method comprising:

generating, by a computing system comprising computer hardware and independent of query processing, a set of one or more HRBlobs organized according to a hierarchy, wherein an HRBlob comprises a collection of arranged data stored as a single entity that is constructed from a data store or from another HRBlob, and is configured to provide an answer to one or more specific query templates comprising a requested dimension and a requested measure;

determining one or more respective properties associated with the one or more HRBlobs, the one or more respective properties comprising at least one of a measure, dimension, or level of arrangement;

receiving one or more queries from a user;

determining, by analyzing characteristics of the one or more queries and the one or more respective properties associated with the one or more HRBlobs, whether to service a given query of the one or more queries with the set of one or more HRBlobs or the data store;

in response to determining to service the given query with the set of one or more HRBlobs,

generating a response to the given query based on data from the set of one or more HRBlobs;

in response to determining to service the given query with data in the data store,

generating a response to the given query based on data from the data store; and

continuously updating the set of one or more HRBlobs based on updates to the data store for future query processing.

2. The method of claim 1, wherein the method is performed by a complementary system, which is added onto an existing data store system using an existing interface.

3. The method of claim 1, wherein the method is performed by an integrated system, which is integrated into a data store system.

4. The method of claim 1, wherein the method begins performance without any prior knowledge of the data store contents and any existing summary tables.

5. The method of claim 1, wherein each HRBlob comprises any subset of data store data records from the data store, with any subset of measures from the data store, and any subset and any combination of metadata dimensions from the data store, arranged in any order and in any level.

6. The method of claim 1, wherein each HRBlob comprises a dimension and measure that are recalculated based on changes to the data store.

7. The method of claim 1, further comprising automatically recognizing and adapting changes in the data store'"'"'s content and in the data store'"'"'s properties by updating the set of one or more HRBlobs.

8. The method of claim 7, wherein the changes are adapted online either prior to a query, or while processing a query, or after the query was executed.

9. The method of claim 7, wherein the changes are adapted offline.

10. The method of claim 1, further comprising creating a new HRBlob to answer the given query if, in response to determining to service the given query with the set of one or more HRBlobs, there is no existing HRBlob to answer the query.

11. The method of claim 1, further comprising routing the query to the data store to be processed if, in response to determining to service the given query with the set of one or more HRBlobs, there is no existing HRBlob to answer the query.

12. The method of claim 1, wherein queries are processed online.

13. The method of claim 1, wherein queries are processed offline.

14. The method of claim 1, wherein continuously updating the set of one or more HRBlobs further comprises continuously updating the set of one or more HRBlobs in the absence of query proccessing.

15. A computing system comprising:

a non-transitory computer readable medium storing machine-executable instructions configured for execution by the computing system in order to cause the computing system to;

generate, independent of query processing, a set of one or more collections of arranged data, wherein a collection of arranged data is stored as a single entity that is constructed from a data store, and is configured to provide an answer to one or more specific query templates comprising a requested dimension and a requested measure;

determine one or more respective properties associated with the one or more collections of arranged data, the one or more respective properties comprising at least one of a measure, dimension, or level of arrangement;

receive one or more queries from a user;

determine, by analyzing characteristics of the one or more queries and the one or more respective properties associated with the one or more collections of arranged data, whether to service a given query of the one or more queries with the set of one or more collections of arranged data or the data store,

in response to determining to service the given query with the set of one or more collections of arranged data,

generate a response to the given query based on data from the set of one or more collections of arranged data;

in response to determining to service the given query with data in the data store,

generate a response to the given query based on data from the data store; and

continuously update the set of one or more collections of arranged data based on updates to the data store.

16. The computing system of claim 15, wherein each collection of arranged data comprises any subset of data store data records from the data store, with any subset of measures from the data store, and any subset and any combination of metadata dimensions from the data store, arranged in any order and in any level.

17. The computing system of claim 15, wherein the instructions are further configured to cause the computing system to automatically recognize and adapt changes in the data store'"'"'s content and in the data store'"'"'s properties by updating the set of one or more collections of arranged data.

18. The computing system of claim 15, wherein each collection of arranged data comprises a dimension and measure that are recalculated based on changes to the data store.

19. The computing system of claim 15, wherein continuously updating the set of one or more collections of arranged data further comprises continuously updating the set of one or more collections of arranged data in the absence of query processing.

20. A non-transitory computer-readable medium encoded with instructions thereon, wherein the instructions are readable by a computing device in order to cause the computing device to perform operations comprising:

generating a set of one or more collections of arranged data independent of query processing, wherein a collection of arranged data is stored as a single entity that is constructed from a data store, and is configured to provide an answer to one or more specific query templates comprising a requested dimension and a requested measure;

continuously updating the set of one or more collections of arranged data based on updates to the data store;

determining one or more respective properties associated with the one or more collections of arranged data, the one or more respective properties comprising at least one of a measure, dimension, or level of arrangement;

receiving one or more queries from a user;

determining, by analyzing characteristics of the one or more queries and the one or more respective properties associated with the one or more collections of arranged data, whether to service a given query of the one or more queries with the set of one or more collections of arranged data or the data store; and

in response to determining to service the given query with the set of one or more collections of arranged data,

generating a response to the given query based on data from the set of one or more collections of arranged data.

21. The computer-readable medium of claim 20, wherein each collection of arranged data comprises any subset of data store data records from the data store, with any subset of measures from the data store, and any subset and any combination of metadata dimensions from the data store, arranged in any order and in any level.

22. The computer-readable medium of claim 20, wherein the operations further comprise automatically recognizing and adapting changes in the data store'"'"'s content and in the data store'"'"'s properties by updating the set of one or more collections of arranged data.

23. The computer-readable medium of claim 20, wherein each collection of arranged data comprises a dimension and measure that are recalculated based on changes to the data store.

24. The computer-readable medium of claim 20, wherein continuously updating the set of one or more collections of arranged data further comprises continuously updating the set of one or more one or more collections of arranged data in the absence of query processing.