CHECKING FRESHNESS OF DATA FOR A DATA INTEGRATION SYSTEM, DIS
First Claim
1. A method of checking freshness of data for a data integration system (DIS), storing data integrated from external sources in a data store following a data query to the DIS, the method comprising:
- carrying out a freshness check out on queried data integrated from external sources, the freshness check accessing stored metadata in the DIS and comparing the stored metadata for queried data with current metadata of the external sources for the queried data; and
allowing by the DIS, if the stored metadata matches the current metadata, the query to use the data in a data store and if the stored metadata does not match the current metadata, the data in the data store is refreshed from the external sources before use in the query.
1 Assignment
0 Petitions
Accused Products
Abstract
A method of checking freshness of data for a data integration system, DIS, storing data integrated from external sources in a data store where a freshness check is carried out on queried data integrated from external sources, the freshness check accessing stored metadata in the DIS and comparing the stored metadata for the queried data with current metadata of the external sources for the queried data; and where if the stored metadata matches the current metadata, the DIS allows the query to use the data in the data store and if the stored metadata does not match the current metadata, the data in the data store is refreshed from the external source before use in the query.
11 Citations
19 Claims
-
1. A method of checking freshness of data for a data integration system (DIS), storing data integrated from external sources in a data store following a data query to the DIS, the method comprising:
-
carrying out a freshness check out on queried data integrated from external sources, the freshness check accessing stored metadata in the DIS and comparing the stored metadata for queried data with current metadata of the external sources for the queried data; and allowing by the DIS, if the stored metadata matches the current metadata, the query to use the data in a data store and if the stored metadata does not match the current metadata, the data in the data store is refreshed from the external sources before use in the query. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A method in a data store linked to a data integration system (DIS), which is configured to integrate data from external sources and store integrated data in the data store, the method comprising:
-
accepting a user input in a form of a query about data in the data store; sending a freshness check command to the DIS to compare stored metadata for queried data in the DIS with current metadata for the queried data in the external sources; and waiting for a response from the DIS before passing the query for execution. - View Dependent Claims (7)
-
-
8. A method according to claim 67, wherein the freshness check command is only sent if a query directed to a same queried data has not been made within a time span.
-
9. A data integration system (DIS), comprising:
-
a data aggregation section linked to external sources and configured to integrate data from the external sources and to store integrated data in a data store; and a registry configured to store metadata of external data sources for data in the data store; wherein the DIS is configured to be triggered to carry out a freshness check of user queried data; the data aggregation section is configured to provide current metadata from an external source for the queried data; wherein the registry is configured to compare stored metadata for the queried data with the current metadata; and wherein if the stored metadata matches the current metadata, the DIS allows a query to use the data in the data store and if the stored metadata does not match the current metadata, the data aggregation section is configured to refresh data in the data store from the external source before use in the query. - View Dependent Claims (10, 11, 12, 13)
the registry is configured to send the execution command without further action if the regenerated metadata does match the metadata.
-
-
14. A data store linked to a data integration system (DIS) which is configured to integrate data from external sources and store integrated data in the data store, the data store comprising:
-
one or more stores for data; an input allowing a query to be sent to the data store; and a query checker triggered by the query, which is configured to cause a freshness check command to be sent to the DIS to compare stored metadata for queried data in the DIS with current metadata for the queried data in the external sources and to wait for a response from the DIS before passing the query to the data store. - View Dependent Claims (15, 16, 17)
-
-
18. A non-transitory computer-readable medium storing a computer program which when executed in a data store a data integration system (DIS) carries out a method of checking freshness of data for the DIS storing data integrated from external sources in a data store following a data query to the DIS, the method comprising:
-
carrying out a freshness check on queried data integrated from the external sources, the freshness check accessing stored metadata in the DIS and comparing stored metadata for queried data with current metadata of the external sources for the queried data; and wherein if the stored metadata matches the current metadata, the DIS allows the query to use data in the data store and if the stored metadata does not match the current metadata, the data in the data store is refreshed from the external source before use in the query.
-
-
19. A non-transitory computer-readable medium storing a computer program which when executed in a data store or a data integration system (DIS) carries out a method in a data store linked to the DIS which is configured to integrate data from external sources and store integrated data in the data store, the method comprising:
-
accepting a user input in a form of a query about data in the data store; sending a freshness check command to the DIS to compare stored metadata for queried data in the DIS with current metadata for the queried data in the external sources; and waiting for a response from the DIS before passing the query for execution.
-
Specification