POLICY BASED DATA COLLECTION, PROCESSING, AND NEGOTIATION FOR ANALYTICS

• US 20160275158A1
• Filed: 03/20/2015
• Published: 09/22/2016
• Est. Priority Date: 03/20/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Baset, Salman A., Deng, Yu, Kim, Minkyong, Segal, Alla, Schulz, Charles O., Sailer, Anca, Wang, Long
• Granted Patent: US 10,223,329 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/367 Ontology

Abstract

An approach for ontological policy based data collection, processing, and negotiation for data in view of analytics is provided. The approach searches one or more data sources for data related to a data request. The approach collects data related to the data request from the one or more data sources. The approach determines whether one or more attributes generated from the data request match one or more descriptors associated with the data related to the data request. The approach creates one or more annotated ontologies for the data related to the data request. The approach displays a hierarchical visualization of the one or more annotated ontologies for the data related to the data request. The approach updates the one or more annotated ontologies for the data related to the data request based, at least in part, on an evaluation of the quality of the one or more data selections.

Claims

1. A method for ontological policy based data collection, processing, and negotiation for data in view of analytics, the method comprising:

searching, by one or more computer processors, one or more data sources for data related to a data request;

collecting, by one or more computer processors, data related to the data request from the one or more data sources;

determining, by one or more computer processors, whether one or more attributes generated from the data request match one or more descriptors associated with the data related to the data request;

responsive to a determination that the one or more attributes generated from the data request match one or more descriptors associated with the data related to the data request, creating, by one or more computer processors, one or more annotated ontologies for the data related to the data request;

displaying, by one or more computer processors, a hierarchical visualization of the one or more annotated ontologies for the data related to the data request; and

updating, by one or more computer processors, the one or more annotated ontologies for the data related to the data request based, at least in part, on an evaluation of the quality of the one or more data selections.

2. The method of claim 1, wherein searching one or more data sources for data related to a data request, further comprises:

generating, by one or more computer processors, one or more attributes from the data request; and

searching, by one or more computer processors, the one or more data sources for data related to the one or more attributes.

3. The method of claim 2, wherein collecting the data related to the one or more attributes, further comprises:

extracting, by one or more computer processors, one or more descriptors from the data, wherein the one or more descriptors describe and identify the data;

populating, by one or more computer processors, a data descriptor template for the data with the one or more descriptors; and

determining, by one or more computer processors, one or more ontologies defining a domain for the data.

4. The method of claim 3, wherein determining one or more ontologies defining a domain for the data, further comprises:

discovering, by one or more computer processors, one or more relevant ontology descriptors; and

associating, by one or more computer processors, the one or more relevant ontology descriptors with one or more descriptors from the data.

5. The method of claim 1, wherein determining whether one or more attributes generated from the data request match one or more descriptors associated with the data related to the data request, further comprises at least one of:

determining, by one or more computer processors, that the attributes generated from the data request match descriptors associated with the data related to the data request where at least one of one or more features of the available data are related to at least one of the attributes generated from the data request; and

determining, by one or more computer processors, that the attributes generated from the data request do not match descriptors associated with the data related to the data request where at least one of one or more features of the available data are not related to at least one of the attributes generated from the data request.

6. The method of claim 1, wherein displaying a hierarchical visualization of one or more ontologies for the data related to the data request, further comprises:

associating, by one or more computer processors, one or more user defined policy rules with one or more descriptors from the data related to the data request, wherein associating the one or more user defined policy rules with one or more descriptors for the data related to the data request includes determining a level of relevancy between policy rules and data descriptors; and

creating, by one or more computer processors, one or more annotated ontologies for the data related to the data request, wherein creating the one or more annotated ontologies includes combining one or more ontologies defining a domain for the data with one or more modifiable data policy rules to describe the data and one or more handling requirements for the data based on the one or more modifiable data policy rules.

7. The method of claim 6, wherein creating one or more annotated ontologies for the data related to the data request, further comprises:

annotating, by one or more computer processors, one or more data descriptors with at least one summary of one or more documents from the data related to the data request, wherein annotating the one or more data descriptors with the at least one summary includes at least one of associating summary information generated from searching one or more data sources, applying data policy rules to the at least one summary, and modifying the at least one summary to conform to relevant data policy rules.

8. The method of claim 1, further comprises:

filtering, by one or more computer processors, data from the one or more ontologies for the data related to the data request based, at least in part, on one or more data selections, a data consumer data policy, and a data provider data policy, wherein filtering includes cleaning data from one or more ontologies by applying one or more modifiable data policy rules from the data consumer data policy and the data provider data policy.

9. The method of claim 1, wherein updating the one or more ontologies for the data related to the data request based, at least in part, on an evaluation of the quality of the one or more data selections, further comprises:

prompting, by one or more computer processors, to evaluate quality of one or more data selections, where an evaluation of the quality of the one or more data selections include at least one of ranking a data source credibility, ranking a data source prestige, ranking a data source relevance to a particular domain, and ranking a ratio of data updated based on data filtering; and

prompting, by one or more computer processors, to modify an existing data policy.

10. A computer program product for ontological policy based data collection, processing, and negotiation for data in view of analytics, the computer program product comprising:

one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the program instructions comprising;

program instructions to search, by one or more computer processors, one or more data sources for data related to a data request;

program instructions to collect, by one or more computer processors, data related to the data request from the one or more data sources;

program instructions to determine, by one or more computer processors, whether one or more attributes generated from the data request match one or more descriptors associated with the data related to the data request;

responsive to a determination that the one or more attributes generated from the data request match one or more descriptors associated with the data related to the data request, program instructions to create, by one or more computer processors, one or more annotated ontologies for the data related to the data request;

program instructions to display, by one or more computer processors, a hierarchical visualization of the one or more annotated ontologies for the data related to the data request; and

program instructions to update, by one or more computer processors, the one or more annotated ontologies for the data related to the data request based, at least in part, on an evaluation of the quality of the one or more data selections.

11. The computer program product of claim 10, wherein program instructions to determine whether one or more attributes generated from the data request match one or more descriptors associated with the data related to the data request, further comprises at least one of:

program instructions to determine, by one or more computer processors, that the attributes generated from the data request match descriptors associated with the data related to the data request where at least one of one or more features of the available data are related to at least one of the attributes generated from the data request; and

program instructions to determine, by one or more computer processors, that the attributes generated from the data request do not match descriptors associated with the data related to the data request where at least one of one or more features of the available data are not related to at least one of the attributes generated from the data request.

12. The computer program product of claim 10, wherein program instructions to display a hierarchical visualization of one or more ontologies for the data related to the data request, further comprises:

program instructions to associate, by one or more computer processors, one or more user defined policy rules with one or more descriptors from the data related to the data request, wherein associating the one or more user defined policy rules with one or more descriptors for the data related to the data request includes determining a level of relevancy between policy rules and data descriptors; and

program instructions to create, by one or more computer processors, one or more annotated ontologies for the data related to the data request, wherein creating the one or more annotated ontologies includes combining one or more ontologies defining a domain for the data with one or more modifiable data policy rules to describe the data and one or more handling requirements for the data based on the one or more modifiable data policy rules.

13. The computer program product of claim 12, wherein program instructions to create one or more annotated ontologies for the data related to the data request, further comprises:

program instructions to annotate, by one or more computer processors, one or more data descriptors with at least one summary of one or more documents from the data related to the data request, wherein annotating the one or more data descriptors with the at least one summary includes at least one of associating summary information generated from searching one or more data sources, applying data policy rules to the at least one summary, and modifying the at least one summary to conform to relevant data policy rules.

14. The computer program product of claim 10, further comprises:

program instructions to filter, by one or more computer processors, data from the one or more ontologies for the data related to the data request based, at least in part, on one or more data selections, a data consumer data policy, and a data provider data policy, wherein filtering includes cleaning data from one or more ontologies by applying one or more modifiable data policy rules from the data consumer data policy and the data provider data policy.

15. The computer program product of claim 10, wherein program instructions to update the one or more ontologies for the data related to the data request based, at least in part, on an evaluation of the quality of the one or more data selections, further comprises:

program instructions to prompting, by one or more computer processors, to evaluate quality of one or more data selections, where an evaluation of the quality of the one or more data selections include at least one of ranking a data source credibility, ranking a data source prestige, ranking a data source relevance to a particular domain, ranking a data selection, and ranking a ratio of data updated based on data filtering; and

program instructions to prompt, by one or more computer processors, to modify an existing data policy.

16. A computer system for ontological policy based data collection, processing, and negotiation for data in view of analytics, the computer system comprising:

one or more computer readable storage media;

program instructions stored on at least one of the one or more computer readable storage media for execution by at least one of the one or more computer processors, the program instructions comprising;

program instructions to search, by one or more computer processors, one or more data sources for data related to a data request;

program instructions to collect, by one or more computer processors, data related to the data request from the one or more data sources;

program instructions to determine, by one or more computer processors, whether one or more attributes generated from the data request match one or more descriptors associated with the data related to the data request;

responsive to a determination that the one or more attributes generated from the data request match one or more descriptors associated with the data related to the data request, program instructions to create, by one or more computer processors, one or more annotated ontologies for the data related to the data request;

program instructions to display, by one or more computer processors, a hierarchical visualization of the one or more annotated ontologies for the data related to the data request; and

program instructions to update, by one or more computer processors, the one or more annotated ontologies for the data related to the data request based, at least in part, on an evaluation of the quality of the one or more data selections.

17. The computer system of claim 16, wherein program instructions to display a hierarchical visualization of one or more ontologies for the data related to the data request, further comprises:

program instructions to associate, by one or more computer processors, one or more user defined policy rules with one or more descriptors from the data related to the data request, wherein associating the one or more user defined policy rules with one or more descriptors for the data related to the data request includes determining a level of relevancy between policy rules and data descriptors; and

program instructions to create, by one or more computer processors, one or more annotated ontologies for the data related to the data request, wherein creating the one or more annotated ontologies includes combining one or more ontologies defining a domain for the data with one or more modifiable data policy rules to describe the data and one or more handling requirements for the data based on the one or more modifiable data policy rules.

18. The computer system of claim 17, wherein program instructions to create one or more annotated ontologies for the data related to the data request, further comprises:

program instructions to annotate, by one or more computer processors, one or more data descriptors with at least one summary of one or more documents from the data related to the data request, wherein annotating the one or more data descriptors with the at least one summary includes at least one of associating summary information generated from searching one or more data sources, applying data policy rules to the at least one summary, and modifying the at least one summary to conform to relevant data policy rules.

19. The computer system of claim 16, further comprises:

program instructions to filter, by one or more computer processors, data from the one or more ontologies for the data related to the data request based, at least in part, on one or more data selections, a data consumer data policy, and a data provider data policy, wherein filtering includes cleaning data from one or more ontologies by applying one or more modifiable data policy rules from the data consumer data policy and the data provider data policy.

20. The computer system of claim 16, wherein program instructions to update the one or more ontologies for the data related to the data request based, at least in part, on an evaluation of the quality of the one or more data selections, further comprises:

program instructions to prompting, by one or more computer processors, to evaluate quality of one or more data selections, where an evaluation of the quality of the one or more data selections include at least one of ranking a data source credibility, ranking a data source prestige, ranking a data source relevance to a particular domain, ranking a data selection, and ranking a ratio of data updated based on data filtering; and

program instructions to prompt, by one or more computer processors, to modify an existing data policy.