DETECTING RELEVANT FACETS BY LEVERAGING DIAGRAM IDENTIFICATION, SOCIAL MEDIA AND STATISTICAL ANALYSIS SOFTWARE

• US 20170124201A1
• Filed: 11/04/2015
• Published: 05/04/2017
• Est. Priority Date: 11/04/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Guo, Zhili, Jiang, Peng Hui, Bei, Xiao Xian, Li, Fang Ming, Zhan, Ghang
• Granted Patent: US 10,572,557 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/24575 using context
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: G06F 16/3331 Query processing
• CPC Class Codes: G06F 16/335 Filtering based on additional data, e.g. user or group profiles filtering in web context G06F16/9535, G06F16/9536
• CPC Class Codes: G06F 16/338 Presentation of query results
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation

Abstract

An approach to finding facets of big data across multiple subject fields which have mutual relevance and provide useful information and insights. The approach is based on an analysis of diagrams associated with facets found in big data, such as that available on the internet, and the results of the analysis are further refined through a regional analysis and a search of social media data for events pertaining to the facets. Embodiments can further make use of statistical analysis software to provide statistical evidence related to the facets that can validate the results and findings of facet relevancy.

Claims

1. A method for determining relevant facets of big data, the method comprising:

searching a first one or more data sources for one or more facets, wherein the one or more facets comprise at least one of facet data and facet diagrams;

creating one or more facet diagrams for the at least one or more facet data;

comparing the one or more facet diagrams to a base facet diagram to generate a first group of relevant facet diagrams based on a diagrammatic analysis;

filtering the first group of relevant facet diagrams based on at least one of a regional analysis and a search of social media to generate a second group of relevant facet diagrams; and

outputting the second group of relevant facet diagrams.

2. The method of claim 1, further comprising:

presenting a list of one or more second data sources, which provide data associated with the second group of relevant facet diagrams, for statistical analysis via statistical analysis software.

3. The method of claim 1, wherein the one or more facets comprise at least one of structured and unstructured data.

4. The method of claim 1, wherein the searching the first one or more data sources is based on a preconfigured search criteria.

5. The method of claim 1, wherein the diagrammatic analysis comprises comparing trends of the one or more facet diagrams across a plurality of corresponding time segments for a predetermined threshold.

6. The method of claim 1, wherein the regional analysis comprises retrieving similar facets, associated with the first group of relevant facet diagrams, from one or more geographical regions other than those associated with the first group of relevant facet diagrams, comparing the similar facets based on the diagrammatic analysis and filtering the first group of relevant facet diagrams based on the comparison of the similar facets, according to a predetermined criteria.

7. The method of claim 1, wherein the filtering of the first group of relevant facet diagrams based on the search of social media comprises a retrieval of one or more social media events, associated with the first group of relevant facet diagrams, within a predetermined threshold.

8. A computer program product for determining relevant facets of big data, the computer program product comprising:

one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the program instructions comprising;

program instructions to search a first one or more data sources for one or more facets, wherein the one or more facets comprise at least one of facet data and facet diagrams;

program instructions to create one or more facet diagrams for the at least one or more facet data;

program instructions to compare the one or more facet diagrams to a base facet diagram to generate a first group of relevant facet diagrams based on a diagrammatic analysis;

program instructions to filter the first group of relevant facet diagrams based on at least one of a regional analysis and a search of social media to generate a second group of relevant facet diagrams; and

program instructions to output the second group of relevant facet diagrams.

9. The computer program product of claim 8, further comprising:

program instructions to present a list of one or more second data sources, which provide data associated with the second group of relevant facet diagrams, for statistical analysis via statistical analysis software.

10. The computer program product of claim 8, wherein the one or more facets comprise at least one of structured and unstructured data.

11. The computer program product of claim 8, wherein the program instructions to search the first one or more data sources is based on a preconfigured search criteria.

12. The computer program product of claim 8, wherein the diagrammatic analysis comprises comparing trends of the one or more facet diagrams across a plurality of corresponding time segments for a predetermined threshold.

13. The computer program product of claim 8, wherein the regional analysis comprises retrieving similar facets, associated with the first group of relevant facet diagrams, from one or more geographical regions other than those associated with the first group of relevant facet diagrams, comparing the similar facets based on the diagrammatic analysis and filtering the first group of relevant facet diagrams based on the comparison of the similar facets, according to a predetermined criteria.

14. The computer program product of claim 8, wherein the program instructions to filter the first group of relevant facet diagrams based on the search of social media comprises a retrieval of one or more social media events, associated with the first group of relevant facet diagrams, within a predetermined threshold.

15. A computer system for determining relevant facets of big data, the computer system comprising:

one or more computer processors;

one or more computer readable storage media;

program instructions stored on the one or more computer readable storage media for execution by at least one of the one or more processors, the program instructions comprising;

program instructions to search a first one or more data sources for one or more facets, wherein the one or more facets comprise at least one of facet data and facet diagrams;

program instructions to create one or more facet diagrams for the at least one or more facet data;

program instructions to compare the one or more facet diagrams to a base facet diagram to generate a first group of relevant facet diagrams based on a diagrammatic analysis;

program instructions to filter the first group of relevant facet diagrams based on at least one of a regional analysis and a search of social media to generate a second group of relevant facet diagrams; and

program instructions to output the second group of relevant facet diagrams.

16. The computer system of claim 15, further comprising:

program instructions to present a list of one or more second data sources, which provide data associated with the second group of relevant facet diagrams, for statistical analysis via statistical analysis software.

17. The computer system of claim 15, wherein the program instructions to search the first one or more data sources is based on a preconfigured search criteria.

18. The computer system of claim 15, wherein the diagrammatic analysis comprises comparing trends of the one or more facet diagrams across a plurality of corresponding time segments for a predetermined threshold.

19. The computer system of claim 15, wherein the regional analysis comprises retrieving similar facets, associated with the first group of relevant facet diagrams, from one or more geographical regions other than those associated with the first group of relevant facet diagrams, comparing the similar facets based on the diagrammatic analysis and filtering the first group of relevant facet diagrams based on the comparison of the similar facets, according to a predetermined criteria.

20. The computer system of claim 15, wherein the program instructions to filter the first group of relevant facet diagrams based on the search of social media comprises a retrieval of one or more social media events, associated with the first group of relevant facet diagrams, within a predetermined threshold.