Real-time and adaptive data mining

• US 9,229,977 B2
• Filed: 06/26/2013
• Issued: 01/05/2016
• Est. Priority Date: 08/02/2012
• Status: Active Grant

• Current Assignee: Rule 14 LLC
• Original Assignee: Rule 14
• Inventors: Chadha, Sharon Gill, Cheng, Xin, Chadha, Parvinder
• Primary Examiner(s): Beausoliel, Jr., Robert
• Assistant Examiner(s): Pham, Michael
• Application Number:
  US13/928,313
• Publication Number:
  US 20140040301A1
• Time in Patent Office: 923 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 16/2453 Query optimisation
• CPC Class Codes: G06F 16/2462 Approximate or statistical queries
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9532 Query formulation
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: G06F 40/30 Semantic analysis

Abstract

A method of analyzing data is presented. The method includes generating a query based on a topic of interest, expanding search terms of the query, executing the query on one or more data sources, monitoring a specific data source selected from the one or more data sources. The monitoring is performed to monitor for matches to the query.

Claims

1. A method of analyzing data, comprising:

generating, via a first user, a query based at least in part on a topic of interest;

expanding search terms of the query;

executing the query on a plurality of data sources;

selecting at least one data source from the plurality of data sources, the at least one data source being selected when results of the query are greater than or equal to an accuracy thresholds;

monitoring, based on a set schedule, the at least one data source to extract data from the at least one data source when at least an update to stored data that matches the query, newly added data that matches the query, or a combination thereof; and

establishing a communication channel with a second user based at least in part on the data extracted from the at least one monitored data source.

2. The method of claim 1, further comprising

analyzing the extracted data;

and

receiving feedback from the user based at least in part on the established communication channel.

3. The method of claim 2, further comprising visualizing at least the extracted data, the analyzed data, or a combination thereof.

4. The method of claim 1, in which expanding the query comprises expanding the search terms to include at least misspellings, synonyms, sub-topics, antonyms, or a combination thereof.

5. The method of claim 1, further comprising:

refining the search terms based at least in part on the executed query, and in which the monitoring is performed to monitor for matches to a refined query.

6. The method of claim 1, in which the plurality of data sources include open-source data sources that are publically available and closed-source data sources that at not publically accessible.

7. The method of claim 1, in which the query is a natural language query, and

further comprising translating the query to a system understood language.

8. The method of claim 1, in which the plurality of data sources are pre-defined.

9. The method of claim 1, in which the monitoring comprises deploying extractors to each of specific data source, a number of extractors being dynamic based at least in part on a traffic volume of each specific data source.

10. An apparatus configured to analyze data, the apparatus comprising:

a memory unit; and

at least one processor coupled to the memory unit, in which the at least one processor is configured;

to generate, via a first user, a query based at least in part on a topic of interest;

to expand search terms of the query;

to execute the query on a plurality of data sources;

to select at least one data source from the plurality of data sources, the at least one data source being selected when results of the query are greater than or equal to an accuracy thresholds;

to monitor, based on a set schedule, the at least one data source to extract data from the at least one data source when at least an update to stored data that matches the query, newly added data that matches the query, or a combination thereof; and

to establish a communication channel with a second user based at least in part on the data extracted from the at least one monitored data source.

11. The apparatus of claim 10, in which the at least one processor is further configured:

to analyze the extracted data;

and

to receive feedback from the user based at least in part on the established communication channel.

12. The apparatus of claim 11, in which the at least one processor is further configured to visualize at least the extracted data, the analyzed data, or a combination thereof.

13. The apparatus of claim 11, in which the at least one processor is further configured to expand the search terms to include at least misspelling, synonyms, sub-topics, antonyms, or a combination thereof.

14. The apparatus of claim 11, in which the at least one processor is further configured:

to refine the search terms based at least in part on the executed query, and

to monitor for matches to a refined query.

15. The apparatus of claim 11, in which the plurality of data sources include open-source data sources that are publically available and closed-source data sources that at not publically accessible.

16. The apparatus of claim 11, in which the query is a natural language query, and

in which the at least one processor is further configured to translate the query to a system understood language.

17. The apparatus of claim 11, in which the plurality of data sources are pre-defined.

18. The apparatus of claim 11, in which the at least one processor is further configured to deploy extractors to each of specific data source, a number of extractors being dynamic based at least in part on a traffic volume of each specific data source.

19. A computer program product for data analysis, the computer program product comprising:

a non-transitory computer-readable medium having program code recorded thereon, the program code comprising;

program code to generate, via a first user, a query based at least in part on a topic of interest;

program code to expand search terms of the query;

program code to execute the query on a plurality of data sources;

program code to select at least one data source from the plurality of data sources, the at least one data source being selected when results of the query are greater than or equal to an accuracy thresholds;

program code to monitor, based on a set schedule, the at least one data source to extract data from the at least one data source when at least an update to stored data that matches the query, newly added data that matches the query, or a combination thereof; and

program code to establish a communication channel with a second user based at least in part on the data extracted from the at least one monitored data source.

20. The computer program of claim 19, further comprising:

program code to analyze the extracted data;

and

program code to receive feedback from the user based at least in part on the established communication channel.

21. The computer program of claim 19, further comprising:

program code to refine the search terms based at least in part on the executed query, and

program code to monitor for matches to a refined query.