System and method for cross-cloud identification of topics

• US 10,387,474 B2
• Filed: 10/06/2016
• Issued: 08/20/2019
• Est. Priority Date: 10/07/2015
• Status: Active Grant

• Current Assignee: Harmon.ie R&d Ltd. (Harmon.ie, Inc.)
• Original Assignee: Harmon.ie R&d Ltd. (Harmon.ie, Inc.)
• Inventors: Sheinfeld, Roy
• Primary Examiner(s): Spieler, William
• Application Number:
  US15/286,953
• Publication Number:
  US 20170103077A1
• Time in Patent Office: 1,048 Days
• CPC Class Codes: G06F 16/355 Class or cluster creation or modification

Abstract

A system and method for identifying topics in unstructured data. The method includes obtaining unstructured data from at least one data source, wherein the obtained unstructured data includes at least one unstructured data object; determining, based on the obtained unstructured data, at least one set of topic identification rules; identifying, based on the at least one unstructured data object and the at least one set of topic identification rules, at least one candidate topic of the unstructured data; and analyzing the unstructured data with respect to the at least one candidate topic to determine at least one representative topic from among the at least one candidate topic, wherein each of the at least one representative topic indicates a context of at least a portion of the unstructured data.

Claims

1. A method for identifying topics in unstructured data, the method being performed by a computer system, the method comprising:

obtaining unstructured data from at least one data source, wherein the obtained unstructured data includes at least one unstructured data object;

determining, based on the obtained unstructured data, at least one set of topic identification rules;

identifying, based on the at least one unstructured data object and the at least one set of topic identification rules, at least one candidate topic of the unstructured data; and

analyzing the unstructured data with respect to the at least one candidate topic to determine at least one representative topic from among the at least one candidate topic, wherein each of the at least one representative topic indicates a context of at least a portion of the unstructured data.

2. The method of claim 1, further comprising:

monitoring the at least one data source, wherein the unstructured data is obtained based on the monitoring.

3. The method of claim 1, further comprising:

obtaining metadata associated with the obtained unstructured data, wherein the at least one candidate topic is identified further based on the metadata.

4. The method of claim 1, wherein identifying at least one candidate topic of the unstructured data further comprises:

determining a type of each unstructured data object, wherein the at least one set of topic identification rules is determined further based on the determined unstructured data object types.

5. The method of claim 4, wherein determining a type of each unstructured data object further comprises:

partitioning each unstructured data object into a plurality of portions; and

identifying, for each unstructured data object, a type of each portion, wherein the type of the unstructured data object is determined further based on the identified portion types.

6. The method of claim 1, wherein analyzing the unstructured data further comprises:

correlating among the unstructured data, wherein the at least one representative topic is determined based on the correlation.

7. The method of claim 1, further comprising:

storing, in a database, the at least one representative topic; and

associating each representative topic with at least one of the at least one unstructured data object.

8. The method of claim 7, further comprising:

receiving a search query;

matching the received query to at least the stored one of the determined representative topics; and

returning, as part of search results supplied in response to the received query, at least the at least one unstructured data object associated with the matched stored representative topic.

9. The method of claim 8 wherein the received search query includes at least one topic and wherein the topic of the received query is matched to at least one of the determined representative topics.

10. The method of claim 1, further comprising:

receiving a search query;

matching the received query to at least one of the determined representative topics;

identifying at least one of the at least one unstructured data object that is associated with the matched determined representative topic; and

returning at least the identified at least one unstructured data object as part of search results supplied in response to the received search query.

11. The method of claim 10 wherein the received search query includes at least one topic and wherein the matching step matches the topic of the received query to at least one of the determined representative topics.

12. A non-transitory computer readable medium having stored thereon instructions for causing one or more processing units to execute a method, the method comprising:

obtaining unstructured data from at least one data source, wherein the obtained unstructured data includes at least one unstructured data object;

determining, based on the obtained unstructured data, at least one set of topic identification rules;

identifying, based on the unstructured data and the at least one set of topic identification rules, at least one candidate topic of the unstructured data; and

analyzing the unstructured data with respect to the at least one candidate topic to determine at least one representative topic from among the at least one candidate topic, wherein each of the at least one representative topic indicates a context of at least a portion of the unstructured data.

13. A system for identifying topics in unstructured data, comprising:

a processing circuitry; and

a memory, the memory containing instructions that, when executed by the processing circuitry, configure the system to;

obtain unstructured data from at least one data source, wherein the obtained unstructured data includes at least one unstructured data object;

determine, based on the obtained unstructured data, at least one set of topic identification rules;

identify, based on the at least one unstructured data object and the at least one set of topic identification rules, at least one candidate topic of the unstructured data; and

analyze the unstructured data with respect to the at least one candidate topic to determine at least one representative topic from among the at least one candidate topic, wherein each of the at least one representative topic indicates a context of at least a portion of the unstructured data.

14. The system of claim 13, wherein the system is further configured to:

monitor the at least one data source, wherein the unstructured data is obtained based on the monitoring.

15. The system of claim 13, wherein the system is further configured to:

obtain metadata associated with the obtained unstructured data, wherein the at least one candidate topic is identified further based on the metadata.

16. The system of claim 13, wherein the system is further configured to:

determine a type of each unstructured data object, wherein the at least one set of topic identification rules is determined further based on the determined unstructured data object types.

17. The system of claim 16, wherein the system is further configured to:

partition each unstructured data object into a plurality of portions; and

identify, for each unstructured data object, a type of each portion, wherein the type of the unstructured data object is determined further based on the identified portion types.

18. The system of claim 17, wherein the system is further configured to:

correlate among the unstructured data, wherein the at least one representative topic is determined based on the correlation.

19. The system of claim 13, wherein the system is further configured to:

store, in a database, the at least one representative topic; and

associate each representative topic with at least one of the at least one unstructured data object.

20. The system of claim 13, wherein the system is further configured to:

receive a search query;

match the received query to at least one of the determined representative topics;

identify at least one of the at least one unstructured data object that is associated with the matched determined representative topic; and

return at least the identified at least one unstructured data object as part of search results supplied in response to the received search query.