GENERATING A TAXONOMY FROM UNSTRUCTURED INFORMATION

• US 20130232147A1
• Filed: 10/29/2010
• Published: 09/05/2013
• Est. Priority Date: 10/29/2010
• Status: Abandoned Application

• Current Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Original Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Inventors: Mehra, Pankaj, Ulanov, Alexander, Simanovsky, Andrey
• Application Number:
  US13/879,427
• Publication Number:
  US 20130232147A1
• Time in Patent Office: Days
• US Class Current: 707/737
• CPC Class Codes: G06F 16/35 Clustering; Classification
• CPC Class Codes: G06F 16/36 Creation of semantic tools, e.g. ontology or thesauri

Abstract

At least one term is extracted [202] from unstructured information. The at least one term is validated [204]. Then, a sense of the at least one extracted and validated term is determined [206]. The at least one extracted and validated term is clustered [208] into at least one group of terms according to the determined sense. A taxonomy is generated [210] based on the clustering and a mining of accessible taxonomies.

Claims

1. A method [200A] for generating a taxonomy from unstructured information, said method comprising:

extracting [202] at least one term from unstructured information [122];

validating [204] said at least one term [124];

determining [206] a sense of at least one extracted and validated term [108];

clustering [208] said at least one extracted and validated term [108] into at least one group [112] of terms according to said determined sense; and

generating [210] a taxonomy [120] based on said clustering and a minin of accessible taxonomies.

2. The method [200A] of claim 1, further comprising:

assigning [212] a probability value to said at least one group [112] of terms.

3. The method [200A] of claim 1, wherein said determining [206] a sense of at least one extracted and validated term comprises:

determining a shared sense of a first set of said at least one extracted and validated term[108] that is unambiguous.

4. The method [200A] of claim 3, further comprising:

based on a determined shared sense, disambiguating a second set of said at least one extracted and validated term [108] that is ambiguous.

5. The method [200A] of claim 1, wherein said validating [204] at least one term [124] comprises:

estimating a probability of a co-occurrence of said at least one extracted term, based on at least one language model.

6. The method [200A] of claim 1, wherein said validating [204] at least one term [124] comprises:

estimating a probability that a first term of said at least one extracted term is related to a second term of said at least one extracted term and belongs to a domain.

7. The method [200A] of claim 1, wherein said generating [210] a taxonomy based on said clustering and a mining of taxonomies comprises:

generating said taxonomy [120] that is in a human readable format.

8. The method [200A] of claim 1, wherein said generating [210] a taxonomy [120] based on said clustering and a mining of taxonomies comprises:

generating said taxonomy [120] that is in a computer readable format.

9. The method [200A] of claim 1, wherein said clustering [208] said at least one extracted and validated term [108] into at least one group [112] of terms according to said determining [206] said sense comprises:

grouping together terms with shared hypernyms.

10. The method [200A] of claim 1, wherein said clustering [208] said at least one extracted and validated term [108] into at least one group [112] of terms according to said determining [206] said sense comprises:

grouping synonymous terms into synonym rings.

11. The method [200A] of claim 1, wherein said clustering [208] said at least one extracted and validated term [108] into at least one group [112] of terms according to said determining [206] said sense comprises:

grouping together terms with shared senses.

12. A system [100] comprising:

a term extractor [104] configured for extracting at least one term [124] from unstructured information [122];

a term validater [106] configured for validating said at least one term [124];

a sense determiner [126] configured for determining a sense of at least one extracted and validated term [108];

a term clusterer [110] configured for clustering said at least one extracted and validated term [108] into at least one group [112] of terms according to a determined sense; and

a taxonomy generator [118] configured for generating a taxonomy [120] based on said clustering and a mining of taxonomies [102].

13. The system [100] of claim 12, wherein said sense determiner [126] comprising:

a shared sense determiner [114] configured for determining a shared sense of a first set of said at least one extracted and validated term [108] that is unambiguous; and

a term disambiguater [116] configured for, based on a determined shared sense, disambiguating a second set of said at least one extracted and validated term [108] that is ambiguous.

14. The system [100] of claim 12, wherein said unstructured formation [122] is a document comprising text.

15. A non-transitory computer-readable storage medium comprising instructions stored thereon which, when executed by a computer system, cause said computer system to perform a method [200B] for generating a taxonomy from unstructured information [122], said method comprising:

extracting [214] at least one term [124] from unstructured information [122];

validating [216] said at least one term [124];

determining [218] a sense of at least one extracted and validated term [108], said determining comprising;

determining a shared sense of a first set of said at least one extracted and validated term [108] that is unambiguous; and

based on a determined shared sense, disambiguating a second set of said at least one extracted and validated term [108] that is ambiguous;

clustering [220] said at least one extracted and validated term [108] into at least one group of terms according to said determined sense; and

generating [222] a taxonomy [120] based on said clustering and a mining of taxonomies.