DETERMINING SYNONYM-ANTONYM POLARITY IN TERM VECTORS

• US 20140067368A1
• Filed: 08/29/2012
• Published: 03/06/2014
• Est. Priority Date: 08/29/2012
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Yih, Wen-tau, Zweig, Geoffrey G., Platt, John C.
• Application Number:
  US13/597,277
• Publication Number:
  US 20140067368A1
• Time in Patent Office: Days
• US Class Current: 704/9
• CPC Class Codes: G06F 16/3338 Query expansion
• CPC Class Codes: G06F 40/247 Thesauruses; Synonyms
• CPC Class Codes: G06F 40/30 Semantic analysis

Abstract

A document-term matrix may be generated based on a corpus. A term representation matrix may be generated based on modifying a plurality of elements of the document-term matrix based on antonym information included in the corpus. Similarities may be determined based on a plurality of elements of the term representation matrix.

Claims

1. A system comprising:

a term relationship manager tangibly embodied via executable instructions stored on a computer-readable storage medium, the term relationship manager including;

an initial model generator configured to generate an initial document-term matrix based on a thesaurus;

a term representation generator configured to generate a term representation matrix based on modifying a plurality of elements of the initial document-term matrix based on antonym information associated with the plurality of elements of the initial document-term matrix, based on latent semantic analysis.

2. The system of claim 1, further comprising:

a polarity inducing component configured to determine polarity indicators associated with a group of indicated terms included in the initial document-term matrix, each of the indicated terms having an associated set of synonym terms representing synonyms to the respective associated indicated term, and an associated set of antonym terms representing antonyms to the respective associated indicated term, wherein the determined polarity indicators include;

a first set of term polarity indicators assigned to the indicated terms and their respective associated set of synonym terms, and

a second set of term polarity indicators assigned to each respective set of antonym terms associated with each respective indicated term,

wherein the first set of term polarity indicators represent a synonymy polarity that is opposite to an antonymy polarity represented by the second set of term polarity indicators.

4. The system of claim 1, wherein:

the term representation generator is configured to generate the term representation matrix based on an approximation of the initial document-term matrix based on latent semantic analysis, wherein

the term representation matrix is of substantially lower rank than the initial document-term matrix.

5. The system of claim 4, wherein:

the term representation generator is configured to generate the term representation matrix based on one or more of;

an approximation with singular value decomposition, or

an approximation with eigen-decomposition on a corresponding covariance matrix.

6. The system of claim 1, further comprising:

a term similarity determination component configured to determine, via a device processor, term similarities based on a plurality of elements of the term representation matrix.

7. The system of claim 6, wherein:

the term similarity determination component is configured to determine a measure of similarity between pairs of terms included in the thesaurus based on one or more of;

generating a cosine score of corresponding column vectors included in the term representation matrix that correspond to respective terms included in the pairs, or

generating a cosine score of corresponding row vectors included in the term representation matrix that correspond to respective terms included in the pairs.

8. The system of claim 1, wherein:

the initial model generator is configured to generate the initial document-term matrix based on determining respective weight values for each element of the initial document-term matrix, based on one or more of;

a term-frequency function, or

a term frequency times inverse document frequency (TF-IDF) function.

9. The system of claim 1, further comprising:

a term acquisition component configured to obtain a query term; and

a term substitution component configured to determine a substitute representation for the query term, if the query term is not included in the thesaurus, wherein the term substitution component determines the substitute representation for the query term based on one or more of;

a morphological variation of the query term,

a stemmed version of the query term, or

a context vector representing the query term, wherein the context vector is generated based on a corpus that includes terms that are not included in the thesaurus.

3. The system of claim Error! Reference source not found., wherein:

each of the term polarity indicators in the second set of term polarity indicators includes a negated numeric sign relative to a numeric sign of the term polarity indicators in the first set of term polarity indicators.

10. A method comprising:

generating a document-term matrix based on a corpus;

generating, via a device processor, a term representation matrix based on modifying a plurality of elements of the document-term matrix based on antonym information included in the corpus; and

determining similarities based on a plurality of elements of the term representation matrix.

11. The method of claim 10, wherein:

the corpus includes a thesaurus, wherein

the document-term matrix includes one or more of;

matrix rows of elements that represent groups of terms that are included in thesaurus entries, or

matrix columns of elements that represent groups of terms that are included in thesaurus entries.

12. The method of claim 10 wherein:

modifying the plurality of elements of the document-term matrix includes;

determining that a first term in the corpus is related as an antonym to a second term in the corpus;

assigning a positive polarity value to the first term for inclusion in the document-term matrix; and

assigning a negative polarity value to the second term, relative to the positive polarity value of the first term, for inclusion in the document-term matrix, wherein

the similarities include similarity values between pairs of terms that are represented in the term representation matrix.

13. The method of claim 10 wherein:

generating the term representation matrix includes generating the term representation matrix based on an approximation of the document-term matrix with latent semantic analysis, wherein the term representation matrix is of substantially lower rank than the document-term matrix.

14. The method of claim 10 wherein:

determining the similarities includes determining term similarities between pairs of terms included in the term representation matrix, based on one or more of;

generating a cosine score of corresponding column vectors included in the term representation matrix that correspond to respective terms included in the pairs of terms, or

generating a cosine score of corresponding row vectors included in the term representation matrix that correspond to respective terms included in the pairs of terms.

15. The method of claim 10, further comprising:

obtaining a query term; and

determining an alternative representation for the query term, if the query term is not included in the term representation matrix, wherein the alternative representation is determined based on one or more of;

a morphological variation of the query term, or

a stemmed version of the query term.

16. The method of claim 10, further comprising:

obtaining a query term; and

determining an alternative representation for the query term, if the query term is not included in the term representation matrix, wherein the alternative representation is determined based on generating a context vector representing the query term, based on a term collection that includes terms that are not included in the corpus.

17. The method of claim 16, further comprising:

embedding the query term in a corpus space based on a context vector space associated with the context vector, based on one or more of;

a k-nearest neighbors determination, or

linear regression.

18. A computer program product tangibly embodied on a computer-readable storage medium and including executable code that causes at least one data processing apparatus to:

obtain a first term that is included in a vocabulary;

determine an antonym associated with the first term, based on accessing a first polarity indicator associated with the first term in a term co-occurrence matrix and a second polarity indicator associated with the antonym in the term co-occurrence matrix.

19. The computer program product of claim 18, wherein:

the second polarity indicator includes a negated numeric sign relative to a numeric sign of the first polarity indicator, wherein

the term co-occurrence matrix includes a document-term matrix.

20. The computer program product of claim 18, wherein the executable code is configured to cause the at least one data processing apparatus to:

determine an initial term co-occurrence matrix based on a thesaurus that includes a plurality of thesaurus terms included in the vocabulary, a group of the thesaurus terms each having at least one antonym term included in the initial term co-occurrence matrix;

determine a first set of term polarity indicators associated with each of the thesaurus terms included in the group, relative to the respective antonym terms that are associated with the respective thesaurus terms included in the group;

determine a second set of term polarity indicators associated with each of the respective antonym terms that are associated with the respective thesaurus terms included in the group; and

generate a term representation matrix based on an approximation of the initial term co-occurrence matrix, wherein the term representation matrix is of substantially lower rank than the initial term co-occurrence matrix, and the term representation matrix includes the determined first and second sets of term polarity indicators associated with each respective thesaurus term and associated antonym term, wherein

the determined first and second sets of term polarity indicators include the first and second polarity indicators.