Method and system for retrieving confirming sentences

• US 7,194,455 B2
• Filed: 09/19/2002
• Issued: 03/20/2007
• Est. Priority Date: 09/19/2002
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Zhang, Yue, Zhou, Ming, Gao, Jianfeng, Wu, Hua, Huang, Chang-Ning
• Primary Examiner(s): Kindred; Alford
• Assistant Examiner(s): THAI, HANH B
• Application Number:
  US10/247,596
• Publication Number:
  US 20040059718A1
• Time in Patent Office: 1,643 Days
• Field of Search: 707/3, 707/4, 707/6, 704 1- 10, 704/200
• US Class Current: 1/1
• CPC Class Codes: G06F 16/3347 using vector based model
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching

Abstract

A method, computer readable medium and system are provided which retrieve confirming sentences from a sentence database in response to a query. A search engine retrieves confirming sentences from the sentence database in response to the query. IN retrieving the confirming sentences, the search engine defines indexing units based upon the query, with the indexing units including both lemma from the query and extended indexing units associated with the query. The search engine then retrieves a plurality of sentences from the sentence database using the defined indexing units as search parameters. A similarity between each of the plurality of retrieved sentences and the query is determined by the search engine, wherein each similarity is determined as a function of a linguistic weight of a term in the query. The search engine then ranks the plurality of retrieved sentences based upon the determined similarities.

Claims

1. A computer-implemented method of providing to a user sentences from a sentence database, stored on a computing device, in response to a query, the method comprising:

receiving the query;

defining indexing units based upon the query, the indexing units including both lemma from the query and extended indexing units associated with the query;

retrieving a plurality of sentences from the sentence database stored on the computing device using the defined indexing units as search parameters;

determining a similarity between each of the plurality of retrieved sentences and the query, wherein each similarity is determined as a function of a linguistic weight of a term in the query and as a function of a sentence length factor which is an exponential function of a length of a corresponding one of the plurality of retrieved sentences; and

ranking the plurality of retrieved sentences based upon the determined similarities.

2. The method of claim 1, wherein the linguistic weight of the term in the query is a weight assigned to the term in the query as a function of its part of speech.

3. The method of claim 2, wherein determining the similarity between each of the plurality of retrieved sentences and the query further comprises determining each similarity as a function of linguistic weights of a plurality of terms in the query.

4. The method of claim 3, wherein determining the similarity between each of the plurality of retrieved sentences and the query further comprises determining each similarity as a function of vector weights of each of the plurality of terms in the query and linguistic weights of each of the plurality of terms in the query.

5. The method of claim 4, wherein the vector weights of each of the plurality of terms in the query are determined as a function of an occurrence frequency of the respective term in the query.

6. The method of claim 5, wherein the vector weights of each of the plurality of terms in the query are determined as a function of occurrence frequencies of the respective terms in the sentence database.

7. The method of claim 6, wherein determining the similarity between each of the plurality of retrieved sentences and the query further comprises determining the similarity for a particular retrieved sentence as a function of vector weights of each of a plurality of terms in the particular sentence, the vector weights of each of the plurality of terms in the query and the linguistic weights of each of the plurality of terms in the query.

8. The method of claim 7, wherein the vector weights of each of the plurality of terms in the particular retrieved sentence are determined as a function of occurrence frequencies of the respective terms in the particular retrieved sentence.

9. The method of claim 8, wherein the vector weights of each of the plurality of terms in the particular retrieved sentence are determined as a function of occurrence frequencies of the respective terms in the sentence database.

10. The method of claim 9, wherein determining the similarity between each of the plurality of retrieved sentences and the query further comprises determining the similarity for the particular retrieved sentence as a function of inner products of the vector weights of the plurality of terms in the query, the vector weights of the plurality of terms in the particular retrieved sentence, and the linguistic weights of each of the plurality of terms in the query.

11. The method of claim 1, wherein defining the indexing units based upon the query further comprises:

defining the indexing units to include both the lemma from the query and lemma from the query with their corresponding parts of speech.

12. The method of claim 1, wherein defining the indexing units based upon the query further comprises:

defining the indexing units to include both the lemma from the query and phrasal verbs from the query.

13. The method of claim 1, wherein defining the indexing units based upon the query further comprises:

defining the indexing units to include both the lemma from the query and dependency triples corresponding to the query.

14. The method of claim 1, wherein defining the indexing units based upon the query further comprises:

defining the indexing units to include the lemma from the query, lemma from the query with their corresponding parts of speech, phrasal verbs from the query, and dependency triples corresponding to the query.

15. A tangible computer readable medium having computer-executable instructions for performing a method of providing to a user sentences from a sentence database, stored on a computing device, in response to a query, the method having steps comprising:

receiving the query;

defining indexing units based upon the query, the indexing units including both lemma from the query and extended indexing units associated with the query; and

retrieving a plurality of sentences from the sentence database, stored on the computing device, using the defined indexing units as search parameters;

determining a similarity between each of the plurality of retrieved sentences and the query, wherein each similarity is determined as a function of vector weights of each of the plurality of terms in the query and linguistic weights of each of the plurality of terms in the query, and wherein the vector weights of each of the plurality of terms in the query are determined as a function of occurrence frequencies of the respective terms in the sentence database, and wherein each similarity is further determined as a function of a sentence length factor which is an exponential function of a length of a corresponding one of the plurality of retrieved sentences;

ranking the plurality of retrieved sentences based upon the determined similarities; and

outputting to the user sentences from the plurality of retrieved sentences based upon the ranking.

16. A system for retrieving confirming sentences from a sentence database in response to a query, the system comprising:

an input component which receives the query as an input; and

a search engine coupled to the input component, the search engine configured to define indexing units based upon the query, the indexing units including both lemma from the query and extended indexing units associated with the query, the search engine retrieving a plurality of confirming sentences from the sentence database using the defined indexing units as search parameters, the search engine further configured to determine a similarity between each of the plurality of retrieved confirming sentences and the query, wherein each similarity is determined as a function of a sentence length factor which is an exponential function of a length of a corresponding one of the plurality of retrieved sentences, the search engine ranking the plurality of retrieved confirming sentences based upon the determined similarities.

17. The system of claim 16, wherein the search engine is configured to define the indexing units to include both the lemma from the query and lemma from the query with their corresponding parts of speech.

18. The system of claim 16, wherein the search engine is configured to define the indexing units to include both the lemma from the query and phrasal verbs from the query.

19. The system of claim 16, wherein the search engine is configured to define the indexing units to include both the lemma from the query and dependency triples corresponding to the query.

20. The system of claim 16, wherein the search engine is configured to define the indexing units to include the lemma from the query, lemma from the query with their corresponding parts of speech, phrasal verbs from the query, and dependency triples corresponding to the query.