Method and system for retrieving confirming sentences

• US 7,974,963 B2
• Filed: 07/22/2005
• Issued: 07/05/2011
• Est. Priority Date: 09/19/2002
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Joseph R. Kelly
• Inventors: Zhang, Yue, Gao, Jianfeng, Wu, Hua, Huang, Chang-Ning, Zhou, Ming
• Primary Examiner(s): Mofiz; Apu M
• Assistant Examiner(s): Nguyen; Thu Nga
• Application Number:
  US11/187,567
• Publication Number:
  US 20050273318A1
• Time in Patent Office: 2,174 Days
• Field of Search: 707/706
• US Class Current: 707/706
• CPC Class Codes: G06F 16/3347 using vector based model
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching

Abstract

A method, computer readable medium and system are provided which retrieve confirming sentences from a sentence database in response to a query. A search engine retrieves confirming sentences from the sentence database in response to the query. IN retrieving the confirming sentences, the search engine defines indexing units based upon the query, with the indexing units including both lemma from the query and extended indexing units associated with the query. The search engine then retrieves a plurality of sentences from the sentence database using the defined indexing units as search parameters. A similarity between each of the plurality of retrieved sentences and the query is determined by the search engine, wherein each similarity is determined as a function of a linguistic weight of a term in the query. The search engine then ranks the plurality of retrieved sentences based upon the determined similarities.

Claims

1. A system for retrieving confirming sentences from a sentence database in response to a query, the system comprising:

a processor;

computer storage medium having stored thereon computer executable instructions for configuring the processor to implement system components comprising;

an input component which receives the query as an input; and

a search engine coupled to the input component, the search engine comprising;

a retrieval component retrieving a plurality of confirming sentences from the sentence database in response to the query; and

a ranking component determining a similarity score for each respective confirming sentences of the plurality of retrieved confirming sentences relative to the query, wherein the similarity score for each respective confirming sentence is based on a plurality of factors, including a length factor calculated by determining a sentence length value corresponding to a length of the respective confirming sentence and applying the sentence length value to an exponential function, and wherein at least one of the plurality of factors comprises linguistic weights of a plurality of terms in the query, the linguistic weight of each term in the query comprising a weight assigned to the term in the query as a function of its part of speech; and

wherein the ranking component determines the similarity score of the respective confirming sentence as a function of vector weights of each of a plurality of terms in the respective confirming sentence, vector weights of each of the plurality of terms in the query, and the linguistic weight of the plurality of terms in the query; and

wherein the ranking component ranks the plurality of retrieved confirming sentences based upon the determined similarity scores.

2. The system of claim 1, wherein the vector weights of each of the plurality of terms in the respective confirming sentence or of the plurality of terms of the query are functions of occurrence frequencies of the respective terms in the respective confirming sentence or in the query.

3. The system of claim 2, wherein the vector weights of each of the plurality of terms in the respective confirming sentence or of the plurality of terms of the query are functions of occurrence frequencies of the respective terms in the sentence database.

4. The system of claim 1, wherein the retrieval component is retrieves the plurality of confirming sentences by determining extended indexing units from the query, and searching the sentence database using the extended indexing units as search terms.

5. A method of providing to a user confirming sentences from a sentence database in response to a query using a computer with a processor, the method comprising:

using the processor to retrieve a plurality of confirming sentences from the sentence database in response to the query;

using the processor to determine a similarity score for each respective confirming sentence of the plurality of retrieved confirming sentences relative to the query, the similarity score for each respective confirming sentence being determined based on a plurality of factors, wherein at least one of the plurality of factors is a length factor calculated by determining a sentence length value corresponding to the respective confirming sentence and applying the sentence length value to an exponential function, and wherein at least one of the plurality of factors comprises linguistic weights of a plurality of terms in the query, the linguistic weight of each of the plurality of terms in the query comprising a weight assigned to the term in the query as a function of its part of speech, and wherein using the processor to determine the similarity score for the respective confirming sentence comprises using the processor to determine a function of vector weights of each of a plurality of terms in the respective confirming sentence, vector weights of each of the plurality of terms in the query, and the linguistic weights of the plurality of terms in the query; and

using the processor to rank the plurality of retrieved confirming sentences based upon the determined similarity scores.

6. The method of claim 5, wherein the vector weights of each of the plurality of terms in the query are determined as a function of an occurrence frequency of the respective term in the query.

7. The method of claim 6, wherein the vector weights of each of the plurality of terms in the query are determined as a function of occurrence frequencies of the respective terms in the sentence database.

8. The method of claim 7, wherein the vector weights of each of the plurality of terms in the respective confirming sentence are determined as a function of occurrence frequencies of the respective terms in the respective confirming sentence.

9. The method of claim 8, wherein the vector weights of each of the plurality of terms in the respective confirming sentence are determined as a function of occurrence frequencies of the respective terms in the sentence database.

10. The method of claim 9, wherein using the processor to determine the similarity scores for each of the plurality of retrieved confirming sentences relative to the query further comprises using the processor to determine a function of inner products of the vector weights of the plurality of terms in the query, the vector weights of the plurality of terms in the respective confirming sentence, and the linguistic weights of each of the plurality of terms in the query.

11. The method of claim 10, wherein using the processor to retrieve the plurality of confirming sentences further includes using the processor to determine extended indexing units from the query, and using the processor to search the sentence database using the extended indexing units as search terms.