Method and system for retrieving confirming sentences

• US 20050273318A1
• Filed: 07/22/2005
• Published: 12/08/2005
• Est. Priority Date: 09/19/2002
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Zhang, Yue, Zhou, Ming, Gao, Jianfeng, Wu, Hua, Huang, Chang-Ning
• Granted Patent: US 7,974,963 B2
• Time in Patent Office: Days
• US Class Current: 704/10
• CPC Class Codes: G06F 16/3347 using vector based model
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching

Abstract

A method, computer readable medium and system are provided which retrieve confirming sentences from a sentence database in response to a query. A search engine retrieves confirming sentences from the sentence database in response to the query. IN retrieving the confirming sentences, the search engine defines indexing units based upon the query, with the indexing units including both lemma from the query and extended indexing units associated with the query. The search engine then retrieves a plurality of sentences from the sentence database using the defined indexing units as search parameters. A similarity between each of the plurality of retrieved sentences and the query is determined by the search engine, wherein each similarity is determined as a function of a linguistic weight of a term in the query. The search engine then ranks the plurality of retrieved sentences based upon the determined similarities.

Claims

1-17. -17. (canceled)

18. A method of providing to a user confirming sentences from a sentence database in response to a query, the method comprising:

retrieving a plurality of confirming sentences from the sentence database in response to the query;

determining a similarity between each of the plurality of retrieved confirming sentences and the query, wherein each similarity is determined as a function of a linguistic weight of a term in the query; and

ranking the plurality of retrieved confirming sentences based upon the determined similarities.

19. The method of claim 18, wherein the linguistic weight of the term in the query is a weight assigned to the term in the query as a function of its part of speech.

20. The method of claim 19, wherein determining the similarity between each of the plurality of retrieved confirming sentences and the query further comprises determining each similarity as a function of linguistic weights of a plurality of terms in the query.

21. The method of claim 20, wherein determining the similarity between each of the plurality of retrieved confirming sentences and the query further comprises determining each similarity as a function of vector weights of each of the plurality of terms in the query and linguistic weights of each of the plurality of terms in the query.

22. The method of claim 21, wherein the vector weights of each of the plurality of terms in the query are determined as a function of an occurrence frequency of the respective term in the query.

23. The method of claim 22, wherein the vector weights of each of the plurality of terms in the query are determined as a function of occurrence frequencies of the respective terms in the sentence database.

24. The method of claim 23, wherein determining the similarity between each of the plurality of retrieved confirming sentences and the query further comprises determining the similarity for a particular confirming sentence as a function of vector weights of each of a plurality of terms in the particular confirming sentence, the vector weights of each of the plurality of terms in the query and the linguistic weights of each of the plurality of terms in the query.

25. The method of claim 24, wherein the vector weights of each of the plurality of terms in the particular confirming sentence are determined as a function of occurrence frequencies of the respective terms in the particular confirming sentence.

26. The method of claim 25, wherein the vector weights of each of the plurality of terms in the particular confirming sentence are determined as a function of occurrence frequencies of the respective terms in the sentence database.

27. The method of claim 26, wherein determining the similarity between each of the plurality of retrieved confirming sentences and the query further comprises determining the similarity for the particular confirming sentence as a function of inner products of the vector weights of the plurality of terms in the query, the vector weights of the plurality of terms in the particular confirming sentence, and the linguistic weights of each of the plurality of terms in the query.

28. The method of claim 18, wherein each similarity is further determined as a function of a sentence length factor corresponding to a length of a corresponding one of the plurality of confirming sentences.

29. The method of claim 28, wherein the sentence length factor is a function of the length of the corresponding one of the plurality of confirming sentences.

30. The method of claim 29, wherein the sentence length factor is an exponential function of the length of the corresponding one of the plurality of confirming sentences.

31. The method of claim 18, wherein retrieving the plurality of confirming sentences further includes determining extended indexing units from the query, and searching the sentence database using the extended indexing units as search terms.

32. A computer-readable medium having computer-executable instructions for performing steps of claim 18.

33-45. -45. (canceled)

46. A system for retrieving confirming sentences from a sentence database in response to a query, the system comprising:

an input component which receives the query as an input; and

a search engine coupled to the input component, the search engine comprising;

a retrieval component configured to retrieve a plurality of confirming sentences from the sentence database in response to the query; and

a ranking component configured to determine a similarity between each of the plurality of retrieved confirming sentences and the query, wherein each similarity is determined as a function of a linguistic weight of a term in the query, the ranking component further configured to rank the plurality of retrieved confirming sentences based upon the determined similarities.

47. The system of claim 46, wherein the linguistic weight of the term in the query is a weight assigned to the term in the query as a function of its part of speech.

48. The system of claim 47, wherein the ranking component is configured to determine the similarity between each of the plurality of retrieved confirming sentences and the query by determining each similarity as a function of linguistic weights of a plurality of terms in the query.

49. The system of claim 48, wherein the ranking component is configured to determine the similarity between a particular retrieved confirming sentence and the query as a function of vector weights of each of a plurality of terms in the particular confirming sentence, vector weights of each of the plurality of terms in the query and the linguistic weights of each of the plurality of terms in the query.

50. The system of claim 49, wherein the vector weights of each of the plurality of terms in the particular confirming sentence or of the plurality of terms of the query are functions of occurrence frequencies of the respective terms in the particular confirming sentence or in the query.

51. The system of claim 50, wherein the vector weights of each of the plurality of terms in the particular confirming sentence or of the plurality of terms of the query are functions of occurrence frequencies of the respective terms in the sentence database.

52. The system of claim 46, wherein the ranking component is further configured to determine each similarity as a function of a sentence length factor corresponding to a length of a corresponding one of the plurality of confirming sentences.

53. The system of claim 52, wherein the ranking component is further configured to determine each similarity as a function of an exponential function of the length of the corresponding one of the plurality of confirming sentences.

54. The system of claim 53, wherein the retrieval component is configured to retrieve the plurality of confirming sentences by determining extended indexing units from the query, and searching the sentence database using the extended indexing units as search terms.

55-73. -73. (canceled)