DETERMINING RELEVANCE OF A DOCUMENT TO A QUERY BASED ON SPANS OF QUERY TERMS

• US 20090182734A1
• Filed: 01/09/2009
• Published: 07/16/2009
• Est. Priority Date: 10/26/2005
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Ma, Wei-Ying, Wen, Ji-Rong, Song, Ruihua
• Application Number:
  US12/351,765
• Publication Number:
  US 20090182734A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/334 Query execution G06F16/335 takes precedence
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: Y10S 707/99931 Database or file accessing
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99934 Query formulation, input preparation, or translation
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access

Abstract

A relevance system determines the relevance of a query term to a document based on spans within the document that contain the query term. The relevance system aggregates the relevance of the query terms into an overall relevance for the document. For each query term, the relevance system calculates a span relevance for each span that contains that query term. The relevance system then aggregates the span relevances for a query term into a query term relevance for that document. The relevance system may aggregate the query term relevances into a document relevance.

Claims

1. A method in a computer system with a processor and a memory for determining relevance of documents to a query, the method comprising:

receiving from a user a query having query terms;

for each of a plurality of documents,

identifying spans of query terms within the document, each identified span including at least two query terms and having a span width indicating distance between the query terms of the span, wherein the distance between the query terms is based on number of terms between the query terms, and wherein a span has a span width that is less than a threshold span width;

for each identified span, calculating a span relevance based on the span width of the span;

for each query term, calculating a query term relevance for the query term based on the span relevance for each span that includes the query term; and

aggregating the calculated query term relevances for the query term into a document relevance indicating relevance of the document to the received query; and

displaying an indication of the documents in an order based on the document relevances of the documents to the received query.

2. The method of claim 1 wherein the identifying of spans includes identifying spans of query terms wherein a span includes no repeated occurrences of a query term and wherein a distance between adjacent query terms within a span is less than a threshold distance.

3. The method of claim 2 wherein a span includes a repeated occurrence of a query term that is closest to a query term of the span.

4. The method of claim 1 wherein the relevance for the query term for a span is calculated based on the following:

$f<br><br>\left(t,{\mathrm{espan}}_i\right)=\frac{n_i^y}{{\mathrm{Width}<br><br>\left({\mathrm{espan}}_i\right)}^x}$

where t is a query term, espan_i is a span that contains t, n_i is the number of query terms that occur in espan_i, Width(espan_i) is the span width of espan_i, x is an exponent that is used to control the influence of the span width, and y is an exponent that is used to control the influence of the number of query terms in the span.

5. The method of claim 1 wherein the aggregating includes summing the calculated relevance for the query term for each span.

6. The method of claim 1 including replacing a term frequency with the aggregated relevance in an equation for calculating relevance of a document to a query.

7. The method of claim 6 wherein the equation before replacing is based on term frequency and inverse document frequency.

8. The method of claim 6 wherein term frequency is not used to calculate relevance.

9. The method of claim 1 wherein the document is a web page.

10. A computer-readable storage medium containing instructions for controlling a computer system to identify spans of query terms of a query within a document of terms for use in determining relevance of the document to the query, by a method comprising:

identifying query terms within the document;

identifying sequences of query terms within the document wherein a sequence includes at least two query terms such that a distance between the query terms is less than a threshold distance, the distance between the query terms is based on number of terms between the query terms and wherein a sequence is a span of query terms; and

calculating relevance of the document to the query based on the identified sequences of query terms.

11. The computer-readable medium of claim 10 wherein a distance between adjacent query terms within a sequence is less than a threshold distance.

12. The computer-readable medium of claim 11 wherein the distance between two query terms is based on the number of non-query terms between the two query terms.

13. The computer-readable medium of claim 10 wherein when a sequence of query terms is adjacent to two occurrences of the same query term, including within the sequence the query term that is closest to a query term of the sequence.

14. The computer-readable medium of claim 10 including calculating a relevance of query terms based on the following:

$f<br><br>\left(t,{\mathrm{espan}}_i\right)=\frac{n_i^y}{{\mathrm{Width}<br><br>\left({\mathrm{espan}}_i\right)}^x}$

where t is a query term, espan_i is a span that contains t, n_i, is the number of query terms that occur in espan_i, Width(espan_i) is the span width of espan_i, x is an exponent that is used to control the influence of the span width, and y is an exponent that is used to control the influence of the number of query terms in the span.

15. A method in a computer system with a processor and a memory for calculating relevance of a document of terms to a query of query terms, the method comprising:

identifying spans of query terms within the document, a span comprising terms of the document that includes multiple query terms of the query and having a span width that is based on number of non-query terms of the span;

calculating a relevance contribution of each query term based on the identified spans that contain the query term;

determining relevance of the document to the query based on the calculated relevance contributions without using term frequency; and

outputting an indication of the determined relevance of the document to the query.

16. The method of claim 15 wherein the identifying of spans includes identifying sequences of query terms wherein a sequence includes no repeated occurrences of a query term and wherein at least one sequence includes at least three query terms.

17. The method of claim 16 wherein a distance between adjacent query terms within a sequence is less than a threshold distance.

18. The method of claim 15 wherein the calculating of the relevance contribution of a query term includes calculating relevance of the query term resulting from a span based on the following:

$f<br><br>\left(t,{\mathrm{espan}}_i\right)=\frac{n_i^y}{{\mathrm{Width}<br><br>\left({\mathrm{espan}}_i\right)}^x}$

where t is a query term, espan_i is a span that contains t, n_i is the number of query terms that occur in espan_i, Width(espan_i) is the span width of espan_i, x is an exponent that is used to control the influence of the span width, and y is an exponent that is used to control the influence of the number of query terms in the span.

19. The method of claim 15 wherein the determining of relevance is based on an equation that uses inverse document frequency.

20. The method of claim 19 wherein term frequency within the equation is replaced with the calculated relevance contribution.