Field weighting in text searching

• US 7,584,221 B2
• Filed: 03/18/2004
• Issued: 09/01/2009
• Est. Priority Date: 03/18/2004
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Taylor, Michael, Larimore, Stefan Isbein, Robertson, Stephen, Zaragoza, Hugo, Petriuc, Mihai
• Primary Examiner(s): Corrielus; Jean M
• Assistant Examiner(s): COLAN, GIOVANNA B
• Application Number:
  US10/804,326
• Publication Number:
  US 20050210006A1
• Time in Patent Office: 1,993 Days
• Field of Search: 704/9, 709/224, 707/102, 707/5, 707/3, 707/201, 707/203, 707/204, 707/10
• US Class Current: 1/1
• CPC Class Codes: G06F 16/313 Selection or weighting of terms for indexing
• CPC Class Codes: G06F 16/38 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: Y10S 707/99952 Coherency, e.g. same view to multiple users

Abstract

A field-weighted search combines statistical information for each term across document fields in a suitably weighted fashion. Both field-specific term frequencies and field and document lengths are considered to obtain a field-weighted document weight for each query term. Each field-weighted document weight can then be combined in order to generate a field-weighted document score that is responsive to the overall query.

Claims

1. A computer-implemented method of determining a field-weighted score for a document having multiple fields relative to a query having a plurality of query terms, the computer-implemented method comprising:

determining fields of the document, wherein each field includes a contextual section of the document based on the document structure;

determining a field weight for each of the determined fields, wherein the field weight corresponds to a number of times for replicating the content of each of the determined fields;

replicating the content of each of the determined fields the number of times indicated by the field weight for each of the determined fields, wherein the replicated content of each field is concatenated into a field set for each of the determined fields;

combining each concatenated field set for each field of the document to generate a virtual document including each concatenated field set for each field of the document;

indexing the virtual document to produce virtual document statistics; and

causing a processor of a computing device to compute the field-weighted score from the virtual document index based on the query.

2. The computer-implemented method of claim 1 wherein the query is associated with a search and the field-weighted score represents a level of relevance of the document to the query.

3. The computer-implemented method of claim 1 wherein each field weight is represented by an integer value and the replicating operation comprises:

generating each field set to include a number of copies of a field of the document, wherein the number of copies equals the integer value.

4. The computer-implemented method of claim 1 wherein the combining operation comprises:

concatenating each field set into the virtual document.

5. The computer-implemented method of claim 1 wherein the computing operation comprises:

computing a field-weighted document weight for each query term in the query from the virtual document statistics.

6. The computer-implemented method of claim 1 wherein causing the processor of the computing device to compute the field-weighted score from the virtual document index based on the query comprises:

computing a field-weighted document weight for each query term in the query from the virtual document statistics; and

computing the field-weighted score based on the field-weighted document weight for each query term.

7. The computer-implemented method of claim 1 further comprising:

ranking the field-weighted score with field-weighted scores of other documents.

8. A computer-readable storage medium having computer executable instructions for determining a field-weighted score for a document having multiple fields relative to a query having a plurality of query terms, the instructions comprising:

determining fields of the document, wherein each field includes a contextual section of the document based on the document structure;

determining a field weight for each of the determined fields, wherein the field weight corresponds to a number of times for replicating the content of each of the determined fields;

replicating the content of each of the determined fields the number of times indicated by the field weight for each of the determined fields, wherein the replicated content of each field is concatenated into a field set for each of the determined fields;

combining each concatenated field set for each field of the document to generate a virtual document including each concatenated field set for each field of the document;

indexing the virtual document to produce a virtual document statistics; and

computing the field-weighted score from the virtual document index based on the query.

9. The computer-readable storage of claim 8 wherein the query is associated with a search and the field-weighted score represents a level of relevance of the document to the query.

10. The computer-readable storage of claim 8 wherein each field weight is represented by an integer value and the replicating operation comprises:

generating each field set to include a number of copies of a field of the document, wherein the number of copies equals the integer value.

11. The computer-readable storage medium of claim 8 wherein the combining operation comprises:

concatenating each field set into the virtual document.

12. The computer-readable storage medium of claim 8 wherein the computing operation comprises:

computing a field-weighted document weight for each query term in the query from the virtual document statistics.

13. The computer-readable storage medium of claim 8 wherein the computing operation comprises:

computing a field-weighted document weight for each query term in the query from the virtual document statistics; and

computing the field-weighted score based on the field-weighted document weight for each query term.

14. The computer-readable storage medium of claim 8 further comprising:

ranking the field-weighted score with field-weighted scores of other documents.

15. A system comprising:

a processor; and

a memory having computer-executable instructions stored thereon, wherein the computer-executable instructions are configured for;

determining fields of the document, wherein each field includes a contextual section of the document based on the document structure;

determining a field weight for each of the determined fields, wherein the field weight corresponds to a number of times for replicating the content of each of the determined fields;

replicating the content of each of the determined fields the number of times indicated by the field weight for each of the determined fields, wherein the replicated content of each field is concatenated into a field set for each of the determined fields;

combining each concatenated field set for each field of the document to generate a virtual document including each concatenated field set for each field of the document;

indexing the virtual document to produce a virtual document statistics; and

computing the field-weighted score from the virtual document index based on the query.

16. The system of claim 15 wherein the query is associated with a search and the field-weighted score represents a level of relevance of the document to the query.

17. The system of claim 15 wherein each field weight is represented by an integer value and the replicating operation comprises:

generating each field set to include a number of copies of a field of the document, wherein the number of copies equals the integer value.

18. The system of claim 15 wherein the combining operation comprises:

concatenating each field set into the virtual document.

19. The system of claim 15 wherein the computing operation comprises:

computing a field-weighted document weight for each query term in the query from the virtual document statistics.

20. The system of claim 15 wherein the computing operation comprises:

computing a field-weighted document weight for each query term in the query from the virtual document statistics; and

computing the field-weighted score based on the field-weighted document weight for each query term.

21. The system of claim 15 further comprising:

ranking the field-weighted score with field-weighted scores of other documents.