System and method for labeling a document

• US 7,680,760 B2
• Filed: 10/28/2005
• Issued: 03/16/2010
• Est. Priority Date: 10/28/2005
• Status: Expired due to Fees

• Current Assignee: R2 Solutions LLC (Acacia Research Corporation)
• Original Assignee: Yahoo! Inc. (Apollo Global Management, Inc.)
• Inventors: Joshi, Deepa, Davies, Winton
• Primary Examiner(s): Mahmoudi; Tony
• Assistant Examiner(s): Uddin; Md. I
• Application Number:
  US11/261,981
• Publication Number:
  US 20070100813A1
• Time in Patent Office: 1,600 Days
• Field of Search: 707/205, 707/2, 707/3, 707/4, 707/5, 707/6, 707/204, 715/254, 706/12
• US Class Current: 707/758
• CPC Class Codes: G06F 16/313 Selection or weighting of terms for indexing
• CPC Class Codes: G06F 16/93 Document management systems

Abstract

A system and method for selecting a proxy keyword for an unknown document. An unknown document is received by a receiver. A plurality of candidate documents and corresponding keywords are determined for the unknown document. Using the keywords from the candidate documents, proxy keywords are determined for the unknown document based on a plurality of factors including a length of the keywords, a distance of the candidate documents from the unknown document, a similarity of the text between the unknown document and the respective candidate document, a rank of the keywords within each candidate document, and a frequency of the keyword within its respective candidate document.

Claims

1. A computerized method for selecting a proxy keyword for a document, the method comprising:

receiving an unknown document;

electronically determining, using a processing device, at least a first candidate document from the world wide web for the unknown document on the basis of a search of one or more valued search terms;

determining at least a first keyword for the first candidate document;

electronically determining, using the processing device, at least a second candidate document from the world wide web for the unknown document on the basis of a search of one or more valued search terms;

determining at least a second keyword for the second candidate document;

electronically determining, using the processing device, a proxy keyword for the unknown document based on the first and second keywords; and

wherein the first candidate document and the second candidate document are documents which are most similar to the unknown document.

2. The method as recited in claim 1, wherein the determining a proxy keyword includes:

determining a first distance from the first candidate document to the unknown document;

determining a second distance from the second candidate document to the unknown document; and

using the first and second distances to determine the proxy keyword.

3. The method as recited in claim 1, wherein the determining a proxy keyword includes:

determining a first length of the first keyword;

determining a second length of the second keyword; and

using the first and second lengths to determine the proxy keyword.

4. The method as recited in claim 1, further comprising:

determining at least a third keyword for the first candidate document, the first and third keywords being in a first order;

determining at least a fourth keyword for the second candidate document, the second and fourth keywords being in a second order; and

wherein

the determining a proxy keyword for the unknown document is based on the first and second order.

5. The method as recited in claim 4, wherein:

the first order is based on a frequency in which the first and third keywords occur in the unknown document; and

the second order is based on a frequency in which the second and fourth keywords occur in the second document.

6. The method as recited in claim 1, wherein the determining a proxy keyword for the unknown document is based on a percentage of text matching between the first keyword and the unknown document, and based on a percentage of text matching between the second keyword and the unknown document.

7. The method as recited in claim 6, wherein the determining a proxy keyword includes:

determining a first distance from the first candidate document to the unknown document;

determining a second distance from the second candidate document to the unknown document; and

using the first and second distances to determine the proxy keyword.

8. The method as recited in claim 7, wherein the determining a proxy keyword includes:

determining a first length of the first keyword;

determining a second length of the second keyword; and

using the first and second lengths to determine the proxy keyword.

9. The method as recited in claim 8, further comprising:

determining at least a third keyword for the first candidate document, the first and third keywords being in a first order;

determining at least a fourth keyword for the second candidate document, the second and fourth keywords being in a second order; and

wherein

the determining a proxy keyword for the unknown document is based on the first and second order.

10. The method as recited in claim 1, wherein the receiving the unknown document including crawling the World Wide Web.

11. The method as recited in claim 1, wherein the determining at least a first keyword includes:

determining a rank of the first candidate document in response to a search for a particular search query;

or

determining a monthly volume of the first keyword.

12. A system for selecting a proxy keyword for a document, the system comprising:

a receiver effective to receive an unknown document;

a candidate document determination module effective to determine at least a first candidate document from the World Wide Web for the unknown document on the basis of a search of one or more valued search terms;

a proxy phrase determination module effective to determine at least a first keyword for the first candidate document;

the candidate document determination module further effective to determine at least a second candidate document from the World Wide Web for the unknown document on the basis of a search of one or more valued search terms;

the proxy phrase determination module effective to determine at least a second keyword for the second candidate document; and

a processor effective to determine a proxy keyword for the unknown document based on the first and second keywords; and

wherein the first candidate document and the second candidate document are documents which are most similar to the unknown document.

13. The system as recited in claim 12, wherein the processor is effective to determine the proxy keyword by:

determining a first distance from the first candidate document to the unknown document;

determining a second distance from the second candidate document to the unknown document; and

using the first and second distances to determine the proxy keyword.

14. The system as recited in claim 12, wherein the processor is effective to determine the proxy keyword by:

determining a first length of the first keyword;

determining a second length of the second keyword; and

using the first and second lengths to determine the proxy keyword.

15. The system as recited in claim 12, wherein:

the proxy phrase determination module is further effective to determine at least a third keyword for the first candidate document, the first and third keywords being in a first order;

the proxy phrase determination module is further effective to determine at least a fourth keyword for the second candidate document, the second and fourth keywords being in a second order; and

wherein

the processor is effective to determine the proxy keyword for the unknown document based on the first and second order.

16. The system as recited in claim 15, wherein:

the first order is based on a frequency in which the first and third keywords occur in the unknown document; and

the second order is based on a frequency in which the second and fourth keywords occur in the second document.

17. The system as recited in claim 12, wherein the processor is effective to determine the proxy keyword for the unknown document based on a percentage of text matching between the first candidate document and the unknown document, and based on a percentage of text matching between the second candidate document and the unknown document.

18. The system as recited in claim 17, wherein the processor determines the proxy keyword by:

determining a first distance from the first candidate document to the unknown document;

determining a second distance from the second candidate document to the unknown document; and

using the first and second distances to determine the proxy keyword.

19. The system as recited in claim 18, wherein the processor determines the proxy keyword by:

determining a first length of the first keyword;

determining a second length of the second keyword; and

using the first and second lengths to determine the proxy keyword.

20. The system as recited in claim 19, wherein:

the proxy phrase determination module is further effective to determine at least a third keyword for the first candidate document, the first and third keywords being in a first order;

the proxy phrase determination module is further effective to determine at least a fourth keyword for the second candidate document, the second and fourth keywords being in a second order; and

wherein

the processor is effective to determine the proxy keyword for the unknown document based on the first and second order.

21. The system as recited in claim 12, wherein the receiver includes a crawler.