System and method for labeling a document

• US 20070100813A1
• Filed: 10/28/2005
• Published: 05/03/2007
• Est. Priority Date: 10/28/2005
• Status: Active Grant

• Current Assignee: R2 Solutions LLC (Acacia Research Corporation)
• Original Assignee: Yahoo! Inc. (Apollo Global Management, Inc.)
• Inventors: Joshi, Deepa, Davies, Winton
• Granted Patent: US 7,680,760 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/313 Selection or weighting of terms for indexing
• CPC Class Codes: G06F 16/93 Document management systems

Abstract

A system and method for selecting a proxy keyword for an unknown document. An unknown document is received by a receiver. A plurality of candidate documents and corresponding keywords are determined for the unknown document. Using the keywords from the candidate documents, proxy keywords are determined for the unknown document based on a plurality of factors including a length of the keywords, a distance of the candidate documents from the unknown document, a similarity of the text between the unknown document and the respective candidate document, a rank of the keywords within each candidate document, and a frequency of the keyword within its respective candidate document.

Claims

1. A method for selecting a proxy keyword for a document, the method comprising:

receiving a first document;

determining at least a first candidate document from the world wide web for the first document;

determining at least a first keyword for the first candidate document;

determining at least a second candidate document from the world wide web for the first document;

determining at least a second keyword for the second candidate document;

determining a proxy keyword for the first document based on the first and second keywords.

2. The method as recited in claim 1, wherein the determining a proxy keyword includes:

determining a first distance from the first candidate document to the first document;

determining a second distance from the second candidate document to the first document; and

using the first and second distances to determine the proxy keyword.

3. The method as recited in claim 1, wherein the determining a proxy keyword includes:

determining a first length of the first keyword;

determining a second length of the second keyword; and

using the first and second lengths to determine the proxy keyword.

4. The method as recited in claim 1, further comprising:

determining at least a third keyword for the first candidate document, the first and third keywords being in a first order;

determining at least a fourth keyword for the second candidate document, the second and fourth keywords being in a second order; and

wherein

the determining a proxy keyword for the first document is based on the first and second order.

5. The method as recited in claim 4, wherein:

the first order is based on a frequency in which the first and third keywords occur in the first document; and

the second order is based on a frequency in which the second and fourth keywords occur in the second document.

6. The method as recited in claim 1, wherein the determining a proxy keyword for the first document is based on a percentage of text matching between the first keyword and the first document, and based on a percentage of text matching between the second keyword and the first document.

7. The method as recited in claim 6, wherein the determining a proxy keyword includes:

determining a first distance from the first candidate document to the first document;

determining a second distance from the second candidate document to the first document; and

using the first and second distances to determine the proxy keyword.

8. The method as recited in claim 7, wherein the determining a proxy keyword includes:

determining a first length of the first keyword;

determining a second length of the second keyword; and

using the first and second lengths to determine the proxy keyword.

9. The method as recited in claim 8, further comprising:

determining at least a third keyword for the first candidate document, the first and third keywords being in a first order;

determining at least a fourth keyword for the second candidate document, the second and fourth keywords being in a second order; and

wherein

the determining a proxy keyword for the first document is based on the first and second order.

10. The method as recited in claim 1, wherein the receiving the first document including crawling the World Wide Web.

11. The method as recited in claim 1, wherein the determining at least a first candidate document comprises performing a search on a plurality of valued search keywords.

12. The method as recited in claim 1, wherein the determining at least a first keyword includes:

determining a rank of the first candidate document in response to a search for a particular search query;

or

determining a monthly volume of the first keyword.

13. A system for selecting a proxy keyword for a document, the system comprising:

a receiver effective to receive a first document;

a candidate document determination module effective to determine at least a first candidate document from the World Wide Web for the first document;

a proxy phrase determination module effective to determine at least a first keyword for the first candidate document;

the candidate document determination module further effective to determine at least a second candidate document World Wide Web for the first document;

the proxy phrase determination module effective to determine at least a second keyword for the second candidate document; and

a processor effective to determine a proxy keyword for the first document based on the first and second keywords.

14. The system as recited in claim 13, wherein the processor is effective to determine the proxy keyword by:

determining a first distance from the first candidate document to the first document;

determining a second distance from the second candidate document to the first document; and

using the first and second distances to determine the proxy keyword.

15. The system as recited in claim 13, wherein the processor is effective to determine the proxy keyword by:

determining a first length of the first keyword;

determining a second length of the second keyword; and

using the first and second lengths to determine the proxy keyword.

16. The system as recited in claim 13, wherein:

the proxy phrase determination module is further effective to determine at least a third keyword for the first candidate document, the first and third keywords being in a first order;

the proxy phrase determination module is further effective to determine at least a fourth keyword for the second candidate document, the second and fourth keywords being in a second order; and

wherein

the processor is effective to determine the proxy keyword for the first document based on the first and second order.

17. The system as recited in claim 16, wherein:

the first order is based on a frequency in which the first and third keywords occur in the first document; and

the second order is based on a frequency in which the second and fourth keywords occur in the second document.

18. The system as recited in claim 13, wherein the processor is effective to determine the proxy keyword for the first document based on a percentage of text matching between the first candidate document and the first document, and based on a percentage of text matching between the second candidate document and the first document.

19. The method as recited in claim 18, wherein the processor determines the proxy keyword by:

determining a first distance from the first candidate document to the first document;

determining a second distance from the second candidate document to the first document; and

using the first and second distances to determine the proxy keyword.

20. The system as recited in claim 19, wherein the processor determines the proxy keyword by:

determining a first length of the first keyword;

determining a second length of the second keyword; and

using the first and second lengths to determine the proxy keyword.

21. The system as recited in claim 20, wherein:

the proxy phrase determination module is further effective to determine at least a third keyword for the first candidate document, the first and third keywords being in a first order;

the proxy phrase determination module is further effective to determine at least a fourth keyword for the second candidate document, the second and fourth keywords being in a second order; and

wherein

the processor is effective to determine the proxy keyword for the first document based on the first and second order.

22. The method as recited in claim 13, wherein the receiver includes a crawler.

23. A document label file for a first document produced by the method of:

receiving a first document;

determining at least a first candidate document from the world wide web for the first document;

determining at least a first keyword for the first candidate document;

determining at least a second candidate document from the world wide web for the first document;

determining at least a second keyword for the second candidate document;

determining a proxy keyword for the first document based on the first and second keywords.