Method and apparatus for finding related documents in a collection of linked documents using a bibliographic coupling link analysis

• US 6,182,091 B1
• Filed: 09/29/1999
• Issued: 01/30/2001
• Est. Priority Date: 03/18/1998
• Status: Expired due to Term

• Current Assignee: Majandro LLC (IP Edge LLC)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Pirolli, Peter L., Pitkow, James E.
• Primary Examiner(s): HOMERE, JEAN RAYMOND
• Application Number:
  US09/407,789
• Time in Patent Office: 489 Days
• Field of Search: 707/5, 707/3, 707/102, 707/501, 707/514
• US Class Current: 715/206
• CPC Class Codes: G06F 16/30 of unstructured textual data document management systems G06F16/93
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface

Abstract

A method and apparatus for identifying related documents in a collection of linked documents. In the method the link structure of documents to other documents are analyzed. By analyzing only the link structure, a process intensive content analysis of the documents is avoided. A citation analysis technique, such as bibliographic coupling analysis, is performed on the set of documents to extract link information. For bibliographic coupling analysis that information would include the number of other documents that a given pair of documents link to. By using the link information, related documents are identified using a suitable analysis technique, such as clustering or spreading activation.

Claims

1. A method for identifying related documents in a set of linked documents, said method comprising the steps of:

a) generating a link index for each document in said set of linked documents;

b) identifying document pairs of said set of linked documents;

c) generating bibliographic coupling strength information for each of said identified document pairs; and

d) performing a suitable analysis operation using said bibliographic coupling strength information to identify related information.

2. The method as recited in claim 1 wherein said step of generating bibliographic coupling strength information for each of said identified document pairs is further comprised of the substep of comparing the link index for each document in said set of linked documents and identifying documents that both documents link to.

3. The method as recited in claim 2, wherein said suitable analysis operation is a clustering operation.

4. The method as recited in claim 2, wherein said suitable analysis operation is a spreading activation operation.

5. The method as recited in claim 1 wherein said documents are pages on the world wide web.

6. A computer based system for identifying related documents in a collection of linked documents, said system comprising:

means for accessing said documents in said collection of linked documents;

means for generating a citation index for a document;

means for generating document pairs from said documents in said collection of linked documents;

means for generating bibliographic coupling strength information for each of said identified document pairs; and

at least one means for performing a suitable analysis operation using said bibliographic coupling strength information to identify related information.

7. The system as recited in claim 6 wherein said means for generating bibliographic coupling strength is further comprised of means for comparing the citation index for each document to determine the number of documents that each document pair links to.

8. The system as recited in claim 7 wherein said at least one means for performing a suitable analysis operation is means for performing a clustering operation.

9. The system as recited in claim 7 wherein said at least one means for performing a suitable analysis operation is means for performing a spreading activation operation.

10. A program storage device readable by a machine, tangibly embodying a program of instructions executable by the machine to perform method steps for the identifying related documents in a collection of linked documents, said method steps comprising:

a) generating a link index for each document in said set of linked documents;

b) identifying document pairs of said set of linked documents;

c) generating bibliographic coupling strength information for each of said identified document pairs; and

d) performing a suitable analysis operation using said bibliographic coupling strength information to identify related information.

11. The program storage device as recited in claim 10 wherein said method step generating bibliographic coupling strength information for each of said identified document pairs is further comprised of the substep of comparing the link index for each document in said set of linked documents and identifying documents that both documents link to.