Method and apparatus for retrieving text using document signatures

• US 6,029,167 A
• Filed: 07/25/1997
• Issued: 02/22/2000
• Est. Priority Date: 07/25/1997
• Status: Expired due to Fees

• Current Assignee: Justsystems Evans Research Incorporated
• Original Assignee: Claritech Corporation
• Inventors: Evans, David A.
• Primary Examiner(s): Black, Thomas G.
• Assistant Examiner(s): Jung, David Yiuk
• Application Number:
  US08/900,784
• Time in Patent Office: 942 Days
• Field of Search: 707/1-206, 707/501-513, 379/237-302, 701/99, 702/138, 380/28-54, 364/578, 706/1-62
• US Class Current: 1/1
• CPC Class Codes: G06F 40/194 Calculation of difference between files
• CPC Class Codes: G06F 40/284 Lexical analysis, e.g. tokenisation or collocates
• CPC Class Codes: G06F 40/289 Phrasal analysis, e.g. finite state techniques or chunking
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99934 Query formulation, input preparation, or translation
• CPC Class Codes: Y10S 707/99942 Manipulating data structure, e.g. compression, compaction, compilation
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing

Abstract

A method and apparatus for retrieving similar or identical textual passages among different documents is disclosed. Normal discourse structures along with textual content attributes are used to encode a known passage with "marker sequences" that give a characterizing "signature" to the passage. The encoded known passage is then evaluated against similarly encoded passages appearing in a database of documents. If it is determined that there is a possible match between the encoded known passage and an encoded passage in a database document, a sequential string search is performed to determine whether the two passages are likely to be similar or identical. If the sequential string search records a probable match between the known passage and the database passage, the database passage is displayed for further review.

Claims

1. A method for retrieving documents from a database, comprising:

identifying markers in a first text passage, representing the number of non-marker characters between said identified markers in said first text passage to generate a first marker sequence;

identifying markers in a plurality of documents from said database;

representing the number of non-marker characters between identified markers in said plurality of database documents to generate a plurality of database marker sequences; and

evaluating said first marker sequence against said plurality of database marker sequences to retrieve documents from said database.

2. The method of claim 1 wherein said database documents contain passages that are identical to said first text passage.

3. The method of claim 2, wherein said first text passage is compared with said database documents using a sequential string search of said first marker sequence against said plurality of database marker sequences.

4. The method of claim 1 wherein said database documents contain passages that are similar to said first text passage.

5. The method of claim 4, wherein said first text passage is compared with said database documents using a sequential string search of said first marker sequence against said plurality of database marker sequences.

6. An apparatus for retrieving documents from a database, comprising:

an input device coupled to a processing unit for selecting a first text passage;

a storage unit coupled to said processor unit for storing said database documents;

wherein said processor unit identifies markers in said first text passage and represents the number of non-marker characters between markers in said first text passage to generate a first marker sequence;

wherein said processor unit identifies markers in a plurality of documents from said database and represents the number of non-marker characters between markers in said plurality of documents from said database to generate a plurality of database marker sequences; and

wherein said processor evaluates said first marker sequence against said plurality of database marker sequences to retrieve documents from said database.

7. The apparatus of claim 6 wherein said database documents contain passages that are identical to said known passage.

8. The apparatus of claim 7, wherein said first text passage is compared with said database documents using a sequential string search of said first marker sequence against said plurality of database marker sequences.

9. The apparatus of claim 6, wherein said database documents contain passages that are similar to said known passage.

10. The apparatus of claim 9, wherein said first text passage is compared with said database documents using a sequential string search of said first marker sequence against said plurality of database marker sequences.