Document processing apparatus, word extracting apparatus, word extracting method and storage medium for storing word extracting program

• US 5,905,980 A
• Filed: 09/18/1997
• Issued: 05/18/1999
• Est. Priority Date: 10/31/1996
• Status: Expired due to Term

• Current Assignee: Fuji Xerox Company Limited (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Xerox Company Limited (Fujifilm Holdings Corporation)
• Inventors: Masuichi, Hiroshi, Tateno, Masakazu, Umemoto, Hiroshi
• Primary Examiner(s): Kulik, Paul V.
• Assistant Examiner(s): WALLACE, MICHAEL J
• Application Number:
  US08/933,113
• Time in Patent Office: 607 Days
• Field of Search: 707/1, 707/2, 707/3, 707/4, 707/5, 707/6, 707/200
• US Class Current: 707/700
• CPC Class Codes: G06F 16/313 Selection or weighting of terms for indexing
• CPC Class Codes: Y10S 707/961 Associative
• CPC Class Codes: Y10S 707/99931 Database or file accessing
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access

Abstract

The present invention provides a document processing apparatus, word extracting apparatus, word extracting method and storage medium for storing a word extracting program, capable of appropriately presenting effective associate words to the user. A retrieving element executes retrieval of documents based on a retrieval condition inputted through a retrieval condition inputting element. A keyword designating element designates an arbitrary word among the words included in the retrieved documents as an associate-word-searching word and designates other words as candidates for an associate word. A simultaneous appearance probability calculating element calculates a simultaneous appearance probability of the associate-word-searching word and one of the candidates for the associate word in any of the retrieved documents. A first independent appearance probability calculating element obtains an independent appearance probability of the associate-word-searching word in each of all documents. A second independent appearance probability calculating element calculates an independent appearance probability of each of the candidates for the associate word in each of all documents. A calculating element calculates the sum or product of the independent appearance probability of the associate-word-searching word and the independent appearance probability of each of the candidates for the associate word. An associate word extracting element extracts a word according to the ratio of the simultaneous appearance probability to the sum or product calculated by the calculating element.

Claims

1. A document processing apparatus comprising:

a document information storing element for storing information including a document identifier and a plurality of words included in a document for each of all documents;

a retrieval condition inputting element for inputting a retrieval condition for the documents to be retrieved;

a retrieving element for retrieving specific documents matching the retrieval condition by using the information;

a keyword designating element for designating an arbitrary word in the documents as an associate-word-searching word and designating other words as candidates to be associated;

a simultaneous appearance probability calculating element for calculating a probability that the associate-word-searching word and one of the candidates are simultaneously included in any of the documents retrieved by the retrieving element for each of the candidates;

a first independent appearance probability calculating element for calculating a first probability that the associate-word-searching word is included in any of all documents;

a second independent appearance probability calculating element for calculating a second probability that one of the candidates is included in any of all documents for each of the candidates;

a calculating element for calculating the sum of product of the first and second probabilities for each of the candidates; and

an associate word extracting element for calculating a ratio of the probability calculated by the simultaneous appearance probability calculating element to the sum or product calculated by the calculating element for each of the candidates and extracting a word according to the ratio of each of the candidates.

2. A word extracting apparatus comprising:

an item information storing element for storing information including an item identifier and a plurality of words included in an item for each of all items;

a retrieval condition inputting element for inputting a retrieval condition for the items to be retrieved;

a retrieving element for retrieving specific items matching the retrieval condition by using the information;

a keyword designating element for designating an arbitrary word in the items as an associate-word-searching word and designating other words as candidates to be associated;

a simultaneous appearance probability calculating element for calculating a probability that the associate-word-searching word and one of the candidates are simultaneously included in any of the items retrieved by the retrieving element for each of the candidates;

a first independent appearance probability calculating element for calculating a first probability that the associate-word-searching word is included in any of all items;

a second independent appearance probability calculating element for calculating a second probability that one of the candidates is included in any of all items for each of the candidates;

a calculating element for calculating the sum or product of the first and second probabilities for each of the candidates; and

an associate word extracting element for calculating a ratio of the probability calculated by the simultaneous appearance probability calculating element to the sum or product calculated by the calculating element for each of the candidates and extracting a word according to the ratio of each of the candidates.

3. A word extracting apparatus comprising:

an item information storing element for storing information including an item identifier and a plurality of words included in an item for each of all items;

a retrieval condition inputting element for inputting a retrieval condition for the items to be retrieved;

a retrieving element for retrieving specific items matching the retrieval condition by using the information;

a keyword designating element for designating an arbitrary word in the items as an associate-word-searching word and designating other words as candidates to be associated;

a simultaneous appearance probability calculating element for calculating a probability that the associate-word-searching word and one of the candidates are simultaneously included in any of the items retrieved by the retrieving element for each of the candidates;

a first independent appearance probability calculating element for calculating a first probability that the associate-word-searching word is included in any of all items;

a second independent appearance probability calculating element for calculating a second probability that one of the candidates is included in any of all items for each of the candidates;

a calculating element for calculating the sum or product of the first and second probabilities for each of the candidates; and

an associate word extracting element for calculating a statistical value using the probability calculated by the simultaneous appearance probability calculating element and the sum or product calculated by the calculating element for each of the candidates and extracting a word according to the statistical values of each of the candidates.

4. The word extracting apparatus as set forth in claim 3, wherein the associate word extracting element adopts at least one of mutual information, Dice-coefficient and t-score as the statistical value and extracts the candidate having the statistical value not less than a predetermined threshold value.

5. The word extracting apparatus as set forth in claim 3, further comprising:

a displaying element for displaying the item retrieved by the retrieving element.

6. A word extracting method for an information retrieving apparatus which comprises an item information storing element for storing information including an item identifier and a plurality of words included in an item for each of all items, comprising the steps of:

inputting a retrieval condition for the item;

retrieving specific items matching the retrieval condition from the item information storing element;

designating an arbitrary word in the retrieved items as an associate-word-searching word and designating other words as candidates to be associated;

calculating a simultaneous probability that the associate-word-searching word and one of the candidates are simultaneously included in any of the retrieved items for each of the candidates;

calculating a first probability that the associate-word-searching word is included in any of all items;

calculating a second probability that one of the candidates is included in any of all items for each of the candidates;

calculating the sum or product of the first and second probabilities for each of the candidates; and

calculating a statistical value using the simultaneous probability and the sum or product for each of the candidates and extracting a word according to the statistical value of each of the candidates.

7. A storage medium readable by a computer, storing a program of instructions executable by the computer to perform a method for extracting a word, the method comprising the steps of:

storing information including an item identifier and a plurality of words included in an item for each of all items;

inputting a retrieval condition for the items;

retrieving specific items matching the retrieval condition from the item information storing element;

designating an arbitrary word in the retrieved items as an associate-word-searching word and designating other words as candidates to be associated;

calculating a simultaneous probability that the associate-word-searching word and one of the candidates are simultaneously included in any of the retrieved items for each of the candidates;

calculating a first probability that the associate-word-searching word is included in any of all items;

calculating a second probability that one of the candidates is included in any of all items for each of the candidates;

calculating the sum or product of the first and second probabilities for each of the candidates; and

calculating statistical value using the simultaneous probability and the sum or product for each of the candidates and extracting a word according to the statistical value of each of the candidates.