DOCUMENT PROCESSING DEVICE AND DOCUMENT PROCESSING METHOD

• US 20090132566A1
• Filed: 03/28/2007
• Published: 05/21/2009
• Est. Priority Date: 03/31/2006
• Status: Abandoned Application

• Current Assignee: Justsystems Corporation
• Original Assignee: Justsystems Corporation
• Inventors: Ochi, Shingo, Hino, Takanori
• Application Number:
  US12/294,135
• Publication Number:
  US 20090132566A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 40/137 Hierarchical processing, e.g. outlines
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]

Abstract

A structured document file in similarity relation is specified based on a tag structure of a structured document file.

A node-pair detection unit detects from a structured file a tag pair having a predetermined positional relation as a node pair. An attribute-value acquisition unit indexes as an attribute value the appearance mode of a node pair in a structured document file. An index-information creation unit creates index information associating a node pair and an attribute value thereof. A common-pair detection unit detects as a common pair a node pair that is common in a query document, which is a structured document file, and in a document to be examined, which is a structured document file to be compared. A node-similarity-value calculation unit indexes as a node similarity value, by referring to the index information of the query document and the index information of the document to be examined, the similarity between the attribute value of the common pair in the query document and the attribute value of the common pair in the document to be examined.

Claims

1. A document processing apparatus comprising:

a node-pair detection unit operative to detect from a structured file described using a predetermined tag set a tag pair having a predetermined positional relation as a node pair;

an attribute-value acquisition unit operative to index as an attribute value according to a predetermined rule an appearance mode of a node pair in a structured document file;

an index creation unit operative to create index information associating a node pair and an attribute value thereof;

a common-pair detection unit operative to detect as a common pair a node pair that is common in a node pair group detected from a first structured document file and a node pair group detected from a second structured document file; and

a node-similarity-value calculation unit operative to index as a node similarity value, by referring to the index information of the first structured document file and the index information of the second structured document file, the similarity between the attribute value of the common pair in the first structured document file and the attribute value of the common pair in the second structured document file.

2. The document processing apparatus according to claim 1, wherein the attribute-value acquisition unit is operative to index as attribute values a relative positional relation of two tags included in a node pair, a position of a tag included in a node pair in a structured document file, or the number of the appearance of a node pair in a structured document file.

3. The document processing apparatus according to claim 1, further comprising a document-similarity-value calculation unit operative to calculate as a document similarity value, from a node similarity value calculated for a common pair in a first structured document file and a second structured document file, the similarity in a document structure between the first structured document file and the second structured document file.

4. The document processing apparatus according to claim 3, further comprising a ranking display unit operative to display, when a document similarity value to a first structured document file to be compared against is calculated for each of a plurality of second document files, a list of titles of the second structured document files in descending order of the document similarity value.

5. The document processing apparatus according to claim 1, wherein the common-pair detection unit is operative to determine according to a predetermined evaluation rule whether a character string showing a tag name included in a node pair detected from a first structured document file and a character string showing a tag name included in a node pair detected from a second structured document file are in a similarity relation and to target, and, when the character strings are determined to be in the similarity relation, identify those node pairs as common pairs.

6. The document processing apparatus according to claim 1, further comprising:

a rarity-value calculation unit operative to calculate as a rarity value, by counting the occurrence frequency of a node pair to be examined from a plurality of targeted structured document files, the rarity of an appearance of the node pair in the plurality of structured document files; and

a rarity-based correction unit operative to correct a node similarity value in accordance with a rarity value so that a node similarity value of a common pair having a high rarity value is increased.

7. The document processing apparatus according to claim 1, further comprising:

a distribution-approximate-value calculation unit operative to specify a statistical distribution range of an attribute value of a node pair to be examined from a plurality of targeted structured document files and to calculate as a distribution approximate value the closeness of the position of an attribute value in the distribution range of a common pair in a first structured document file and the position of an attribute value in the distribution range of a common pair in a second structured document file; and

a distribution-based correction unit operative to correct a node similarity value in accordance with a distribution approximate value so that a node similarity value of a common pair close to the other common pair in the distribution range is increased.

8. The document processing apparatus according to claim 1, further comprising a node-similarity-value display unit operative to arrange on a screen a plurality of display regions corresponding to a node pair detected from a first structured document file and to change a display mode of a display area corresponding to a common pair in accordance with a node similarity value for a common pair detected in consideration of the relation with a second structured document file.

9. A document processing method comprising:

detecting in a structured file described using a predetermined tag set a tag pair having a predetermined positional relation as a node pair;

indexing as an attribute value according to a predetermined rule an appearance mode of a node pair in a structured document file;

creating index information associating a node pair and an attribute value thereof;

detecting as a common pair a node pair that is common in a node pair group detected from a first structured document file and a node pair group detected from a second structured document file; and

indexing as a node similarity value, by referring to the index information of the first structured document file and the index information of the second structured document file, the similarity between the attribute value of the common pair in the first structured document file and the attribute value of the common pair in the second structured document file.

10. A document processing computer program product comprising:

a module that detects from a structured file described using a predetermined tag set a tag pair having a predetermined positional relation as a node pair;

a module that indexes as an attribute value according to a predetermined rule an appearance mode of a node pair in a structured document file;

a module that creates index information associating a node pair and an attribute value thereof;

a module that detects as a common pair a node pair that is common in a node pair group detected from a first structured document file and a node pair group detected from a second structured document file; and

a module that indexes as a node similarity value, by referring to the index information of the first structured document file and the index information of the second structured document file, the similarity between the attribute value of the common pair in the first structured document file and the attribute value of the common pair in the second structured document file.