Document data processing device

• US 8,768,941 B2
• Filed: 07/23/2010
• Issued: 07/01/2014
• Est. Priority Date: 07/27/2009
• Status: Active Grant

• Current Assignee: Hitachi Solutions Limited (Hitachi, Ltd.)
• Original Assignee: Hitachi Solutions Limited (Hitachi, Ltd.)
• Inventors: Matsumoto, Toshiko
• Primary Examiner(s): Beausoliel, Jr., Robert
• Assistant Examiner(s): Khakhar, Nirav K
• Application Number:
  US13/380,561
• Publication Number:
  US 20120179718A1
• Time in Patent Office: 1,439 Days
• Field of Search: 707/755
• US Class Current: 707/755
• CPC Class Codes: G06F 16/38 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 40/106 Display of layout of documents; Previewing
• CPC Class Codes: G06F 40/258 Heading extraction; Automatic titling; Numbering
• CPC Class Codes: G06T 1/00 General purpose image data processing

Abstract

There is provided a technique for automatically acquiring metadata with respect to various organizations which significantly reduces the man-hours required to prepare models for metadata extraction. With a pair comprising a document and metadata appearing therein as input, using a layout feature, and proximate text string and partial text string features with respect to metadata and a text string that is not metadata, the use of the layout feature, the proximate text string and the partial text string with respect to the automatic acquisition of metadata is automatically configured (see FIG. 1).

Claims

1. A document data processing device that manages documents using metadata within the documents, the document data processing device comprising:

a memory which stores document data to be processed; and

a processor which acquires the document data to be processed, from the memory, for which a type of metadata included in the documents is specified; and

an output device which outputs a first determination result by the processor,

wherein the processor determines whether or not a layout feature that metadata to be processed within the document data to be processed has is effective in extracting the metadata to be processed, to generate the first determination result, by checking whether or not the layout feature that the metadata to be processed has is manifested in a text string other than the metadata in the document data to be processed, and, based on a result of the check, determines whether or not the layout feature is effective in extracting the metadata.

2. The document data processing device according to claim 1, wherein

the processor acquires a plurality of document data as subjects of processing,

the processor, with respect to the plurality of document data to be processed for which the same metadata type is specified, calculates the number of documents in which the layout feature is manifested only in a text string of the metadata (n1) and the number of documents in which the layout feature is manifested only in a text string other than the metadata (n2);

and

the output device outputs the numbers of documents, and, if n1>

n2, presents information indicating that the layout feature is set as a model of a feature to be watched in automatically acquiring the metadata.

3. The document data processing device according to claim 1, wherein the processor further

determines whether or not a text string feature that is in proximity to metadata to be processed within the document data to be processed is effective in extracting the metadata to be processed to generate a second determination result;

and

wherein the output device further outputs the second determination result by the processor.

4. The document data processing device according to claim 3, wherein the processor checks whether or not the proximate text string feature is manifested in proximity to a text string other than the metadata to be processed, and, based on a result of the check, determines whether or not the proximate text string feature is effective in extracting the metadata to be processed.

5. The document data processing device according to claim 1, wherein the processor further

determines whether or not a partial text string feature included in metadata to be processed within the document data to be processed is effective in extracting the metadata to be processed to generate a third determination result;

and

wherein the output device further outputs the third determination result by the processor.

6. The document data processing device according to claim 5, wherein the processor checks whether or not the partial text string feature is included in a text string other than the metadata to be processed, and, based on a result of the check, determines whether or not the partial text string feature is effective in extracting the metadata to be processed.

7. A document data processing device that manages documents using metadata within the documents, the document data processing device comprising:

a memory which stores document data to be processed; and

a processor which acquire the document data to be processed, from the memory, for which a type of metadata included in the documents is specified; and

an output device which outputs a first determination result by the processor, wherein the processor determines whether or not at least two features from among a layout feature that metadata to be processed within the document data to be processed has, a proximate text string feature that is in proximity to the metadata to be processed, and a partial text string feature included in the metadata to be processed are effective in extracting the metadata to be processed, to generate the first determination result, by checking whether or not the layout feature that the metadata to be processed has is manifested in a text string other than the metadata in the document data to be processed, and, based on a result of the check, determines whether or not the layout feature is effective in extracting the metadata.

8. The document data processing device according to claim 7, wherein the processor further checks whether or not the proximate text string feature is manifested in proximity to another text string other than the metadata to be processed, to generate a second determination result, and, based on result determines whether or not the proximate text string feature is effective in extracting the metadata to be processed.

9. The document data processing device according to claim 7, wherein the processor further checks whether or not the partial text string feature is included in a text string other than the metadata to be processed, to generate a third determination result, and, based on the third determination result, determines whether or not the partial text string feature is effective in extracting the metadata to be processed.

10. The document data processing device according to claim 7, wherein

the processor acquires a plurality of document data as subjects of processing,

the processor, with respect to the plurality of document data to be processed for which the same metadata type is specified, calculates the number of documents in which the layout feature is manifested only in a text string of the metadata (n1) and the number of documents in which the layout feature is manifested only in a text string other than the metadata (n2);

and

the output device outputs the numbers of documents, and, if n1>

n2, presents information indicating that the layout feature is set as a model of a feature to be watched in automatically acquiring the metadata.