Apparatus and a method for logically processing a composite graph in a formatted document

• US 9,569,407 B2
• Filed: 12/03/2013
• Issued: 02/14/2017
• Est. Priority Date: 05/10/2013
• Status: Expired due to Fees

• Current Assignee: Peking University Founder Group Company Limited (Beijing Peking University Asset Management Company Limited), Founder Apabi Technology Limited, Peking University
• Original Assignee: Peking University Founder Group Company Limited (Beijing Peking University Asset Management Company Limited), Founder Apabi Technology Limited, Peking University
• Inventors: Xu, Canhui, Tang, Zhi, Tao, Xin, Shi, Cao
• Primary Examiner(s): Nguyen, Maikhanh
• Application Number:
  US14/095,682
• Publication Number:
  US 20140337719A1
• Time in Patent Office: 1,169 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 40/106 Display of layout of documents; Previewing
• CPC Class Codes: G06F 40/205 Parsing
• CPC Class Codes: G06V 30/414 Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text

Abstract

The present invention provides an apparatus for logically processing a composite graph in a formatted document, the apparatus comprising: a composite graph block extraction unit, used to extract a composite graph block in the formatted document; a document parsing unit, used to parse the formatted document to obtain a text element contained therein; a cutline element extraction unit, used to extract a cutline element from the text element; a correlativity detection unit, used to detect correlativity between the composite graph block and the cutline element; a correlativity storage unit, used to store the detected correlativity. The present invention also provides a method for logically processing a composite graph in a formatted document. According to the technical scheme disclosed in the present invention, it is easily achieve layout understanding of the composite graph in a graph-text mixed layout of the formatted document, so as to avoid a logical error.

Claims

1. An apparatus for logically processing a composite graph in a formatted document, comprising a computer processor and a computer readable storage medium which stores a plurality of computer-executable instructions, wherein the computer-executable instructions, when being executed by the computer processor, cause the computer processor to:

extract a composite graph block in the formatted document;

parse the formatted document to obtain a text element included therein;

extract a cutline element from the text element;

detect correlativity between the composite graph block and the extracted cutline element, wherein the correlativity detection comprises;

determining the number of in-text-illustration composite graphs included in the composite graph block;

in the case that the composite graph block only contains one in-text-illustration composite graph, selecting a cutline element having a distance to the one in-text-illustration composite graph smaller than a preset distance, and making the selected cutline element as a cutline element relating to the one in-text-illustration composite graph; and

in the case that the composite graph block contains multiple in-text-illustration composite graphs, making the multiple in-text-illustration composite graphs and all of the parsed cutline elements as a vertex of a bipartite graph respectively, so as to use the bipartite graph to determine the correlativity between the multiple in-text-illustration composite graphs and the cutline elements; and

store the detected correlativity.

2. The apparatus for logically processing a composite graph in a formatted document according to claim 1, wherein the computer-executable instructions, when being executed by the computer processor, further cause the computer processor to:

obtain characteristic attribute information of the composite graph block;

classify an element included in the composite graph block, according to the characteristic attribute information; and

reserve an in-text-illustration composite graph in the composite graph block and filter other elements according to classification result, so as to detect the correlativity between the reserved in-text-illustration composite graph and the cutline element.

3. The apparatus for logically processing a composite graph in a formatted document according to claim 2, wherein the computer-executable instructions, when being executed by the computer processor, further cause the computer processor to:

add a corresponding logic label to each element in the composite graph block, to symbolize the classification each element belonging to; and

store one or both of the logic label and an identification of the element corresponding to the logic label.

4. The apparatus for logically processing a composite graph in a formatted document according to claim 1, wherein the computer-executable instructions, when being executed by the computer processor, cause the computer processor to:

read preset typesetting characteristic information of the cutline element; and

retrieve in it a parsed text element according to the read typesetting characteristic information to obtain the cutline element.

5. A method for logically processing a composite graph in a formatted document, comprising:

extracting, by an apparatus, a composite graph block in a formatted document;

extracting a cutline element from a text element parsed from the formatted document;

detecting correlativity between the composite graph block and the extracted cutline element, wherein the correlativity detection comprises;

if the composite graph block only contains one in-text-illustration composite graph, selecting a cutline element having a distance to the one in-text-illustration composite graph smaller than a preset distance, and using the cutline element having the distance to the one in-text-illustration composite graph smaller than the preset distance as a cutline element correlating to the one in-text-illustration composite graph; and

if the composite graph block contains multiple in-text-illustration composite graphs, making the multiple in-text-illustration composite graphs and all of the parsed cutline elements as a vertex of a bipartite graph respectively, so as to use the bipartite graph to determine the correlativity between the multiple in-text-illustration composite graphs and the cutline elements; and

store the detected correlativity.

6. The method for logically processing a composite graph in a formatted document according to claim 5, before the detecting of the correlativity between the composite graph block and the cutline element, further comprises:

obtaining characteristic attribute information of the composite graph block, so as to classify an element contained in the composite graph block; and

reserving an in-text-illustration composite graph in the composite graph block according to classification result, and filtering other elements, so as to detect the correlativity between the reserved in-text-illustration composite graph and the cutline element.

7. The method for logically processing a composite graph in a formatted document according to claim 6, further comprises:

adding a corresponding logic label to each element in the composite graph block to symbolize each element'"'"'s classification; and

the storing of the detected correlativity further comprising storing one or both of the logic label and an identification of the element corresponding to the logic label.

8. The method for logically processing a composite graph in a formatted document according to any of claim 5, wherein the extracting the cutline element from the text element parsed from the formatted document comprises:

reading preset typesetting characteristic information of the cutline element; and

retrieving in a parsed text element to obtain the cutline element, according to the read typesetting characteristic information.