Apparatus And A Method For Logically Processing A Composite Graph In A Formatted Document

• US 20140337719A1
• Filed: 12/03/2013
• Published: 11/13/2014
• Est. Priority Date: 05/10/2013
• Status: Active Grant

• Current Assignee: Peking University Founder Group Company Limited (Beijing Peking University Asset Management Company Limited), Founder Apabi Technology Limited, Peking University
• Original Assignee: Peking University Founder Group Company Limited (Beijing Peking University Asset Management Company Limited), Founder Apabi Technology Limited, Peking University
• Inventors: Tang, Zhi, Xu, Canhui, Tao, Xin, Shi, Cao
• Granted Patent: US 9,569,407 B2
• Time in Patent Office: Days
• US Class Current: 715/255
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 40/106 Display of layout of documents; Previewing
• CPC Class Codes: G06F 40/205 Parsing
• CPC Class Codes: G06V 30/414 Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text

Abstract

The present invention provides an apparatus for logically processing a composite graph in a formatted document, the apparatus comprising: a composite graph block extraction unit, used to extract a composite graph block in the formatted document; a document parsing unit, used to parse the formatted document to obtain a text element contained therein; a cutline element extraction unit, used to extract a cutline element from the text element; a correlativity detection unit, used to detect correlativity between the composite graph block and the cutline element; a correlativity storage unit, used to store the detected correlativity. The present invention also provides a method for logically processing a composite graph in a formatted document. According to the technical scheme disclosed in the present invention, it is easily achieve layout understanding of the composite graph in a graph-text mixed layout of the formatted document, so as to avoid a logical error.

Claims

1. An apparatus for logically processing a composite graph in a foi matted document, comprising:

a composite graph block extraction unit, configured to extract a composite graph block in the formatted document;

a document parsing unit, configured to parse the formatted document to obtain a text element included therein;

a cutline element extraction unit, configured to extract a cutline element from the text element;

a correlativity detection unit, configured to detect correlativity between the composite graph block and the cutline element; and

a correlativity storage unit, configured to store the detected correlativity.

2. The apparatus for logically processing a composite graph in a formatted document according to claim 1, further comprises:

an information acquisition unit, configured to obtain characteristic attribute information of the composite graph block;

an element classification unit, configured to classify an element included in the composite graph block, according to the characteristic attribute information; and

a composite graph processing unit, configured to reserve a in-text-illustration composite graph in the composite graph block and filter other elements according to classification result, so that the correlativity detection unit detects the correlativity between the in-text-illustration composite graph and the cutline element.

3. The apparatus for logically processing a composite graph in a formatted document according to claim 2, further comprises:

a label adding unit, configured to add a corresponding logic label to each element in the composite graph block, to symbolize the classification each element belonging to; and

the correlativity storage unit, further configured to store the logic label and/or an identification of the element corresponding to the logic label.

4. The apparatus for logically processing a composite graph in a formatted document according to claim 2, wherein the correlativity detection unit comprises:

a number determining subunit, configured to determine the number of the in-text-illustration composite graph included in the composite graph block;

a distance analyzing subunit, configured to, in the case that the composite graph block only contains one in-text-illustration composite graph, select a cutline element having a distance to the in-text-illustration composite graph smaller than a preset distance, and make the cutline element as a cutline element relating to the in-text-illustration composite graph; and

a bipartite graph analyzing subunit, configured to, in the case that the composite graph block contains multiple in-text-illustration composite graphs, make the multiple in-text-illustration composite graphs and all of the parsed cutline elements as a vertex of a bipartite graph respectively, so as to use the bipartite graph to determine the correlativity between the multiple in-text-illustration composite graphs and the cutline elements.

5. The apparatus for logically processing a composite graph in a formatted document according to claim 1, wherein the cutline element extraction unit comprises:

an information reading subunit, configured to read preset typesetting characteristic information of the cutline element; and

an element retrieving subunit, configured to retrieve in the text elements that parsed by the document parsing unit according to the read typesetting characteristic information to obtain the cutline element.

6. A method for logically processing a composite graph in a formatted document, comprising:

Extracting, by an apparatus, a composite graph block in a formatted document in a composite graph block extracting step (202);

extracting a cutline element from a text element parsed from the formatted document in a cutline element extracting step (204);

detecting correlativity between the composite graph block and the cutline element in a correlativity detection step (206); and

storing the detected correlativity in a correlativity storing step (208).

7. The method for logically processing a composite graph in a formatted document according to claim 6, before the correlativity detection step (206), further comprises:

obtaining characteristic attribute information of the composite graph block, so as to classify an element contained in the composite graph block; and

reserving an in-text-illustration composite graph in the composite graph block according to classification result, and filtering other elements, so as to detect correlativity between the in-text-illustration composite graph and the cutline element in the correlativity detection step (206).

8. The method for logically processing a composite graph in a formatted document according to claim 7, further comprises:

adding a corresponding logic label to each element in the composite graph block to symbolize each element'"'"'s classification; and

the correlativity storing step (208) further comprising storing the logic label and/or an identification of the element corresponding to the logic label.

9. The method for logically processing a composite graph in a formatted document according to claim 7, wherein, the correlativity detection step (206) comprises:

selecting a cutline element having a distance to the in-text-illustration composite graph smaller than a preset distance, if the composite graph block only contains one in-text-illustration composite graph, using the cutline element as a cutline element correlating to the in-text-illustration composite graph; and

making multiple in-text-illustration composite graphs, if the composite graph block contains multiple in-text-illustration composite graphs, and all of the parsed cutline elements as a vertex of a bipartite graph respectively, so as to use the bipartite graph to determine the correlativity between the multiple in-text-illustration composite graphs and the cutline elements.

10. The method for logically processing a composite graph in a formatted document according to any of claim 6, wherein the cutline element extracting step (204) comprises:

reading preset typesetting characteristic information of the cutline element; and

retrieving in a parsed text element to obtain the cutline element, according to the read typesetting characteristic information.