Ruled line extracting program, ruled line extracting apparatus and ruled line extracting method

• US 7,769,234 B2
• Filed: 11/30/2006
• Issued: 08/03/2010
• Est. Priority Date: 08/31/2006
• Status: Expired due to Fees

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Takebe, Hiroaki, Fujimoto, Katsuhito
• Primary Examiner(s): Do; Anh Hong
• Application Number:
  US11/607,758
• Publication Number:
  US 20080056576A1
• Time in Patent Office: 1,342 Days
• Field of Search: 382/190, 382/192, 382/199, 382/163, 382/180, 382/175, 382/302, 382/173, 382/162, 358/403, 715/228
• US Class Current: 382/190
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/155 Removing patterns interfering with the pattern to be recognised, such as ruled lines or underlines
• CPC Class Codes: G06V 30/412 Layout analysis of documents structured with printed lines or input boxes, e.g. business forms or tables

Abstract

A ruled line extracting apparatus, a ruled line extracting program and a ruled line extracting method re-extract a ruled line by changing the predetermined requirements to be met by ruled line s when a ruled line candidate extracted according to the requirements shows a low reliability. A ruled line extracting program that causes a computer to extract a ruled line in an image of a document comprises an extraction step that extracts a ruled line candidate from the image of a document according to the first requirement predefined to be met by the figures of the elements of the ruled lines, a judgment step that judges if the ruled line candidate is stable or unstable according to the structural stability of the ruled line candidate extracted in the extraction step, a requirement determination step that determines the second requirement to be met by the figures of the elements of the ruled line different from the first requirement according to the ruled line candidate judged as stable in the judgment step and the first requirement and a re-extraction step that re-extracts a ruled line candidate according to the second requirement determined in the requirement determination step.

Claims

1. A computer-readable medium storing a ruled line extracting program that causes a computer to execute a process to extract a ruled line in a document image of a document, the process comprising:

extracting a ruled line candidate from the document image by executing a labeling process on the document image and selecting the ruled line candidate which is a black pixel link component satisfying a first requirement predefined to be met by figures of elements of the ruled lines;

judging if the ruled line candidate is stable or unstable according to a structural stability of the ruled line candidate extracted in the extracting;

determining a second requirement to be met by the figures of the elements of the ruled line different from the first requirement according to the ruled line candidate judged as stable in the judging and the first requirement; and

re-extracting a ruled line candidate according to the second requirement determined in the determining.

2. The computer-readable medium according to claim 1, wherein

the first requirement includes a parameter range showing the range of an element parameter that indicates properties of a graphic to be selected as a ruled line element of the ruled line and/or the range of a consolidation parameter that indicates properties of the graphic of the ruled line element to be consolidated as ruled line candidate.

3. The computer-readable medium according to claim 2, wherein

the extracting is adapted to select a graphic that makes the element parameter to be found within the corresponding parameter range from the document image and consolidate a plurality of ruled line elements that make the consolidation parameter to be found within the corresponding parameter range to generate the ruled line candidate.

4. The computer-readable medium according to claim 3, wherein

the ruled line is a broken ruled line;

the parameter range of the element parameter is defined by a threshold value for sizes of circumscribed rectangles of the black pixel link components; and

the extracting is adapted to extract the black pixel link components from the document image expressed by a binary system and select the black pixel link components that make the element parameter to be found within the corresponding parameter range as ruled line elements.

5. The computer-readable medium according to claim 3, wherein

the ruled line is a broken ruled line;

the parameter range of the consolidation parameter is defined by a threshold value for a gap separating two ruled line elements, a threshold value for a drift in the direction perpendicular to the direction of consolidating two ruled line elements and/or a threshold value for the number of consolidated ruled line elements; and

the extracting is adapted to select a plurality of ruled line elements that make the consolidation parameter to be found within the parameter range as ruled line candidate.

6. The computer-readable medium according to claim 3, wherein

the ruled line is a solid ruled line;

and

the extracting is adapted to divide the document image expressed by a binary system into a plurality of regions, select regions that make the element parameter to be found within the parameter range out of the regions as ruled line elements and consolidate the ruled line elements to generate a ruled line candidate.

7. The computer-readable medium according to claim 2, wherein

the judging defines a third requirement by changing the parameter range of the first requirement according to the parameters of the ruled line elements constituting the ruled line candidate, extracts an interim ruled line candidate from the document image according to the third requirement as in the extracting and judges the ruled line candidate extracted in the extracting as unstable when it differs from the interim ruled line candidate.

8. The computer-readable medium according to claim 2, wherein

the judging defines the third requirement by changing the parameter range of the first requirement according to the parameters of the ruled line elements constituting the ruled line candidate, extracts an interim ruled line candidate from the document image according to the third requirement as in the extracting and judges the ruled line candidate extracted in the extracting as unstable when any of the ruled line elements constituting the interim ruled line candidate is not larger than a predetermined threshold value.

9. The computer-readable medium according to claim 2, wherein

the judging judges the ruled line candidate as unstable when the positional arrangement of the ruled line elements included in the ruled line candidate is not uniform.

10. The computer-readable medium according to claim 2, wherein

the judging judges the ruled line candidate as unstable when circumscribed rectangles of the ruled line elements constituting the ruled line candidate overlap circumscribed rectangles of black pixel link components other than the ruled line elements and having predetermined profiles.

11. The computer-readable medium according to claim 2, wherein

the judging extracts a plurality of ruled line candidates uniformly arranged in the vertical direction and a plurality of ruled line candidates uniformly arranged in the horizontal direction as a group of regular ruled line candidates and judges the ruled line candidates other than the group of regular ruled line candidates as unstable.

12. The computer-readable medium according to claim 11, wherein

the judging puts ruled line candidates having a starting point located within a predetermined range from a first y-coordinate, an ending point located within a predetermined range from a second y-coordinate and a same number of ruled line elements and ruled line candidates having a starting point located within a predetermined range from a first x-coordinate, an ending point located within a predetermined range from a second x-coordinate and a same number of ruled line elements into the group of regular ruled line candidates.

13. The computer-readable medium according to claim 2, wherein

the determining extracts a ruled line candidate contained in a predetermined region located in the vicinity of each ruled line candidate judged as unstable in the judging out of the ruled line candidates judged as stable in the judging and defines a value between the parameter value indicating the properties of the ruled line candidate and a threshold value of the first requirement as a threshold value of the second requirement.

14. A ruled line extracting apparatus that extracts a ruled line in an image of a document, comprising:

an extraction section that extracts a ruled line candidate from the image of a document according to a first requirement predefined to be met by figures of elements of the ruled lines;

a judgment section that judges if the ruled line candidate is stable or unstable according to a structural stability of the ruled line candidate extracted by the extraction section;

a requirement determination section that determines a second requirement to be met by the figures of the elements of the ruled line different from the first requirement according to the ruled line candidate judged as stable by the judgment section and the first requirement; and

a re-extraction section that re-extracts a ruled line candidate according to the second requirement determined by the requirement determination section.

15. The apparatus according to claim 14, wherein

the first requirement includes a parameter range showing the range of an element parameter that indicates properties of a graphic to be selected as a ruled line element of the ruled line and/or the range of a consolidation parameter that indicates properties of the graphic of the ruled line element to be consolidated as ruled line candidate.

16. The apparatus according to claim 15, wherein

the extraction section is adapted to select a graphic that makes the element parameter to be found within the corresponding parameter range from the document image and consolidate a plurality of ruled line elements that make the consolidation parameter to be found within the corresponding parameter range to generate the ruled line candidate.

17. The apparatus according to claim 16, wherein

the ruled line is a broken ruled line;

the parameter range of the element parameter is defined by a threshold value for sizes of circumscribed rectangles of black pixel link components; and

the extraction section being is adapted to extract the black pixel link components from a document image expressed by a binary system and select the black pixel link components that make the element parameter to be found within the corresponding parameter range as ruled line elements.

18. The apparatus according to claim 16, wherein

the ruled line is a broken ruled line;

the parameter range of the consolidation parameter is defined by a threshold value for a gap separating two ruled line elements, a threshold value for a drift in the direction perpendicular to the direction of consolidating two ruled line elements and/or a threshold value for the number of consolidated ruled line elements; and

the extraction section being is adapted to select a plurality of ruled line elements that make the consolidation parameter to be found within the parameter range as ruled line candidate.

19. The apparatus according to claim 16, wherein

the ruled line is a solid ruled line;

and

the extraction section is adapted to divide a document image expressed by a binary system into a plurality of regions, select regions that make the element parameter to be found within the parameter range out of the regions as ruled line elements and consolidate the ruled line elements to generate a ruled line candidate.

20. A ruled line extracting method of extracting a ruled line in a document image of a document, the method comprising:

using an extraction section for extracting a ruled line candidate from the document image by executing a labeling process on the document image and selecting the ruled line candidate which is a black pixel link component satisfying a first requirement predefined to be met by figures of elements of the ruled lines;

using a judging section for judging if the ruled line candidate is stable or unstable according to the structural stability of the ruled line candidate extracted in the extracting;

using a requirement determination section for determining a second requirement to be met by the figures of the elements of the ruled line different from the first requirement according to the ruled line candidate judged as stable in the judging and the first requirement; and

using a re-extraction section for re-extracting a ruled line candidate according to the second requirement determined in the determining.