TEXT LINE FRAGMENTS FOR TEXT LINE ANALYSIS

• US 20150178255A1
• Filed: 12/16/2014
• Published: 06/25/2015
• Est. Priority Date: 12/20/2013
• Status: Active Application

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Blennerhassett, Michael John
• Application Number:
  US14/572,637
• Publication Number:
  US 20150178255A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06V 30/1478 of characters or characters lines
• CPC Class Codes: G06V 30/158 using character size, text spacings or pitch estimation

Abstract

A method of determining a local text line flow from an image of a document is disclosed. The method receives a plurality of text connected components from the image and forms text line fragments of the text connected components based on interconnection features between neighbouring text connected components of the plurality of text connected components. The text line fragments have a predetermined maximum aspect ratio. The method then determines the local text line flow for the document based on a properties of the text line fragments.

Claims

1. A method of determining a local text line flow from an image of a document, the method comprising:

receiving a plurality of text connected components from the image;

forming text line fragments of the text connected components based on interconnection features between neighbouring text connected components of the plurality of text connected components, the text line fragments having a predetermined maximum aspect ratio; and

determining the local text line flow for the document based on a properties of the text line fragments.

2. A method according to claim 1, wherein each of the text line fragments are formed using text line fragments having an aspect ratio within the predetermined maximum aspect ratio.

3. A method according to claim 1, wherein the forming comprises at least one of merging text connected components to form a text line fragment, and splitting text line fragments into multiple text line fragments.

4. A method according to claim 1, wherein the forming comprises:

merging text connected components to form text line fragments; and

splitting text line fragments to provide for the text line fragments to have an aspect ratio within the predetermined maximum aspect ratio.

5. A method according to claim 1, further comprising determining the aspect ratio of a text line fragment using an image moment of the text line fragment.

6. A method according to claim 5, wherein the determining of the aspect ratio comprises calculating second order image moments using pixels of connected components contained in the text line fragment.

7. A method according to claim 5, wherein the determining of the aspect ratio comprises calculating image moments by summing pixel values weighted by position in the text line fragment.

8. A method according to claim 7 wherein

the zero'"'"'th order moment is the sum of the number of a set of pixels formed by one of an area of a connected components or a group of connected components,

the one-zero and the zero-one order image moments are the sum of a set of pixels weighted by x-position and y-position respectively.

9. A method according to claim 8 further comprising dividing the one-zero and zero-one image moments by the zero'"'"'th moment to provide the x-position and y-position respectively for the centroid of a set of pixels.

10. A method according to claim 9 comprising calculating the aspect ratio of a set of pixels using central moments, the central moments being calculated by summing pixels weighted by position which is offset by the centroid.

11. A method according to claim 5, comprising calculating the aspect ratio for a set of pixels by calculating the smallest rotated rectangle that contains all the pixels of the set, and using a ratio of the width and height of the rotated rectangle as the aspect ratio for the set of pixels.

12. A method according to claim 5, comprising approximating the aspect ratio of a text line fragment by counting the number of contained text connected components.

13. A method according to claim 1, wherein the determining of the local text line flow comprises generating a Delaunay triangulation from interconnection features associate with the text line fragments and calculating a curst for points in the triangulation, and using the crust to form text lines from the text line fragments.

14. A method according to claim 13, wherein the forming of text lines comprises associating text line fragments within a distance threshold of a line of the crust.

15. A method according to claim 13, wherein the forming of text lines comprises associating text line fragments within an angle threshold of a line of the crust.

16. A method of determining a local text line flow from an image of a document, the method comprising:

receiving a plurality of text CCs from the image;

forming text line fragments of the text CCs based on interconnection features between neighbouring text CCs of the plurality of text CCs;

forming sub-text line fragments by splitting the formed text line fragments according to an aspect ratio of the formed text line fragments and a comparison of a size of the text line fragment with a size of the text CCs forming the text line fragment; and

determining the local text line flow for the document based on a centre of each of the sub-text line fragments and a direction of an axis of each of the sub-text line fragments.

17. A non-transitory computer readable storage medium having a program recorded thereon, the program being executable by computerised apparatus to determine a local text line flow from an image of a document, the program comprising:

code for receiving a plurality of text connected components from the image;

code for forming text line fragments of the text connected components based on interconnection features between neighbouring text connected components of the plurality of text connected components, the text line fragments having a predetermined maximum aspect ratio; and

code for determining the local text line flow for the document based on a properties of the text line fragments.

18. A non-transitory computer readable storage medium having a program recorded thereon, the program being executable by computerised apparatus to determine a local text line flow from an image of a document, the program comprising:

code for receiving a plurality of text CCs from the image;

code for forming text line fragments of the text CCs based on interconnection features between neighbouring text CCs of the plurality of text CCs;

code for forming sub-text line fragments by splitting the formed text line fragments according to an aspect ratio of the formed text line fragments and a comparison of a size of the text line fragment with a size of the text CCs forming the text line fragment; and

code for determining the local text line flow for the document based on a centre of each of the sub-text line fragments and a direction of an axis of each of the sub-text line fragments.

19. Computerised apparatus comprising a processor and a memory, the memory having recorded therein a program executable by the processor for determining a local text line flow from an image of a document, the program being configured to implement the method steps of:

receiving a plurality of text connected components from the image;

forming text line fragments of the text connected components based on interconnection features between neighbouring text connected components of the plurality of text connected components, the text line fragments having a predetermined maximum aspect ratio; and

determining the local text line flow for the document based on a properties of the text line fragments.