Image processing method and apparatus for determining orientations based on reliabilities of a plurality of portions into which image has been divided or for determining orientations of portions of image divided by user's input so as to recognize characters for each divided portion of image, image forming apparatus, and storage medium

• US 8,532,434 B2
• Filed: 06/11/2010
• Issued: 09/10/2013
• Est. Priority Date: 06/15/2009
• Status: Active Grant

• Current Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Morimoto, Atsuhisa
• Primary Examiner(s): Chu, Randolph I
• Application Number:
  US12/814,144
• Publication Number:
  US 20100316295A1
• Time in Patent Office: 1,187 Days
• Field of Search: None
• US Class Current: 382/290
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/1463 Orientation detection or correction, e.g. rotation of multiples of 90 degrees
• CPC Class Codes: G06V 30/414 Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text

Abstract

An image processing apparatus includes: a division section for dividing input image data into portions; an orientation determining section for calculating reliabilities of directions of image data of each portion when the directions are regarded as orientations, and setting an orientation with the highest reliability as an orientation of each portion; a display control section for generating display image data including an image of a target portion whose reliability of an orientation is less than a predetermined value and images of designation regions from which a user'"'"'s input to designate the orientation of the target portion is entered; and a character recognition section for recognizing characters of each portion in such a manner that the orientation is designated from the designation regions or set by the orientation determining section. This allows prompt recognition of characters of a portion whose reliability of orientation is low, in accordance with a right orientation.

Claims

1. An image processing apparatus, comprising at least a processor that includes:

a division section for dividing input image data into a plurality of portions;

an orientation determining section for calculating reliabilities of upper-, lower-, left-, and right-directions of image data of each of the plurality of portions when the upper-, lower-, left-, and right-directions are regarded as orientations, and setting an orientation with the highest reliability out of the calculated reliabilities as an orientation of said each of the plurality of portions;

a display control section for, when the plurality of portions whose orientations are set by the orientation determining section include a target portion whose reliability of an orientation is less than a predetermined value and a non-target portion whose reliability of an orientation is not less than the predetermined value, generating display image data used when a display device displays at least an image of the target portion and images of designation regions by one of which a user'"'"'s input to designate the orientation of the target portion is entered; and

a character recognition section for recognizing characters of the plurality of portions in such a manner that the orientation of the target portion is an orientation designated from one of the designation regions and the orientation of the non-target portion is an orientation set by the orientation determining section.

2. The image processing apparatus as set forth in claim 1, wherein the display control section includes a display image generating section for generating the image of the target portion and the images of the designation regions and a display image output section for enlarging the image of the target portion and the images of the designation regions and outputting the enlarged image of the target portion and the enlarged images of the designation regions as the display image data.

3. The image processing apparatus as set forth in claim 2, wherein the display control section includes a rotation process section for rotating the display image data in accordance with the user'"'"' input to designate the orientation from one of the designation regions, and for outputting the rotated display image data as the display image data.

4. The image processing apparatus as set forth in claim 1, wherein the character recognition section recognizes characters of the non-target portion after rotating the non-target portion in accordance with the orientation set by the orientation determining section, and recognizes characters of the target portion after rotating the target portion in accordance with the user'"'"'s input to designate the orientation from one of the designation regions.

5. The image processing apparatus as set forth in claim 1, wherein the display control section positions the designation regions at an upper side, a lower side, a left side, and a right side of the target portion, respectively, and designs the designation regions to have different sizes and/or different colors in accordance with differences between reliabilities of upper-, lower-, left-, and right-directions which are calculated by the orientation determining section.

6. The image processing apparatus as set forth in claim 5, wherein the display control section designs the designation regions to have different sizes in accordance with differences between reliabilities of upper-, lower-, left-, and right-directions which are calculated by the orientation determining section, so that the size of the designation region is larger as the designation region corresponds to a direction with higher reliability as the orientation.

7. The image processing apparatus as set forth in claim 5, wherein the display control section designs the designation regions to have different colors in accordance with differences between reliabilities of upper-, lower-, left-, and right-directions which are calculated by the orientation determining section, so that the color of the designation region is deeper as the designation region corresponds to a direction with higher reliability as the orientation.

8. An image forming apparatus, comprising:

the image processing apparatus as set forth in claim 1;

a display device for displaying the display image data; and

a printing apparatus for printing image data onto a paper sheet.

9. The image forming apparatus as set forth in claim 8, wherein

the display device is a touch-panel display device, and

the display control section accepts, as the user'"'"'s input, a user'"'"'s touching operation on a screen of the display device.

10. An image processing method, comprising the steps of:

(i) dividing input image data into a plurality of portions;

(ii) calculating reliabilities of upper-, lower-, left-, and right-directions of image data of each of the plurality of portions when the upper-, lower-, left-, and right-directions are regarded as orientations, and setting an orientation with the highest reliability out of the calculated reliabilities as an orientation of said each of the plurality of portions;

(iii) when the plurality of portions whose orientations are set in the step (ii) include a target portion whose reliability of an orientation is less than a predetermined value and a non-target portion whose reliability of an orientation is not less than the predetermined value, generating display image data used when a display device displays at least an image of the target portion and images of designation regions by one of which a user'"'"'s input to designate the orientation of the target portion is entered; and

(iv) recognizing characters of the plurality of portions in such a manner that the orientation of the target portion is an orientation designated from one of the designation regions and the orientation of the non-target portion is an orientation set in the step (ii).

11. A non-transitory computer-readable storage medium with an executable program stored thereon, wherein the program instructs a processor to perform the following steps:

(i) dividing input image data into a plurality of portions;

(ii) calculating reliabilities of upper-, lower-, left-, and right-directions of image data of each of the plurality of portions when the upper-, lower-, left-, and right-direction are regarded as orientations, and setting an orientation with the highest reliability out of the calculated reliabilities as an orientation of said each of the plurality of portions;

(iii) when the plurality of portions whose orientations are set in the step (ii) include a target portion whose reliability of an orientation is less than a predetermined value and a non-target portion whose reliability of an orientation is not less than the predetermined value, generating display image data used when a display device displays at least an image of the target portion and images of designation regions by one of which a user'"'"'s input to designate the orientation of the target portion is entered; and

(iv) recognizing characters of the plurality of portions in such a manner that the orientation of the target portion is an orientation designated from one of the designation regions and the orientation of the non-target portion is an orientation set in the step (ii).