IMAGE PROCESSING APPARATUS AND STORAGE MEDIUM STORING IMAGE PROCESSING PROGRAM

• US 20120038659A1
• Filed: 01/18/2011
• Published: 02/16/2012
• Est. Priority Date: 08/12/2010
• Status: Active Grant

• Current Assignee: Fuji Xerox Company Limited (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Xerox Company Limited (Fujifilm Holdings Corporation)
• Inventors: MATSUGUMA, Chihiro, UEJO, Hiroyoshi, OHYA, Kazuhiro, KOYANAGI, Katsuya, ADACHI, Shintaro
• Granted Patent: US 8,447,143 B2
• Time in Patent Office: Days
• US Class Current: 345/589
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/155 Removing patterns interfering with the pattern to be recognised, such as ruled lines or underlines

Abstract

An image processing apparatus that includes a character recognition component, a determining component and a generating component is provided. The determining component determines, when document data is generated that contains first data representing the document and representing the entity in which the characters are mixed and second data containing character code data of the characters recognized by the character recognition component and representing a character block displaying the characters represented by the character code data, whether to hide the character block represented by the second data behind the entity represented by the first data or to display the character block represented by the second data in front of the entity represented by the first data when the document represented by the document data is displayed, based on lightness or distribution of the lightness of a background region around the characters of the entity or the like.

Claims

1. An image processing apparatus, comprising:

a character recognition component that performs character recognition on characters mixed in an entity based on image data obtained by reading, as an image, a document containing entities in which characters are mixed;

a determining component that determines, when document data is generated that contains first data representing the document and representing the entity in which the characters are mixed and second data containing character code data of the characters recognized by the character recognition component and representing a character block displaying the characters represented by the character code data, whether to hide the character block represented by the second data behind the entity represented by the first data or to display the character block represented by the second data in front of the entity represented by the first data when the document represented by the document data is displayed, based on at least one of lightness or distribution of the lightness of a background region around the characters of the entity, a number of characters or a number of lines of the characters in the entity, lightness of a region of the characters in the entity, accuracy of the character recognition by the character recognition component, a size of the characters in the entity, or a type of the entity; and

a generating component that generates the document data for which a front/back relationship of a display between the character block and the entity when the document is displayed has been set according to a determination result of the determining component.

2. The image processing apparatus of claim 1, wherein the determining component determines to hide the character block behind the entity if the lightness of the background region around the characters of the entity is less than a first threshold value or distribution of the lightness of the background region around the characters is equal to a second threshold value or more.

3. The image processing apparatus of claim 1, wherein the determining component determines to hide the character block behind the entity if the number of characters of the characters in the entity is equal to a third threshold value or more or if the number of lines of the characters in the entity is equal to a fourth threshold value or more.

4. The image processing apparatus of claim 1, wherein the determining component determines to display the character block in front of the entity if the lightness of the region of the characters of the entity is equal to a fifth threshold value or more.

5. The image processing apparatus of claim 1, wherein the determining component determines to hide the character block behind the entity if the accuracy of the character recognition by the character recognition component is less than a sixth threshold value.

6. The image processing apparatus of claim 1, wherein the determining component determines to hide the character block behind the entity if the size of the characters in the entity is equal to a seventh threshold value or more.

7. The image processing apparatus of claim 1, wherein the determining component determines to hide the character block behind the entity if the type of the entity is a type designated as a type for hiding the character block.

8. The image processing apparatus of claim 1, wherein the determining component determines whether to hide the character block behind the entity or to display the character block in front of the entity based on a result of comparison with at least one threshold value of the lightness or the distribution of the lightness of the background region around the characters of the entity, the number of characters or the number of lines of the characters in the entity, the lightness of the region of the characters in the entity, the accuracy of the character recognition by the character recognition component, or the size of the characters in the entity, and if the type of the entity is a type designated as a type for hiding the character block, the at least one threshold value is changed in advance so that a probability of determining to hide the character block behind the entity is higher than when the type of the entity is determined not to be the type designated as a type for hiding the character block hidden.

9. The image processing apparatus of claim 1, wherein:

the determining component compares at least one of the lightness or the distribution of the lightness of the background region around the characters of the entity, the number of characters or the number of lines of the characters in the entity, the lightness of the region of the characters in the entity, the accuracy of the character recognition by the character recognition component, the size of the characters in the entity, or the type of the entity, with a threshold value or with setting information stored in a storage component and determines, based on a comparison result, whether to hide the character block behind the entity or to display the character block in front of the entity; and

the image processing apparatus further comprises a first changing component that changes the threshold value or the setting information stored in the storage component in accordance with instructions from a user wherein instructions to change the threshold value or the setting information are issued from the user via an instruction component.

10. The image processing apparatus of claim 1, wherein, if the determining component determines to hide the character block behind the entity, the generating component generates, as the second data, data representing the character block that respectively displays the characters represented by the character code data and the background region around the characters in a predetermined character color and background color and, if the determining component determines to display the character block in front of the entity, the generating component generates, as the second data, data representing the character block that respectively displays the characters represented by the character code data and the background region around the characters in colors identical or similar to the character color of the characters while mixed in the entity or a background color of the background region.

11. The image processing apparatus of claim 10, wherein:

color specifying information, specifying the character color and the background color of the character block when the determining component determines to hide the character block behind the entity, is stored in the storage component in advance; and

the image processing apparatus further comprises a second changing component that changes the color specifying information in accordance with instructions from a user in a case in which instructions to change at least one of the character color or the background color of the character block are issued from the user via an instruction component after the determining component determines to hide the character block behind the entity,

12. The image processing apparatus of claim 1, further comprising:

an input receiving component that receives input from the user of removal instruction information that instructs removal of the second data from the document data when the determination result of the determining component is a specific determination result, wherein

the generating component generates data as the document data from which the second data is removed when the input of the removal instruction information is received by the input receiving component and the determination result of the determining component matches the specific determination result provided in the removal instruction information.

13. The image processing apparatus of claim 12, wherein, when data is generated as the document data from which the second data is removed, the generating component generates character image data representing the characters while mixed in the entity as an image and generates data as the document data that contains the generated character image data, and sets the front/back relationship of the display between a character image and the entity when the document is displayed so that the character image representing the character image data is displayed in front of the entity when the document is displayed.

14. The image processing apparatus of claim 1, wherein:

at least the first data has a format capable of setting any information as attribute information of the entity; and

the image processing apparatus further comprises an attribute setting component that sets the character code data of the characters recognized by the character recognition component to the first data as the attribute information of the entity.

15. A storage medium readable by a computer, the storage medium storing a program of instructions executable by the computer to function as an image processing apparatus that includes:

a character recognition component that performs character recognition on characters mixed in an entity based on image data obtained by reading, as an image, a document containing entities in which characters are mixed;

a determining component that determines, when document data is generated that contains first data representing the document and representing the entity in which the characters are mixed and second data containing character code data of the characters recognized by the character recognition component and representing a character block displaying the characters represented by the character code data, whether to hide the character block represented by the second data behind the entity represented by the first data or to display the character block represented by the second data in front of the entity represented by the first data when the document represented by the document data is displayed, based on at least one of lightness or distribution of the lightness of a background region around the characters of the entity, a number of characters or a number of lines of the characters in the entity, lightness of a region of the characters in the entity, accuracy of the character recognition by the character recognition component, a size of the characters in the entity, or a type of the entity; and

a generating component that generates the document data for which a front/back relationship of a display between the character block and the entity when the document is displayed has been set according to a determination result of the determining component.