Image processing device and image processing method

• US 9,218,537 B2
• Filed: 08/01/2013
• Issued: 12/22/2015
• Est. Priority Date: 09/21/2012
• Status: Active Grant

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Moteki, Atsunori, Matsuda, Takahiro, Murase, Taichi, Suzuki, Genta
• Primary Examiner(s): Patel, Nirav G
• Assistant Examiner(s): GILLIARD, DELOMIA L
• Application Number:
  US13/956,794
• Publication Number:
  US 20140086488A1
• Time in Patent Office: 873 Days
• Field of Search: 382/182
• US Class Current: 1/1
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/187 involving region growing; involving region merging; involving connected component labelling
• CPC Class Codes: G06T 7/248 involving reference images or patches
• CPC Class Codes: G06V 30/224 of printed characters having additional code marks or containing code marks
• CPC Class Codes: G06V 30/418 Document matching, e.g. of document images

Abstract

An image processing device includes a processor; and a memory which stores a plurality of instructions which, when executed by the processor, cause the processor to execute: acquiring a picked image; selecting pixels, which are adjacent to each other, to be connected based on value of the pixels in the image; generating a pixel connected area which includes the connected pixels; extracting a feature point from an outer edge of the pixel connected area; and calculating a moved amount of the feature point on the basis of the feature point of a plurality of images that have been picked at the first time and the second time by the acquiring.

Claims

1. An image processing device comprising:

a processor; and

a memory which stores a plurality of instructions which, when executed by the processor, cause the processor to execute;

acquiring a picked image;

selecting pixels, which are adjacent to each other, to be connected based on value of the pixels in the image;

generating a pixel connected area which includes the connected pixels, the generating including setting of an initial kernel size as a parameter used for generating the pixel connected area, performing opening on pixels in the initial kernel size, determining a rate of change in a number of pixels in the initial kernel size as a result of the opening, comparing the rate of change to a threshold value, and setting the initial kernel size as a desired kernel size or incrementing the initial kernel size until the desired kernel size is reached based on the comparing;

extracting a feature point from an outer edge of the pixel connected area; and

calculating a moved amount of the feature point on the basis of the feature point of a plurality of images that have been picked at the first time and the second time by the acquiring.

2. The device according to claim 1, wherein the instructions, when executed by the processor, further cause the processor to execute:

converting a plurality of pixels included in the image into binary pixels;

in either one of binary pixels, connecting pixels which are adjacent to each other and are of the same value.

3. The device according to claim 2,

wherein the connecting connects pixels which are adjacent to each other by expanding, or by both expanding and contracting, one of the binary pixels.

4. The device according to claim 2,

wherein the generating repeatedly expands or contracts while changing a size of a processing area to be dilated or eroded and generates the pixel connected area in accordance with a rate of change of the pixels.

5. The device according to claim 1,

wherein the image includes a character;

and

wherein an outer edge of the pixel connected area includes a feature of an outer edge of a shape of the character.

6. The device according to claim 1,

wherein the acquiring acquires a reference point included in the image;

and

wherein the calculating calculates relative positions of an image pickup element which picks up the image and the reference point on the basis of a moved amount of the feature point.

7. The device according to claim 4,

wherein the generating defines an initial value of the size of the processing area to generate the pixel connected area in accordance with the moved amount of the feature point.

8. The device according to claim 2,

wherein the converting defines an arrangement area of the plurality of pixels with respect to the image and replaces pixels in an inner area which is not in contact with an outer edge of the arrangement area with the pixels which are dilated or eroded.

9. The device according to claim 6, wherein the instructions, when executed by the processor, further cause the processor to execute:

displaying additional information of the image,

wherein the acquiring acquires specifying information which uniquely specifies a respective image included in the plurality of the image; and

wherein the displaying displays the additional information of the image correlated with the specifying information in accordance with the relative position.

10. The device according to claim 9, wherein the instructions, when executed by the processor, further cause the processor to execute:

storing the specifying information and the additional information that accessed at least by the acquiring or the displaying.

11. An image processing method comprising:

acquiring a picked image;

converting a plurality of pixels included in the image into binary pixels;

selecting pixels, which are adjacent to each other, to be connected based on value of the pixels in the image;

generating a pixel connected area which includes the connected pixels, the generating including setting of an initial kernel size as a parameter used for generating the pixel connected area, performing opening on pixels in the initial kernel size, determining a rate of change in a number of pixels in the initial kernel size as a result of the opening, comparing the rate of change to a threshold value, and setting the initial kernel size as a desired kernel size or incrementing the initial kernel size until the desired kernel size is reached based on the comparing;

extracting, by a computer processor, a feature point from an outer edge of the pixel connected area; and

calculating a moved amount of the feature point on the basis of the feature point of a plurality of images that have been picked at the first time and the second time by the acquiring.

12. The method according to claim 11, wherein the instructions, when executed by the processor, further cause the processor to execute:

converting a plurality of pixels included in the image into binary pixels;

in either one of binary pixels, connecting pixels which are adjacent to each other and are of the same value.

13. The method according to claim 12,

wherein the connecting connects pixels which are adjacent to each other by expanding, or by both expanding and contracting, one of the binary pixels.

14. The method according to claim 12,

wherein the generating repeatedly expands or contracts while changing a size of a processing area to be dilated or eroded and generates the pixel connected area in accordance with a rate of change of the pixels.

15. The method according to claim 11,

wherein the image includes a character;

and

wherein an outer edge of the pixel connected area includes a feature of an outer edge of a shape of the character.

16. The method according to claim 11,

wherein the acquiring acquires a reference point included in the image;

and

wherein the calculating calculates relative positions of an image pickup element which picks up the image and the reference point on the basis of a moved amount of the feature point.

17. The method according to claim 14,

wherein the generating defines an initial value of the size of the processing area to generate the pixel connected area in accordance with the moved amount of the feature point.

18. The method according to claim 12,

wherein the converting defines an arrangement area of the plurality of pixels with respect to the image and replaces pixels in an inner area which is not in contact with an outer edge of the arrangement area with the pixels which are dilated or eroded.

19. The method according to claim 16, wherein the instructions, when executed by the processor, further cause the processor to execute:

displaying additional information of the image,

wherein the acquiring acquires specifying information which uniquely specifies a respective image included in the plurality of the image; and

wherein the displaying displays the additional information of the image correlated with the specifying information in accordance with the relative position.

20. A non-transitory computer-readable storage medium storing image processing program that causing a computer to execute a process comprising:

acquiring a picked image;

converting a plurality of pixels included in the image into binary pixels;

selecting pixels, which are adjacent to each other, to be connected based on value of the pixels in the image;

generating a pixel connected area which includes the connected pixels, the generating including setting of an initial kernel size as a parameter used for generating the pixel connected area, performing opening on pixels in the initial kernel size, determining a rate of change in a number of pixels in the initial kernel size as a result of the opening, comparing the rate of change to a threshold value, and setting the initial kernel size as a desired kernel size or incrementing the initial kernel size until the desired kernel size is reached based on the comparing;

extracting a feature point from an outer edge of the pixel connected area; and

calculating a moved amount of the feature point on the basis of the feature point of a plurality of images that have been picked at the first time and the second time by the acquiring.