IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND STORAGE MEDIUM

• US 20160180536A1
• Filed: 03/01/2016
• Published: 06/23/2016
• Est. Priority Date: 09/20/2013
• Status: Active Grant

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: YAMAGUCHI, Nobuyasu
• Granted Patent: US 9,704,246 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/20164 Salient point detection; Corner detection
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 7/12 Edge-based segmentation
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 10/24 Aligning, centring, orientation detection or correction of the image
• CPC Class Codes: G06V 10/245 by locating a pattern; Special marks for positioning
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

An image processing apparatus, includes a processor configured to obtain a marker image including a first pixel area including a first image indicating a shape of an outer frame and a second pixel area and a second image arranged within the outer frame, extract an intersecting point of a first line segment in parallel with a boundary between the first pixel area and the second pixel area which are adjacent to each other along a predetermined direction and a second line segment in parallel with a boundary between the first pixel area and the second pixel area which are adjacent to each other along a direction perpendicular to the predetermined direction, a first apex indicating an apex of four corners of the outer frame, and a second apex included in the second image, and identify a display position using the intersecting point, the first apex, or the second apex.

Claims

1. An image processing apparatus, comprising:

a memory; and

a processor coupled to the memory and configured to;

obtain an image of a marker that includes a first pixel area and a second pixel area having mutually different color tones and is used to identify display information and a reference position for displaying the display information, the first pixel area including a first image indicating a shape of an outer frame of the first pixel area and a second image arranged within the outer frame,

extract, from the image of the marker, an intersecting point of a first line segment in parallel with a boundary between the first pixel area and the second pixel area which are adjacent to each other along a predetermined direction and a second line segment in parallel with a boundary between the first pixel area and the second pixel area which are adjacent to each other along a direction perpendicular to the predetermined direction, a first apex indicating an apex of four corners of the outer frame, and a second apex included in the second image, and

identify a position for displaying the display information while the intersecting point, the first apex, or the second apex is set as the reference position.

2. The image processing apparatus according to claim 1, wherein

the first line segment is identified by a first boundary obtained by being adjacent to the first pixel area and the second pixel area in a stated order towards the predetermined direction and a second boundary obtained by being adjacent to the second pixel area and the first pixel area in a stated order towards the predetermined direction, and

the second line segment is identified by a third boundary obtained by being adjacent to the first pixel area and the second pixel area in a stated order towards the direction perpendicular to the predetermined direction and a fourth boundary obtained by being adjacent to the second pixel area and the first pixel area in a stated order towards the direction perpendicular to the predetermined direction.

3. The image processing apparatus according to claim 2, wherein

the first line segment is in parallel with the first boundary and the second boundary and is identified based on a midpoint of the first boundary and the second boundary, and

the second line segment is in parallel with the third boundary and the fourth boundary and is identified based on a midpoint of the third boundary and the fourth boundary.

4. The image processing apparatus according to claim 1, wherein

the second image includes an image of a polygonal shape, and

the second apex includes an apex of the polygonal shape.

5. The image processing apparatus according to claim 1, wherein the processor is configured to

identify the reference position based on descending priorities set with respect to the intersecting point, the first apex, and the second apex in a stated order.

6. The image processing apparatus according to claim 5, wherein

the priorities include weighting coefficients, and

the processor is configured to apply the weighting coefficients to the intersecting point, the first apexes, and the second apexes to calculate the reference position.

7. The image processing apparatus according to claim 5, wherein the processor is configured to:

extract a long side formed by a plurality of second apexes included in the image of the polygonal shape and a short side shorter than the long side, and

set the priorities with respect to the plurality of second apexes based on a length of the short side.

8. The image processing apparatus according to claim 7, wherein the processor is configured to

set the priorities with respect to the plurality of second apexes in a manner that a higher priority is assigned as a length of the long side is longer in a case where two or more of the short sides having the same length are extracted.

9. The image processing apparatus according to claim 1, wherein

the second image includes an image of one or more checkered shapes formed by part of the first pixel area and part of the second pixel area, and

the processor is configured to extract a center point of the one or more of the checkered shapes as the intersecting point.

10. The image processing apparatus according to claim 9, wherein the processor is configured to:

extract edge sides of each of of the one or more of the checkered shape, and

set the priorities with respect to the plurality of intersecting points extracted from the one or more checkered shapes in a manner that a higher priority is assigned as a length of the edge side is longer.

11. The image processing apparatus according to claim 1, wherein the processor is configured to:

extract a marker ID from the marker,

generate a marker pattern corresponding to the marker ID, and

extract the intersecting point, the first apex, and the second apex by using the marker pattern.

12. An image processing method executed by a processor included in an image processing apparatus, the method comprising:

obtaining an image of a marker that includes a first pixel area and a second pixel area having mutually different color tones and is used to identify display information and a reference position for displaying the display information, the first pixel area including a first image indicating a shape of an outer frame of the first pixel area and a second image arranged within the outer frame;

extracting, from the image of the marker, an intersecting point of a first line segment in parallel with a boundary between the first pixel area and the second pixel area which are adjacent to each other along a predetermined direction and a second line segment in parallel with a boundary between the first pixel area and the second pixel area which are adjacent to each other along a direction perpendicular to the predetermined direction, a first apex indicating an apex of four corners of the outer frame, and a second apex included in the second image; and

identifying a position for displaying the display information while the intersecting point, the first apex, or the second apex is set as the reference position.

13. A non-transitory computer-readable storage medium storing a program that causes a processor included in a computer to execute a process, the process comprising:

obtaining an image of a marker that includes a first pixel area and a second pixel area having mutually different color tones and is used to identify display information and a reference position for displaying the display information, the first pixel area including a first image indicating a shape of an outer frame of the first pixel area and a second image arranged within the outer frame;

extracting, from the image of the marker, an intersecting point of a first line segment in parallel with a boundary between the first pixel area and the second pixel area which are adjacent to each other along a predetermined direction and a second line segment in parallel with a boundary between the first pixel area and the second pixel area which are adjacent to each other along a direction perpendicular to the predetermined direction, a first apex indicating an apex of four corners of the outer frame, and a second apex included in the second image; and

identifying a position for displaying the display information while the intersecting point, the first apex, or the second apex is set as the reference position.