Image processing device, image processing method, program for image processing device, recording medium, and image display device

• US 9,269,124 B2
• Filed: 12/18/2012
• Issued: 02/23/2016
• Est. Priority Date: 12/19/2011
• Status: Active Grant

• Current Assignee: Dai Nippon Printing Company Limited
• Original Assignee: Dai Nippon Printing Company Limited
• Inventors: Yagi, Takuya, Yoshino, Kyoji, Inagaki, Koji
• Primary Examiner(s): Wu, Jingge
• Application Number:
  US14/366,005
• Publication Number:
  US 20140314336A1
• Time in Patent Office: 1,162 Days
• US Class Current: 1/1
• CPC Class Codes: G06T 3/047 Fisheye or wide-angle transformations
• CPC Class Codes: G06T 3/12 Panospheric to cylindrical image transformations
• CPC Class Codes: H04N 1/3878 Skew detection or correction
• CPC Class Codes: H04N 23/58 Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
• CPC Class Codes: H04N 23/81 for suppressing or minimising disturbance in the image signal generation

Abstract

A distorted image (S) is acquired through a photographing operation using a wide-angle lens or an omnidirectional mirror. A cutting reference point (P) for cutting a partial cut region from the distorted image is set. The cut region is set according to the cutting reference point. An eye vector (n) corresponding to the cutting reference point is set with a photographing viewpoint of the distorted image as a base point. The cut region is shifted by a predetermined distance from the cutting reference point. The shifted cut region is transformed through image transformation to transform the distorted image into a planar regular image (T′) according to the eye vector. The shifted cut region (E′) is transformed.

Claims

1. An image processing device comprising:

a distorted image acquiring unit that acquires a distorted image through a photographing operation using a wide-angle lens or an omnidirectional mirror;

a cutting reference point setting unit that sets a cutting reference point for cutting a partial cut region from the distorted image;

a cut region setting unit that sets the cut region according to the cutting reference point;

an eye vector setting unit that sets an eye vector corresponding to the cutting reference point, with a photographing viewpoint of the distorted image as a base point;

an offset unit that shifts the cut region by a predetermined distance from the cutting reference point; and

an image transforming unit that transforms the shifted cut region through image transformation to transform the distorted image into a planar regular image according to the eye vector.

2. The image processing device according to claim 1, further comprising:

a virtual spherical surface setting unit that sets a virtual spherical surface with the center of the distorted image as a center, wherein the eye vector setting unit sets an eye vector facing an intersection between the virtual spherical surface and a straight line orthogonal to a plane including the distorted image and passing through the cutting reference point from the center of the virtual spherical surface.

3. The image processing device according to claim 1, wherein

the eye vector setting unit receives a parameter to specify the eye vector and sets the eye vector,

the cut region setting unit sets a region of the planar regular image corresponding to the cut region within a surface orthogonal to the eye vector at an intersection therebetween in the direction of the eye vector,

the offset unit shifts the set region of the planar regular image within the surface orthogonal to the eye vector, and

the image transforming unit finds a pixel value of the distorted image corresponding to each point of the shifted region of the planar regular image according to the eye vector, and sets the found pixel value of the distorted image to a pixel value of the planar regular image.

4. The image processing device according to claim 3, wherein

the surface orthogonal to the eye vector comprises a surface of a cylinder.

5. The image processing device according to claim 1, wherein

the eye vector setting unit sets a plurality of eye vectors,

the cut region setting unit sets a cut region according to each of the eye vectors,

the image transforming unit transforms the cut region into a planar regular image, and

the planar regular image found by the image transforming unit is displayed on a single displaying unit.

9. The image processing device according to claim 2, wherein

the eye vector setting unit receives a parameter to specify the eye vector and sets the eye vector,

the cut region setting unit sets a region of the planar regular image corresponding to the cut region within a surface orthogonal to the eye vector at an intersection therebetween in the direction of the eye vector,

the offset unit shifts the set region of the planar regular image within the surface orthogonal to the eye vector, and

the image transforming unit finds a pixel value of the distorted image corresponding to each point of the shifted region of the planar regular image according to the eye vector, and sets the found pixel value of the distorted image to a pixel value of the planar regular image.

10. The image processing device according to any one of claim 2, wherein

the eye vector setting unit sets a plurality of eye vectors,

the cut region setting unit sets a cut region according to each of the eye vectors,

the image transforming unit transforms the cut region into a planar regular image, and

the planar regular image found by the image transforming unit is displayed on a single displaying unit.

11. The image processing device according to any one of claim 3, wherein

the eye vector setting unit sets a plurality of eye vectors,

the cut region setting unit sets a cut region according to each of the eye vectors,

the image transforming unit transforms the cut region into a planar regular image, and

the planar regular image found by the image transforming unit is displayed on a single displaying unit.

12. The image processing device according to any one of claim 4, wherein

the eye vector setting unit sets a plurality of eye vectors,

the cut region setting unit sets a cut region according to each of the eye vectors,

the image transforming unit transforms the cut region into a planar regular image, and

the planar regular image found by the image transforming unit is displayed on a single displaying unit.

13. The image processing device according to any one of claim 9, wherein

the eye vector setting unit sets a plurality of eye vectors,

the cut region setting unit sets a cut region according to each of the eye vectors,

the image transforming unit transforms the cut region into a planar regular image, and

the planar regular image found by the image transforming unit is displayed on a single displaying unit.

6. An image processing method, which is performed by an image processing device to process an image, the image processing method comprising:

a step of acquiring a distorted image through a photographing operation using a wide-angle lens or an omnidirectional mirror;

a step of setting a cutting reference point for cutting a partial cut region from the distorted image;

a step of setting the cut region according to the cutting reference point;

a step of setting an eye vector corresponding to the cutting reference point, with a photographing viewpoint of the distorted image as a base point;

a step of shifting the cut region by a predetermined distance from the cutting reference point; and

a step of transforming the shifted cut region through image transformation to transform the distorted image into a planar regular image according to the eye vector.

7. A non-transitory recording medium having stored therein a computer-readable program for an image processing device, which causes a computer to function as:

a distorted image acquiring unit that acquires a distorted image through a photographing operation using a wide-angle lens or an omnidirectional mirror;

a cutting reference point setting unit that sets a cutting reference point for cutting a partial cut region from the distorted image;

a cut region setting unit that sets the cut region according to the cutting reference point;

an eye vector setting unit that sets an eye vector corresponding to the cutting reference point, with a photographing viewpoint of the distorted image as a base point;

an offset unit that shifts the cut region by a predetermined distance from the cutting reference point; and

an image transforming unit that transforms the shifted cut region through image transformation to transform the distorted image into a planar regular image according to the eye vector.

8. An image display device comprising:

a distorted image acquiring unit that acquires a distorted image through a photographing operation using a wide-angle lens or an omnidirectional mirror;

a cutting reference point setting unit that sets a cutting reference point for cutting a partial cut region from the distorted image;

a cut region setting unit that sets the cut region according to the cutting reference point;

an eye vector setting unit that sets an eye vector corresponding to the cutting reference point, with a photographing viewpoint of the distorted image as a base point;

an offset unit that shifts the cut region by a predetermined distance from the cutting reference point;

an image transforming unit that transforms the shifted cut region through image transformation to transform the distorted image into a planar regular image according to the eye vector; and

a displaying unit that displays the planar regular image acquired through the image transforming unit.