IMAGE GENERATION DEVICE, IMAGE GENERATION METHOD, AND IMAGE GENERATION PROGRAM

• US 20100054580A1
• Filed: 11/12/2009
• Published: 03/04/2010
• Est. Priority Date: 03/11/2004
• Status: Abandoned Application

• Current Assignee: Olympus Corporation
• Original Assignee: Olympus Corporation
• Inventors: Miyoshi, Takashi, Iwaki, Hidekazu, Kosaka, Akio
• Application Number:
  US12/617,267
• Publication Number:
  US 20100054580A1
• Time in Patent Office: Days
• US Class Current: 382/154
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G08G 1/16 Anti-collision systems road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection

Abstract

The image generation device includes distance calculation means for calculating a distance between a space model and an imaging device arrangement object model which is a model such as a vehicle having a camera mounted, according to viewpoint conversion image data generated by viewpoint conversion means, captured image data representing captured image, a space model, or mapped space data. When displaying an image viewed from an arbitrary virtual viewpoint in the 3D space, the image display format is changed according to the distance calculated by the distance calculation means. When displaying a monitoring object such as a vicinity of a vehicle, a shop, a house or a city as an image viewed from an arbitrary virtual viewpoint in the 3D space, it is possible to display the monitoring object in such a manner that the relationship between the vehicle and the image of the monitoring object can be understood intuitionally.

Claims

1. An image generation device comprising:

a space reconfiguration unit for mapping images input from one or a plurality of cameras mounted on an image acquisition unit arrangement object on to a spatial model;

an image acquisition unit arrangement object movement detection unit for detecting a movement of the image acquisition unit arrangement object;

a virtual viewpoint setting unit for obtaining blind spot information specifying a blind spot for an observer operating the image acquisition unit arrangement object based on the result of the detection, and for setting a virtual viewpoint in a 3D space based on the blind spot information;

a viewpoint conversion unit for generating a virtual viewpoint image that is an image viewed from the virtual viewpoint in a 3D space by referring to the spatial data obtained by the mapping by the space reconfiguration unit; and

a display control unit for controlling a manner of display of the virtual viewpoint image.

2. The image generation device according to claim 1, wherein:

the display control unit is configured to control a display such that the blind spot can be distinguished from other portions in a virtual viewpoint image including the blind spot and portions around the blind spot.

3. The image generation device according to claim 1, wherein:

the display control unit is configured to control a display of the virtual viewpoint image such that a color of the blind spot comes out differently from that of other portions in order that the blind spot can be distinguished from other portions.

4. An image generation program for causing a computer to execute:

a space reconfiguration process of mapping images input from one or a plurality of cameras mounted on an image acquisition unit arrangement object on to a spatial model;

a viewpoint conversion process of generating a virtual viewpoint image that is an image viewed from an arbitrary virtual viewpoint in a 3D space by referring to the spatial data obtained by the mapping in the space reconfiguration process; and

a display control process of controlling a manner of display of the virtual viewpoint image in order to cause a display unit arranged on a part that is in the image acquisition unit arrangement object and that causes a blind spot for an observer to display the virtual viewpoint image corresponding to a view which can not be seen in the blind spot.

5. An image generation method comprising execution of:

a space reconfiguration step of mapping images input from one or a plurality of cameras mounted on an image acquisition unit arrangement object onto a spatial model;

a viewpoint conversion step of generating a virtual viewpoint image that is an image viewed from an arbitrary virtual viewpoint in a 3D space by referring to the spatial data obtained by the mapping in the space reconfiguration step; and

a display control step of controlling a manner of display of the virtual viewpoint image in order to cause a display unit arranged on a part which is in the image acquisition unit arrangement object and which causes a blind spot for an observer to display the virtual viewpoint image corresponding to a view which can not be seen in the blind spot.