Image generation apparatus, image generation method and image generation program

• US 20070009137A1
• Filed: 09/12/2006
• Published: 01/11/2007
• Est. Priority Date: 03/16/2004
• Status: Abandoned Application

• Current Assignee: Olympus Corporation
• Original Assignee: Olympus Corporation
• Inventors: Miyoshi, Takashi, Iwaki, Hidekazu, Kosaka, Akio
• Application Number:
  US11/519,333
• Publication Number:
  US 20070009137A1
• Time in Patent Office: Days
• US Class Current: 382/104
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 1/31 providing stereoscopic vision
• CPC Class Codes: B60R 2300/102 using 360 degree surveillance camera system
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/302 combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/305 merging camera image with lines or icons
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/8033 for pedestrian protection
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: G06T 17/10 Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
• CPC Class Codes: G06T 2200/08 involving all processing steps from image acquisition to 3D model generation
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection

Abstract

Provided are an image generation apparatus, image generation method and image generation program which are capable of displaying the relationship between a vehicle, et cetera, and an imaged image of the subject of monitoring in a manner intuitively comprehensible when displaying the monitoring subject, such as a vehicle, shop, surrounding area of a house, or street, by further comprising a movement information calculation unit for calculating movement information relating to a movement of an camera unit installation body based on either of viewpoint conversion image data generated by a viewpoint conversion unit, imaged image data expressing an imaged image, a spatial model, or mapped spatial data, and by a display unit displaying an image of an camera unit installation body model corresponding to the camera unit installation body and also movement information calculated by a movement information calculation unit.

Claims

1. An image generation apparatus comprising one or a plurality of camera units, being mounted onto an camera unit installation body, for imaging an image;

a spatial reconstruction unit for mapping an image imaged by the camera unit in a spatial model;

a viewpoint conversion unit for generating viewpoint conversion image data viewed from the arbitrary virtual view point in a three-dimensional space based on spatial data mapped by the spatial reconstruction unit; and

a display unit for displaying an image viewed from the arbitrary virtual view point in the three-dimensional space based on viewpoint conversion image data generated by the viewpoint conversion unit, wherein

the image generation apparatus further comprises

a movement information calculating unit for calculating movement information relating to a movement of the camera unit installation body based on either of viewpoint conversion data generated by the viewpoint conversion unit, the spatial model or the mapped spatial data, wherein

the display unit displays an image of an camera unit installation body model corresponding to the camera unit installation body and also the movement information calculated by the movement information calculating unit.

2. The image generation apparatus according to claim 1, wherein

said movement information is either of movement direction information for indicating a direction of movement, movement track information for indicating a predicted movement track, movement speed information for indicating a speed of movement, or movement destination information relating to a compass direction, place name landmark, et cetera, of a predicted movement destination.

3. The image generation apparatus according to claim 1, further comprising

a collision probability calculation unit for calculating a probability of said camera unit installation body model colliding with said spatial model based on either of said viewpoint conversion image data generated by said viewpoint conversion unit, said imaged image data expressing said imaged image, said spatial model, or said mapped spatial data, all of which are corresponding to respectively different clock times, wherein

said display unit displays a part having a probability of collision calculated by the collision probability calculation unit by a different display pattern in an image of the camera unit installation body model which is displayed by superimposing with an image by the viewpoint conversion image data generated by the viewpoint conversion unit.

4. The image generation apparatus according to claim 3, wherein

said display pattern is at least either one of a color, a bordering or a warning icon.

5. The image generation apparatus according to claim 1, further comprising

a blind spot calculation unit for calculating blind spot information which indicates a zone becoming a blind spot for a predetermined place of said camera unit installation body based on a camera unit installation body model expressed by data corresponding to the camera unit installation body, wherein

said display unit displays the camera unit installation body model and also the blind spot information calculated by the blind spot calculation unit.

6. The image generation apparatus according to claim 1, further comprising

a second body recognition unit for recognizing a second body different from said camera unit installation body based on either of said viewpoint conversion image data converted by said viewpoint conversion unit, said imaged image data expressing said imaged image, said spatial model, or said mapped spatial data;

and

a second body blind spot calculation unit for calculating second body blind spot information which is recognized by the second body recognition unit and indicates a zone becoming a blind spot for the second body based on other body data for indicating data relating to a predetermined second body, wherein

said display unit displays said camera unit installation body model and also the blind spot information relating to the aforementioned second body calculated by the second body blind spot calculation unit.

7. The image generation apparatus according to claim 1, wherein

said camera unit installation body or said second body is at least either one of a vehicle, a pedestrian, a building or a road structure body.

8. An image generation apparatus, comprising:

one or a plurality of camera units, being mounted onto an camera unit installation body, for imaging an image;

a second body recognition unit for recognizing a second body different from the camera unit installation body based on imaged data imaged by the camera unit;

a second body blind spot calculation unit for calculating second body blind spot information which is recognized by the second body recognition unit and indicates a zone becoming a blind spot for the second body based on second body data for indicating data relating to a predetermined second body;

a display unit for displaying the camera unit installation body model and also the blind spot information calculated by the second body blind spot calculation unit.

9. The image generation apparatus according to claim 8, wherein

said camera unit installation body or said second body is at least either one of a vehicle, a pedestrian, a building or a road structure body.

10. An image generation method, comprising the steps of

mapping, in a spatial model, an image imaged by one or a plurality of camera unit which are mounted onto an camera unit installation body;

generating viewpoint conversion image data viewed from the arbitrary virtual view point in a three-dimensional space based on the mapped spatial data; and

displaying an image viewed from the arbitrary virtual view point in the three-dimensional space based on the generated viewpoint conversion image data, wherein the image generation method further comprises the step of

calculating movement information relating to a movement of the camera unit installation body based on either of the generated viewpoint conversion data, the imaged image data expressing the imaged image, the spatial model or the mapped spatial data, wherein

the displaying displays an image of the camera unit installation body model and also the movement information together with the viewpoint conversion image.

11. An image generation program for making a computer carry out the procedures of

mapping, in a spatial model, an image imaged by one or a plurality of camera unit which are mounted onto an camera unit installation body;

generating viewpoint conversion image data viewed from the arbitrary virtual view point in a three-dimensional space based on the mapped spatial data; and

displaying an image viewed from the arbitrary virtual view point in the three-dimensional space based on the generated viewpoint conversion image data, wherein the image generation program further comprises the procedure of

calculating movement information relating to a movement of the camera unit installation body based on either of the generated viewpoint conversion data, the imaged image data expressing the imaged image, the spatial model or the mapped spatial data, wherein

the displaying displays an image of the camera unit installation body model and also the movement information together with the viewpoint conversion image.

12. An image generation method for being executed by a computer which carries out the processing of

imaging an image by one or a plurality of camera unit which are mounted onto an camera unit installation body;

recognizing a second body different from the camera unit installation body based on the imaged image data;

calculating second body blind spot information which indicates a zone becoming a blind spot of the recognized second body based on second body data which indicates data relating to a predetermined second body; and

displaying the calculated second body blind spot information together with the camera unit installation body model.

13. An image generation program for making a computer carry out the procedures of

imaging an image by one or a plurality of camera unites which are mounted on an camera unit installation body;

recognizing second body different from the camera unit installation body based on the imaged image data;

calculating second body blind spot information which indicates a zone becoming a blind spot of the recognized second body based on second body data which indicates data relating to a predetermined second body; and

displaying the calculated second body blind spot information together with the camera unit installation body model.