IMAGE GENERATION APPARATUS

• US 20110234801A1
• Filed: 02/23/2011
• Published: 09/29/2011
• Est. Priority Date: 03/25/2010
• Status: Active Grant

• Current Assignee: Fujitsu Ten Limited (DENSO Corporation)
• Original Assignee: Fujitsu Ten Limited (DENSO Corporation)
• Inventors: YAMADA, Masahiro, MATSUOKA, Azusa, TANIGUCHI, Susumu
• Granted Patent: US 8,780,202 B2
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 2300/103 using camera systems provided with artificial illumination device, e.g. IR light source
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/304 using merged images, e.g. merging camera image with stored images
• CPC Class Codes: B60R 2300/60 characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/2624 for obtaining an image which is composed of whole input images, e.g. splitscreen
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

An image display system is capable of generating a composite image that shows a surrounding area of a vehicle viewed from virtual viewpoints, by combining a plurality of shot images taken by a plurality of on-vehicle cameras that are disposed at different locations on the vehicle. The image display system changes data volumes of two shot images taken by two of the on-vehicle cameras based on a lighting mode of a lighting apparatus, the data volumes being used for an overlap area of the composite image that corresponds to the surrounding area of the vehicle where the two on-vehicle cameras can shoot in overlap. This reduces problems caused by lighting of the lighting apparatus in the overlap area of the composite image.

Claims

1. An image generation apparatus that generates an image for display on a display installed in a vehicle, the image generation apparatus comprising:

an image generator that generates a composite image showing a surrounding area of the vehicle viewed from virtual viewpoints, by combining a plurality of shot images taken by a plurality of on-vehicle cameras that are disposed at different locations on the vehicle;

a receiver that receives a signal indicating a lighting mode of a lighting apparatus included in the vehicle; and

a controller that changes data volumes of two shot images taken by two of the on-vehicle cameras based on the lighting mode of the lighting apparatus, the data volumes being used in an overlap area of the composite image that corresponds to the surrounding area of the vehicle where the two on-vehicle cameras can shoot in overlap.

2. The image generation apparatus of claim 1, wherein

the controller increases the data volume of the shot image taken by a first on-vehicle camera of the two on-vehicle cameras whose optical axis heads toward an area that is lighted by the lighting apparatus, and decreases the data volume of the shot image taken by a second on-vehicle camera of the two on-vehicle cameras, in a case where the lighting apparatus is on, as compared to a case where the lighting apparatus is off.

3. The image generation apparatus of claim 2, wherein

the controller expands an area that uses the shot image taken by the first on-vehicle camera, and narrows an area that uses the shot image taken by the second on-vehicle camera, in the overlap area of the composite image, in the case where the lighting apparatus is on, as compared to the case where the lighting apparatus is off.

4. The image generation apparatus of claim 3, wherein

the controller uses only the shot image taken by the first on-vehicle camera for the overlap area of the composite image in the case where the lighting apparatus is on.

5. The image generation apparatus of claim 2, wherein

the controller narrows an area where the shot image taken by the first on-vehicle camera and the shot image taken by the second on-vehicle camera are blended, in the case where the lighting apparatus is on, as compared to the case where the lighting apparatus is off.

6. The image generation apparatus of claim 2, wherein

the controller increases a blending proportion of the shot image taken by the first on-vehicle camera in an area where the shot image taken by the first on-vehicle camera and the shot image taken by the second on-vehicle camera are blended, in the case where the lighting apparatus is on, as compared to the case where the lighting apparatus is off.

7. An image display system for installation in a vehicle, the image display system comprising:

an image generator that generates a composite image showing a surrounding area of the vehicle viewed from virtual viewpoints, by combining a plurality of shot images taken by a plurality of on-vehicle cameras that are disposed at different locations on the vehicle;

a receiver that receives a signal indicating a lighting mode of a lighting apparatus included in the vehicle;

a controller that changes data volumes of two shot images taken by two of the on-vehicle cameras based on the lighting mode of the lighting apparatus, the data volumes being used in an overlap area of the composite image that corresponds to the surrounding area of the vehicle where the two on-vehicle cameras can shoot in overlap; and

a display that displays the composite image generated by the image generator.

8. An image generation method for generating an image for display on a display installed in a vehicle, the image generation method comprising the steps of:

(a) generating a composite image showing a surrounding area of the vehicle viewed from virtual viewpoints, by combining a plurality of shot images taken by a plurality of on-vehicle cameras that are disposed at different locations on the vehicle;

(b) receiving a signal indicating a lighting mode of a lighting apparatus included in the vehicle; and

(c) changing data volumes of two shot images taken by two of the on-vehicle cameras based on the lighting mode of the lighting apparatus, the data volumes being used in an overlap area of the composite image that corresponds to the surrounding area of the vehicle where the two on-vehicle cameras can shoot in overlap.

9. The image generation method of claim 8, wherein

the step (c) increases the data volume of the shot image taken by a first on-vehicle camera of the two on-vehicle cameras whose optical axis heads toward an area that is lighted by the lighting apparatus, and decreases the data volume of the shot image taken by a second on-vehicle camera of the two on-vehicle cameras, in a case where the lighting apparatus is on, as compared to a case where the lighting apparatus is off.

10. The image generation method of claim 9, wherein

the step (c) expands an area that uses the shot image taken by the first on-vehicle camera, and narrows an area that uses the shot image taken by the second on-vehicle camera, in the overlap area of the composite image, in the case where the lighting apparatus is on, as compared to the case where the lighting apparatus is off.

11. The image generation method of claim 10, wherein

the step (c) uses only the shot image taken by the first on-vehicle camera for the overlap area of the composite image in the case where the lighting apparatus is on.

12. The image generation method of claim 9, wherein

the step (c) narrows an area where the shot image taken by the first on-vehicle camera and the shot image taken by the second on-vehicle camera are blended, in the case where the lighting apparatus is on, as compared to the case where the lighting apparatus is off.

13. The image generation method of claim 9, wherein

the step (c) increases a blending proportion of the shot image taken by the first on-vehicle camera in an area where the shot image taken by the first on-vehicle camera and the shot image taken by the second on-vehicle camera are blended, in the case where the lighting apparatus is on, as compared to the case where the lighting apparatus is off.