IMAGE GENERATION APPARATUS

• US 20120314072A1
• Filed: 06/01/2012
• Published: 12/13/2012
• Est. Priority Date: 06/08/2011
• Status: Abandoned Application

• Current Assignee: Fujitsu Ten Limited (DENSO Corporation)
• Original Assignee: Fujitsu Ten Limited (DENSO Corporation)
• Inventors: SAWADA, Yasuyoshi, HARUMOTO, Satoshi, KIYO, Kouei, YAMASHITA, Yoshitsugu
• Application Number:
  US13/486,576
• Publication Number:
  US 20120314072A1
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/605 the adjustment being automatic
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A shift determining part of an image display system determines a traveling direction of a vehicle. A composite image generator generates a composite image that shows a periphery of the vehicle and an area that is in a direction opposite to the determined traveling direction of the vehicle in a seamless manner. The periphery is viewed from a virtual viewpoint that is set looking down at the vehicle. A display displays a display image including the composite image. Since the display image includes the composite image that shows the area that is in the direction opposite to the determined traveling direction of the vehicle, a user can notice an object that exists in the direction opposite to the traveling direction of the vehicle by looking at the display image.

Claims

1. An image generation apparatus that is used in a vehicle and generates an image that shows a periphery of the vehicle, the image generation apparatus comprising:

an input that acquires shot images from a plurality of cameras, each of which captures the periphery of the vehicle in a different direction;

a controller that determines a traveling direction of the vehicle;

a generator that generates a composite image including a first area and a second area in a seamless manner based on the shot images, the first area showing the periphery of the vehicle viewed from a virtual viewpoint that is set looking down at the vehicle, the second area showing an area that includes an outside of the first area and is in a direction opposite to the determined traveling direction; and

an output that transmits a display image including the composite image to a display apparatus to display the display image on the display apparatus.

2. The image generation apparatus of claim 1, wherein

the display image includes the composite image and an image that shows a third area in the determined traveling direction of the vehicle.

3. The image generation apparatus of claim 1, wherein

the composite image includes an image of the vehicle.

4. The image generation apparatus of claim 3, wherein the generator sets,

when the determined traveling direction is a forward direction, a center position of the image of the vehicle in the composite image above a center line that is set horizontally at a vertical center of the composite image, and

when the determined traveling direction is a backward direction, the center position of the image of the vehicle in the composite image below the center line that is set horizontally at the vertical center of the composite image.

5. The image generation apparatus of claim 1, wherein

the generator generates the composite image by projecting data of the shot images onto a virtual projection surface, and

a part corresponding to the first area on the virtual projection surface is a flat surface.

6. The image generation apparatus of claim 5, wherein

a part corresponding to the second area on the virtual projection surface is a curved surface that is contiguous with the flat surface.

7. An image generation apparatus that is used in a vehicle and generates an image that shows a periphery of the vehicle, the image generation apparatus comprising:

an input that acquires shot images from a plurality of cameras, each of which captures one of an area in front of the vehicle and an area behind the vehicle;

a controller that determines a traveling direction of the vehicle;

a generator that generates a display image based on the shot images; and

an output that transmits the display image to a display apparatus to display the display image on the display apparatus, wherein

the generator generates as the display image,

a first display image that shows the area in front of the vehicle when the determined traveling direction of the vehicle is a forward direction, and

selectively one of a second display image and a third display image in conformity with a user'"'"'s operation when the determined traveling direction of the vehicle is a backward direction, the second display image showing the area behind the vehicle, the third display image showing the area in front of the vehicle in a different form than the first display image.

8. The image generation apparatus of claim 7, wherein

the first display image includes a mask area that partially hides the area in front of the vehicle, and

the third display image does not include the mask area.

9. The image generation apparatus of claim 7, wherein

the first display image includes a non-transparent mask area that partially hides the area in front of the vehicle, and

the third display image includes a transparent mask area that partially hides the area in front of the vehicle.

10. The image generation apparatus of claim 7, wherein

a mask area shown on the first display image is different in shape from a mask area shown on the third display image, each of the mask areas hiding the area in front of the vehicle.

11. An image generation apparatus that is used in a vehicle and generates an image that shows a periphery of the vehicle, the image generation apparatus comprising:

an input that acquires a shot image from a side camera that captures a side area of the vehicle;

a controller that determines a traveling direction of the vehicle;

a detector that detects a state of a side mirror of the vehicle;

a generator that generates a display image that shows the side area covering the determined traveling direction of the vehicle based on the shot image acquired from the side camera, when the side mirror is retracted; and

an output that transmits the display image to a display apparatus to display the display image on the display apparatus.

12. The image generation apparatus of claim 11, wherein

the display image includes an image of a part of a body of the vehicle.

13. An image generation method for use in a vehicle and for generating an image that shows a periphery of the vehicle, the image generation method comprising the steps of:

(a) acquiring shot images from a plurality of cameras, each of which captures the periphery of the vehicle in a different direction;

(b) determining a traveling direction of the vehicle;

(c) generating a composite image that shows a first area and a second area in a seamless manner based on the shot images, the first area showing the periphery of the vehicle viewed from a virtual viewpoint that is set looking down at the vehicle, the second area showing an area that includes an outside of the first area of the vehicle and is in a direction opposite to the determined traveling direction; and

(d) displaying a display image that includes the composite image.

14. An image generation method for use in a vehicle and for generating an image that shows a periphery of the vehicle, the image generation method comprising the steps of:

(a) acquiring shot images from a plurality of cameras, each of which captures one of an area in front of the vehicle and an area behind the vehicle;

(b) determining a traveling direction of the vehicle;

(c) generating a display image based on the shot images; and

(d) displaying the display image, wherein

the step (c) generates as the display image,

a first display image that shows the area in front of the vehicle when the determined traveling direction of the vehicle is a forward direction, and

selectively one of a second display image and a third display image in conformity with a user'"'"'s operation when the determined traveling direction of the vehicle is a backward direction, the second display image showing the area behind the vehicle, the third display image showing the area in front of the vehicle in a different form than the first display image.

15. An image generation method for use in a vehicle and for generating an image that shows a periphery of the vehicle, the image generation method comprising the steps of:

(a) acquiring a shot image from a side camera that captures a side area of the vehicle;

(b) determining a traveling direction of the vehicle;

(c) detecting a state of a side mirror of the vehicle;

(d) generating a display image that shows the side area covering the determined traveling direction of the vehicle based on the shot image acquired from the side camera when the side mirror is retracted; and

(e) displaying the display image.