IMAGE PROCESSING APPARATUS, ELECTRONIC APPARATUS, AND IMAGE PROCESSING METHOD

• US 20150262488A1
• Filed: 06/01/2015
• Published: 09/17/2015
• Est. Priority Date: 05/29/2009
• Status: Active Grant

• Current Assignee: Fujitsu Ten Limited (DENSO Corporation)
• Original Assignee: Fujitsu Ten Limited (DENSO Corporation)
• Inventors: OZAKI, Yukisuke, YAMASHITA, Takayoshi, OHNO, Yasuhiro
• Granted Patent: US 10,339,811 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/602 with an adjustable viewpoint
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G08G 1/0962 having an indicator mounted inside the vehicle, e.g. giving voice messages
• CPC Class Codes: G08G 1/165 for passive traffic, e.g. including static obstacles, trees
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: G08G 1/168 Driving aids for parking, e.g. acoustic or visual feedback on parking space
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A technology for displaying images on a displaying apparatus mounted on a vehicle is provided. In response to a predetermined instruction signal, synthetic images viewed from a virtual viewpoint around and above the periphery of the vehicle are generated based on a plurality of images acquired from a plurality of cameras for capturing the periphery of the vehicle. The plurality of synthetic images, in which a position of a viewpoint moves sequentially varies such that the synthetic images move in a circle around the vehicle, are sequentially output to the displaying apparatus. Accordingly, the user monitors the entire circumference of the vehicle from the viewpoint where the user sees the vehicle in front of user'"'"'s eyes, so that the user can intuitively recognize the positional relation between the vehicle and an obstacle from one screen.

Claims

1. An image processing apparatus that processes an image to be displayed on a display apparatus mounted on a vehicle, the image processing apparatus comprising:

a receiving section that receives an instruction signal;

a synthetic image generating section that generates a plurality of first synthetic images based on at least one image of the periphery of the vehicle captured by at least one camera, the first synthetic images being viewed to the vehicle from a plurality of virtual viewpoints disposed around and above the vehicle; and

an output section that sequentially outputs the first synthetic images to the display apparatus so that a virtual viewpoint of the first synthetic images moves in an arc around the vehicle at an angle that is less than 360°

, in response to the instruction signal.

2. The image processing apparatus as set forth in claim 1, wherein the synthetic image generating section generates the first synthetic images with one camera.

3. The image processing apparatus as set forth in claim 2, wherein the one camera is one of a front camera, side cameras and a back camera.

4. The image processing apparatus as set forth in claim 1,

wherein the synthetic image generating section generates a second synthetic image being viewed to the vehicle from a virtual viewpoint disposed directly above substantially a center the vehicle,

wherein the output section sequentially outputs the first synthetic images and the second synthetic image to the display apparatus such that the virtual viewpoint moves in a continuous manner between the first synthetic images and the second synthetic image.

5. The image processing apparatus as set forth in claim 4, wherein the output section outputs the second synthetic image after outputting the first synthetic images.

6. The image processing apparatus as set forth in claim 1, wherein the synthetic image generating section generates the first synthetic images such that the virtual viewpoint moves in a circle around a position of the vehicle.

7. The image processing apparatus as set forth in claim 1, wherein the synthetic image generating section generates the first synthetic images such that the virtual viewpoint moves in a circle around a user-specified position in the vicinity of the vehicle.

8. The image processing apparatus as set forth in claim 1, wherein the receiving section receives the instruction signal when the image processing apparatus is activated.

10. The image processing apparatus as set forth in claim 7, further comprising the display apparatus that displays the synthetic image output from the output section.

9. An electronic apparatus that processes an image to be displayed on a display apparatus mounted on a vehicle, the electronic apparatus comprising:

an operating section that outputs an instruction signal;

a receiving section that receives the instruction signal;

a synthetic image generating section that generates a synthetic image based on at least one image of the periphery of the vehicle captured by at least one camera, the synthetic image being viewed to the vehicle from a virtual viewpoint disposed around and above the vehicle such that the virtual viewpoint moves around the vehicle in a continuous manner; and

an output section that outputs the synthetic image to the display apparatus so that a virtual viewpoint of the synthetic image moves in an arc around the vehicle at an angle that is less than 360°

, in response to the instruction signal.

11. An image processing method for processing an image to be displayed on a display apparatus mounted on a vehicle, the image processing method comprising:

receiving an instruction signal;

generating a plurality of synthetic images based on at least one image of the periphery of the vehicle captured by at least one camera, the synthetic images being viewed to the vehicle from a plurality of virtual viewpoints disposed around and above the vehicle; and

sequentially outputting the synthetic images to the display apparatus so that a virtual viewpoint of the synthetic images moves in an arc around the vehicle at an angle that is less than 360°

, in response to the instruction signal.