Image processing apparatus, electronic apparatus, and image processing method

• US 10,339,811 B2
• Filed: 06/01/2015
• Issued: 07/02/2019
• Est. Priority Date: 05/29/2009
• Status: Active Grant

• Current Assignee: Fujitsu Ten Limited (DENSO Corporation)
• Original Assignee: Fujitsu Ten Limited (DENSO Corporation)
• Inventors: Ohno, Yasuhiro, Ozaki, Yukisuke, Yamashita, Takayoshi
• Primary Examiner(s): Czekaj, Dave
• Assistant Examiner(s): Joisil, Berteau
• Application Number:
  US14/727,167
• Publication Number:
  US 20150262488A1
• Time in Patent Office: 1,492 Days
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/602 with an adjustable viewpoint
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G08G 1/0962 having an indicator mounted inside the vehicle, e.g. giving voice messages
• CPC Class Codes: G08G 1/165 for passive traffic, e.g. including static obstacles, trees
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: G08G 1/168 Driving aids for parking, e.g. acoustic or visual feedback on parking space
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A technology for displaying images on a displaying apparatus mounted on a vehicle is provided. In response to a predetermined instruction signal, synthetic images viewed from a virtual viewpoint around and above the periphery of the vehicle are generated based on a plurality of images acquired from a plurality of cameras for capturing the periphery of the vehicle. The plurality of synthetic images, in which a position of a viewpoint moves sequentially varies such that the synthetic images move in a circle around the vehicle, are sequentially output to the displaying apparatus. Accordingly, the user monitors the entire circumference of the vehicle from the viewpoint where the user sees the vehicle in front of user'"'"'s eyes, so that the user can intuitively recognize the positional relation between the vehicle and an obstacle from one screen.

Claims

1. An image processing apparatus that processes an image to be displayed on a display apparatus mounted on a vehicle, the image processing apparatus comprising:

a receiving section that receives an instruction signal;

a synthetic image generating section that generates a plurality of first synthetic images based on a plurality of images of a periphery of the vehicle captured by a plurality of cameras which are provided so as to be capable of capturing a 360°

view of the periphery of the vehicle, the first synthetic images being viewed towards the vehicle from a plurality of virtual viewpoints disposed around the vehicle; and

an output section that sequentially outputs the first synthetic images to the display apparatus so that the virtual viewpoint of the first synthetic images moves in a circle around the vehicle at an angle that is less than 360°

while being directed towards the vehicle in response to the instruction signal.

2. The image processing apparatus as set forth in claim 1,

wherein the synthetic image generating section generates a second synthetic image being viewed towards the vehicle from a virtual viewpoint disposed above the vehicle,

wherein the output section sequentially outputs the first synthetic images and the second synthetic image to the display apparatus such that the virtual viewpoint moves in a continuous manner between the first synthetic images and the second synthetic image.

3. The image processing apparatus as set forth in claim 2, wherein the output section outputs the second synthetic image after outputting the first synthetic images.

4. The image processing apparatus as set forth in claim 1, wherein the synthetic image generating section generates the first synthetic images such that the virtual viewpoint moves in a circle around a position of the vehicle.

5. The image processing apparatus as set forth in claim 1, wherein the synthetic image generating section generates the first synthetic images such that the virtual viewpoint moves in a circle around a user-specified position in the vicinity of the vehicle.

6. The image processing apparatus as set forth in claim 1, wherein the receiving section receives the instruction signal when the image processing apparatus is activated by a predetermined user operation.

7. The image processing apparatus as set forth in claim 5, further comprising the display apparatus that displays the first synthetic image output from the output section.

8. An image processing method for processing an image to be displayed on a display apparatus mounted on a vehicle, the image processing method comprising:

receiving an instruction signal;

generating a plurality of synthetic images based on a plurality of images of a periphery of the vehicle captured by a plurality of cameras which are provided so as to be capable of capturing a 360°

view of the periphery of the vehicle, the synthetic images being viewed towards the vehicle from a plurality of virtual viewpoint disposed around the vehicle; and

sequentially outputting the synthetic images to the display apparatus so that the virtual viewpoint of the synthetic images circle in a sequence around the vehicle at an angle that is less than 360°

while being directed towards the vehicle in response to the instruction signal.

9. An electronic apparatus that processes an image to be displayed on a display apparatus mounted on a vehicle, the electronic apparatus comprising:

an operation section that outputs an instruction signal;

a receiving section that receives the instruction signal;

a synthetic image generating section that generates a plurality of first synthetic images based on a plurality of images of a periphery of the vehicle captured by a plurality of cameras which are provided so as to be capable of capturing a 360°

view of the periphery of the vehicle, the first synthetic images being viewed towards the vehicle from a plurality of virtual viewpoints disposed around the vehicle; and

an output section that sequentially outputs the first synthetic images to the display apparatus so that the virtual viewpoint of the first synthetic images moves in a circle around the vehicle at an angle that is less than 360°

while being directed towards the vehicle in response to the instruction signal.