Vehicle display device and vehicle display method for displaying images

• US 10,427,683 B2
• Filed: 12/18/2017
• Issued: 10/01/2019
• Est. Priority Date: 08/27/2015
• Status: Active Grant

• Current Assignee: JVC Kenwood Corporation
• Original Assignee: JVC Kenwood Corporation
• Inventors: Yamada, Yasuo, Ishida, Ichiro
• Primary Examiner(s): Paige, Tyler D
• Application Number:
  US15/845,267
• Publication Number:
  US 20180105173A1
• Time in Patent Office: 652 Days
• Field of Search: 701 49
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: B60W 30/165 Automatically following the path of a preceding lead vehicle, e.g. "electronic tow-bar"
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0183 Adaptation to parameters characterising the motion of the vehicle
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02F 1/133 Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements arrangements or circuits for control of liquid crystal elements in a matrix, not structurally associated with these elements G09G3/36
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G08G 1/0968 Systems involving transmission of navigation instructions to the vehicle
• CPC Class Codes: G08G 1/16 Anti-collision systems road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08
• CPC Class Codes: G08G 1/168 Driving aids for parking, e.g. acoustic or visual feedback on parking space
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

An image acquisition unit acquires an image around a vehicle. A distance acquisition unit acquires a distance to a first object included in the acquired image. An image processing unit processes the image such that a distance to a second object located beneath the first object included in the acquired image is reflected, in accordance with the acquired distance. A viewpoint transformation processing unit subjects the processed image to viewpoint transformation to produce an image as viewed from above the vehicle. A display processing unit causes a display unit to display the image subjected to transformation.

Claims

1. A vehicle display device comprising:

an image acquisition unit that acquires an image around a vehicle;

a distance acquisition unit that acquires a first distance between a first object included in the acquired image and the vehicle;

an image processing unit that processes the acquired image such that a distance to a second object located beneath the first object included in the acquired image is reflected, in accordance with the first distance acquired in the distance acquisition unit, by deleting the second object in the acquired image when the second object is positioned such that the second object is hidden from view by the first object in a view of the vehicle from above and is not hidden from view by the first object in the acquired image;

a viewpoint transformation processing unit that subjects the acquired image thus processed to viewpoint transformation to produce a bird'"'"'s-eye image as viewed from above the vehicle; and

a display control unit that causes a display unit to display the bird'"'"'s-eye image.

2. The vehicle display device according to claim 1, wherein

the image processing unit processes the acquired image such that the distance to the second object located beneath the first object is reflected when the first distance is smaller than a first threshold value, by deleting the second object in the acquired image when the second object located beneath the first object is positioned such that the second object is hidden from view by the first object in a view of the vehicle from above and is not hidden from view by the first object in the acquired image.

3. The vehicle display device according to claim 2, wherein

the image processing unit derives a second distance between the first object and the second object based on the first distance, and processes the acquired image such that the distance to the second object located beneath the first object is reflected when the derived second distance is smaller than a second threshold value, by deleting the second object in the acquired image when the second object located beneath the first object is positioned such that the second object is hidden from view by the first object in a view of the vehicle from above and is not hidden from view by the first object in the acquired image.

4. The vehicle display device according to claim 2, wherein

the image processing unit defines the first threshold value and the second threshold value in accordance with a height of an imaging device that captures the acquired image from a ground.

5. The vehicle display device according to claim 1, wherein

the first object is another vehicle, and

the second object is a parking lot drawn on the ground or a parking lot placed on the ground.

6. The vehicle display device according to claim 1, wherein

the image processing unit deletes a portion of the second object hidden from view by the first object from the acquired image depending on the first distance acquired in the distance acquisition unit.

7. The vehicle display device according to claim 1, wherein

the image processing unit processes the acquired image such that the second object is deleted by being hidden from view by the first object from above, depending on the first distance acquired in the distance acquisition unit.

8. The vehicle display device according to claim 7, wherein

the image processing unit deletes the second object by hiding the second object from view by the first object from above by cutting out an outer shape of the first object and then pasting and superimposing the outer shape on the second object in the acquired image.

9. The vehicle display device according to claim 8, wherein

the image processing unit pastes the outer shape of the first object such that the first object is more toward a driver'"'"'s vehicle than the second object in the acquired image.

10. The vehicle display device according to claim 7, wherein

the image processing unit deletes the second object by hiding the second object from view by the first object by pasting and superimposing a pseudo object simulating an outer shape of the first object on the second object in the acquired image.

11. A vehicle display method comprising:

acquiring an image around a vehicle;

acquiring a first distance between a first object included in the acquired image and the vehicle;

processing an image such that a distance to a second object located beneath the first object included in the acquired image is reflected, in accordance with the acquired first distance, by deleting the second object in the acquired image when the second object is positioned such that the second object is hidden from view by the first object in a view of the vehicle from above and is not hidden from view by the first object in the acquired image;

subjecting the processed image thus processed to viewpoint transformation to produce a bird'"'"'s-eye image as viewed from above the vehicle; and

causing a display unit to display the produced bird'"'"'s-eye image.