Image display control device and image display system including image superimposition unit that superimposes a mirror image and a vehicle-body image

• US 10,475,242 B2
• Filed: 06/20/2014
• Issued: 11/12/2019
• Est. Priority Date: 01/10/2014
• Status: Expired due to Fees

• Current Assignee: Aisin Seiki Co., Ltd. (Aisin Corp.)
• Original Assignee: Aisin Seiki Co., Ltd. (Aisin Corp.)
• Inventors: Hashimoto, Yoshikuni, Honda, Koichiro, Kitamura, Kanae
• Primary Examiner(s): Wang, Jin Cheng
• Application Number:
  US15/110,024
• Publication Number:
  US 20160350974A1
• Time in Patent Office: 1,971 Days
• Field of Search: 348148, 345629, 345633, 3404255, 340459, 340937, 382104
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/305 merging camera image with lines or icons
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G09G 2380/10 Automotive applications
• CPC Class Codes: G09G 5/377 for mixing or overlaying two or more graphic patterns G09G5/02, G09G5/397 take precedence
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

An image display control device of an embodiment includes: a mirror image creation unit that creates a mirror image of an area behind and on the side of a vehicle body based on an image captured with an image pickup unit provided on the vehicle body; an image superimposition unit that superimposes a line drawing from which at least a lower part of the vehicle body is recognizable, and the mirror image created by the mirror image creation unit; and a display control unit that controls a display device to display an image created by superimposing the mirror image and the line drawing by the image superimposition unit.

Claims

1. An image display control device comprising:

a CPU configured to;

create a mirror image of an area behind and on a side of a vehicle body based on an image captured with a camera provided on the vehicle body;

superimpose a line drawing from which at least a lower part of the vehicle body is recognizable, and the mirror image created by the CPU; and

control a display device to display an image created by superimposing the mirror image and the line drawing by the CPU, wherein

the lower part of the vehicle body is a plane that is defined by a floor of the vehicle body, and

the line drawing includes an area showing a plane representing a vehicle floor in lattice pattern, and

the lattice pattern is superimposed on the mirror image at a height of the vehicle floor as viewed from a viewpoint at an interior of the vehicle body.

2. The image display control device according to claim 1, wherein the line drawing is a line drawing from which at least a side part and a bottom part of a rear part of the vehicle body are recognizable.

3. The image display control device according to claim 1, wherein the line drawing includes a first part showing an edge of the lower part of the vehicle body in a vehicle width direction, and a second part showing a rear edge of the lower part of the vehicle body in a vehicle longitudinal direction.

4. The image display control device according to claim 1, wherein the line drawing includes a third part showing a rear edge of a side of the vehicle body in the vehicle longitudinal direction.

5. The image display control device according to claim 1, wherein the line drawing includes a plurality of lines with different surface densities.

6. The image display control device according to claim 1, wherein the line drawing includes a line extending in a vehicle vertical direction on the side part or rear part of the vehicle body.

7. The image display control device according to claim 1, wherein the line drawing includes display elements, and either a width or an interval of the display elements becomes gradually narrower toward the rear of the vehicle body.

8. The image display control device according to claim 1, wherein the line drawing includes a display element showing a center of the lower part of the vehicle body.

9. The image display control device according to claim 1, wherein the line drawing is in a three-dimensional frame form.

10. The image display control device according to claim 1, wherein the CPU is configured to adjust a display range of the superimposed mirror image and the line drawing in accordance with a vehicle condition, and

when the vehicle makes a lane change or the vehicle is moving back while turning, the display range is enlarged.

11. The image display control device according to claim 1, wherein the CPU is configured to determine a display mode of the line drawing in accordance with a vehicle condition, and

when the vehicle makes a lane change or the vehicle is moving back while turning, a transmittance of a vehicle-body image included in the line drawing is increased, the vehicle-body image representing a frame-like outline of the vehicle body.

12. The image display control device according to claim 1, wherein the lattice pattern is formed by lines extending in the vehicle longitudinal direction and lines extending in the vehicle width direction.

13. The image display control device according to claim 1, wherein

the CPU is configured to adjust a display range of the superimposed mirror image and the line drawing in accordance with a vehicle condition and determine a display mode of the line drawing in accordance with a vehicle condition, and

when the vehicle makes a lane change or the vehicle is moving back while turning, the display range is enlarged and a transmittance of a vehicle-body image included in the line drawing is increased, the vehicle-body image representing a frame-like outline of the vehicle body.

14. An image display system comprising:

a first camera that is provided on a vehicle body and captures an image of an area behind the vehicle body;

a second camera that is provided on the vehicle body and captures an image of an area on a side of the vehicle body;

a display device; and

an image display control device that includes;

a CPU configured to;

create a mirror image of an area behind and on the side of the vehicle body based on the images captured with the first camera and the second camera;

superimpose the mirror image and a vehicle-body image from which at least a lower part of the vehicle body is recognizable; and

control the display device to display an image created by superimposing the mirror image and the vehicle-body image by the CPU, wherein

the lower part of the vehicle body is a plane that is defined by a floor of the vehicle body, and

the line drawing includes an area showing a plane representing a vehicle floor in lattice pattern, and

the lattice pattern is superimposed on the mirror image at a height of the vehicle floor as viewed from a viewpoint at an interior of the vehicle body.