VEHICLE PERIPHERY MONITORING SYSTEM

• US 20120242834A1
• Filed: 12/07/2009
• Published: 09/27/2012
• Est. Priority Date: 12/07/2009
• Status: Active Grant

• Current Assignee: Clarion Co., Ltd. (Faurecia SA)
• Original Assignee: Clarion Co., Ltd. (Faurecia SA)
• Inventors: Satoh, Noriyuki, Ishii, Katsuichi
• Granted Patent: US 9,204,108 B2
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/25 to the sides of the vehicle
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/304 using merged images, e.g. merging camera image with stored images
• CPC Class Codes: B60R 2300/60 characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective
• CPC Class Codes: B60R 2300/8026 in addition to a rear-view mirror system
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A vehicle periphery monitoring system is provided, in which by matching a behavior of a semitransparent tire image with an operation from a driver'"'"'s viewpoint, a feeling of strangeness is reduced, an intuitive space perception is assisted and also a moving direction and a behavior of a vehicle can be easily perceived. In a side-view monitor system an image processing controller converts a real camera image including a blind spot into an image to be viewed from a driver'"'"'s viewpoint to generate a blind spot image, and superimposes a semitransparent vehicle image which is obtained by making a vehicle viewed from the driver'"'"'s viewpoint semitransparent and a semitransparent tire image which is obtained by making a tire semitransparent and displaying a behavior following a handle operation viewed from the driver'"'"'s viewpoint on the blind spot image.

Claims

1. A vehicle periphery monitoring system, comprising a blind spot camera imaging a blind spot area from a driver;

an external monitor set at a position in a vehicle interior to be visually confirmed by the driver; and

a monitor display image data generating means generating monitor display image data based on a real camera image input from the blind spot camera, wherein

the monitor display image data generating means

converts the real camera image from the blind spot camera, which includes a blind spot area into an image to be viewed from a driver'"'"'s viewpoint to generate a blind spot image, and

performs an image composition superimposing a semitransparent vehicle image which is obtained by making a vehicle viewed from the driver'"'"'s viewpoint semitransparent and a semitransparent tire image which is obtained by making a tire semitransparent and displays a behavior following a handle operation by being viewed from the driver'"'"'s viewpoint on the blind spot image to generate the monitor display image data expressing the blind spot through the semitransparent vehicle image and semitransparent tire image.

2. The vehicle periphery monitoring system according to claim 1, wherein

the blind spot camera includes a left side camera imaging a front left side area from the vehicle which is in a blind spot from the driver and a right side camera imaging a front right side area from the vehicle which is in a blind spot from the driver;

the monitor display image data generating means

divides the real camera image from the left side camera into two of a left vehicle body image part including a left tire image and the other left periphery image part,

divides the real camera image from the right side camera into two of a right vehicle body image part including a right tire image and the other right periphery image part,

replaces the left and right vehicle image parts with each other,

combining the vehicle body image parts and the periphery image parts by the left and right replacement, and

expresses the semitransparent tire image according to the behavior where a turning angle and a turning direction viewed from the driver'"'"'s viewpoint follows the handle operation.

3. The vehicle periphery monitoring system according to claim 2, wherein

the monitor display image data generating means

sets a point which is obtained by converting the driver'"'"'s viewpoint in a line-symmetrical manner with a center axis of the vehicle as a line-symmetrical axis as an assistant driver'"'"'s viewpoint,

performs a viewpoint conversion of one of the left or right periphery image parts into a conversion image to be viewed from the driver'"'"'s viewpoint,

performs a viewpoint conversion of the other one of the left or right vehicle body image parts into a semitransparent conversion image to be viewed from the assistant driver'"'"'s viewpoint and then performs a mirror image conversion of the semitransparent conversion image into a semitransparent mirror image conversion image, and

performs an image composition superimposing the semitransparent mirror image conversion image on the conversion image to generate one of the left and right monitor display image data.

4. The vehicle periphery monitoring system according to claim 3, wherein

the monitor display image data generating means shifts the semitransparent mirror image conversion image to be superimposed on the conversion image in parallel in view of an actual tire width to express a tire thickness in the semitransparent tire image.

5. The vehicle periphery monitoring system according to claim 3, wherein

the monitor display image data generating means copies a part of an image of a specific part including a tire within the semitransparent mirror image conversion image to be superimposed on the conversion image,

shifts the copied part in parallel in view of an actual tire width, and

superimposes the copied part shifted in parallel again to express a tire thickness in the semitransparent tire image.

6. The vehicle periphery monitoring system according to claim 2, wherein

the monitor display image data generating means adjusts at least one of image expression elements of transmissivity, hue, saturation, and brightness of the semitransparent tire image so as to enhance visibility with respect to the other image part.

7. The vehicle periphery monitoring system according to claim 1, further comprising

a rudder angle detection means detecting a handle operation rudder angle, wherein

the blind spot camera is a single side camera imaging a front side area from the vehicle which is in a blind spot from the driver;

the monitor display image data generating means

draws a tire corresponding to a rudder angle based on the rudder angle information from the rudder angle detection means by computer graphics to generate the semitransparent tire image,

performs an image composition superimposing the semitransparent tire image on a tire position where the tire is to be positioned to express the semitransparent tire image according to the behavior where a turning angle and a turning direction viewed from the driver'"'"'s viewpoint follows the handle operation.

8. The vehicle periphery monitoring system according to claim 7, wherein

the monitor display image data generating means performs an image composition superimposing the semitransparent vehicle interior image obtained based on a vehicle interior image which is obtained by previously photographing a vehicle interior from the driver'"'"'s viewpoint and the semitransparent tire image which is stereoscopically drawn by the computer graphics on the periphery image to be viewed from the driver'"'"'s viewpoint, which is obtained by performing the viewpoint conversion of the camera image from the single side camera to generate the monitor display image data.

9. The vehicle periphery monitoring system according to claim 7, further comprising:

an external environment detection means detecting a hue, a saturation, or a brightness of an external environment of the vehicle, wherein

the monitor display image data generating means changes at least one of the hue, saturation, and brightness of the semitransparent tire image which is drawn by computer graphics according to the hue and brightness of the external environment, which are detected by the external environment detection means so as to enhance visibility for the blind spot image.

10. The vehicle periphery monitoring system according to claim 7, further comprising:

an obstacle detection means detecting an obstacle approaching periphery of the vehicle, wherein

the monitor display image data generating means changes color of the semitransparent tire image drawn by computer graphics into an alarm color when the approach of the obstacle is detected by the obstacle detection means.

11. The vehicle periphery monitoring system according to claim 3, wherein

the monitor display image data generating means adjusts at least one of image expression elements of transmissivity, hue, saturation, and brightness of the semitransparent tire image so as to enhance visibility with respect to the other image part.

12. The vehicle periphery monitoring system according to claim 4, wherein

the monitor display image data generating means adjusts at least one of image expression elements of transmissivity, hue, saturation, and brightness of the semitransparent tire image so as to enhance visibility with respect to the other image part.

13. The vehicle periphery monitoring system according to claim 5, wherein

the monitor display image data generating means adjusts at least one of image expression elements of transmissivity, hue, saturation, and brightness of the semitransparent tire image so as to enhance visibility with respect to the other image part.

14. The vehicle periphery monitoring system according to claim 8, further comprising:

an external environment detection means detecting a hue, a saturation, or a brightness of an external environment of the vehicle, wherein

the monitor display image data generating means changes at least one of the hue, saturation, and brightness of the semitransparent tire image which is drawn by computer graphics according to the hue and brightness of the external environment, which are detected by the external environment detection means so as to enhance visibility for the blind spot image.

15. The vehicle periphery monitoring system according to claim 8, further comprising:

an obstacle detection means detecting an obstacle approaching periphery of the vehicle, wherein

the monitor display image data generating means changes color of the semitransparent tire image drawn by computer graphics into an alarm color when the approach of the obstacle is detected by the obstacle detection means.

16. The vehicle periphery monitoring system according to claim 9, further comprising:

an obstacle detection means detecting an obstacle approaching periphery of the vehicle, wherein

the monitor display image data generating means changes color of the semitransparent tire image drawn by computer graphics into an alarm color when the approach of the obstacle is detected by the obstacle detection means.