VEHICLE PERIPHERY MONITORING DEVICE AND VEHICLE PERIPHERY IMAGE DISPLAY METHOD

• US 20120026333A1
• Filed: 07/27/2010
• Published: 02/02/2012
• Est. Priority Date: 07/29/2009
• Status: Active Grant

• Current Assignee: Clarion Co., Ltd. (Faurecia SA)
• Original Assignee: Clarion Co., Ltd. (Faurecia SA)
• Inventors: Okuyama, Yoshitaka
• Granted Patent: US 9,247,217 B2
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 2300/103 using camera systems provided with artificial illumination device, e.g. IR light source
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/106 using night vision cameras
• CPC Class Codes: B60R 2300/305 merging camera image with lines or icons
• CPC Class Codes: B60R 2300/8053 for bad weather conditions or night vision
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/92 based on global image properties
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

From a plurality of imaging units (110) which capture images of a vehicle periphery and from an image taken by any one of the plurality of imaging units (any one of 111, 121, 131, 141), a value corresponding to brightness of the image is calculated. Based on the calculated value, brightness of images obtained by the plurality of imaging units (110) is corrected by a brightness correction unit (120). After a predetermined coordinate transformation is performed on the brightness corrected images, the images are combined into a single image, and the single image is displayed together with the image taken by the one imaging unit (any one of 111, 121, 131, 141).

Claims

1. A vehicle periphery monitoring device comprising:

a plurality of imaging units mounted on a vehicle and configured to capture images of a vehicle periphery;

an image brightness calculation unit configured to calculate a value corresponding to brightness of an image taken by any one of the plurality of imaging units, from the image taken by the one of the imaging units,

a brightness correction unit configured to correct brightness of the images obtained by the plurality of imaging units on the basis of the value calculated by the image brightness calculation unit,

an image transformation unit configured to perform a predetermined coordinate transformation process on the image with the brightness thereof corrected by the brightness correction unit,

an image combining unit configured to combine the plurality of images after the coordinate transformation process into a single image, and

an image display unit configured to simultaneously display the composite image obtained by the image combining unit and the image taken by the one of the imaging units.

2. The vehicle periphery monitoring device according to claim 1, further comprising:

a traveling direction judgment unit configured to judge a traveling direction of a vehicle; and

an imaging-unit-selecting unit configured to select one imaging unit from the plurality of imaging units on the basis of a judgment result of the traveling direction judgment unit, wherein

the image brightness calculation unit calculates a value corresponding to brightness of an image taken by the one imaging unit selected by the imaging-unit-selecting unit, and

the image display unit simultaneously displays the composite image obtained by the image combining unit and the image taken by the one imaging unit selected by the imaging-unit-selecting unit.

3. The vehicle periphery monitoring device according to claim 2, wherein

the imaging-unit-selecting unit selects a first imaging unit from a plurality of imaging units which capture images in three or more directions and which are mounted so that ranges captured by at least two of the plurality of imaging units partly overlap each other,

the image brightness calculation unit calculates a value corresponding to brightness of a first overlapping imaging range included in an image taken by the selected first imaging unit and in an image taken by a second imaging unit which shares the first overlapping imaging range with the selected first imaging unit, or calculates a value corresponding to brightness of a neighborhood of the first overlapping imaging range,

the brightness correction unit corrects brightness of the image taken by the second imaging unit on the basis of the calculated value,

based on the brightness corrected result, the image brightness calculation unit further calculates a new value corresponding to brightness of a second overlapping imaging range or corresponding to brightness of a neighborhood of the second overlapping imaging range, from the brightness corrected image and an image taken by a third imaging unit and sharing the second overlapping imaging range with the brightness corrected image,

the brightness correction unit further corrects brightness of the image taken by the third imaging unit on the basis of the calculated new value, and

the image brightness calculation unit and the brightness correction unit sequentially repeat the calculation of brightness and the correction of brightness in the same manner thereafter.

4. The vehicle periphery monitoring device according to claim 1, wherein

the image brightness calculation unit calculates a value corresponding to brightness of a first overlapping imaging range included in an image taken by a first imaging unit of a plurality of imaging units, which capture images in three or more directions and which are mounted so that ranges captured by at least two of the plurality of imaging units partly overlap each other, and included in an image taken by a second imaging unit sharing the first overlapping imaging range with the first imaging unit or calculates a value corresponding to brightness of a neighborhood of the first overlapping imaging range,

the brightness correction unit corrects brightness of the image taken by the second imaging unit on the basis of the calculated value,

based on the brightness corrected result, the image brightness calculation unit further calculates a new value corresponding to brightness of a second overlapping imaging range or corresponding to brightness of a neighborhood of the second overlapping imaging unit, from the brightness corrected image and an image taken by a third imaging unit and sharing the second overlapping imaging range with the brightness corrected image,

the brightness correction unit further corrects brightness of the image taken by the third imaging unit on the basis of the calculated new value, and

the image brightness calculation unit and the brightness correction unit sequentially repeat the calculation of brightness and the correction of the brightness in the same manner thereafter.

5. A vehicle periphery image display method for displaying, in one display screen, an image obtained by combining a plurality of images of a vehicle periphery taken by a plurality of imaging units and an image taken by one of the plurality of imaging units, comprising the steps of

calculating a value corresponding to brightness of one image from the plurality of images;

correcting brightness of the plurality of images on the basis of the calculated value;

performing a predetermined coordinate transformation process on the brightness corrected images;

combining the plurality of coordinate-transformed images into a single image; and

displaying the composite image and the one image simultaneously.

6. The vehicle periphery image display method according to claim 5, further comprising the steps of

judging a traveling direction of a vehicle;

selecting one image from a plurality of images captured for a vehicle periphery on the basis of the judgment result of the traveling direction;

calculating a value corresponding to brightness of the one selected image from the one image;

correcting brightness of the plurality of images on the basis of the calculated value;

performing a predetermined coordinate transformation process on the brightness corrected images;

combining the plurality of coordinate-transformed images into a single image; and

displaying the composite image and the one selected image simultaneously.

7. The vehicle periphery image display method according to claim 6, further comprising the steps of

selecting a first image from a plurality of images captured for three or more directions and set so that imaging ranges of at least two of the plurality of images partly overlap each other;

calculating a value corresponding to brightness of a first overlapping imaging range included in the selected first image and in a second image sharing the first overlapping imaging area with the selected first image, or a value corresponding to brightness of a neighborhood of the first overlapping imaging range;

correcting brightness of the second image on the basis of the calculated value;

calculating, based on the brightness corrected result, a new value corresponding to brightness of a second overlapping imaging range or corresponding to brightness of a neighborhood of the second overlapping imaging area from the brightness corrected image and a third image sharing the second overlapping imaging range with the brightness corrected image;

correcting brightness of the third image on the basis of the calculated new value; and

sequentially repeating the calculation of brightness and the correction of brightness in the same manner thereafter.

8. The vehicle periphery image display method according to claim 5, further comprising the steps of

calculating a value corresponding to brightness of a first overlapping imaging range included in a first image of a plurality of images captured for three or more directions and set so that imaging ranges of at least two of the plurality of images partly overlap, and included in a second image in which the first overlapping imaging area that overlaps the first image is captured, or a value corresponding to brightness of a neighborhood of the first overlapping imaging range;

correcting brightness of the different image on the basis of the calculated value;

calculating, based on the brightness corrected result, a new value corresponding to brightness of a second overlapping imaging area or corresponding to brightness of a neighborhood of the second overlapping imaging range, from the brightness corrected image and a third image sharing the second overlapping imaging range with the brightness corrected image;

correcting brightness of the third image on the basis of the calculated new value; and

sequentially repeating the calculation of brightness and the correction of brightness in the same manner thereafter.