IMAGE PROCESSING SYSTEM AND METHOD

• US 20090009604A1
• Filed: 05/23/2008
• Published: 01/08/2009
• Est. Priority Date: 07/02/2007
• Status: Abandoned Application

• Current Assignee: Nissan Motor Co., Ltd.
• Original Assignee: Nissan Motor Co., Ltd.
• Inventors: Sakai, Kazuhiko, Otani, Sotaro, Kanaoka, Akihiro, Sugawara, Daisuke
• Application Number:
  US12/126,128
• Publication Number:
  US 20090009604A1
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2300/102 using 360 degree surveillance camera system
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 25/61 the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

An image processing system for a vehicle including a plurality of image pickup devices directed toward different predetermined areas around the vehicle to provide captured images and a display unit. Subject areas are extracted from the captured images, wherein the subject areas correspond to partial areas of predetermined areas captured by the image pickup devices that are adjacent to the image pickup devices. Brightness values of the subject areas are equalized to provide processed images, and the processed image are combined to generate a display image.

Claims

1. An image processing system for a vehicle including a plurality of image pickup devices directed to different predetermined areas around the vehicle to provide captured images of the predetermined areas and a display unit, the image processing system comprising:

an extracting unit configured to extract subject areas from the captured images wherein the subject areas correspond to partial areas of the predetermined areas that are adjacent to the image pickup devices;

an image processing unit including a brightness controlling unit configured to equalize brightness values of the subject areas to provide processed images;

a display image generating unit configured to combine the processed images to generate a display image.

2. The image processing system according to claim 1 wherein the display image generating unit is configured to convert the processed images into downward images corresponding to a downward view from a virtual view point located above the vehicle and to combine the downward images.

3. The image processing system according to claim 1, further comprising:

the plurality of image pickup devices, each of the plurality of image pickup devices having an image pickup element and a lens disposed in front of the image pickup element; and

wherein the image processing unit includes a first correcting unit configured to perform a first image correction for each of the subject areas in accordance with a luminance curve of a corresponding lens.

4. The image processing system according to claim 3, wherein the first correcting unit is configured to reduce a difference between a luminance value of a portion of a subject area that corresponds to a lens center portion of the corresponding lens and a luminance value of a portion of the subject area that corresponds to a lens edge portion of the corresponding lens.

5. The image processing system according to claim 1 wherein pairs of subject areas from captured images provided by adjacent image pickup devices define overlap portions;

and

the image processing unit includes a second correcting unit configured to detect a difference between average luminance values of the overlap portions in two subject areas after the brightness values are equalized and to perform a second image correction for at least one of the two subject areas to reduce the difference between the average luminance values.

6. The image processing system according to claim 1 wherein the brightness controlling unit is configured to perform automatic gain control processing.

7. An image processing system for a vehicle including a plurality of image pickup devices directed to different predetermined areas around the vehicle to provide captured images of the predetermined areas and a display unit, the image processing system comprising:

means for extracting subject areas from the captured images, wherein the subject areas correspond to partial areas of the predetermined areas that are adjacent to the vehicle;

means for equalizing brightness values of the subject areas to provide processed images; and

means for generating a display image from the processed images.

8. An image processing method for a vehicle including a plurality of image pickup devices directed to different predetermined areas around the vehicle to provide captured images of the predetermined areas and a display unit, the method comprising:

extracting subject area images of subject areas near the plurality of image pickup devices from captured images provided by the image pickup devices;

equalizing brightness values of the subject area images to provide processed images; and

combining the processed images to generate a composite image.

9. The image processing method according to claim 8, further comprising:

converting the processed images to a downward view from a virtual view point located above the vehicle before combining the processed images.

10. The image processing method according to claim 8, further comprising:

correcting a luminance value of each subject area image according to a luminance curve of a lens of a respective image pickup device.

11. The image processing method according to claim 8, further comprising:

reducing a difference between a luminance value of a portion of each subject area image that corresponds to a lens center portion of a lens of a respective image pickup device and a luminance value of a portion of the subject area image that corresponds to a lens edge portion of the lens of the respective image pickup device.

12. The image processing method of claim 8, further comprising:

detecting a difference between average luminance values of overlap portions of a pair of subject area images from captured images provided by adjacent image pickup devices after equalizing brightness values; and

correcting a luminance value of at least one of the subject area images to reduce the difference between the average luminance values of the overlap portions.

13. The image processing method of claim 8, further comprising:

performing automatic gain control processing on the subject area images to provide the processed images.