IMAGING SYSTEM FOR VEHICLE

• US 20130250103A1
• Filed: 05/17/2013
• Published: 09/26/2013
• Est. Priority Date: 10/04/2007
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Lu, Yuesheng, Higgins-Luthman, Michael J., Livengood, William R., Harris, James D.
• Granted Patent: US 8,908,040 B2
• Time in Patent Office: Days
• US Class Current: 348/143
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/843 Demosaicing, e.g. interpolating colour pixel values
• CPC Class Codes: H04N 25/131 including elements passing infrared wavelengths
• CPC Class Codes: H04N 25/135 based on four or more different wavelength filter elements
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 9/646 for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters

Abstract

An imaging system for a vehicle includes an imaging sensor having four photosensing pixels of a sub-array, with one of (a) a red-light transmitting spectral filter disposed at a first photosensing pixel whereby the first pixel of each sub-array primarily senses red visible light and with an IR transmitting spectral filter disposed at the fourth photosensing pixel whereby the fourth pixel of each sub-array primarily senses infrared radiation, and (b) a red-light transmitting spectral filter disposed at a first photosensing pixel whereby the first pixel of each sub-array primarily senses red visible light and with an IR transmitting spectral filter disposed at a third photosensing pixel whereby the third pixel of each sub-array primarily senses infrared radiation. An image processor processes the output of each sub-array to determine at least one of an infrared component of the imaged scene and a visible light component of the imaged scene.

Claims

1. An imaging system suitable for use in a vehicle, said imaging system comprising:

an imaging sensor comprising a two-dimensional array of photosensing elements, said two-dimensional array comprising a plurality of sub-arrays, wherein each sub-array of said plurality of sub-arrays comprises four photosensing pixels comprising a first photosensing pixel, a second photosensing pixel, a third photosensing pixel and a fourth photosensing pixel;

wherein said four photosensing pixels of each said sub-array are arranged in a 2×

2 matrix with said fourth photosensing pixel disposed diagonally to said first photosensing pixel and with said third photosensing pixel disposed diagonally to said second photosensing pixel;

wherein one of (a) a red-light transmitting spectral filter is disposed at said first photosensing pixel whereby said first pixel of each said sub-array primarily senses red visible light and wherein an IR transmitting spectral filter is disposed at said fourth photosensing pixel whereby said fourth pixel of each said sub-array primarily senses infrared radiation and (b) a red-light transmitting spectral filter is disposed at said first photosensing pixel whereby said first pixel of each said sub-array primarily senses red visible light and wherein an IR transmitting spectral filter is disposed at said third photosensing pixel whereby said third pixel of each said sub-array primarily senses infrared radiation;

wherein said imaging sensor is configured to be disposed at a vehicle equipped with said imaging system and wherein, when said imaging sensor is disposed at the equipped vehicle, said imaging sensor has a field of view forwardly of the equipped vehicle through a windshield of the equipped vehicle;

an image processor for processing image data captured by said imaging sensor, wherein said image processor processes the output of each said sub-array to determine at least one of an infrared component of the imaged scene and a visible light component of the imaged scene;

wherein, responsive at least in part to processing by said image processor of the output of each said sub-array and with said imaging sensor disposed at the equipped vehicle and viewing forwardly through the windshield, said imaging system is operable to detect at least one of (i) a headlight of a vehicle ahead of the equipped vehicle, (ii) a taillight of a vehicle ahead of the equipped vehicle, (iii) a lane marking and (iv) a traffic sign.

2. The imaging system of claim 1, wherein a red-light transmitting spectral filter is disposed at said first photosensing pixel whereby said first pixel of each said sub-array primarily senses red visible light and wherein an IR transmitting spectral filter is disposed at said fourth photosensing pixel whereby said fourth pixel of each said sub-array primarily senses infrared radiation and wherein at least one of said second and third photosensing pixels of each said sub-array is a clear photosensing pixel.

3. The imaging system of claim 1, wherein a red-light transmitting spectral filter is disposed at said first photosensing pixel whereby said first pixel of each said sub-array primarily senses red visible light and wherein an IR transmitting spectral filter is disposed at said third photosensing pixel whereby said third pixel of each said sub-array primarily senses infrared radiation and wherein at least one of said second and fourth photosensing pixels of each said sub-array is a clear photosensing pixel.

4. The imaging system of claim 1, wherein a red-light transmitting spectral filter is disposed at said first photosensing pixel whereby said first pixel of each said sub-array primarily senses red visible light and wherein an IR transmitting spectral filter is disposed at said fourth photosensing pixel whereby said fourth pixel of each said sub-array primarily senses infrared radiation and wherein said second photosensing pixel of each said sub-array is a green photosensing pixel that primarily senses green visible light.

5. The imaging system of claim 1, wherein a red-light transmitting spectral filter is disposed at said first photosensing pixel whereby said first pixel primarily senses red visible light and wherein an IR transmitting spectral filter is disposed at said third photosensing pixel whereby said third pixel of each said sub-array primarily senses infrared radiation and wherein said second photosensing pixel of each said sub-array is a green photosensing pixel that primarily senses green visible light.

6. The imaging system of claim 1, wherein said imaging system is associated with at least one of an automatic headlamp control system, a lane departure warning system, an object detection system and a night vision system.

7. The imaging system of claim 1, wherein said imaging system is associated with an intelligent headlamp control system.

8. The imaging system of claim 1, wherein a near infrared illumination source is disposed at the equipped vehicle and is operable to emit near infrared illumination to illuminate forward of the equipped vehicle to enhance nighttime viewing by said imaging sensor, and wherein said near infrared illumination source, when activated, illuminates at least a portion of the forward field of view of said imaging sensor with near infrared illumination and wherein said near infrared illumination source comprises at least one of (i) a near infrared light-emitting light emitting diode and (ii) a near infrared light-emitting laser.

9. The imaging system of claim 1, wherein, responsive at least in part to determination of a red visible light component of the imaged scene via said processing of the output of said first pixel of each said sub-array and with said imaging sensor disposed at the equipped vehicle and viewing forwardly through the windshield, said imaging system is operable to detect traffic signs.

10. The imaging system of claim 1, wherein, responsive at least in part to determination of an infrared component of the imaged scene via said processing of the output of each said sub-array and with said imaging sensor disposed at the equipped vehicle and viewing forwardly through the windshield, said imaging system is operable to detect reflections by objects located forward of the equipped vehicle.

11. The imaging system of claim 1, wherein said two-dimensional array of photosensing elements comprises at least 262,144 photosensing pixels.

12. An imaging system suitable for use in a vehicle, said imaging system comprising:

an imaging sensor comprising a two-dimensional array of photosensing elements, said two-dimensional array comprising a plurality of sub-arrays, wherein each sub-array of said plurality of sub-arrays comprises four photosensing pixels comprising a first photosensing pixel, a second photosensing pixel, a third photosensing pixel and a fourth photosensing pixel;

wherein said four photosensing pixels of each said sub-array are arranged in a 2×

2 matrix with said fourth photosensing pixel disposed diagonally to said first photosensing pixel and with said third photosensing pixel disposed diagonally to said second photosensing pixel;

wherein one of (a) a red-light transmitting spectral filter is disposed at said first photosensing pixel whereby said first pixel of each said sub-array primarily senses red visible light and wherein an IR transmitting spectral filter is disposed at said fourth photosensing pixel whereby said fourth pixel of each said sub-array primarily senses infrared radiation and (b) a red-light transmitting spectral filter is disposed at said first photosensing pixel whereby said first pixel of each said sub-array primarily senses red visible light and wherein an IR transmitting spectral filter is disposed at said third photosensing pixel whereby said third pixel of each said sub-array primarily senses infrared radiation;

wherein said imaging sensor is configured to be disposed at a vehicle equipped with said imaging system and wherein, when said imaging sensor is disposed at the equipped vehicle, said imaging sensor has a field of view forwardly of the equipped vehicle through a windshield of the equipped vehicle;

an image processor for processing image data captured by said imaging sensor, wherein said image processor processes the output of each said sub-array to determine at least one of an infrared component of the imaged scene and a visible light component of the imaged scene;

wherein said second photosensing pixel of each said sub-array is a clear photosensing pixel; and

wherein, responsive at least in part to processing by said image processor of the output of each said sub-array and with said imaging sensor disposed at the equipped vehicle and viewing forwardly through the windshield, said imaging system is operable to detect at least one of (i) a headlight of a vehicle ahead of the equipped vehicle, (ii) a taillight of a vehicle ahead of the equipped vehicle, (iii) a lane marking and (iv) a traffic sign.

13. The imaging system of claim 12, wherein a red-light transmitting spectral filter is disposed at said first photosensing pixel whereby said first pixel of each said sub-array primarily senses red visible light and wherein an IR transmitting spectral filter is disposed at said fourth photosensing pixel whereby said fourth pixel of each said sub-array primarily senses infrared radiation.

14. The imaging system of claim 12, wherein a red-light transmitting spectral filter is disposed at said first photosensing pixel whereby said first pixel of each said sub-array primarily senses red visible light and wherein an IR transmitting spectral filter is disposed at said third photosensing pixel whereby said third pixel of each said sub-array primarily senses infrared radiation.

15. The imaging system of claim 12, wherein, responsive at least in part to determination of an infrared component of the imaged scene via said processing of the output of each said sub-array and with said imaging sensor disposed at the equipped vehicle and viewing forwardly through the windshield, said imaging system is operable to detect reflections by objects located forward of the equipped vehicle.

16. The imaging system of claim 12, wherein said two-dimensional array of photosensing elements comprises at least 262,144 photosensing pixels.

17. An imaging system suitable for use in a vehicle, said imaging system comprising:

an imaging sensor comprising a two-dimensional array of photosensing elements, said two-dimensional array comprising a plurality of sub-arrays, wherein each sub-array of said plurality of sub-arrays comprises four photosensing pixels comprising a first photosensing pixel, a second photosensing pixel, a third photosensing pixel and a fourth photosensing pixel;

wherein said four photosensing pixels of each said sub-array are arranged in a 2×

2 matrix with said fourth photosensing pixel disposed diagonally to said first photosensing pixel and with said third photosensing pixel disposed diagonally to said second photosensing pixel;

wherein one of (a) a red-light transmitting spectral filter is disposed at said first photosensing pixel whereby said first pixel of each said sub-array primarily senses red visible light and wherein an IR transmitting spectral filter is disposed at said fourth photosensing pixel whereby said fourth pixel of each said sub-array primarily senses infrared radiation and (b) a red-light transmitting spectral filter is disposed at said first photosensing pixel whereby said first pixel of each said sub-array primarily senses red visible light and wherein an IR transmitting spectral filter is disposed at said third photosensing pixel whereby said third pixel of each said sub-array primarily senses infrared radiation;

wherein said imaging sensor is configured to be disposed at a vehicle equipped with said imaging system and wherein, when said imaging sensor is disposed at the equipped vehicle, said imaging sensor has a field of view forwardly of the equipped vehicle through a windshield of the equipped vehicle;

an image processor for processing image data captured by said imaging sensor, wherein said image processor processes the output of each said sub-array to determine at least one of an infrared component of the imaged scene and a visible light component of the imaged scene;

wherein said second photosensing pixel of each said sub-array is a clear photosensing pixel;

wherein said imaging system is associated with at least one of an automatic headlamp control system, a lane departure warning system, an object detection system and a night vision system; and

wherein said two-dimensional array of photosensing elements comprises at least 262,144 photosensing pixels.

18. The imaging system of claim 17, wherein a red-light transmitting spectral filter is disposed at said first photosensing pixel whereby said first pixel of each said sub-array primarily senses red visible light and wherein an IR transmitting spectral filter is disposed at said fourth photosensing pixel whereby said fourth pixel of each said sub-array primarily senses infrared radiation.

19. The imaging system of claim 17, wherein a red-light transmitting spectral filter is disposed at said first photosensing pixel whereby said first pixel of each said sub-array primarily senses red visible light and wherein an IR transmitting spectral filter is disposed at said third photosensing pixel whereby said third pixel of each said sub-array primarily senses infrared radiation.

20. The imaging system of claim 17, wherein, responsive at least in part to determination of an infrared component of the imaged scene via said processing of the output of each said sub-array and with said imaging sensor disposed at the equipped vehicle and viewing forwardly through the windshield, said imaging system is operable to detect reflections by objects located forward of the equipped vehicle.