Image acquisition and processing systems for vehicle equipment control

• US 8,065,053 B2
• Filed: 01/31/2011
• Issued: 11/22/2011
• Est. Priority Date: 11/18/2004
• Status: Active Grant

• Current Assignee: Gentex Corporation
• Original Assignee: Gentex Corporation
• Inventors: Walstra, Eric J., DeBruine, Timothy S., Bush, Gregory S., Stam, Joseph S.
• Primary Examiner(s): Tran; Dalena
• Assistant Examiner(s): FIGUEROA, JAIME
• Application Number:
  US13/017,764
• Publication Number:
  US 20110125374A1
• Time in Patent Office: 295 Days
• Field of Search: 701/26, 701/36, 701/38, 340/42, 340/148, 340/307, 340/461, 340/435, 340/901, 340/903, 340/469, 340/939, 348/36, 348/E13.007, 348/E13.015, 348/E13.026, 348/E7.085, 348/E9.002, 359/462.1, 359/462.11, 359/462.41, 381/86, 381/87, 381/122, 381/345, 381/389, 455/41.2, 455/569.2, 382/173, 250/208.1
• US Class Current: 701/36
• CPC Class Codes: B60Q 1/1423 Automatic dimming circuits, i.e. switching between high beam and low beam due to change of ambient light or light level in road traffic
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60R 1/04 mounted inside vehicle B60R1/025, B60R1/08 take precedence
• CPC Class Codes: B60R 1/06 mounted on vehicle exterior B60R1/025, B60R1/08 take precedence
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 21/0134 responsive to imminent contact with an obstacle , e.g. using radar systems
• CPC Class Codes: B60R 21/01538 for image processing, e.g. cameras or sensor arrays
• CPC Class Codes: B60R 2300/106 using night vision cameras
• CPC Class Codes: B60R 2300/108 using 'non-standard' camera systems, e.g. camera sensor used for additional purposes i.a. rain sensor, camera sensor split in multiple image areas
• CPC Class Codes: B60R 2300/302 combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/804 for lane monitoring
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road

Abstract

An improved image acquisition and processing system includes an image sensor and one or more processors that are configured to receive at least a portion of at least one image from the image sensor. The dynamic aim of the image sensor is configured as a function of at least one feature extracted from at least a portion of an image. The processors are further configured to generate at least one vehicle equipment control signal as a function of the extracted feature.

Claims

1. An apparatus, comprising:

at least one image sensor;

at least one processor configured to receive at least a portion of at least one image from said at least one image sensor such that a dynamic aim of said at least one image sensor is configured as a function of at least one lane marker identified in at least a portion of said at least one image and generates at least one vehicle equipment control signal as a function of at least one extracted feature from said at least one image; and

wherein said dynamic aim of said at least one image sensor adapts to changes in road conditions for establishing a position of approximately a center of a road captured in said at least one image.

2. The apparatus as in claim 1, wherein said at least one extracted feature is at least one lane marker.

3. The apparatus as in claim 1, wherein an intersection of a left lane marker and a right lane marker indicates the center of a road.

4. The apparatus as in claim 1, wherein said portion of the at least one image is divided into a plurality of cells defining a series of sub-windows within an original image.

5. The apparatus as in claim 1, configured as a rearview mirror assembly comprising at least one of:

a second imager sensor, an automatic exterior light control module, a moisture sensor module, a compass sensor, a compass, a speaker, a microphone, a windshield wiper automatic control, a digital signal processor, an automatic defogger control, a collision avoidance control, a lane departure warning module, an electro-optic mirror element control module, a supplemental illuminator module, a photo sensor and a second processor.

6. The apparatus as in claim 1, configured as a rearview mirror having at least one device comprising:

an imager, an automatic exterior light control module, a moisture sensor module, a compass sensor, a compass, a speaker, a microphone, a windshield wiper automatic control, a digital signal processor, an automatic defogger control, a collision avoidance control, a lane departure warning module, an electro-optic mirror element control module, a supplemental illuminator module, a photo sensor and a second processor.

7. The apparatus as in claim 1, configured to function as at least of:

an automatic exterior light control system, a moisture sensing system, a windshield wiper control, a defroster control, a defogger control, a lane keeping system, a lane departure warning system, a security system, a vision system, an adaptive cruise control system, a parking aid system, a blind spot warning system, a sun load sensing system, a blue sky detection system, a tunnel detection system, a day time running lights control system, a security system, an air bag activation system, a rear vision system, an occupancy detection system, a monitoring system, a collision avoidance system, an accident recreation system and an image acquisition system.

8. The apparatus, comprising:

at least one image sensor;

at least one processor configured to receive at least a portion of at least one image from said at least one image sensor such that a dynamic aim of said at least one image sensor is adjusted as a function of at least one lane marker detected by said at least one image sensor; and

wherein said dynamic aim of said at least one image sensor adapts to changes in road conditions for establishing a position of approximately a center of a road captured in said at least one image.

9. The apparatus as in claim 8, wherein the portion of at least one image is divided into a plurality of cells defining a series of sub-windows within an original image.

10. The apparatus as in claim 8, wherein said at least one processor includes:

a first processor for use with the at least image sensor; and

a second processor configured to generate at least one vehicle equipment control signal as a function of the at least a portion of the at least one image.

11. The apparatus as in claim 10, wherein said at least one vehicular equipment control signal is used in connection with:

vision assistance, headlamp control, rain sensing, lane departure warning, collision avoidance, sign recognition or adaptive cruise control.

12. The apparatus as in claim 8, configured as a rearview mirror assembly comprising a housing, having at least one device selected from:

an imager, an automatic exterior light control module, a moisture sensor module, a compass sensor, a compass, a speaker, a microphone, a windshield wiper automatic control, a digital signal processor, an automatic defogger control, a collision avoidance control, a lane departure warning module, an electro-optic mirror element control module, a supplemental illuminator module, a photo sensor and a processor.

13. The apparatus as in claim 8, configured to function as:

an automatic exterior light control system, a moisture sensing system, a windshield wiper control, a defroster control, a defogger control, a lane keeping system, a lane departure warning system, a security system, a vision system, an adaptive cruise control system, a parking aid system, a blind spot warning system, a sun load sensing system, a blue sky detection system, a tunnel detection system, a day time running lights control system, a security system, an air bag activation system, a rear vision system, an occupancy detection system, a monitoring system, a collision avoidance system, an accident recreation system or an image acquisition system.

14. An apparatus, comprising:

at least one imager for performing multiple vehicular functions;

at least one processor configured to receive at least a portion of at least one image from said at least one imager such that a dynamic aim of said at least one imager is configured as a function of at least one lane marker detected by said at least one imager and a portion of at least one image is divided into a plurality of cells defining a series of sub-windows within an original image; and

wherein said dynamic aim of said at least one image sensor adapts to changes in road conditions for establishing a position of approximately a center of a road captured in such at least one image.

15. The apparatus as in claim 14, wherein said multiple vehicular functions include:

vision assistance, headlamp control, rain sensing, lane departure warning, collision avoidance, sign recognition, or adaptive cruise control.

16. The apparatus as in claim 14, wherein said at least one processor includes:

a first processor configured to adjust the dynamic aim of the at least one imager; and

a second processor configured to generate at least one vehicle equipment control signal as a function of the at least a portion of at least one image.

17. The apparatus as in claim 14, wherein said dynamic aim comprises aiming said imager at least once every small number of image cycles.