System and method for controlling vehicle equipment by determining spatial composition of an image of a vehicle window

• US 7,485,844 B2
• Filed: 03/29/2007
• Issued: 02/03/2009
• Est. Priority Date: 09/16/1997
• Status: Expired due to Fees

• Current Assignee: Gentex Corporation
• Original Assignee: Gentex Corporation
• Inventors: Roberts, John K., Stam, Joseph S., Bechtel, Jon H.
• Primary Examiner(s): Epps; Georgia Y
• Assistant Examiner(s): BUI PHO, PASCAL M
• Application Number:
  US11/693,087
• Publication Number:
  US 20070194208A1
• Time in Patent Office: 677 Days
• Field of Search: 250/227.25, 250900-908, 250573-577, 250/208.1, 356436-442, 356/445, 340601-604, 73/290.1, 318/483
• US Class Current: 250/227.25
• CPC Class Codes: B60S 1/0822 characterized by the arrangement or type of detection means
• CPC Class Codes: B60S 1/0833 Optical rain sensor
• CPC Class Codes: B60S 1/0844 including a camera
• CPC Class Codes: B60S 1/0885 the sensor being integrated in a rear-view mirror module
• CPC Class Codes: B60S 1/0888 characterized by the attachment of the elements in a unit
• CPC Class Codes: G06T 2207/20056 Discrete and fast Fourier transform, [DFT, FFT]
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 7/42 using transform domain methods
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: H04N 23/00 Cameras or camera modules comprising electronic image sensors; Control thereof
• CPC Class Codes: Y10S 15/15 Moisture responsive
• CPC Class Codes: Y10S 318/02 Windshield wiper controls

Abstract

A control system is disclosed for automatically detecting moisture on the windshield of a vehicle. The automatic moisture detecting system includes an optical system for imaging a portion of the windshield onto an image array sensor, such as a CMOS active pixel sensor. The voltage of each of the pixels which represents the illumination level is converted to a corresponding gray scale value by an analog digital converter. The spatial frequency composition of the gray scale values are analyzed to determine the amount of rain present in order to provide a control signal to control the operation of the windshield wipers of the vehicle as a function of the amount of moisture present. The system is also adapted to detect the level of fog both on the interior of the windshield as well as the exterior of the windshield.

Claims

1. A vehicle equipment control system comprising:

an image sensor having a two-dimensional array of pixel sensors for detecting moisture on a vehicle window, wherein the vehicle window is a windshield of the vehicle, and the vehicle having windshield wipers;

an optical system operable to image a portion of the vehicle window onto the image sensor; and

a processor in communication with the image sensor, the processor operative to determine spatial composition of the image whereby a vehicle equipment control signal is generated based on the determined spatial composition, wherein the processor determines a spatial frequency component of the moisture on the windshield and generates control signals to control the time intervals at which the windshield wipers are activated.

2. The system of claim 1 further including a rearview mirror assembly adapted for attaching to a vehicle, wherein said image sensor is supported by said rearview mirror assembly.

3. The system of claim 1 further including a rearview mirror assembly adapted for attaching to a vehicle, wherein at least a portion of said processor is supported by said rearview mirror assembly.

4. The system of claim 1, wherein the image sensor comprises a CMOS active pixel sensor.

5. The system of claim 1, wherein the system further includes an illuminator to illuminate the imaged portion of the vehicle window.

6. The system of claim 1, wherein the imaged portion of the vehicle window includes the path of a windshield wiper and the processor is further operable to determine if the wiper is in the imaged portion of the window using the determined spatial composition.

7. The system of claim 6, wherein the system further comprises a driver on/off sensitivity control in communication with the processor.

8. The system of claim 1, wherein the image sensor includes a windowing feature to alternately output signals from different regions of the image sensor that are smaller than the entire imaging area of the image sensor.

9. The system of claim 1, wherein the processor determines the spatial composition by detecting edges of objects in the image.

10. The system of claim 9, wherein the processing system determines the spatial composition by detecting high spatial frequency components.

11. The system of claim 1, wherein the processor is further operative to distinguish long term spatial components on the imaged portion of the vehicle window.

12. The system of claim 11, wherein said processor subtracts the long term components when analyzing an image to detect moisture.

13. The system of claim 1, further including a wiper system, wherein the processor detects removal of moisture from the vehicle window following actuation of the wiper system.

14. A method for controlling vehicle equipment upon the detection of moisture on a vehicle window comprising:

acquiring an image of a portion of the vehicle window;

generating a signal corresponding to the acquired image;

determining spatial high frequency components of the signal;

determining whether moisture is present on the vehicle window using the spatial high frequency components; and

generating a vehicle equipment control signal when moisture is present on the vehicle window.

15. The method of claim 14 wherein generating the signal comprises digitizing the acquired image to provide a digitized signal.

16. The method of claim 15, wherein determining spatial high frequency components of the digitized signal comprises using high pass digital filtering of the digitized signal.

17. The method of claim 14 further comprising illuminating the imaged portion of the vehicle window.

18. The method of claim 14, the vehicle including a wiper for wiping the vehicle window along a path, the imaged portion of the vehicle window including the path of the wiper wherein the method further comprises detecting the presence of the wiper in the imaged portion of the vehicle window.

19. The method of claim 18 wherein detecting the presence of the wiper comprises determining if a plurality of high frequency components in the direction of wiper travel through the imaged portion of the vehicle window is greater than a plurality of high frequency components in a direction normal to the direction of wiper travel through the imaged portion of the vehicle window.