IMAGE SENSING SYSTEM FOR A VEHICLE

• US 20070120706A1
• Filed: 01/24/2007
• Published: 05/31/2007
• Est. Priority Date: 02/26/1993
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Donnelly Corporation (Magna International Incorporated)
• Inventors: Schofield, Kenneth, Larson, Mark, Vadas, Keith
• Granted Patent: US 7,459,664 B2
• Time in Patent Office: Days
• US Class Current: 340/901
• CPC Class Codes: B60Q 1/1423 Automatic dimming circuits, i.e. switching between high beam and low beam due to change of ambient light or light level in road traffic
• CPC Class Codes: B60Q 2300/054 Variable non-standard intensity, i.e. emission of various beam intensities different from standard intensities, e.g. continuous or stepped transitions of intensity
• CPC Class Codes: B60Q 2300/056 Special anti-blinding beams, e.g. a standard beam is chopped or moved in order not to blind
• CPC Class Codes: B60Q 2300/21 Manual control
• CPC Class Codes: B60Q 2300/312 Adverse weather
• CPC Class Codes: B60Q 2300/314 Ambient light
• CPC Class Codes: B60Q 2300/41 preceding vehicle
• CPC Class Codes: B60Q 2300/42 oncoming vehicle
• CPC Class Codes: B60R 2001/1223 with sensors or transducers
• CPC Class Codes: B60S 1/0822 characterized by the arrangement or type of detection means
• CPC Class Codes: B60S 1/0844 including a camera
• CPC Class Codes: B60S 1/087 including an ambient light sensor control of vehicle lights B60Q
• CPC Class Codes: G01J 1/0488 with spectral filtering
• CPC Class Codes: G01J 1/4228 arrangements with two or more detectors, e.g. for sensitivity compensation
• CPC Class Codes: G01J 3/02 Details
• CPC Class Codes: G01J 3/36 Investigating two or more bands of a spectrum by separate detectors
• CPC Class Codes: G01J 3/51 using colour filters
• CPC Class Codes: G01J 3/513 having fixed filter-detector pairs
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle

Abstract

An image sensing system for a vehicle includes an imaging sensor and a logic and control circuit. The imaging sensor comprises a two-dimensional array of light sensing photosensor elements formed on a semiconductor substrate and is disposed at an interior portion of the vehicle proximate the windshield of the vehicle and has a forward field of view to the exterior of the vehicle through an area of the windshield. The logic and control circuit comprises an image processor for processing image data derived from the imaging sensor. The logic and control circuit generates at least one control output. The image sensing system detects lane markers on a road being traveled by the vehicle and present in the field of view of the imaging sensor.

Claims

1. An image sensing system for a vehicle, said image sensing system comprising:

an imaging sensor;

said imaging sensor comprising a two-dimensional array of light sensing photosensor elements formed on a semiconductor substrate;

said imaging sensor disposed at an interior portion of the vehicle proximate the windshield of the vehicle;

said imaging sensor having a forward field of view to the exterior of the vehicle through an area of the windshield;

a logic and control circuit;

said logic and control circuit comprising an image processor for processing image data derived from said imaging sensor;

said image processing comprising at least one of (i) spatial differentiation, (ii) spectral signature recognition, and (iii) pattern recognition;

said logic and control circuit generating at least one control output; and

wherein said image sensing system detects lane markers on a road being traveled by the vehicle and present in the field of view of said imaging sensor.

2. The image sensing system of claim 1, wherein at least one of (i) said array of light sensing photosensor elements and (ii) at least a portion of said logic and control circuit is formed on said semiconductor substrate as a CMOS device.

3. The image sensing system of claim 1, wherein said array of light sensing photosensor elements and at least a portion of said logic and control circuit are formed on said semiconductor substrate as a CMOS device.

4. The image sensing system of claim 2, wherein said portion of said logic and control circuit comprises at least one of (i) an analog-to-digital converter, (ii) a logic circuit, (iii) a clock, (iv) random access memory, and (v) a digital-to-analog converter.

5. The image sensing system of claim 1 further comprising a lens imaging light external of the vehicle onto said array of light sensing photosensor elements, and wherein said lens comprises a molded plastic lens.

6. The image sensing system of claim 1, including a lens imaging light external of the vehicle onto said array of light sensing photosensor elements and wherein said lens is at least one of (i) bonded to said imaging sensor and (ii) in close contact with said imaging sensor.

7. The image sensing system of claim 1, wherein said interior portion is at or proximate to an interior rearview mirror assembly of the vehicle.

8. The image sensing system of claim 1, wherein at least a portion of said logic and control circuit is commonly formed with said array of light sensing photosensor elements on said semiconductor substrate as an integrated circuit.

9. The image sensing system of claim 1, wherein said logic and control circuit comprises a logic circuit, at least a portion of said logic circuit comprising a configuration of digital logic elements formed on said semiconductor substrate.

10. The image sensing system of claim 1, wherein said logic and control circuit comprises a logic circuit, said logic circuit comprising at least one of (i) a central processing unit and (ii) a read-only-memory.

11. The image sensing system of claim 1, wherein anti-blooming is provided to mitigate the effect of charge leakage from one of said light sensing photosensor elements to an adjacent one of said light sensing photosensor elements.

12. The image sensing system of claim 1, wherein said logic and control circuit determines a background light level.

13. The image sensing system of claim 1, wherein said at least one control output controls as a function of a speed of the vehicle.

14. The image sensing system of claim 1, wherein said interior portion is generally centrally located along the vehicle axis and is relatively high in the interior of the vehicle.

15. The image sensing system of claim 1, wherein said forward field of view has a horizontal field of view and a vertical field of view and wherein said horizontal field of view is wider than said vertical field of view.

16. The image sensing system of claim 1, wherein said image processing comprises pattern recognition and wherein said pattern recognition identifies objects of interest based on at least one of (i) shape, (ii) reflectivity, (iii) luminance, and (iv) spectral characteristic.

17. The image sensing system of claim 1, wherein said image processing identifies objects of interest and wherein object recognition is enhanced by comparing identified objects over successive frames.

18. The image sensing system of claim 1, wherein said image processing identifies objects of interest and wherein objects of interest are at least one of qualified and disqualified based on object motion in said field of view of said imaging sensor.

19. The image sensing system of claim 1, wherein said imaging sensor detects conditions indicative of fog forward of the vehicle.

20. The image sensing system of claim 1, wherein said detection of lane markers comprises identification by spectral signature.

21. The image sensing system of claim 1, wherein said windshield area comprises a windshield area that is swept by the windshield wipers.

22. An image sensing system for a vehicle, said image sensing system comprising:

an imaging sensor;

said imaging sensor comprising a two-dimensional array of light sensing photosensor elements formed on a semiconductor substrate;

said imaging sensor disposed at an interior portion of the vehicle proximate the windshield of the vehicle;

said imaging sensor having a forward field of view to the exterior of the vehicle through an area of the windshield and wherein said windshield area comprises a windshield area that is swept by the windshield wipers;

a logic and control circuit;

said logic and control circuit comprising an image processor for processing image data derived from said imaging sensor;

said image processing comprising at least one of (i) spatial differentiation, (ii) spectral signature recognition, and (iii) pattern recognition;

said logic and control circuit generating at least one control output;

wherein said image sensing system detects lane markers on a road being traveled by the vehicle and present in the field of view of said imaging sensor; and

wherein said detection of lane markers comprises identification by spectral signature.

23. The image sensing system of claim 22, wherein at least one of (i) said array of light sensing photosensor elements and (ii) at least a portion of said logic and control circuit is formed on said semiconductor substrate as a CMOS device.

24. The image sensing system of claim 22, wherein said array of light sensing photosensor elements and at least a portion of said logic and control circuit are formed on said semiconductor substrate as a CMOS device and wherein said portion of said logic and control circuit comprises at least one of (i) an analog-to-digital converter, (ii) a logic circuit, (iii) a clock, (iv) random access memory, and (v) a digital-to-analog converter.

25. The image sensing system of claim 22, including a lens imaging light external of the vehicle onto said light sensing array, and wherein said lens comprises a molded plastic lens and wherein said lens is at least one of (i) bonded to said imaging sensor and (ii) in close contact with said imaging sensor.

26. The image sensing system of claim 22, wherein said interior portion is at or proximate to an interior rearview mirror assembly of the vehicle.

27. The image sensing system of claim 22, wherein said forward field of view has a horizontal field of view and a vertical field of view and wherein said horizontal field of view is wider than said vertical field of view.

28. The image sensing system of claim 22, wherein said image processing comprises pattern recognition and wherein said pattern recognition identifies objects of interest based on at least one of (i) shape, (ii) reflectivity, (iii) luminance, and (iv) spectral characteristic.

29. The image sensing system of claim 22, wherein said image processing identifies objects of interest and wherein object recognition is enhanced by comparing identified objects over successive frames.

30. The image sensing system of claim 22, wherein said image processing identifies objects of interest and wherein objects of interest are at least one of qualified and disqualified based on object motion in said field of view of said imaging sensor.

31. An image sensing system for a vehicle, said image sensing system comprising:

an imaging sensor;

said imaging sensor comprising a two-dimensional array of light sensing photosensor elements formed on a semiconductor substrate;

said imaging sensor disposed at an interior portion of the vehicle proximate the windshield of the vehicle;

said imaging sensor having a forward field of view to the exterior of the vehicle through an area of the windshield and wherein said windshield area comprises a windshield area that is swept by the windshield wipers;

a logic and control circuit;

said logic and control circuit comprising an image processor for processing image data derived from said imaging sensor;

said logic and control circuit generating at least one control output;

wherein said image sensing system detects lane markers on a road being traveled by the vehicle and present in the field of view of said imaging sensor; and

wherein said image processing comprises pattern recognition and wherein said pattern recognition identifies objects of interest based on at least one of (i) shape, (ii) reflectivity, (iii) luminance, and (iv) spectral characteristic.

32. The image sensing system of claim 31, wherein at least one of (a) at least one of (i) said array of light sensing photosensor elements and (ii) at least a portion of said logic and control circuit is formed on said semiconductor substrate as a CMOS device and (b) said array of light sensing photosensor elements and at least a portion of said logic and control circuit are formed on said semiconductor substrate as a CMOS device.

33. The image sensing system of claim 31, wherein said forward field of view has a horizontal field of view and a vertical field of view and wherein said horizontal field of view is wider than said vertical field of view and wherein object recognition is enhanced by comparing identified objects over successive frames.

34. The image sensing system of claim 31, wherein objects of interest are at least one of qualified and disqualified based on object motion in said field of view of said imaging sensor.

35. The image sensing system of claim 31, wherein said image processing comprises at least one of (i) spatial differentiation and (ii) spectral signature recognition.

36. The image sensing system of claim 31, wherein said detection of lane markers comprises identification by spectral signature.

37. The image sensing system of claim 31, wherein said interior portion is at or proximate to an interior rearview mirror assembly of the vehicle.

38. An image sensing system for a vehicle, said image sensing system comprising:

an imaging sensor;

said imaging sensor comprising a two-dimensional array of light sensing photosensor elements formed on a semiconductor substrate as a CMOS device;

said imaging sensor disposed at an interior portion of the vehicle proximate the windshield of the vehicle and wherein said interior portion is at or proximate to an interior rearview mirror assembly of the vehicle;

said imaging sensor having a forward field of view to the exterior of the vehicle through an area of the windshield and wherein said windshield area comprises a windshield area that is swept by the windshield wipers;

a logic and control circuit;

said logic and control circuit comprising an image processor for processing image data derived from said imaging sensor;

said logic and control circuit generating at least one control output;

wherein said image sensing system detects lane markers on a road being traveled by the vehicle and present in the field of view of said imaging sensor;

wherein said image processing comprises pattern recognition and wherein said pattern recognition identifies objects of interest based on at least one of (i) shape, (ii) reflectivity, (iii) luminance, and (iv) spectral characteristic; and

wherein said forward field of view has a horizontal field of view and a vertical field of view and wherein said horizontal field of view is wider than said vertical field of view.

39. The image sensing system of claim 38, wherein said array of light sensing photosensor elements and at least a portion of said logic and control circuit are commonly formed on said semiconductor substrate as a CMOS device.

40. The image sensing system of claim 38, wherein said image processing comprises at least one of (i) spatial differentiation and (ii) spectral signature recognition.

41. The image sensing system of claim 38, wherein said detection of lane markers comprises identification by spectral signature.

42. An image sensing system for a vehicle, said image sensing system comprising:

an imaging sensor;

said imaging sensor comprising a two-dimensional array of light sensing photosensor elements formed on a semiconductor substrate;

said imaging sensor disposed at an interior portion of the vehicle proximate the windshield of the vehicle and wherein said interior portion is at or proximate to an interior rearview mirror assembly of the vehicle;

said imaging sensor having a forward field of view to the exterior of the vehicle through an area of the windshield and wherein said windshield area comprises a windshield area that is swept by the windshield wipers;

a logic and control circuit;

said logic and control circuit comprising an image processor for processing image data derived from said imaging sensor;

said logic and control circuit generating at least one control output;

wherein said image sensing system detects lane markers on a road being traveled by the vehicle and present in the field of view of said imaging sensor;

wherein said image processing comprises pattern recognition;

wherein said image processing identifies objects of interest and wherein object recognition is enhanced by comparing identified objects over successive frames; and

wherein said forward field of view has a horizontal field of view and a vertical field of view and wherein said horizontal field of view is wider than said vertical field of view.

43. The image sensing system of claim 42, wherein at least one of (i) said array of light sensing photosensor elements and (ii) at least a portion of said logic and control circuit is formed on said semiconductor substrate as a CMOS device.

44. The image sensing system of claim 42, wherein said pattern recognition identifies objects of interest based on at least one of (i) shape, (ii) reflectivity, (iii) luminance, and (iv) spectral characteristic.

45. The image sensing system of claim 42, wherein objects of interest are at least one of qualified and disqualified based on object motion in said field of view of said imaging sensor.