IMAGE SENSING SYSTEM FOR A VEHICLE

• US 20070120657A1
• Filed: 01/24/2007
• Published: 05/31/2007
• Est. Priority Date: 02/26/1993
• Status: Abandoned Application

• Current Assignee: Donnelly Corporation (Magna International Incorporated)
• Original Assignee: Donnelly Corporation (Magna International Incorporated)
• Inventors: Schofield, Kenneth, Larson, Mark, Vadas, Keith
• Application Number:
  US11/626,529
• Publication Number:
  US 20070120657A1
• Time in Patent Office: Days
• US Class Current: 340/435
• CPC Class Codes: B60N 2/002 Seats provided with an occupancy detection means mounted therein or thereon detection means responsive to presence or absence of children B60N2/266
• CPC Class Codes: B60Q 1/14 having dimming means
• CPC Class Codes: B60Q 1/1423 Automatic dimming circuits, i.e. switching between high beam and low beam due to change of ambient light or light level in road traffic
• CPC Class Codes: B60Q 2300/054 Variable non-standard intensity, i.e. emission of various beam intensities different from standard intensities, e.g. continuous or stepped transitions of intensity
• CPC Class Codes: B60Q 2300/056 Special anti-blinding beams, e.g. a standard beam is chopped or moved in order not to blind
• CPC Class Codes: B60Q 2300/21 Manual control
• CPC Class Codes: B60Q 2300/314 Ambient light
• CPC Class Codes: B60Q 2300/3321 Detection of streetlights
• CPC Class Codes: B60Q 2300/41 preceding vehicle
• CPC Class Codes: B60Q 2300/42 oncoming vehicle
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/088 using a cell of electrically changeable optical characteristic, e.g. liquid-crystal or electrochromic mirrors
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 1/30 providing vision in the non-visible spectrum, e.g. night or infrared vision
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2001/1223 with sensors or transducers
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 21/01538 for image processing, e.g. cameras or sensor arrays
• CPC Class Codes: B60R 2300/101 : using cameras with adjustable capturing direction
• CPC Class Codes: B60R 2300/103 : using camera systems provided with artificial illumination device, e.g. IR light source
• CPC Class Codes: B60R 2300/105 : using multiple cameras
• CPC Class Codes: B60R 2300/106 : using night vision cameras
• CPC Class Codes: B60R 2300/107 : using stereoscopic cameras
• CPC Class Codes: B60R 2300/205 : using a head-up display
• CPC Class Codes: B60R 2300/207 : using multi-purpose displays, e.g. camera image and navigation or video on same display
• CPC Class Codes: B60R 2300/30 : characterised by the type of image processing
• CPC Class Codes: B60R 2300/302 : combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/303 : using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/304 : using merged images, e.g. merging camera image with stored images
• CPC Class Codes: B60R 2300/305 : merging camera image with lines or icons
• CPC Class Codes: B60R 2300/307 : virtually distinguishing relevant parts of a scene from the background of the scene
• CPC Class Codes: B60R 2300/404 : triggering from stand-by mode to operation mode
• CPC Class Codes: B60R 2300/50 : characterised by the display information being shared, e.g. external display, data transfer to other traffic participants or centralised traffic controller
• CPC Class Codes: B60R 2300/802 : for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/8026 : in addition to a rear-view mirror system
• CPC Class Codes: B60R 2300/804 : for lane monitoring
• CPC Class Codes: B60R 2300/8053 : for bad weather conditions or night vision
• CPC Class Codes: B60R 2300/806 : for aiding parking
• CPC Class Codes: B60R 2300/8066 : for monitoring rearward traffic
• CPC Class Codes: B60R 2300/8086 : for vehicle path indication
• CPC Class Codes: B60R 2300/8093 : for obstacle warning
• CPC Class Codes: B60S 1/0822 : characterized by the arrangement or type of detection means
• CPC Class Codes: B60S 1/0844 : including a camera
• CPC Class Codes: B60S 1/0885 : the sensor being integrated in a rear-view mirror module
• CPC Class Codes: G01J 1/4204 : with determination of ambient light solar light G01J2001/4266
• CPC Class Codes: G01J 1/4228 : arrangements with two or more detectors, e.g. for sensitivity compensation
• CPC Class Codes: G08G 1/167 : Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: H04N 13/239 : using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 2013/0081 : Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 7/18 : Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources

Abstract

An image sensing system for a vehicle includes an imaging sensor and a logic and control circuit. The imaging sensor comprises a two-dimensional array of light sensing photosensor elements formed on a semiconductor substrate, and has a field of view exterior of the vehicle. The logic and control circuit comprises an image processor for processing image data derived from the imaging sensor. The image sensing system may generate an indication of the presence of an object within the field of view of the imaging sensor. Preferably, video images may be captured by said imaging sensor and may be displayed by a display device for viewing by the driver when operating the vehicle. The logic and control circuit may generate at least one control output, and the at least control output may control an enhancement of the video images.

Claims

1. An image sensing system for a vehicle, said image sensing system comprising:

an imaging sensor;

said imaging sensor comprising a two-dimensional array of light sensing photosensor elements;

wherein said array of light sensing photosensor elements and at least a portion of said logic and control circuit are commonly formed on a semiconductor substrate;

said imaging sensor having a field of view exterior of the vehicle;

wherein said image sensing system generates an indication of the presence of an object within the field of view of said imaging sensor;

wherein said indication comprises at least one of a visual warning and an audible warning;

a logic and control circuit; and

said logic and control circuit comprising an image processor for processing image data derived from said imaging sensor.

2. The image sensing system of claim 1, wherein said array of light sensing photosensor elements is formed on said semiconductor substrate as a CMOS device.

3. The image sensing system of claim 1, wherein said array of light sensing photosensor elements and at least a portion of said logic and control circuit are commonly formed on a semiconductor substrate as an integrated circuit.

4. The image sensing system of claim 1, wherein said array of light sensing photosensor elements and at least a portion of said logic and control circuit are commonly formed on a semiconductor substrate as a CMOS device.

5. The image sensing system of claim 1, wherein said logic and control circuit generates at least one control output, said control output being indicative of another vehicle rearward of and approaching the vehicle equipped with said imaging sensor.

6. The image sensing system of claim 5, wherein said at least one control output is indicative that a lane change may not be safely undertaken by the vehicle equipped with said imaging sensor.

7. The image sensing system of claim 6, wherein said at least one control output is generated based on at least one of distance and speed of a trailing vehicle.

8. The image sensing system of claim 5, wherein said at least one control output controls an alarm audible to the driver when operating the vehicle.

9. The image sensing system of claim 5, wherein said at least one control output controls a display device visible to the driver when operating the vehicle.

10. The image sensing system of claim 5, wherein video images captured by said imaging sensor are displayed by a display device for viewing by the driver when operating the vehicle.

11. The image sensing system of claim 10, wherein the driver of the vehicle has a field of view through the windshield of the vehicle and wherein said display device may be observed by the driver at the upward portion of said driver'"'"'s field of view.

12. The image sensing system of claim 10, wherein said display device is disposed at or proximate an interior mirror assembly location of the vehicle.

13. The image sensing system of claim 10, wherein said display device comprises a display device selected from the group comprising (i) a back lit liquid crystal display device, (ii) a plasma display device, and (iii) a field emission display device.

14. The image sensing system of claim 10, wherein said at least one control output controls an enhancement of said video images.

15. The image sensing system of claim 14, wherein said enhancement of said video images comprises at least one of (i) a graphic overlay, (ii) displaying an imaged object in a particular color, and (iii) flashing an imaged object.

16. The image sensing system of claim 15, wherein said enhancement is a function of the speed of the vehicle equipped with said imaging sensor.

17. The image sensing system of claim 14, wherein said enhancement of said video images displayed by said display device is a function of at least one of (i) the travel direction of the vehicle equipped with said imaging sensor, (ii) the speed of the vehicle equipped with said imaging sensor, (iii) the rate of turn of the vehicle equipped with said imaging sensor, and (iv) the separation distance of the vehicle equipped with said imaging sensor to adjacent objects.

18. The image sensing system of claim 1, wherein video images captured by said imaging sensor are displayed by a display device for viewing by the driver when operating the vehicle in a forward direction of travel.

19. The image sensing system of claim 1, wherein said logic and control circuit comprises at least one of (i) an analog-to-digital converter, (ii) a logic circuit, (iii) a clock, (iv) a random access memory, and (v) a digital-to-analog converter.

20. The image sensing system of claim 1, wherein said field of view comprises a blind spot to the rear of the vehicle.

21. The image sensing system of claim 1, wherein the vehicle equipped with said imaging sensor comprises a distance-measuring system.

22. The image sensing system of claim 21, wherein said distance-measuring system comprises at least one of (a) a radar sensor, (ii) an ultrasonic sensor, (ii) an infrared sensor and (ii) a stereoscopic sensor.

23. The image sensing system of claim 1, wherein said imaging sensor is disposed at an interior portion of the vehicle and has a field of view exterior of the vehicle through a window of the vehicle.

24. The image sensing system of claim 1, wherein said imaging sensor comprises a night vision imaging sensor.

25. The image sensing system of claim 24, wherein said night vision imaging sensor comprises a monochrome imaging sensor.

26. The image sensing system of claim 25, wherein said monochrome night vision imaging sensor is disposed at an interior portion of the vehicle and has a field of view exterior of the vehicle through a window of the vehicle.

27. An image sensing system for a vehicle, said image sensing system comprising:

an imaging sensor;

said imaging sensor comprising a two-dimensional array of light sensing photosensor elements;

wherein said array of light sensing photosensor elements is formed on a semiconductor substrate as a CMOS device;

said imaging sensor having a field of view exterior of the vehicle;

a logic and control circuit;

said logic and control circuit comprising an image processor for processing image data derived from said imaging sensor;

a display device visible to the driver when operating the vehicle;

wherein video images captured by said imaging sensor are displayed by said display device for viewing by the driver when operating the vehicle;

wherein said logic and control circuit generates at least one control output, and wherein said at least one control output controls an enhancement of said video images; and

wherein said enhancement enhances the driver'"'"'s awareness of the presence of an object within the field of view of said imaging sensor.

28. The image sensing system of claim 27, wherein said array of light sensing photosensor elements and at least a portion of said logic and control circuit are commonly formed on a semiconductor substrate as at least one of (i) an integrated circuit and (ii) a CMOS device.

29. The image sensing system of claim 27, wherein said control output is a function of a determination by said logic and control circuit of another vehicle rearward of and approaching the vehicle equipped with said imaging sensor.

30. The image sensing system of claim 29, wherein said at least one control output is indicative that a lane change may not be safely undertaken by the vehicle equipped with said imaging sensor.

31. The image sensing system of claim 30, wherein said indication is generated based on at least one of distance and speed of a trailing vehicle.

32. The image sensing system of claim 29, wherein said at least one control output controls an alarm audible to the driver when operating the vehicle.

33. The image sensing system of claim 27, wherein said logic and control circuit comprises at least one of (i) an analog-to-digital converter, (ii) a logic circuit, (iii) a clock, (iv) a random access memory, and (v) a digital-to-analog converter.

34. The image sensing system of claim 27, wherein said video images are visible to the driver when operating the vehicle in a forward direction of travel.

35. The image sensing system of claim 27, wherein said field of view comprises a blind spot to the rear of the vehicle.

36. The image sensing system of claim 27, wherein said display device is disposed at or proximate an interior mirror assembly location of the vehicle.

37. The image sensing system of claim 27, wherein said display device comprises a display device selected from the group comprising (i) a back lit liquid crystal display device, (ii) a plasma display device, and (iii) a field emission display device.

38. The image sensing system of claim 27, wherein said enhancement of said video images comprises at least one of (i) a graphic overlay, (ii) displaying an imaged object in a particular color, and (iii) flashing an imaged object.

39. The image sensing system of claim 27, wherein said enhancement is a function of the speed of the vehicle equipped with said imaging sensor.

40. The image sensing system of claim 27, wherein the vehicle equipped with said imaging sensor comprises a distance-measuring system.

41. The image sensing system of claim 40, wherein said distance-measuring system comprises at least one of (a) a radar sensor, (ii) an ultrasonic sensor, (ii) an infrared sensor and (ii) a stereoscopic sensor.

42. The image sensing system of claim 27, wherein said enhancement of said video images displayed by said display device is a function of at least one of (i) the travel direction of the vehicle equipped with said imaging sensor, (ii) the speed of the vehicle equipped with said imaging sensor, (iii) the rate of turn of the vehicle equipped with said imaging sensor, and (iv) the separation distance of the vehicle equipped with said imaging sensor to adjacent objects.

43. The image sensing system of claim 27, wherein said imaging sensor is disposed at an interior portion of the vehicle and has a field of view exterior of the vehicle through a window of the vehicle.

44. The image sensing system of claim 27, wherein said imaging sensor comprises a night vision imaging sensor.

45. The image sensing system of claim 44, wherein said night vision imaging sensor comprises a monochrome imaging sensor.

46. The image sensing system of claim 45, wherein said monochrome night vision imaging sensor imaging sensor is disposed at an interior portion of the vehicle and has a field of view exterior of the vehicle through a window of the vehicle.

47. An image sensing system for a vehicle, said image sensing system comprising:

an imaging sensor;

said imaging sensor comprising a two-dimensional array of light sensing photosensor elements;

wherein said array of light sensing photosensor elements is formed on a semiconductor substrate;

said imaging sensor having a field of view exterior of the vehicle;

a logic and control circuit;

said logic and control circuit comprising an image processor for processing image data derived from said imaging sensor;

a display device visible to the driver when operating the vehicle;

wherein video images captured. by said imaging sensor are displayed by said display device for viewing by the driver when operating the vehicle;

wherein said logic and control circuit generates at least one control output, and wherein said at least control output controls an enhancement of said video images;

wherein said enhancement enhances the driver'"'"'s awareness of the presence of an object within the field of view of said imaging sensor; and

wherein at least one of (i) said field of view comprises a blind spot to the rear of the vehicle and (ii) said control output is a function of a determination by said logic and control circuit of another vehicle rearward of and approaching the vehicle equipped with said imaging sensor.

48. The image sensing system of claim 47, wherein said array of light sensing photosensor elements is formed on said semiconductor substrate as a CMOS device.

49. The image sensing system of claim 47, wherein said array of light sensing photosensor elements and at least a portion of said logic and control circuit are commonly formed on a semiconductor substrate.

50. The image sensing system of claim 47, wherein said array of light sensing photosensor elements and at least a portion of said logic and control circuit are commonly formed on a semiconductor substrate as at least one of (i) an integrated circuit and (ii) a CMOS device.

51. The image sensing system of claim 47, wherein said control output is a function of a determination by said logic and control circuit of another vehicle rearward of and approaching the vehicle equipped with said imaging sensor and wherein said at least one control output is indicative that a lane change may not be safely undertaken by the vehicle equipped with said imaging sensor.

52. The image sensing system of claim 51, wherein said indication is generated based on at least one of distance and speed of a trailing vehicle.

53. The image sensing system of claim 47, wherein said logic and control circuit comprises at least one of (i) an analog-to-digital converter, (ii) a logic circuit, (iii) a clock, (iv) a random access memory, and (v) a digital-to-analog converter.

54. The image sensing system of claim 47, wherein said at least one control output controls an alarm audible to the driver when operating the vehicle.

55. The image sensing system of claim 47, wherein said display device comprises a display device selected from the group comprising (i) a back lit liquid crystal display device, (ii) a plasma display device, and (iii) a field emission display device.

56. The image sensing system of claim 47, wherein said enhancement of said video images comprises at least one of (i) a graphic overlay, (ii) displaying an imaged object in a particular color, and (iii) flashing an imaged object.

57. The image sensing system of claim 47, wherein said enhancement is a function of the speed of the vehicle equipped with said imaging sensor.

58. The image sensing system of claim 47, wherein the vehicle equipped with said imaging sensor comprises a distance-measuring system.

59. The image sensing system of claim 58, wherein said distance-measuring system comprises at least one of (a) a radar sensor, (ii) an ultrasonic sensor, (ii) an infrared sensor and (ii) a stereoscopic sensor.

60. The image sensing system of claim 47, wherein said enhancement of said video images displayed by said display device is a function of at least one of (i) the travel direction of the vehicle equipped with said imaging sensor, (ii) the speed of the vehicle equipped with said imaging sensor, (iii) the rate of turn of the vehicle equipped with said imaging sensor, and (iv) the separation distance of the vehicle equipped with said imaging sensor to adjacent objects.

61. The image sensing system of claim 47, wherein said imaging sensor comprises a color imaging sensor.