IMAGING SYSTEM FOR VEHICLE

• US 20120098968A1
• Filed: 12/22/2011
• Published: 04/26/2012
• Est. Priority Date: 04/15/2004
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Donnelly Corporation (Magna International Incorporated)
• Inventors: Schofield, Kenneth, Lynam, Niall R.
• Granted Patent: US 8,325,986 B2
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: B60K 2360/143 Touch sensitive instrument input devices
• CPC Class Codes: B60K 2360/148 Instrument input by voice
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: B60K 2360/27 using semi-transparent optical elements
• CPC Class Codes: B60K 2360/331 Electroluminescent elements
• CPC Class Codes: B60K 2360/334 Projection means
• CPC Class Codes: B60K 2360/34 Backlit symbols
• CPC Class Codes: B60K 2360/589 Wireless data transfers
• CPC Class Codes: B60K 2360/777 on or in sun visors
• CPC Class Codes: B60K 2370/143 Touch sensitive input devices
• CPC Class Codes: B60K 2370/148 Input by voice
• CPC Class Codes: B60K 2370/152 Displays
• CPC Class Codes: B60K 2370/21 using cameras
• CPC Class Codes: B60K 2370/27 using semi-transparent optical elements
• CPC Class Codes: B60K 2370/331 Electroluminescent elements
• CPC Class Codes: B60K 2370/334 Projection means
• CPC Class Codes: B60K 2370/34 Backlit symbols
• CPC Class Codes: B60K 2370/52 Control of displays
• CPC Class Codes: B60K 2370/589 Wireless
• CPC Class Codes: B60K 2370/777 on or in sun visors
• CPC Class Codes: B60K 35/10 : Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/22 : Display screens
• CPC Class Codes: B60K 35/60 : Instruments characterised by their location or relative disposition in or on vehicles arrangements of lighting devices on dashboards B60Q3/10
• CPC Class Codes: B60K 35/81 : for controlling displays
• CPC Class Codes: B60K 35/85 : Arrangements for transferring vehicle- or driver-related data
• CPC Class Codes: B60Q 1/08 : automatically
• CPC Class Codes: B60Q 2300/42 : oncoming vehicle
• CPC Class Codes: B60Q 9/008 : for anti-collision purposes
• CPC Class Codes: B60R 1/001 : integrated in the windows, e.g. Fresnel lenses
• CPC Class Codes: B60R 1/04 : mounted inside vehicle B60R1/025, B60R1/08 take precedence
• CPC Class Codes: B60R 1/12 : Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 1/24 : in front of the vehicle
• CPC Class Codes: B60R 1/26 : to the rear of the vehicle
• CPC Class Codes: B60R 11/04 : Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2001/1215 : with information displays
• CPC Class Codes: B60R 2001/1253 : with cameras, video cameras or video screens
• CPC Class Codes: B60R 2011/0026 : Windows, e.g. windscreen
• CPC Class Codes: B60R 2300/205 : using a head-up display
• CPC Class Codes: B60R 2300/207 : using multi-purpose displays, e.g. camera image and navigation or video on same display
• CPC Class Codes: B60R 2300/30 : characterised by the type of image processing
• CPC Class Codes: B60R 2300/301 : combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/302 : combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/804 : for lane monitoring
• CPC Class Codes: B60R 2300/8093 : for obstacle warning
• CPC Class Codes: B60W 2050/143 : Alarm means
• CPC Class Codes: B60W 2050/146 : Display means
• CPC Class Codes: B60W 30/143 : Speed control B60W30/16 takes precedence
• CPC Class Codes: B60W 30/18 : Propelling the vehicle
• CPC Class Codes: B60W 50/14 : Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: B60W 50/16 : Tactile feedback to the driver, e.g. vibration or force feedback to the driver on the steering wheel or the accelerator pedal
• CPC Class Codes: G06T 7/20 : Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 10/147 : Details of sensors, e.g. sensor lenses fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19
• CPC Class Codes: G06V 20/58 : Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/582 : of traffic signs
• CPC Class Codes: G06V 20/584 : of vehicle lights or traffic lights
• CPC Class Codes: G06V 20/588 : Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G08G 1/166 : for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G08G 1/167 : Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: H04N 23/54 : Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
• CPC Class Codes: H04N 7/18 : Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source

Abstract

An imaging system for a vehicle includes a camera, an image processor and a control. The field of view of the camera is in a forward direction of travel of the equipped vehicle, and the camera is operable to capture frames of image data. The image processor is operable to process the image data. The control is operable to adjust a light beam emanating from a forward facing light of the equipped vehicle responsive to image processing of frames of image data. The control, responsive to the image processing, is operable to control at least one of (a) adjustment of a beam direction of a light beam emanating from the forward facing light, (b) adjustment of a visible intensity of a light beam emanating from the forward facing light and (c) adjustment of a range of a light beam emanating from the forward facing light.

Claims

1. An imaging system for a vehicle, said imaging system comprising:

a camera having a field of view exterior of a vehicle equipped with said imaging system, wherein said field of view is in a forward direction of travel of the equipped vehicle, and wherein said camera is operable to capture frames of image data;

an image processor operable to process said image data;

a control operable to adjust a light beam emanating from a forward facing light of the equipped vehicle responsive to image processing of frames of image data;

wherein said control, responsive to said image processing, is operable to control at least one of (a) adjustment of a beam direction of a light beam emanating from said forward facing light, (b) adjustment of a visible intensity of a light beam emanating from said forward facing light and (c) adjustment of a range of a light beam emanating from said forward facing light; and

wherein said control, responsive to said image processing, is operable to control at least two of (i) lane departure warning, (ii) traffic sign recognition and (iii) object detection.

2. The imaging system of claim 1, wherein said control, responsive to said image processing, is operable to control (i) lane departure warning and (ii) traffic sign recognition.

3. The imaging system of claim 1, wherein said control, responsive to said image processing, is operable to control (i) lane departure warning and (ii) object detection.

4. The imaging system of claim 1, wherein image processing of frames of image data by said control includes recognition of at least one of (a) a spectral characteristic of an object present in the forward field of view of said camera, (b) a spatial characteristic of an object present in the forward field of view of said camera, (c) the size of an object present in the forward field of view of said camera, (d) the location of an object present in the forward field of view of said camera, (e) the location of an object present in the forward field of view of said camera relative to the road along which the equipped vehicle is traveling, (f) the geometric shape of an object present in the forward field of view of said camera and (g) a character present in the forward field of view of said camera.

5. The imaging system of claim 1, wherein said control is operable to generate an alert to the driver of the equipped vehicle.

6. The imaging system of claim 5, wherein said alert is indicative of at least one of (a) the vehicle speed, (b) a posted speed limit and (c) a difference between the vehicle speed and a posted speed limit.

7. The imaging system of claim 1, wherein said image processor is operable to process said image data in accordance with an algorithm, wherein said algorithm comprises at least one of an object recognition routine and a character recognition routine.

8. The imaging system of claim 1, wherein said control is operable to control said beam adjustment at least in part responsive to the current geographical location of the equipped vehicle.

9. The imaging system of claim 8, wherein said control is at least in part responsive to a global positioning system of the equipped vehicle and wherein said global positioning system determines the current geographical location of the equipped vehicle.

10. The imaging system of claim 1, wherein said control is operable to adapt to local regulations responsive to the current geographical location of the equipped vehicle.

11. The imaging system of claim 10, wherein at least one of (a) the current geographical location of the equipped vehicle is determined by a vehicle-based global positioning system, and wherein said control is responsive to said vehicle-based global positioning system, and (b) said control is responsive to a user input that is actuatable by a user to select a geographical location or zone to establish the current geographical location of the equipped vehicle.

12. The imaging system of claim 10, wherein the current geographical location of the equipped vehicle is determined by a vehicle-based global positioning system, and wherein said control is responsive to said vehicle-based global positioning system to (a) process image data in accordance with an imperial setting when the current geographical location of the equipped vehicle is determined to be in the United States so that numbers on speed limit signage present in said field of view are interpreted by said control as being in miles per hour, and (b) process image data in accordance with a metric setting when the current geographical location of the equipped vehicle is determined to be outside of the United States so that numbers on speed limit signage present in said field of view are interpreted by said control as being in kilometers per hour.

13. The imaging system of claim 1, wherein said control is responsive to a selection of one of an imperial setting and a metric setting, and wherein said control, responsive to said selection, is operable to (a) process image data in accordance with an imperial setting when the imperial setting is selected to process numbers on speed limit signage present in said field of view as being in miles per hour, and (b) process image data in accordance with a metric setting when the metric setting is selected to process numbers on speed limit signage present in said field of view as being in kilometers per hour.

14. The imaging system of claim 1, wherein said control is operable to control adjustment of a beam direction of a light beam emanating from said forward facing light.

15. The imaging system of claim 14, wherein said control is operable to detect a headlamp of an oncoming vehicle in the forward field of view of said camera and wherein said control adjusts said beam direction relative to the detected oncoming vehicle.

16. The imaging system of claim 15, wherein said control is operable to detect a headlamp of an oncoming vehicle in the forward field of view of said camera and wherein said control adjusts said beam direction away from the detected oncoming vehicle.

17. The imaging system of claim 1, Wherein said control adjusts at least one of a baffle, a slat, a filter and a louver to adjust at least one of (i) an amount of light emanating from said forward facing light, (ii) a visible intensity of said forward facing light and (iii) a range of said forward facing light.

18. The imaging system of claim 1, wherein said image processor, at least in part, processes (a) a first frame of image data for said beam adjustment, (b) a second frame of image data for lane departure warning and (c) a third frame of image data for object detection.

19. An imaging system for a vehicle, said imaging system comprising;

a camera having a field of view exterior of a vehicle equipped with said imaging system, wherein said field of view is in a forward direction of travel of the equipped vehicle, and wherein said camera is operable to capture frames of image data, and wherein said camera comprises a CMOS image sensor;

an image processor operable to process said image data;

a control operable to adjust a light beam emanating from a forward facing light of the equipped vehicle responsive to image processing of frames of image data;

wherein said control, responsive to said image processing, is operable to control at least one of (a) adjustment of a beam direction of a light beam emanating from said forward facing light, (b) adjustment of a visible intensity of a light beam emanating from said forward facing light and (c) adjustment of a range of a light beam emanating from said forward facing light; and

wherein said control, responsive to said image processing, is operable to control (i) lane departure warning and (ii) traffic sign recognition.

20. The imaging system of claim 19, wherein image processing of frames of image data by said control includes recognition of at least one of (a) a spectral characteristic of an object present in the forward field of view of said camera, (b) a spatial characteristic of an object present in the forward field of view of said camera, (c) the size of an object present in the forward field of view of said camera, (d) the location of an object present in the forward field of view of said camera, (e) the location of an object present in the forward field of view of said camera relative to the road along which the equipped vehicle is traveling, (f) the geometric shape of an object present in the forward field of view of said camera and (g) a character present in the forward field of view of said camera.

21. The imaging system of claim 19, wherein said control is operable to generate an alert to the driver of the equipped vehicle.

22. An imaging system for a vehicle, said imaging system comprising:

a camera having a field of view exterior of a vehicle equipped with said imaging system, wherein said field of view is in a forward direction of travel of the equipped vehicle, and wherein said camera is operable to capture frames of image data;

an image processor operable to process said image data;

a control operable to adjust a light beam emanating from a forward facing light of the equipped vehicle responsive to image processing of frames of image data;

wherein said control is operable to adjust at least one of a baffle, a slat, a filter and a louver of said forward facing light;

wherein said control, responsive to said image processing, is operable to control at least one of (a) adjustment of a beam direction of a light beam emanating from said forward facing light, (b) adjustment of a visible intensity of a light beam emanating from said forward facing light and (c) adjustment of a range of a light beam emanating from said forward facing light; and

wherein said control, responsive to said image processing, is operable to control at least one of (i) lane departure warning, (ii) traffic sign recognition and (iii) object detection.

23. The imaging system of claim 22, wherein image processing of frames of image data by said control includes recognition of at least one of (a) a spectral characteristic of an object present in the forward field of view of said camera, (b) a spatial characteristic of an object present in the forward field of view of said camera, (c) the size of an object present in the forward field of view of said camera, (d) the location of an object present in the forward field of view of said camera, (e) the location of an object present in the forward field of view of said camera relative to the road along which the equipped vehicle is traveling, (f) the geometric shape of an object present in the forward field of view of said camera and (g) a character present in the forward field of view of said camera.

24. The imaging system of claim 22, wherein said control adjusts said at least one of a baffle, a slat, a filter and a louver of said forward facing light to adjust at least one of (i) an amount of light emanating from said forward facing light, (ii) a visible intensity of said forward facing light and (iii) a range of said forward facing light.