IMAGING SYSTEM FOR VEHICLE

• US 20130162828A1
• Filed: 02/25/2013
• Published: 06/27/2013
• Est. Priority Date: 12/23/2004
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Donnelly Corporation (Magna International Incorporated)
• Inventors: Higgins-Luthman, Michael J.
• Granted Patent: US 8,543,277 B2
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 1/23 with a predetermined field of view
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/30 characterised by the type of image processing
• CPC Class Codes: B60R 2300/402 Image calibration
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/804 for lane monitoring
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: B60R 2300/8066 for monitoring rearward traffic
• CPC Class Codes: B60W 40/04 Traffic conditions
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/584 of vehicle lights or traffic lights
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 25/76 Addressed sensors, e.g. MOS or CMOS sensors
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources

Abstract

A vehicular imaging system includes an imaging device that captures image data and a control for processing captured image data. The control may utilize edge detection in processing captured image data. Responsive at least in part to processing of captured image data by the control, the control determines objects of interest present in the field of view of the imaging device. The objects of interest determined to be present in the field of view of the imaging device include at least one of (i) vehicles present exterior of the vehicle, (ii) headlights of vehicles present exterior of the vehicle, (iii) a bicycle that is present exterior of the vehicle and (iv) a bicycle rider that is present exterior of the vehicle. Responsive at least in part to processing of captured image data by the control, a driver of the vehicle is alerted to a hazardous condition.

Claims

1. An imaging system for detecting objects exterior of a vehicle, said imaging system comprising:

an imaging device comprising an array of photo-sensing elements, wherein said imaging device is disposed at a vehicle equipped with said imaging system, and wherein said imaging device captures image data;

wherein, with said imaging device disposed at the equipped vehicle, said imaging device has a field of view exterior of the equipped vehicle;

a control for processing image data captured by said imaging device;

wherein said control utilizes edge detection in processing captured image data;

wherein, responsive at least in part to processing of captured image data by said control, said control determines objects of interest present in the field of view of said imaging device;

wherein objects of interest determined to be present in the field of view of said imaging device comprise at least one of (i) vehicles present exterior of the equipped vehicle and (ii) headlights of vehicles present exterior of the equipped vehicle;

wherein said control is operable to determine at least one of (i) a bicycle that is present exterior of the equipped vehicle and (ii) a bicycle rider that is present exterior of the equipped vehicle;

wherein, responsive at least in part to processing of captured image data by said control, a driver of the equipped vehicle is alerted to a hazardous condition; and

wherein said control processes a reduced data set of said captured image data to determine objects of interest present exterior of the equipped vehicle.

2. The imaging system of claim 1, wherein said control is operable to adjust processing of captured image data to accommodate misalignment of said imaging device when said imaging device is disposed at the equipped vehicle.

3. The imaging system of claim 1, wherein said control is operable to distinguish between objects present in the field of view of said imaging device and shadows of objects.

4. The imaging system of claim 1, wherein said control is operable to at least one of (a) determine that an object present in the field of view is a headlight of a vehicle forward of the equipped vehicle, (b) determine that an object present in the field of view is a headlight of a vehicle rearward of the equipped vehicle and (b) determine that an object present in the field of view is a headlight of a vehicle that is sideward of the equipped vehicle.

5. The imaging system of claim 1, wherein said imaging device captures image data for at least one of (a) a headlamp control system for detecting a headlamp of a vehicle present in the field of view of said imaging device and (b) a lane departure warning system.

6. The imaging system of claim 1, wherein said control distinguishes a headlight of a vehicle that is present exterior of the equipped vehicle in the field of view of said imaging device from other light sources present in the field of view of said imaging device.

7. The imaging system of claim 1, wherein said control is operable to switch between daytime and nighttime algorithms in response to an ambient light level at the equipped vehicle.

8. The imaging system of claim 1, wherein said control determines that a bicycle is present exterior of the equipped vehicle at least in part responsive to a determined speed of the bicycle.

9. The imaging system of claim 1, wherein said use of said edge detection by said control comprises determination of generally vertical edges of objects present in the field of view of said imaging device.

10. The imaging system of claim 9, wherein said determined generally vertical edges are used at least in part in identification of objects of interest by said control.

11. The imaging system of claim 1, wherein, in determining objects of interest present in the field of view of said imaging device, edges that are not indicative of objects of interest are substantially ignored in order to at least one of (a) reduce processing requirements and (b) reduce false signals.

12. The imaging system of claim 1, wherein said control determines that an object of interest determined to be present in the field of view of said imaging device is a wheel.

13. The imaging system of claim 1, wherein said imaging device is disposed behind the windshield of the equipped vehicle and wherein said imaging device views through the windshield and forward of the equipped vehicle, and wherein said array of photo-sensing elements comprises a CMOS array of photo-sensing elements.

14. The imaging system of claim 1, wherein said field of view of said imaging device encompasses a portion of the equipped vehicle.

15. The imaging system of claim 14, wherein said control is operable to determine that the portion of the equipped vehicle is not an object of interest.

16. The imaging system of claim 1, wherein the field of view of said imaging device encompasses (a) a rearward field of view at least partially rearward of the equipped vehicle, (b) a sideward field of view at least partially sideward of the equipped vehicle and (c) a forward field of view at least partially forward of the equipped vehicle.

17. The imaging system of claim 1, wherein said imaging device is disposed at a side of the equipped vehicle and has a field of view at least one of rearward of the equipped vehicle and sideward of the equipped vehicle.

18. The imaging system of claim 17, wherein a portion of the side of the equipped vehicle is present in the field of view of said imaging device and wherein said control determines that the portion of the equipped vehicle is not an object of interest.

19. The imaging system of claim 1, wherein said reduced data set is representative of a target zone that is encompassed by the field of view of said imaging device.

20. The imaging system of claim 19, wherein the target zone is not inclusive of a portion of the equipped vehicle.

21. The imaging system of claim 20, wherein said control adjusts the target zone responsive to a steering angle of the wheels of the equipped vehicle.

22. The imaging system of claim 1, wherein said control is operable to select said reduced image data set in response to a change in the travel speed of the equipped vehicle.

23. The imaging system of claim 1, wherein said control is operable to select said reduced image data set based at least in part on a steering angle of the equipped vehicle.

24. The imaging system of claim 1, wherein the driver of the equipped vehicle is alerted that an object of interest is determined to be present in the field of view of said imaging device.

25. The imaging system of claim 1, wherein a video display screen is located in an interior cabin of the equipped vehicle and is viewable by the driver of the equipped vehicle, and wherein images are displayed by said video display screen that are derived, at least in part, from image data captured by said imaging device.

26. An imaging system for detecting objects exterior of a vehicle, said imaging system comprising:

an imaging device comprising a CMOS array of photo-sensing elements, wherein said imaging device is disposed at a vehicle equipped with said imaging system, and wherein said imaging device captures image data;

wherein, with said imaging device disposed at the equipped vehicle, said imaging device has a field of view exterior of the equipped vehicle;

a control for processing image data captured by said imaging device;

wherein said control utilizes edge detection in processing captured image data;

wherein, responsive at least in part to processing of captured image data by said control, said control determines objects of interest present in the field of view of said imaging device;

wherein objects of interest determined to be present in the field of view of said imaging device comprise at least one of (i) vehicles present exterior of the equipped vehicle and (ii) headlights of vehicles present exterior of the equipped vehicle;

wherein said control is operable to determine at least one of (i) a bicycle that is present exterior of the equipped vehicle and (ii) a bicycle rider that is present exterior of the equipped vehicle;

wherein, responsive at least in part to processing of captured image data by said control, a driver of the equipped vehicle is alerted to a hazardous condition; and

wherein said imaging device captures image data for at least one of (a) a headlamp control system for detecting a headlamp of a vehicle present in the field of view of said imaging device and (b) a lane departure warning system.

27. The imaging system of claim 26, wherein said control is operable to distinguish between objects present in the field of view of said imaging device and shadows of objects.

28. The imaging system of claim 26, wherein said control is operable to switch between daytime and nighttime algorithms in response to an ambient light level at the equipped vehicle.

29. The imaging system of claim 26, wherein said imaging device is disposed behind the windshield of the equipped vehicle and wherein said imaging devices views through the windshield and forward of the equipped vehicle.

30. The imaging system of claim 26, wherein said field of view of said imaging device encompasses a portion of the equipped vehicle, and wherein said control is operable to determine that the portion of the equipped vehicle is not an object of interest.

31. The imaging system of claim 26, wherein said control processes a reduced data set of said captured image data to determine objects of interest, and wherein said reduced data set is representative of a target zone that is encompassed by the field of view of said imaging device.

32. The imaging system of claim 31, wherein at least one of (i) the target zone is not inclusive of a portion of the equipped vehicle, (ii) said control is operable to select said reduced image data set in response to a function of the equipped vehicle, (iii) said control is operable to select said reduced image data set in response to a change in the travel speed of the equipped vehicle and (iv) said control is operable to select said reduced image data set in response to a steering angle of the equipped vehicle.

33. An imaging system for detecting objects exterior of a vehicle, said imaging system comprising:

an imaging device comprising an array of photo-sensing elements, wherein said imaging device is disposed at a vehicle equipped with said imaging system, and wherein said imaging device captures image data;

wherein, with said imaging device disposed at the equipped vehicle, said imaging device has a field of view exterior of the equipped vehicle;

wherein said imaging device is disposed behind the windshield of the equipped vehicle and wherein said imaging devices views through the windshield and forward of the equipped vehicle;

a control for processing image data captured by said imaging device;

wherein, responsive at least in part to processing of captured image data by said control, said control determines objects of interest present in the field of view of said imaging device;

wherein said control is operable to determine at least one of (i) a bicycle that is present exterior of the equipped vehicle and (ii) a bicycle rider that is present exterior of the equipped vehicle;

wherein, responsive at least in part to processing of captured image data by said control, a driver of the equipped vehicle is alerted to a hazardous condition;

wherein said imaging device captures image data for at least one of (a) a headlamp control system for detecting a headlamp of a vehicle present in the field of view of said imaging device and (b) a lane departure warning system;

wherein said control processes a reduced data set of said captured image data to determine objects of interest; and

wherein at least one of (i) said reduced data set is representative of a target zone that is encompassed by the field of view of said imaging device and (ii) said control is operable to select said reduced image data set in response to a function of the equipped vehicle.

34. The imaging system of claim 33, wherein said control is operable to select said reduced image data set in response to a function of the equipped vehicle and wherein said function comprises at least one of (i) a change in the travel speed of the equipped vehicle and (ii) a steering angle of the equipped vehicle.

35. The imaging system of claim 33, wherein said reduced data set is representative of a target zone that is encompassed by the field of view of said imaging device and that is not inclusive of a portion of the equipped vehicle.

36. The imaging system of claim 33, wherein said control is operable to distinguish between objects present in the field of view of said imaging device and shadows of objects.

37. The imaging system of claim 33, wherein said control is operable to switch between daytime and nighttime algorithms in response to an ambient light level at the equipped vehicle.

38. The imaging system of claim 33, wherein said control utilizes edge detection in processing captured image data.

39. The imaging system of claim 33, wherein said field of view of said imaging device encompasses a portion of the equipped vehicle, and wherein said control is operable to determine that the portion of the equipped vehicle is not an object of interest.

40. The imaging system of claim 33, wherein objects of interest determined to be present in the field of view of said imaging device comprise at least one of (i) vehicles present exterior of the equipped vehicle and (ii) headlights of vehicles present exterior of the equipped vehicle.

41. An imaging system for detecting objects exterior of a vehicle, said imaging system comprising:

an imaging device comprising an array of photo-sensing elements, wherein said imaging device is disposed at a vehicle equipped with said imaging system, and wherein said imaging device captures image data;

wherein, with said imaging device disposed at the equipped vehicle, said imaging device has a field of view exterior of the equipped vehicle;

wherein said imaging device is disposed behind the windshield of the equipped vehicle and wherein said imaging devices views through the windshield and forward of the equipped vehicle;

a control for processing image data captured by said imaging device;

wherein said control utilizes edge detection in processing captured image data;

wherein, responsive at least in part to processing of captured image data by said control, said control determines objects of interest present in the field of view of said imaging device;

wherein said control is operable to determine at least one of (i) a bicycle that is present exterior of the equipped vehicle and (ii) a bicycle rider that is present exterior of the equipped vehicle;

wherein, responsive at least in part to processing of captured image data by said control, a driver of the equipped vehicle is alerted to a hazardous condition; and

wherein said imaging device captures image data for at least one of (a) a headlamp control system for detecting a headlamp of a vehicle present in the field of view of said imaging device and (b) a lane departure warning system.

42. The imaging system of claim 41, wherein said control processes a reduced data set of said captured image data to determine objects of interest, and wherein said reduced data set is representative of a target zone that is encompassed by the field of view of said imaging device.

43. The imaging system of claim 42, wherein at least one of (i) the target zone is not inclusive of a portion of the equipped vehicle, (ii) said control is operable to select said reduced image data set in response to a function of the equipped vehicle, (iii) said control is operable to select said reduced image data set in response to a change in the travel speed of the equipped vehicle and (iv) said control is operable to select said reduced image data set in response to a steering angle of the equipped vehicle.

44. The imaging system of claim 41, wherein at least one of (a) said control is operable to adjust processing of captured image data to accommodate misalignment of said imaging device when said imaging device is disposed at the equipped vehicle, (b) said control is operable to distinguish between objects present in the field of view of said imaging device and shadows of objects and (c) in determining objects of interest present in the field of view of said imaging device, edges that are not indicative of objects of interest are substantially ignored.

45. An imaging system for detecting objects exterior of a vehicle, said imaging system comprising:

an imaging device comprising an array of photo-sensing elements, wherein said imaging device is disposed at a vehicle equipped with said imaging system, and wherein said imaging device captures image data;

wherein, with said imaging device disposed at the equipped vehicle, said imaging device has a field of view exterior of the equipped vehicle;

wherein said imaging device is disposed behind the windshield of the equipped vehicle and wherein said imaging devices views through the windshield and forward of the equipped vehicle;

a control for processing image data captured by said imaging device;

wherein, responsive at least in part to processing of captured image data by said control, said control determines objects of interest present in the field of view of said imaging device;

wherein said control is operable to determine at least one of (i) a bicycle that is present exterior of the equipped vehicle and (ii) a bicycle rider that is present exterior of the equipped vehicle;

wherein, responsive at least in part to processing of captured image data by said control, a driver of the equipped vehicle is alerted to a hazardous condition;

wherein said imaging device captures image data for at least one of (a) a headlamp control system for detecting a headlamp of a vehicle present in the field of view of said imaging device and (b) a lane departure warning system; and

wherein at least one of (a) said control is operable to adjust processing of captured image data to accommodate misalignment of said imaging device when said imaging device is disposed at the equipped vehicle, (b) said control is operable to distinguish between objects present in the field of view of said imaging device and shadows of objects and (c) said control processes a reduced data set of said captured image data to determine objects of interest.

46. The imaging system of claim 45, wherein said control processes a reduced data set of said captured image data to determine objects of interest and wherein said reduced data set is representative of a target zone that is encompassed by the field of view of said imaging device.

47. The imaging system of claim 46, wherein at least one of (i) the target zone is not inclusive of a portion of the equipped vehicle, (ii) said control is operable to select said reduced image data set in response to a function of the equipped vehicle, (iii) said control is operable to select said reduced image data set in response to a change in the travel speed of the equipped vehicle and (iv) said control is operable to select said reduced image data set in response to a steering angle of the equipped vehicle.