VEHICULAR VISION SYSTEM WITH AUXILIARY LIGHT SOURCE

• US 20190311206A1
• Filed: 06/24/2019
• Published: 10/10/2019
• Est. Priority Date: 09/23/2015
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Solar, Martin, Wombacher, Marius
• Granted Patent: US 10,929,693 B2
• Time in Patent Office: Days
• CPC Class Codes: B60Q 1/085 due to special conditions, e.g. adverse weather, type of road, badly illuminated road signs or potential dangers B60Q1/10, B60Q1/12, B60Q1/1423 take precedence
• CPC Class Codes: B60Q 1/143 combined with another condition, e.g. using vehicle recognition from camera images or activation of wipers
• CPC Class Codes: B60Q 1/18 being additional front lights bracket mounted headlights B60Q1/0483
• CPC Class Codes: B60Q 2300/322 Road curvature
• CPC Class Codes: B60Q 2300/45 Special conditions, e.g. pedestrians, road signs or potential dangers
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/24 in front of the vehicle
• CPC Class Codes: B60R 2300/804 for lane monitoring
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06V 10/141 Control of illumination
• CPC Class Codes: G06V 10/40 Extraction of image or video features
• CPC Class Codes: G06V 10/764 using classification, e.g. of video objects
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

A vehicular vision system includes a camera configured to be mounted at an in-cabin side of a windshield of a vehicle and having a field of view exterior and forward of the vehicle. An ECU includes an image processor operable to process image data captured by the camera when the camera is mounted at the vehicle windshield. The ECU, responsive at least in part to processing of captured image data, determines lane markers ahead of the vehicle. The ECU determines a path of travel of the vehicle. The ECU, responsive at least in part to processing of captured image data, detects an object that is present forward of the vehicle. Responsive to determination at the ECU that the detected object is in the path of travel of the vehicle, an auxiliary light source of the vehicle is controlled by the ECU to enhance illumination of the detected object.

Claims

1. A vehicular vision system, said vehicular vision system comprising:

a camera configured to be mounted at an in-cabin side of a windshield of a vehicle equipped with said vehicular vision system;

said camera having a field of view exterior and forward of the equipped vehicle when mounted at the windshield of the equipped vehicle;

said camera comprising an imaging sensor;

said imaging sensor comprising an imaging array of at least 1 million photosensors;

said camera operable to capture image data when mounted at the windshield of the equipped vehicle;

an electronic control unit (ECU) comprising an image processor operable to process image data captured by said camera;

wherein said ECU, responsive at least in part to processing by said image processor of captured image data, determines lane markers ahead of the equipped vehicle on a road being traveled along by the equipped vehicle;

wherein said ECU determines a path of travel of the equipped vehicle;

wherein said ECU, responsive at least in part to processing at said ECU of captured image data, detects an object that is present forward of the equipped vehicle; and

wherein, responsive to determination at said ECU that the detected object is in the path of travel of the equipped vehicle, an auxiliary light source of the equipped vehicle is controlled by said ECU to enhance illumination of the detected object.

2. The vehicular vision system of claim 1, wherein said auxiliary light source comprises a plurality of individual light sources.

3. The vehicular vision system of claim 2, wherein said ECU controls at least some of said plurality of individual light sources to provide enhanced illumination in the path of travel of the equipped vehicle outside the range of the equipped vehicle'"'"'s headlights.

4. The vehicular vision system of claim 2, wherein, responsive at least in part to processing by said image processor of captured image data and with said auxiliary light source controlled to enhance illumination at the detected object, said ECU classifies the detected object.

5. The vehicular vision system of claim 4, wherein a shape that corresponds to the classification of the detected object is determined.

6. The vehicular vision system of claim 2, responsive at least in part to processing by said image processor of captured image data, said ECU classifies the detected object to be a bicycle.

7. The vehicular vision system of claim 2, responsive at least in part to processing by said image processor of captured image data, said ECU classifies the detected object to be a pedestrian.

8. The vehicular vision system of claim 2, wherein said plurality of individual light sources comprises a matrix of individual light emitting diodes.

9. The vehicular vision system of claim 8, wherein responsive at least in part to processing by said image processor of captured image data, said ECU controls at least some of said matrix of individual light emitting diodes to provide enhanced illumination in the path of travel of the equipped vehicle outside the range of the equipped vehicle'"'"'s headlights.

10. The vehicular vision system of claim 8, wherein said ECU controls at least some of said matrix of individual light emitting diodes to provide enhanced illumination in the path of travel of the equipped vehicle outside the range of the equipped vehicle'"'"'s headlights responsive to determination of ambient light being below a threshold level.

11. The vehicular vision system of claim 1, wherein said camera captures image data at an image frame capture rate and wherein said auxiliary light source of the equipped vehicle is controlled by said ECU to enhance illumination of the detected object in sync with the image frame capture rate of said camera.

12. The vehicular vision system of claim 1, wherein said ECU determines the path of travel of the equipped vehicle responsive at least in part to processing by said image processor of captured image data.

13. The vehicular vision system of claim 1, wherein said ECU determines the path of travel of the equipped vehicle responsive at least in part to processing at said ECU of map data.

14. The vehicular vision system of claim 1, wherein said image processor processes captured image data for a pedestrian detection system of the equipped vehicle.

15. The vehicular vision system of claim 1, wherein said image processor processes captured image data for a traffic sign recognition system of the equipped vehicle.

16. The vehicular vision system of claim 1, wherein said image processor processes captured image data for a headlamp control system of the equipped vehicle.

17. The vehicular vision system of claim 1, wherein said image processor processes captured image data for a collision avoidance system of the equipped vehicle.

18. A vehicular vision system, said vehicular vision system comprising:

a camera configured to be mounted at an in-cabin side of a windshield of a vehicle equipped with said vehicular vision system;

said camera having a field of view exterior and forward of the equipped vehicle when mounted at the windshield of the equipped vehicle;

said camera comprising an imaging sensor;

said imaging sensor comprising an imaging array of at least 1 million photosensors;

said camera operable to capture image data when mounted at the windshield of the equipped vehicle;

an electronic control unit (ECU) comprising an image processor operable to process image data captured by said camera;

wherein said ECU, responsive at least in part to processing by said image processor of captured image data, determines lane markers ahead of the equipped vehicle on a road being traveled along by the equipped vehicle;

wherein said ECU determines a path of travel of the equipped vehicle;

wherein said ECU, responsive at least in part to processing at said ECU of captured image data, detects an object that is present forward of the equipped vehicle;

wherein, responsive to determination at said ECU that the detected object is in the path of travel of the equipped vehicle, an auxiliary light source of the equipped vehicle is controlled by said ECU to enhance illumination of the detected object; and

wherein responsive at least in part to processing by said image processor of captured image data, said ECU classifies the detected object to be a pedestrian.

19. The vehicular vision system of claim 18, wherein said auxiliary light source comprises a plurality of individual light sources, and wherein responsive at least in part to processing by said image processor of captured image data, said ECU controls at least some of said plurality of individual light sources to provide enhanced illumination in the path of travel of the equipped vehicle outside the range of the equipped vehicle'"'"'s headlights.

20. The vehicular vision system of claim 19, wherein said ECU determines the path of travel of the equipped vehicle responsive at least in part to processing by said image processor of captured image data.

21. The vehicular vision system of claim 19, wherein said ECU determines the path of travel of the equipped vehicle responsive at least in part to processing at said ECU of map data.

22. The vehicular vision system of claim 18, wherein said camera captures image data at an image frame capture rate and wherein said auxiliary light source of the equipped vehicle is controlled by said ECU to enhance illumination of the detected object in sync with the image frame capture rate of said camera.

23. The vehicular vision system of claim 22, wherein the image frame capture rate of said camera is 30 frames per second.

24. The vehicular vision system of claim 18, wherein said image processor processes captured image data for a pedestrian detection system of the equipped vehicle.

25. The vehicular vision system of claim 18, wherein said image processor processes captured image data for a traffic sign recognition system of the equipped vehicle.

26. The vehicular vision system of claim 18, wherein said image processor processes captured image data for a headlamp control system of the equipped vehicle.

27. The vehicular vision system of claim 18, wherein said image processor processes captured image data for a collision avoidance system of the equipped vehicle.

28. The vehicular vision system of claim 18, wherein said plurality of individual light sources comprises a matrix of individual light emitting diodes.

29. The vehicular vision system of claim 28, wherein responsive at least in part to processing by said image processor of captured image data, said ECU controls at least some of said matrix of individual light emitting diodes to provide enhanced illumination in the path of travel of the equipped vehicle outside the range of the equipped vehicle'"'"'s headlights.

30. A vehicular vision system, said vehicular vision system comprising:

a camera configured to be mounted at an in-cabin side of a windshield of a vehicle equipped with said vehicular vision system;

said camera having a field of view exterior and forward of the equipped vehicle when mounted at the windshield of the equipped vehicle;

said camera comprising an imaging sensor;

said imaging sensor comprising an imaging array of at least 1 million photosensors;

said camera operable to capture image data when mounted at the windshield of the equipped vehicle;

an electronic control unit (ECU) comprising an image processor operable to process image data captured by said camera;

wherein said ECU, responsive at least in part to processing by said image processor of captured image data, determines lane markers ahead of the equipped vehicle on a road being traveled along by the equipped vehicle;

wherein said ECU determines a path of travel of the equipped vehicle;

wherein said ECU determines the path of travel of the equipped vehicle responsive at least in part to processing by said image processor of captured image data;

wherein said ECU, responsive at least in part to processing at said ECU of captured image data, detects an object that is present forward of the equipped vehicle;

wherein, responsive to determination at said ECU that the detected object is in the path of travel of the equipped vehicle, an auxiliary light source of the equipped vehicle is controlled by said ECU to enhance illumination of the detected object;

wherein said auxiliary light source comprises a plurality of individual light sources; and

wherein responsive at least in part to processing by said image processor of captured image data, said ECU controls at least some of said plurality of individual light sources to provide enhanced illumination in the path of travel of the equipped vehicle.

31. The vehicular vision system of claim 30, wherein said camera captures image data at an image frame capture rate and wherein said auxiliary light source of the equipped vehicle is controlled by said ECU to enhance illumination of the detected object in sync with the image frame capture rate of said camera.

32. The vehicular vision system of claim 31, wherein the image frame capture rate of said camera is 30 frames per second.

33. The vehicular vision system of claim 30, wherein said image processor processes captured image data for a pedestrian detection system of the equipped vehicle.

34. The vehicular vision system of claim 30, wherein said image processor processes captured image data for a traffic sign recognition system of the equipped vehicle.

35. The vehicular vision system of claim 30, wherein said image processor processes captured image data for a headlamp control system of the equipped vehicle.

36. The vehicular vision system of claim 30, wherein said image processor processes captured image data for a collision avoidance system of the equipped vehicle.

37. The vehicular vision system of claim 30, responsive at least in part to processing by said image processor of captured image data, said ECU classifies the detected object to be a bicycle.

38. The vehicular vision system of claim 30, responsive at least in part to processing by said image processor of captured image data, said ECU classifies the detected object to be a pedestrian.

39. The vehicular vision system of claim 30, responsive at least in part to processing by said image processor of captured image data, said ECU classifies the detected object to be a vehicle.

40. The vehicular vision system of claim 39, wherein said plurality of individual light sources comprises a matrix of individual light emitting diodes.

41. The vehicular vision system of claim 40, wherein responsive at least in part to processing by said image processor of captured image data, said ECU controls at least some of said matrix of individual light emitting diodes to provide enhanced illumination in the path of travel of the equipped vehicle outside the range of the equipped vehicle'"'"'s headlights.