VEHICLE VISION SYSTEM WITH DETECTION ENHANCEMENT USING LIGHT CONTROL

• US 20170083774A1
• Filed: 09/23/2016
• Published: 03/23/2017
• Est. Priority Date: 09/23/2015
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Solar, Martin, Wombacher, Marius
• Granted Patent: US 10,331,956 B2
• Time in Patent Office: Days
• CPC Class Codes: B60Q 1/085 due to special conditions, e.g. adverse weather, type of road, badly illuminated road signs or potential dangers B60Q1/10, B60Q1/12, B60Q1/1423 take precedence
• CPC Class Codes: B60Q 1/143 combined with another condition, e.g. using vehicle recognition from camera images or activation of wipers
• CPC Class Codes: B60Q 1/18 being additional front lights bracket mounted headlights B60Q1/0483
• CPC Class Codes: B60Q 2300/322 Road curvature
• CPC Class Codes: B60Q 2300/45 Special conditions, e.g. pedestrians, road signs or potential dangers
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/24 in front of the vehicle
• CPC Class Codes: B60R 2300/804 for lane monitoring
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06V 10/141 Control of illumination
• CPC Class Codes: G06V 10/40 Extraction of image or video features
• CPC Class Codes: G06V 10/764 using classification, e.g. of video objects
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

A vision system of a vehicle includes a camera having a field of view exterior and forward of the vehicle. A control includes an image processor that is operable to process image data captured by the camera. The control is operable to determine lane markers ahead of the vehicle and in a path of travel of the vehicle, and predicts lane markers beyond the sensing range of the camera. Responsive to prediction of lane markers ahead of the vehicle that are outside and beyond the first sensing range of the camera, the control controls a matrix of light emitting diodes to enhance illumination at a target region that encompasses where lane markers are predicted to be. Responsive to processing of captured image data with enhanced illumination at the target region, the control is operable to determine the presence of an object at the target region.

Claims

1. A vision system for a vehicle, said vision system comprising:

a camera configured to be disposed at a vehicle so as to have a field of view exterior and forward of the vehicle;

a control comprising an image processor operable to process image data captured by said camera;

wherein said control, responsive to processing of captured image data by said image processor, is operable to determine lane markers ahead of the vehicle and in a path of travel of the vehicle and in a sensing range of said camera that is based on illumination present ahead of the vehicle and in a path of travel of the vehicle;

wherein, responsive to determination of lane markers ahead of the vehicle via processing of captured image data by said image processor, said control is operable to predict lane markers ahead of the vehicle that are outside and beyond a first sensing range of said camera;

wherein, responsive to processing of captured image data by said image processor, said control is operable to control a matrix of light emitting diodes, and wherein, responsive to prediction of lane markers ahead of the vehicle that are outside and beyond the first sensing range of said camera, said control controls at least one light emitting diode of said matrix of light emitting diodes to enhance illumination at a target region that encompasses where lane markers outside and beyond the first sensing range are predicted to be;

wherein said camera has the first sensing range when said at least one light emitting diode is not activated and has a second sensing range when said at least one light emitting diode is activated, and wherein the second sensing range extends further from the vehicle than the first sensing range;

wherein the target region is outside and beyond the first sensing range of said camera when said at least one light emitting diode is not activated but is within the second sensing range of said camera when said at least one light emitting diode is activated; and

wherein, responsive to processing of captured image data by said image processor with said at least one light emitting diode activated, said control is operable to determine the presence of an object present at the target region and within the second sensing range.

2. The vision system of claim 1, wherein said control is operable to control one or more of the individual light emitting diodes to enhance the illumination of a selected portion of the target region.

3. The vision system of claim 1, wherein said control controls said at least one light emitting diode to provide enhanced illumination at an outer region of the determined lane markers outside the range of the vehicle'"'"'s low beam headlights and beyond where the lane marker is determined prior to said control controlling said at least one light emitting diode.

4. The vision system of claim 1, comprising a display for displaying images derived from image data captured by said camera.

5. The vision system of claim 4, wherein said vision system is operable to generate a graphic overlay that is overlayed on displayed images, and wherein the graphic overlay is overlayed at a region of the displayed image that corresponds to the determined object.

6. The vision system of claim 5, wherein, responsive to processing of captured image data by said image processor with said at least one light emitting diode controlled to enhance illumination at the target region, said control is operable to classify the determined object, and wherein the graphic overlay comprises a shape that corresponds to the classification of the determined object.

7. The vision system of claim 5, wherein, responsive to determination, via processing of captured image data by said image processor with said at least one light emitting diode controlled to enhance illumination at the target region, of a bicyclist ahead of the vehicle and in the target region, said control is operable to classify the determined bicyclist as a bicyclist, and wherein the graphic overlay comprises a bicycle shape.

8. The vision system of claim 1, wherein, responsive to processing of captured image data by said image processor, said control is operable to control said matrix of light emitting diodes to enhance illumination of the target region in the determined path of travel of the vehicle and outside of illumination provided by the vehicle'"'"'s low beam headlights.

9. The vision system of claim 1, wherein, responsive to processing of captured image data by said image processor, said control is operable to control said matrix of light emitting diodes to enhance illumination of the target region in the determined path of travel of the vehicle and outside of illumination provided by the vehicle'"'"'s high beam headlights.

10. The vision system of claim 1, wherein said control is operable to control said matrix of light emitting diodes to enhance illumination of the target region in the determined path of travel of the vehicle responsive to determination of ambient light being below a threshold level.

11. The vision system of claim 1, wherein said matrix of light emitting diodes comprises a matrix headlight of the vehicle.

12. A vision system for a vehicle, said vision system comprising:

a camera configured to be disposed at a vehicle so as to have a field of view exterior and forward of the vehicle;

a display for displaying images derived from image data captured by said camera;

a control comprising an image processor operable to process image data captured by said camera;

wherein said control, responsive to processing of captured image data by said image processor, is operable to determine lane markers ahead of the vehicle and in a path of travel of the vehicle and in a sensing range of said camera that is based on illumination present ahead of the vehicle and in a path of travel of the vehicle;

wherein, responsive to determination of lane markers ahead of the vehicle via processing of captured image data by said image processor, said control is operable to predict lane markers ahead of the vehicle that are outside and beyond a first sensing range of said camera;

wherein, responsive to processing of captured image data by said image processor, said control is operable to control a matrix headlight of the vehicle, said matrix headlight comprising a matrix of light emitting diodes, and wherein, responsive to prediction of lane markers ahead of the vehicle that are outside and beyond the first sensing range of said camera, said control controls at least one light emitting diode of said matrix of light emitting diodes to enhance illumination at a target region that encompasses where lane markers outside and beyond the first sensing range are predicted to be;

wherein said camera has the first sensing range when said at least one light emitting diode is not activated and has a second sensing range when said at least one light emitting diode is activated, and wherein the second sensing range extends further from the vehicle than the first sensing range;

wherein the target region is outside and beyond the first sensing range of said camera when said at least one light emitting diode is not activated but is within the second sensing range of said camera when said at least one light emitting diode is activated;

wherein, responsive to processing of captured image data by said image processor with said at least one light emitting diode activated, said control is operable to determine the presence of an object present at the target region and within the second sensing range; and

wherein said vision system is operable to generate a graphic overlay that is overlayed on displayed images, and wherein the graphic overlay is overlayed at a region of the displayed image that corresponds to the determined object.

13. The vision system of claim 12, wherein said control is operable to control one or more of the individual light emitting diodes to enhance the illumination of a selected portion of the target region.

14. The vision system of claim 12, wherein, responsive to processing of captured image data by said image processor with said at least one light emitting diode controlled to enhance illumination at the target region, said control is operable to classify the determined object, and wherein the graphic overlay comprises a shape that corresponds to the classification of the determined object.

15. The vision system of claim 12, wherein, responsive to determination, via processing of captured image data by said image processor with said at least one light emitting diode controlled to enhance illumination at the target region, of a bicyclist ahead of the vehicle and in the target region, said control is operable to classify the determined bicyclist as a bicyclist, and wherein the graphic overlay comprises a bicycle shape.

16. A vision system for a vehicle, said vision system comprising:

a camera configured to be disposed at a vehicle so as to have a field of view exterior and forward of the vehicle;

a control comprising an image processor operable to process image data captured by said camera;

wherein said control, responsive to processing of captured image data by said image processor, is operable to determine lane markers ahead of the vehicle and in a path of travel of the vehicle and in a sensing range of said camera that is based on illumination present ahead of the vehicle and in a path of travel of the vehicle;

wherein, responsive to determination of lane markers ahead of the vehicle via processing of captured image data by said image processor, said control is operable to predict lane markers ahead of the vehicle that are outside and beyond a first sensing range of said camera;

wherein, responsive to processing of captured image data by said image processor, said control is operable to control a matrix headlight of the vehicle, said matrix headlight comprising a matrix of light emitting diodes, and wherein, responsive to prediction of lane markers ahead of the vehicle that are outside and beyond the first sensing range of said camera, said control controls at least one light emitting diode of said matrix of light emitting diodes to enhance illumination at a target region that encompasses where lane markers outside and beyond the first sensing range are predicted to be;

wherein said camera has the first sensing range when said at least one light emitting diode is not activated and has a second sensing range when said at least one light emitting diode is activated, and wherein the second sensing range extends further from the vehicle than the first sensing range;

wherein the target region is outside and beyond the first sensing range of said camera when said at least one light emitting diode is not activated but is within the second sensing range of said camera when said at least one light emitting diode is activated;

wherein, responsive to processing of captured image data by said image processor with said at least one light emitting diode activated, said control is operable to determine the presence of an object present at the target region and within the second sensing range; and

wherein said control is operable to control said matrix of light emitting diodes to enhance illumination of the target region in the determined path of travel of the vehicle responsive to determination of ambient light being below a threshold level.

17. The vision system of claim 16, comprising a display for displaying images derived from image data captured by said camera, and wherein said vision system is operable to generate a graphic overlay that is overlayed on displayed images, and wherein the graphic overlay is overlayed at a region of the displayed image that corresponds to the determined object, and wherein, responsive to processing of captured image data by said image processor with said at least one light emitting diode controlled to enhance illumination at the target region, said control is operable to classify the determined object, and wherein the graphic overlay comprises a shape that corresponds to the classification of the determined object.

18. The vision system of claim 16, comprising a display for displaying images derived from image data captured by said camera, and wherein said vision system is operable to generate a graphic overlay that is overlayed on displayed images, and wherein the graphic overlay is overlayed at a region of the displayed image that corresponds to the determined object, and wherein, responsive to determination, via processing of captured image data by said image processor with said at least one light emitting diode controlled to enhance illumination at the target region, of a bicyclist ahead of the vehicle and in the target region, said control is operable to classify the determined bicyclist as a bicyclist, and wherein the graphic overlay comprises a bicycle shape.

19. The vision system of claim 16, wherein, responsive to processing of captured image data by said image processor, said control is operable to control said matrix of light emitting diodes to enhance illumination of the target region in the determined path of travel of the vehicle and outside of illumination provided by the vehicle'"'"'s low beam headlights.

20. The vision system of claim 16, wherein, responsive to processing of captured image data by said image processor, said control is operable to control said matrix of light emitting diodes to enhance illumination of the target region in the determined path of travel of the vehicle and outside of illumination provided by the vehicle'"'"'s high beam headlights.