Vehicle vision system with detection enhancement using light control

• US 10,331,956 B2
• Filed: 09/23/2016
• Issued: 06/25/2019
• Est. Priority Date: 09/23/2015
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Solar, Martin, Wombacher, Marius
• Primary Examiner(s): Philippe, Gims S
• Application Number:
  US15/273,752
• Publication Number:
  US 20170083774A1
• Time in Patent Office: 1,005 Days
• Field of Search: 348148
• CPC Class Codes: B60Q 1/085 due to special conditions, e.g. adverse weather, type of road, badly illuminated road signs or potential dangers B60Q1/10, B60Q1/12, B60Q1/1423 take precedence
• CPC Class Codes: B60Q 1/143 combined with another condition, e.g. using vehicle recognition from camera images or activation of wipers
• CPC Class Codes: B60Q 1/18 being additional front lights bracket mounted headlights B60Q1/0483
• CPC Class Codes: B60Q 2300/322 Road curvature
• CPC Class Codes: B60Q 2300/45 Special conditions, e.g. pedestrians, road signs or potential dangers
• CPC Class Codes: B60R 1/24 in front of the vehicle
• CPC Class Codes: B60R 2300/804 for lane monitoring
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06V 10/141 Control of illumination
• CPC Class Codes: G06V 10/40 Extraction of image or video features
• CPC Class Codes: G06V 10/764 using classification, e.g. of video objects
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

A vision system of a vehicle includes a camera having a field of view exterior and forward of the vehicle. A control includes an image processor that is operable to process image data captured by the camera. The control is operable to determine lane markers ahead of the vehicle and in a path of travel of the vehicle, and predicts lane markers beyond the sensing range of the camera. Responsive to prediction of lane markers ahead of the vehicle that are outside and beyond the first sensing range of the camera, the control controls a matrix of light emitting diodes to enhance illumination at a target region that encompasses where lane markers are predicted to be. Responsive to processing of captured image data with enhanced illumination at the target region, the control is operable to determine the presence of an object at the target region.

Claims

1. A vision system for a vehicle, said vision system comprising:

a camera configured to be disposed at a vehicle so as to have a field of view exterior and forward of the vehicle;

a control comprising an image processor operable to process image data captured by said camera;

wherein said control, responsive to processing of captured image data by said image processor, is operable to determine lane markers ahead of the vehicle and in a path of travel of the vehicle and in a first effective sensing range of said camera that is based on illumination present ahead of the vehicle and in a path of travel of the vehicle;

wherein, responsive to determination of lane markers ahead of the vehicle via processing of captured image data by said image processor, said control is operable to predict lane markers ahead of the vehicle that are outside and beyond the first effective sensing range of said camera;

wherein the first effective sensing range encompasses a first region illuminated by at least one light emitting diode of a matrix of light emitting diodes of said vision system, and wherein the matrix of light emitting diodes are part of an exterior light of the vehicle;

wherein, responsive to processing of captured image data by said image processor, said control is operable to control said matrix of light emitting diodes, and wherein, responsive to prediction of lane markers ahead of the vehicle that are outside and beyond the first effective sensing range of said camera, and responsive to detection of an object present at least partially outside of the first effective sensing range of said camera, said control controls at least one other light emitting diode of said matrix of light emitting diodes to enhance illumination at a target region that encompasses where lane markers outside and beyond the first effective sensing range are predicted to be;

wherein said camera has the first effective sensing range when said at least one light emitting diode is activated and said at least one other light emitting diode is not activated and has a second effective sensing range when said at least one light emitting diode and said at least one other light emitting diode are activated, and wherein the second effective sensing range extends further from the vehicle than the first effective sensing range;

wherein the target region is outside and beyond the first effective sensing range of said camera when said at least one other light emitting diode is not activated but is within the second effective sensing range of said camera when said at least one other light emitting diode is activated; and

wherein, responsive to processing of captured image data by said image processor with said at least one other light emitting diode activated, said control is operable to confirm the presence of the object at the target region and within the second effective sensing range.

2. The vision system of claim 1, wherein said control is operable to control one or more others of the individual light emitting diodes to enhance the illumination of a selected portion of the target region.

3. The vision system of claim 1, wherein said control controls said at least one other light emitting diode to provide enhanced illumination at an outer region of the determined lane markers outside the range of low beam headlights of the vehicle and beyond where the lane markers are determined prior to said control controlling said at least one other light emitting diode.

4. The vision system of claim 1, comprising a display for displaying images derived from image data captured by said camera.

5. The vision system of claim 4, wherein said vision system is operable to generate a graphic overlay that is overlaid on displayed images, and wherein the graphic overlay is overlaid at a region of the displayed image that corresponds to the detected object.

6. The vision system of claim 5, wherein, responsive to processing of captured image data by said image processor with said at least one other light emitting diode controlled to enhance illumination at the target region, said control is operable to classify the detected object, and wherein the graphic overlay comprises a shape that corresponds to the classification of the detected object.

7. The vision system of claim 5, wherein, responsive to determination, via processing of captured image data by said image processor with said at least one other light emitting diode controlled to enhance illumination at the target region, of a moving pattern indicative of a bicycle'"'"'s tires in motion ahead of the vehicle and in the target region, said control is operable to classify the determined moving pattern as a bicycle, and wherein the graphic overlay comprises a bicycle shape.

8. The vision system of claim 1, wherein, responsive to processing of captured image data by said image processor, said control is operable to control said matrix of light emitting diodes to enhance illumination of the target region in the determined path of travel of the vehicle and outside of illumination provided by low beam headlights of the vehicle.

9. The vision system of claim 1, wherein, responsive to processing of captured image data by said image processor, said control is operable to control said matrix of light emitting diodes to enhance illumination of the target region in the determined path of travel of the vehicle and outside of illumination provided by high beam headlights of the vehicle.

10. The vision system of claim 1, wherein said control is operable to control said matrix of light emitting diodes to enhance illumination of the target region in the determined path of travel of the vehicle responsive to determination of ambient light being below a threshold level.

11. The vision system of claim 1, wherein said matrix of light emitting diodes comprises a matrix headlight of the vehicle.

12. A vision system for a vehicle, said vision system comprising:

a camera configured to be disposed at a vehicle so as to have a field of view exterior and forward of the vehicle;

a display for displaying images derived from image data captured by said camera;

a control comprising an image processor operable to process image data captured by said camera;

wherein said control, responsive to processing of captured image data by said image processor, is operable to determine lane markers ahead of the vehicle and in a path of travel of the vehicle and in a first effective sensing range of said camera that is based on illumination present ahead of the vehicle and in a path of travel of the vehicle;

wherein, responsive to determination of lane markers ahead of the vehicle via processing of captured image data by said image processor, said control is operable to predict lane markers ahead of the vehicle that are outside and beyond the first effective sensing range of said camera;

wherein the first effective sensing range encompasses a first region illuminated by at least one light emitting diode of a matrix headlight of the vehicle, said matrix headlight comprising a matrix of light emitting diodes;

wherein, responsive to processing of captured image data by said image processor, said control is operable to control said matrix headlight of the vehicle, and wherein, responsive to prediction of lane markers ahead of the vehicle that are outside and beyond the first effective sensing range of said camera, and responsive to detection of an object present at least partially outside of the first effective sensing range of said camera, said control controls at least one light emitting diode of said matrix of light emitting diodes to enhance illumination at a target region that encompasses where lane markers outside and beyond the first effective sensing range are predicted to be;

wherein said camera has the first effective sensing range when said at least one light emitting diode is activated and said at least one other light emitting diode is not activated and has a second effective sensing range when said at least one light emitting diode is activated and said at least one other light emitting diode are activated, and wherein the second effective sensing range extends further from the vehicle than the first effective sensing range;

wherein the target region is outside and beyond the first effective sensing range of said camera when said at least one other light emitting diode is not activated but is within the second effective sensing range of said camera when said at least one other light emitting diode is activated;

wherein, responsive to processing of captured image data by said image processor with said at least one other light emitting diode activated, said control is operable to confirm the presence of the object at the target region and within the second effective sensing range; and

wherein said vision system is operable to generate a graphic overlay that is overlaid on displayed images, and wherein the graphic overlay is overlaid at a region of the displayed image that corresponds to the detected object.

13. The vision system of claim 12, wherein said control is operable to control one or more of the individual light emitting diodes to enhance the illumination of a selected portion of the target region.

14. The vision system of claim 12, wherein, responsive to processing of captured image data by said image processor with said at least one other light emitting diode controlled to enhance illumination at the target region, said control is operable to classify the detected object, and wherein the graphic overlay comprises a shape that corresponds to the classification of the detected object.

15. The vision system of claim 12, wherein, responsive to determination, via processing of captured image data by said image processor with said at least one other light emitting diode controlled to enhance illumination at the target region, of a moving pattern indicative of a bicycle'"'"'s tires in motion ahead of the vehicle and in the target region, said control is operable to classify the determined moving pattern as a bicycle, and wherein the graphic overlay comprises a bicycle shape.

16. A vision system for a vehicle, said vision system comprising:

a camera configured to be disposed at a vehicle so as to have a field of view exterior and forward of the vehicle;

a control comprising an image processor operable to process image data captured by said camera;

wherein said control, responsive to processing of captured image data by said image processor, is operable to determine lane markers ahead of the vehicle and in a path of travel of the vehicle and in a first effective sensing range of said camera that is based on illumination present ahead of the vehicle and in a path of travel of the vehicle;

wherein, responsive to determination of lane markers ahead of the vehicle via processing of captured image data by said image processor, said control is operable to predict lane markers ahead of the vehicle that are outside and beyond the first effective sensing range of said camera;

wherein the first effective sensing range encompasses a first region illuminated by at least one light emitting diode of a matrix headlight of the vehicle, said matrix headlight comprising a matrix of light emitting diodes;

wherein, responsive to processing of captured image data by said image processor, said control is operable to control said matrix headlight of the vehicle, and wherein, responsive to prediction of lane markers ahead of the vehicle that are outside and beyond the first effective sensing range of said camera, and responsive to detection of an object present at least partially outside of the first effective sensing range of said camera, said control controls at least one light emitting diode of said matrix of light emitting diodes to enhance illumination at a target region that encompasses where lane markers outside and beyond the first effective sensing range are predicted to be;

wherein said camera has the first effective sensing range when said at least one light emitting diode is activated and said at least one other light emitting diode is not activated and has a second effective sensing range when said at least one light emitting diode and said at least one other light emitting diode are activated, and wherein the second effective sensing range extends further from the vehicle than the first effective sensing range;

wherein the target region is outside and beyond the first effective sensing range of said camera when said at least one other light emitting diode is not activated but is within the second effective sensing range of said camera when said at least one other light emitting diode is activated;

wherein, responsive to processing of captured image data by said image processor with said at least one light emitting diode activated, said control is operable to confirm the presence of the object at the target region and within the second effective sensing range; and

wherein said control is operable to control said matrix of light emitting diodes to enhance illumination of the target region in the determined path of travel of the vehicle responsive to determination of ambient light being below a threshold level.

17. The vision system of claim 16, comprising a display for displaying images derived from image data captured by said camera, and wherein said vision system is operable to generate a graphic overlay that is overlaid on displayed images, and wherein the graphic overlay is overlaid at a region of the displayed image that corresponds to the detected object, and wherein, responsive to processing of captured image data by said image processor with said at least one light emitting diode controlled to enhance illumination at the target region, said control is operable to classify the detected object, and wherein the graphic overlay comprises a shape that corresponds to the classification of the detected object.

18. The vision system of claim 16, comprising a display for displaying images derived from image data captured by said camera, and wherein said vision system is operable to generate a graphic overlay that is overlaid on displayed images, and wherein the graphic overlay is overlaid at a region of the displayed image that corresponds to the detected object, and wherein, responsive to determination, via processing of captured image data by said image processor with said at least one light emitting diode controlled to enhance illumination at the target region, of a moving pattern indicative of a bicycle'"'"'s tires in motion ahead of the vehicle and in the target region, said control is operable to classify the determined moving pattern as a bicycle, and wherein the graphic overlay comprises a bicycle shape.

19. The vision system of claim 16, wherein, responsive to processing of captured image data by said image processor, said control is operable to control said matrix of light emitting diodes to enhance illumination of the target region in the determined path of travel of the vehicle and outside of illumination provided by low beam headlights of the vehicle.

20. The vision system of claim 16, wherein, responsive to processing of captured image data by said image processor, said control is operable to control said matrix of light emitting diodes to enhance illumination of the target region in the determined path of travel of the vehicle and outside of illumination provided by high beam headlights of the vehicle.