Vehicle vision system utilizing communication system

• US 9,881,220 B2
• Filed: 10/21/2014
• Issued: 01/30/2018
• Est. Priority Date: 10/25/2013
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Koravadi, Krishna
• Primary Examiner(s): Czekaj, Dave
• Assistant Examiner(s): SULLIVAN, TYLER
• Application Number:
  US14/519,469
• Publication Number:
  US 20150124096A1
• Time in Patent Office: 1,197 Days
• Field of Search: None
• CPC Class Codes: B62D 15/0285 Parking performed automatically
• CPC Class Codes: G01C 21/3685 the POI's being parking facilities
• CPC Class Codes: G06V 20/584 of vehicle lights or traffic lights

Abstract

A vehicle vision system includes a camera disposed at a vehicle and having a field of view forwardly of the vehicle, and a control having an image processor. The control is operable to receive wireless communication that is associated with a traffic light ahead of the vehicle, with the wireless communication including a communicated status of the traffic light. The image processor, responsive to processing of captured image data, is operable to determine an imaged status of the traffic light. The control compares the imaged status with the communicated status and, when they correspond, confirms the status of the traffic light ahead of the vehicle. Responsive to a determination that the driver of the vehicle is not properly responding to the confirmed traffic light status, the system generate an alert to the driver of the vehicle and/or applies the brakes of the vehicle.

Claims

1. A vision system of a vehicle, said vision system comprising:

a camera disposed at a vehicle and having a field of view forward of the vehicle;

a control comprising an image processor;

wherein said image processor is operable to process image data captured by said camera;

wherein said control is operable to receive wireless communication that is associated with a traffic light ahead of the vehicle, the wireless communication comprising a communicated status of the traffic light ahead of the vehicle;

wherein said image processor, responsive to processing of captured image data, is operable to determine an imaged status of the traffic light ahead of the vehicle and in the field of view of said camera;

wherein said control compares the imaged status with the communicated status and, when the communicated status corresponds to the imaged status, determines the status of the traffic light ahead of the vehicle;

wherein, responsive to a determination that a driver of the vehicle is not properly responding to the determined traffic light status, said system is operable to at least one of (i) generate an alert to the driver of the vehicle and (ii) apply the brakes of the vehicle; and

wherein, when the communicated status does not correspond to the imaged status, said control generates an alert to the driver of the vehicle.

2. The vision system of claim 1, wherein the wireless communication is from a V2I communication device associated with the traffic light ahead of the vehicle.

3. The vision system of claim 1, wherein, responsive to determination of fog or rain or snow conditions, said control determines the status of the traffic light ahead of the vehicle by applying a greater weighting factor to the communicated status as compared to the imaged status.

4. The vision system of claim 1, wherein the communicated status is fused with the processed image data to increase the reliability of the determination of the status of the traffic light ahead of the vehicle.

5. The vision system of claim 1, wherein, responsive to a GPS system of the vehicle, locations of traffic lights ahead of the vehicle are provided to said control.

6. The vision system of claim 5, wherein said control uses the provided traffic light location information in conjunction with at least one of the communicated status and the imaged status to increase the reliability of the determination of the status of the traffic light ahead of the vehicle.

7. The vision system of claim 5, wherein, responsive to determination, based on the GPS system, that no traffic light is forward of the vehicle, said control applies a lower weighting factor to the imaged status as compared to the communicated status.

8. The vision system of claim 1, wherein, responsive to a determination that the driver of the vehicle is approaching an intersection at which the determined traffic light status is indicative of a red light, said system is operable to at least one of (i) generate an alert to the driver of vehicle and (ii) apply the brakes of the vehicle.

9. The vision system of claim 1, wherein, responsive to a determination that the driver of the vehicle is approaching an intersection at which the determined traffic light status is indicative of a red light, said system is operable to first generate an alert to the driver of the vehicle and second, if the driver does not respond to the alert, apply the brakes of the vehicle.

10. The vision system of claim 1, wherein said control is operable to receive another wireless communication and wherein the other wireless communication is indicative of an availability of at least one parking space, and wherein, responsive to determination of an available parking space, the driver of the vehicle can reserve the available parking space via actuation by the driver of a user input.

11. The vision system of claim 10, wherein said vision system at least one of (i) determines an available parking space responsive to the other communication being indicative of an available parking space and (ii) determines an available parking space responsive to image processing of image data captured by said camera.

12. A vision system of a vehicle, said vision system comprising:

a camera disposed at a vehicle and having a field of view forward of the vehicle;

a control comprising an image processor;

wherein said image processor is operable to process image data captured by said camera;

wherein said control is operable to receive wireless communication that is associated with a traffic light ahead of the vehicle, the wireless communication comprising a communicated status of the traffic light ahead of the vehicle;

wherein the wireless communication is from a V2I communication device associated with the traffic light ahead of the vehicle;

wherein said image processor, responsive to processing of captured image data, is operable to determine an imaged status of the traffic light ahead of the vehicle and in the field of view of said camera;

wherein said control compares the imaged status with the communicated status and, when the communicated status corresponds to the imaged status, determines the status of the traffic light ahead of the vehicle;

wherein, responsive to a determination that a driver of the vehicle is not properly responding to the determined traffic light status, said system is operable to at least one of (i) generate an alert to the driver of the vehicle and (ii) apply the brakes of the vehicle;

wherein, responsive to determination of fog or rain or snow conditions, said control determines the status of the traffic light ahead of the vehicle by applying a greater weighting factor to the communicated status as compared to the imaged status; and

wherein said control generates an alert to the driver of the vehicle responsive to the communicated status not corresponding to the imaged status.

13. The vision system of claim 12, wherein, responsive to a GPS system of the vehicle, locations of traffic lights ahead of the vehicle are provided to said control, and wherein said control uses the provided traffic light location information in conjunction with at least one of the communicated status and the imaged status to increase the reliability of the determination of the status of the traffic light ahead of the vehicle.

14. The vision system of claim 12, wherein, responsive to a determination that the driver of the vehicle is approaching an intersection at which the determined traffic light status is indicative of a red light, said system is operable to first generate an alert to the driver of the vehicle and second, if the driver does not respond to the alert, apply the brakes of the vehicle.

15. The vision system of claim 12, wherein said control is operable to receive another wireless communication and wherein the other wireless communication is indicative of an availability of at least one parking space, and wherein, responsive to determination of an available parking space, the driver of the vehicle can reserve the available parking space via actuation by the driver of a user input.

16. A vision system of a vehicle, said vision system comprising:

a camera disposed at a vehicle and having a field of view forward of the vehicle;

a control comprising an image processor;

wherein said image processor is operable to process image data captured by said camera;

wherein said control is operable to receive wireless communication that is associated with a traffic light ahead of the vehicle, the wireless communication comprising a communicated status of the traffic light ahead of the vehicle;

wherein the wireless communication is from a V2I communication device associated with the traffic light ahead of the vehicle;

wherein said image processor, responsive to processing of captured image data, is operable to determine an imaged status of the traffic light ahead of the vehicle and in the field of view of said camera;

wherein said control compares the imaged status with the communicated status and, when the communicated status corresponds to the imaged status, determines the status of the traffic light ahead of the vehicle;

wherein, responsive to a determination that the driver of the vehicle is approaching an intersection at which the determined traffic light status is indicative of a red light, said system is operable to first generate an alert to the driver of the vehicle and second, if the driver does not respond to the alert, apply the brakes of the vehicle; and

wherein, when the communicated status does not correspond to the imaged status, said control generates an alert to the driver of the vehicle.

17. The vision system of claim 16, wherein, responsive to a GPS system of the vehicle, locations of traffic lights ahead of the vehicle are provided to said control, and wherein said control uses the provided traffic light location information in conjunction with at least one of the communicated status and the imaged status to increase the reliability of the determination of the status of the traffic light ahead of the vehicle.

18. The vision system of claim 16, wherein, responsive to determination of fog or rain or snow conditions, said control determines the status of the traffic light ahead of the vehicle by applying a greater weighting factor to the communicated status as compared to the imaged status said control generates an alert to the driver of the vehicle responsive to the communicated status.

19. The vision system of claim 16, wherein said control is operable to receive another wireless communication and wherein the other wireless communication is indicative of an availability of at least one parking space, and wherein, responsive to determination of an available parking space, the driver of the vehicle can reserve the available parking space via actuation by the driver of a user input.