SYSTEMS AND METHODS FOR CAUSING A VEHICLE RESPONSE BASED ON TRAFFIC LIGHT DETECTION

• US 20160318490A1
• Filed: 06/28/2016
• Published: 11/03/2016
• Est. Priority Date: 04/28/2015
• Status: Active Grant

• Current Assignee: MobilEye Vision Technologies Ltd. (Intel Corporation)
• Original Assignee: MobilEye Vision Technologies Ltd. (Intel Corporation)
• Inventors: BEN SHALOM, Itai
• Granted Patent: US 10,507,807 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B60K 2031/0025 Detecting position of target vehicle, e.g. vehicle driving ahead from host vehicle
• CPC Class Codes: B60K 31/0008 including means for detecting potential obstacles in vehicle path
• CPC Class Codes: B60Q 9/00 Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 , e.g. haptic signalling
• CPC Class Codes: B60T 2201/022 Collision avoidance systems
• CPC Class Codes: B60T 2210/32 Vehicle surroundings
• CPC Class Codes: B60T 2210/36 Global Positioning System [GPS]
• CPC Class Codes: B60T 7/12 for automatic initiation; for initiation not subject to will of driver or passenger limiting speed of vehicles other than rail vehicles B60K31/00
• CPC Class Codes: B60T 7/18 operated by wayside apparatus
• CPC Class Codes: B60T 7/22 initiated by contact of vehicle, e.g. bumper, with an external object, e.g. another vehicle , or by means of contactless obstacle detectors mounted on the vehicle
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 2540/18 Steering angle
• CPC Class Codes: B60W 2555/60 Traffic rules, e.g. speed limits or right of way
• CPC Class Codes: B60W 30/18109 Braking
• CPC Class Codes: B60W 30/18154 Approaching an intersection

Abstract

A traffic light detection system for a vehicle is provided. The system may include at least one processing device programmed to receive, from at least one image capture device, a plurality of images representative of an area forward of the vehicle, the area including a traffic light fixture having at least one traffic light. The at least one processing device may also be programmed to analyze at least one of the plurality of images to determine a status of the at least one traffic light, and determine an estimated amount of time until the vehicle will reach an intersection associated with the traffic light fixture. The at least one processing device may further be programmed to cause a system response based on the status of at least one traffic light and the estimated amount of time until the vehicle will reach the intersection.

Claims

1. A traffic light detection system for a vehicle, the system comprising:

at least one processing device programmed to;

receive, from at least one image capture device, a plurality of images representative of an area forward of the vehicle, the area including a traffic light fixture having at least one traffic light;

analyze at least one of the plurality of images to determine a status of the at least one traffic light;

determine an estimated amount of time until the vehicle will reach an intersection associated with the traffic light fixture; and

cause a system response based on the status of at least one traffic light and the estimated amount of time until the vehicle will reach the intersection.

2. The system of claim 1, wherein the at least one processing device is further programmed to cause the system response when the status of the at least one traffic light is represented by a yellow or red color.

3. The system of claim 1, wherein the at least one processing device is further programmed to cause the system response when the estimated amount of time until the vehicle will reach the intersection is equal to or less than a predetermined time threshold.

4. The system of claim 1, wherein the predetermined time threshold is one second, two seconds, three seconds, four seconds, or five seconds.

5. The system of claim 1, wherein the at least one processing device is further programmed to cause the system response when the status of the at least one traffic light is represented by a yellow or red color, and the estimated amount of time until the vehicle will reach the intersection is equal to or less than a predetermined time threshold.

6. The system of claim 1, wherein the at least one processing device is further programmed to determine whether the at least one traffic light is relevant to the vehicle.

7. The system of claim 6, wherein the at least one processing device is further programmed to suppress the system response when the at least one traffic light is determined to be not relevant to the vehicle.

8. The system of claim 1, wherein the at least one processing device is further programmed to analyze at least one of the plurality of images to identify a marking on a road in the area forward of the vehicle.

9. The system of claim 8, wherein the at least one processing device is further programmed to determine whether the at least one traffic light is relevant to the vehicle based on the marking on the road.

10. The system of claim 9, wherein the marking on the road includes a turn lane arrow, and the at least one processing device is further programmed to suppress the system response based on detecting the turn lane arrow.

11. The system of claim 1, wherein the at least one processing device is further programmed to determine the amount of time until the vehicle will reach the intersection based on a distance of the vehicle to a stop line associated with the traffic light fixture.

12. The system of claim 11, wherein the distance of the vehicle to the stop line is determined based on analysis of at least two of the plurality of images including the stop line.

13. The system of claim 1, wherein the at least one processing device is further programmed to determine the amount of time until the vehicle will reach the intersection based on a distance of the vehicle to the traffic light fixture.

14. The system of claim 13, wherein the distance of the vehicle to the traffic light fixture is determined based on analysis of at least two of the plurality of images including the traffic light fixture.

15. The system of claim 1, wherein the at least one processing device is further programmed to suppress the system response when a signal from a steering system of the vehicle indicates that the vehicle turns left or right.

16. The system of claim 1, wherein the system response includes applying vehicle brakes.

17. The system of claim 1, wherein the at least one processing device is further programmed to provide a visual or auditory notice to a driver of the vehicle prior to causing the system response.

18. The system of claim 1, wherein the at least one processing device is further programmed to cause the system response when:

the status of the at least one traffic light is represented by a yellow or red color; and

a minimum deceleration needed for the vehicle to travel a distance from a current position of the vehicle to the intersection to achieve a full stop before reaching the intersection is equal to or greater than a predetermined deceleration threshold.

19. The system of claim 18, wherein the at least one processing device is further programmed to determine the minimum deceleration based on a current speed of the vehicle and the distance from the current position of the vehicle to the intersection.

20. The system of claim 1, wherein the at least one processing device is further programmed to cause the system response when:

the status of the at least one traffic light is represented by a yellow or red color; and

the estimated amount of time for the vehicle to travel a distance from a current position of the vehicle to the intersection to achieve a full stop before reaching the intersection is equal to or greater than a predetermined deceleration threshold.

21. The system of claim 1, wherein the at least one processing device is further programmed to cause the system response when:

the status of at least one traffic light is represented by a yellow or red color;

the estimated amount of time until the vehicle will reach the intersection is equal to or less than a predetermined time threshold; and

one or more predetermined suppression schemes are not satisfied.

22. The system of claim 1, wherein the at least one processing device is further programmed to cause the system response when:

the status of the at least one traffic light is represented by a yellow or red color;

a minimum deceleration needed for the vehicle to travel a distance from a current position of the vehicle to the intersection to achieve a full stop before reaching the intersection is equal to or greater than a predetermined deceleration threshold; and

one or more predetermined suppression schemes are not satisfied.

23. The system of claim 21, wherein the one or more predetermined suppression schemes include:

suppressing the system response when;

the at least one traffic light is on a left or right side of the field of view at a distance to a center of the field of view that is greater than a predetermined distance;

the traffic light fixture including the at least one traffic light is more than a predetermined distance away from the vehicle;

or

a distance from the vehicle to a preceding vehicle is less than a predetermined distance.

24. The system of claim 21, wherein the one or more predetermined suppression schemes include:

suppressing the system response when;

a signal from a braking system of the vehicle indicates that the driver has applied a brake;

a signal from a lighting system of the vehicle indicates that a left or right turn signal is blinking and the status of the at least one traffic light is represented by a green color with an arrow indication;

or

a signal from a steering system indicates that the vehicle is making a sharp turn.

25. A traffic light detection system for a vehicle, the system comprising:

at least one processing device programmed to;

receive, from at least one image capture device, a plurality of images representative of an area forward of the vehicle, the area including a traffic light fixture having at least one traffic light;

analyze at least one of the plurality of images to determine a status of the at least one traffic light;

determine a distance from the vehicle to an intersection; and

cause a system response based on the status of at least one traffic light and the distance from the vehicle to the intersection.

26. The traffic light detection system of claim 25, further comprising:

determining an amount of time until the vehicle will reach an intersection associated with the traffic light fixture based on the distance and a current speed of the vehicle;

comparing the amount of time to a predetermine time threshold; and

triggering the system response when the amount of time is smaller than or equal to the predetermined time threshold.

27. The traffic light detection system of claim 25, further comprising:

determining an amount of time until the vehicle will reach an intersection associated with the traffic light fixture based on the distance and a current speed of the vehicle;

comparing the amount of time to a predetermine time threshold;

determining whether a predetermined suppression scheme is satisfied; and

triggering the system response when the amount of time is smaller than or equal to the predetermined time threshold and when the predetermined suppression scheme is not satisfied.

28. The traffic light detection system of claim 25, further comprising:

determining, based on the distance from the vehicle to the intersection, a minimum deceleration required for vehicle to stop before the intersection within the distance from the vehicle to the intersection;

comparing the minimum deceleration required with a predetermined deceleration threshold; and

triggering the system response when the minimum deceleration required is greater than or equal to the predetermined deceleration threshold.

29. The traffic light detection system of claim 25, further comprising:

determining, based on the distance from the vehicle to the intersection, a minimum deceleration required for vehicle to stop before the intersection within the distance from the vehicle to the intersection;

comparing the minimum deceleration required with a predetermined deceleration threshold;

determining whether a predetermined suppression scheme is satisfied; and

triggering the system response when the minimum deceleration required is greater than or equal to the predetermined deceleration threshold and when the predetermined suppression scheme is not satisfied.

30. The traffic light detection system of claim 25, further comprising:

determining an amount of time until the vehicle will reach an intersection associated with the traffic light fixture based on the distance and a current speed of the vehicle;

comparing the amount of time to a predetermine time threshold;

determining, based on the distance from the vehicle to the intersection, a minimum deceleration required for vehicle to stop before the intersection within the distance from the vehicle to the intersection;

comparing the minimum deceleration required with a predetermined deceleration threshold; and

triggering the system response when the amount of time is smaller than or equal to the predetermined time threshold and when the minimum deceleration required is greater than or equal to the predetermined deceleration threshold.

31. The traffic light detection system of claim 25, further comprising:

determining an amount of time until the vehicle will reach an intersection associated with the traffic light fixture based on the distance and a current speed of the vehicle;

comparing the amount of time to a predetermine time threshold;

determining, based on the distance from the vehicle to the intersection, a minimum deceleration required for vehicle to stop before the intersection within the distance from the vehicle to the intersection;

comparing the minimum deceleration required with a predetermined deceleration threshold;

determining whether a predetermined suppression scheme is satisfied; and

triggering the system response when the amount of time is smaller than or equal to the predetermined time threshold, when the minimum deceleration required is greater than or equal to the predetermined deceleration threshold, and when the predetermined suppression scheme is not satisfied.