Traffic light detecting system and method

• US 9,070,305 B1
• Filed: 01/21/2011
• Issued: 06/30/2015
• Est. Priority Date: 01/22/2010
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Raman, Tiruvilwamalai Venkatraman, Chen, Charles L., Levandowski, Anthony Scott
• Primary Examiner(s): ALAM, MIRZA F
• Application Number:
  US13/011,036
• Publication Number:
  US 20150179088A1
• Time in Patent Office: 1,621 Days
• Field of Search: 340/944, 340/995.1, 340/995.13, 340/995.24, 340/996, 340/438, 340/425.5, 340/937, 340/995, 340/988, 340/693.1, 340/693.3, 340/902, 340/904, 340/903, 340/907, 340/901, 340/919, 340/918, 340/990, 701/209, 701/207, 701/210, 701/408, 701/514, 701/448, 701/301, 701/19, 701/23, 701/200, 701/214, 701/1, 701/431, 701/437, 701/444, 701/468, 701/96, 455/343.1, 455/343.2, 455/343.4, 455/343.6, 455/456.1, 455/238.1, 342/452, 342/451, 342/464, 342/107
• US Class Current: 1/1
• CPC Class Codes: G06V 20/584 of vehicle lights or traffic lights
• CPC Class Codes: G09B 21/007 using both tactile and audible presentation of the information
• CPC Class Codes: H04M 1/72457 according to geographic location
• CPC Class Codes: H04M 1/72481 for visually impaired users
• CPC Class Codes: H04W 4/026 using orientation information, e.g. compass

Abstract

Systems and methods are provided for determining the status of traffic lights through a mobile device and communicating the status to the user of the device. The mobile device detects its geographical location, direction and elevation. The mobile device also receives information related to traffic lights, such as location and type. The device calculates positional deviation from the device to the traffic light and generates one or more prompts in the form of audible or tactile cues that progressively guide the user to point the device at the traffic light. The mobile device detects the image and color of the traffic light and determines the illumination and sign status of the traffic light. Then the mobile device communicates the traffic light status to the user.

Claims

1. A method of identifying a traffic light status, where the status comprises at least one of a color illumination status and a sign status of a traffic light, the method comprising:

receiving, at a user device, geolocation data associated with the traffic light and the user device, the user device geolocation data including a location of the user device, and the traffic light geolocation data including a location of the traffic light;

detecting an elevation and a direction of the user device;

determining from the geolocation data of the user device if a current location is adjacent to an intersection;

prompting a user to orient the user device to face the traffic light if the current location is adjacent to the intersection;

generating, with the user device, one or more instructions to orient the user device to face the traffic light based on the geolocation data associated with the traffic light and the user device, and on the elevation, the direction and an orientation of the user device;

capturing one or more images of the traffic light by an image capture device of the user device;

performing with the user device image processing on the captured images to determine a status of the traffic light; and

communicating the status to a user of the user device.

2. The method of claim 1, wherein generating the one or more instructions to orient the user device further comprises:

generating a map for an area between the user device and the traffic light; and

calculating deviations from the user device to the traffic light based on the map.

3. The method of claim 1, wherein determining the status of the traffic light with the user device further comprises:

receiving light signals from a plurality of light sources, where one of the light sources comprises the traffic light; and

filtering light signals for frequency ranges emitted by the traffic light.

4. The method of claim 1, further comprising:

receiving information related to the traffic light, the information comprising at least one of a size, a type and a timing sequence of the traffic light; and

wherein determining the status of the traffic light with the user device is performed based on the received information related to the traffic light.

5. The method of claim 1, wherein communicating the status of the traffic light to the user further comprises generating at least one of an audible output and a tactile output.

6. The method of claim 1, wherein determining the status of the traffic light further comprises at least one of recognizing signs associated with the traffic light, receiving audible information related to the status of the traffic light and determining the status of the traffic light is further based on the audible information.

7. The method of claim 1, wherein the location of the traffic light and the location of the user device are detected by a geographic position device, and the direction associated with the user device is detected by a digital compass.

8. A device for identifying a traffic light status of a traffic light, the device comprising:

memory for storing geolocation data of the traffic light, geolocation data of the device, and direction information and elevation information for the device; and

a processor coupled to the memory, the processor being configured to execute a set of instructions stored in the memory to;

receive the geolocation data of the traffic light and the device;

determine a current elevation and a current direction of the device;

determine from the geolocation data of a user device if a current location is adjacent to an intersection;

prompt a user to orient the user device to face the traffic light if the current location is adjacent to the intersection;

determine with the device one or more instructions to orient the device to face the traffic light based on the received geolocation data, the current elevation,

the current direction and an orientation of the device;

receive light signals from a plurality of light sources, where one of the light sources comprises the traffic light;

filter light signals for frequency ranges emitted by the traffic light to determine a status of the traffic light including at least one of a color illumination status and a sign status; and

communicate the status to a user of the device.

9. The device of claim 8, wherein the processor is further configured to generate the instructions by:

generating a map for an area between the user device and the traffic light; and

calculating deviations from the device to the traffic light based on the map.

10. The device of claim 8, the device further including an imager, and the processor is further configured to:

capture one or more images of the traffic light and a surrounding area with the imager;

perform image processing on the captured images to determine the status of the traffic light.

11. The device of claim 8, wherein the processor is further configured to:

receive information related to the traffic light, including at least one of a size, a type and a timing sequence of the traffic light,

wherein the processor determines the status of the traffic light using the received information related to the traffic light.

12. The device of claim 8, wherein the processor is further configured to generate an audible output or a tactile output of the traffic light status.

13. The device of claim 8, wherein the processor determines the status of the traffic light by at least one of recognizing signs associated with the traffic light, and receiving audible information related to the status of the traffic light.

14. The device of claim 8, wherein the processor determines a location of the traffic light and a location of the device using a geographic position device, and determines the direction of the device with a digital compass.