System and method for traffic signal detection

• US 8,620,032 B2
• Filed: 05/10/2011
• Issued: 12/31/2013
• Est. Priority Date: 05/10/2011
• Status: Active Grant

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: Zeng, Shuqing
• Primary Examiner(s): Patel, Jayesh A
• Assistant Examiner(s): Kholdebarin, Iman K
• Application Number:
  US13/104,220
• Publication Number:
  US 20120288138A1
• Time in Patent Office: 966 Days
• Field of Search: 382/104, 340907-933
• US Class Current: 382/104
• CPC Class Codes: G08G 1/09623 Systems involving the acquisition of information from passive traffic signs by means mounted on the vehicle G08G1/0967 takes precedence
• CPC Class Codes: G08G 1/09626 where the origin of the information is within the own vehicle, e.g. a local storage device, digital map

Abstract

A method and system may determine a location of a vehicle, collect an image using a camera associated with the vehicle, analyze the image in conjunction with the location of the vehicle and/or previously collected information on the location of traffic signals or other objects (e.g., traffic signs), and using this analysis locate an image of a traffic signal within the collected image. The position (e.g., a geographic position) of the signal may be determined, and stored for later use. The identification of the signal may be used to provide an output such as the status of the signal, such as green light.

Claims

1. A method comprising:

determining a location of a vehicle;

collecting an image using a camera associated with the vehicle; and

analyzing the image in conjunction with the location of the vehicle and in conjunction with previously collected information on the location of traffic signals, collected by a system in the vehicle and relevant to the specific vehicle, wherein the previously collected information is stored in a database or memory within the vehicle, to locate an image of a traffic signal within the collected image;

locating the image of the traffic signal by analyzing portions of the image, wherein the analysis is weighted by the location of the vehicle in conjunction with known map data, and is input to one or more classifiers, each comprising an ensemble of detectors in cascade.

2. The method of claim 1 comprising determining the geographic location of the traffic signal.

3. The method of claim 1 wherein the previously collected information on the location of traffic signals is collected based on images captured by the camera associated with the vehicle.

4. The method of claim 1 comprising updating the previously collected information on the location of traffic signals with the location of the traffic signal.

5. The method of claim 1 comprising locating an image of a traffic signal by creating a set of candidate windows each surrounding a portion of the image wherein the selection of each window is weighted by previously collected information on the location of traffic signals.

6. The method of claim 1 comprising determining the status of the traffic signal.

7. A system comprising:

a database storing previously collected information on the location of traffic signals;

a camera;

a vehicle location detection system; and

a controller to;

accept a location of a vehicle from the vehicle location detection system;

collect an image using the camera;

analyze the image in conjunction with the location of the vehicle and in conjunction with the previously collected information on the location of traffic signals, collected by a system in the vehicle and relevant to the specific vehicle, wherein the previously collected information is stored in the database or memory within the vehicle, to locate an image of a traffic signal within the collected image; and

wherein the controller is to locate the image of the traffic signal by analyzing portions of the image, wherein the analysis is weighted by the location of the vehicle in conjunction with known map data, and is input to one or more classifiers, each comprising an ensemble of detectors in cascade.

8. The system of claim 7 wherein the controller is to determine the geographic location of the traffic signal.

9. The system of claim 7 wherein the previously collected information on the location of traffic signals is collected based on images captured by the camera.

10. The system of claim 7 wherein the controller is to update the previously collected information on the location of traffic signals with the location of the traffic signal.

11. The system of claim 7 wherein the controller is to locate an image of a traffic signal by creating a set of candidate windows each surrounding a portion of the image wherein the selection of each window is weighted by previously collected information on the location of traffic signals.

12. The system of claim 7 wherein the controller is to determine the status of the traffic signal.

13. A method comprising:

in a vehicle, capturing an image;

searching within a plurality of candidate areas within the image for a traffic signal, wherein the candidate areas are determined using as input, and in conjunction with, previously collected information on the location of traffic signals as stored in a system or database within the vehicle or controlled by the vehicle, and relevant to the specific vehicle;

determining the status of the traffic signal within the image and

wherein searching for the traffic signal within the image is weighted by the location of the vehicle, and is input to one or more classifiers, each comprising an ensemble of detectors in cascade.

14. The method of claim 13 comprising determining the geographic location of the traffic signal.

15. The method of claim 13 wherein the information on the location of traffic signals is collected based on images captured in the vehicle.

16. The method of claim 13 comprising updating information on the location of traffic signals with the location of the traffic signal.

17. The method of claim 13 wherein the candidate areas each define a portion of the image wherein the determination of each area is weighted by information on the location of traffic signals.