Vehicle and mobile device traffic hazard warning techniques

• US 8,907,771 B2
• Filed: 07/15/2013
• Issued: 12/09/2014
• Est. Priority Date: 07/11/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Vasquez, Juan, Mok, Vinson
• Primary Examiner(s): HUNNINGS, TRAVIS R
• Application Number:
  US13/942,075
• Publication Number:
  US 20140015973A1
• Time in Patent Office: 512 Days
• US Class Current: 340/436
• CPC Class Codes: B60Q 2900/30 Lamps commanded by wireless transmissions
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G08G 1/16 Anti-collision systems road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08
• CPC Class Codes: G08G 1/165 for passive traffic, e.g. including static obstacles, trees
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A computer-implemented method includes monitoring an environment external to a vehicle via a sensor of the vehicle or a mobile device. The monitoring includes recording audio or video signals based on an output of the sensor. Audio or image recognition is performed via the mobile device based on the audio or video signals. Based on results of the audio or image recognition, objects in an area through which the vehicle is to pass are detected. The method includes determining which ones of the detected objects satisfy a predetermined criteria. The predetermined criteria includes object features that are indiscernible or marginally discernible to a vehicle operator with a perception deficiency. Selected ones of the detected objects that satisfy the predetermined criteria are monitored. The vehicle operator is alerted of the selected ones of the detected objects with an alert predetermined to be discernible to the vehicle operator.

Claims

1. A mobile device, comprising:

a memory adapted to store one or more input parameters identifying at least one object to monitor;

a sensor configured to;

monitor an environment external to a vehicle,

capture images of such environment from a location within the vehicle, and

generate an image signal representing a captured image;

one or more processing units configured to;

perform image recognition based on the captured image utilizing the input parameters,

detect objects in the environment external to the vehicle based on results of the image recognition, and

identify selected ones of the detected objects as traffic indicators based on one or more predetermined criteria; and

an output device configured to output an alert to a vehicle operator of the detected objects identified;

wherein the one or more processing units are further configured to determine that the traffic indicators are marginally discernible or indiscernible to the vehicle operator with a perception deficiency.

2. The mobile device of claim 1, wherein the alert comprises an audio alert.

3. The mobile device of claim 1, wherein the traffic indicators include one or more of a traffic light, a sign, a stop sign, a stop light, a road hazard, a lane marking, and an object located at an intersection.

4. The mobile device of claim 1, wherein the traffic indicators include one or more colors predetermined to be marginally discernible or indiscernible by the vehicle operator, wherein the alert comprises an alert to the vehicle operator of the detected objects identified as having one or more of the colors.

5. The mobile device of claim 1, wherein the output device is a display screen, and outputting the alert comprises altering an image of the traffic indicators on the display screen in an augmented reality of the environment displayed on the display screen.

6. A computer-implemented method, comprising:

monitoring, via a sensor associated with at least one of a vehicle and a mobile device, an environment external to the vehicle, wherein the monitoring of the environment includes recording video signals of the environment based on an output of the sensor;

performing image recognition based on the video signals;

detecting, at the mobile device and based on results of the image recognition, objects in the environment external to the vehicle;

identifying that at least one of the objects detected comprises a traffic indicator;

outputting an alert corresponding to the traffic indicator;

determining, by one or more processors, that the traffic indicators are marginally discernible or indiscernible to a vehicle operator with a perception deficiency.

7. The computer-implemented method of claim 6, wherein the traffic indicators include one or more of a traffic light, a sign, a stop sign, a stop light, a road hazard, a lane marking, and an object located at an intersection.

8. The computer-implemented method of claim 6, further comprising monitoring the environment via a sensing network including:

monitoring the area via the sensor, wherein the sensing network comprises the sensor and a second sensor; and

monitoring, via a second sensor, an area other than the environment external to the vehicle monitored by the sensor, wherein the video signals are generated based on an output of the second sensor.

9. The computer-implemented method of claim 6, wherein the sensor is mounted at least one of in and on the mobile device.

10. The computer-implemented method of claim 6, wherein the traffic indicator includes one or more colors predetermined to be marginally discernible or indiscernible by the vehicle operator, wherein outputting the alert comprises alerting the vehicle operator of detected objects identified as having one or more of the colors.

11. The computer-implemented method of claim 6, wherein the alert comprises an audio alert.

12. The computer-implemented method of claim 6, wherein outputting the alert comprises altering an image of the traffic indicator in an augmented reality of the environment displayed on the mobile device.

13. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause a computing device to output an alert, by performing the steps of:

monitoring, via a sensor associated with at least one of a vehicle and a mobile device, an environment external to the vehicle, wherein the monitoring of the environment includes recording video signals of the environment based on an output of the sensor;

performing image recognition based on the video signals;

detecting, at the mobile device and based on results of the image recognition, objects in the environment external to the vehicle;

identifying that at least one of the objects detected comprises a traffic indicator;

outputting an alert corresponding to the traffic indicator;

determining that the traffic indicators are marginally discernible or indiscernible to a vehicle operator with a perception deficiency.

14. The computer-readable storage medium of claim 13, wherein the alert comprises an audio alert.

15. The computer-readable storage medium of claim 13, wherein the traffic indicators include one or more of a traffic light, a sign, a stop sign, a stop light, a road hazard, a lane marking, and an object located at an intersection.

16. The computer-readable storage medium of claim 13, wherein the traffic indicator includes one or more colors predetermined to be marginally discernible or indiscernible by the vehicle operator, wherein outputting the alert comprises alerting the vehicle operator of detected objects identified as having one or more of the colors.

17. The computer-readable storage medium of claim 13, wherein outputting the alert comprises altering an image of the traffic indicator in an augmented reality of the environment displayed on the mobile device.