Vehicle and mobile device traffic hazard warning techniques

• US 9,195,894 B2
• Filed: 11/04/2014
• Issued: 11/24/2015
• Est. Priority Date: 07/11/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Vasquez, Juan, Mok, Vinson
• Primary Examiner(s): HUNNINGS, TRAVIS R
• Application Number:
  US14/532,490
• Publication Number:
  US 20150199578A1
• Time in Patent Office: 385 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: B60Q 2900/30 Lamps commanded by wireless transmissions
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G08G 1/16 Anti-collision systems road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08
• CPC Class Codes: G08G 1/165 for passive traffic, e.g. including static obstacles, trees
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A computer-implemented method includes monitoring an environment external to a vehicle via a sensor of the vehicle or a mobile device. The monitoring includes recording audio or video signals based on an output of the sensor. Audio or image recognition is performed via the mobile device based on the audio or video signals. Based on results of the audio or image recognition, objects in an area through which the vehicle is to pass are detected. The method includes determining which ones of the detected objects satisfy a predetermined criteria. The predetermined criteria includes object features that are indiscernible or marginally discernible to a vehicle operator with a perception deficiency. Selected ones of the detected objects that satisfy the predetermined criteria are monitored. The vehicle operator is alerted of the selected ones of the detected objects with an alert predetermined to be discernible to the vehicle operator.

Claims

1. An system comprising:

memory storing predetermined criteria for detecting objects in an environment external to a vehicle;

one or more sensors configured to monitor the environment and capture images of the environment from a location within the vehicle; and

one or more processors configured to;

receive the captured images from the one or more sensors;

perform image recognition on the captured images in order to detect one or more objects, and

identify selected ones of the one or more detected objects as traffic indicators that are marginally discernible or indiscernible to a vehicle operator using the predetermined criteria; and

provide a notification to the vehicle operator via an output device identifying the selected ones of the one or more detected objects.

2. The system of claim 1, further comprising the vehicle.

3. The system of claim 1 further comprising the output device, wherein the output device is configured to provide the notification as an audio alert.

4. The system of claim 1, wherein the traffic indicators include one or more of a traffic light, a sign, a stop sign, a stop light, a road hazard, a lane marking, and an object located at an intersection.

5. The system of claim 1, wherein the traffic indicators include one or more colors predetermined to be marginally discernible or indiscernible by the vehicle operator.

6. The system of claim 1, wherein the output device is a display screen, and the one or more processors are configured to provide the notification by altering an image of the traffic indicators on the display screen in an augmented reality of the environment displayed on the display screen.

7. The system of claim 1, wherein the one or more processors are further configured to use input parameters to adjust the predetermined criteria and the system further comprises an operator input device configured to receive the input parameters from the vehicle operator, wherein the input parameters identify objects to be monitored by the one or more sensors.

8. The system of claim 7, wherein the one or more processors are further configured to use the adjusted predetermined criteria to perform the image recognition.

9. The system of claim 1, wherein the predetermined criteria include one or more object features, and an object feature includes at least one of a color, image, audio pattern, and video pattern predetermined to be indiscernible or marginally discernible by the vehicle operator.

10. A computer-implemented method comprising:

accessing, by one or more processors, predetermined criteria for detecting objects in an environment external to a vehicle;

receiving, by the one or more processors, captured images from one or more sensors;

performing, by the one or more processors, image recognition on the captured images in order to detect one or more objects, and

identifying, by the one or more processors, selected ones of the one or more detected objects as traffic indicators that are marginally discernible or indiscernible to a vehicle operator using the predetermined criteria; and

providing, by the one or more processors, a notification to the vehicle operator via an output device identifying the selected ones of the one or more detected objects.

11. The method of claim 10, wherein the traffic indicators include one or more of a traffic light, a sign, a stop sign, a stop light, a road hazard, a lane marking, and an object located at an intersection.

12. The method of claim 10, wherein the traffic indicators include one or more colors predetermined to be marginally discernible or indiscernible by the vehicle operator.

13. The method of claim 10, wherein the output device is a display screen, and providing the notification includes altering an image of the traffic indicators on the display screen in an augmented reality of the environment displayed on the display screen.

14. The method of claim 10, further comprising:

receiving from an operator input apparatus input parameters identifying objects to be monitored by the one or more sensors; and

adjusting the predetermined criteria and the system further comprises an operator input device configured to receive the input parameters from the vehicle operator.

15. The method of claim 14, further comprising using the adjusted predetermined criteria to perform the image recognition.

16. The method of claim 10, wherein the predetermined criteria include one or more object features, and an object feature includes at least one of a color, image, audio pattern, and video pattern predetermined to be indiscernible or marginally discernible by the vehicle operator.

17. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause one or more processors of a computing device to perform a method, the method comprising:

accessing predetermined criteria for detecting objects in an environment external to a vehicle;

receiving captured images from one or more sensors;

performing image recognition on the captured images in order to detect one or more objects, and

identifying selected ones of the one or more detected objects as traffic indicators that are marginally discernible or indiscernible to a vehicle operator using the predetermined criteria; and

providing a notification to the vehicle operator via an output device identifying the selected ones of the one or more detected objects.

18. The medium of claim 17, wherein the method further comprises:

receiving from an operator input apparatus input parameters identifying objects to be monitored by the one or more sensors; and

adjusting the predetermined criteria and the system further comprises an operator input device configured to receive the input parameters from the vehicle operator.

19. The medium of claim 17, wherein the method further comprises using the adjusted predetermined criteria to perform the image recognition.

20. The medium of claim 17, wherein the method further comprises wherein the predetermined criteria include one or more object features, and an object feature includes at least one of a color, image, audio pattern, and video pattern predetermined to be indiscernible or marginally discernible by the vehicle operator.