PROVIDING REMOTE ASSISTANCE TO AN AUTONOMOUS VEHICLE

• US 20160334230A1
• Filed: 05/13/2015
• Published: 11/17/2016
• Est. Priority Date: 05/13/2015
• Status: Active Grant

• Current Assignee: Uber Technologies, Inc.
• Original Assignee: Uber Technologies, Inc.
• Inventors: Ross, William, Bares, John, LaRose, David, Sweeney, Matthew
• Granted Patent: US 10,345,809 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B60W 30/165 Automatically following the path of a preceding lead vehicle, e.g. "electronic tow-bar"
• CPC Class Codes: B60W 60/0059 Estimation of the risk associated with autonomous or manual driving, e.g. situation too complex, sensor failure or driver incapacity
• CPC Class Codes: G01C 21/3415 Dynamic re-routing, e.g. recalculating the route when the user deviates from calculated route or after detecting real-time traffic data or accidents
• CPC Class Codes: G05D 1/0027 involving a plurality of vehicles, e.g. fleet or convoy travelling fleet control of land vehicles from a control room G05D1/0297; traffic control systems for road vehicles G08G1/00; for marine craft G08G3/00; for aircraft G08G5/00
• CPC Class Codes: G05D 2201/0213 Road vehicle, e.g. car or truck

Abstract

An event is detected that impairs a confidence level of the autonomous vehicle in progressing through a current route. In response to detecting the event, the autonomous vehicle communicates information about the event to a remote source of guidance. The autonomous vehicle can receive instructions from the remote source of guidance on how to handle the event. The autonomous vehicle can then implement the instructions to handle the event while it operates.

Claims

1. A method for operating an autonomous vehicle, the method being implemented by one or more processors and comprising:

(a) detecting an event that impairs a confidence level of the autonomous vehicle in progressing through a current route;

(b) communicating information about the event to a remote source of guidance;

(c) receiving instructions from the remote source of guidance on handling the event; and

(d) implementing the instructions.

2. The method of claim 1, further comprising:

determining, on the autonomous vehicle, a set of alternative options for handling the event; and

communicating the set of alternative options to the remote source of guidance;

wherein receiving instructions includes receiving a selection of one of the alternative options of the set from the remote source of guidance.

3. The method of claim 1, wherein when (a) through (d) are performed in a duration that exceeds a threshold time limit, the autonomous vehicle decreases velocity.

4. The method of claim 3, wherein the threshold time limit is about 2 seconds.

5. The method of claim 1, wherein communicating information about the event includes selecting input from a subset of available sensors to communicate as information to the remote source of guidance.

6. The method of claim 5, wherein selecting input from the subset of available sensors to communicate as information to the remote source of guidance is based at least in part on a type of road segment on which the autonomous vehicle is traveling on.

7. The method of claim 5, wherein selecting input from a subset of available sensors to communicate as information to the remote source of guidance is based at least in part on a sensor characteristic of a sensor which detected the event.

8. The method of claim 5, wherein selecting input from a subset of available sensors to communicate as information to the remote source of guidance is based on a pre-determined rule based logic.

9. The method of claim 5, wherein selecting input from a subset of available sensors to communicate as information includes sequencing communication of the information so that information from a first set of sensors is communicated during an initial duration, and information from a second set of sensors is communicated during a second duration.

10. The method of claim 1, further comprising generating an interface for a human operator at the remote source to respond to the communicated information.

11. The method of claim 10, wherein the interface includes a plurality of directional indicators, each directional indicator being selectable by the human operator to provide instructions to the autonomous vehicle for a directional movement that is responsive to detecting the event.

12. The method of claim 11, wherein the interface includes one or more indicators that are each selectable by the human operator to provide instructions to the autonomous vehicle for a velocity adjustment that is responsive to detecting the event.

13. The method of claim 11, wherein the interface includes an approximate time for a human operator at the remote source to provide input through the interface.

14. The method of claim 1, wherein detecting the event includes detecting an object in a roadway of the autonomous vehicle that is not recognized or recognized with a level of certainty that is below a threshold.

15. The method of claim 14, wherein detecting the object in the roadway includes detecting the object using a long range sensor.

16. A method for guiding an autonomous vehicle, the method being implemented by one or more processors and comprising:

(a) processing an alert from an autonomous vehicle, the alert including sensor information which indicates an uncertainty in how the autonomous vehicle should proceed on a trip;

(b) displaying an interface for a human operator based on the sensor information, the interface including a set of indicators, each indicator in the set indicating a direction or velocity adjustment;

(c) detecting a selection input from the human operator of one of the indicators in the set of indicators; and

(d) communicating an instruction to the autonomous vehicle to take an action in accordance with the direction or velocity adjustment indicated by the selection input of the human operator.

17. The method of claim 16, wherein one of the indicators in the set indicates a null direction or velocity adjustment.

18. The method of claim 16, wherein displaying the interface includes superimposing the interface on content generated from the sensor information.

19. The method of claim 16, wherein displaying the interface includes displaying a time remaining for the human operator to provide the selection input before the autonomous vehicle performs a default action.

20. A non-transitory computer-readable medium that stores instructions for guiding an autonomous vehicle, the instructions, when executed by one or more processors, causing the one or more processors to perform operations comprising:

(a) processing an alert from an autonomous vehicle, the alert including sensor information which indicates an uncertainty in how the autonomous vehicle should proceed on a trip;

(b) displaying an interface for a human operator based on the sensor information, the interface including a set of indicators, each indicator in the set indicating a direction or velocity adjustment;

(c) detecting a selection input from the human operator of one of the indicators in the set of indicators; and

(d) communicating an instruction to the autonomous vehicle to take an action in accordance with the direction or velocity adjustment indicated by the selection input of the human operator.