Remote assistance for autonomous vehicles in predetermined situations
First Claim
1. A computer-implemented method comprising:
- determining a representation of an environment of an autonomous vehicle based on sensor data of the environment;
based on the representation, identifying that the autonomous vehicle is in a given situation from a predetermined set of situations for which the autonomous vehicle will request remote assistance;
sending a request for verification of an autonomous operation to take in the given situation to a remote computing device that comprises a user interface to display the representation of the environment and an indication of the given situation;
receiving a response from the remote computing device indicating verification of the autonomous operation; and
after receiving the response, causing the autonomous vehicle to perform the autonomous operation.
6 Assignments
0 Petitions
Accused Products
Abstract
Example systems and methods enable an autonomous vehicle to request assistance from a remote operator in certain predetermined situations. One example method includes determining a representation of an environment of an autonomous vehicle based on sensor data of the environment. Based on the representation, the method may also include identifying a situation from a predetermined set of situations for which the autonomous vehicle will request remote assistance. The method may further include sending a request for assistance to a remote assistor, the request including the representation of the environment and the identified situation. The method may additionally include receiving a response from the remote assistor indicating an autonomous operation. The method may also include causing the autonomous vehicle to perform the autonomous operation.
-
Citations
18 Claims
-
1. A computer-implemented method comprising:
-
determining a representation of an environment of an autonomous vehicle based on sensor data of the environment; based on the representation, identifying that the autonomous vehicle is in a given situation from a predetermined set of situations for which the autonomous vehicle will request remote assistance; sending a request for verification of an autonomous operation to take in the given situation to a remote computing device that comprises a user interface to display the representation of the environment and an indication of the given situation; receiving a response from the remote computing device indicating verification of the autonomous operation; and after receiving the response, causing the autonomous vehicle to perform the autonomous operation. - View Dependent Claims (2, 3, 4, 5, 6, 16, 17, 18)
-
-
7. A computer-implemented method comprising:
-
receiving a request for verification of an autonomous operation from an autonomous vehicle, the request comprising a representation of an environment of the autonomous vehicle and an identified situation from a predetermined set of situations; receiving sensor data representative of the environment of the autonomous vehicle; providing for display of a user interface that shows the representation of the environment, at least a portion of the sensor data, and an indication of the identified situation; receiving, via the user interface, verification of the autonomous operation for the autonomous vehicle to perform in the identified situation; and after receiving verification of the autonomous operation, sending a response to the request to the autonomous vehicle to perform the autonomous operation in the identified situation. - View Dependent Claims (8, 9, 10)
-
-
11. An autonomous vehicle, comprising:
a control system configured to; determine a representation of an environment of the autonomous vehicle based on sensor data of the environment; based on the representation, identify that the autonomous vehicle is in a given situation from a predetermined set of situations for which the autonomous vehicle will request remote assistance; send a request for verification of an autonomous operation to take in the given situation to a remote computing device that comprises a user interface to display the representation of the environment and an indication of the given situation; receive a response from the remote computing device indicating verification of the autonomous operation; and after receiving the response, cause the autonomous vehicle to perform the autonomous operation. - View Dependent Claims (12, 13, 14, 15)
Specification