Assisted perception for autonomous vehicles
First Claim
1. An autonomous vehicle comprising:
- a set of sensors configured to receive data, wherein the data represents objects of an environment of the autonomous vehicle;
a control system, configured to operate the autonomous vehicle; and
one or more processors configured to;
determine, based on the received data, at least one object of the environment that has a detection confidence below a threshold, wherein the detection confidence is indicative of a likelihood that the determined object is correctly identified in the environment; and
based on the at least one object having a detection confidence below the threshold;
communicate, from the received data, image data of the at least one object for further processing to a remote operator,determine at least one natural-language question associated with the at least one object having a detection confidence below the threshold,communicate the at least one natural-language question to the remote operator,receive an answer to the at least one natural-language question from the remote operator providing an object indication, andprovide instructions to control the autonomous vehicle by the control system based on the object indication.
6 Assignments
0 Petitions
Accused Products
Abstract
Disclosed herein are systems and methods for providing supplemental identification abilities to an autonomous vehicle system. The sensor unit of the vehicle may be configured to receive data indicating an environment of the vehicle, while the control system may be configured to operate the vehicle. The vehicle may also include a processing unit configured to analyze the data indicating the environment to determine at least one object having a detection confidence below a threshold. Based on the at least one object having a detection confidence below a threshold, the processor may communicate at least a subset of the data indicating the environment for further processing. The vehicle is also configured to receive an indication of an object confirmation of the subset of the data. Based on the object confirmation of the subset of the data, the processor may alter the control of the vehicle by the control system.
-
Citations
24 Claims
-
1. An autonomous vehicle comprising:
-
a set of sensors configured to receive data, wherein the data represents objects of an environment of the autonomous vehicle; a control system, configured to operate the autonomous vehicle; and one or more processors configured to; determine, based on the received data, at least one object of the environment that has a detection confidence below a threshold, wherein the detection confidence is indicative of a likelihood that the determined object is correctly identified in the environment; and based on the at least one object having a detection confidence below the threshold; communicate, from the received data, image data of the at least one object for further processing to a remote operator, determine at least one natural-language question associated with the at least one object having a detection confidence below the threshold, communicate the at least one natural-language question to the remote operator, receive an answer to the at least one natural-language question from the remote operator providing an object indication, and provide instructions to control the autonomous vehicle by the control system based on the object indication. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A method comprising:
-
receiving data by a set of sensors, wherein the data represents objects of an environment of an autonomous vehicle; operating the autonomous vehicle by a control system; determining, by a processor, based on the received data, at least one object of the environment that has a detection confidence below a threshold, wherein the detection confidence is indicative of a likelihood that the determined object is correctly identified in the environment; and based on the at least one object having a detection confidence below the threshold, the processor; communicating, from the received data, image data of the at least one object for further processing to a remote operator, determining at least one natural-language question associated with the at least one object having a detection confidence below the threshold, communicating the at least one natural-language question to the remote operator, receiving an answer to the at least one natural-language question from the remote operator providing an object indication, and providing instructions to control the autonomous vehicle by the control system based on the object indication. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. An article of manufacture including a non-transitory computer-readable medium having stored thereon instructions that, when executed by a processor in a vehicle system, causes the vehicle system to perform operations comprising:
-
receiving data by a set of sensors, wherein the data represents objects of an environment of an autonomous vehicle; determining based on the received data, at least one object of the environment that has a detection confidence below a threshold, wherein the detection confidence is indicative of a likelihood that the determined object is correctly identified in the environment; and based on the at least one object having a detection confidence below the threshold; communicating, from the received data, image data of the at least one object for further processing to a remote operator, determining at least one natural-language question associated with the at least one object having a detection confidence below the threshold, communicating the at least one natural-language question to the remote operator, receiving an answer to the at least one natural-language question from the remote operator providing an object indication, and providing instructions to control the autonomous vehicle by the control system based on the object indication. - View Dependent Claims (18, 19, 20)
-
-
21. A method comprising:
-
determining, by a processor, based on received data, a preliminary identification of at least one object of the environment; operating an autonomous vehicle by a control system, based on the preliminary identification; and determining, by a processor the at least one object of the environment that has a detection confidence below a threshold, wherein the detection confidence indicates a likelihood that the determined object is present in the environment; and based on the at least one object having a detection confidence below the threshold, the processor; communicating, from the received data, image data of the at least one object for further processing to a remote operator, determining at least one natural-language question associated with the at least one object having a detection confidence below the threshold, communicating the at least one natural-language question to the remote operator, receiving an answer to the at least one natural-language question from the remote operator providing a corrected identification, and providing instructions to control the autonomous vehicle by the control system based on the corrected identification. - View Dependent Claims (22, 23, 24)
-
Specification