System and method for evaluating the perception system of an autonomous vehicle
First Claim
1. A method for optimizing object detection performed by autonomous vehicles, the method comprising:
- receiving, by one or more computing devices having one or more processors, sensor data captured by a sensor of an autonomous vehicle, wherein the sensor data includes one or more first object labels applied by the autonomous vehicle, each of the one or more first object labels corresponding to an object of the sensor data;
receiving, by the one or more computing devices, one or more second object labels not applied by the autonomous vehicle for the sensor data;
determining, by the one or more computing devices, a difference between a first value for the one or more first object labels applied by the autonomous vehicle and a second value for the one or more second object labels;
comparing, by the one or more computing devices, the determined differences to a threshold value, wherein the threshold value is selected based on a type of sensor that generated the sensor data; and
generating, by the one or more computing devices, a recommendation for an adjustment of at least one object detection parameter of at least one of a plurality of sensors based on the comparison in order to optimize object detection.
3 Assignments
0 Petitions
Accused Products
Abstract
A method and apparatus are provided for optimizing one or more object detection parameters used by an autonomous vehicle to detect objects in images. The autonomous vehicle may capture the images using one or more sensors. The autonomous vehicle may then determine object labels and their corresponding object label parameters for the detected objects. The captured images and the object label parameters may be communicated to an object identification server. The object identification server may request that one or more reviewers identify objects in the captured images. The object identification server may then compare the identification of objects by reviewers with the identification of objects by the autonomous vehicle. Depending on the results of the comparison, the object identification server may recommend or perform the optimization of one or more of the object detection parameters.
294 Citations
20 Claims
-
1. A method for optimizing object detection performed by autonomous vehicles, the method comprising:
-
receiving, by one or more computing devices having one or more processors, sensor data captured by a sensor of an autonomous vehicle, wherein the sensor data includes one or more first object labels applied by the autonomous vehicle, each of the one or more first object labels corresponding to an object of the sensor data; receiving, by the one or more computing devices, one or more second object labels not applied by the autonomous vehicle for the sensor data; determining, by the one or more computing devices, a difference between a first value for the one or more first object labels applied by the autonomous vehicle and a second value for the one or more second object labels; comparing, by the one or more computing devices, the determined differences to a threshold value, wherein the threshold value is selected based on a type of sensor that generated the sensor data; and generating, by the one or more computing devices, a recommendation for an adjustment of at least one object detection parameter of at least one of a plurality of sensors based on the comparison in order to optimize object detection. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A method for optimizing object detection performed by autonomous vehicles, the method comprising:
-
receiving, by one or more computing devices having one or more processors, sensor data captured by a sensor of an autonomous vehicle, wherein the sensor data includes one or more first object labels applied by the autonomous vehicle, each of the one or more first object labels corresponding to an object of the sensor data; receiving, by the one or more computing devices, one or more second object labels not applied by the autonomous vehicle for the sensor data; determining, by the one or more computing devices, a difference between a first value indicating a quantity of the one or more first object labels applied by the autonomous vehicle and a second value indicating a quantity of the one or more second object labels; comparing, by the one or more computing devices, the determined differences to a threshold value, wherein the threshold value is selected based on a type of sensor that generated the sensor data; and generating, by the one or more computing devices, a recommendation for an adjustment of at least one object detection parameter of at least one of a plurality of sensors based on the comparison in order to optimize object detection. - View Dependent Claims (15, 16, 17, 18, 19, 20)
-
Specification