Minimizing incorrect sensor data associations for autonomous vehicles
First Claim
1. A method of minimizing incorrect associations of sensor data for an autonomous vehicle, the autonomous vehicle operating in a driving environment, a stationary object and a dynamic object being located in a forward portion of the driving environment, the method comprising:
- acquiring, using at least a radar sensor, a first sensor observation of the forward portion of the driving environment in which the dynamic object is located away from the stationary object, the first sensor observation including radar data for the dynamic object and the stationary object, acquiring the first sensor observation including;
transmitting one or more radar signals into the forward portion of the driving environment;
receiving one or more reflections of the one or more transmitted radar signals, whereby the one or more radar signals are reflected off of objects in the driving environment;
determining the location of the stationary object in the driving environment based on the radar data;
acquiring, using at least the radar sensor and a lidar sensor, a second sensor observation of the forward portion of the driving environment in which the dynamic object is located substantially near the determined location of the stationary object, the second sensor observation including radar data and lidar data for the dynamic object and the stationary object, the second sensor observation being subsequent to the first sensor observation, acquiring the second sensor observation including;
transmitting one or more radar signals into the forward portion of the driving environment;
receiving one or more reflections of the one or more transmitted radar signals, whereby the one or more radar signals are reflected off of objects in the driving environment;
transmitting one or more lidar signals into the forward portion of the driving environment;
receiving one or more reflections of the one or more transmitted lidar signals, whereby the one or more lidar signals are reflected off of objects in the driving environment; and
for the second sensor observation, preventing the lidar data of the dynamic object from being associated with radar data obtained substantially at the determined location of the stationary object.
2 Assignments
0 Petitions
Accused Products
Abstract
Minimizing incorrect associations of sensor data for an autonomous vehicle are described. A driving environment of the autonomous vehicle includes a stationary object and a dynamic object. Such objects can be detected by radar sensors and/or lidar sensors. In one example, a history of radar observation can be used to minimize incorrect sensor data associations. In such case, the location of a stationary object in the driving environment can be determined. When a dynamic object passes by the stationary object, lidar data of the dynamic object is prevented from being associated with radar data obtained substantially at the determined location of the stationary object. In another example, identifiers assigned to radar data can be used to minimize incorrect sensor data associations. In such case, lidar data of an object can be associated with radar data having a particular identifier.
13 Citations
20 Claims
-
1. A method of minimizing incorrect associations of sensor data for an autonomous vehicle, the autonomous vehicle operating in a driving environment, a stationary object and a dynamic object being located in a forward portion of the driving environment, the method comprising:
-
acquiring, using at least a radar sensor, a first sensor observation of the forward portion of the driving environment in which the dynamic object is located away from the stationary object, the first sensor observation including radar data for the dynamic object and the stationary object, acquiring the first sensor observation including; transmitting one or more radar signals into the forward portion of the driving environment; receiving one or more reflections of the one or more transmitted radar signals, whereby the one or more radar signals are reflected off of objects in the driving environment; determining the location of the stationary object in the driving environment based on the radar data; acquiring, using at least the radar sensor and a lidar sensor, a second sensor observation of the forward portion of the driving environment in which the dynamic object is located substantially near the determined location of the stationary object, the second sensor observation including radar data and lidar data for the dynamic object and the stationary object, the second sensor observation being subsequent to the first sensor observation, acquiring the second sensor observation including; transmitting one or more radar signals into the forward portion of the driving environment; receiving one or more reflections of the one or more transmitted radar signals, whereby the one or more radar signals are reflected off of objects in the driving environment; transmitting one or more lidar signals into the forward portion of the driving environment; receiving one or more reflections of the one or more transmitted lidar signals, whereby the one or more lidar signals are reflected off of objects in the driving environment; and for the second sensor observation, preventing the lidar data of the dynamic object from being associated with radar data obtained substantially at the determined location of the stationary object. - View Dependent Claims (2, 3, 4)
-
-
5. A method of minimizing incorrect associations of sensor data for an autonomous vehicle, the autonomous vehicle operating in a driving environment, a stationary object and a dynamic object being located in a forward portion of the driving environment, the method comprising:
-
acquiring a first sensor observation of the forward portion of the driving environment in which the dynamic object is located away from the stationary object, the first sensor observation including radar data for the dynamic object and the stationary object; determining the location of the stationary object in the driving environment based on the radar data; acquiring a second sensor observation of the forward portion of the driving environment in which the dynamic object is located substantially near the determined location of the stationary object, the second sensor observation including radar data and lidar data for the dynamic object and the stationary object, the second sensor observation being subsequent to the first sensor observation; for the second sensor observation, preventing the lidar data of the dynamic object from being associated with radar data obtained substantially at the determined location of the stationary object; determining a driving maneuver for the autonomous vehicle based at least partially on the lidar data of the dynamic object that is prevented from being associated with radar data obtained substantially at the determined location of the stationary object; and causing the autonomous vehicle to implement the determined driving maneuver. - View Dependent Claims (6)
-
-
7. A system for minimizing incorrect associations of sensor data for an autonomous vehicle, the autonomous vehicle operating in a driving environment, a stationary object and a dynamic object being located in a forward portion of the driving environment, the system comprising:
-
a sensor system including a radar sensor and a lidar sensor, the sensor system being configured to; acquire, using at least the radar sensor, a first sensor observation of a forward portion of the driving environment in which the dynamic object is located away from the stationary object, the first sensor observation including radar data for the dynamic object and the stationary object, acquiring the first sensor observation including; transmitting one or more radar signals into the forward portion of the driving environment; receiving one or more reflections of the one or more transmitted radar signals, whereby the one or more radar signals are reflected off of objects in the driving environment; and acquire, using at least the radar sensor and the lidar sensor, a second sensor observation of the forward portion of the driving environment in which the dynamic object is located substantially near the stationary object, the second sensor observation including radar data and lidar data for the dynamic object and the stationary object, the second sensor observation being subsequent to the first sensor observation, acquiring the second sensor observation including; transmitting one or more radar signals into the forward portion of the driving environment; receiving one or more reflections of the one or more transmitted radar signals, whereby the one or more radar signals are reflected off of objects in the driving environment; transmitting one or more lidar signals into the forward portion of the driving environment; receiving one or more reflections of the one or more transmitted lidar signals, whereby the one or more lidar signals are reflected off of objects in the driving environment; and a processor operatively connected to the sensor system, the processor being programmed to initiate executable operations including; for the first sensor observation, determining the location of the stationary object in the driving environment based on the radar data; and for the second sensor observation, preventing the lidar data of the dynamic object from being associated with radar data obtained substantially at the determined location of the stationary object. - View Dependent Claims (8, 9, 10)
-
-
11. A system for minimizing incorrect associations of sensor data for an autonomous vehicle, the autonomous vehicle operating in a driving environment, a stationary object and a dynamic object being located in a forward portion of the driving environment, the system comprising:
-
a sensor system including a radar sensor and a lidar sensor, the sensor system being configured to; acquire a first sensor observation of a forward portion of the driving environment in which the dynamic object is located away from the stationary object, the first sensor observation including radar data for the dynamic object and the stationary object; and acquire a second sensor observation of the forward portion of the driving environment in which the dynamic object is located substantially near the stationary object, the second sensor observation including radar data and lidar data for the dynamic object and the stationary object, the second sensor observation being subsequent to the first sensor observation; and a processor operatively connected to the sensor system, the processor being programmed to initiate executable operations including; for the first sensor observation, determining the location of the stationary object in the driving environment based on the radar data; for the second sensor observation, preventing the lidar data of the dynamic object from being associated with radar data obtained substantially at the determined location of the stationary object; determining a driving maneuver for the autonomous vehicle based at least partially on the lidar data of the dynamic object that is prevented from being associated with radar data obtained substantially at the determined location of the stationary object; and causing the autonomous vehicle to implement the determined driving maneuver. - View Dependent Claims (12)
-
-
13. A method of minimizing incorrect associations of sensor data for an autonomous vehicle, the autonomous vehicle operating in a driving environment, a stationary object and a dynamic object being located in a forward portion of the driving environment, the method comprising:
-
acquiring, using at least a radar sensor and a lidar sensor, a first sensor observation of the forward portion of the driving environment, the first sensor observation including radar data and lidar data for the dynamic object and the stationary object, a first identifier being assigned to the radar data for the dynamic object and a second identifier being assigned to the radar data for the stationary object, acquiring the first sensor observation including; transmitting one or more radar signals into the forward portion of the driving environment; receiving one or more reflections of the one or more transmitted radar signals, whereby the one or more radar signals are reflected off of objects in the driving environment; transmitting one or more lidar signals into the forward portion of the driving environment; receiving one or more reflections of the one or more transmitted lidar signals, whereby the one or more lidar signals are reflected off of objects in the driving environment; for the first sensor observation, associating the lidar data of the dynamic object with the radar data having the first identifier assigned thereto; for the first sensor observation, associating the lidar data of the stationary object with the radar data having the second identifier assigned thereto; acquiring, using at least the radar sensor and the lidar sensor, a second sensor observation of the forward portion of the driving environment, the second sensor observation including radar data and lidar data for the dynamic object and the stationary object, the second sensor observation being subsequent to the first sensor observation, the first identifier being assigned to the radar data for the dynamic object and the second identifier being assigned to the radar data for the stationary object, acquiring the second sensor observation including; transmitting one or more radar signals into the forward portion of the driving environment; receiving one or more reflections of the one or more transmitted radar signals, whereby the one or more radar signals are reflected off of objects in the driving environment; transmitting one or more lidar signals into the forward portion of the driving environment; and receiving one or more reflections of the one or more transmitted lidar signals, whereby the one or more lidar signals are reflected off of objects in the driving environment; and for the second sensor observation, associating the lidar data of the dynamic object with only radar data with the first identifier assigned thereto. - View Dependent Claims (14, 15)
-
-
16. A method of minimizing incorrect associations of sensor data for an autonomous vehicle, the autonomous vehicle operating in a driving environment, a stationary object and a dynamic object being located in a forward portion of the driving environment, the method comprising:
-
acquiring a first sensor observation of the forward portion of the driving environment, the first sensor observation including radar data and lidar data for the dynamic object and the stationary object, a first identifier being assigned to the radar data for the dynamic object and a second identifier being assigned to the radar data for the stationary object; for the first sensor observation, associating the lidar data of the dynamic object with the radar data having the first identifier assigned thereto; for the first sensor observation, associating the lidar data of the stationary object with the radar data having the second identifier assigned thereto; acquiring a second sensor observation of the forward portion of the driving environment, the second sensor observation including radar data and lidar data for the dynamic object and the stationary object, the second sensor observation being subsequent to the first sensor observation, the first identifier being assigned to the radar data for the dynamic object and the second identifier being assigned to the radar data for the stationary object; for the second sensor observation, associating the lidar data of the dynamic object with only radar data with the first identifier assigned thereto; determining a driving maneuver for the autonomous vehicle based at least partially on the lidar data of the dynamic object with only radar data with the first identifier assigned thereto; and causing the autonomous vehicle to implement the determined driving maneuver.
-
-
17. A system for minimizing incorrect associations of sensor data for an autonomous vehicle, the autonomous vehicle operating in a driving environment, a stationary object and a dynamic object being located in a forward portion of the driving environment, the system comprising:
a sensor system including a radar sensor and a lidar sensor, the sensor system being configured to; acquire, using at least the radar sensor and the lidar sensor, a first sensor observation of the forward portion of the driving environment, the first sensor observation including radar data and lidar data for the dynamic object and the stationary object, a first identifier being assigned to the radar data for the dynamic object and a second identifier being assigned to the radar data for the stationary object, acquiring the first sensor observation including; transmitting one or more radar signals into the forward portion of the driving environment; receiving one or more reflections of the one or more transmitted radar signals, whereby the one or more radar signals are reflected off of objects in the driving environment; transmitting one or more lidar signals into the forward portion of the driving environment; receiving one or more reflections of the one or more transmitted lidar signals, whereby the one or more lidar signals are reflected off of objects in the driving environment; acquire, using at least the radar sensor and the lidar sensor, a second sensor observation of the forward portion of the driving environment, the second sensor observation including radar data and lidar data for the dynamic object and the stationary object, the second sensor observation being subsequent to the first sensor observation, the first identifier being assigned to the radar data for the dynamic object and the second identifier being assigned to the radar data for the stationary object, acquiring the second sensor observation including; transmitting one or more radar signals into the forward portion of the driving environment; receiving one or more reflections of the one or more transmitted radar signals, whereby the one or more radar signals are reflected off of objects in the driving environment; transmitting one or more lidar signals into the forward portion of the driving environment; and receiving one or more reflections of the one or more transmitted lidar signals, whereby the one or more lidar signals are reflected off of objects in the driving environment; and a processor operatively connected to the sensor system, the processor being programmed to initiate executable operations comprising; for the first sensor observation, associating the lidar data of the dynamic object with the radar data having the first identifier assigned thereto; for the first sensor observation, associating the lidar data of the stationary object with the radar data having the second identifier assigned thereto; and for the second sensor observation, associating the lidar data of the dynamic object with only radar data with the first identifier assigned thereto. - View Dependent Claims (18, 19)
-
20. A system for minimizing incorrect associations of sensor data for an autonomous vehicle, the autonomous vehicle operating in a driving environment, a stationary object and a dynamic object being located in a forward portion of the driving environment, the system comprising:
-
a sensor system including a radar sensor and a lidar sensor, the sensor system being configured to; acquire a first sensor observation of the forward portion of the driving environment, the first sensor observation including radar data and lidar data for the dynamic object and the stationary object, a first identifier being assigned to the radar data for the dynamic object and a second identifier being assigned to the radar data for the stationary object; acquire a second sensor observation of the forward portion of the driving environment, the second sensor observation including radar data and lidar data for the dynamic object and the stationary object, the second sensor observation being subsequent to the first sensor observation, the first identifier being assigned to the radar data for the dynamic object and the second identifier being assigned to the radar data for the stationary object; a processor operatively connected to the sensor system, the processor being programmed to initiate executable operations comprising; for the first sensor observation, associating the lidar data of the dynamic object with the radar data having the first identifier assigned thereto; for the first sensor observation, associating the lidar data of the stationary object with the radar data having the second identifier assigned thereto; for the second sensor observation, associating the lidar data of the dynamic object with only radar data with the first identifier assigned thereto; determining a driving maneuver for the autonomous vehicle based at least partially on the lidar data of the dynamic object and the radar data with the first identifier assigned thereto; and causing the autonomous vehicle to implement the determined driving maneuver.
-
Specification