Automated driving system that merges heterogenous sensor data
First Claim
1. An automated driving system for a vehicle, the system comprising:
- a first sensor providing first sensor data about an object of interest, wherein the first sensor data comprises 3D characteristics;
a second sensor providing second sensor data about the object of interest, wherein the first and second sensors are different types of sensors, wherein the second sensor data comprises 2D characteristics; and
a processor communicatively coupled to the first sensor and the second sensor, wherein the processor is configured to;
process the first and second sensor data for the object of interest by transforming the first or second sensor data into a common coordinate system, by comparing similarities between the characteristics of the object of interest and a fused object in the common coordinate system to determine if the object of interest and the fused object match, and augmenting the fused object with the characteristics of the object of interest if the object of interest and the fused object match; and
generate one or more drive control signals to control a motion of the vehicle in response to the fused object.
3 Assignments
0 Petitions
Accused Products
Abstract
An automated driving system comprising a first sensor providing first sensor data, a second sensor providing second sensor data, wherein the first and second sensors are different types of sensors and a processor communicatively coupled to the first sensor and the second sensor. The processor is configured to transform the first and second sensor data into a common three-dimensional coordinate system to create a representation of an image for a field of view corresponding to a direction of travel, identify one or more objects in the field of view, and generate one or more drive control signals to control a motion of the vehicle in response to the one or more objects in the field of view.
-
Citations
15 Claims
-
1. An automated driving system for a vehicle, the system comprising:
-
a first sensor providing first sensor data about an object of interest, wherein the first sensor data comprises 3D characteristics; a second sensor providing second sensor data about the object of interest, wherein the first and second sensors are different types of sensors, wherein the second sensor data comprises 2D characteristics; and a processor communicatively coupled to the first sensor and the second sensor, wherein the processor is configured to; process the first and second sensor data for the object of interest by transforming the first or second sensor data into a common coordinate system, by comparing similarities between the characteristics of the object of interest and a fused object in the common coordinate system to determine if the object of interest and the fused object match, and augmenting the fused object with the characteristics of the object of interest if the object of interest and the fused object match; and generate one or more drive control signals to control a motion of the vehicle in response to the fused object. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A non-transitory computer-readable medium comprising instructions in code which when loaded into a memory and executed by a processor of a vehicle cause the processor to:
-
receive first sensor data about an object of interest from a first sensor, wherein the first sensor data comprises 3D characteristics; receive second sensor data about the object of interest from a second sensor of a type different from the first sensor, wherein the second sensor data comprises 2D characteristics; process the first and second sensor data for the object of interest by transforming the first or second sensor data into a common coordinate system, by comparing similarities between the characteristics of the object of interest and a fused object in the common coordinate system to determine if the object of interest and the fused object match, and augmenting the fused object with the characteristics of the object of interest if the object of interest and the fused object match; and generate one or more drive control signals to control a motion of the vehicle in response to the fused object. - View Dependent Claims (7, 8, 9, 10)
-
-
11. A vehicle comprising:
-
a powertrain; a braking system; a steering system; an automated driving system for at least partially controlling one or more of the powertrain, braking system and steering system; wherein the automated driving system includes; a first sensor providing first sensor data about an object of interest, wherein the first sensor data comprises 3D characteristics; a second sensor providing second sensor data about the object of interest, wherein the first and second sensors are different types of sensors, wherein the first sensor data comprises 2D characteristics; and a processor communicatively coupled to the first sensor and the second sensor, wherein the processor is configured to; process the first and second sensor data for the object of interest by transforming the first or second sensor data into a common coordinate system to compare similarities between the characteristics of the object of interest and a fused object in the common coordinate system to determine if the object of interest and the fused object match, and augmenting the fused object with the characteristics of the object of interest if the object of interest and the fused object match; and generate one or more drive control signals to control a motion of the vehicle in response to the fused object. - View Dependent Claims (12, 13, 14, 15)
-
Specification