Vehicle control system with target vehicle trajectory tracking

• US 10,407,047 B2
• Filed: 12/06/2016
• Issued: 09/10/2019
• Est. Priority Date: 12/07/2015
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Johnson, Nathaniel S., Powar, Gayatri U.
• Primary Examiner(s): Do, Truc M
• Application Number:
  US15/369,921
• Publication Number:
  US 20170158197A1
• Time in Patent Office: 1,008 Days
• CPC Class Codes: B60W 10/18 including control of braking systems
• CPC Class Codes: B60W 10/20 including control of steering systems
• CPC Class Codes: B60W 2520/10 Longitudinal speed
• CPC Class Codes: B60W 2520/14 Yaw
• CPC Class Codes: B60W 2554/4041 Position
• CPC Class Codes: B60W 2554/803 Relative lateral speed
• CPC Class Codes: B60W 2554/804 Relative longitudinal speed
• CPC Class Codes: B60W 30/095 Predicting travel path or likelihood of collision
• CPC Class Codes: B60W 30/0953 the prediction being responsive to vehicle dynamic parameters
• CPC Class Codes: B60W 30/0956 the prediction being responsive to traffic or environmental parameters

Abstract

A driver assistance system of an equipped vehicle includes at least one camera disposed at the equipped vehicle so as to have a field of view exterior of the equipped vehicle. A control has an image processor operable to process frames of image data captured by the camera. The image processor processes frames of captured image data to determine a target vehicle present in the field of view of the camera and to determine motion of the determined target vehicle relative to the equipped vehicle. The control, responsive to processing frames of captured image data via the image processor, determines a path of travel of the determined target vehicle relative to the equipped vehicle as the equipped vehicle is moving. The control translates the determined motion of the target vehicle to a local coordinate system of the equipped vehicle.

Claims

1. A driver assistance system of a vehicle, said driver assistance system comprising:

at least one camera configured to be disposed at a vehicle equipped with said driver assistance system so as to have a field of view exterior of the equipped vehicle;

a control having an image processor operable to process frames of image data captured by said camera;

wherein, with said at least one camera disposed at the equipped vehicle, said image processor processes frames of captured image data to determine a target vehicle present in the field of view of said camera and to determine motion of the determined target vehicle relative to the equipped vehicle;

wherein said control, responsive to processing frames of captured image data via said image processor with said at least one camera disposed at the equipped vehicle, determines a path of travel of the determined target vehicle relative to the equipped vehicle as the equipped vehicle is moving;

wherein said control translates the determined motion of the target vehicle to a local coordinate system of the equipped vehicle; and

wherein said control controls the equipped vehicle to follow the determined path of travel of the target vehicle.

2. The driver assistance system of claim 1, wherein said control determines the relative path of travel of the determined target vehicle responsive to determined changes in location of the determined target vehicle relative to the equipped vehicle.

3. The driver assistance system of claim 1, wherein said control determines the relative path of travel of the determined target vehicle responsive to determined changes in speed of the determined target vehicle relative to the equipped vehicle.

4. The driver assistance system of claim 1, wherein said control controls the equipped vehicle to follow the determined path of travel of the target vehicle by controlling a steering system of the equipped vehicle, a braking system of the equipped vehicle and an accelerator system of the equipped vehicle.

5. The driver assistance system of claim 1, wherein said control controls the equipped vehicle to follow the determined path of travel of the target vehicle by controlling at least one selected from the group consisting of a steering system of the equipped vehicle, a braking system of the equipped vehicle and an accelerator system of the equipped vehicle.

6. The driver assistance system of claim 1, wherein said control updates the local coordinate system of the equipped vehicle as the equipped vehicle moves.

7. The driver assistance system of claim 6, wherein said control determines motion of the equipped vehicle via the equipped vehicle'"'"'s velocity and yaw rate.

8. The driver assistance system of claim 1, wherein, responsive to processing frames of captured image data via said image processor with said at least one camera disposed at the equipped vehicle, said control updates the determined motion of the target vehicle to the local coordinate system of the equipped vehicle as both the target vehicle and the equipped vehicle move so the determined motion of the target vehicle remains in the local coordinate system as the equipped vehicle moves.

9. The driver assistance system of claim 1, wherein, responsive to processing frames of captured image data via said image processor with said at least one camera disposed at the equipped vehicle, said control determines a plurality of positions of the determined target vehicle along the determined path of travel of the determined target vehicle relative to the equipped vehicle as the equipped vehicle is moving, and wherein the plurality of positions are stored in memory so a trajectory of the determined target vehicle can be determined.

10. The driver assistance system of claim 9, wherein said control stores a position of the determined target vehicle only when the determined position of the target vehicle is at least a threshold distance from the previously stored position.

11. The driver assistance system of claim 1, wherein, responsive to the determined motion of the target vehicle translated to the local coordinate system, said control maneuvers the equipped vehicle to follow the determined target vehicle.

12. The driver assistance system of claim 1, wherein said control is operable to maneuver the equipped vehicle responsive to a GPS system, and wherein, responsive to loss of GPS system signal and responsive to the determined motion of the target vehicle translated to the local coordinate system, said control maneuvers the equipped vehicle to follow the determined target vehicle.

13. The driver assistance system of claim 1, wherein said control translates the determined motion of the target vehicle to the local coordinate system of the equipped vehicle using a relative longitudinal position of the target vehicle and a relative lateral position of the target vehicle.

14. A driver assistance system of a vehicle, said driver assistance system comprising:

at least one camera configured to be disposed at a vehicle equipped with said driver assistance system so as to have a field of view exterior of the equipped vehicle;

a control having an image processor operable to process frames of image data captured by said camera;

wherein, with said at least one camera disposed at the equipped vehicle, said image processor processes frames of captured image data to determine a target vehicle present in the field of view of said camera and to determine motion of the determined target vehicle relative to the equipped vehicle;

wherein said control, responsive to processing frames of captured image data via said image processor with said at least one camera disposed at the equipped vehicle, determines a path of travel of the determined target vehicle relative to the equipped vehicle as the equipped vehicle is moving;

wherein said control translates the determined motion of the target vehicle to a local coordinate system of the equipped vehicle;

wherein said control determines the relative path of travel of the determined target vehicle responsive to determined changes in location of the determined target vehicle relative to the equipped vehicle;

wherein, responsive to processing frames of captured image data via said image processor with said at least one camera disposed at the equipped vehicle, said control determines a plurality of positions of the determined target vehicle along the determined path of travel of the determined target vehicle relative to the equipped vehicle as the equipped vehicle is moving;

wherein the plurality of positions are stored in memory so a trajectory of the determined target vehicle can be determined; and

wherein said control stores a position of the determined target vehicle only when the determined position of the target vehicle is at least a threshold distance from the previously stored position.

15. The driver assistance system of claim 14, wherein said control updates the local coordinate system of the equipped vehicle as the equipped vehicle moves.

16. The driver assistance system of claim 14, wherein, responsive to processing frames of captured image data via said image processor with said at least one camera disposed at the equipped vehicle, said control updates the determined motion of the target vehicle to the local coordinate system of the equipped vehicle as both the target vehicle and the equipped vehicle move so the determined motion of the target vehicle remains in the local coordinate system as the equipped vehicle moves.

17. The driver assistance system of claim 14, wherein, responsive to the determined motion of the target vehicle translated to the local coordinate system, said control maneuvers the equipped vehicle to follow the determined target vehicle.

18. A driver assistance system of a vehicle, said driver assistance system comprising:

at least one camera configured to be disposed at a vehicle equipped with said driver assistance system so as to have a field of view exterior of the equipped vehicle;

a control having an image processor operable to process frames of image data captured by said camera;

wherein said control is operable to maneuver the equipped vehicle responsive to a GPS system of the equipped vehicle;

wherein, with said at least one camera disposed at the equipped vehicle, said image processor processes frames of captured image data to determine a target vehicle present in the field of view of said camera and to determine motion of the determined target vehicle relative to the equipped vehicle;

wherein said control, responsive to processing frames of captured image data via said image processor with said at least one camera disposed at the equipped vehicle, determines a path of travel of the determined target vehicle relative to the equipped vehicle as the equipped vehicle is moving;

wherein said control translates the determined motion of the target vehicle to a local coordinate system of the equipped vehicle;

wherein said control updates the local coordinate system of the equipped vehicle as the equipped vehicle moves; and

wherein, responsive to loss of GPS system signal and responsive to the determined motion of the target vehicle translated to the local coordinate system, said control maneuvers the equipped vehicle to follow the determined target vehicle.

19. The driver assistance system of claim 18, wherein said control determines motion of the equipped vehicle via the equipped vehicle'"'"'s velocity and yaw rate.

20. The driver assistance system of claim 18, wherein said control translates the determined motion of the target vehicle to the local coordinate system of the equipped vehicle using a relative longitudinal position of the target vehicle and a relative lateral position of the target vehicle.