VEHICLE VISION SYSTEM WITH ACCELERATED OBJECT CONFIRMATION

• US 20130278769A1
• Filed: 03/22/2013
• Published: 10/24/2013
• Est. Priority Date: 03/23/2012
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Nix, Axel, Shonk, Carl W., Van Dan Elzen, Christopher L.
• Granted Patent: US 10,609,335 B2
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: B60R 1/24 in front of the vehicle
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 2300/301 combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/50 characterised by the display information being shared, e.g. external display, data transfer to other traffic participants or centralised traffic controller
• CPC Class Codes: G08G 1/161 Decentralised systems, e.g. inter-vehicle communication
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A vision system for a vehicle includes a camera and an image processor. The camera has a forward field of view exterior of the vehicle. The image processor is operable to process image data captured by the camera. At least one device is operable to detect objects that are present forward of the vehicle and outside of the forward field of view of the camera. The device may include at least one of (i) a sensor, (ii) an element of a vehicle-to-vehicle communication system and (iii) an element of a vehicle-to-infrastructure communication system. Responsive to detection of the object being indicative of the object about to enter the field of view of the camera, the image processor anticipates the object entering the field of view of the camera and, upon entering of the field of view of the camera by the object, the image processor detects the object.

Claims

1. A vision system for a vehicle, said vision system comprising:

a camera disposed at a vehicle equipped with said vision system and having a forward field of view exterior of the equipped vehicle;

an image processor operable to process image data captured by said camera;

at least one device operable to detect an object present forward of the equipped vehicle and outside of the forward field of view of said camera;

wherein said at least one device comprises at least one of (i) a sensor, (ii) an element of a vehicle-to-vehicle communication system and (iii) an element of a vehicle-to-infrastructure communication system; and

wherein, responsive to detection of the object by said at least one device being indicative of the object about to enter the forward field of view of said camera, said image processor anticipates the object entering the forward field of view of said camera and wherein, upon entering of the forward field of view of said camera by the object, said image processor detects the object.

2. The vision system of claim 1, wherein said at least one device comprises a sensor that is part of the equipped vehicle.

3. The vision system of claim 2, wherein said sensor comprises a non-vision based sensor.

4. The vision system of claim 2, wherein said sensor comprises at one of (i) a radar sensor and (ii) a lidar sensor.

5. The vision system of claim 2, wherein said sensor has a field of sensing that encompasses a portion of the field of view of said camera.

6. The vision system of claim 1, wherein said at least one device comprises at least one of an element of a vehicle-to-vehicle communication system and an element of a vehicle-to-infrastructure communication system.

7. The vision system of claim 6, comprising a vehicle interface processor that receives a communication from said at least one device and receives tracking information from said image processor, and wherein said vehicle interface processor communicates hypothesis information to said image processor for accelerated object detection.

8. The vision system of claim 1, wherein information about objects present outside the forward field of view of said camera is communicated to said image processor via a vehicle interface processor.

9. The vision system of claim 1, wherein said vision system, responsive to the output of said at least one device, is operable to determine if an object is present in a field of sensing of said at least one device and to determine if the detected object is likely to enter the forward field of view of said camera.

10. The vision system of claim 9, wherein, responsive to a determination that an object is likely to enter the forward field of view of said camera, said image processor is operable to provide enhanced detection of the object as it enters the forward field of view of said camera.

11. A vision system for a vehicle, said vision system comprising:

a camera disposed at a vehicle equipped with said vision system and having a forward field of view exterior of the equipped vehicle;

an image processor operable to process image data captured by said camera;

at least one device operable to detect an object present forward of the equipped vehicle and outside of the forward field of view of said camera;

wherein said at least one device comprises at least one of (i) a sensor, (ii) an element of a vehicle-to-vehicle communication system and (iii) an element of a vehicle-to-infrastructure communication system;

wherein, responsive to detection of the object by said at least one device being indicative of the object about to enter the forward field of view of said camera, said image processor anticipates the object entering the forward field of view of said camera and wherein, upon entering of the forward field of view of said camera by the object, said image processor detects the object;

a vehicle interface processor that receives a communication from said at least one device and receives tracking information from said image processor, and wherein said vehicle interface processor communicates hypothesis information to said image processor for accelerated object detection; and

wherein said vision system, responsive to the output of said at least one device, is operable to determine if an object is present in a field of sensing of said at least one device and to determine if the detected object is likely to enter the forward field of view of said camera.

12. The vision system of claim 11, wherein said at least one device comprises a sensor that is part of the equipped vehicle.

13. The vision system of claim 12, wherein said sensor comprises a non-vision based sensor, and wherein said sensor comprises at one of (i) a radar sensor and (ii) a lidar sensor.

14. The vision system of claim 12, wherein said sensor has a field of sensing that encompasses a portion of the field of view of said camera.

15. The vision system of claim 11, wherein said at least one device comprises at least one of an element of a vehicle-to-vehicle communication system and an element of a vehicle-to-infrastructure communication system.

16. The vision system of claim 11, wherein, responsive to a determination that an object is likely to enter the forward field of view of said camera, said image processor is operable to provide enhanced detection of the object as it enters the forward field of view of said camera.

19. The vision system of claim 11, wherein, responsive at least in part to at least one of a vehicle-to-vehicle communication system and an element of a vehicle-to-infrastructure communication system, said vision system is operable to determine if an object is present in the field of sensing of said at least one device and to determine if the detected object is likely to enter the forward field of view of said camera.

20. The vision system of claim 11, wherein said vision system, responsive to the output of said sensor, is operable to determine if an object is present in the field of sensing of said sensor and to determine if the detected object is likely to enter the forward field of view of said camera, and wherein, responsive to a determination that the object is likely to enter the forward field of view of said camera, said image processor is operable to provide enhanced detection of the object as it enters the forward field of view of said camera.

17. A vision system for a vehicle, said vision system comprising:

a camera disposed at a vehicle equipped with said vision system and having a forward field of view exterior of the equipped vehicle;

an image processor operable to process image data captured by said camera;

at least one sensor of the vehicle is operable to detect an object present forward of the equipped vehicle and outside of the forward field of view of said camera;

wherein said sensor has a field of sensing that encompasses a portion of the field of view of said camera; and

wherein, responsive to detection of the object by said at least one sensor being indicative of the object about to enter the forward field of view of said camera, said image processor anticipates the object entering the forward field of view of said camera and wherein, upon entering of the forward field of view of said camera by the object, said image processor detects the object.

18. The vision system of claim 17, wherein said sensor comprises a non-vision based sensor, and wherein said sensor comprises at one of (i) a radar sensor and (ii) a lidar sensor.