VEHICLE VISION SYSTEM WITH OBJECT DETECTION VIA TOP VIEW SUPERPOSITION

• US 20130286193A1
• Filed: 03/20/2013
• Published: 10/31/2013
• Est. Priority Date: 03/21/2012
• Status: Abandoned Application

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Pflug, Goerg
• Application Number:
  US13/847,815
• Publication Number:
  US 20130286193A1
• Time in Patent Office: Days
• US Class Current: 348/135
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/002 specially adapted for covering the peripheral part of the vehicle, e.g. for viewing tyres, bumpers or the like integrated in the windows B60R1/001; combined with rear-view mirrors B60R1/08
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/304 using merged images, e.g. merging camera image with stored images
• CPC Class Codes: B60R 2300/307 virtually distinguishing relevant parts of a scene from the background of the scene
• CPC Class Codes: B60R 2300/8093 for obstacle warning

Abstract

A vehicle vision system includes at least two cameras having exterior fields of view and an image processor that processes captured image data and compares image data in overlapping regions of fields of views of two or more adjacent or neighboring cameras at a vehicle (such as a corner region near a corner of the vehicle where a portion of the field of view of a side camera of the vehicle overlaps a portion of the field of view of a front or rear camera of the vehicle). The system processes a common data sub-set and different data sub-sets of image data captured by the cameras at the overlapping regions, and processes the common data sub-set differently from the other data sub-sets. The system may generate a synthesized image derived from the data sub-sets for displaying images at a display screen for viewing by the driver of the vehicle.

Claims

1. A vehicle vision system comprising:

a first camera disposed at a first side of a vehicle equipped with said vehicle vision system and having a first field of view exterior and sideward of the equipped vehicle;

a second camera disposed at the equipped vehicle and having a second exterior field of view exterior of the equipped vehicle;

wherein said first field of view of said first camera overlaps said second field of view of said second camera at a first overlapping region;

wherein said second camera and said first camera are operable to capture image data indicative of an object located at the first overlapping region;

wherein said first camera captures a first image data set of the object and said second camera captures a second image data set of the object;

wherein said first image data set and said second image data set both comprise a common sub-set of image data of the object;

wherein said first image data set further comprises a first sub-set of image data of the object and wherein said second image data set further comprises a second sub-set of image data of the object;

wherein both said first sub-set of image data of the object and said second sub-set of image data of the object differ from said common sub-set of image data of the object;

wherein said first sub-set of image data of the object differs from said second sub-set of image data of the object;

wherein an image processor processes said common sub-set of image data of the object, said first sub-set of image data of the object and said second sub-set of image data of the object;

wherein processing of said common sub-set of image data by said image processor differs from processing of said first sub-set of image data by said image processor and wherein processing of said common sub-set of image data by said image processor differs from processing of said second sub-set of image data by said image processor; and

wherein said image processor utilizes said common sub-set of image data of the object, said first sub-set of image data and said second sub-set of image data of the object to synthesize an image of the object for display on a display screen viewable in an interior cabin of the equipped vehicle by a driver normally operating the equipped vehicle.

2. The vehicle vision system of claim 1, wherein said image processor processes said first and second sub-sets of image data to determine an orientation of the object at the first overlapping region.

3. The vehicle vision system of claim 1, comprising a third camera disposed at a second side of the equipped vehicle and having a third field of view exterior and sideward of the equipped vehicle at an opposite side of the equipped vehicle from said first camera, wherein said third field of view of said third camera at least partially overlaps said second field of view of said second camera at a second overlapping region, and wherein said image processor is operable to process image data captured by said third camera.

4. The vehicle vision system of claim 3, comprising a fourth camera having a fourth field of view exterior of the equipped vehicle, wherein said fourth field of view at least partially overlaps said first field of view of said first camera at a third overlapping region and at least partially overlaps said third field of view of said third camera at a fourth overlapping region, and wherein said image processor is operable to process image data captured by said fourth camera.

5. The vehicle vision system of claim 4, wherein each of said cameras includes a wide angle lens.

6. The vehicle vision system of claim 1, wherein said first sub-set of image data and said second sub-set of image data are processed by said image processor to determine at least one of (i) a vertical component of the object present in said first overlapping region and (ii) an edge of the object present in said first overlapping region.

7. The vehicle vision system of claim 6, wherein said vehicle vision system is operable to track an object that is determined to have a vertical component.

8. The vehicle vision system of claim 6, wherein said display screen comprises a video display screen for displaying video images derived from image data captured by at least said second camera, and wherein said vehicle vision system is operable to highlight objects.

9. The vehicle vision system of claim 1, wherein said vehicle vision system is operable to determine a distance between the equipped vehicle and the object present at said first overlapping region, and wherein said vehicle vision system is operable to generate an alert to the driver of the equipped vehicle responsive to the determined distance being less than a threshold distance.

10. The vehicle vision system of claim 1, wherein said first camera is disposed at an exterior rearview mirror assembly at the first side of the equipped vehicle.

11. A vehicle vision system comprising:

a first side camera disposed at a first side of a vehicle equipped with said vehicle vision system and having a first field of view exterior and sideward of the equipped vehicle;

a rear camera disposed at a rear portion of the equipped vehicle and having a second exterior field of view exterior and rearward of the equipped vehicle;

wherein said first field of view of said first camera overlaps said second field of view of said second camera at a first overlapping region;

wherein said rear camera and said first side camera are operable to capture image data indicative of an object located at the first overlapping region;

wherein said first side camera captures a first image data set of the object and said rear camera captures a second image data set of the object;

wherein said first image data set and said second image data set both comprise a common sub-set of image data of the object;

wherein said first image data set further comprises a first sub-set of image data of the object and wherein said second image data set further comprises a second sub-set of image data of the object;

wherein both said first sub-set of image data of the object and said second sub-set of image data of the object differ from said common sub-set of image data of the object;

wherein said first sub-set of image data of the object differs from said second sub-set of image data of the object;

wherein an image processor processes said common sub-set of image data of the object, said first sub-set of image data of the object and said second sub-set of image data of the object;

wherein processing of said common sub-set of image data by said image processor differs from processing of said first sub-set of image data by said image processor and wherein processing of said common sub-set of image data by said image processor differs from processing of said second sub-set of image data by said image processor; and

wherein said image processor utilizes said common sub-set of image data of the object, said first sub-set of image data and said second sub-set of image data of the object to synthesize an image of the object for display on a display screen viewable in an interior cabin of the equipped vehicle by a driver normally operating the equipped vehicle.

12. The vehicle vision system of claim 11, wherein said first sub-set of image data and said second sub-set of image data are processed by said image processor to determine at least one of (i) a vertical component of the object present in said first overlapping region and (ii) an edge of the object present in said first overlapping region.

13. The vehicle vision system of claim 12, wherein said vehicle vision system is operable to track an object that is determined to have a vertical component.

14. The vehicle vision system of claim 11, wherein said display screen comprises a video display screen for displaying images captured by said second camera during a reversing maneuver of the vehicle.

15. The vehicle vision system of claim 14, wherein said system emphasizes an object present in the overlapping region, such as via a graphic overlay or via coloring the object so as to highlight the object as displayed by said video display.

16. A vehicle vision system comprising:

a first camera disposed at the equipped vehicle and having a first field of view exterior of the equipped vehicle;

a second camera disposed at the equipped vehicle and having a second field of view exterior of the equipped vehicle;

a third camera disposed at the equipped vehicle and having a third field of view exterior of the equipped vehicle;

a fourth camera disposed at the equipped vehicle and having a fourth field of view exterior of the equipped vehicle;

wherein said first field of view of said first camera overlaps said second field of view of said second camera at a first overlapping region and wherein said second field of view of said second camera overlaps said third field of view of said third camera at a second overlapping region and wherein said third field of view of said third camera overlaps said fourth field of view of said fourth camera at a third overlapping region and wherein said fourth field of view of said fourth camera overlaps said first field of view of said first camera at a fourth overlapping region;

wherein said second camera and said first camera are operable to capture image data indicative of an object located at the first overlapping region;

wherein said first camera captures a first image data set of the object and said second camera captures a second image data set of the object;

wherein said first image data set and said second image data set both comprise a common sub-set of image data of the object;

wherein said first image data set further comprises a first sub-set of image data of the object and wherein said second image data set further comprises a second sub-set of image data of the object;

wherein both said first sub-set of image data of the object and said second sub-set of image data of the object differ from said common sub-set of image data of the object;

wherein said first sub-set of image data of the object differs from said second sub-set of image data of the object;

wherein an image processor processes said common sub-set of image data of the object, said first sub-set of image data of the object and said second sub-set of image data of the object;

wherein processing of said common sub-set of image data by said image processor differs from processing of said first sub-set of image data by said image processor and wherein processing of said common sub-set of image data by said image processor differs from processing of said second sub-set of image data by said image processor; and

wherein said image processor utilizes said common sub-set of image data of the object, said first sub-set of image data and said second sub-set of image data of the object to synthesize an image of the object for display on a display screen viewable in an interior cabin of the equipped vehicle by a driver normally operating the equipped vehicle.

17. The vehicle vision system of claim 16, wherein said first sub-set of image data and said second sub-set of image data are processed by said image processor to determine at least one of (i) a vertical component of the object present in said first overlapping region and (ii) an edge of the object present in said first overlapping region.

18. The vehicle vision system of claim 17, wherein said vehicle vision system is operable to track an object that is determined to have a vertical component.

19. The vehicle vision system of claim 16, wherein one of said first, second, third and fourth cameras comprises a rear camera having a rearward field of view exterior of the equipped vehicle and another of said first, second, third and fourth cameras comprises a front camera having a forward field of view exterior of the equipped vehicle.

20. The vehicle vision system of claim 19, wherein the others of said first, second, third and fourth cameras comprise side cameras disposed at respective exterior rearview mirror assemblies at respective sides of the equipped vehicle and having respective sideward fields of view exterior of the equipped vehicle.