Vehicle vision system with customized display

• US 9,762,880 B2
• Filed: 12/07/2012
• Issued: 09/12/2017
• Est. Priority Date: 12/09/2011
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Pflug, Goerg
• Primary Examiner(s): Nawaz, Talha M
• Application Number:
  US14/362,636
• Publication Number:
  US 20140333729A1
• Time in Patent Office: 1,740 Days
• Field of Search: None
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 15/50 Lighting effects
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 2207/30264 Parking
• CPC Class Codes: G06T 2210/62 Semi-transparency
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G06T 7/80 Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
• CPC Class Codes: H04N 13/106 Processing image signals for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/15 for colour aspects of image signals

Abstract

A vehicle vision system includes a plurality of cameras having respective fields of view exterior of the vehicle. A processor is operable to process image data captured by the cameras and to generate images of the environment surrounding the vehicle. The processor is operable to generate a three dimensional vehicle representation of the vehicle. A display screen is operable to display the generated images of the environment surrounding the vehicle and to display the generated vehicle representation of the equipped vehicle as would be viewed from a virtual camera viewpoint. At least one of (a) a degree of transparency of at least a portion of the displayed vehicle representation is adjustable by the system, (b) the vehicle representation comprises a vector model and (c) the vehicle representation comprises a shape, body type, body style and/or color corresponding to that of the actual equipped vehicle.

Claims

1. A vision system for a vehicle, said vision system comprising:

a plurality of cameras disposed at a vehicle equipped with said vision system, wherein said plurality of cameras have respective fields of view exterior of the equipped vehicle;

a processor operable to process image data captured by said cameras, wherein said processor processes captured image data to generate images of an environment at least partially surrounding the equipped vehicle;

wherein said processor is operable to generate a three dimensional vehicle representation of the equipped vehicle;

a display screen viewable by a driver of the equipped vehicle, wherein said display screen is operable to display the generated images of the environment and to display the three dimensional vehicle representation of the equipped vehicle as would be viewed from a virtual camera viewpoint exterior to and higher than the equipped vehicle itself;

wherein the three dimensional vehicle representation comprises a body type corresponding to that of the equipped vehicle and at least one of (i) a body style corresponding to that of the equipped vehicle and (ii) a color corresponding to that of the actual equipped vehicle; and

wherein a portion of the three dimensional vehicle representation is rendered as displayed to be at least partially transparent to render viewable at said display screen an object at or near the equipped vehicle that would otherwise be partially hidden by non-transparent display of that portion of the three dimensional vehicle representation.

2. The vision system of claim 1, wherein the three dimensional vehicle representation of the equipped vehicle comprises (i) a body style corresponding to that of the equipped vehicle and (ii) a color corresponding to that of the equipped vehicle.

3. The vision system of claim 1, wherein, responsive at least in part to processing of image data captured by at least one of said cameras, said vision system determines the body type of the equipped vehicle and at least one of (i) a body style of the equipped vehicle and (ii) a color of the equipped vehicle.

4. The vision system of claim 1, wherein, responsive at least in part to a selection input, said vision system determines the body type of the equipped vehicle and at least one of (i) a body style of the equipped vehicle and (ii) a color of the equipped vehicle.

5. The vision system of claim 1, wherein said vision system is operable to adjust a degree of transparency of the at least partially transparent portion of the three dimensional vehicle representation.

6. The vision system of claim 5, wherein the degree of transparency of the three dimensional vehicle representation is adjusted responsive to at least one of (i) a distance from the equipped vehicle to the virtual camera viewpoint and (ii) an aberration angle of the equipped vehicle from the viewing direction of the virtual camera viewpoint.

7. The vision system of claim 1, wherein the three dimensional vehicle representation comprises an overlay that is applied to the displayed images, and wherein at least one of (i) a noise level of said overlay is adapted to generally match a noise level in said image data captured by said cameras and (ii) a blurring level of said overlay is adapted to the speed of the overlay relative to the displayed images.

8. The vision system of claim 1, wherein the displayed images are enhanced by an artificial blooming effect around light sources meant to appear bright.

9. The vision system of claim 1, wherein the displayed images are enhanced by having artificial lens flare overlays.

10. The vision system of claim 1, wherein a stitching borderline between images derived from image data captured by two of said cameras is adjusted dynamically according to structure appearing in image data captured by said two of said cameras.

11. The vision system of claim 1, wherein the field of view of at least some of said cameras encompasses a portion of the equipped vehicle, and wherein captured image data of the portion of the equipped vehicle is transferred into a three dimensional vehicle representation as seen from the virtual camera viewpoint.

12. The vision system of claim 1, wherein the three dimensional vehicle representation of the equipped vehicle is generated responsive at least in part to input representative of the body type and body style and color of the equipped vehicle, and wherein said input is provided at a vehicle assembly plant.

13. A vision system for a vehicle, said vision system comprising:

a plurality of cameras disposed at a vehicle equipped with said vision system, wherein said plurality of cameras have respective fields of view exterior of the equipped vehicle;

a processor operable to process image data captured by said cameras, wherein said processor processes captured image data to generate images of an environment at least partially surrounding the equipped vehicle;

wherein said processor is operable to generate a three dimensional vehicle representation of the equipped vehicle;

a display screen viewable by a driver of the equipped vehicle, wherein said display screen is operable to display the generated images of the environment and to display the three dimensional vehicle representation of the equipped vehicle as would be viewed from a virtual camera viewpoint exterior to and higher than the equipped vehicle itself;

wherein the three dimensional vehicle representation comprises a body type corresponding to that of the equipped vehicle and at least one of (i) a body style corresponding to that of the equipped vehicle and (ii) a color corresponding to that of the actual equipped vehicle; and

wherein a portion of the three dimensional vehicle representation is rendered as displayed to be at least partially transparent to render viewable at said display screen an object at or near the equipped vehicle that would otherwise be partially hidden by non-transparent display of that portion of the three dimensional vehicle representation.

14. The vision system of claim 13, wherein a degree of transparency of at least a portion of the displayed three dimensional vehicle representation is adjustable.