VEHICLE VISION SYSTEM WITH CUSTOMIZED DISPLAY

• US 20170374340A1
• Filed: 09/11/2017
• Published: 12/28/2017
• Est. Priority Date: 12/09/2011
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Pflug, Goerg
• Granted Patent: US 10,129,518 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 15/50 Lighting effects
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 2207/30264 Parking
• CPC Class Codes: G06T 2210/62 Semi-transparency
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G06T 7/80 Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
• CPC Class Codes: H04N 13/106 Processing image signals for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/15 for colour aspects of image signals

Abstract

A vision system for a vehicle includes a plurality of cameras and a processor operable to process image data captured by the cameras to generate images derived from image data captured by at least some of the cameras. The processor is operable to generate a three dimensional vehicle representation. A display screen, viewable by a driver of the vehicle, is operable to display the generated images and the three dimensional vehicle representation as would be viewed from a virtual camera viewpoint exterior to and higher than the vehicle itself. A portion of the three dimensional vehicle representation is rendered as displayed to be at least partially transparent to enable viewing at the display screen of an object present exterior of the vehicle that would otherwise be partially hidden by non-transparent display of that portion of the three dimensional vehicle representation.

Claims

1. A vision system for a vehicle, said vision system comprising:

a plurality of cameras disposed at a vehicle equipped with said vision system, wherein said plurality of cameras comprises a front camera having a field of view forward of the equipped vehicle, a rear camera having a field of view rearward of the equipped vehicle, a driver side camera having a field of view sideward of the equipped vehicle, and a passenger side camera having a field of view sideward of the equipped vehicle;

a processor operable to process image data captured by said plurality of cameras;

wherein said processor processes image data captured by at least some of said front camera, said rear camera, said driver side camera and said passenger side camera to generate images derived from image data captured by the at least some of said front camera, said rear camera, said driver side camera and said passenger side camera;

wherein said processor is operable to generate a three dimensional vehicle representation;

a display screen viewable by a driver of the equipped vehicle, wherein said display screen is operable to display the generated images and to display the three dimensional vehicle representation as would be viewed from a virtual camera viewpoint exterior to and higher than the equipped vehicle itself;

wherein the displayed images are representative of an environment at least partially surrounding the equipped vehicle; and

wherein a portion of the three dimensional vehicle representation is rendered as displayed to be at least partially transparent to enable viewing at said display screen of an object present exterior of the equipped vehicle that would otherwise be partially hidden by non-transparent display of that portion of the three dimensional vehicle representation.

2. The vision system of claim 1, wherein the three dimensional vehicle representation comprises one of (i) a vehicle representation having a body style corresponding to that of the equipped vehicle and (ii) a vehicle representation having a color corresponding to that of the equipped vehicle.

3. The vision system of claim 1, wherein, responsive at least in part to processing of image data captured by at least one of said plurality of cameras, said vision system determines the body type of the equipped vehicle and at least one of (i) a body style of the equipped vehicle and (ii) a color of the equipped vehicle.

4. The vision system of claim 1, wherein, responsive at least in part to a selection input, said vision system determines the body type of the equipped vehicle and at least one of (i) a body style of the equipped vehicle and (ii) a color of the equipped vehicle.

5. The vision system of claim 1, wherein said vision system is operable to adjust a degree of transparency of the at least partially transparent portion of the three dimensional vehicle representation.

6. The vision system of claim 5, wherein the degree of transparency of the three dimensional vehicle representation is adjusted responsive to a distance from the equipped vehicle to the virtual camera viewpoint.

7. The vision system of claim 5, wherein the degree of transparency of the three dimensional vehicle representation is adjusted responsive to an aberration angle of the equipped vehicle from the viewing direction of the virtual camera viewpoint.

8. The vision system of claim 1, wherein the three dimensional vehicle representation comprises an overlay that is applied to the displayed images.

9. The vision system of claim 8, wherein a noise level of said overlay is adapted to generally match a noise level in said image data captured by said plurality of cameras.

10. The vision system of claim 8, wherein a blurring level of said overlay is adapted to the speed of the overlay relative to the displayed images.

11. The vision system of claim 1, wherein the displayed images are enhanced by an artificial blooming effect around light sources meant to appear bright.

12. The vision system of claim 1, wherein the displayed images are enhanced by having artificial lens flare overlays.

13. The vision system of claim 1, wherein a stitching borderline between images derived from image data captured by two of said plurality of cameras is adjusted dynamically according to structure appearing in image data captured by said two of said plurality of cameras.

14. The vision system of claim 1, wherein the field of view of at least some of said plurality of cameras encompasses a portion of the equipped vehicle, and wherein captured image data of the portion of the equipped vehicle is transferred into a three dimensional vehicle representation as seen from the virtual camera viewpoint.

15. The vision system of claim 1, wherein the three dimensional vehicle representation is generated responsive at least in part to input representative of the body type and body style and color of the equipped vehicle.

16. A vision system for a vehicle, said vision system comprising:

a plurality of cameras disposed at a vehicle equipped with said vision system, wherein said plurality of cameras comprises a front camera having a field of view forward of the equipped vehicle, a rear camera having a field of view rearward of the equipped vehicle, a driver side camera having a field of view sideward of the equipped vehicle, and a passenger side camera having a field of view sideward of the equipped vehicle;

a processor operable to process image data captured by said plurality of cameras;

wherein said processor processes image data captured by at least some of said front camera, said rear camera, said driver side camera and said passenger side camera to generate images derived from image data captured by the at least some of said front camera, said rear camera, said driver side camera and said passenger side camera;

wherein said processor is operable to generate a three dimensional vehicle representation;

a display screen viewable by a driver of the equipped vehicle, wherein said display screen is operable to display the generated images and to display the three dimensional vehicle representation as would be viewed from a virtual camera viewpoint exterior to and higher than the equipped vehicle itself;

wherein the three dimensional vehicle representation comprises an overlay that is applied to the displayed images;

wherein the displayed images are representative of an environment at least partially surrounding the equipped vehicle;

wherein a portion of the three dimensional vehicle representation is rendered as displayed to be at least partially transparent to enable viewing at said display screen of an object present exterior of the equipped vehicle that would otherwise be partially hidden by non-transparent display of that portion of the three dimensional vehicle representation; and

wherein said vision system is operable to adjust a degree of transparency of the at least partially transparent portion of the three dimensional vehicle representation.

17. The vision system of claim 16, wherein the degree of transparency of the three dimensional vehicle representation is adjusted responsive to a distance from the equipped vehicle to the virtual camera viewpoint.

18. The vision system of claim 16, wherein the degree of transparency of the three dimensional vehicle representation is adjusted responsive to an aberration angle of the equipped vehicle from the viewing direction of the virtual camera viewpoint.

19. A vision system for a vehicle, said vision system comprising:

a plurality of cameras disposed at a vehicle equipped with said vision system, wherein said plurality of cameras comprises a front camera having a field of view forward of the equipped vehicle, a rear camera having a field of view rearward of the equipped vehicle, a driver side camera having a field of view sideward of the equipped vehicle, and a passenger side camera having a field of view sideward of the equipped vehicle;

a processor operable to process image data captured by said plurality of cameras;

wherein said processor processes image data captured by at least some of said front camera, said rear camera, said driver side camera and said passenger side camera to generate images derived from image data captured by the at least some of said front camera, said rear camera, said driver side camera and said passenger side camera;

wherein said processor is operable to generate a three dimensional vehicle representation;

a display screen viewable by a driver of the equipped vehicle, wherein said display screen is operable to display the generated images and to display the three dimensional vehicle representation as would be viewed from a virtual camera viewpoint exterior to and higher than the equipped vehicle itself;

wherein the displayed images are representative of an environment at least partially surrounding the equipped vehicle;

wherein a portion of the three dimensional vehicle representation is rendered as displayed to be at least partially transparent to enable viewing at said display screen of an object present exterior of the equipped vehicle that would otherwise be partially hidden by non-transparent display of that portion of the three dimensional vehicle representation;

wherein the field of view of at least some of said plurality of cameras encompasses a portion of the equipped vehicle, and wherein captured image data of the portion of the equipped vehicle is transferred into a three dimensional vehicle representation as seen from the virtual camera viewpoint; and

wherein the three dimensional vehicle representation is representative of at least one of body type of the equipped vehicle, body style of the equipped vehicle and color of the equipped vehicle.

20. The vision system of claim 19, wherein the three dimensional vehicle representation comprises an overlay that is applied to the displayed images.