VEHICLE VISION SYSTEM WITH CUSTOMIZED DISPLAY

• US 20190082157A1
• Filed: 11/12/2018
• Published: 03/14/2019
• Est. Priority Date: 12/09/2011
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Pflug, Goerg
• Granted Patent: US 10,542,244 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 15/50 Lighting effects
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 2207/30264 Parking
• CPC Class Codes: G06T 2210/62 Semi-transparency
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G06T 7/80 Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
• CPC Class Codes: H04N 13/106 Processing image signals for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/15 for colour aspects of image signals

Abstract

A vision system for a vehicle includes a plurality of cameras and a processor operable to process image data captured by the cameras to generate images derived from image data captured by at least some of the cameras. The processor generates a vehicle representation. A display screen, viewable by a driver of the vehicle, displays the generated images and the vehicle representation as would be viewed from a virtual camera viewpoint exterior to and higher than the vehicle itself. A portion of the vehicle representation is rendered as displayed to be at least partially transparent to enable viewing at the display screen of an object present exterior of the vehicle that would otherwise be partially hidden by non-transparent display of that portion of the vehicle representation.

Claims

1. A method for displaying images representative of an environment at least partially surrounding a vehicle, said method comprising:

disposing a plurality of cameras at a vehicle;

wherein disposing the plurality of cameras comprises disposing a front camera at the vehicle, and wherein the front camera, when disposed at the vehicle, has a field of view at least forward of the vehicle;

wherein disposing the plurality of cameras comprises disposing a rear camera at the vehicle, and wherein the rear camera, when disposed at the vehicle, has a field of view at least rearward of the vehicle;

wherein disposing the plurality of cameras comprises disposing a driver side camera at the vehicle, and wherein the driver side camera, when disposed at the vehicle, has a field of view at least sideward of the vehicle;

wherein disposing the plurality of cameras comprises disposing a passenger side camera at the vehicle, and wherein the passenger side camera, when disposed at the vehicle, has a field of view at least sideward of the vehicle;

providing a processor for processing image data captured by the plurality of cameras;

providing a display screen in the vehicle so as to be viewable by a driver of the vehicle;

capturing image data via the plurality of cameras;

processing, via the processor, image data captured by at least some of the front camera, the rear camera, the driver side camera and the passenger side camera to generate images derived from image data captured by the at least some of the front camera, the rear camera, the driver side camera and the passenger side camera;

generating, via the processor, a vehicle representation that is representative of the vehicle;

displaying, via the display screen, the generated images and the vehicle representation as would be viewed from a virtual camera viewpoint exterior to and higher than the vehicle itself; and

rendering a portion of the vehicle representation as displayed to be at least partially transparent to enable viewing at the display screen of an object present exterior of the vehicle that would otherwise be partially hidden by non-transparent display of that portion of the vehicle representation.

2. The method of claim 1, wherein generating the vehicle representation comprises generating, via the processor, a vehicle representation that has a color corresponding to that of the vehicle.

3. The method of claim 2, comprising determining, via processing of image data captured by at least one of the plurality of cameras, the color of the vehicle.

4. The method of claim 2, comprising determining, responsive at least in part to an input, the color of the vehicle.

5. The method of claim 1, wherein generating the vehicle representation comprises generating, via the processor, a vehicle representation that is representative of at least a body style of the vehicle.

6. The method of claim 5, comprising determining, via processing of image data captured by at least one of the plurality of cameras, the body style of the vehicle.

7. The method of claim 5, comprising determining, responsive at least in part to an input, the body style of the vehicle.

8. The method of claim 7, wherein the input comprises an input indicative of the body style, and wherein the input is provided at the vehicle assembly plant.

9. The method of claim 1, comprising adjusting a degree of transparency of the at least partially transparent portion of the vehicle representation.

10. The method of claim 9, wherein adjusting the degree of transparency of the at least partially transparent portion of the vehicle representation is based at least in part on distance from the vehicle to the virtual camera viewpoint.

11. The method of claim 9, wherein adjusting the degree of transparency of the at least partially transparent portion of the vehicle representation is based at least in part on an aberration angle of the vehicle from the viewing direction of the virtual camera viewpoint.

12. The method of claim 1, wherein generating the vehicle representation comprises generating an overlay that is applied to the displayed images.

13. The method of claim 12, comprising adapting a noise level of the overlay to match a noise level in the image data captured by the plurality of cameras.

14. The method of claim 12, comprising adapting a blurring level of the overlay to a speed of the overlay relative to the displayed images.

15. The method of claim 1, comprising enhancing the displayed images via artificial blooming around light sources meant to appear bright.

16. The method of claim 1, comprising enhancing the displayed images via artificial lens flare overlays.

17. The method of claim 1, comprising dynamically adjusting a stitching borderline between images derived from image data captured by two of the plurality of cameras according to structure appearing in image data captured by the two of the plurality of cameras.

18. The method of claim 1, wherein the field of view of at least some of the plurality of cameras encompasses a portion of the vehicle, and wherein said method comprises transferring into the vehicle representation captured image data of the portion of the vehicle.

19. The method of claim 1, comprising generating the vehicle representation responsive at least in part to input representative of body type, body style and color of the vehicle.

20. A method for displaying images representative of an environment at least partially surrounding a vehicle, said method comprising:

disposing a plurality of cameras at a vehicle;

wherein disposing the plurality of cameras comprises disposing a front camera at the vehicle, and wherein the front camera, when disposed at the vehicle, has a field of view at least forward of the vehicle;

wherein disposing the plurality of cameras comprises disposing a rear camera at the vehicle, and wherein the rear camera, when disposed at the vehicle, has a field of view at least rearward of the vehicle;

wherein disposing the plurality of cameras comprises disposing a driver side camera at the vehicle, and wherein the driver side camera, when disposed at the vehicle, has a field of view at least sideward of the vehicle;

wherein disposing the plurality of cameras comprises disposing a passenger side camera at the vehicle, and wherein the passenger side camera, when disposed at the vehicle, has a field of view at least sideward of the vehicle;

wherein the field of view of at least one of the plurality of cameras encompasses a portion of the vehicle;

providing a processor for processing image data captured by the plurality of cameras;

providing a display screen in the vehicle so as to be viewable by a driver of the vehicle;

capturing image data via the plurality of cameras;

processing, via the processor, image data captured by at least some of the front camera, the rear camera, the driver side camera and the passenger side camera to generate images derived from image data captured by the at least some of the front camera, the rear camera, the driver side camera and the passenger side camera;

determining, responsive at least in part to an input, a body style of the vehicle;

generating, via the processor, a vehicle representation that is representative of at least the determined body style of the vehicle;

displaying, via the display screen, the generated images and the vehicle representation as would be viewed from a virtual camera viewpoint exterior to and higher than the vehicle itself; and

rendering a portion of the vehicle representation as displayed to be at least partially transparent to enable viewing at the display screen of an object present exterior of the vehicle that would otherwise be partially hidden by non-transparent display of that portion of the vehicle representation.

21. The method of claim 20, wherein the input comprises an input indicative of the body style, and wherein the input is provided at the vehicle assembly plant.

22. The method of claim 20, comprising determining, responsive at least in part to an input, a color of the vehicle, wherein generating the vehicle representation comprises generating, via the processor, a vehicle representation that has a color corresponding to the determined color of the vehicle.

23. The method of claim 20, wherein generating the vehicle representation comprises generating an overlay that is applied to the displayed images.

24. The method of claim 20, comprising dynamically adjusting a stitching borderline between images derived from image data captured by two of the plurality of cameras according to structure appearing in image data captured by the two of the plurality of cameras.

25. The method of claim 20, comprising transferring into the vehicle representation captured image data of the portion of the vehicle that is encompassed by the field of view of at least one of the plurality of cameras.

26. A method for displaying images representative of an environment at least partially surrounding a vehicle, said method comprising:

disposing a plurality of cameras at a vehicle;

wherein disposing the plurality of cameras comprises disposing a front camera at the vehicle, and wherein the front camera, when disposed at the vehicle, has a field of view at least forward of the vehicle;

wherein disposing the plurality of cameras comprises disposing a rear camera at the vehicle, and wherein the rear camera, when disposed at the vehicle, has a field of view at least rearward of the vehicle;

wherein disposing the plurality of cameras comprises disposing a driver side camera at the vehicle, and wherein the driver side camera, when disposed at the vehicle, has a field of view at least sideward of the vehicle;

wherein disposing the plurality of cameras comprises disposing a passenger side camera at the vehicle, and wherein the passenger side camera, when disposed at the vehicle, has a field of view at least sideward of the vehicle;

wherein the field of view of at least one of the plurality of cameras encompasses a portion of the vehicle;

providing a processor for processing image data captured by the plurality of cameras;

providing a display screen in the vehicle so as to be viewable by a driver of the vehicle;

capturing image data via the plurality of cameras;

processing, via the processor, image data captured by at least some of the front camera, the rear camera, the driver side camera and the passenger side camera to generate images derived from image data captured by the at least some of the front camera, the rear camera, the driver side camera and the passenger side camera;

generating, via the processor, a vehicle representation that is representative of the vehicle;

displaying, via the display screen, the generated images and the vehicle representation as would be viewed from a virtual camera viewpoint exterior to and higher than the vehicle itself;

rendering a portion of the vehicle representation as displayed to be at least partially transparent to enable viewing at the display screen of an object present exterior of the vehicle that would otherwise be partially hidden by non-transparent display of that portion of the vehicle representation; and

adjusting a degree of transparency of the at least partially transparent portion of the vehicle representation.

27. The method of claim 26, wherein adjusting the degree of transparency of the at least partially transparent portion of the vehicle representation is based at least in part on distance from the vehicle to the virtual camera viewpoint.

28. The method of claim 26, wherein adjusting the degree of transparency of the at least partially transparent portion of the vehicle representation is based at least in part on an aberration angle of the vehicle from the viewing direction of the virtual camera viewpoint.

29. The method of claim 26, wherein generating the vehicle representation comprises generating an overlay that is applied to the displayed images.

30. The method of claim 26, comprising transferring into the vehicle representation captured image data of the portion of the vehicle encompassed by the field of view of the at least one of the plurality of cameras.

31. The method of claim 26, comprising determining a body style of the vehicle, wherein generating the vehicle representation comprises generating, via the processor, a vehicle representation that is representative of at least the determined body style of the vehicle.

32. The method of claim 31, wherein determining the body style comprises determining, via processing of image data captured by the at least one of the plurality of cameras, the body style of the vehicle.