Method, Head-Up Display and Output System for the Perspective Transformation and Outputting of Image Content, and Vehicle

• US 20190005608A1
• Filed: 09/10/2018
• Published: 01/03/2019
• Est. Priority Date: 03/11/2016
• Status: Active Grant

• Current Assignee: Bayerische Motoren Werke AG
• Original Assignee: Bayerische Motoren Werke AG
• Inventors: BAYERL, Tobias, BROWN, Sean, CIESLA, Christoph
• Granted Patent: US 10,460,428 B2
• Time in Patent Office: Days
• CPC Class Codes: B60K 2360/186 Displaying information according to relevancy
• CPC Class Codes: B60K 2360/334 Projection means
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: G02B 2027/011 comprising device for correcting geometrical aberrations, distortion
• CPC Class Codes: G02B 2027/0123 comprising devices increasing the field of view
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 2207/20221 Image fusion; Image merging
• CPC Class Codes: G06T 3/00 Geometric image transformations in the plane of the image
• CPC Class Codes: G06T 3/053 Detail-in-context presentations fisheye or wide-angle transformations G06T3/047
• CPC Class Codes: G06T 3/08 Projecting images onto non-planar surfaces, e.g. geodetic screens
• CPC Class Codes: G06T 3/4007 based on interpolation, e.g. bilinear interpolation image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G06T 3/608 by skew deformation, e.g. two-pass or three-pass rotation
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: G09G 2360/122 : Tiling
• CPC Class Codes: G09G 2360/18 : Use of a frame buffer in a display terminal, inclusive of the display panel
• CPC Class Codes: G09G 2380/10 : Automotive applications
• CPC Class Codes: G09G 5/006 : Details of the interface to the display terminal specific for a display terminal using a CRT G09G1/167; using a flat panel G09G3/2096; circuits for interfacing with colour displays G09G5/04
• CPC Class Codes: G09G 5/363 : Graphics controllers
• CPC Class Codes: G09G 5/377 : for mixing or overlaying two or more graphic patterns G09G5/02, G09G5/397 take precedence
• CPC Class Codes: H04N 7/18 : Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A method, a head-up display and a display system for the perspective transformation and displaying of rendered image content, as well as a corresponding vehicle, are provided. In the perspective transformation and outputting method, the image content to be displayed is subdivided into a plurality of tiles, and the individual tiles are each transformed in perspective using perspective transformation. The individual tiles that have been transformed in perspective are then combined to form a transformed image content, and the image content transformed in perspective is projected onto a projection area of the head-up display or displayed on a display unit.

Claims

1. A method for perspective transformation and display of a rendered image content by a head-up display, comprising the acts of:

dividing the rendered image content into a plurality of tiles;

transforming individual ones of the plurality of tiles by perspective transformation;

combining the perspectively transformed tiles into a transformed image content; and

projecting the perspectively transformed image content onto a projection surface assigned to the head-up display.

5. The method as claimed in claim 1, wherein

during the transforming act, each of the individual ones of the plurality of tiles is perspectively transformed with regard to one or more of trapezoid shape, curvature, stretching, compression, rotation, and offset.

7. The method as claimed in claim 5, wherein

adjoining tiles of the plurality of tiles have overlapping image contents.

8. The method as claimed in claim 1, wherein

the image content is in the form of raster graphics, and

individual pixels of the individual ones of the plurality of tiles are displaced by the perspective transformation.

9. The method as claimed in claim 8, wherein

during the perspective transforming act, interpolation is performed between at least a portion of adjoining ones of the individual pixels of the individual ones of the plurality of tiles.

10. The method as claimed in claim 8, wherein

during the perspective transforming act, the individual ones of the plurality of tiles are perspectively transformed by multiplication by a transformation matrix.

11. The method as claimed in claim 10, wherein

the transformation matrix is chosen from a multiplicity of transformation matrices.

12. The method as claimed claim 1, wherein

during the perspective transforming act, the perspective transformation of the individual ones of the plurality of tiles is carried out by a graphics module via a graphics programming interface.

13. The method as claimed in claim 1, further comprising the act of:

storing the perspectively transformed tiles in a buffer memory.

14. The method as claimed in claim 13, wherein

only a portion of the individual ones of the plurality of tiles is perspectively transformed, and

during the act of combining the individual perspectively transformed tiles, perspectively transformed tiles corresponding to the remaining the individual ones of the plurality of tiles retrieved from the buffer memory are combined with the portion the individual ones of the plurality of tiles is perspectively transformed to form the perspectively transformed image content.

15. The method as claimed in claim 14, wherein

the portion of the individual ones of the plurality of tiles perspectively transformed include the individual ones of the plurality of tiles having elements of the image content changed with respect to image content previously stored in the buffer.

16. The method as claimed in claim 1, wherein

different portions of the plurality of tiles have different color depths.

17. The method as claimed in claim 1, wherein

during the perspective transformation act, the plurality of tiles are mirrored by a point or line mirroring, and

during the combining act are combined to form a perspectively transformed, mirrored image content.

2. A method for the perspective transformation and outputting of a captured image content, comprising the acts of:

dividing the captured image content into a plurality of tiles;

transforming individual ones of the plurality of tiles by perspective transformation;

combining the perspectively transformed tiles into a transformed image content; and

outputting the perspectively transformed image content.

3. The method as claimed in claim 2, wherein

the perspectively transformed image content is displayed on a display unit.

4. The method as claimed in claim 3, wherein

the individual ones of the plurality of tiles are transformed such that the perspectively transformed image content is represented by the display unit in an uncompressed manner in at least one first region and in a compressed manner in at least one second region.

6. The method as claimed in claim 2, wherein

during the transforming act, each of the individual ones of the plurality of tiles is perspectively transformed with regard to one or more of trapezoid shape, curvature, stretching, compression, rotation, and offset.

18. A head-up display for the perspective transformation and display of a rendered image content, comprising:

a control unit including

a first module configured to divide the rendered image content into a plurality of tiles,

a second module configured to transform individual ones of the plurality of tiles by perspective transformation, and

a third module configured to combine the individual perspectively transformed tiles into a transformed image content; and

a projection unit configured to project the perspectively transformed image content onto a projection surface assigned to the head-up display.

19. An output system for the perspective transformation and outputting of a captured image content, comprising:

a control unit including

a first module configured to divide the rendered image content into a plurality of tiles,

a second module configured to transform individual ones of the plurality of tiles by perspective transformation, and

a third module configured to combine the individual perspectively transformed tiles into a transformed image content; and

an output unit configured to output the perspectively transformed image content.

20. A vehicle, comprising:

a vehicle front window; and

a head-up display including

a control unit including

a first module configured to divide the rendered image content into a plurality of tiles,

a second module configured to transform individual ones of the plurality of tiles by perspective transformation, and

a third module configured to combine the individual perspectively transformed tiles into a transformed image content; and

a projection unit configured to project the perspectively transformed image content onto the vehicle front window.

21. A vehicle, comprising:

a control unit including

a first module configured to divide the rendered image content into a plurality of tiles,

a second module configured to transform individual ones of the plurality of tiles by perspective transformation, and

a third module configured to combine the individual perspectively transformed tiles into a transformed image content; and

an output unit configured to output the perspectively transformed image content on a display unit in the vehicle.