Display controller, heads-up image display system and method thereof

• US 9,811,932 B2
• Filed: 04/17/2015
• Issued: 11/07/2017
• Est. Priority Date: 04/17/2015
• Status: Active Grant

• Current Assignee: NXP USA, Inc. (NXP Semiconductors NV)
• Original Assignee: NXP USA, Inc. (NXP Semiconductors NV)
• Inventors: Staudenmaier, Michael Andreas, Bajaj, Kshitij, Singh, Chanpreet
• Primary Examiner(s): Yang, Ryan R
• Application Number:
  US14/689,369
• Publication Number:
  US 20160307346A1
• Time in Patent Office: 935 Days
• Field of Search: 345629
• CPC Class Codes: B60K 2360/186 Displaying information according to relevancy
• CPC Class Codes: B60K 2360/334 Projection means
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: G02B 2027/0123 comprising devices increasing the field of view
• CPC Class Codes: G02B 2027/013 comprising a combiner of particular shape, e.g. curvature
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 3/18 Image warping, e.g. rearranging pixels individually
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: G09G 2340/10 Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video
• CPC Class Codes: G09G 2358/00 Arrangements for display data security
• CPC Class Codes: G09G 2360/02 Graphics controller able to handle multiple formats, e.g. input or output formats
• CPC Class Codes: G09G 2360/06 Use of more than one graphics processor to process data before displaying to one or more screens
• CPC Class Codes: G09G 2380/10 Automotive applications
• CPC Class Codes: G09G 5/026 Control of mixing and/or overlay of colours in general G09G5/022 and G09G5/024 take precedence
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: G09G 5/38 : with means for controlling the display position

Abstract

The present application relates to a display controller and display system and a method of operating thereof. At a filtering stage display image data are generated on the basis of received pixel-mapped image data. The filtering operation accepts a plurality of pixels out of the received image data as input values to generate a pixel of the display image data as output value. It is further determined whether the plurality of pixels being the input values to the filtering operation are marked. If all pixels thereof are marked, the output pixel being the output value is marked. The marked pixels in the display image data are validated on the basis reference data.

Claims

1. A display controller, comprising:

a filter stage to receive an input image layer comprising a plurality of input image pixels, and to provide a plurality of output image pixels based on the plurality of input image pixels, wherein;

each pixel of the plurality of input image pixels includes marking information indicating safety relevant or non-safety relevant;

each pixel of the plurality of output image pixels includes marking information indicating safety relevant or non-safety relevant;

a particular output image pixel of the plurality of output image pixels is based on a group of more than one of the plurality of input image pixels; and

the marking information of the particular output image pixel is set by the filter stage to indicate safety relevant in response to all of the pixels of the group being marked as safety relevant; and

a verifier stage, coupled to the filter stage, to validate the plurality of output image pixels based on the marking information of an output image pixel indicating that the output image pixel is safety relevant, and based on reference data.

2. The display controller of claim 1, further comprising:

at least one data input to receive first image data representing a safety relevant image part and to receive second image data representing a non-safety relevant image part;

a merging stage coupled to the at least one data input to receive the first image data and the second image data and arranged to compose the first image data and the second image data to form the plurality of input image pixels to be provided to the filter stage,

wherein pixels belonging to the first image data in the plurality of input image pixels include marking information indicating safety relevant.

3. The display controller of claim 1,

wherein the each pixel of the plurality of input image pixels comprises a color information.

4. The display controller of claim 1, wherein the verifier stage includes:

a comparator portion arranged to compare marked pixels in the plurality of output image pixels with the reference data to validate the plurality of output image pixels with respect to the safety relevant image part included therein.

5. The display controller of claim 1, wherein the verifier stage includes:

a checksum calculator arranged to determine a checksum from marked pixels in the plurality of output image pixels, wherein the checksum is validated against the reference data.

6. The display controller of claim 5,

wherein the checksum calculator is further arranged to determine the checksum on the basis of at least one of pixel values of the marked pixels and locations of the marked pixels in an image space.

7. The display controller of claim 5, wherein the verifier stage further includes:

at least one image data input to receive the plurality of output image pixels;

at least one parameter input to receive at least one of information about the safety relevant image part and information about the filtering operation applied to generate the plurality of output image pixels; and

a set of reference data, wherein each reference data is associated with a specific safety relevant image part and a specific filtering operation applied to generate the plurality of output image pixels,

wherein the verifier stage is further arranged to select the reference data for validation from the set of reference data on the basis of the received information.

8. The display controller of claim 1, wherein the verifier stage includes:

a reference table arranged to store a set of reference data records, wherein each record is associated with a specified safety relevant part and a specified filtering operation.

9. The display controller of claim 1, wherein the filter stage includes:

a warp mapping stage arranged to operate a warp mapping operation to generate the plurality of output image pixels on the basis of the received plurality of input image pixels, wherein a display image composed by the plurality of output image pixels is warped to be displayed on a non-planar surface in such a way that an observer of the displayed image perceives the image as being undistorted.

10. The display controller of claim 9,

wherein the warp mapping stage is configurable to adjust the warp mapping operation to generate warped image data for being projected on non-planar surfaces with differing curvatures and/or observed by the observer at differing viewing distances and angles.

11. The display controller of claim 1, wherein the filter stage includes:

a safety voter portion arranged to generate marking data for the plurality of output image pixels on the basis of marking data of the received plurality of input image pixels.

12. The display controller of claim 1, further comprising:

a first data input to receive first image data representing a safety relevant image part from at least one image data source; and

a second data input to receive second image data representing a non-safety relevant image part from at least one image data source.

13. The display controller of claim 1, further comprising:

a display system, including;

a displaying component, coupled to the filter stage, for displaying an image representative of the plurality of output image pixels to an observer;

wherein the filter stage is arranged to supply the display image data to the displaying component.

14. The display controller of claim 13,

wherein the display system is a heads-up display system, and

wherein the displaying component is an image projector for projecting the image representative of the plurality of output image pixels on a surface into the line of sight of the observer.

15. The display controller of claim 1, further comprising:

a merge stage to receive source image data from a plurality of image sources, to generate a merged image based on the source image data and to provide the merged image to the filter stage as the input image layer.

16. A method of operating a display controller, said method comprising:

receiving an input image layer comprising a plurality of input image pixels comprising a safety relevant image part and a non-safety relevant image part, wherein the each pixel of the plurality of input image pixels includes marking information indicating safety relevant or non-safety relevant;

performing a filtering operation on the received plurality of input image pixels, wherein the filtering operation provides a plurality of output image pixels based on the plurality of input image pixels;

each pixel of the plurality of output image pixels includes marking information indicating safety relevant or non-safety relevant;

a particular output image pixel of the plurality of output image pixels is based on a group of more than one of the plurality of input image pixels; and

the marking information of the particular output image pixel is set by the filtering operation to indicate safety relevant in response to all of the pixels of the group being marked as safety relevant;

generating display image data on the basis of the plurality of output image pixels; and

validating the plurality of output image pixels based on the marking information of an output image pixel indicating that the output image pixel is safety relevant, and based on a basis reference data.

17. The method according to claim 16,

receiving first image data representing the safety relevant image part;

receiving second image data representing the non-safety relevant image part; and

composing the first image data and the second image data to form the plurality of input image pixels to be provided for filtering.

18. The method according to claim 16, further comprising:

determining a checksum on the basis of the plurality of output image pixels; and

validating the checksum against the basis reference data.

19. The method according to claim 16, wherein the filtering operation further comprises:

performing a warp mapping operation on the plurality of input image pixels to generate the plurality of output image pixels, wherein a display image composed by the plurality of output image pixels is warped to be displayed on a non-planar surface in such a way that an observer of the displayed image perceives the image as being undistorted.

20. The method of claim 16, further comprising:

receiving source image data from a plurality of image sources;

generating a merged image based on the source image data; and

providing the merged image as the input image layer.