LOW RESOLUTION RGB RENDERING FOR EFFICIENT TRANSMISSION

• US 20180137602A1
• Filed: 11/14/2016
• Published: 05/17/2018
• Est. Priority Date: 11/14/2016
• Status: Abandoned Application

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Spitzer, Mark, Vieri, Carlin, Turner, Eric, Bastani, Behnam
• Application Number:
  US15/351,205
• Publication Number:
  US 20180137602A1
• Time in Patent Office: Days
• CPC Class Codes: G02B 30/34 Stereoscopes providing a stereoscopic pair of separated images corresponding to parallactically displaced views of the same object, e.g. 3D slide viewers
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 3/4007 based on interpolation, e.g. bilinear interpolation image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403
• CPC Class Codes: G06T 3/4069 by subpixel displacements
• CPC Class Codes: G09G 2300/0452 Details of colour pixel setup, e.g. pixel composed of a red, a blue and two green components
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 2340/0414 Vertical resolution change
• CPC Class Codes: G09G 2340/0421 Horizontal resolution change
• CPC Class Codes: G09G 2340/0457 Improvement of perceived resolution by subpixel rendering
• CPC Class Codes: G09G 2350/00 Solving problems of bandwidth in display systems
• CPC Class Codes: G09G 3/2003 Display of colours specific for liquid crystal displays G09G3/3607
• CPC Class Codes: G09G 5/02 characterised by the way in which colour is displayed details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607

Abstract

A display device includes a pixel array and a display controller. The pixel array has a non-red-green-blue (non-RGB) pixel format that includes at least first, second, and third color components, and wherein sub-pixels of the first color component are present at a first resolution and sub-pixels of each of the second and third color components are present at a second resolution lower than the first resolution. The display controller is configured to receive a first image in a an RGB pixel format in which sub-pixels of the first color component, sub-pixels of the second color component, and sub-pixels of the third color component each are present in the first image at the second resolution. The display controller further is configured to scale sub-pixels of the first color component in the first image from the second resolution to the first resolution to generate a second image having the non-RGB format.

Claims

1. A display system comprising:

a display device comprising;

an input coupled to at least one physical layer;

a pixel array having a non-red-green-blue (non-RGB) pixel format that includes at least first, second, and third color components, and wherein sub-pixels of the first color component are present in the pixel array at a first resolution and sub-pixels of each of the second and third color components are present in the pixel array at a second resolution lower than the first resolution; and

a display controller coupled to the input and the pixel array, the display controller configured to receive a first image in an RGB pixel format and whereby sub-pixels of the first color component, sub-pixels of the second color component, and sub-pixels of the third color component each are present in the first image at the second resolution, and wherein the display controller further is configured to scale sub-pixels of the first color component in the first image from the second resolution to the first resolution to generate a second image having the non-RGB format.

2. The display system of claim 1, further comprising:

a rendering device coupled to the physical layer and comprising a graphics processing unit (GPU) configured to render the first image in the RGB pixel format with sub-pixels of the first color component, sub-pixels of the second color component, and sub-pixels of the third color component each present in the first image at the second resolution, and to provide the rendered first image for transmission to the pixel array via the at least one physical layer.

3. The display system of claim 2, wherein:

the GPU further is configured to query the display device to determine the non-RGB pixel format of the pixel array.

4. The display system of claim 2, wherein the first color component comprises a green color component.

5. The display system of claim 4, wherein the non-RGB pixel format comprises a red-green, blue-green (RGBG) pixel format.

6. The display system of claim 5, wherein the display controller is configured to scale sub-pixels of the first color component by replicating pixel values for green sub-pixels in the second image from green sub-pixels present in the first image.

7. The display system of claim 5, wherein the display controller is configured to scale sub-pixels of the first color component by generating pixel values for green sub-pixels in the second image via interpolation of sets of two or more green sub-pixels present in the first image.

8. The display system of claim 1, wherein the display controller is configured to scale sub-pixels of the first color component by replicating pixel values for sub-pixels of the first color component for the second image from sub-pixels of the first color present in the first image.

9. The display system of claim 1, wherein the display controller is configured to scale sub-pixels of the first color component by generating pixel values for sub-pixels of the first color component for the second image via interpolation of sets of two or more pixels of the first color component in the first image.

10. The display system of claim 1, wherein the display controller further is configured to vertically the second image to generate a third image for display at the pixel array.

11. The display system of claim 1, further comprising:

a head mounted display (HMD) device comprising a left-eye display and a right-eye display, wherein one of one of the left-eye display and the right-eye display includes the pixel array.

12. In a display system comprising a display device having a pixel array having a non-red-green-blue (non-RGB) pixel format that includes at least first, second, and third color components, and wherein sub-pixels of the first color component are present at in the pixel array at a first resolution and sub-pixels of the second and third color components are present in the pixel array at a second resolution lower than the first resolution, a method comprising:

receiving, at the display device, a first image in the an RGB pixel format and whereby sub-pixels of the first color component, sub-pixels of the second color component, and sub-pixels of the third color component each are present in the first image at the second resolution; and

scaling, at the display device, sub-pixels of the first color component in the first image from the second resolution to the first resolution to generate a second image.

13. The method of claim 12, further comprising:

rendering, at a graphics processing unit (GPU) of the display system, the first image in the RGB pixel format with sub-pixels of the first color component, sub-pixels of the second color component, and sub-pixels of the third color component each present in the first image at the first resolution; and

providing the first image from the GPU to the display device via at least one physical layer between the GPU and the display device.

14. The method of claim 12, further comprising:

querying, at the GPU, the display device to determine the non-RGB pixel format of the pixel array.

15. The method of claim 12, wherein the first color component comprises a green color component.

16. The method of claim 15, wherein the non-RGB pixel format comprises a red-green, blue-green (RGBG) pixel format.

17. The method of claim 16, wherein:

scaling sub-pixels of the first color component in the first image comprises replicating pixel values for green sub-pixels of the second image from pixel values for green sub-pixels present in the first image.

18. The method of claim 16, wherein:

scaling sub-pixels of the first color component in the first image comprises generating pixel values for green sub-pixels of the second image via interpolation of sets of two or more green sub-pixels present in the first image.

19. The method of claim 12, wherein:

scaling sub-pixels of the first color component in the first image comprises replicating pixel values for sub-pixels of the first color component in the second image from pixel values for sub-pixels of the first color component present in the first image.

20. The method of claim 12, wherein:

scaling sub-pixels of the first color component in the first image comprises generating pixel values of the first color component for the second image via interpolation of sets of two or more pixels of the first color component in the first image.

21. The method of claim 12, further comprising:

vertically scaling the second image to generate a third image for display at the pixel array.

22. A system comprising:

a rendering device comprising a graphics processing unit (GPU) configured to render a first image in a red-blue-green (RGB) pixel format having sub-pixels of at least a first color component, a second color component, and a third color component, wherein the first image comprises a foveal region and a peripheral region, the foveal region composed of sub-pixels of the first color component present in the foveal region at a first resolution and sub-pixels of the second color component and sub-pixels of the third color component each are present in the foveal region at a second resolution lower than the first resolution, and the peripheral region composed of sub-pixels of the first color component, sub-pixels of the second color component, and subpixels of the third color component each present in the peripheral region at the second resolution; and

a head mounted display (HMD) device comprising;

a pixel array having a non-RGB pixel format, wherein sub-pixels of the first color component are present at in the pixel array at the first resolution and sub-pixels of the second and third color components are present in the pixel array at the second resolution; and

a display controller to scale sub-pixels of the first color component in the peripheral region from the second resolution to the first resolution to generate a scaled peripheral region and to blend the foveal region with the scaled peripheral region to generate a second image for display at the pixel array.

23. The system of claim 22, wherein:

the display controller is to scale sub-pixels of the first color component by replicating pixel values for sub-pixels of the first color component for the scaled peripheral region from pixel values for sub-pixels of the first color present in the peripheral region.

24. The system of claim 22, wherein:

the display controller is to scale sub-pixels of the first color component by generating pixel values of the first color component for the scaled peripheral region via interpolation of sets of two or more pixels of the first color component in the peripheral region.

25. The system of claim 22, wherein:

the first color component is a green color component, the second color component is a red color component, and the third color component is a blue color component; and

the non-RGB pixel format comprises a red-green, blue-green (RGBG) format.