Independently processing planes of display data

• US 8,982,151 B2
• Filed: 06/14/2010
• Issued: 03/17/2015
• Est. Priority Date: 06/14/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Tardif, John, Grossman, Mark S.
• Primary Examiner(s): WANG, JIN CHENG
• Application Number:
  US12/815,248
• Publication Number:
  US 20110304713A1
• Time in Patent Office: 1,737 Days
• Field of Search: 345/419, 345/613, 345/699, 345/428, 345/619, 345/629, 345/501, 345/506, 345/660, 345/669, 345/670, 386/95, 386/353
• US Class Current: 345/629
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 2340/08 Monochrome to colour transformation
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels

Abstract

Independently processing planes of display data is provided by a method of outputting a video stream. The method includes retrieving from memory a first plane of display data having a first set of display parameters and post-processing the first plane of display data to adjust the first set of display parameters. The method further includes retrieving from memory a second plane of display data having a second set of display parameters and post-processing the second plane of display data independently of the first plane of display data. The method further includes blending the first plane of display data with the second plane of display data to form blended display data and outputting the blended display data.

Claims

1. A method for outputting a video stream using a computing system, the method comprising:

retrieving from memory a first plane of display data;

retrieving from memory a second plane of display data;

in response to nearing a graphics-processing budget of the computing system, decreasing a resolution of the first plane of display data while maintaining a predetermined frame rate of the first plane of display data to adhere to the graphics processing budget;

independently maintaining a resolution of the second plane of display data while the resolution of the first plane of display data is decreased;

blending the first plane of display data with the second plane of display data to form blended display data; and

outputting the blended display data at or above the predetermined frame rate without exceeding the graphics processing budget.

2. The method of claim 1, further comprising applying input color space conversion independently to the first and/or second planes of display data to match frame-buffer formats of the first and second planes of display data to a common color space for the blending.

3. The method of claim 1, further comprising applying an inverse gamma correction independently to the first and/or second planes of display data to convert gamma-corrected content in the first and second planes of display data into linear space.

4. The method of claim 1, where the resolution of the first plane of display data is decreased by a first video scaler.

5. The method of claim 1, where the first plane of display data comprises an application-generated display surface, where the second plane of display data comprises a system-generated display surface, and where blending the first plane with the second plane comprises positioning the second plane over the first plane.

6. The method of claim 1, where the first plane of display data comprises an application-generated primary display surface, where the second plane comprises an application-generated overlay, and where blending the first plane with the second plane comprises positioning the second plane over the first plane.

7. The method of claim 1, where the first plane comprises a system-generated display surface, where the second plane comprises a system-generated overlay, and where blending the first plane with the second plane comprises positioning the second plane over the first plane.

8. The method of claim 1, where outputting the blended display data comprises outputting to a video encoder.

9. The method of claim 1, where the first plane of display data includes a left eye perspective and a right eye perspective, where the second plane of display data includes a left eye perspective and a right eye perspective, and where blending the first plane of display data with the second plane of display data includes blending a scaled version of the left eye perspective of the first plane with a scaled version of the left eye perspective of the second plane and blending a scaled version of the right eye perspective of the first plane with a scaled version of the right eye perspective of the second plane.

10. The method of claim 1 where the computing system includes a graphics processing unit (GPU), and where the graphics processing budget expresses bandwidth of the GPU.

11. A method for outputting three-dimensional display data using a computing device, the method comprising:

recognizing a graphics processing budget of the computing device;

in response to nearing the graphics-processing budget, scaling a left eye perspective of a first plane of display data to a lower resolution to adhere to the graphics-processing budget, and independently scaling a left eye perspective of a second plane of display data to a higher resolution;

in response to the nearing the graphics-processing budget, scaling a right eye perspective of the first plane of display data to the lower resolution to adhere to the graphics-processing budget, and independently scaling a right eye perspective of the second plane of display data to the higher resolution;

blending the left eye perspective of the first plane of display data with the left eye perspective of the second plane of display data to form a left eye perspective of blended display data;

blending the right eye perspective of the first plane of display data with the right eye perspective of the second plane of display data to form a right eye perspective of the blended display data; and

outputting to a three-dimensional display device the left eye perspective of the blended display data and the right eye perspective of the blended display data at or above a predetermined frame rate without exceeding the graphics processing budget.

12. The method of claim 11, where the first plane comprises an application-generated primary display surface, where the second plane comprises a head-up display element.

13. The method of claim 12, where the first plane comprises an application-generated primary display surface, where the second plane comprises a system-generated overlay, and where said blending comprises positioning the second plane over the first plane for the left and right eye perspectives.

14. The method of claim 12, where scaling comprises packing a frame buffer for display-specific rendering.

15. The method of claim 12, where frame buffer memory associated with the first plane of display data and frame buffer memory associated with the second plane of display data are each structured to support display-agnostic rendering, and where scaling the left eye perspective or the right eye perspective of the first plane or the second plane comprises referencing the frame buffer memory associated with that plane and formatting the left eye perspective or the right eye perspective of that plane for display-specific rendering.

16. The method of claim 15, where referencing the frame buffer memory associated with that plane comprises obtaining regions of display data of that plane associated with a left eye or a right eye in order to incorporate parallax on a pixel-by-pixel basis, and where scaling the left eye perspective or the right eye perspective of that plane comprises packing a frame buffer with data from the regions obtained via the frame buffer memory.

17. The method of claim 15, where scaling further comprises incorporating parallax in order to produce the right eye perspective as a final horizontal pixel offset applied to the region of display data associated with a left eye based on an offset parameter stored in a configuration register.

18. The method of claim 12, where scaling the right eye perspective of the first plane of display data comprises specifying a pixel offset with respect to the left eye perspective of the first plane of display data.

19. A method for outputting a video stream using a computing device, the method comprising:

recognizing a graphics processing budget of the computing device;

retrieving from memory a first plane of display data comprising application-generated moving content;

in response to nearing the graphics-processing budget, decreasing a resolution of the first plane of display data while maintaining a predetermined frame rate of the first plane of display data as the graphics processing budget to adhere to the graphics-processing budget;

retrieving from memory a second plane of display data comprising a static overlay to be positioned over the moving content;

independently maintaining a resolution of the second plane of display data while the resolution of the first plane of display data is decreased;

blending the first plane of display data with the second plane of display data to form blended display data; and

outputting the blended display data to a video encoder at or above the predetermined frame rate without exceeding the graphics processing budget.

20. The method of claim 19 further comprising applying one or more of an input color space conversion, an inverse gamma correction, and a video scaler independently to the first and second planes of display data.