System and method for layering using tile-based renderers

• US 9,715,750 B2
• Filed: 05/13/2016
• Issued: 07/25/2017
• Est. Priority Date: 09/12/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Patel, Amar, Pronovost, Steve, Pelton, Blake D.
• Primary Examiner(s): AMIN, JWALANT B
• Application Number:
  US15/154,912
• Publication Number:
  US 20170061662A1
• Time in Patent Office: 438 Days
• Field of Search: None
• CPC Class Codes: G06F 17/00 Digital computing or data processing equipment or methods, specially adapted for specific functions information retrieval, database structures or file system structures therefor G06F16/00
• CPC Class Codes: G06F 9/44 Arrangements for executing specific programs
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06T 1/00 General purpose image data processing
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 11/40 Filling a planar surface by adding surface attributes, e.g. colour or texture
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G09G 2360/122 Tiling
• CPC Class Codes: G09G 5/36 characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
• CPC Class Codes: G09G 5/363 Graphics controllers

Abstract

A method for tile-based rendering of content. Content may be rendered in a memory region organized as multiple tiles. In scenarios in which content is generated in layers, for operations that involve compositing image layers, an order in which portions of the image are processed may be selected to reduce the aggregate number of memory accesses times, which in turn may improve the performance of a computer that uses tile-based rendering. An image may be processed such that operations relating to rendering portions of different layers corresponding to the same tile are performed sequentially. Such processing may be used in a computer with a graphics processing unit that supports tile-based rendering, and may be particularly well suited for computers with a slate form factor. An interface to a graphics processing utility within the computer may provide a flag to allow an application to specify whether operations may be reordered.

Claims

1. A method of rendering content, comprising:

rendering at least a first portion of content corresponding to a first tile to produce one or more pixel values, wherein the content comprises a plurality of content layers, and wherein the content is organized as a plurality of tiles including the first tile and a second tile;

receiving an indication of whether the content is to be rendered tile-then-layer or layer-then-tile based at least in part on potential dependency of output for one tile on content for another tile, wherein;

tile-then-layer rendering includes at least one operation for compositing values for portions for at least two layers associated with the first tile before rendering a second portion of the content corresponding to the second tile; and

if the indication indicates that the content is to be rendered tile-then-layer;

compositing values for the portions of the at least two layers associated with the first tile before rendering the second portion of the content corresponding to the second tile.

2. The method of claim 1, wherein at least the first portion of the content comprises a first content layer and a second content layer, wherein the one or more pixel values comprise a first set of pixel values and a second set of pixel values, and wherein the rendering of the at least the first portion of the content corresponding to the first tile includes:

rendering at least a portion of the first content layer corresponding to the first tile to calculate the first set pixel values;

in response to rendering at least the portion of the first content layer, copying the first set of pixel values to a region of a memory; and

in response to the copying, rendering at least a portion of the second content layer corresponding to the first tile to calculate the second set of pixel values.

3. The method of claim 2, wherein the memory is communicatively coupled to a graphics processing unit (GPU) of a computing device, and wherein the memory is not onboard the GPU.

4. The method of claim 2, wherein the method further comprises:

using at least one of the first set of pixel values or the second set of pixel values to obtain one or more new pixel values.

5. The method of claim 1, wherein receiving the indication comprises:

receiving an indication through an interface to a graphics processing routine.

6. The method of claim 5, wherein the indication comprises a parameter whose value indicates to first perform at least one operation on the one or more pixel values.

7. A system for rendering content, the system comprising:

a graphics processing unit (GPU) having rendering hardware, wherein the GPU is configured to;

receive an indication of a sequence in which the GPU is to render tiles and layers of a graphical image with respect to each other, the indication being based at least in part on whether content for individual tiles is renderable independent of content for other tiles, and wherein the graphical image is to be presented on a display associated with the computing device; and

configure the GPU according to the indicated sequence.

8. The system of claim 7, wherein at least a first portion of the graphical image comprises a first content layer and a second content layer, and wherein the GPU is further configured to:

render at least the first portion of the graphical image corresponding to a first tile.

9. The system of claim 8, wherein the GPU is further configured to:

render the at least the first portion of the graphical image corresponding to the first tile by;

rendering at least a portion of the first content layer corresponding to the first tile to calculate a first set pixel values;

in response to rendering at least the portion of the first content layer, copying the first set of pixel values to a region of a memory; and

in response to the copying, rendering at least a portion of the second content layer corresponding to the first tile to calculate the second set of pixel values.

10. The system of claim 7, further comprising:

a memory that is communicatively coupled to the GPU, wherein the memory is not onboard the GPU.

11. The system of claim 7, wherein receiving the indication comprises:

receiving an indication through an interface to a graphics processing routine.

12. The system of claim 7, wherein the indication comprises a parameter whose value indicates to first perform at least one operation on the one or more pixel values.

13. The system of claim 7, wherein the GPU is further configured to:

apply at least one of a transparency or a clipping effect to at least a portion of the graphical image corresponding to a first tile.

14. The system of claim 7, wherein the GPU is further configured to:

complete at least one operation for one or more pixel values corresponding to a first tile before performing any rendering of a second tile.

15. A method of rendering content, the method comprising:

receiving, by a graphics processing unit (GPU) having rendering hardware, an indication of how the GPU is to render tiles and layers of a graphical image with respect to each other, the indication being based at least in part on whether content for individual tiles is renderable independent of content for other tiles;

configuring the GPU according to the received indication; and

rendering at least a first portion of the graphical image by the configured GPU for presentation on a display.

16. The method of claim 15, wherein the method further comprises:

rendering the at least the first portion of the graphical image by;

rendering at least a portion of a first content layer corresponding to a first tile to calculate a first set pixel values;

in response to rendering at least the portion of the first content layer, copying the first set of pixel values to a region of a memory; and

in response to the copying, rendering at least a portion of a second content layer corresponding to the first tile to calculate a second set of pixel values.

17. The method of claim 15, wherein receiving the indication comprises:

receiving an indication through an interface to a graphics processing routine.

18. The method of claim 15, wherein the indication comprises a parameter whose value indicates to first perform at least one operation on the one or more pixel values.

19. The method of claim 15, wherein the indication comprises at least one of an indication that the GPU is to perform rendering on a tile-then-layer basis or that the GPU is to perform rendering on a layer-then-tile basis.

20. The method of claim 15, wherein the method further comprises:

completing at least one operation for one or more pixel values corresponding to a first tile before performing any rendering of a second tile.