POST-RENDER GRAPHICS OVERLAYS

• US 20080284798A1
• Filed: 05/06/2008
• Published: 11/20/2008
• Est. Priority Date: 05/07/2007
• Status: Abandoned Application

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Ellis, Brian, Elmieh, Baback, Wilson, Simon, Weybrew, Steven Todd
• Application Number:
  US12/116,056
• Publication Number:
  US 20080284798A1
• Time in Patent Office: Days
• US Class Current: 345/630
• CPC Class Codes: G06T 15/503 Blending, e.g. for anti-aliasing

Abstract

In general, the present disclosure describes various techniques for overlaying or combining a set of rendered graphics surfaces onto a single graphics frame. One example device includes a first processor that selects a surface level for each of a plurality of rendered graphics surfaces prior to the device outputting any of the rendered graphics surfaces to a display. The device further includes a second processor that retrieves the rendered graphics surfaces, overlays the rendered graphics surfaces onto a graphics frame in accordance with each of the selected surface levels, and outputs the graphics frame to the display.

Claims

1. A device comprising:

a first processor that selects a surface level for each of a plurality of rendered graphics surfaces prior to the device outputting any of the rendered graphics surfaces to a display; and

a second processor that retrieves the rendered graphics surfaces, overlays the rendered graphics surfaces onto a graphics frame in accordance with each of the selected surface levels, and outputs the graphics frame to the display.

2. The device of claim 1, wherein:

the first processor and the second processor are separate processors, and

the first processor and the second processor are each selected from a group consisting of a graphics processor, a display processor, and a control processor.

3. The device of claim 1, further comprising:

one or more surface buffers; and

a third processor that renders the rendered graphics surfaces, and stores the rendered graphics surfaces in the one or more surface buffers,

wherein the second processor retrieves the rendered graphics surfaces from the one or more surface buffers.

4. The device of claim 3, wherein:

the third processor comprises a graphics processor comprising an accelerated three-dimensional (3D) graphics pipeline, and

the first processor comprises a control processor comprising a general purpose processing pipeline.

5. The device of claim 3, wherein:

the rendered graphics surfaces comprise a first set of rendered graphics surfaces,

the first processor renders a second set of rendered graphics surfaces, and selects a surface level for each of the rendered graphics surfaces in the second set of rendered graphics surfaces prior to the device outputting any of the rendered graphics surfaces to the display, and

the second processor overlays the second set of rendered graphics surfaces onto the graphics frame in accordance with the selected surface levels.

6. The device of claim 5, wherein:

at least one of the rendered graphics surfaces in the first set of rendered graphics surfaces comprises an on-screen surface, and

each of the rendered graphics surfaces in the second set of rendered graphics surfaces comprises an off-screen surface.

7. The device of claim 5, wherein:

each of the rendered graphics surfaces in the first set of rendered graphics surfaces comprises a three-dimensional (3D) surface, and

at least one of the rendered graphics surfaces in the second set of rendered graphics surfaces comprises a surface selected from a group consisting of a two-dimensional (2D) surface and a video surface.

8. The device of claim 3, wherein:

the third processor comprises a primitive processing unit that performs operations on primitives, and a pixel processing unit that performs pixel operations, and

the second processor performs a limited set of the pixel operations.

9. The device of claim 8, wherein a number of unique pixel operations performed by the second processor is less than a number of unique pixel operations performed by the pixel processing unit.

10. The device of claim 1, wherein:

the second processor comprises an overwrite block, and

when the rendered graphics surfaces overlap, the overwrite block selects one of the rendered graphics surfaces having a highest surface level, and formats the graphics frame such that the selected one of the rendered graphics surfaces is displayed for overlapping portions of the rendered graphics surfaces.

11. The device of claim 1, wherein:

the second processor overlays the rendered graphics surfaces onto the graphics frame at least in part by combining the rendered graphics surfaces according to one or more compositing modes, wherein the one or more compositing modes include at least one of color keying with constant alpha blending, color keying without constant alpha blending, full surface constant alpha blending, or full surface per-pixel alpha blending.

12. The device of claim 1, wherein:

the first processor generates an overlay stack having a plurality of layers, and binds each of the rendered graphics surfaces to individual layers within the overlay stack,

the second processor overlays the rendered graphics surfaces onto the graphics frame in accordance with the overlay stack.

13. The device of claim 12, wherein:

each of the layers in the overlay stack has a unique layer level, and

when the graphics frame is displayed on the display, rendered graphics surfaces bound to a layer having a first layer level within the overlay stack appear closer to a viewer of the display than rendered graphics surfaces bound to layers having layer levels lower than the first layer level.

14. The device of claim 12, wherein:

the first processor selectively enables and disables individual layers within the overlay stack for each graphics frame to be displayed,

when a first layer within the overlay stack is enabled for a first graphics frame, the second processor processes each of the rendered graphics surfaces bound to the first layer to generate the first graphics frame, and

when the first layer is disabled for the first graphics frame, the second processor does not process any rendered graphics surfaces bound to the first layer to generate the first graphics frame.

15. The device of claim 1, wherein:

the first processor selectively enables and disables individual rendered graphics surfaces for each graphics frame to be displayed;

when a first rendered graphics surface within the plurality of rendered graphics surfaces is enabled for a first graphics frame, the second processor processes the first rendered graphics surface to generate the first graphics frame;

when the first rendered graphics surface is disabled for the first graphics frame, the second processor does not process the first rendered graphics surface to generate the first graphics frame.

16. The device of claim 1, wherein the rendered graphics surfaces comprise a first set of rendered graphics surfaces, the device further comprising:

a first surface buffer;

a second surface buffer;

a first graphics processor that generates the first set of rendered graphics surfaces, and stores the first set of rendered graphics surfaces in the first surface buffer; and

a second graphics processor that generates a second set of rendered graphics surfaces, and stores the second set of rendered graphics surfaces in the second surface buffer,

wherein the first processor selects a surface level for each of the rendered graphics surfaces within the second set of rendered graphics surfaces prior to the device outputting any of the rendered graphics surfaces to the display, and

wherein the second processor retrieves the first set of rendered graphics surfaces from the first surface buffer, retrieves the second set of rendered graphics surfaces from the second surface buffer, and overlays the first set of rendered graphics surfaces and the second set of rendered graphics surfaces onto the graphics frame in accordance with each of the selected surface levels.

17. The device of claim 16, wherein:

the first graphics processor comprises an accelerated three-dimensional (3D) graphics pipeline; and

the second graphics processor comprises an accelerated two-dimensional (2D) graphics pipeline.

18. The device of claim 1, wherein the device comprises a wireless communication device handset.

19. The device of claim 1, wherein the device comprises one or more integrated circuit devices.

20. A method comprising:

retrieving a plurality of rendered graphics surfaces;

selecting a surface level for each of the rendered graphics surfaces prior to outputting any of the rendered graphics surfaces to a display;

overlaying the rendered graphics surfaces onto a graphics frame in accordance with each of the selected surface levels; and

outputting the graphics frame to the display.

21. The method of claim 20, further comprising:

generating the rendered graphics surfaces; and

storing the rendered graphics surfaces in one or more surface buffers,

wherein retrieving the plurality of rendered graphics surfaces comprises retrieving the plurality of rendered graphics surfaces from the one or more surface buffers.

22. The method of claim 20, wherein the rendered graphics surfaces comprise a first set of rendered graphics surfaces, and wherein the method further comprises:

generating the first set of rendered graphics surfaces with a first processor;

generating a second set of rendered graphics surfaces with a second processor, wherein the first processor and the second processor are separate processors;

selecting a surface level for each rendered graphics surface in the second set of rendered graphics surfaces; and

overlaying the second set of rendered graphics surfaces onto the graphics frame in accordance with the selected surface levels.

23. The method of claim 22, wherein:

at least one of the rendered graphics surfaces in the first set of rendered graphics surfaces comprises an on-screen surface, and

each of the rendered graphics surfaces in the second set of rendered graphics surfaces comprises an off-screen surface.

24. The method of claim 22, wherein:

each of the rendered graphics surfaces in the first set of rendered graphics surfaces comprises a three-dimensional (3D) surface, and

at least one of the rendered graphics surfaces in the second set of rendered graphics surfaces comprises a surface selected from a group consisting of a two-dimensional (2D) surface and a video surface.

25. The method of claim 20, wherein overlaying the rendered graphics surfaces onto the graphics frame in accordance with each of the selected surface levels comprises:

selecting one of the rendered graphics surfaces having a highest surface level when the rendered graphics surfaces overlap; and

formatting the graphics frame such that the selected one of the rendered graphics surfaces is displayed for overlapping portions of the rendered graphics surfaces.

26. The method of claim 20, wherein overlaying the rendered graphics surfaces onto the graphics frame in accordance with each of the selected surface levels comprises:

combining the rendered graphics surfaces according to one or more compositing modes, wherein the one or more compositing modes include at least one of color keying with constant alpha blending, color keying without constant alpha blending, full surface constant alpha blending, or full surface per-pixel alpha blending.

27. The method of claim 20, further comprising:

generating an overlay stack having a plurality of layers;

binding each of the rendered graphics surfaces to individual layers within the overlay stack;

overlaying the rendered graphics surfaces onto the graphics frame in accordance with the overlay stack.

28. The method of claim 27, wherein each of the layers in the overlay stack has a unique layer level, and wherein overlaying the rendered graphics surfaces onto the graphics frame in accordance with the overlay stack comprises:

formatting the graphics frame such that when the graphics frame is displayed on the display, rendered graphics surfaces bound to a layer having a first layer level within the overlay stack appear closer to a viewer of the display than rendered graphics surfaces bound to layers having layer levels lower than the first layer level.

29. The method of claim 27, further comprising:

selectively enabling individual layers within the overlay stack for each graphics frame to be displayed;

processing each of the rendered graphics surfaces bound to a first layer within the overlay stack to generate a first graphics frame when the first layer is enabled for the first graphics frame; and

not processing any rendered graphics surfaces bound to the first layer to generate the first graphics frame when the first layer is disabled for the first graphics frame.

30. The method of claim 27, further comprising:

selectively enabling individual rendered graphics surfaces for each graphics frame to be displayed;

processing a first rendered graphics surface to generate a first graphics frame when a first rendered graphics surface is enabled for a first graphics frame;

not processing the first rendered graphics surface to generate the first graphics frame when the first rendered graphics surface is disabled for the first graphics frame.

31. The method of claim 20, wherein the rendered graphics surfaces comprise a first set of rendered graphics surfaces, and wherein the method further comprises:

generating the first set of rendered graphics surfaces with a first graphics processor;

generating a second set of rendered graphics surfaces with a second graphics processor;

storing the first set of rendered graphics surfaces in a first surface buffer;

storing the second set of rendered graphics surfaces in a second surface buffer;

selecting a surface level for each rendered graphics surfaces within the second set of rendered graphics surfaces prior to outputting any of the rendered graphics surfaces to the display;

retrieving the first set of rendered graphics surfaces from the first surface buffer;

retrieving the second set of rendered graphics surfaces from the second surface buffer; and

overlaying the first set of rendered graphics surfaces and the second set of rendered graphics surfaces onto the graphics frame in accordance with each of the selected surface levels.

32. The method of claim 31, wherein:

the first graphics processor comprises an accelerated three-dimensional (3D) graphics pipeline; and

the second graphics processor comprises an accelerated two-dimensional (2D) graphics pipeline.

33. A device comprising:

means for retrieving a plurality of rendered graphics surfaces;

means for selecting a surface level for each of the rendered graphics surfaces prior to outputting any of the rendered graphics surfaces to a display;

means for overlaying the rendered graphics surfaces onto a graphics frame in accordance with each of the selected surface levels; and

means for outputting the graphics frame to the display.

34. The device of claim 33, further comprising:

means for generating the rendered graphics surfaces; and

means for storing the rendered graphics surfaces in one or more surface buffers,

wherein the means for retrieving the plurality of rendered graphics surfaces comprises means for retrieving the plurality of rendered graphics surfaces from the one or more surface buffers.

35. The device of claim 33, wherein the rendered graphics surfaces comprise a first set of rendered graphics surfaces, and wherein the device further comprises:

means for generating the first set of rendered graphics surfaces with a first processor;

means for generating a second set of rendered graphics surfaces with a second processor, wherein the first processor and the second processor are separate processors;

means for selecting a surface level for each rendered graphics surface in the second set of rendered graphics surfaces; and

means for overlaying the second set of rendered graphics surfaces onto the graphics frame in accordance with the selected surface levels.

36. The device of claim 35, wherein:

at least one of the rendered graphics surfaces in the first set of rendered graphics surfaces comprises an on-screen surface, and

each of the rendered graphics surfaces in the second set of rendered graphics surfaces comprises an off-screen surface.

37. The device of claim 35, wherein:

each of the rendered graphics surfaces in the first set of rendered graphics surfaces comprises a three-dimensional (3D) surface, and

at least one of the rendered graphics surfaces in the second set of rendered graphics surfaces comprises a surface selected from a group consisting of a two-dimensional (2D) surface and a video surface.

38. The device of claim 33, wherein the means for overlaying the rendered graphics surfaces onto the graphics frame in accordance with each of the selected surface levels comprises:

means for selecting one of the rendered graphics surfaces having a highest surface level when the rendered graphics surfaces overlap; and

means for formatting the graphics frame such that the selected one of the rendered graphics surfaces is displayed for overlapping portions of the rendered graphics surfaces.

39. The device of claim 33, wherein the means for overlaying the rendered graphics surfaces onto the graphics frame in accordance with each of the selected surface levels comprises:

means for combining the rendered graphics surfaces according to one or more compositing modes, wherein the one or more compositing modes include at least one of color keying with constant alpha blending, color keying without constant alpha blending, full surface constant alpha blending, or full surface per-pixel alpha blending.

40. The device of claim 33, further comprising:

means for generating an overlay stack having a plurality of layers;

means for binding each of the rendered graphics surfaces to individual layers within the overlay stack and

means for overlaying the rendered graphics surfaces onto the graphics frame in accordance with the overlay stack.

41. The device of claim 40, wherein each of the layers in the overlay stack has a unique layer level, and wherein the means for overlaying the rendered graphics surfaces onto the graphics frame in accordance with the overlay stack comprises:

means for formatting the graphics frame such that when the graphics frame is displayed on the display, rendered graphics surfaces bound to a layer having a first layer level within the overlay stack appear closer to a viewer of the display than rendered graphics surfaces bound to layers having layer levels lower than the first layer level.

42. The device of claim 40, further comprising:

means for selectively enabling individual layers within the overlay stack for each graphics frame to be displayed; and

means for processing each of the rendered graphics surfaces bound to a first layer within the overlay stack to generate a first graphics frame when the first layer is enabled for the first graphics frame, and not processing any rendered graphics surfaces bound to the first layer to generate the first graphics frame when the first layer is disabled for the first graphics frame.

43. The device of claim 33, further comprising:

means for selectively enabling individual rendered graphics surfaces for each graphics frame to be displayed; and

means for processing a first rendered graphics surface to generate a first graphics frame when a first rendered graphics surface is enabled for a first graphics frame, and not processing the first rendered graphics surface to generate the first graphics frame when the first rendered graphics surface is disabled for the first graphics frame.

44. The device of claim 33, wherein the rendered graphics surfaces comprise a first set of rendered graphics surfaces, and wherein the device further comprises:

means for generating the first set of rendered graphics surfaces with a first graphics processor;

means for generating a second set of rendered graphics surfaces with a second graphics processor;

means for storing the first set of rendered graphics surfaces in a first surface buffer;

means for storing the second set of rendered graphics surfaces in a second surface buffer;

means for selecting a surface level for each rendered graphics surface within the second set of rendered graphics surfaces prior to the device outputting any of the rendered graphics surfaces to the display;

means for retrieving the first set of rendered graphics surfaces from the first surface buffer;

means for retrieving the second set of rendered graphics surfaces from the second surface buffer; and

means for overlaying the first set of rendered graphics surfaces and the second set of rendered graphics surfaces onto the graphics frame in accordance with each of the selected surface levels.

45. The device of claim 44, wherein:

the first graphics processor comprises an accelerated three-dimensional (3D) graphics pipeline; and

the second graphics processor comprises an accelerated two-dimensional (2D) graphics pipeline.

46. A computer-readable medium comprising instructions that cause one or more processors to:

retrieve a plurality of rendered graphics surfaces;

select a surface level for each of the rendered graphics surfaces prior to outputting any of the rendered graphics surfaces to a display;

overlay the rendered graphics surfaces onto a graphics frame in accordance with each of the selected surface levels; and

output the graphics frame to the display.

47. The computer-readable medium of claim 46, further comprising instructions that cause the one or more processors to:

generate the rendered graphics surfaces; and

store the rendered graphics surfaces in one or more surface buffers,

wherein the instructions that cause the one or more processors to retrieve the plurality of rendered graphics surfaces comprise instructions that cause the one or more processors to retrieve the plurality of rendered graphics surfaces from the one or more surface buffers.

48. The computer-readable medium of claim 46, wherein the rendered graphics surfaces comprise a first set of rendered graphics surfaces, and wherein the computer-readable medium further comprises instructions that cause the one or more processors to:

generate the first set of rendered graphics surfaces;

generate a second set of rendered graphics surfaces;

select a surface level for each rendered graphics surface in the second set of rendered graphics surfaces; and

overlay the first set of rendered graphics surfaces and the second set of rendered graphics surfaces onto the graphics frame in accordance with the selected surface levels.

49. The computer-readable medium of claim 48, wherein:

at least one of the rendered graphics surfaces in the first set of rendered graphics surfaces comprises an on-screen surface, and

each of the rendered graphics surfaces in the second set of rendered graphics surfaces comprises an off-screen surface.

50. The computer-readable medium of claim 48, wherein:

each of the rendered graphics surfaces in the first set of rendered graphics surfaces comprises a three-dimensional (3D) surface, and

at least one of the rendered graphics surfaces in the second set of rendered graphics surfaces comprises a surface selected from a group consisting of a two-dimensional (2D) surface and a video surface.

51. The computer-readable medium of claim 46, wherein the instructions that cause the one or more processors to overlay the rendered graphics surfaces onto the graphics frame in accordance with each of the selected surface levels comprise instructions that cause the one or more processors to:

select one of the rendered graphics surfaces having a highest surface level when the rendered graphics surfaces overlap; and

format the graphics frame such that the selected one of the rendered graphics surfaces is displayed for overlapping portions of the rendered graphics surfaces.

52. The computer-readable medium of claim 46, wherein the instructions that cause the one or more processors to overlay the rendered graphics surfaces onto the graphics frame in accordance with each of the selected surface levels comprise instructions that cause the one or more processors to:

combine the rendered graphics surfaces according to one or more compositing modes, wherein the one or more compositing modes include at least one of color keying with constant alpha blending, color keying without constant alpha blending, full surface constant alpha blending, or full surface per-pixel alpha blending.

53. The computer-readable medium of claim 46, further comprising instructions that cause the one or more processors to:

generate an overlay stack having a plurality of layers;

bind each of the rendered graphics surfaces to individual layers within the overlay stack; and

overlay the rendered graphics surfaces onto the graphics frame in accordance with the overlay stack.

54. The computer-readable medium of claim 53, wherein each of the layers in the overlay stack has a unique layer level, and wherein the instructions that cause the one or more processors to overlay the rendered graphics surfaces onto the graphics frame in accordance with the overlay stack comprise instructions that cause the one or more processors to:

format the graphics frame such that when the graphics frame is displayed on the display, rendered graphics surfaces bound to a layer having a first layer level within the overlay stack appear closer to a viewer of the display than rendered graphics surfaces bound to layers having layer levels lower than the first layer level.

55. The computer-readable medium of claim 53, further comprising instructions that cause the one or more processors to:

selectively enable individual layers within the overlay stack for each graphics frame to be displayed;

process each of the rendered graphics surfaces bound to a first layer within the overlay stack to generate a first graphics frame when the first layer is enabled for the first graphics frame; and

not process any rendered graphics surfaces bound to the first layer to generate the first graphics frame when the first layer is disabled for the first graphics frame.

56. The computer-readable medium of claim 46, further comprising instructions that cause the one or more processors to:

selectively enable individual rendered graphics surfaces for each graphics frame to be displayed;

process a first rendered graphics surface to generate a first graphics frame when a first rendered graphics surface is enabled for a first graphics frame; and

not process the first rendered graphics surface to generate the first graphics frame when the first rendered graphics surface is disabled for the first graphics frame.

57. The computer-readable medium of claim 46, wherein the rendered graphics surfaces comprise a first set of rendered graphics surfaces, and wherein the computer-readable medium further comprises instructions that cause the one or more processors to:

generate the first set of rendered graphics surfaces with a first graphics processor;

generate a second set of rendered graphics surfaces with a second graphics processor;

store the first set of rendered graphics surfaces in a first surface buffer;

store the second set of rendered graphics surfaces in a second surface buffer;

select a surface level for each rendered graphics surfaces within the second set of rendered graphics surfaces prior to the device outputting any of the rendered graphics surfaces to the display;

retrieve the first set of rendered graphics surfaces from the first surface buffer;

retrieve the second set of rendered graphics surfaces from the second surface buffer; and

overlay the first set of rendered graphics surfaces and the second set of rendered graphics surfaces onto the graphics frame in accordance with each of the selected surface levels.

58. The computer-readable medium of claim 57, wherein:

the first graphics processor comprises an accelerated three-dimensional (3D) graphics pipeline; and

the second graphics processor comprises an accelerated two-dimensional (2D) graphics pipeline.