Methods and systems for merging graphics for display on a computing device

• US 20040212621A1
• Filed: 05/20/2004
• Published: 10/28/2004
• Est. Priority Date: 03/23/2001
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Estrop, Stephen J., Wilt, Nicholas P., McCartney, Colin D.
• Granted Patent: US 7,315,307 B2
• Time in Patent Office: Days
• US Class Current: 345/473
• CPC Class Codes: G09G 2320/103 Detection of image changes, e.g. determination of an index representative of the image change
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 2340/10 Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: G09G 5/393 Arrangements for updating the contents of the bit-mapped memory
• CPC Class Codes: G09G 5/397 Arrangements specially adapted for transferring the contents of two or more bit-mapped memories to the screen simultaneously, e.g. for mixing or overlay G09G5/02 takes precedence
• CPC Class Codes: G09G 5/399 using two or more bit-mapped memories, the operations of which are switched in time, e.g. ping-pong buffers

Abstract

Disclosed are methods and systems that allow video applications to merge their outputs for display and to transform the outputs of other applications before display. A graphics arbiter tells applications the estimated time when the next frame will be displayed on a display screen. Applications tailor their output to the estimated display time. When output from a first application is incorporated into a scene produced by a second application, the graphics arbiter “offsets” the estimated display time it gives to the first application in order to compensate for the latency caused by the second application'"'"'s processing of the first application'"'"'s output. A set of overlay buffers parallels the traditional buffers used to prepare frames for the display screen. In composing a frame, the screen merges video information from a traditional buffer with that from an overlay buffer, conserving display resources at the final point in the display composition process.

Claims

1-3. -3. (Cancelled)

4. A method for an executable to transform first display information provided by a first display source distinct from the executable, the first display source associated with a first display memory surface set, the first display memory surface set distinct from a presentation surface set associated with a display device, the first display source releasing the first display information in the first display memory surface set, a graphics arbiter transferring second display information from an output display memory surface set to the presentation surface set associated with the display device, the method comprising:

gathering the first display information from the first display memory surface set associated with the first display source;

transforming the first display information; and

transferring the transformed display information to the output display memory surface set.

5. The method of claim 4 wherein the executable is in the set:

application program, graphics arbiter, and operating system.

6. The method of claim 4 wherein the output display memory surface set is associated with the executable.

7. The method of claim 4 wherein the output display memory surface set is the presentation surface set associated with the display device.

8. The method of claim 4 wherein transforming comprises performing an operation in the set:

stretching, texture mapping, lighting, highlighting, translating from a first display format into a second display format, and applying a multi-dimensional transformation.

9. The method of claim 4 further comprising:

gathering per-pixel alpha information from the first display source; and

gathering third display information from a second display memory surface set associated with a second display source;

wherein transforming comprises using the per-pixel alpha information to merge the first and second display information.

10. A computer-readable medium containing instructions for performing a method for an executable to transform first display information provided by a first display source distinct from the executable, the first display source associated with a first display memory surface set, the first display memory surface set distinct from a presentation surface set associated with a display device, the first display source releasing the first display information in the first display memory surface set, a graphics arbiter transferring second display information from an output display memory surface set to the presentation surface set associated with the display device, the method comprising:

gathering the first display information from the first display memory surface set associated with the first display source;

transforming the first display information; and

transferring the transformed display information to the output display memory surface set.

11-18. -18. (Cancelled)