System and method for composing a display frame of multiple layered graphic sprites

• US 5,546,518 A
• Filed: 01/06/1995
• Issued: 08/13/1996
• Est. Priority Date: 01/06/1995
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Edwards, Michael, Blossom, Jon
• Primary Examiner(s): Herndon, Heather R.
• Assistant Examiner(s): BUCHEL JR, RUDOLPH JOHN
• Application Number:
  US08/369,649
• Time in Patent Office: 585 Days
• Field of Search: 395/121, 395/157-158, 395/152, 395/135
• US Class Current: 345/473
• CPC Class Codes: G06T 15/503 Blending, e.g. for anti-aliasing
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video
• CPC Class Codes: H04N 19/23 with coding of regions that are present throughout a whole video segment, e.g. sprites, background or mosaic
• CPC Class Codes: H04N 5/45 Picture in picture , e.g. displaying simultaneously another television channel in a region of the screen
• CPC Class Codes: H04N 9/75 Chroma key
• CPC Class Codes: Y10S 345/95 Sprite processing

Abstract

A data processing apparatus includes a graphics display device for displaying a display frame comprising a plurality of display frame pixels. A sprite management system composes the display frame from a plurality of graphic sprites. Each graphic sprite comprises a plurality of sprite pixels and corresponding sprite pixel values. Each sprite has a specified depth relative to the other sprites. One of the sprites is designated to be a video sprite. This sprite is loaded with a chroma-key value. The sprite management system includes a data processing device connected to access a display frame composition buffer. The data processing device is programmed to write pixel values of individual sprites to the display frame composition buffer. This writing begins with the pixel values of the sprite having the greatest depth and proceeds with the pixel values of the remaining sprites in order of decreasing sprite depth. The display frame data is then passed to a video overlay board which overlays a video image over those pixels containing the chroma-key value. The result is a display frame in which the plurality of graphic sprites, including the video sprite, appear layered with respect to each other in accordance with their respectively specified depths.

Claims

1. In a data processing apparatus having a graphics display device for displaying a display frame comprising a plurality of display frame pixels, the data processing apparatus having a display frame composition buffer with mapped locations corresponding to the individual display frame pixels, a method of displaying graphic sprites represented by sprite pixels and having specified depths relative to each other, the method comprising the following steps:

designating at least one of the graphic sprites to be a video sprite;

setting non-transparent pixels of the designated graphic sprite to a pre-selected key value;

writing at least the non-transparent pixels of the graphic sprites to the display frame composition buffer;

beginning said writing step with the pixels of the graphic sprite having the greatest depth and proceeding with the pixels of the remaining graphic sprites in order of decreasing depth, wherein each sprite pixel written to a particular display frame composition buffer location replaces any sprite pixel previously written to that same particular display frame composition buffer location;

overlaying a video image on the display frame, said overlaying being performed only over those display frame pixels contained in the display frame composition buffer which equal the pre-selected key value, the designated graphic sprite and its video image thereby appearing layered among the other graphic sprites in accordance with the respective depths of the graphic sprites.

2. A method as recited in claim 1 wherein the writing step comprises writing only the non-transparent pixels of the graphic sprites.

3. A method as recited in claim 1 wherein said setting step comprises setting only the non-transparent pixels of the designated sprite to the pre-selected key value.

4. A method as recited in claim 1 wherein said setting step comprises setting only the non-transparent pixels of the designated sprite to the pre-selected key value, the method further comprising an additional step of setting the transparent pixels of the designated sprite to a pre-selected transparent pixel value.

5. A method as recited in claim 1 wherein said setting step comprises setting only non-transparent pixels of the designated sprite to the pre-selected key value, the method further comprising an additional step of setting the transparent pixels of the designated sprite to a preselected transparent pixel value, said writing step comprising writing only those pixels which do not equal the pre-selected transparent pixel value.

6. In a data processing apparatus having a graphics display device for displaying a display frame comprising a plurality of display frame pixels, the data processing apparatus having a display frame composition buffer for storing a plurality of display frame pixel values at mapped locations corresponding to the individual display frame pixels, a method of displaying graphic sprites represented by sprite pixels and corresponding sprite pixel values stored in individual sprite buffers, the graphic sprites having specified depths relative to each other, the method comprising the following steps:

designating at least one of the graphic sprites to be a video sprite;

writing a pre-selected key value to at least those locations in the sprite buffer of the designated graphic sprite which correspond to non-transparent sprite pixels;

identifying a sprite depth order which begins with the graphic sprite having the greatest depth and which continues with the remaining graphic sprites in order of decreasing sprite depth;

transferring pixel values of individual graphic sprites from their respective sprite buffers to the display frame composition buffer;

said transferring step being performed sprite by sprite in accordance with the identified sprite depth order, wherein each sprite pixel value transferred to a particular display frame composition buffer location replaces any sprite pixel value previously transferred to that same particular display frame composition buffer location;

communicating the pixel values transferred to the display frame composition buffer to a video overlay circuit;

the video overlay circuit performing a step of overlaying a video image on the display frame, said overlaying being performed only over those display frame pixels which have values equal to the pre-selected key value, the designated graphic sprite and its video image thereby appearing layered in accordance with the depths of the graphic sprites.

7. A method as recited in claim 6 wherein the transferring step comprises transferring only the non-transparent pixels of the graphic sprites.

8. A method as recited in claim 6 wherein the writing step writes the pre-selected key value to only those locations in the sprite buffer of the designated graphic sprite which correspond to non-transparent sprite pixels.

9. A method as recited in claim 6 wherein the writing step writes the pre-selected key value to only those locations in the sprite buffer of the designated graphic sprite which correspond to non-transparent sprite pixels, the method further comprising an additional step of writing a pre-selected transparent pixel value to locations in the sprite buffer of the designated graphic sprite which correspond to transparent pixels.

10. A method as recited in claim 6 wherein the writing step writes the pre-selected key value to only those locations in the sprite buffer of the designated graphic sprite which correspond to non-transparent sprite pixels, the method further comprising an additional step of writing a pre-selected transparent pixel value to locations in the sprite buffer of the designated graphic sprite which correspond to transparent pixels, said transferring step comprising transferring only those pixel values which are not equal to the pre-selected transparent pixel value.

11. A method as recited in claim 6 and further comprising:

specifying a pre-selected transparent pixel value to represent transparent sprite pixels;

wherein the transferring step comprises transferring only those sprite pixel values which are not equal to the pre-selected transparent pixel value.

12. In a data processing apparatus having a graphics display device for displaying a display frame comprising a plurality of display frame pixels, a sprite management system for displaying graphic sprites represented by sprite pixels, the graphic sprites having specified depths relative to each other, the sprite management system comprising:

a data processing device;

a display frame composition buffer connected to be accessed by the data processing device for storing a plurality of display frame pixels at mapped locations corresponding to the individual display frame pixels;

the data processing device being programmed to designate at least one of the plurality of graphic sprites to be a video sprite and to set non-transparent pixels of the designated sprite to a pre-selected key value;

the data processing device being further programmed to write at least the non-transparent pixels of the graphic sprites to the display frame composition buffer, said writing beginning with the pixels of the graphic sprite having the greatest depth and proceeding with the pixels of the remaining graphic sprites in order of decreasing sprite depth, wherein each sprite pixel written to a particular display frame composition buffer location replaces any sprite pixel previously written to that same particular display frame composition buffer location;

the sprite management system further comprising a video overlay circuit connected to receive the written pixel values from the display frame composition buffer and to overlay a video image on the display frame, the video overlay circuit being of a type which overlays the video image only on display frame pixels having values from the composition buffer which are equal to the pre-selected key value, the designated graphic sprite and its video image thereby appearing layered among the other graphic sprites in accordance with the depths of the graphic sprites.

13. A sprite management system as recited in claim 12 wherein the data processing device is further programmed to write only the non-transparent pixels of the graphic sprites to the display frame composition buffer.

14. A sprite management system as recited in claim 12 wherein the data processing device is further programmed to set only the non-transparent pixels of the designated graphic sprite to the pre-selected key value.

15. A sprite management system as recited in claim 12 wherein the data processing device is further programmed to set only the non-transparent pixels of the designated graphic sprite to the pre-selected key value, the data processor being further programmed to set the transparent pixels of the designated sprite to a pre-selected transparent pixel value.

16. A sprite management system as recited in claim 12 wherein the data processing device is further programmed to set only the non-transparent pixels of the designated graphic sprite to the pre-selected key value, the data processor being further programmed to set the transparent pixels of the designated sprite to a pre-selected transparent pixel value and to write to the display frame composition buffer only those pixels which do not equal the pre-selected transparent pixel value.

17. In a data processing apparatus having a graphics display device for displaying a display frame comprising a plurality of display frame pixels, a sprite management system for displaying graphic sprites represented by sprite pixels and corresponding sprite pixel values, the graphic sprites having specified depths relative to each other, the sprite management system comprising:

a data processing device;

a display frame composition buffer connected to be accessed by the data processing device for storing a plurality of display frame pixel values at mapped locations corresponding to the individual display frame pixels;

individual sprite buffers corresponding to the respective graphic sprites, the sprite buffers being connected to be accessed by the data processing device, the sprite buffers containing sprite pixel values at mapped locations corresponding to the pixels of the respective graphic sprites;

the data processing device being programmed to designate at least one of the plurality of graphic sprites to be a video sprite and to load the sprite buffer of the designated graphic sprite with a pre-selected key value;

the data processing device being further programmed to transfer non-transparent pixel values of individual graphic sprites from their respective sprite buffers to the display frame composition buffer, said transfer beginning with the pixel values of the graphic sprite having the greatest depth and proceeding with the pixel values of the remaining graphic sprites in order of decreasing sprite depth, wherein each sprite pixel value transferred to a particular display frame composition buffer location replaces any sprite pixel value previously transferred to that same particular display frame composition buffer location;

the sprite management system further comprising a video overlay circuit connected to receive the transferred pixel values from the display frame composition buffer and to overlay a video image on the display frame, the video overlay circuit being of a type which overlays the video image only on display frame pixels from the composition buffer which have values equal to the pre-selected key value, the designated graphic sprite and its video image thereby appearing layered among the other graphic sprites in accordance with the depths of the graphic sprites.

18. A sprite management system as recited in claim 17 wherein the data processing device is further programmed to transfer only the non-transparent pixel values of the individual graphic sprites.

19. A sprite management system as recited in claim 17 wherein the data processing device is further programmed to load the preselected key value to only those locations in the sprite buffer of the designated graphic sprite which correspond to non-transparent sprite pixels.

20. A sprite management system as recited in claim 17 wherein the data processing device is further programmed to load the preselected key value to only those locations in the sprite buffer of the designated graphic sprite which correspond to non-transparent sprite pixels, and to write a pre-selected transparent pixel value to locations in the sprite buffer of the designated graphic sprite which correspond to transparent pixels.

21. A sprite management system as recited in claim 17 wherein the data processing device is further programmed to load the preselected key value to only those locations in the sprite buffer of the designated graphic sprite which correspond to non-transparent sprite pixels, to write a pre-selected transparent pixel value to locations in the sprite buffer of the designated graphic sprite which correspond to transparent pixels, and to transfer to the display frame composition buffer only those pixel values which are not equal to the pre-selected transparent pixel value.

22. In a data processing apparatus having a graphics display device for displaying a display frame comprising a plurality of display frame pixels, a sprite management system for displaying graphic sprites represented by sprite pixels and corresponding sprite pixel values, the graphic sprites having specified depths relative to each other, the sprite management system comprising:

a display frame composition buffer which stores a plurality of display frame pixel values at mapped locations corresponding to the individual display frame pixels;

individual sprite buffers corresponding to the respective graphic sprites, the sprite buffers containing sprite pixel values at mapped locations corresponding to the pixels of the respective sprites;

at least one of the plurality of graphic sprites being designated as a video sprite;

loading means for loading the sprite buffer of the designated graphic sprite with a pre-selected key value;

transfer means for transferring pixel values of individual graphic sprites from their respective sprite buffers to the display frame composition buffer, said transfer means first transferring the pixel values of the graphic sprite having the greatest depth and subsequently transferring the pixel values of the remaining graphic sprites in order of decreasing sprite depths, wherein each sprite pixel value transferred to a particular display frame composition buffer location replaces any sprite pixel value previously transferred to that same particular display frame composition buffer location;

overlay means connected to receive the transferred pixel values from the display frame composition buffer for overlaying a video image on the display frame, the overlay means being further for overlaying the video image only on display frame pixels from the composition buffer which have values equal to the pre-selected key value, the designated graphic sprite and its video image thereby appearing layered among the other graphic sprites in accordance with the depths of the graphic sprites.

23. A sprite management system as recited in claim 22 wherein the transfer-means transfers only the non-transparent pixel values of the individual graphic sprites.

24. A sprite management system as recited in claim 22 wherein the loading means loads the pre-selected key value to only those locations in the sprite buffer of the designated graphic sprite which correspond to non-transparent sprite pixels.

25. A sprite management system as recited in claim 22 wherein the loading means loads the pre-selected key value to only those locations in the sprite buffer of the designated graphic sprite which correspond to non-transparent sprite pixels and loads a pre-selected transparent pixel value to locations in the sprite buffer of the designated graphic sprite which correspond to transparent pixels.

26. A sprite management system as recited in claim 22 wherein the loading means loads the pre-selected key value to only those locations in the sprite buffer of the designated graphic sprite which correspond to non-transparent sprite pixels and loads a pre-selected transparent pixel value to locations in the sprite buffer of the designated graphic sprite which correspond to transparent pixels, the transfer means transferring to the display frame composition buffer only those pixel values which are not equal to the pre-selected transparent pixel value.