Compositing digital information on a display screen based on screen descriptor

• US 5,745,095 A
• Filed: 12/13/1995
• Issued: 04/28/1998
• Est. Priority Date: 12/13/1995
• Status: Expired due to Term

• Current Assignee: Rovi Technologies Corporation (Adeia Inc.)
• Original Assignee: Microsoft Corporation
• Inventors: Fries, Robert M., Parchem, John M.
• Primary Examiner(s): NGUYEN, CHANH DUY
• Application Number:
  US08/572,292
• Time in Patent Office: 867 Days
• Field of Search: 345/189, 345/190, 345/201, 345/203, 345/196, 345/185, 345/115, 345/113, 345/114, 345/119, 345/120, 348/564, 348/563, 348/567, 395/508, 395/509, 395/512
• US Class Current: 345/633
• CPC Class Codes: G09G 2340/10 Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video
• CPC Class Codes: G09G 5/42 characterised by the display of patterns using a display memory without fixed position correspondence between the display memory contents and the display position on the screen

Abstract

A method and system for producing a composite image of two or more graphic objects. In a set top box (44) designed to be used with a television receiver or video monitor (40), an application specific integrated circuit (ASIC) (76) is provided that includes a dynamic composition engine (DCE) (84), which generates a composite image for display on the screen of the television receiver. The composite image is based upon Screen Descriptor data that include a Line Descriptor defining each scan line using Span Descriptors. A Span Descriptor defines the portion of a line occupied by one of the objects that will comprise the composite image and specifies how that object will be combined with other objects on the line. A line buffer is filled with the pixels for the scan line next to be displayed while data in a second line buffer are written to the display screen. The two line buffers are then switched, enabling the next line to be composed in one line buffer while the data in the other line buffer are written to the screen. A new Screen Descriptor is produced if a change in the composite image occurs. When the last Line Descriptor in the current Screen Descriptor is processed, a pointer to the new Screen Descriptor is passed to the DCE to enable the new Screen Descriptor to be used for generating the next frame on the display screen.

Claims

1. A method for displaying objects on a screen as an image that comprises a plurality of scan lines, comprising the steps of:

(a) storing bitmap data in a memory for each object to be displayed on the screen;

(b) creating a data structure based on the bitmap data for each object, said data structure describing each object to be displayed on the screen and including a Screen Descriptor referencing a plurality of Line Descriptors that define the composition of each scan line of the screen, providing a composite of any objects that overlap on the scan line;

(c) storing the data structure in the memory;

(d) processing the data structure to produce video data for each scan line to be displayed on the screen; and

(e) generating an image on the screen using the video data for the scan lines of the screen, said image displaying the composite of any overlapping objects on the scan lines.

2. The method of claim 1, wherein the plurality of Line Descriptors each include at least one Span Descriptor, each Span Descriptor comprising information required to compose a span of the scan line, each span comprising a segment of the scan line in which one of a background and at least a portion of an object is disposed.

3. The method of claim 2, wherein the information in the Span Descriptor includes a length and a position of the span in the scan line, and an opcode that describes a format for elements of the screen comprising the image to be displayed.

4. The method of claim 2, wherein the information in the Span Descriptor includes a value that determines how the span will be mixed with an element that it overlaps in the scan line when the scan line is displayed on the screen.

5. The method of claim 1, wherein the data structure is processed one scan line at a time to generate the image.

6. The method of claim 1, wherein the data structure is processed for a plurality of scan lines at a time to generate the image.

7. The method of claim 1, wherein the Screen Descriptor includes a plurality of entries corresponding in number to the number of scan lines on the screen, an entry for a scan line comprising a count indicating the number of spans on said scan line and a pointer to the Line Descriptor for said scan line.

8. The method of claim 1, wherein the step of processing the data structure to produce video data for each scan line comprises the step of alternately loading one of two scan line composition buffers with the video data while video data in the other scan line composition buffer are displayed on the screen and then loading the other scan line composition buffer with video data while the video data in the one scan line composition buffer are displayed on the screen.

9. The method of claim 1, further comprising the step of creating an inactive Screen Descriptor that becomes active when a new frame is to be displayed on the screen, the Screen Descriptor that was previously used to produce video data becoming inactive while being updated to display a subsequent new frame on the screen.

10. The method of claim 9, wherein Screen Descriptor entries from an active Screen Descriptor are employed in the inactive Screen Descriptor for any scan lines that are unchanged in the subsequent new frame to be displayed, and new entries are created for scan lines that are changed in the subsequent new frame.

11. The method of claim 10, wherein pointers to the Screen Descriptor entries from the active Screen Descriptor are used to reference said Screen Descriptor entries for use in the subsequent new frame for any scan lines that are unchanged.

12. The method of claim 10, wherein a last Scan Descriptor in the active Screen Descriptor initiates an activation of the inactive Screen Descriptor and inactivation of the active Screen Descriptor.

13. The method of claim 1, wherein the Screen Descriptor includes pointers to the Line Descriptors in the memory.

14. The method of claim 1, wherein one Span Descriptor in a Line Descriptor specifies a fixed palette and a different Span Descriptor in said Line Descriptor specifies a variable palette to determine colors applied to each object displayed on the screen.

15. The method of claim 14, wherein the fixed palette is a universal palette that includes colors for optimally displaying objects on the screen, and the variable palette is a palette associated with an object, which may be different for different objects.

16. A system adapted for controlling the display of objects on a screen as an image comprising a plurality of scan lines, comprising:

(a) a memory for storing bitmap data for each of the objects and machine instructions controlling the operation of the system;

(b) a processor, coupled to the memory, for executing the machine instructions so as to implement a plurality of functions used for controlling the display of the objects, said plurality of functions including producing control signals for a dynamic composition engine, said dynamic composition engine producing video signals that are adapted to drive the screen to display the objects in response to the control signals, said dynamic composition engine including;

(i) means for creating a data structure based upon the bitmap data for each of the objects to be displayed, said data structure being stored in the memory, describing each object to be displayed on the screen, and including a Screen Descriptor referencing a plurality of Line Descriptors that define the composition of each scan line of the screen providing a composite of any objects that overlap on the scan line; and

(ii) means for processing the data structure to produce video data for each scan line to be displayed on the screen; and

(c) said system further including means for generating an image on the screen using the video data for the scan lines of the screen, said image displaying the composite of any overlapping objects on the scan lines.

17. The system of claim 16, wherein the processor, the memory, and the dynamic composition engine comprise a component to be used with a television, said television including the screen on which the image is displayed.

18. The system of claim 16, wherein the plurality of Line Descriptors each include at least one Span Descriptor, each Span Descriptor comprising information required to compose a span of the scan line, each span comprising a segment of the scan line in which one of a background and at least a portion of an object is disposed.

19. The system of claim 16, wherein the information in the Span Descriptor includes a length and a position of the span in the scan line, and an opcode that describes a format for elements of the screen comprising the image.

20. The system of claim 16, wherein the information in the Span Descriptor includes a value that determines how the span will be mixed with an element that it overlaps in the scan line when the scan line is displayed on the screen.

21. The system of claim 16, wherein the Screen Descriptor includes a plurality of entries corresponding in number to the number of scan lines on the screen, an entry for a scan line comprising a count indicating the number of spans on said scan line and a pointer to the Line Descriptor for said scan line.

22. The system of claim 16, further comprising two scan line composition buffers that are alternately loaded with video data for successive scan lines of the image, one of the scan line composition buffers being loaded with video data while video data in the other scan line composition buffer are displayed on the screen to compose the image, the other scan line composition buffer being then loaded with video data while the video data in said one scan line composition buffer are displayed on the screen to further compose the image.

23. The system of claim 16, further comprising means for creating an inactive Screen Descriptor that becomes active when a new frame is to be displayed on the screen, the Screen Descriptor that was previously used to produce video data then becoming inactive while being updated to display a subsequent new frame on the screen.

24. The system of claim 23, wherein Screen Descriptor entries from an active Screen Descriptor are employed in the inactive Screen Descriptor for any scan lines that are unchanged in the subsequent new frame to be displayed, and new entries are created for scan lines that are changed in the subsequent new frame.

25. The system of claim 24, wherein pointers to the Screen Descriptor entries from the active Screen Descriptor are provided to access said Screen Descriptor entries used in the subsequent new frame for any scan lines that are unchanged.

26. The system of claim 16, wherein the means for processing process the data structure one scan line at a time to generate the image.

27. The system of claim 16, wherein the means for processing process a plurality of scan lines at a time using the data structure to generate the image.

28. The system of claim 16, wherein the Screen Descriptor includes pointers to the Line Descriptors in the memory.

29. The system of claim 16, wherein one Span Descriptor in a Line Descriptor specifies a fixed palette and a different Span Descriptor in said Line Descriptor specifies a variable palette to determine colors applied to each object displayed on the screen.

30. The system of claim 29, wherein the fixed palette is a universal palette that includes colors for optimally displaying objects on the screen, and the variable palette is a palette associated with an object, which may be different for different objects.