Strategies for processing image information using a color information data structure

• US 7,929,754 B2
• Filed: 06/08/2009
• Issued: 04/19/2011
• Est. Priority Date: 08/01/2003
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Estrop, Stephen J., Evans, Glenn F.
• Primary Examiner(s): Tran; Phuoc
• Application Number:
  US12/480,478
• Publication Number:
  US 20100150441A1
• Time in Patent Office: 680 Days
• Field of Search: 382/162, 382/167, 382/303, 382/304, 348/441, 348/446
• US Class Current: 382/162
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G09G 2310/0229 De-interlacing
• CPC Class Codes: G09G 2340/0435 Change or adaptation of the frame rate of the video stream
• CPC Class Codes: G09G 2360/125 using unified memory architecture [UMA]
• CPC Class Codes: G09G 5/363 Graphics controllers
• CPC Class Codes: H04N 7/012 Conversion between an interlaced and a progressive signal for graphics images G09G2310/0229
• CPC Class Codes: H04N 7/0122 the input and the output signals having different aspect ratios
• CPC Class Codes: H04N 9/642 Multi-standard receivers
• CPC Class Codes: H04N 9/67 for matrixing camera processing pipelines for matrixing of colour signals H04N23/85
• CPC Class Codes: H04N 9/69 for modifying the colour signals by gamma correction controlling camera response for colour signals H04N23/83

Abstract

Strategies are described for processing image information using a data structure which conveys color information. The color information describes color-related formatting applied to the image information. The data structure can be passed down a video processing pipeline, where each functional component in the pipeline can draw color information from the data structure to improve the accuracy of its processing. Further, each component can supply previously unknown color information to the data structure for use by other (downstream) components in the pipeline. Exemplary fields of the data structure can include one or more of: a video transfer function field; a color primaries field; an image light field; a transfer matrix field; a nominal range field; and a video chroma sampling field. The transfer matrix field can be used to convert image information from one color space to another, such as a luma-related color space to an RGB-related color space. Processing operations can be performed on progressive and linear RGB image information.

Claims

1. A method for processing image information, the method comprising:

providing a principal video stream of image information;

providing a video sub-stream of image information; and

performing, via a graphics processing unit and based on color information specified in a color information data structure, at least two tasks involving the principal video stream and the video sub-stream to produce output video information expressed in a specified color space.

2. The method according to claim 1, wherein the specified color space is an RGB-related color space.

3. The method according to claim 2, wherein the RGB-related color space defines nonlinear RGB data.

4. The method according to claim 2, wherein the RGB-related color space defines linear RGB data.

5. The method according to claim 1, wherein the specified color space is a luma-related color space.

6. The method according to claim 1, wherein the specified color space defines a common color space for processing plural streams of image information.

7. The method according to claim 1, wherein the color information identifies the specified color space.

8. The method according to claim 1, wherein the performing operates on plural streams of image information, each having its own respective color information data structure associated therewith.

9. The method according to claim 1, wherein said at least two tasks include deinterlacing the principal video stream, and wherein the color information data structure includes information which governs the deinterlacing.

10. The method according to claim 1, wherein said at least two tasks include converting image information from a first color space to a second color space.

11. The method according to claim 10, wherein the first color space is a luma-related color space and the second color space is an RGB-related color space.

12. The method according to claim 10, wherein the color information in the color information data structure governs the converting.

13. The method according to claim 1, wherein said at least two tasks include at least two of:

deinterlacing the principal video stream;

combining the principal video stream with the video sub-stream; and

converting image information from a first color space to a second color space.

14. The method according to claim 1, wherein said at least two tasks are performed in a single operation.

15. One or more computer-readable memory devices having, stored thereon, computer-executable instructions for performing acts comprising:

providing a principal video stream of image information;

providing a video sub-stream of image information; and

performing, via a graphics processing unit and based on color information specified in a color information data structure, at least two tasks involving the principal video stream and the video sub-stream to produce output video information expressed in a specified color space.

16. An apparatus comprising:

a memory storing computer-executable instructions; and

a processor coupled to the memory, the processor configured to process the computer-executable instructions implementing the apparatus to;

provide a principal video stream of image information;

provide a video sub-stream of image information; and

perform, via a graphics processing unit and based on color information specified in a color information data structure, at least two tasks involving the principal video stream and the video sub-stream to produce output video information expressed in a specified color space.

17. A method for processing image information, the method comprising:

providing a principal video stream of image information;

providing a video sub-stream of image information; and

performing, via a graphics processing unit and based on color information specified in a color information data structure, tasks involving the principal video stream and the video sub-stream to produce output video information expressed in a specified color space, the tasks comprising;

converting input image information in a luma-related color space into linear image information within an RGB-related color space;

performing processing on the linear image information in the RGB-related color space to produce processed information; and

converting the processed information into nonlinear image information within a luma-related color space.

18. The method according to claim 17, wherein the converting also involves transforming the input image information from an interlaced format into a progressive format prior to the processing operation, and, after processing, transforming the processed information from a progressive format into an interlaced format.

19. The method according to claim 17, further comprising supplying a color information data structure, and using color information specified in the color information data structure to govern at least one of the converting of the input information, the processing, or the converting of the processed information.

20. An apparatus for processing image information, the apparatus comprising:

a memory including graphics texture units configured to store image information; and

a processor coupled to the memory, the processor executing a data processing module configured to;

assign at least one of the graphics texture units to a principal video stream of image information;

assign at least one other of the graphics texture units to a video sub-stream of image information; and

perform, based on color information specified in a color information data structure, at least two tasks involving the principal video stream and the video sub-stream in a single operation to produce composite video information expressed in a specified color space.