Strategies for processing image information using a color information data structure

• US 7,643,675 B2
• Filed: 07/29/2004
• Issued: 01/05/2010
• Est. Priority Date: 08/01/2003
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Estrop, Stephen J., Evans, Glenn F.
• Primary Examiner(s): Tran; Phuoc
• Application Number:
  US10/902,325
• Publication Number:
  US 20050024384A1
• Time in Patent Office: 1,986 Days
• Field of Search: 382/162, 382/167, 382/303, 345/501, 345/522, 348/441, 348/446
• US Class Current: 382/162
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G09G 2310/0229 De-interlacing
• CPC Class Codes: G09G 2340/0435 Change or adaptation of the frame rate of the video stream
• CPC Class Codes: G09G 2360/125 using unified memory architecture [UMA]
• CPC Class Codes: G09G 5/363 Graphics controllers
• CPC Class Codes: H04N 7/012 Conversion between an interlaced and a progressive signal for graphics images G09G2310/0229
• CPC Class Codes: H04N 7/0122 the input and the output signals having different aspect ratios
• CPC Class Codes: H04N 9/642 Multi-standard receivers
• CPC Class Codes: H04N 9/67 for matrixing camera processing pipelines for matrixing of colour signals H04N23/85
• CPC Class Codes: H04N 9/69 for modifying the colour signals by gamma correction controlling camera response for colour signals H04N23/83

Abstract

Strategies are described for processing image information using a data structure which conveys color information. The color information describes color-related formatting applied to the image information. The data structure can be passed down a video processing pipeline, where each functional component in the pipeline can draw color information from the data structure to improve the accuracy of its processing. Further, each component can supply previously unknown color information to the data structure for use by other (downstream) components in the pipeline. Exemplary fields of the data structure can include one or more of: a video transfer function field; a color primaries field; an image light field; a transfer matrix field; a nominal range field; and a video chroma sampling field. The transfer matrix field can be used to convert image information from one color space to another, such as a luma-related color space to an RGB-related color space. Processing operations can be performed on progressive and linear RGB image information.

Claims

1. A method for processing image information having color content expressed in a prescribed format, comprising:

providing a color information data structure that contains color information that defines at least one aspect of the prescribed format;

passing the color information data structure to at least one functional component used to process the image information, along with the image information; and

processing the image information at said at least one functional component based on the color information in the color information data structure,

wherein the color information data structure comprises an image light field which conveys information comprising gamma, brightness, and contrast associated with the image information.

2. The method according to claim 1, wherein said at least one functional component belongs to a group of functional components defining a video processing pipeline, wherein the color information data structure is passed down the video processing pipeline for use by downstream functional components.

3. The method according to claim 2, wherein the video processing pipeline performs the operations of:

converting input image information in a luma-related color space into linear image information within an RGB-related color space; and

performing processing on the linear image information in the RGB-related color space to produce processed information.

4. The method according to claim 3, wherein the converting also involves transforming the input image information from an interlaced format into a progressive format prior to the processing operation.

5. The method according to claim 3, wherein the video processing pipeline further performs the operations of:

converting the processed information into nonlinear image information within a luma-related color space.

6. The method according to claim 5, wherein the converting of the processed information also involves transforming the processed information from a progressive format into an interlaced format.

7. The method according to claim 2, wherein the video processing pipeline performs color conversion, and wherein the color information in the color information data structure governs the color conversion.

8. The apparatus according to claim 1, further comprising initializing unknown values within the color information data structure to a prescribed default value.

9. The method according to claim 1, wherein said at least one functional component further determines at least one other aspect of the prescribed format and adds said at least one other aspect to at least one unknown value in the color information data structure.

10. The method according to claim 1, wherein the passing of the color information data structure comprises passing the color information data structure in an unused field of an existing data structure.

11. The method according to claim 1, further comprising setting a flag which indicates that said at least one functional component has the capacity to process the color information data structure.

12. The method according to claim 1, wherein the color information data structure comprises a video transfer function field which conveys information regarding the transfer function used to convert linear image information into nonlinear image information, and/or vice versa.

13. The method according to claim 1, wherein the color information data structure comprises a color primaries field which conveys color primaries associated with the image information.

14. The method according to claim 1, wherein the color information data structure comprises a transfer matrix field which conveys information regarding a transfer matrix that can be used to modify the color space of the image information.

15. The method according to claim 1, wherein the color information data structure comprises a nominal range field which conveys information regarding potential toe room and head room associated with the image information.

16. The method according to claim 1, wherein the color information data structure comprises a video chroma sampling field which indicates the manner in which chroma samples in the image information are sampled and aligned relative to associated luma samples.

17. The method according to claim 1, wherein the color information data structure comprises:

a video transfer function field which conveys information regarding the transfer function used to convert linear image information into nonlinear image information, and/or vice versa;

a color primaries field which conveys color primaries associated with the image information;

a transfer matrix field that can be used to modify the color space of the image information;

a nominal range field which conveys information regarding potential toe room and head room associated with the image information; and

a video chroma sampling field which indicates the manner in which chroma samples in the image information are sampled and aligned relative to associated luma samples.

18. One or more computer-readable storage media including, stored thereon, processor-executable instructions for implementing the method of claim 1.

19. An apparatus including a processor and one or more computer-readable storage media comprising computer executable instructions configured to perform each of the providing, passing and processing of claim 1.

20. An apparatus including a processor and one or more computer-readable storage media comprising computer executable instructions configured to perform each of the providing, passing and processing using the color information data structure of claim 17.

21. A system for processing image information having color content expressed in a prescribed format, comprising:

plural functional components defining a video processing pipeline,

wherein each of the plural functional components includes logic configured to process a color information data structure that contains color information that defines at least one aspect of the prescribed format; and

wherein the color information data structure comprises;

an image light field which conveys an intended viewing condition associated with the image information;

a nominal range field which conveys information regarding potential toe room and head room associated with the image information; and

a video chroma sampling field which indicates the manner in which chroma samples in the information are sampled and aligned relative to associated luma samples.

22. The system according to claim 21, wherein the color information data structure further comprises at least one of:

a video transfer function field which conveys information regarding the transfer function used to convert linear image information into nonlinear image information, and/or vice versa;

a color primaries field which conveys color primaries associated with the image information;

or

a transfer matrix field that can be used to modify the color space of the image information.

23. A method comprising:

providing a color information data structure that contains color information that defines at least one aspect of a prescribed format;

passing the color information data structure to at least one functional component used to process the image information, along with the image information; and

processing the image information at said at least one functional component based on the color information in the color information data structure,

wherein the color information data structure comprises;

a video transfer function field which conveys information regarding the transfer function used to convert linear image information into nonlinear image information, and/or vice versa;

a color primaries field which conveys color primaries associated with the image information;

an image light field which conveys an intended viewing condition associated with the image information;

a transfer matrix field that can be used to modify the color space of the image information;

a nominal range field which conveys information regarding potential toe room and head room associated with the image information; and

a video chroma sampling field which indicates the manner in which chroma samples in the image information are sampled and aligned relative to associated luma samples.