Providing 3D look-up table (LUT) estimation for color gamut scalability

• US 9,912,925 B2
• Filed: 12/12/2014
• Issued: 03/06/2018
• Est. Priority Date: 12/13/2013
• Status: Active Grant

• Current Assignee: VID SCALE Inc. (InterDigital, Inc.)
• Original Assignee: VID SCALE Inc. (InterDigital, Inc.)
• Inventors: Ye, Yan, Dong, Jie, He, Yuwen
• Primary Examiner(s): Saltarelli, Dominic D
• Application Number:
  US14/568,807
• Publication Number:
  US 20150172616A1
• Time in Patent Office: 1,180 Days
• Field of Search: 37524002
• CPC Class Codes: H04N 1/64 Systems for the transmission or the storage of the colour picture signal; Details therefor, e.g. coding or decoding means therefor H04N19/00 takes precedence
• CPC Class Codes: H04N 11/24 High-definition television systems
• CPC Class Codes: H04N 13/139 Format conversion, e.g. of frame-rate or size
• CPC Class Codes: H04N 13/15 for colour aspects of image signals
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 19/80 Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation H04N19/635, H04N19/86 take precedence
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression
• CPC Class Codes: H04N 9/64 Circuits for processing colour signals H04N9/77 takes precedence; camera processing pipelines for processing colour signals H04N23/84
• CPC Class Codes: H04N 9/67 for matrixing camera processing pipelines for matrixing of colour signals H04N23/85

Abstract

Systems and/or methods for estimating color conversion components. A video coding device may receive a picture associated with a first color space. The picture may comprise a first component at a first sampling location, a second component at a second sampling location and the second component at a third sampling location. The video coding device may apply a first interpolation filter to the second component at the second sampling location and the second component at the third sampling location to determine the second component at the first sampling location. The second component at the first sampling location may be associated with the first color space. The video coding device may apply a color conversion model to the first component at the first sampling location and to the second component at the first sampling location to translate the first component at the first sampling location to a second color space.

Claims

1. A video coding device, comprising:

a processor configured to;

receive a picture associated with a first color space that covers a first volume of colors, wherein the picture is characterized by a chroma format where luma sampling locations and chroma sampling locations are misaligned, and the picture comprises a first component at a first sampling location, a second component at a second sampling location and the second component at a third sampling location,

apply a first interpolation filter to the second component at the second sampling location and the second component at the third sampling location to determine the second component at the first sampling location, wherein the second component at the first sampling location is associated with the first color space, wherein when the first component is a luma component, the first sampling location is a luma sampling location and the first interpolation filter is applied to a chroma component at the second and the third sampling locations to determine the chroma component at the luma sampling location, and when the first component is the chroma component, the first sampling location is a chroma sampling location, and the first interpolation filter is applied to the luma component at the second and the third sampling locations to determine the luma component at the chroma sampling location; and

apply a color conversion model to the first component at the first sampling location and to the second component at the first sampling location to translate the first component at the first sampling location from the first color space to a second color space that covers a broader volume of colors compared to the first volume of colors.

2. The video coding device of claim 1, wherein the first component is a luma component and the second component is a first chroma component or a second chroma component, or wherein the first component is the first chroma component or the second chroma component and the second component is the luma component.

3. The video coding device of claim 2, wherein the processor is further configured to:

add the second component at the second sampling location, the second component at the third sampling location, and one to determine a sum; and

divide the sum by two.

4. The video coding device of claim 1, wherein the processor is further configured to:

multiply the second component at the second sampling location by three;

add the multiplied second component at the second sampling location, the second component at the third sampling location, and two to determine a sum; and

divide the sum by four.

5. The video coding device of claim 1, wherein the picture comprises the second component at a fourth sampling location and the second component at a fifth sampling location;

and

wherein the processor is configured to apply the first interpolation filter to the second component at the second sampling location, the second component at the third sampling location, the second component at the fourth sampling location, and the second component at the fifth sampling location to determine the second component at the first sampling location.

6. The video coding device of claim 5, wherein the processor is further configured to:

add the second component at the second sampling location and the second component at the third sampling location to determine a first sum;

add the second component at the fourth sampling location and the second component at the fifth sampling location to determine a second sum;

multiply the second sum by three to determine a third sum;

add the first sum, the third sum, and four to determine a fourth sum; and

divide the fourth sum by eight.

7. The video coding device of claim 1, wherein the picture comprises a third component at the second sampling location and the third component at the third sampling location, wherein the first component is a luma component, the second component is a first chroma component, and the third component is a second chroma component, and wherein the processor is further configured to:

apply the first interpolation filter to the third component at the second sampling location and the third component at the third sampling location to determine the third component at the first sampling location, wherein the third component at the first sampling location is associated with the first color space; and

apply the color conversion model to the first component at the first sampling location, to the second component at the first sampling location, and to the third component at the first sampling location to translate the first component at the first sampling location to the second color space.

8. The video coding device of claim 1, wherein the picture comprises a third component at the first sampling location, and wherein the processor is further configured to:

apply the color conversion model to the first component at the first sampling location, to the third component at the first sampling location and to the second component at the first sampling location to translate the first component at the first sampling location to the second color space.

9. The video coding device of claim 8, wherein the first component is a first chroma component, the second component is a luma component, and the third component is a second chroma component, or wherein the first component is the second chroma component, the second component is the luma component, and the third component is the first chroma component.

10. The video coding device of claim 1, wherein the picture is characterized by at least one of:

a 4;

2;

0 chroma format or a 4;

2;

2 chroma format.

11. The video coding device of claim 1, wherein the color conversion model is based on a 3-dimensional look up table (LUT).

12. The video coding device of claim 1, wherein the processor is further configured to receive a scalable bitstream, the scalable bitstream comprising a base layer and an enhancement layer, wherein the base layer comprises the picture, the base layer is associated with the first color space and the enhancement layer is associated with the second color space, and the color-converted first and second components are used for inter-layer prediction.

13. A video coding device, comprising:

a processor configured to;

receive a picture associated with a first color space that covers a first volume of colors, wherein the picture is characterized by a chroma format where luma sampling locations and chroma sampling locations are misaligned, and the picture comprises a luma component at a first sampling location, a first chroma component at a second sampling location, a second chroma component at the second sampling location, the first chroma component at a third sampling location, the second chroma component at the third sampling location, the first chroma component at a fourth sampling location, the second chroma component at the fourth sampling location, the first chroma component at a fifth sampling location, and the second chroma component at the fifth sampling location;

apply an interpolation filter to two or more of the first chroma component at the second sampling location, the first chroma component at the third sampling location, the first chroma component at the fourth sampling location, and the first chroma component at the fifth sampling location to determine the first chroma component at the first sampling location of the luma component, wherein the first chroma component at the first sampling location is associated with the first color space;

apply the interpolation filter to two or more of the second chroma component at the second sampling location, the second chroma component at the third sampling location, the second chroma component at the fourth sampling location, and the second chroma component at the fifth sampling location to determine the second chroma component at the first sampling location of the luma component, wherein the second chroma component at the first sampling location is associated with the first color space; and

apply a color conversion model to the luma component at the first sampling location, the first chroma component at the first sampling location, and the second chroma component at the first sampling location to translate the luma component at the first sampling location from the first color space to a second color space that covers a broader volume of colors compared to the first volume of colors.

14. A video coding device, comprising:

a processor configured to;

receive a picture associated with a first color space that covers a first volume of colors, wherein the picture is characterized by a chroma format where luma sampling locations and chroma sampling locations are misaligned, and the picture comprises a first chroma component at a first sampling location, a second chroma component at the first sampling location, a luma component at a second sampling location, the luma component at a third sampling location, the luma component at a fourth sampling location, and the luma component at a fifth sampling location;

apply an interpolation filter to two or more of the luma component at the second sampling location, the luma component at the third sampling location, the luma component at the fourth sampling location, and the luma component at the fifth sampling location to determine the luma component at the first sampling location of the first chroma component, wherein the luma component at the first sampling location is associated with the first color space;

apply a color conversion model to the first chroma component at the first sampling location, the second chroma component at the first sampling location, and to the luma component at the first sampling location to translate the first chroma component at the first sampling location from the first color space to a second color space that covers a broader volume of colors compared to the first volume of colors; and

apply the color conversion model to the first chroma component at the first sampling location, the second chroma component at the first sampling location, and to the luma component at the first sampling location to translate the second chroma component at the first sampling location to the second color space.

15. A video coding method, comprising:

receiving a picture associated with a first color space that covers a first volume of colors, wherein the picture is characterized by a chroma format where luma sampling locations and chroma sampling locations are misaligned, and the picture comprises a first component at a first sampling location, a second component at a second sampling location and the second component at a third sampling location,

applying a first interpolation filter to the second component at the second sampling location and the second component at the third sampling location to determine the second component at the first sampling location, wherein the second component at the first sampling location is associated with the first color space, wherein when the first component is a luma component, the first sampling location is a luma sampling location and the first interpolation filter is applied to a chroma component at the second and the third sampling locations to determine the chroma component at the luma sampling location, and when the first component is the chroma component, the first sampling location is a chroma sampling location, and the first interpolation filter is applied to the luma component at the second and the third sampling locations to determine the luma component at the chroma sampling location; and

applying a color conversion model to the first component at the first sampling location and to the second component at the first sampling location to translate the first component at the first sampling location from the first color space to a second color space that covers a broader volume of colors compared to the first volume of colors.

16. The video coding method of claim 15, wherein the first component is a luma component and the second component is a first chroma component or a second chroma component, or wherein the first component is the first chroma component or the second chroma component and the second component is the luma component.

17. The video coding method of claim 16, wherein the method to apply the first interpolation filter further comprises:

adding the second component at the second sampling location, the second component at the third sampling location, and one to determine a sum; and

dividing the sum by two.

18. The video coding method of claim 15, wherein the method to apply the first interpolation filter further comprises:

multiplying the second component at the second sampling location by three;

adding the multiplied second component at the second sampling location, the second component at the third sampling location, and two to determine a sum; and

dividing the sum by four.

19. The video coding method of claim 15, wherein the picture comprises the second component at a fourth sampling location and the second component at a fifth sampling location, and wherein the method further comprises:

applying the first interpolation filter to the second component at the second sampling location, the second component at the third sampling location, the second component at the fourth sampling location, and the second component at the fifth sampling location to determine the second component at the first sampling location.

20. The video coding method of claim 19, wherein the method to apply the first interpolation filter further comprises:

adding the second component at the second sampling location and the second component at the third sampling location to determine a first sum;

adding the second component at the fourth sampling location and the second component at the fifth sampling location to determine a second sum;

multiplying the second sum by three to determine a third sum;

adding the first sum, the third sum, and four to determine a fourth sum; and

dividing the fourth sum by eight.

21. The video coding method of claim 15, wherein the picture comprises a third component at the second sampling location and the third component at the third sampling location, wherein the first component is a luma component, the second component is a first chroma component, and the third component is a second chroma component, and wherein the method further comprises:

applying the first interpolation filter to the third component at the second sampling location and the third component at the third sampling location to determine the third component at the first sampling location, wherein the third component at the first sampling location is associated with the first color space; and

applying the color conversion model to the first component at the first sampling location, to the second component at the first sampling location, and to the third component at the first sampling location to translate the first component at the first sampling location to the second color space.

22. The video coding method of claim 15, wherein the picture comprises a third component at the first sampling location, and wherein the method further comprises:

applying the color conversion model to the first component at the first sampling location, to the third component at the first sampling location and to the second component at the first sampling location to translate the first component at the first sampling location to the second color space.

23. The video coding method of claim 22, wherein the first component is a first chroma component, the second component is a luma component, and the third component is a second chroma component, or wherein the first component is the second chroma component, the second component is the luma component, and the third component is the first chroma component.