PROVIDING 3D LOOK-UP TABLE (LUT) ESTIMATION FOR COLOR GAMUT SCALABILITY

• US 20150172616A1
• Filed: 12/12/2014
• Published: 06/18/2015
• Est. Priority Date: 12/13/2013
• Status: Active Grant

• Current Assignee: VID SCALE Inc. (InterDigital, Inc.)
• Original Assignee: VID SCALE Inc. (InterDigital, Inc.)
• Inventors: Ye, Yan, Dong, Jie, He, Yuwen
• Granted Patent: US 9,912,925 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04N 1/64 Systems for the transmission or the storage of the colour picture signal; Details therefor, e.g. coding or decoding means therefor H04N19/00 takes precedence
• CPC Class Codes: H04N 11/24 High-definition television systems
• CPC Class Codes: H04N 13/139 Format conversion, e.g. of frame-rate or size
• CPC Class Codes: H04N 13/15 for colour aspects of image signals
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 19/80 Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation H04N19/635, H04N19/86 take precedence
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression
• CPC Class Codes: H04N 9/64 Circuits for processing colour signals H04N9/77 takes precedence; camera processing pipelines for processing colour signals H04N23/84
• CPC Class Codes: H04N 9/67 for matrixing camera processing pipelines for matrixing of colour signals H04N23/85

Abstract

Systems and/or methods for estimating color conversion components. A video coding device may receive a picture associated with a first color space. The picture may comprise a first component at a first sampling location, a second component at a second sampling location and the second component at a third sampling location. The video coding device may apply a first interpolation filter to the second component at the second sampling location and the second component at the third sampling location to determine the second component at the first sampling location. The second component at the first sampling location may be associated with the first color space. The video coding device may apply a color conversion model to the first component at the first sampling location and to the second component at the first sampling location to translate the first component at the first sampling location to a second color space.

Claims

1. A video coding device, comprising:

a processor configured to;

receive a picture associated with a first color space, wherein the picture comprises a first component at a first sampling location, a second component at a second sampling location and the second component at a third sampling location,

apply a first interpolation filter to the second component at the second sampling location and the second component at the third sampling location to determine the second component at the first sampling location, wherein the second component at the first sampling location is associated with the first color space; and

apply a color conversion model to the first component at the first sampling location and to the second component at the first sampling location to translate the first component at the first sampling location to a second color space.

2. The video coding device of claim 1, wherein the first component is a luma component and the second component is a first chroma component or a second chroma component, or wherein the first component is the first chroma component or the second chroma component and the second component is the luma component.

3. The video coding device of claim 2, wherein the processor configured to apply the first interpolation filter comprises:

the processor configured to;

add the second component at the second sampling location, the second component at the third sampling location, and one to determine a sum; and

divide the sum by two.

4. The video coding device of claim 1, wherein the processor configured to apply the first interpolation filter comprises:

the processor configured to;

multiply the second component at the second sampling location by three;

add the multiplied second component at the second sampling location, the second component at the third sampling location, and two to determine a sum; and

divide the sum by four.

5. The video coding device of claim 1, wherein the picture comprises the second component at a fourth sampling location and the second component at a fifth sampling location;

and

wherein the processor is configured to apply the first interpolation filter to the second component at the second sampling location, the second component at the third sampling location, the second component at the fourth sampling location, and the second component at the fifth sampling location to determine the second component at the first sampling location.

6. The video coding device of claim 5, wherein the processor configured to apply the first interpolation filter comprises:

the processor configured to;

add the second component at the second sampling location and the second component at the third sampling location to determine a first sum;

add the second component at the fourth sampling location and the second component at the fifth sampling location to determine a second sum;

multiply the second sum by three to determine a third sum;

add the first sum, the third sum, and four to determine a fourth sum; and

divide the fourth sum by eight.

7. The video coding device of claim 1, wherein the picture comprises a third component at the second sampling location and the third component at the third sampling location, wherein the first component is a luma component, the second component is a first chroma component, and the third component is a second chroma component, and wherein the processor is further configured to:

apply the first interpolation filter to the third component at the second sampling location and the third component at the third sampling location to determine the third component at the first sampling location, wherein the third component at the first sampling location is associated with the first color space; and

apply the color conversion model to the first component at the first sampling location, to the second component at the first sampling location, and to the third component at the first sampling location to translate the first component at the first sampling location to the second color space.

8. The video coding device of claim 1, wherein the picture comprises a third component at the first sampling location, and wherein the processor is further configured to:

apply the color conversion model to the first component at the first sampling location, to the third component at the first sampling location and to the second component at the first sampling location to translate the first component at the first sampling location to the second color space.

9. The video coding device of claim 8, wherein the first component is a first chroma component, the second component is a luma component, and the third component is a second chroma component, or wherein the first component is the second chroma component, the second component is the luma component, and the third component is the first chroma component.

10. The video coding device of claim 1, wherein the picture is characterized by a 4:

2;

0 chroma format.

11. The video coding device of claim 1, wherein the color conversion model is based on a 3-dimensional look up table (LUT).

12. The video coding device of claim 1, wherein the processor is further configured to receive a scalable bitstream, the scalable bitstream comprising a base layer and an enhancement layer, wherein the base layer comprises the picture, the base layer is associated with the first color space and the enhancement layer is associated with the second color space.

13. A video coding device, comprising:

a processor configured to;

receive a picture associated with a first color space, wherein the picture comprises a luma component at a first sampling location, a first chroma component at a second sampling location, a second chroma component at the second sampling location, the first chroma component at a third sampling location, the second chroma component at the third sampling location, the first chroma component at a fourth sampling location, the second chroma component at the fourth sampling location, the first chroma component at a fifth sampling location, and the second chroma component at the fifth sampling location;

apply an interpolation filter to two or more of the first chroma component at the second sampling location, the first chroma component at the third sampling location, the first chroma component at the fourth sampling location, and the first chroma component at the fifth sampling location to determine the first chroma component at the first sampling location, wherein the first chroma component at the first sampling location is associated with the first color space; and

apply the interpolation filter to two or more of the second chroma component at the second sampling location, the second chroma component at the third sampling location, the second chroma component at the fourth sampling location, and the second chroma component at the fifth sampling location to determine the second chroma component at the first sampling location, wherein the second chroma component at the first sampling location is associated with the first color space; and

apply a color conversion model to the luma component at the first sampling location, the first chroma component at the first sampling location, and the second chroma component at the first sampling location to translate the luma component at the first sampling location to a second color space.

14. A video coding device, comprising:

a processor configured to;

receive a picture associated with a first color space, wherein the picture comprises a first chroma component at a first sampling location, a second chroma component at the first sampling location, a luma component at a second sampling location, the luma component at a third sampling location, the luma component at a fourth sampling location, and the luma component at a fifth sampling location;

apply an interpolation filter to two or more of the luma component at the second sampling location, the luma component at the third sampling location, the luma component at the fourth sampling location, and the luma component at the fifth sampling location to determine the luma component at the first sampling location, wherein the luma component at the first sampling location is associated with the first color space;

apply a color conversion model to the first chroma component at the first sampling location, the second chroma component at the first sampling location, and to the luma component at the first sampling location to translate the first chroma component at the first sampling location to a second color space; and

apply the color conversion model to the first chroma component at the first sampling location, the second chroma component at the first sampling location, and to the luma component at the first sampling location to translate the second chroma component at the first sampling location to the second color space.

15. A video coding method, comprising:

receiving a picture associated with a first color space, wherein the picture comprises a first component at a first sampling location, a second component at a second sampling location and the second component at a third sampling location,

applying a first interpolation filter to the second component at the second sampling location and the second component at the third sampling location to determine the second component at the first sampling location, wherein the second component at the first sampling location is associated with the first color space; and

applying a color conversion model to the first component at the first sampling location and to the second component at the first sampling location to translate the first component at the first sampling location to a second color space.

16. The video coding method of claim 15, wherein the first component is a luma component and the second component is a first chroma component or a second chroma component, or wherein the first component is the first chroma component or the second chroma component and the second component is the luma component.

17. The video coding method of claim 16, wherein the method to apply the first interpolation filter further comprises:

adding the second component at the second sampling location, the second component at the third sampling location, and one to determine a sum; and

dividing the sum by two.

18. The video coding method of claim 15, wherein the method to apply the first interpolation filter further comprises:

multiplying the second component at the second sampling location by three;

adding the multiplied second component at the second sampling location, the second component at the third sampling location, and two to determine a sum; and

dividing the sum by four.

19. The video coding method of claim 15, wherein the picture comprises the second component at a fourth sampling location and the second component at a fifth sampling location, and wherein the method further comprises:

applying the first interpolation filter to the second component at the second sampling location, the second component at the third sampling location, the second component at the fourth sampling location, and the second component at the fifth sampling location to determine the second component at the first sampling location.

20. The video coding method of claim 19, wherein the method to apply the first interpolation filter further comprises:

adding the second component at the second sampling location and the second component at the third sampling location to determine a first sum;

adding the second component at the fourth sampling location and the second component at the fifth sampling location to determine a second sum;

multiplying the second sum by three to determine a third sum;

adding the first sum, the third sum, and four to determine a fourth sum; and

dividing the fourth sum by eight.

21. The video coding method of claim 15, wherein the picture comprises a third component at the second sampling location and the third component at the third sampling location, wherein the first component is a luma component, the second component is a first chroma component, and the third component is a second chroma component, and wherein the method further comprises:

applying the first interpolation filter to the third component at the second sampling location and the third component at the third sampling location to determine the third component at the first sampling location, wherein the third component at the first sampling location is associated with the first color space; and

applying the color conversion model to the first component at the first sampling location, to the second component at the first sampling location, and to the third component at the first sampling location to translate the first component at the first sampling location to the second color space.

22. The video coding method of claim 15, wherein the picture comprises a third component at the first sampling location, and wherein the method further comprises:

applying the color conversion model to the first component at the first sampling location, to the third component at the first sampling location and to the second component at the first sampling location to translate the first component at the first sampling location to the second color space.

23. The video coding method of claim 22, wherein the first component is a first chroma component, the second component is a luma component, and the third component is a second chroma component, or wherein the first component is the second chroma component, the second component is the luma component, and the third component is the first chroma component.