Color correction with a lookup table

• US 10,462,439 B2
• Filed: 10/03/2016
• Issued: 10/29/2019
• Est. Priority Date: 10/02/2015
• Status: Active Grant

• Current Assignee: InterDigital Madison Patent Holdings SAS (InterDigital, Inc.)
• Original Assignee: VID SCALE Inc. (InterDigital, Inc.)
• Inventors: He, Yuwen, Ye, Yan, Kerofsky, Louis
• Primary Examiner(s): Lee, Michael
• Application Number:
  US15/765,338
• Publication Number:
  US 20180288381A1
• Time in Patent Office: 1,121 Days
• Field of Search: 348453
• CPC Class Codes: H04N 1/6005 with luminance or chrominance signals, e.g. LC1C2, HSL or YUV
• CPC Class Codes: H04N 11/28 involving bandwidth reduction, e.g. subsampling
• CPC Class Codes: H04N 19/12 Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression
• CPC Class Codes: H04N 7/0135 involving interpolation processes interpolation-based image scaling G06T3/4007; interpolation for video coding H04N19/587, H04N19/59
• CPC Class Codes: H04N 9/646 for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters
• CPC Class Codes: H04N 9/77 Circuits for processing the brightness signal and the chrominance signal relative to each other, e.g. adjusting the phase of the brightness signal relative to the colour signal, correcting differential gain or differential phase circuits for matrixing H04N9/67

Abstract

Color correction in high dynamic range video (HDR) using 2D look-up table (LUT) may be provided. The color correction may be applied in a decoder after decoding the HDR video signal. For example, the color correction may be applied before, during, or after chroma upsampling of the HDR video signal. The 2D LUT may include a representation of the color space of the HDR video signal. The color correction may include applying triangle interpolation to the sample values of the color component of the color space. The 2D LUT may be estimated by an encoder and signaled to the decoder. The encoder may decide to reuse a prior-signaled 2D LUT or use a new 2D LUT.

Claims

1. A method for processing video content, the method comprising:

receiving a first luma sample, a first chroma sample, and a two-dimensional (2D) look-up table (LUT) for producing corrected chroma values, wherein the 2D LUT defines a luma dimension and a chroma dimension associated with a 2D color space of the video content, the 2D color space is defined by a plurality of rectangular units with respective vertices, and the 2D LUT comprises corrected chroma component values associated with the respective vertices of the rectangular units;

determining an input luma value and an input chroma value to the 2D LUT via an upsampling operation utilizing at least one of the first luma sample or the first chroma sample, wherein the first luma sample and the first chroma sample are associated with different sampling locations, and the input luma value and the input chroma value are aligned to a same sampling location;

producing an output chroma value based on the 2D LUT, the input chroma value and the input luma value; and

reconstructing the video content using at least the output chroma value.

2. The method of claim 1, wherein the plurality of rectangular units of the 2D color space are derived using quadtree partitioning.

3. The method of claim 1, wherein the producing of the output chroma value comprises:

determining a first rectangular unit among the plurality of rectangular units to which the input luma value and the input chroma value belong; and

calculating the output chroma value via triangle interpolation based on a subset of the chroma component values associated with the vertices of the first rectangular unit, the input chroma value, and the input luma value.

4. The method of claim 3, wherein the calculating of the output chroma value via triangle interpolation comprises:

determining a first triangle inside the first rectangular unit to which the input luma value and the input chroma value belong; and

applying triangle interpolation based on the chroma component values associated with the vertices of the first triangle, the input chroma value, and the input luma value.

5. The method of claim 3, wherein the calculating of the output chroma value via triangle interpolation comprises applying triangle interpolation based on the chroma component values associated with three vertices of the first rectangular unit, the input chroma value, and the input luma value.

6. The method of claim 1, further comprising receiving a second luma sample, wherein the input chroma value is set to the first chroma sample, and wherein the input luma value is determined by interpolating at least the first luma sample and the second luma sample.

7. The method of claim 1, further comprising receiving a second chroma sample, wherein the input luma value is set to the first luma sample, and wherein the input chroma value is determined by interpolating at least the first chroma sample and the second chroma sample.

8. A device for processing video content, the device comprising:

a processor configured to;

receive a first luma sample, a first chroma sample, and a two-dimensional (2D) look-up table (LUT) for producing corrected chroma values, wherein the 2D LUT defines a luma dimension and a chroma dimension both of which are associated with a 2D color space of the video content, the 2D color space of the video content is defined by a plurality of rectangular units with respective vertices, and the 2D LUT comprises corrected chroma component values associated with the respective vertices of the rectangular units;

determine an input luma value and an input chroma value to the 2D LUT via an upsampling operation utilizing at least one of the first luma sample or the first chroma sample, wherein the first luma sample and the first chroma sample are associated with different sampling locations, and the input luma value and the input chroma value are aligned to a same sampling location;

produce an output chroma value based on the 2D LUT, the input chroma value and the input luma value; and

reconstruct the video content using at least the output chroma value.

9. The device of claim 8, wherein the plurality of rectangular units of the 2D color space are derived using quadtree partitioning.

10. The device of claim 8, wherein the processor being configured to produce the output chroma value comprises the processor being configured to:

determine a first rectangular unit among the plurality of rectangular units to which the input luma value and the input chroma value belong; and

calculate the output chroma value via triangle interpolation based on a subset of the chroma component values associated with the vertices of the first rectangular unit, the input chroma value, and the input luma value.

11. The device of claim 10, wherein the processor being configured to calculate the output chroma value via triangle interpolation comprises the processor being configured to:

determine a first triangle inside the first rectangular unit to which the input luma value and the input chroma value belong; and

apply triangle interpolation based on the chroma component values associated with the vertices of the first triangle, the input chroma value, and the input luma value.

12. The device of claim 10, wherein the processor being configured to calculate the output chroma value via triangle interpolation comprises the processor being configured to apply triangle interpolation based on the chroma component values associated with three vertices of the first rectangular unit, the input chroma value, and the input luma value.

13. The device of claim 8, wherein the processor is configured to receive a second luma sample, to set the input chroma value to the first chroma sample, and to determine the input luma value by interpolating at least the first luma sample and the second luma sample.

14. The device of claim 8, wherein the processor is configured to receive a second chroma sample, to set the input luma value to the first luma sample, and to determine the input chroma value by interpolating at least the first chroma sample and the second chroma sample.

15. A method for processing video content, the method comprising:

partitioning a two-dimensional (2D) color space associated with the video content into a plurality of rectangular units with respective vertices, wherein the 2D color space comprises a luma dimension and a chroma dimension;

determining a chroma sample value and a luma sample value for estimating a 2D look-up table (LUT) associated with the 2D color space, wherein both the chroma sample value and the luma sample value are aligned to a first sampling location, and wherein the 2D LUT comprises a plurality of chroma component values associated with the vertices of the 2D color space;

determining a corrected chroma value associated with one of the vertices of the 2D color space based on the chroma sample value, the luma sample value, and an original version of the video content;

setting one of the chroma component values in the 2D LUT to the corrected chroma value; and

coding the 2D LUT in a video bitstream associated with the video content.

16. The method of claim 15, wherein the 2D color space is partitioned using quadtree partitioning.