Inter-layer prediction using sample-adaptive adjustments for bit depth scalable video coding

• US 9,532,057 B2
• Filed: 12/20/2013
• Issued: 12/27/2016
• Est. Priority Date: 12/28/2012
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Van Der Auwera, Geert, Karczewicz, Marta
• Primary Examiner(s): CHIO, TAT CHI
• Application Number:
  US14/137,031
• Publication Number:
  US 20140185664A1
• Time in Patent Office: 1,103 Days
• US Class Current: 1/1
• CPC Class Codes: H04N 19/103 Selection of coding mode or of prediction mode
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/182 the unit being a pixel
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/196 being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters processing of motion vectors H04N19/513
• CPC Class Codes: H04N 19/33 in the spatial domain
• CPC Class Codes: H04N 19/50 using predictive coding H04N19/61 takes precedence

Abstract

An apparatus for coding video data according to certain aspects includes a memory unit and a processor in communication with the memory unit. The memory unit stores video data. The video data may include a base layer comprising samples with a lower bit depth and an enhancement layer comprising samples with a higher bit depth. The processor predicts the values of samples in the enhancement layer based on the values of samples in the base layer. The prediction performed by the processor includes applying a preliminary mapping to the base layer samples to obtain preliminary predictions, and then applying adaptive adjustments to the preliminary predictions to obtain refined predictions. Parameters used for the adaptive adjustments may depend on the values and distribution of base layer samples. The processor may encode or decode the video data.

Claims

1. An apparatus configured to code video data, the apparatus comprising:

a memory configured to store video data associated with a first layer and a second layer, the first layer including a first layer sample having a first bit depth; and

a processor in communication with the memory, the processor configured to;

apply a preliminary mapping function to the first layer sample to produce a preliminary predicted sample;

determine a first category of the first layer sample based on one or more values with the first layer sample, wherein the first category is based on a comparison between the one or more values associated with the first layer sample and a plurality of bands defined at least by one or more boundary points between adjacent bands in the plurality of bands;

determine one or more adjustment parameters based on the determined first category of the first layer sample; and

perform, on the preliminary predicted sample, a piecewise adjustment operation using the one or more adjustment parameters to determine a refined predicted sample, the piecewise adjustment operation comprising one or more of a multiplication, a division, an exponentiation, or a logarithm, the refined predicted sample having a second bit depth that is greater than the first bit depth.

2. The apparatus of claim 1, wherein the first bit depth is 8 bits, and the second bit depth is one of 10 bits, 12 bits, and 14 bits.

3. The apparatus of claim 1, wherein the first category of the first layer sample is determined from one or more luminance or chrominance values of the first layer sample.

4. The apparatus of claim 1, wherein the processor is further configured to determine a second category of the first layer sample based on (i) the one or more values associated with the first layer sample and (ii) one or more values associated with a neighboring sample in the first layer, and to determine one or more additional adjustment parameters based on the determined second category of the first layer sample, wherein the piecewise adjustment operation is further based on the one or more additional adjustment parameters.

5. The apparatus of claim 4, wherein the second category of the first layer sample depends on results of a plurality of comparisons between the first layer sample and other samples which are spatially adjacent to the first layer sample in the video data.

6. The apparatus of claim 1, wherein

the first layer sample represents a luminance value on a scale of possible luminance values;

the scale of possible luminance values is divided into a plurality of luminance bands;

the luminance value represented by the first layer sample lies within one of the luminance bands; and

the first category of the first layer sample corresponds to the luminance band within which the first layer sample lies.

7. The apparatus of claim 1, wherein

the first layer sample represents a chrominance value on a scale of possible chrominance values;

the scale of possible chrominance values is divided into a plurality of chrominance bands;

the chrominance value represented by the first layer sample lies within one of the chrominance bands; and

the first category of the first layer sample corresponds to the chrominance band within which the first layer sample lies.

8. The apparatus of claim 1, wherein the preliminary mapping function comprises at least one logarithmic or exponential operation.

9. The apparatus of claim 1, wherein the preliminary mapping function comprises a left bit shift or multiplication by a number greater than or equal to 2.

10. The apparatus of claim 1, wherein the preliminary mapping function comprises a look-up table that maps each possible first layer sample value onto a corresponding second layer sample value.

11. The apparatus of claim 1, wherein the preliminary predicted sample has a bit depth equal to the second bit depth.

12. The apparatus of claim 1, wherein the one or more adjustment parameters comprise ratios, coefficients, exponents, or logarithmic bases.

13. The apparatus of claim 1, wherein the piecewise adjustment operation further comprises an addition or a subtraction.

14. The apparatus of claim 1, wherein the processor is further configured to add a residual value to the refined predicted sample to determine a second layer sample.

15. A method of coding video data, the method comprising:

receiving the video data comprising a first layer sample having a first bit depth;

applying a preliminary mapping function to the first layer sample to produce a preliminary predicted sample;

determining a first category of the first layer sample based on one or more values associated with the first layer sample, wherein the first category is based on a comparison between the one or more values associated with the first layer sample and a plurality of bands defined at least by one or more boundary points between adjacent bands in the plurality of bands;

determining one or more adjustment parameters based on the determined first category of the first layer sample; and

performing, on the preliminary predicted sample, a piecewise adjustment operation using the one or more adjustment parameters to determine a refined predicted sample, the piecewise adjustment operation comprising one or more of a multiplication, a division, an exponentiation, or a logarithm, the refined predicted sample having a second bit depth that is greater than the first bit depth.

16. The method of claim 15, wherein the first bit depth is 8 bits, and the second bit depth is one of 10 bits, 12 bits, and 14 bits.

17. The method of claim 15, wherein the first category of the first layer sample is determined from one or more luminance or chrominance values of the first layer sample.

18. The method of claim 15, further comprising determining a second category of the first layer sample based on (i) the one or more values associated with the first layer sample and (ii) one or more values associated with a neighboring sample in the first layer, and determining one or more additional adjustment parameters based on the determined second category of the first layer sample, wherein the piecewise adjustment operation is further based on the one or more additional adjustment parameters.

19. The method of claim 18, wherein the second category of the first layer sample depends on results of a plurality of comparisons between the first layer sample and other samples which are spatially adjacent to the first layer sample in the video data.

20. The method of claim 15, wherein

the first layer sample represents luminance value one a scale of possible luminance values;

the scale of possible luminance values is divided into a plurality of luminance bands;

the luminance value represented by the first layer sample lies within one of the luminance bands; and

the first category of the first layer sample corresponds to the luminance band within which the first layer sample lies.

21. The method of claim 15, wherein

the first layer sample represents a chrominance value on a scale of possible chrominance values;

the scale of possible chrominance values is divided into a plurality of chrominance bands;

the chrominance value represented by the first layer sample lies within one of the chrominance bands; and

the first category of the first layer sample corresponds to the chrominance band within which the first layer sample lies.

22. The method of claim 15, wherein the preliminary mapping function comprises at least one logarithmic or exponential operation.

23. The method of claim 15, wherein the preliminary mapping function comprises a left bit shift or multiplication by a number greater than or equal to 2.

24. The method of claim 15, wherein the preliminary mapping function comprises a look-up table that maps each possible first layer sample value onto a corresponding second layer sample value.

25. The method of claim 15, wherein the preliminary predicted sample has a bit depth equal to the second bit depth.

26. The method of claim 15, wherein the one or more adjustment parameters comprise ratios, coefficients, exponents, or logarithmic bases.

27. The method of claim 15, wherein the piecewise adjustment operation further comprises an addition or a subtraction.

28. The method of claim 15, wherein the processor is further configured to add a residual value to the refined predicted sample to determine a second layer sample.

29. A non-transitory computer readable medium comprising code that, when executed, causes an apparatus to:

receive video data comprising a first layer sample having a first bit depth;

apply a preliminary mapping function to the first layer sample to produce a preliminary predicted sample;

determine a first category of the first layer sample based on one or more values associated with the first layer sample, wherein the first category is based on a comparison between the one or more values associated with the first layer sample and a plurality of bands defined at least by one or more boundary points between adjacent bands in the plurality of bands;

determine one or more adjustment parameters based on the determined first category of the first layer sample; and

perform, on the preliminary predicted sample, a piecewise adjustment operation using the one or more adjustment parameters to determine a refined predicted sample, the piecewise adjustment operation comprising one or more of a multiplication, a division, an exponentiation, or a logarithm, the refined predicted sample having a second bit depth that is greater than the first bit depth.

30. A video coding device configured to code video data, the video coding device comprising:

means for receiving the video data comprising a first layer sample having a first bit depth;

means for applying a preliminary mapping function to the first layer sample to produce a preliminary predicted sample;

means for determining a first category of the first layer sample based on one or more values associated with the first layer sample, wherein the first category is based on a comparison between the one or more values associated with the first layer sample and a plurality of bands defined at least by one or more boundary points between adjacent bands in the plurality of bands;

means for determining one or more adjustment parameters based on the determined first category of the first layer sample; and

means for performing, on the preliminary predicted sample, a piecewise adjustment operation using the one or more adjustment parameters to determine a refined predicted sample, the piecewise adjustment operation comprising one or more of a multiplication, a division, an exponentiation, or a logarithm, the refined predicted sample having a second bit depth that is greater than the first bit depth.