Methods and apparatuses for encoding an HDR images, and methods and apparatuses for use of such encoded images

• US 10,075,738 B2
• Filed: 03/19/2015
• Issued: 09/11/2018
• Est. Priority Date: 05/28/2014
• Status: Active Grant

• Current Assignee: Koninklijke Philips N.V.
• Original Assignee: Koninklijke Philips N.V.
• Inventors: Van Der Vleuten, Renatus Josephus, Mertens, Mark Jozef Willem
• Primary Examiner(s): Alavi, Amir
• Application Number:
  US15/306,873
• Publication Number:
  US 20170078706A1
• Time in Patent Office: 1,272 Days
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/20208 High dynamic range [HDR] image processing
• CPC Class Codes: G06T 5/92 based on global image properties
• CPC Class Codes: G06T 9/00 Image coding bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00
• CPC Class Codes: G09G 2320/0271 Adjustment of the gradation levels within the range of the gradation scale, e.g. by redistribution or clipping
• CPC Class Codes: G09G 2320/0276 for the purpose of adaptation to the characteristics of a display device, i.e. gamma correction
• CPC Class Codes: G09G 2320/0673 for control of gamma adjustment, e.g. selecting another gamma curve
• CPC Class Codes: G09G 2340/02 Handling of images in compressed format, e.g. JPEG, MPEG
• CPC Class Codes: G09G 2340/06 Colour space transformation
• CPC Class Codes: G09G 3/2003 Display of colours specific for liquid crystal displays G09G3/3607
• CPC Class Codes: G09G 5/10 Intensity circuits
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/98 Adaptive-dynamic-range coding [ADRC]
• CPC Class Codes: H04N 5/20 Circuitry for controlling amplitude response
• CPC Class Codes: H04N 7/0117 involving conversion of the spatial resolution of the incoming video signal for graphics images G09G2340/0407

Abstract

Encoding a high dynamic range image (M_HDR), comprising: 1. converting the high dynamic range image to an image of lower luminance dynamic range (LDR_o) by applying the acts of: a) scaling the high dynamic range image to a predetermined scale of the luma axis such as [0,1], b) a sensitivity tone mapping which changes the brightnesses of pixel colors falling within at least a subrange comprising the darker colors in the high dynamic range image, c) a gamma function, and d) applying an arbitrary monotonically increasing function mapping the lumas resulting from performing the acts b and c to output lumas of the lower dynamic range image (LDR_o); and 2. outputting in an image signal (S_im) a codification of the pixel colors of the lower luminance dynamic range image (LDR_o), and 3. outputting in the image signal (S_im) values encoding the functional behavior of the above color conversions as metadata, or values for the inverse functions, which metadata allows to reconstruct a high dynamic range image (Rec_HDR) from the lower luminance dynamic range image (LDR_o).

Claims

1. A method of encoding a high dynamic range image (M_HDR), comprising the steps of:

converting the high dynamic range image to an image of lower luminance dynamic range (LDR_o) by applying;

a) normalization of the high dynamic range image to a scale of the luma axis being [0,1] yielding a normalized high dynamic range image with normalized colors having normalized luminances (Yn_HDR),

b) calculating a gamma function on the normalized luminances yielding gamma-converted luminances (xg),

c) applying a first tone mapping yielding lumas (v) which is defined as v=log(1+(RHO−

1)*xg)/log(RHO), with RHO having a predetermined value, and

d) applying an arbitrary monotonically increasing tone mapping function mapping the lumas to output lumas (Yn_LDR) of the lower dynamic range image (LDR_o); and

outputting in an image signal (S_im) a codification of the pixel colors of the lower luminance dynamic range image (LDR_o), and

outputting in the image signal (S_im) values encoding the function shapes of the above color conversions b to d as metadata, or values for their inverse functions, which metadata allows a receiver to reconstruct a reconstructed high dynamic range image (Rec_HDR) from the lower luminance dynamic range image (LDR_o), wherein RHO or a value being a function of RHO is outputted in the metadata.

2. A method of encoding a high dynamic range image (M_HDR) as claimed in claim 1 in which the gamma function calculation uses a gamma value equal to 1/(2.4).

3. A method of encoding a high dynamic range image (M_HDR) as claimed in claim 1 comprising determining a gain value (gai) for mapping the maximum luma of the lower dynamic range image (LDR_o) to a specific value of the possible values in the reconstructed high dynamic range image (Rec_HDR), and encoding that gain value in the image signal (S_im).

4. A method of encoding a high dynamic range image (M_HDR) as claimed in claim 3, in which the identification of the first geometrical region is performed by a human grader via a user interface unit, and the amount of banding of the first geometrical region in the reconstructed high dynamic range image (Rec_HDR), and the visual quality of reconstruction of the second geometrical region in the reconstructed high dynamic range image (Rec_HDR) are judged by the human grader as acceptable or unacceptable, wherein in case of the acceptable judgement the values encoding the function shape of the redistribution mapping function or its inverse are encoded in the image signal, or in case of the inacceptable judgement the steps are done again with different parameters to come to an alternative redistribution mapping function.

5. An image decoder as claimed in claim 4 comprising a tone remapping unit arranged to apply a further tone mapping (Ff1, Ff2, . . . ) received in the image signal (S_im) to the lower dynamic range image (LDR_t) to obtain a second lower dynamic range image (LDR_ul) which reverses a code redistribution action previously applied by the encoder of the lower dynamic range image for obtaining a reduced banding in at least a region of the reconstructed high dynamic range image (Rec_HDR).

6. The method of encoding a high dynamic range image (M_HDR) of claim 1 comprising:

after applying any of the above color mappings to determine the lower dynamic range image (LDR_o), applying a further technical tone mapping (301) to determine a second lower dynamic range image (LDR_i) which can be used to drive LDR displays as an alternative driving image alternative to the lower luminance dynamic range image (LDR_o), which technical tone mapping is determined by;

a) determining a first geometrical region of the lower luminance dynamic range image (LDR_o) for which the visibility of banding in the corresponding reconstructed high dynamic range image (Rec_HDR) is above an acceptable level,

b) determine a range of lumas (L_u) for that region,

c) determine a second range of pixel lumas (L_uu) adjacent on the luma axis to the range of lumas (L_u), wherein the second range is identified to fulfill the conditions that it has a number of lumas above a minimum number (MIN), and corresponds to a second geometrical image region which contains a texture which can be represented using less than the minimum number of codes in an LDR image (LDR_i) upon which to apply the functions yielding a reconstructed high dynamic range image (Rec_HDR) of sufficient visual quality for that second region, and

d) determining a redistribution mapping function which redistributes the lumas of the first and second range of lumas, so that additional codes are available for the first range, and outputting in the image signal (S_im) values encoding the function shape of the redistribution mapping function or preferably its inverse.

7. An image encoder arranged to encode a high dynamic range image (M_HDR), comprising:

a dynamic range conversion unit arranged to convert the high dynamic range image to an image of lower luminance dynamic range (LDR_o), the dynamic range conversion unit comprising;

a) a normalizer arranged to normalize the high dynamic range image to a luma axis ranging over [0,1] and to output normalized luminances (Yn_HDR),

b) a gamma conversion unit arranged to apply a gamma function to the normalized luminances and to output gamma-converted luminances (xg),

c) a first tone mapping unit arranged to apply a first tone mapping which yields lumas (v) which is defined as v=log(1+(RHO−

1)*xg)/log(RHO), with RHO having a predetermined value,

d) an arbitrary tone mapping unit arranged to apply an arbitrary monotonically increasing function which maps the lumas (v) to output lumas (Yn_LDR) of the lower dynamic range image (LDR_o); and

the image encoder further comprising;

an image compressor arranged to apply a data reduction transformation to the colors of the lower dynamic range image (LDR_o) which colors are organized in component images, and which reduction transformation involves at least applying a DCT transform to blocks of adjacent color component values, yielding a compressed codification (LDR₁₃ c) of the pixel colors of the lower luminance dynamic range mage; and

a formatter arranged to output in an image signal (S_im) the compressed codification (LDR_c), and arranged to in addition output in the image signal (S_im) values encoding the function shape of the color conversions as metadata, or values for their inverse functions, which metadata allows a receiver to reconstruct a high dynamic range image (Rec_HDR) based upon the lower luminance dynamic range image (LDR_o), the values comprising RHO or a value being a function of RHO.

8. An image decoder arranged to receive a high dynamic range image signal (S_im) and comprising:

a deformatter arranged to obtain a compressed pixellized lower dynamic range image (LDR_c) and parameter data (P) out of the image signal (S_im); and

a decompressor arranged to apply at least an inverse DCT transform to the compressed pixellized lower dynamic range image (LDR_c) to obtain a pixellized lower dynamic range image (LDR_t); and

a dynamic range conversion unit (153) arranged to transform the lower dynamic range image (LDR_t) into a reconstructed high dynamic range image (Rec_HDR), wherein the dynamic range conversion unit comprises;

a) an arbitrary tone mapping unit arranged to apply an arbitrary monotonically increasing tone mapping, the parameters which define it (P_CC) being received in the parameter data (P), b) a first tone mapping unit arranged to apply a mapping as defined by a function of the form;

9. A method of decoding a high dynamic range image signal (S_im) comprising:

obtaining a compressed pixellized lower dynamic range image (LDR_c) and parameter data (P) out of the image signal (S_im);

decompressing the compressed pixellized lower dynamic range image (LDR_c) by applying at least an inverse DCT transform to the compressed pixellized lower dynamic range image (LDR_c) to obtain a pixellized lower dynamic range image (LDR_t); and

transforming the lower dynamic range image (LDR_t) into a reconstructed high dynamic range image (Rec_HDR), by;

a) applying an arbitrary monotonically increasing tone mapping, the parameters which define it (P_CC) being received in the parameter data (P), b)applying a mapping as defined by at least one received parameter (RHO) the mapping being defined by a function of the form;