METHODS AND APPARATUSES FOR CREATING CODE MAPPING FUNCTIONS FOR ENCODING AN HDR IMAGE, AND METHODS AND APPARATUSES FOR USE OF SUCH ENCODED IMAGES

• US 20160165256A1
• Filed: 06/30/2014
• Published: 06/09/2016
• Est. Priority Date: 07/18/2013
• Status: Active Grant

• Current Assignee: Koninklijke Philips N.V.
• Original Assignee: Koninklijke Philips N.V.
• Inventors: Van Der Vleuten, Renatus Josephus, STESSEN, Jeroen Hubert Christoffel, Van Mourik, Johannes Gerardus Rijk
• Granted Patent: US 10,194,162 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G09G 2320/0271 Adjustment of the gradation levels within the range of the gradation scale, e.g. by redistribution or clipping
• CPC Class Codes: G09G 5/10 Intensity circuits
• CPC Class Codes: H04N 1/64 Systems for the transmission or the storage of the colour picture signal; Details therefor, e.g. coding or decoding means therefor H04N19/00 takes precedence
• CPC Class Codes: H04N 19/36 Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 23/741 by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
• CPC Class Codes: H04N 9/68 for controlling the amplitude of colour signals, e.g. automatic chroma control circuits H04N9/71, H04N9/73 take precedence; camera processing pipelines for controlling the colour saturation of colour signals H04N23/86

Abstract

To enable better encoding of the currently starting to appear high dynamic range images for use in full high dynamic range technical systems (containing an HDR display, and e.g. in an HDR grading application of a HDR movie), we invented a method of encoding a high dynamic range image, comprising the steps of: inputting pixel colors of an input high dynamic range image, wherein the pixel colors have information of a luminance and a chromaticity; applying an inverse of a mapping function to derive a luma code (v) of the luminance of a pixel color, which mapping function is predetermined as comprising a first partial function which is defined as (I), in which rho is a tuning constant, and v is the luma code corresponding to a luminance to be encoded, and a second partial mapping defined as L=L_mP⁶⁵ in which Lm is a peak luminance of a predefined reference display, and gamma is a constant which is preferably equal to 2.4, outputting a matrix of pixels having a color encoding comprising the luma codes.

Claims

1. A method of encoding a high dynamic range video of images, comprising the steps of:

inputting pixel colors of an input high dynamic range image, wherein the pixel colors have information of a luminance and a chromaticity;

applying an inverse of a mapping function, to derive a luma code (v) of the luminance of a pixel color, which mapping function is predetermined as comprising a first partial function which is defined as

2. A method of encoding a high dynamic range video of images according to claim 1 in which Lm equals 5000 nit.

3. A method of encoding a high dynamic range video of images according to claim 1 in which rho equals 25.

4. A method of encoding a high dynamic range video of images according to claim 1 in which the gamma function is composed of an equivalent gamma of a Rec. 709 encoding gamma and a gamma 2.4 function.

5. A method of encoding a high dynamic range video of images according to claim 1 in which the parameters rho and gamma, are further optimized to yield an encoded image which looks good according to a human color grader on a 100 nit display, whereby the at least one of the parameters rho and gamma is preferably optimized by a human grader.

6. A method of encoding a high dynamic range video of images as claimed in claim 1, in which chromaticity coordinates (u,v) of the color encoding are defined referenced from a CIE XYZ representation of the colors of pixels in the high dynamic range image (HDR_ORIG) by fractional equations of the type:

7. A method of encoding a high dynamic range video of images as claimed in claim 1, in which the chromaticity coordinates (u,v) are defined relative to a predetermined white point such as preferably D65.

8. A method of encoding a high dynamic range video of images according to claim 1, in which an image signal (S_im) is formed which comprises a pixel matrix image with pixel colors encoded with one color component being the luma code, and associated therewith metadata comprising at least one of the rho and gamma parameter.

16. An video decoding apparatus for decoding a high dynamic range video of images encoding (S_im) comprising:

a receiving and formatting unit arranged to receive the high dynamic range image encoding (S_im) and derive therefrom an image encoding (Im_1) comprising luma codes, resulting from an encoding method as defined in claim 1, to be processed;

a color mapping unit arranged to apply a color mapping strategy to derive from the image encoding Im_1 a high dynamic range image (REC_HDR), wherein the color mapping unit is arranged to apply on pixel lumas v in the image encoding (Im_1) a predetermined mapping function defined as comprising a first partial function which is

17. An video decoding apparatus for decoding a high dynamic range video of images encoding (S_im) as claimed in claim 16 wherein:

the receiving and formatting unit is arranged to derive from the high dynamic range image encoding (S_im) at least one of the parameters rho, gamma, or Lm.

9-11. -11 (canceled)

12. An video encoding apparatus for encoding a high dynamic range video of images, comprising:

an input for obtaining pixel colors of an input high dynamic range image, wherein the pixel colors have information of a luminance and a chromaticity;

a grading managing unit arranged for applying an inverse of a mapping function to derive a luma code (v) of the luminance of a pixel color, which mapping function is predetermined as comprising a first partial function which is defined as

13. An video encoding apparatus as claimed in claim 12 comprising a user interface unit allowing a human grader to select a particular value of rho and/or gamma.

14. An video encoding apparatus as claimed in claim 12 comprising an automatic image analysis unit arranged to determine a particular value of rho and/or gamma based upon a statistical analysis of the luminances of objects present in at least one of the high dynamic range images (HDR_ORIG).

15. An video encoding apparatus as claimed in claim 12 in which the grading managing unit is arranged to determine chromatic components of the pixels of the high dynamic range image (HDR_ORIG) as:

18. An video decoding apparatus for decoding a high dynamic range video of images encoding (S_im) as claimed in claim 12, in which the color mapping unit is further arranged to receive chromaticity coordinates (u,v) for the pixel colors, and to apply a transformation to map together with the information of the luminances the u and v components of the pixel colors of the image Im_1 to a universal color representation like e.g. a CIE XYZ color representation, or to a device dependent color representation like RGB.

19. An video decoding apparatus for decoding a high dynamic range video of images encoding (S_im) as claimed in claim 12 in which the color mapping unit is further arranged to apply a second color mapping strategy using further color mapping parameters co-encoded as metadata specifying a color mapping to an image with a dynamic range different from the dynamic range defined by the high dynamic range image (REC_HDR).

20. A display comprising the video decoding apparatus as claimed in claim 12-s.

21. A method of image video decoding comprising:

receiving an encoded high dynamic range video video of images (S_im) and deriving therefrom an image encoding (Im_1) to be processed, and

color mapping by applying a color mapping strategy to derive from the image encoding (Im_1) a high dynamic range image (REC_HDR), wherein the color mapping unit is arranged to apply on pixel lumas v in the image encoding (Im_1) a predetermined mapping function defined as comprising a first partial function which is