Encoding, Decoding, and Representing High Dynamic Range Images

• US 20130071022A1
• Filed: 11/13/2012
• Published: 03/21/2013
• Est. Priority Date: 04/15/2011
• Status: Active Grant

• Current Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Original Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Inventors: Jia, Wenhui, Ninan, Ajit, Ten, Arkady, Ward, Gregory John
• Granted Patent: US 8,508,617 B2
• Time in Patent Office: Days
• US Class Current: 382/166
• CPC Class Codes: G06T 9/00 Image coding bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/169 characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
• CPC Class Codes: H04N 19/182 the unit being a pixel
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/50 using predictive coding H04N19/61 takes precedence
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 23/741 by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
• CPC Class Codes: H04N 23/85 for matrixing
• CPC Class Codes: H04N 9/67 for matrixing camera processing pipelines for matrixing of colour signals H04N23/85
• CPC Class Codes: H04N 9/77 Circuits for processing the brightness signal and the chrominance signal relative to each other, e.g. adjusting the phase of the brightness signal relative to the colour signal, correcting differential gain or differential phase circuits for matrixing H04N9/67

Abstract

Techniques are provided to encode and decode image data comprising a tone mapped (TM) image with HDR reconstruction data in the form of luminance ratios and color residual values. In an example embodiment, luminance ratio values and residual values in color channels of a color space are generated on an individual pixel basis based on a high dynamic range (HDR) image and a derivative tone-mapped (TM) image that comprises one or more color alterations that would not be recoverable from the TM image with a luminance ratio image. The TM image with HDR reconstruction data derived from the luminance ratio values and the color-channel residual values may be outputted in an image file to a downstream device, for example, for decoding, rendering, and/or storing. The image file may be decoded to generate a restored HDR image free of the color alterations.

Claims

1. A method, comprising:

receiving a high dynamic range (HDR) image;

generating a tone-mapped (TM) image based on the HDR image;

generating a luminance ratio image, the luminance ratio image comprising luminance ratio values generated by dividing luminance values of the HDR image with luminance values of the TM image;

applying the luminance ratio values to the HDR image to create a re-mapped image;

determining residual chroma values based on the re-mapped image and the TM image;

generating a log ratio image based on the luminance ratio image; and

generating a coded HDR image, the coded HDR image comprising the TM image and HDR reconstruction data, the HDR reconstruction data being derived from the log ratio image and the residual color values.

2. The method of claim 1, wherein generating the HDR reconstruction data further comprises quantizing the log ratio image with a first quantizer to generate quantized log ratio image values;

3. The method of claim 2, wherein quantizing of the log ratio image further comprises generating a quantization parameter based on a minimum pixel value of the log ratio image or a maximum pixel value of the log ratio image.

4. The method of claim 2, wherein generating the HDR reconstruction data further comprises quantizing the residual chroma values with a second quantizer to generate quantized residual chroma values.

5. The method of claim 4, wherein the HDR reconstruction data comprises a residual image with image values derived from the quantized log ratio image values and the quantized residual chroma values.

6. The method of claim 1, wherein the HDR reconstruction data is stored in an application segment of an image file with the TM image as a base image in the image file.

7. The method of claim 6, wherein the image file is in a JPEG-HDR format.

8. The method of claim 6, wherein the TM image is stored in the image file as a JPEG image.

9. The method of claim 1, further comprising applying a color space conversion to at least one of the HDR image, the TM image, or the re-mapped image.

10. The method of claim 1, wherein the HDR image is one of a fixed-point image or a floating-point image.

11. The method of claim 1, wherein the HDR image is encoded in one of JPEG, JPEG-2000, MPEG, AVI, TIFF, BMP, GIFF, or another image format.

12. A method, comprising:

parsing an image file comprising a tone-mapped (TM) base image and high dynamic range (HDR) reconstruction data, the HDR reconstruction data comprising quantized log ratio luminance values and quantized residual chroma values;

computing quantization parameters relating to the quantized log ratio luminance values and the quantized residual chroma values;

converting, based at least in part on the quantization parameters, the quantized log ratio luminance values and the quantized residual chroma values into ratio luminance values and residual chroma values; and

reconstructing an HDR image using the TM base image the ratio luminance values and the residual chroma values.

13. The method of claim 12, wherein the image file is parsed with a standard-based image decoder.

14. The method of claim 12, wherein the quantized log ratio luminance values and the quantized residual chroma values are stored in a residual image, and wherein the residual image and the TM base image are de-quantized and decompressed using a common procedure.

15. The method of claim 12, wherein the TM base image comprises results of any tone mapping operations with any tone mapping operator and/or any color alterations on any number of pixels.

16. The method of claim 12, wherein the TM base image comprises a JPEG-coded image.