High dynamic range, backwards-compatible, digital cinema

• US 8,891,863 B2
• Filed: 05/10/2012
• Issued: 11/18/2014
• Est. Priority Date: 06/13/2011
• Status: Active Grant

• Current Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Original Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Inventors: Ninan, Ajit, Hulyalkar, Samir
• Primary Examiner(s): MOTSINGER, SEAN T
• Application Number:
  US13/468,674
• Publication Number:
  US 20120314944A1
• Time in Patent Office: 922 Days
• Field of Search: None
• US Class Current: 382/166
• CPC Class Codes: G06T 2207/20208 High dynamic range [HDR] image processing
• CPC Class Codes: G06T 5/40 using histogram techniques
• CPC Class Codes: H04N 19/33 in the spatial domain
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/647 using significance based coding, e.g. Embedded Zerotrees of Wavelets [EZW] or Set Partitioning in Hierarchical Trees [SPIHT]
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/41415 involving a public display, viewable by several users in a public space outside their home, e.g. movie theatre, information kiosk

Abstract

HDR images are coded and distributed. An initial HDR image is received. Processing the received HDR image creates a JPEG-2000 DCI-compliant coded baseline image and an HDR-enhancement image. The coded baseline image has one or more color components, each of which provide enhancement information that allows reconstruction of an instance of the initial HDR image using the baseline image and the HDR-enhancement images. A data packet is computed, which has a first and a second data set. The first data set relates to the baseline image color components, each of which has an application marker that relates to the HDR-enhancement images. The second data set relates to the HDR-enhancement image. The data packets are sent in a DCI-compliant bit stream.

Claims

1. A method, comprising:

receiving a high dynamic range (HDR) image;

processing the received HDR image, wherein the received HDR image comprises (a) a coded baseline image that complies with the Digital Cinema Systems Specification of the Digital Cinema Initiative (DCI Systems Standard), and (b) one or more HDR-enhancement images are created from the received HDR image;

wherein the coded baseline image comprises at least three color components, wherein the coded baseline image and the one or more HDR-enhancement images each provide enhancement information to allow reconstruction of an instance of the received HDR image using the baseline image and the HDR-enhancement images;

computing a data packet, wherein the data packet comprises;

a first data set that relates to the coded baseline image for the at least three color components; and

a second data set that relates to the HDR-enhancement images,

wherein the HDR enhancement images comprise;

a first coded chroma residual image,

a second chroma residual image, and

a coded ratio image,

wherein each of the residual images is configured to capture chroma information lost in creating the baseline image from the received HDR image, and

wherein the first coded chroma residual image is embedded within a first portion of the data packet that also includes baseline data for a first color component, the second coded chroma residual image is embedded within a second portion of the data packet that also includes baseline data for a second color component, and the coded ratio image is embedded within a third portion of the data packet that also includes baseline data for a third color component;

wherein computing the data packet comprises;

generating a tone-mapped image based on the received HDR image;

generating the coded ratio image, the coded ratio image comprising luminance ratio values generated by dividing luminance values of the received HDR image with luminance values of the tone-mapped image;

applying the luminance ratio values to the received HDR image to create a re-mapped image; and

determining the first coded chroma residual image and the second coded chroma residual image based on the re-mapped image and the tone-mapped image; and

sending the computed data packet in a bit stream that conforms to the DCI Systems Standard.

2. The method of claim 1 wherein the coded baseline image comprises a resolution of 2048×

1080 (2K).

3. The method as recited in claim 1 wherein the coded baseline image comprises a resolution of 4096×

2160 (4K).

4. The method of claim 1 wherein the at least three color components comprise:

an X′

color component;

a Y′

color component; and

a Z′

color component.

5. The method of claim 1, wherein the third portion of the data packet comprises an application marker that separates the baseline data for the third color component and the coded ratio image.

6. The method of claim 1, wherein the first portion of the data packet comprises an application marker that separates the baseline data for the first color component and the first coded chroma residual image.

7. The method of claim 1, wherein the second portion of the data packet comprises an application marker that separates the baseline data for the second color component and the second coded chroma residual image.

8. The method of claim 5, wherein the application marker conforms to a specification of the JPEG 2000 compressor/decompressor (codec) of the Joint Photographic Experts Group (JPEG).

17. The method of claim 6, wherein the application marker conforms to a specification of the JPEG 2000 compressor/decompressor (codec) of the Joint Photographic Experts Group (JPEG).

9. An apparatus comprising a processor, wherein the processor is configured to:

receive a high dynamic range (HDR) image;

process the received HDR image, wherein the HDR image comprises (a) a coded baseline image that complies with the Digital Cinema Systems Specification of the Digital Cinema Initiative (DCI Systems Standard), and (b) one or more HDR-enhancement images are created from the received HDR image;

wherein the coded baseline image comprises at least three color components, wherein the coded baseline image and the one or more HDR-enhancement images each provide enhancement information to allow reconstruction of an instance of the received HDR image using the baseline image and the HDR-enhancement images;

compute a data packet, wherein the data packet comprises;

a first data set that relates to the baseline image for the at least three color components; and

a second data set that relates to the HDR-enhancement images, wherein each of the HDR enhancement images comprise;

a first coded chroma residual image,

a second coded chroma residual image, and

a coded ratio image,

wherein each of the residual images is configured to capture chroma information lost in creating the baseline image from the received HDR image, and

wherein the first coded chroma residual image is embedded within a first portion of the data packet that also includes baseline data for a first color component, the second coded chroma residual image is embedded within a second portion of the data packet that also includes baseline data for a second color component, and the coded ratio image is embedded within a third portion of the data packet that also includes baseline data for a third color component;

wherein compute the data packet comprises;

generate a tone-mapped image based on the received HDR image;

generate the coded ratio image, the coded ratio image comprising luminance ratio values generated by dividing luminance values of the received HDR image with luminance values of the tone-mapped image;

apply the luminance ratio values to the received HDR image to create a re-mapped image; and

determine the first coded chroma residual image and the second coded chroma residual image based on the re-mapped image and the tone-mapped image; and

send the computed data packet in a bit stream that conforms to the DCI Systems Standard, wherein the HDR image is distributed.

11. The apparatus of claim 9, wherein the at least three color components comprise:

an X′

color component;

a Y′

color component; and

a Z′

color component.

12. The apparatus of claim 9, wherein the coded baseline image comprises a resolution of either 2048×

1080 (2K), or 4096×

2160 (4K).

13. The apparatus of claim 9, wherein the third portion of the data packet comprises an application marker that separates the baseline data for the third color component and the coded ratio image, and wherein the application marker conforms to a specification of the JPEG 2000 compressor/decompressor (codec) of the Joint Photographic Experts Group (JPEG).

18. The apparatus of claim 9, wherein the first portion of the data packet comprises an application marker that separates the baseline data for the first color component and the coded ratio image, and wherein the application marker conforms to a specification of the JPEG 2000 compressor/decompressor (codec) of the Joint Photographic Experts Group (JPEG).

10. A non-transitory computer-readable storage medium having stored thereon computer-executable instructions for:

receiving a high dynamic range (HDR) image;

processing the received HDR image, wherein the received HDR image comprises (a) a coded baseline image that complies with the Digital Cinema Systems Specification of the Digital Cinema Initiative (DCI Systems Standard), and (b) one or more HDR-enhancement images are created from the received HDR image;

wherein the coded baseline image comprises at least three color components, wherein the coded baseline image and the one or more HDR-enhancement images each provide enhancement information to allow reconstruction of an instance of the received HDR image using the baseline image and the HDR-enhancement images;

computing a data packet, wherein the data packet comprises;

a first data set that relates to the baseline image for the at least three color components; and

a second data set that relates to the HDR-enhancement images, wherein each of the HDR enhancement images comprise;

a first coded chroma residual image,

a second coded chroma residual image, and

a coded ratio image,

wherein each of the residual images is configured to capture chroma information lost in creating the baseline image from the received HDR image, and

wherein the first coded chroma residual image is embedded within a first portion of the data packet that also includes baseline data for a first color component, the second coded chroma residual image is embedded within a second portion of the data packet that also includes baseline data for a second color component, and the coded ratio image is embedded within a third portion of the data packet that also includes baseline data for a third color component;

wherein computing the data packet comprises;

generating a tone-mapped image based on the received HDR image;

generating the coded ratio image, the coded ratio image comprising luminance ratio values generated by dividing luminance values of the received HDR image with luminance values of the tone-mapped image;

applying the luminance ratio values to the received HDR image to create a re-mapped image; and

determining the first coded chroma residual image and the second coded chroma residual image based on the re-mapped image and the tone-mapped image; and

sending the computed data packet in a bit stream that conforms to the DCI Systems Standard.

14. The computer-readable storage medium of claim 10, wherein the coded baseline image comprises:

an X′

color component;

a Y′

color component; and

a Z′

color component.

15. The computer-readable storage medium of claim 10, wherein the coded baseline image comprises a resolution of either 2048×

1080 (2K), or 4096×

2160 (4K).

16. The computer-readable storage medium of claim 10, wherein the third portion of the data packet comprises an application marker that separates the baseline data for the third color component and the coded ratio image, and wherein the application marker conforms to a specification of the JPEG 2000 compressor/decompressor (codec) of the Joint Photographic Experts Group (JPEG).

19. The computer-readable storage medium of claim 10, wherein the first portion of the data packet comprises an application marker that separates the baseline data for the first color component and the coded ratio image, and wherein the application marker conforms to a specification of the JPEG 2000 compressor/decompressor (codec) of the Joint Photographic Experts Group (JPEG).