GENERATION OF HIGH DYNAMIC RANGE IMAGES FROM LOW DYNAMIC RANGE IMAGES IN MULTIVIEW VIDEO CODING

• US 20130108183A1
• Filed: 07/05/2011
• Published: 05/02/2013
• Est. Priority Date: 07/06/2010
• Status: Active Grant

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Bruls, Wilhelmus Hendrikus Alfonsus, Muijs, Remco Theodorus Johannes
• Granted Patent: US 9,098,906 B2
• Time in Patent Office: Days
• US Class Current: 382/233
• CPC Class Codes: G06T 9/004 Predictors, e.g. intraframe, interframe coding
• CPC Class Codes: H04N 19/103 Selection of coding mode or of prediction mode
• CPC Class Codes: H04N 19/105 Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/154 Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion use of rate-distortion criteria H04N19/147
• CPC Class Codes: H04N 19/184 the unit being bits, e.g. of the compressed video stream
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/593 involving spatial prediction techniques
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding

Abstract

Several approaches are disclosed for combining HDR and 3D image structure analysis and coding, in particular an encoding apparatus for encoding a first view high dynamic range image and a second view high dynamic range image comprising: first and second HDR image receivers (203, 1201) arranged to receive the first view high dynamic range image and a second view high dynamic range image; a predictor (209) arranged to predict the first view high dynamic range image from a low dynamic range representation of the first view high dynamic range image; and a view predictor (1203) to predict the second view high dynamic range image from at least one of the first view high dynamic range image, a low dynamic range representation of the second view high dynamic range image, or a low dynamic range representation of the first view high dynamic range image.

Claims

1. A encoding apparatus for encoding a first view high dynamic range image and a second view high dynamic range image comprising:

first and second HDR image receivers (203, 1201) arranged to receive the first view high dynamic range image and a second view high dynamic range image;

a predictor (209) arranged to predict the first view high dynamic range image from a low dynamic range representation of the first view high dynamic range image; and

a view predictor (1203) to predict the second view high dynamic range image from at least one of the first view high dynamic range image, a low dynamic range representation of the second view high dynamic range image, or a low dynamic range representation of the first view high dynamic range image.

2. The encoding apparatus of claim 1 wherein the predictor (209) is further arranged to predict the first view high dynamic range image based on a stored subsampled description of a relationship between the per spatial locality relationship between the low dynamic range representation pixel values and the first view high dynamic range image pixel values.

3. The encoding apparatus of claim 1 wherein the predictor (209) is further arranged to predict the first view high dynamic range image based on depth indications for spatial regions of the low dynamic range representation.

4. The encoding apparatus of claim 1 wherein the high dynamic range first view image and the high dynamic range second view image are jointly encoded with the high dynamic range first view image being encoded without being dependent on the high dynamic range second view image and the high dynamic range second view image being encoded using data from the high dynamic range first view image, the encoded data being split into separate data streams including a primary data stream comprising data for the high dynamic range first view image and a secondary data stream comprising data for the high dynamic range second view image, the encoding apparatus comprising an output processor (215) further arranged to multiplex preferably in an interleaved way the primary and secondary data streams into an output encoded data stream and to provide data for the primary and secondary data streams with separate identification codes.

5. The encoding apparatus of claim 1 wherein at least one predictor (209 or 1203) is connected to several picture memories for storing prediction pictures.

6. The encoding apparatus of claim 5 wherein all predictors are realized as a standard prediction semiconductor or software topology, which may be used both for predicting from a lower to a higher dynamic range representation and for prediction between different views of an imaged scene.

9. A decoding apparatus as claimed in claim 7 further comprising a formatter, arranged to separate interleaved combined stereo and HDR encoding information as produced by the encoder of claim 4.

7. A decoding apparatus for obtaining a first view high dynamic range image and a second view high dynamic range image comprising:

a first receiver (2201) for receiving an encoded low dynamic range image of a first view;

a second receiver (2202) for receiving high dynamic range image data of the first view;

a third receiver (2202) for receiving image data relating to a second view;

a predictor (2204+2205) for predicting the first view high dynamic range image from a decoded low dynamic range image of the first view and the high dynamic range image data of the first view; and

a view predicting decoder (2210) for obtaining the second view high dynamic range image comprising on the basis of at least one of a) the first view high dynamic range image, b) a decoded low dynamic range representation of the second view high dynamic range image, or c) the decoded low dynamic range representation of the first view high dynamic range image or a transformation thereof.

8. A decoding apparatus as claimed in claim 7 in which the predictor is further arranged to predict the first view high dynamic range image on the basis of derived depth information for the first view.

10. A method of encoding a first view high dynamic range image and a second view high dynamic range image comprising:

receiving the first view high dynamic range image and a second view high dynamic range image;

predicting the first view high dynamic range image from a low dynamic range representation of the first view high dynamic range image; and

predicting the second view high dynamic range image from at least one of the first view high dynamic range image, a low dynamic range representation of the second view high dynamic range image, or a low dynamic range representation of the first view high dynamic range image.

11. A method of decoding encoded image data of a high dynamic range representation of at least two views for obtaining a first view high dynamic range image and a second view high dynamic range image comprising:

receiving an encoded low dynamic range image of a first view;

receiving high dynamic range image data of the first view;

receiving image data relating to a second view;

decoding the encoded low dynamic range image of the first view obtaining a decoded low dynamic range image of the first view;

predicting the first view high dynamic range image from the decoded low dynamic range image of the first view and the high dynamic range image data of the first view; and

obtaining the second view high dynamic range image comprising on the basis of at least one of a) the first view high dynamic range image, b) a decoded low dynamic range representation of the second view high dynamic range image, or c) the decoded low dynamic range representation of the first view high dynamic range image or a transformation thereof.