Methods and Systems for Inter-Layer Image Prediction Signaling

• US 20080175496A1
• Filed: 01/23/2007
• Published: 07/24/2008
• Est. Priority Date: 01/23/2007
• Status: Active Grant

• Current Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Segall, Christopher A.
• Granted Patent: US 8,665,942 B2
• Time in Patent Office: Days
• US Class Current: 382/238
• CPC Class Codes: G06T 2207/20208 High dynamic range [HDR] image processing
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/92 based on global image properties
• CPC Class Codes: G06T 5/94 based on local image properties, e.g. for local contrast enhancement
• CPC Class Codes: H04N 19/105 Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• CPC Class Codes: H04N 19/134 characterised by the element, parameter or criterion affecting or controlling the adaptive coding
• CPC Class Codes: H04N 19/137 Motion inside a coding unit, e.g. average field, frame or block difference
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/184 the unit being bits, e.g. of the compressed video stream
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/36 Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/503 involving temporal prediction adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 23/741 by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors

Abstract

Embodiments of the present invention comprise systems and methods for predicting image elements.

Claims

1. A method for predicting a high dynamic range image block with block-specific prediction data, said method comprising:

a) receiving low dynamic range (LDR) image data for a target image block;

b) receiving high dynamic range (HDR) image data for said target image block, said HDR image data comprising an HDR residual image block, a prediction scaling factor and a prediction offset factor for said target image block;

c) extracting an LDR image block from said LDR image data;

d) scaling said LDR image block with said prediction scaling factor;

e) offsetting said LDR image block with said prediction offset factor; and

f) combining said scaled, offset LDR image block with said HDR residual image block to form an HDR image block corresponding to said target image block.

2. A method as described in claim 1 wherein said combining comprises adding image values in said scaled, offset LDR image block to corresponding values in said HDR residual image block.

3. A method as described in claim 1 wherein said extracting comprises decoding, inverse transformation, dequantizing and prediction of said LDR image block.

4. A method for predicting a high dynamic range image block with differentially-coded prediction data, said method comprising:

a) receiving high dynamic range (HDR) image data for a first image block, said HDR image data comprising a first HDR residual image block and first prediction data for said first image block;

b) receiving high dynamic range (HDR) image data for a second image block, said HDR image data comprising a second HDR residual image block and prediction difference data related to said first prediction data; and

c) combining said first prediction data and said prediction difference data to determine second prediction data for said second image block.

5. A method as described in claim 4 wherein said first image block is an upper neighbor to said second image block.

6. A method as described in claim 4 wherein said first image block is a neighbor to the left of said second image block.

7. A method as described in claim 4 wherein said first image block is selected from a neighborhood around said second image block.

8. A method as described in claim 4 wherein said first image block is selected as the lesser of an upper neighbor and a left-hand neighbor to said second image block.

9. A method as described in claim 4 wherein said first prediction data comprises a scaling factor and an offset factor.

10. A method for predicting a high dynamic range image block with differentially-coded prediction data, said method comprising:

a) receiving high dynamic range (HDR) image data for a first image block, said HDR image data comprising first prediction data for said first image block;

b) receiving high dynamic range (HDR) image data for a second image block, said HDR image data comprising second prediction data for said second image block;

c) receiving third prediction difference data for a third image block wherein said third prediction difference data is differentially coded relative to at least one of said first prediction data and said second prediction data; and

d) determining third prediction data for said third image block based on at least one of said third prediction difference data, said second prediction data and said first prediction data.

11. A method as described in claim 10 wherein said second prediction data comprises a differential quantity related to said first image data.

12. A method as described in claim 10 wherein said determining third prediction data comprises determining a state defined by the values of said first prediction data and said second prediction data.

13. A method as described in claim 10 wherein said first prediction data comprises a scaling factor.

14. A method as described in claim 10 wherein said first prediction data comprises an offset factor.

15. A method for predicting an image, said method comprising:

a) receiving a high-level prediction message defining prediction data for a plurality of image elements wherein said message disables transmission of element-specific prediction data for individual image elements;

b) receiving high dynamic range (HDR) image data for said plurality of image elements, said HDR image data comprising HDR residual image blocks; and

c) predicting said plurality of image elements using data from said high-level prediction message.

16. A method as described in claim 15 wherein said plurality of image elements comprises an image block.

17. A method as described in claim 15 wherein said plurality of image elements comprises an image frame.

18. A method as described in claim 15 further comprising receiving a high-level prediction message wherein said message enables transmission of element-specific prediction data for individual image elements.

19. A method as described in claim 15 wherein said prediction data defined by said high-level prediction message comprises a scaling factor.

20. A method as described in claim 15 wherein said prediction data defined by said high-level prediction message comprises an offset factor.