Methods and systems for inter-layer image prediction

• US 8,503,524 B2
• Filed: 01/23/2007
• Issued: 08/06/2013
• Est. Priority Date: 01/23/2007
• Status: Expired due to Fees

• Current Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Laboratories of America Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Segall, Christopher A.
• Primary Examiner(s): Czekaj, David
• Assistant Examiner(s): Werner, David N
• Application Number:
  US11/626,366
• Publication Number:
  US 20080175494A1
• Time in Patent Office: 2,387 Days
• Field of Search: 375/240.1, 375/240.11, 375/240, 375/240.01, 375/240.12
• US Class Current: 375/240.11
• CPC Class Codes: H04N 19/105 Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/18 the unit being a set of transform coefficients
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/33 in the spatial domain
• CPC Class Codes: H04N 19/36 Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/48 using compressed domain processing techniques other than decoding, e.g. modification of transform coefficients, variable length coding [VLC] data or run-length data motion estimation in a transform domain H04N19/547; processing of decoded motion vectors H04N19/513

Abstract

Embodiments of the present invention comprise systems and methods for predicting image elements, comprising extracting a low dynamic range (LDR) image value from a received LDR image data; modifying the LDR image value based on prediction data of a received high dynamic range (HDR) image data; and predicting an HDR image element based on the modified LDR image value and an HDR residual image element of the received HDR image data.

Claims

1. A method comprising:

extracting a low dynamic range (LDR) image value from received LDR image data;

modifying, by a video decoder, the extracted LDR image value based on prediction data of received high dynamic range (HDR) image data, wherein the prediction data is data for prediction within the video decoder; and

determining, by the video decoder, an HDR image element prediction based on the modified LDR image value and an HDR residual image element of the received HDR image data.

2. The method of claim 1 wherein the LDR image value comprises a spatial domain intensity value.

3. The method of claim 1 wherein the LDR image value comprises a transform domain coefficient.

4. The method of claim 1 wherein the modifying comprises scaling the extracted LDR image value.

5. The method of claim 1 wherein the modifying comprises applying an offset to the extracted LDR image value.

6. The method of claim 1 wherein the modifying comprises scaling the extracted LDR image value and applying an offset to the scaled LDR image value.

7. The method of claim 1 wherein the modifying is based on spatial location.

8. The method of claim 1 wherein the modifying is based on an image element value.

9. The method of claim 1 wherein the modifying varies in relation to an image element chromaticity value.

11. A method as described in claim 1 wherein said LDR image value comprises a spatial domain intensity value.

12. A method as described in claim 1 wherein said LDR image value comprises a transform domain coefficient.

13. A method as described in claim 1 wherein said modifying comprises scaling said LDR image value.

14. A method as described in claim 1 wherein said modifying comprises applying an offset to said LDR image value.

15. A method as described in claim 1 wherein said modifying comprises scaling said LDR image value and applying an offset to said LDR image value.

16. A method as described in claim 1 wherein said modifying varies in relation to spatial location.

17. A method as described in claim 1 wherein said modifying varies in relation to an image element value.

18. A method as described in claim 1 wherein said modifying varies in relation to an image element chromaticity value.

10. A method for predicting a high dynamic range image element by a video decoder, said method comprising:

receiving low dynamic range (LDR) image data;

receiving high dynamic range (HDR) image data, the HDR image data comprising;

prediction data and an HDR residual image element, wherein the prediction data is data for prediction within the video decoder;

extracting an LDR image value from said LDR image data;

modifying, by the video decoder, said LDR image value based on said prediction data; and

determining, by the video decoder, an HDR image element prediction based on combining said modified LDR image value with said HDR residual image element.

19. A method comprising:

modifying a received low dynamic range (LDR) image element;

determining, by a video encoder, a residual high dynamic range (HDR) image element based on the modified LDR image element and a received HDR image element, wherein the received HDR image element is associated with the received LDR image element; and

predicting, by the video encoder, an HDR image data based on the determined residual HDR image element and prediction data, wherein the prediction data comprises at least one of;

scaling parameters and offsetting parameters and wherein the prediction data is data for prediction within the video encoder.

20. A system comprising:

a video encoder, the video encoder configured to;

modify a low dynamic range (LDR) image element based on prediction data, wherein the prediction data is data for prediction within the video encoder;

determine a residual high dynamic range (HDR) image element based on the modified LDR image element and an HDR image element associated with the LDR image element; and

predict an HDR image data based on the determined residual HDR image element and the prediction data; and

a video decoder, the video decoder configured to;

receive the HDR image data and an LDR image data, wherein the received HDR image data comprises the determined residual HDR image element;

modify an extracted LDR image value, wherein the extraction is from the received LDR image data; and

determine an HDR image element prediction based on the modified extracted LDR image value and the determined residual HDR image element of the received HDR image data.

21. The system of claim 20 wherein the encoder is further configured to determine the residual HDR image element based on the comparison of the modified LDR image element and the HDR image element associated with the LDR image element.

22. The system of claim 20 wherein the decoder is further configured to determine the HDR image element based on the combination of the modified extracted LDR image value and the determined residual HDR image element of the received HDR image data.