Video data compression

• US 9,406,112 B2
• Filed: 01/05/2011
• Issued: 08/02/2016
• Est. Priority Date: 07/10/2008
• Status: Active Grant

• Current Assignee: Koninklijke Philips N.V.
• Original Assignee: University of Warwick
• Inventors: Bonnet, Gerhard, Banterle, Francesco, Artusi, Alessandro, Debattista, Kurt, Ledda, Patrick, Edwards, Gavin John, Chalmers, Alan
• Primary Examiner(s): Pe, Geepy
• Assistant Examiner(s): Adrovel, William
• Application Number:
  US12/984,992
• Publication Number:
  US 20110235720A1
• Time in Patent Office: 2,036 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20028 Bilateral filtering
• CPC Class Codes: G06T 5/90 Dynamic range modification of images or parts thereof
• CPC Class Codes: G06T 5/92 based on global image properties
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/33 in the spatial domain
• CPC Class Codes: H04N 19/34 Scalability techniques involving progressive bit-plane based encoding of the enhancement layer, e.g. fine granular scalability [FGS]
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

A method of producing a compressed video data stream (12) by compressing a stream of relatively high dynamic range video frames (2). A bilateral filter (3) extracts a base frame (4) with luminance information. The base frame (4) and the original frame (2) are used to provide a detail frame (5) with chroma information. A tone mapping operation (6) is selected (7, 11) and applied to the base frame to generate a relatively low dynamic range base frame (8), which is then compressed (9). The detail frame (5) is compressed separately. Final frame data (12) is then created, consisting of the compressed relatively low dynamic range base frame, the compressed detail frame, and stored information in respect of the tone mapping operation that had been applied to the base frame.

Claims

1. A method of producing a compressed video data stream by compressing a stream of high dynamic range video frames, wherein for at least some high dynamic range original video frames in the stream which include color and luminance data, the method comprises the steps of:

(a) firstly from the high dynamic range original frame in the stream, using a filter to extract luminance data to form a high dynamic range base frame containing the extracted luminance data;

(b) subsequently using the high dynamic range base frame and the high dynamic range original frame to form a detail frame of fine details containing the color data in the high dynamic range original frame without the extracted luminance data;

(c) generating a tone mapping operation for the high dynamic range base frame and applying that tone mapping operation to the high dynamic range base frame only, to generate a reduced dynamic range base frame;

(d) storing information in respect of the tone mapping operation applied to the high dynamic range base frame;

(e) subjecting the reduced dynamic range base frame to temporal compression, and subjecting the detail frame to temporal compression;

(f) creating a final frame data consisting of the compressed reduced dynamic range base frame, the compressed detail frame, and the information in respect of the tone mapping operation applied to the high dynamic range base frame by inverting the tone mapping operation; and

(g) including the final frame data in the compressed video data stream.

2. A method as claimed in claim 1, wherein generating a tone mapping operation for the high dynamic range base frame comprises selecting a tone mapping function from a plurality of predefined tone mapping functions.

3. A method as claimed in claim 2, wherein the tone mapping operation applied to the high dynamic range base frame is obtained by altering an initial tone mapping function selected from the plurality of predefined tone mapping functions, by reference to stored properties of at least one previous tone mapping function obtained for a previous high dynamic range base frame of the same scene.

4. A method as claimed in claim 3, wherein if the difference between the initial tone mapping operation determined for a given high dynamic range base frame and the at least one previous tone mapping function is too large, the initial tone mapping operation is corrected to a tone mapping operation which corresponds more closely to the at least one previous tone mapping function.

5. A method as claimed in claim 2, wherein generating a tone mapping operation for the high dynamic range base frame further comprises selecting parameters associated with the selected tone mapping function.

6. A method as claimed in claim 1, wherein the detail frame is obtained by subtraction of the high dynamic range base frame from the high dynamic range original frame and/or by division of the high dynamic range original frame by the high dynamic range base frame.

7. A method as claimed in claim 1, wherein the compression of the reduced dynamic range base frame and the compression of the detail frame are carried out separately.

8. A method as claimed in claim 1, wherein the filter used to extract the high dynamic range base frame from the high dynamic range original frame is a bilateral filter.

9. A method as claimed in claim 1, wherein luminance information relating to a frame is included in the compressed video data stream separately from the information in respect of the tone mapping operation applied to the high dynamic range base frame.

10. A method as claimed in claim 2, wherein the plurality of predefined tone mapping functions comprises at least one fixed and/or at least one user defined tone mapping function.

11. A method as claimed in claim 1, wherein the high dynamic range video frames are arranged as a plurality of different scenes each comprising a plurality of the video frames, and the tone mapping operations applied to some high dynamic range base frames in respect of the same scene differ from one another.

12. A method as claimed in claim 1, wherein the high dynamic range video frames are arranged as a plurality of different scenes each comprising a plurality of the video frames, and the tone mapping operations applied to high dynamic range base frames in respect of one of the plurality of scenes differ from the tone mapping operations applied to high dynamic range base frames in respect of another of the plurality of scenes.

13. A method as claimed in claim 12, wherein the tone mapping operations applied to some high dynamic range base frames in the same scene differ from one another.

14. A method of decoding a compressed video data stream which has been obtained by carrying out a method as claimed in claim 1 wherein, using the final frame data in the video data stream, the reduced dynamic range base frame containing luminance data is obtained from the compressed reduced dynamic range base frame, the detail frame containing color data is obtained from the compressed detail frame, using the information in respect of the tone mapping operation applied to the high dynamic range base frame, the high dynamic range base frame is reconstructed via inverse tone mapping applied to the reduced dynamic range base frame only;

and the high dynamic range base frame is combined with the detail frame to reproduce the original high dynamic range frame.