METHODS AND DEVICES FOR CONTROLLING SPATIAL ACCESS GRANULARITY IN COMPRESSED VIDEO STREAMS

• US 20140016703A1
• Filed: 07/09/2013
• Published: 01/16/2014
• Est. Priority Date: 07/11/2012
• Status: Abandoned Application

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: DENOUAL, FRANCK
• Application Number:
  US13/937,466
• Publication Number:
  US 20140016703A1
• Time in Patent Office: Days
• US Class Current: 375/240.16
• CPC Class Codes: H04N 19/12 Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
• CPC Class Codes: H04N 19/147 according to rate distortion criteria rate-distortion as a criterion for motion estimation H04N19/567
• CPC Class Codes: H04N 19/162 User input
• CPC Class Codes: H04N 19/167 Position within a video image, e.g. region of interest [ROI]
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/33 in the spatial domain

Abstract

The present invention provides methods and devices for controlling spatial access granularity in images of video streams compressed according to a block-based scalable video format. Encoded images comprise an encoded base layer and at least one encoded enhancement layer. According to an embodiment of the invention, relevant blocks are determined in the encoded base layer according to a given criterion that depends on video data. The at least one enhancement layer is encoded into at least two distinct groups of blocks independently decodable, or partially decoded, as a function of at least one item of information representative of the determined relevant blocks.

Claims

1. A method for encoding at least one image of a video stream in a block-based scalable video format, the encoded image comprising an encoded base layer and at least one encoded enhancement layer, the method comprising:

determining relevant blocks in the encoded base layer according to a given criterion that depends on video data; and

encoding the at least one enhancement layer into at least two distinct groups of blocks independently decodable, as a function of at least one item of information representative of the determined relevant blocks.

2. The method of claim 1 further comprising a step of generating a relevance map based on the determined relevant blocks, the at least one item of information representative of the determined relevant blocks comprising the generated relevance map.

3. The method of claim 1 wherein the step of determining relevant blocks comprises a step of obtaining the size of at least one block of the base layer, the at least one block whose size is obtained being considered as relevant or not as a function of the obtained size.

4. The method of claim 1 wherein the step of determining relevant blocks comprises a step of obtaining at least one motion vector of at least one block of the base layer, the at least one block whose motion vector is obtained being considered as relevant or not as a function of the obtained motion vector.

5. The method of claim 4 wherein the step of determining relevant blocks comprises a step of estimating at least one residual value based on the at least one block whose motion vector is obtained and on at least one predicted block based on the at least one obtained motion vector.

6. The method of claim 5 wherein the step of estimating at least one residual value is performed as a function of a type of motion estimation applied to the at least one block whose motion vector is obtained.

7. The method of claim 6 wherein the type of motion estimation is encoded as a flag within the video stream.

8. The method of claim 4 wherein the step of determining relevant blocks comprises a step of comparing at least one obtained motion vector with statistical motion data relating to the image to be encoded.

9. The method of claim 8 wherein the statistical motion data comprises a mean value and a standard deviation of motion values of each of a plurality of blocks of the image to be encoded.

10. The method of claim 2 further comprising a step of up-sampling the generated relevance map to encode the at least one enhancement layer into at least two distinct groups of blocks independently decodable.

11. The method of claim 2 wherein the step of generating a relevance map comprises a step of creating at least one region of interest comprising a set of relevant blocks.

12. The method of claim 11 further comprising a step of expanding the at least one region of interest as a function of a minimum size.

13. The method of claim 11 further comprising a step of discarding at least one generated region of interest that is contained within at least one bigger generated region of interest.

14. The method of claim 11 wherein the step of encoding the at least one enhancement layer comprises a first step of encoding blocks that do not correspond to any region of interest of the relevance map and at least one second step of encoding blocks that correspond to at least one region of interest of the relevance map.

15. A device for encoding at least one image of a video stream in a block-based scalable video format, the encoded image comprising an encoded base layer and at least one encoded enhancement layer, the device comprising:

determining means for determining relevant blocks in the encoded base layer according to a given criterion that depends on video data; and

encoding means for encoding the at least one enhancement layer into at least two distinct groups of blocks independently decodable, as a function of at least one item of information representative of determined relevant blocks.

16. A device for decoding at least one image of a video stream in a block-based scalable video format, the encoded image comprising an encoded base layer and at least one encoded enhancement layer, the device comprising:

determining means for determining relevant blocks in the base layer according to a given criterion that depends on video data; and

decoding means for decoding at least a part of the at least one enhancement layer as a function of at least one item of information representative of determined relevant blocks.

17. The device of claim 16 further comprising generating means for generating a relevance map based on determined relevant blocks, the at least one item of information representative of determined relevant blocks comprising the generated relevance map.

18. The device of claim 16 wherein the determining means for determining relevant blocks comprise obtaining means for obtaining the size of at least one block of the base layer, the at least one block whose size is obtained being considered as relevant or not as a function of the obtained size.

19. The device of claim 16 wherein the determining means for determining relevant blocks comprise obtaining means for obtaining at least one motion vector of at least one block of the base layer, the at least one block whose motion vector is obtained being considered as relevant or not as a function of the obtained motion vector.

20. The device of claim 19 wherein the determining means for determining relevant blocks comprise comparing means for comparing at least one obtained motion vector with statistical motion data relating to the image to be decoded.