MULTIVIEW VIDEO DATA ENCODING METHOD AND DEVICE, AND DECODING METHOD AND DEVICE

• US 20140192155A1
• Filed: 08/09/2012
• Published: 07/10/2014
• Est. Priority Date: 08/09/2011
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Choi, Byeong-doo, Park, Jeong-Hoon, Jeong, Seung-soo
• Application Number:
  US14/238,046
• Publication Number:
  US 20140192155A1
• Time in Patent Office: Days
• US Class Current: 348/43
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/25 using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
• CPC Class Codes: H04N 13/282 for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
• CPC Class Codes: H04N 19/513 Processing of motion vectors
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 19/96 Tree coding, e.g. quad-tree coding
• CPC Class Codes: H04N 2213/005 Aspects relating to the "3D+depth" image format

Abstract

A method and apparatus for encoding multi-view video data and a method and apparatus for decoding multi-view video data are provided. The method of encoding multi-view video data includes obtaining a multi-view color video frame and a depth map frame corresponding to the multi-view color video frame, prediction-encoding the multi-view color video frame, and prediction-encoding the depth map frame, based on a result of prediction-encoding the multi-view color video frame.

Claims

1. A method of encoding multi-view video data, the method comprising:

obtaining a multi-view color video frame and a depth map frame corresponding to the multi-view color video frame;

prediction-encoding the obtained multi-view color video frame; and

prediction-encoding the depth map frame, based on a result of the prediction-encoding the multi-view color video frame.

2. The method of claim 1, wherein the prediction-encoding of the multi-view color video frame comprises:

determining coding units having a tree structure including coding units corresponding to a coded depth from among hierarchical coding units corresponding to depths, for each of at least one maximum coding unit that is split from the multi-view color video frame;

determining partitions for prediction-encoding each of the coding units corresponding to the coded depth; and

determining transformation units having a tree structure by performing transformation based on hierarchical transformation units,

wherein the depths each denote a number of times the at least one maximum coding unit is spatially split.

3. The method of claim 2, wherein a result of a prediction-encoding the multi-view color video frame comprises split information including information about coding units, partition units, and transformation units determined for each of the at least one maximum coding unit that is split from the multi-view color video frame, and

the prediction-encoding of the depth map frame comprises:

setting coding units, partition units, and transformation units for each of at least one maximum coding unit that is split from the depth map frame in a split shape of the multi-view color video frame, based on the split information, and

prediction-encoding the depth map frame, based on the set coding units, the set partition units, and the set transformation units.

4. The method of claim 1, wherein a result of the prediction-encoding the multi-view color video frame comprises information about a prediction mode for a block of the multi-view color video frame, and

the prediction-encoding of the depth map frame comprises setting a prediction mode for a block of the depth map frame to be the same as the prediction mode for the block of the multi-view color video frame.

5. The method of claim 4, wherein, when the prediction mode for the block of the multi-view color video frame is an intra prediction mode, the prediction-encoding of the depth map frame comprises predicting a block of the depth map frame, which is disposed at the same location as the block of the multi-view color video frame, by using a pixel value of the block of the multi-view color video frame.

6. The method of claim 1, wherein a result of the prediction-encoding the multi-view color video frame comprises information about a motion vector of a block of the multi-view color video frame, and

the prediction-encoding of the depth map frame comprises determining a motion vector of a block of the depth map frame by using the motion vector of the block of the multi-view color video frame.

7. The method of claim 6, wherein the prediction-encoding of the depth map frame further comprises:

determining an optimum motion vector of the block of the depth map frame by changing the motion vector of the block of the multi-view color video frame within a predetermined pixel range; and

encoding an adjustment value which is a difference between the optimum motion vector and the motion vector of the block of the multi-view color video frame, as information about the motion vector of the block of the depth map frame.

8. A method of decoding multi-view video data, the method comprising:

receiving a bitstream comprising a result of encoding a multi-view color video frame and a depth map frame corresponding to the multi-view color video frame;

decoding the multi-view color video frame; and

prediction-decoding the depth map frame, based on a result of the decoding the multi-view color video frame.

9. The method of claim 8, wherein the prediction-decoding of the depth map frame comprises:

obtaining information about a size of each of at least one maximum coding unit that is split from the multi-view color video frame, a depth denoting a number of times the at least one maximum coding unit is spatially split, partitions used to prediction-encode coding units hierarchically configured according to the depth, and transformation units having a hierarchical structure, from the bitstream;

determining coding units having a tree structure including coding units corresponding to a coded depth from among hierarchical coding units corresponding to depths, for each of the at least one maximum coding unit that is split from the multi-view color video frame;

determining partitions for prediction-decoding each of the coding units corresponding to the coded depth; and

determining transformation units having a tree structure, based on the obtained information, wherein the depths each denote a number of times the at least one maximum coding unit is spatially split.

10. The method of claim 9, wherein a result of the decoding the multi-view color video frame comprises split information including information about coding units, partition units, and transformation units determined for each of the at least one maximum coding unit that is split from the multi-view color video frame, and

the prediction-decoding of the depth map frame comprises:

setting coding units, partition units, and transformation units in a split shape of the multi-view color video frame, for each of at least one maximum coding unit that is split from the depth map frame, based on the split information; and

prediction-decoding the depth map frame based on the set coding units, the set partition units, and the set transformation units.

11. The method of claim 8, wherein a result of the decoding the multi-view color video frame comprises information about a prediction mode for a block of the multi-view color video frame, and

the prediction-decoding of the depth map frame comprises setting a prediction mode for a block of the depth map frame to be the same as a prediction mode for the block of the multi-view color video frame.

12. The method of claim 11, wherein, when the prediction mode for the block of the multi-view color video frame is an intra prediction mode, the prediction-decoding of the depth map frame comprises predicting a block of the depth map frame, which is disposed on the same location as the block of the multi-view color video frame, based on a pixel value of the block of the multi-view color video frame.

13. The method of claim 8, wherein a result of the decoding the multi-view color video frame comprises information about a motion vector of a block of the multi-view color video frame, and

the prediction-decoding of the depth map frame comprises determining a motion vector of a block of the depth map frame, based on the motion vector of the block of the multi-view color video frame.

14. The method of claim 13, wherein the prediction-decoding of the depth map frame comprises:

obtaining an adjustment value, which is a difference between an optimum motion vector of the block of the depth map frame and the motion vector of the block of the multi-view color video frame, from the bitstream, wherein the optimum motion vector is determined by changing the motion vector of the block of the multi-view color video frame within a predetermined pixel range; and

obtaining the motion vector of the block of the depth map frame by adding the adjustment value and the motion vector of the block of the multi-view color video frame together.

15. An apparatus configured to decode multi-view video data, the apparatus comprising:

a receiver configured to receive a bitstream including an encoded-a multi-view color video frame and a depth map frame corresponding to the multi-view color video frame;

a color video frame decoder configured to decode the encoded multi-view color video frame obtained from the bitstream; and

a depth map frame decoder configured to prediction-decode the depth map frame, based on a result of decoding the encoded multi-view color video frame.