Perceptual three-dimensional (3D) video coding based on depth information

• US 10,091,513 B2
• Filed: 09/28/2012
• Issued: 10/02/2018
• Est. Priority Date: 09/29/2011
• Status: Active Grant

• Current Assignee: Texas Instruments, Inc.
• Original Assignee: Texas Instruments, Inc.
• Inventors: Kwon, Do-Kyoung, Budagavi, Madhukar, Chen, Ming-Jun
• Primary Examiner(s): Williams, Jeffery
• Application Number:
  US13/631,841
• Publication Number:
  US 20130083163A1
• Time in Patent Office: 2,195 Days
• Field of Search: 375 E7084, 375 E7227, 375 E7071, 37524003
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/142 Detection of scene cut or scene change
• CPC Class Codes: H04N 19/154 Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion use of rate-distortion criteria H04N19/147
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals

Abstract

A method for encoding a multi-view frame in a video encoder is provided that includes computing a depth quality sensitivity measure for a multi-view coding block in the multi-view frame, computing a depth-based perceptual quantization scale for a 2D coding block of the multi-view coding block, wherein the depth-based perceptual quantization scale is based on the depth quality sensitive measure and a base quantization scale for the 2D frame including the 2D coding block, and encoding the 2D coding block using the depth-based perceptual quantization scale.

Claims

1. A method for encoding a multi-view frame in a video encoder, wherein the multi-view frame includes a plurality of two-dimensional (2D) frames, the method comprising:

determining a depth-quality sensitivity measure for a multi-view coding block in the multi-view frame based on a depth of the multi-view coding block and a depth-quality sensitivity function, the depth-quality sensitivity function defining perceptual quality sensitivity of the multi-view coding block as a function of the depth of the multi-view coding block;

determining a depth-based perceptual quantization scale for a 2D coding block of the multi-view coding block based on the depth-quality sensitivity measure and a base quantization scale for the 2D frame including the 2D coding block; and

encoding the 2D coding block using the depth-based perceptual quantization scale.

2. An apparatus configured to perform video encoding of a multi-view frame, wherein the multi-view frame includes a plurality of two-dimensional (2D) frames, the apparatus comprising one or more processors configured to:

determine a depth-quality sensitivity measure for a multi-view coding block in the multi-view frame based on a depth of the multi-view coding block and a depth-quality sensitivity function, the depth-quality sensitivity function defining perceptual quality sensitivity of the multi-view coding block as a function of the depth of the multi-view coding block;

determine a depth-based perceptual quantization scale for a 2D coding block of the multi-view coding block based on the depth-quality sensitivity measure and a base quantization scale for the 2D frame including the 2D coding block; and

encode the 2D coding block using the depth-based perceptual quantization scale.

3. A non-transitory computer-readable medium comprising instructions that, when executed by a processor, cause the processor to:

determine a depth-quality sensitivity measure for a multi-view coding block in a multi-view frame based on a depth of the multi-view coding block, the multi-view frame including a plurality of two-dimensional (2D) frames and a depth-quality sensitivity function, the depth-quality sensitivity function defining perceptual quality sensitivity of the multi-view coding block as a function of the depth of the multi-view coding block;

determine a depth-based perceptual quantization scale for a 2D coding block of the multi-view coding block based on the depth-quality sensitivity measure and a base quantization scale for the 2D frame including the 2D coding block; and

encode the 2D coding block using the depth-based perceptual quantization scale.