METHOD, AN APPARATUS AND A COMPUTER PROGRAM PRODUCT FOR CODING A 360-DEGREE PANORAMIC VIDEO

• US 20170085917A1
• Filed: 09/22/2016
• Published: 03/23/2017
• Est. Priority Date: 09/23/2015
• Status: Abandoned Application

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Hannuksela, Miska Matias
• Application Number:
  US15/273,026
• Publication Number:
  US 20170085917A1
• Time in Patent Office: Days
• CPC Class Codes: H04N 19/105 Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/182 the unit being a pixel
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/523 with sub-pixel accuracy
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

There are disclosed various methods, apparatuses and computer program products for video encoding. In some embodiments the method comprises reconstructing a 360-degree panoramic source picture for inter-layer prediction; deriving an inter-layer reference picture from the 360-degree panoramic source picture, wherein the deriving comprises one or both of: upsampling at least a part of the 360-degree panoramic source picture, wherein said upsampling comprises filtering samples of a border region of the 360-degree panoramic source picture using at least partly one or more sample values of an opposite side border region and/or one or more variable values associated with one or more blocks of the opposite side border region; determining a reference region that crosses a picture boundary of the 360-degree panoramic source picture, and including in the reference region one or both of the following: one or more sample values of an opposite side border region; one or more variable values associated with one or more blocks of the opposite side border region.

Claims

1. A method comprising

reconstructing a 360-degree panoramic source picture for inter-layer prediction;

deriving an inter-layer reference picture from the 360-degree panoramic source picture, wherein the deriving comprises one or both of;

upsampling at least a part of the 360-degree panoramic source picture, wherein said upsampling comprises filtering samples of a border region of the 360-degree panoramic source picture using at least partly one or more sample values of an opposite side border region and/or one or more variable values associated with one or more blocks of the opposite side border region;

determining a reference region that crosses a picture boundary of the 360-degree panoramic source picture, and including in the reference region one or both of the following;

one or more sample values of an opposite side border region;

one or more variable values associated with one or more blocks of the opposite side border region.

2. The method according to claim 1, further comprising one or more of the following:

deriving a disparity value;

setting syntax elements for the reference region left offset and right offset equal to the disparity value; and

setting syntax elements for the reference region top offset and bottom offset equal to zero.

3. The method according to claim 2, further comprising deriving the disparity value from pictures of one or more access unit using one or more of the following:

deriving an average disparity from one or more depth maps associated with said pictures;

deriving the disparity from camera parameters applying said pictures;

deriving an average disparity between views, using a stereo matching algorithm;

deriving an average disparity from inter-view motion vector applying between picture of different views.

4. The method according to claim 1, further comprising one or more of the following:

deriving an average disparity value for one or more pictures;

setting syntax elements for a scaled reference layer left offset and a scaled reference layer right offset equal to the average disparity value; and

setting syntax element for a scaled reference layer top offset and a scaled reference layer bottom offset equal to zero.

5. The method according to claim 1, further comprising;

creating two occurrences of a base-view picture in reference pictures lists, wherein first occurrence is a conventional inter-layer reference picture and the second occurrence is a resampled picture, and

optionally indicating the creation of the two occurrences in the bitstream.

6. An apparatus comprising at least one processor;

at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following;

to reconstruct a 360-degree panoramic source picture for inter-layer prediction;

to derive an inter-layer reference picture from the 360-degree panoramic source picture, wherein the deriving comprises one or both of;

upsampling at least a part of the 360-degree panoramic source picture, wherein said upsampling comprises filtering samples of a border region of the 360-degree panoramic source picture using at least partly one or more sample values of an opposite side border region and/or one or more variable values associated with one or more blocks of the opposite side border region;

determining a reference region that crosses a picture boundary of the 360-degree panoramic source picture, and including in the reference region one or both of the following;

one or more sample values of an opposite side border region;

one or more variable values associated with one or more blocks of the opposite side border region.

7. The apparatus according to claim 6, further comprising computer program code configured to cause the apparatus to perform at least the following:

to derive a disparity value;

to set syntax elements for the reference region left offset and right offset equal to the disparity value; and

to set syntax elements for the reference region top offset and bottom offset equal to zero.

8. The apparatus according to claim 7, further comprising computer program code configured to cause the apparatus to perform at least the following:

to derive the disparity value from pictures of one or more access unit by using one or more of the following;

deriving an average disparity from one or more depth maps associated with said pictures;

deriving the disparity from camera parameters applying said pictures;

deriving an average disparity between views, using a stereo matching algorithm;

deriving an average disparity from inter-view motion vector applying between picture of different views.

9. The apparatus according to claim 6, further comprising computer program code configured to cause the apparatus to perform at least the following:

deriving an average disparity value for one or more pictures;

setting syntax elements for a scaled reference layer left offset and a scaled reference layer right offset equal to the average disparity value; and

setting syntax element for a scaled reference layer top offset and a scaled reference layer bottom offset equal to zero.

10. The apparatus according to claim 6, further comprising computer program code configured to cause the apparatus to perform at least the following:

creating two occurrences of a base-view picture in reference pictures lists, wherein first occurrence is a conventional inter-layer reference picture and the second occurrence is a resampled picture, and

optionally indicating the creation of the two occurrences in the bitstream.

11. A computer program product comprising a computer-readable medium bearing computer program code embodied therein for use with a computer, the computer program code comprising:

code for reconstructing a 360-degree panoramic source picture for inter-layer prediction;

code for deriving an inter-layer reference picture from the 360-degree panoramic source picture, wherein the deriving comprises one or both of

code for upsampling at least a part of the 360-degree panoramic source picture, wherein said upsampling comprises filtering samples of a border region of the 360-degree panoramic source picture using at least partly one or more sample values of an opposite side border region and/or one or more variable values associated with one or more blocks of the opposite side border region;

code for determining a reference region that crosses a picture boundary of the 360-degree panoramic source picture, and including in the reference region one or both of the following;

one or more sample values of an opposite side border region;

one or more variable values associated with one or more blocks of the opposite side border region.