Tiling in video encoding and decoding

• US 10,298,948 B2
• Filed: 09/27/2018
• Issued: 05/21/2019
• Est. Priority Date: 04/12/2007
• Status: Active Grant

• Current Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Original Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Inventors: Pandit, Purvin Bibhas, Yin, Peng, Tian, Dong
• Primary Examiner(s): Williams, Jeffrey A
• Application Number:
  US16/144,971
• Publication Number:
  US 20190037230A1
• Time in Patent Office: 236 Days
• Field of Search: 37524025
• CPC Class Codes: H04N 13/111 Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/182 the unit being a pixel
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 2213/003 Aspects relating to the "2D+depth" image format

Abstract

Implementations are provided that relate, for example, to view tiling in video encoding and decoding. A particular method includes accessing a video picture that includes multiple pictures combined into a single picture (826), accessing information indicating how the multiple pictures in the accessed video picture are combined (806, 808, 822), decoding the video picture to provide a decoded representation of at least one of the multiple pictures (824, 826), and providing the accessed information and the decoded video picture as output (824, 826). Some other implementations format or process the information that indicates how multiple pictures included in a single video picture are combined into the single video picture, and format or process an encoded representation of the combined multiple pictures.

Claims

1. An apparatus for decoding coded video pictures, the apparatus comprising:

an input for receiving a coded video bitstream comprising coded video pictures;

and

a processor, wherein the processor;

determines from the received bitstream a single picture in a rectangular frame, wherein the single picture includes a first picture and a second picture tiled together;

accesses information to determine how the first picture and the second picture are tiled together using two or more tiles, wherein the accessed information indicates that the second picture is split into two or more parts so that it can be arranged in the rectangular frame together with the first picture; and

decodes the single picture into the first picture and the second picture.

2. The apparatus of claim 1 wherein at least one of the first picture or a part of the second picture is individually flipped in the horizontal or the vertical direction.

3. The apparatus of claim 1, wherein the single picture further comprises a depth image added as a tile, wherein the depth image is associated with the first picture or the second picture.

4. The apparatus of claim 1, wherein the first picture and the second picture correspond to a left view and a right view of a stereoscopic image.

5. The apparatus of claim 1, wherein the processor further accesses upscaling information related to the first picture or the second picture.

6. The apparatus of claim 1, wherein the processor further accesses offset information of the position of the tiles in the single image with respect to its origin.

7. The apparatus of claim 6, wherein the offset information comprises one or more of a left offset, a right offset, a top offset or a bottom offset.

8. A non-transitory processor readable medium having stored thereon encoded video bitstream data for decoding by a decoder, the video bitstream data comprising:

an encoded picture section including an encoding of a single video picture into tiles arranged in a rectangular frame, the single video picture including a first picture and a second picture tiled into the single video picture; and

a signaling section including an encoding of an indication that indicates that the second picture is split into two or more parts so that it can be arranged in the rectangular frame together with the first picture, the indication allowing decoding by the decoder of the encoded single video picture into decoded versions of the first picture and the second picture.

9. The processor readable medium of claim 8, wherein the signaling section indication further indicates that at least one of the first picture or a part of the second picture is individually flipped in the horizontal or the vertical direction.

10. The processor readable medium of claim 8, wherein the single picture further comprises a depth image added as a tile, wherein the depth image is associated with the first picture or the second picture.

11. An apparatus for encoding video pictures into a coded bitstream, the apparatus comprising:

an input for receiving video pictures;

a processor, wherein the processor

tiles together multiple pictures into a single video picture in a rectangular frame, the multiple pictures including a first picture and a second picture;

generates a signaling section indicating how the multiple pictures are tiled into tiles, wherein the generated information indicates that the second picture is split into two or more parts so that it can be arranged in the rectangular frame together with the first picture;

encodes the single video picture to provide an encoded representation of the combined multiple pictures; and

combines the signaling section and the encoded representation as output.

12. The apparatus of claim 11, wherein the signaling section indicates that at least one of the first picture or a part of the second picture is individually flipped in the horizontal or the vertical direction.

13. The apparatus of claim 11, wherein the single picture further comprises a depth image added as a tile, wherein the depth image is associated with the first picture or the second picture.