Tiling in video encoding and decoding

• US 9,445,116 B2
• Filed: 11/19/2015
• Issued: 09/13/2016
• Est. Priority Date: 04/12/2007
• Status: Active Grant

• Current Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Original Assignee: Thomson Licensing (Vantiva SA)
• Inventors: Pandit, Purvin Bibhas, Yin, Peng, Tian, Dong
• Primary Examiner(s): WILLIAMS, JEFFERY A
• Application Number:
  US14/946,252
• Publication Number:
  US 20160080757A1
• Time in Patent Office: 299 Days
• Field of Search: 375/240.25
• US Class Current: 1/1
• CPC Class Codes: H04N 13/111 Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/182 the unit being a pixel
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 2213/003 Aspects relating to the "2D+depth" image format

Abstract

Implementations are provided that relate, for example, to view tiling in video encoding and decoding. A particular method includes accessing a video picture that includes multiple pictures combined into a single picture (826), accessing information indicating how the multiple pictures in the accessed video picture are combined (806, 808, 822), decoding the video picture to provide a decoded representation of at least one of the multiple pictures (824, 826), and providing the accessed information and the decoded video picture as output (824, 826). Some other implementations format or process the information that indicates how multiple pictures included in a single video picture are combined into the single video picture, and format or process an encoded representation of the combined multiple pictures.

Claims

1. A method, comprising:

transmitting an encoded picture section including an encoding of a video picture, the video picture including a first picture of a first view of a multi-view video and a second picture of a second view of the multi-view video arranged into the video picture in which a common object appears shifted from one view to the other; and

transmitting a signaling section including an encoding of an indication that indicates whether at least one of the first picture and the second picture is individually flipped, the indication allowing decoding of the encoded video picture into decoded versions of the first picture and the second picture.

2. The method of claim 1, wherein the first picture is arranged alongside the second picture in the video picture.

3. The method of claim 1, wherein the first picture is arranged above the second picture in the video picture.

4. The method of claim 1, wherein pixels of the first and second pictures are alternately interlaced.

5. An apparatus, comprising a transmitter configured to:

transmit an encoded picture section including an encoding of a video picture, the video picture including a first picture of a first view of a multi-view video and a second picture of a second view of the multi-view video arranged into the video picture in which a common object appears shifted from one view to the other; and

transmit a signaling section including an encoding of an indication that indicates whether at least one of the first picture and the second picture is individually flipped, the indication allowing decoding of the encoded video picture into decoded versions of the first picture and the second picture.

6. The apparatus of claim 5, wherein the first picture is arranged alongside the second picture in the video picture.

7. The apparatus of claim 5, wherein the first picture is arranged above the second picture in the video picture.

8. The apparatus of claim 5, wherein pixels of the first and second pictures are alternately interlaced.

9. A non-transitory computer readable medium having computer readable program code embodied thereon, the computer readable program code comprising:

program code for transmitting an encoded picture section including an encoding of a video picture, the video picture including a first picture of a first view of a multi-view video and a second picture of a second view of the multi-view video arranged into the video picture in which a common object appears shifted from one view to the other; and

program code for transmitting a signaling section including an encoding of an indication that indicates whether at least one of the first picture and the second picture is individually flipped, the indication allowing decoding of the encoded video picture into decoded versions of the first picture and the second picture.

10. A non-transitory computer readable medium having computer readable program code embodied thereon, the computer readable program code comprising:

program code for combining multiple pictures into a video picture, the multiple pictures including a first picture of a first view of a multi-view video and a second picture of a second view of the multi-view video in which a common object or region appears shifted from one view to the other;

program code for generating information indicating how the multiple pictures are combined, wherein the generated information indicates whether at least one of the multiple pictures is individually flipped in one or both of a horizontal direction and a vertical direction;

program code for encoding the video picture to provide an encoded representation of the combined multiple pictures; and

program code for providing the generated information and the encoded representation as output.

11. The medium of claim 10, wherein the first picture is arranged alongside the second picture in the video picture.

12. The medium of claim 10, wherein the first picture is arranged above the second picture in the video picture.

13. The medium of claim 10, wherein pixels of the first and second pictures are alternately interlaced.

14. A non-transitory computer readable medium having computer readable program code embodied thereon, the computer readable program code comprising:

program code for accessing a video picture that includes multiple pictures combined into a single picture, the multiple pictures including a first picture of a first view of a multi-view video and a second picture of a second view of the multi-view video in which a common object or region appears shifted from one view to the other, the video picture being part of a received video stream;

program code for accessing information indicating how the multiple pictures in the accessed video picture are combined, wherein the accessed information indicates whether at least one of the multiple pictures is individually flipped in one or both of a horizontal direction and a vertical direction, and wherein the accessed information is part of the received video stream;

program code for decoding the video picture to provide a decoded representation of at least one of the multiple pictures; and

program code for providing at least one of the accessed information and the decoded representation as output.

15. The medium of claim 14, wherein the first picture is arranged alongside the second picture in the video picture.

16. The medium of claim 14, wherein the first picture is arranged above the second picture in the video picture.

17. The medium of claim 14, wherein pixels of the first and second pictures are alternately interlaced.

18. An apparatus, comprising:

an interface configured to;

access a video picture that includes multiple pictures combined into a single picture, the multiple pictures including a first picture of a first view of a multi-view video and a second picture of a second view of the multi-view video in which a common object or region appears shifted from one view to the other, the video picture being part of a received video stream, and

access information indicating how the multiple pictures in the accessed video picture are combined, wherein the accessed information indicates whether at least one of the multiple pictures is individually flipped in one or both of a horizontal direction and a vertical direction, and wherein the accessed information is part of the received video stream; and

one or more processors configured to;

decode the video picture to provide a decoded representation of at least one of the multiple pictures, and

provide at least one of the accessed information and the decoded representation as output.

19. An apparatus, comprising:

one or more processors configured to;

combine multiple pictures into a video picture, the multiple pictures including a first picture of a first view of a multi-view video and a second picture of a second view of the multi-view video in which a common object or region appears shifted from one view to the other,

generate information indicating how the multiple pictures are combined, wherein the generated information indicates whether at least one of the multiple pictures is individually flipped in one or both of a horizontal direction and a vertical direction, and

encode the video picture to provide an encoded representation of the combined multiple pictures; and

an interface configured to provide the generated information and the encoded representation as output.