Tiling in video encoding and decoding

• US 9,706,217 B2
• Filed: 08/23/2016
• Issued: 07/11/2017
• Est. Priority Date: 04/12/2007
• Status: Active Grant

• Current Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Original Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Inventors: Pandit, Purvin Bibhas, Yin, Peng, Tian, Dong
• Primary Examiner(s): WILLIAMS, JEFFERY A
• Application Number:
  US15/244,192
• Publication Number:
  US 20160360218A1
• Time in Patent Office: 322 Days
• Field of Search: 37524025
• CPC Class Codes: H04N 13/111 Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/182 the unit being a pixel
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 2213/003 Aspects relating to the "2D+depth" image format

Abstract

Implementations are provided that relate, for example, to view tiling in video encoding and decoding. A particular method includes accessing a video picture that includes multiple pictures combined into a single picture (826), accessing information indicating how the multiple pictures in the accessed video picture are combined (806, 808, 822), decoding the video picture to provide a decoded representation of at least one of the multiple pictures (824, 826), and providing the accessed information and the decoded video picture as output (824, 826). Some other implementations format or process the information that indicates how multiple pictures included in a single video picture are combined into the single video picture, and format or process an encoded representation of the combined multiple pictures.

Claims

1. An apparatus, comprising:

an interface configured to;

access a bitstream including a single picture and upsampling information, wherein the single picture includes a first picture and a second picture arranged as the single picture, the first picture corresponding to a first view of a multi-view video and the second picture corresponding to a second view of the multi-view video, wherein the upsampling information indicates whether at least one of the first picture and the second picture is to be upsampled, and

access information indicating how the first picture and the second picture are combined into the single picture, wherein the accessed information indicates that at least one of the first picture and the second picture is individually flipped in one or more of a horizontal direction and a vertical direction; and

one or more processors configured to decode the single picture into the first picture and the second picture.

2. The apparatus as defined in claim 1, wherein the upsampling information indicates that neither the first picture nor the second picture requires upsampling.

3. The apparatus as defined in claim 1, wherein the upsampling information indicates that at least the first picture requires upsampling;

and

wherein the decoding further comprises disassembling the first picture and

the

second picture, both from the single picture, and

wherein upsampling further comprises upsampling the first picture to produce the first view.

4. The apparatus as defined in claim 1, wherein the upsampling information includes an indication of a filter type for use in upsampling.

5. The apparatus as defined in claim 4, wherein the upsampling information further includes a set of filter coefficients, wherein each filter coefficient defines a value for a particular coefficient of a filter specified by the filter type.

6. The apparatus as defined in claim 1, wherein the upsampling information indicates that the first picture and the second picture require upsampling;

and

wherein the decoding further comprises upsampling the first picture to produce a first view, and upsampling the second picture to produce a second view.

7. The apparatus as defined in claim 1, wherein said upsampling information is formatted in a message in accordance with a high level syntax, wherein the message includes the upsampling information.

8. The apparatus as defined in claim 1, wherein the first picture is not flipped and the second picture is flipped horizontally, the first picture and the second picture being arranged side-by-side.

9. The apparatus as defined in claim 1, wherein the first picture is not flipped and the second picture is flipped vertically, the first picture and the second picture being arranged top-bottom.

10. A method comprising:

determining from a received bitstream a single picture and upsampling information, wherein the single picture includes a first picture and a second picture arranged as the single picture, the first picture corresponding to a first view of a

multi-view video and the second picture corresponding to a second view of the multiview video, wherein the upsampling information indicates whether at least one of the first picture and the second picture is to be upsampled;

accessing information indicating how the first picture and the second picture are combined into the single picture, wherein the accessed information indicates that at least one of the first picture and the second picture is individually flipped in one or more of a horizontal direction and a vertical direction.

11. The method as defined in claim 10, wherein the upsampling information indicates that neither the first picture nor the second picture requires upsampling.

12. The method as defined in claim 10, wherein the upsampling information indicates that at least the first picture requires upsampling;

and

wherein the decoding further comprises disassembling the first picture and

the

second picture, both from the single picture, and

wherein upsampling further comprises upsampling the first picture to produce the first view.

13. The method as defined in claim 10, wherein the upsampling information includes an indication of a filter type for use in upsampling.

14. The method as defined in claim 13, wherein the upsampling information further includes a set of filter coefficients, wherein each filter coefficient defines a value for a particular coefficient of a filter specified by the filter type.

15. The method as defined in claim 10, wherein the upsampling information indicates that the first picture and the second picture require upsampling;

and

wherein the decoding further comprises upsampling the first picture to produce a first view, and upsampling the second picture to produce a second view.

16. The method as defined in claim 10, wherein said upsampling information is formatted in a message in accordance with a high level syntax, wherein the message includes the upsampling information.

17. The method as defined in claim 10, wherein the first picture is not flipped and the second picture is flipped horizontally, the first picture and the second picture being arranged side-by-side.

18. The method as defined in claim 10, wherein the first picture is not flipped and the second picture is flipped vertically, the first picture and the second picture being arranged top-bottom.

19. A non-transitory processor readable medium having stored thereon a video signal

structure, the video signal structure comprising:

an encoded picture section including an encoded video picture that includes multiple pictures combined into a single picture and upsampling information for the encoded video picture, wherein the single picture includes a first picture and a second picture arranged as the single picture, the first picture corresponding to a first view of a multi-view video and the second picture corresponding to a second view of the multi-view video, wherein the upsampling information indicates whether at least one of the first picture and the second picture is to be upsampled; and

a signaling section including an encoding of information indicating how the first picture and the second picture are combined into the single picture, wherein the accessed information indicates that at least one of the first picture and the second picture is individually flipped in one or more of a horizontal direction and a vertical direction;

the first picture being not flipped horizontally and the second picture being flipped horizontally, the first picture and the second picture being arranged side-by-side, or

the first picture being not flipped vertically and the second picture being flipped vertically, the first picture and the second picture being arranged top-bottom.