TILING IN VIDEO DECODING AND ENCODING

• US 20100046635A1
• Filed: 04/11/2008
• Published: 02/25/2010
• Est. Priority Date: 04/12/2007
• Status: Active Grant

• Current Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Original Assignee: Thomson Licensing (Vantiva SA)
• Inventors: Yin, Peng, Tian, Dong, Pandit, Purvin Bibhas
• Granted Patent: US 8,780,998 B2
• Time in Patent Office: Days
• US Class Current: 375/240.250
• CPC Class Codes: H04N 13/111 Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/182 the unit being a pixel
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 2213/003 Aspects relating to the "2D+depth" image format

Abstract

Implementations are provided that relate, for example, to view tiling in video encoding and decoding. A particular method includes accessing a video picture that includes multiple pictures combined into a single picture, accessing information indicating how the multiple pictures in the accessed video picture are combined, decoding the video picture to provide a decoded representation of at least one of the multiple pictures, and providing the accessed information and the decoded video picture as output. Some other implementations format or process the information that indicates how multiple pictures included in a single video picture are combined into the single video picture, and format or process an encoded representation of the combined multiple pictures.

Claims

1. A method, comprising:

accessing a video picture that includes multiple pictures combined into a single picture;

accessing information indicating how the multiple pictures in the accessed video picture are combined;

decoding the video picture to provide a decoded representation of the combined multiple pictures; and

providing the accessed information and the decoded video picture as output.

2. The method of claim 1, wherein the multiple pictures includes a first picture from a first view, and a second picture from a second view.

3. The method of claim 2, wherein content of the first picture overlaps content of the second picture.

4. The method of claim 1, wherein the multiple pictures includes a first picture from a first view, and a second picture including depth information for the first picture.

5. The method of claim 1, wherein:

accessing the video picture comprises accessing a video picture provided according to a single-view video standard that treats all pictures as being from a single view, and

accessing the information comprises accessing information provided according to the single-view video standard,

such that the providing of the decoded video picture and the accessed information enables support of multiple views by the single-view video standard.

6. The method of claim 1, wherein:

accessing the video picture comprises accessing a video picture provided according to a multiple-view video standard that explicitly supports multiple views by providing a view identifier for a given picture, the view identifier indicating which of the multiple views corresponds to the given picture, and

accessing the information comprises accessing information provided according to the multiple-view video standard,

such that the providing of the decoded video picture and the accessed information enables support of more than the multiple views by the multiple-view video standard.

7. The method of claim 1, wherein the accessed information indicates at least one of a location and an orientation of at least one of the multiple pictures within the video picture.

8. The method of claim 1, wherein the accessed information indicates that the multiple pictures are combined in a pixel-wise manner.

9. The method of claim 8, wherein pixels of the multiple pictures are offset so as to align similar content from the multiple views.

10. The method of claim 1, wherein the accessing of the video picture, the accessing of the information, the decoding of the video picture, and the providing of the accessed information and the decoded video picture are performed at a decoder.

11. The method of claim 1, wherein the information is comprised in at least one high level syntax element.

12. The method of claim 11, wherein the high level syntax element is comprised in at least one of a slice header, a sequence parameter set, a picture parameter set, a view parameter set, a network abstraction layer unit header, and a supplemental enhancement information message.

13. The method of claim 1, wherein at least one of the multiple pictures represents depth information.

14. An apparatus, comprising:

a decoder for accessing a video picture that includes multiple pictures combined into a single picture, accessing information indicating how the multiple pictures in the accessed video picture are combined, decoding the video picture to provide a decoded representation of the combined multiple pictures, and providing the accessed information and the decoded video picture as output.

15. The apparatus of claim 14, wherein the multiple pictures includes a first picture from a first view, and a second picture including depth information for the first picture.

16. The apparatus of claim 14, wherein at least one of the multiple pictures represents depth information.

17. A method, comprising:

generating information indicating how multiple pictures included in a video picture are combined into a single picture;

encoding the video picture to provide an encoded representation of the combined multiple pictures; and

providing the generated information and encoded video picture as output.

18. The method of claim 17, wherein the multiple pictures includes a first picture from a first view, and a second picture from a second view.

19. The method of claim 18, wherein content of the first picture overlaps content of the second picture.

20. The method of claim 17, wherein the multiple pictures includes a first picture from a first view, and a second picture including depth information for the first picture.

21. The method of claim 17, wherein generating the information comprises generating information in accordance with a single-view video standard that treats all pictures as being from a single view, such that the providing of the encoded video picture and the generated information enables support of multiple views by the single-view video standard.

22. The method of claim 17, wherein generating the information comprises generating information in accordance with a multiple-view video standard that explicitly supports multiple views by providing a view identifier for a given picture, the view identifier indicating which of the multiple views corresponds to the given picture, such that the providing of the encoded video picture and the generated information enables support of more than the multiple views by the multiple-view video standard.

23. The method of claim 17, wherein the generated information indicates at least one of a location and an orientation of at least one of the multiple pictures within the video picture.

24. The method of claim 17, wherein the generated information indicates that the multiple pictures are combined in a pixel-wise manner.

25. The method of claim 24, wherein pixels of the multiple pictures are offset so as to align similar content from the multiple views.

26. The method of claim 17, wherein the generating of the information, the encoding of the video picture, and the providing of the generated information and the encoded video picture are performed at an encoder.

27. The method of claim 17, wherein the generated information is comprised in at least one high level syntax element.

28. The method of claim 27, wherein the high level syntax element is comprised in at least one of a slice header, a sequence parameter set, a picture parameter set, a view parameter set, a network abstraction layer unit header, and a supplemental enhancement information message.

29. The method of claim 17, wherein at least one of the multiple pictures represents depth information.

30. An apparatus, comprising:

an encoder for generating information indicating how multiple pictures included in a video picture are combined into a single picture, encoding the video picture to provide an encoded representation of the combined multiple pictures, and providing the generated information and encoded video picture as output.

31. The apparatus of claim 30, wherein the multiple pictures includes a first picture from a first view, and a second picture including depth information for the first picture.

32. An apparatus, comprising:

means for accessing a video picture that includes multiple pictures combined into a single picture;

means for accessing information indicating how the multiple pictures in the accessed video picture are combined;

means for decoding the video picture to provide a decoded representation of the combined multiple pictures; and

means for providing the accessed information and the decoded video picture as output.

33. An apparatus, comprising:

means for generating information indicating how multiple pictures included in a video picture are combined into a single picture;

means for encoding the video picture to provide an encoded representation of the combined multiple pictures; and

means for providing the generated information and encoded video picture as output.

34. A video signal structure for video encoding, comprising:

information indicating how multiple pictures included in a single video picture are combined into the single video picture; and

an encoded representation of the combined multiple pictures.

35. A computer readable medium having a video signal structure comprising:

information indicating how multiple pictures included in a single video picture are combined into the single video picture; and

an encoded representation of the combined multiple pictures.

36. A video signal formatted to include:

information indicating how multiple pictures included in a single video picture are combined into the single video picture; and

an encoded representation of the combined multiple pictures.

37. A computer readable medium having computer readable program code embodied thereon, the computer readable program code comprising:

program code for accessing a video picture that includes multiple pictures combined into a single picture;

program code for accessing information indicating how the multiple pictures in the accessed video picture are combined;

program code for decoding the video picture to provide a decoded representation of the combined multiple pictures; and

program code for providing the accessed information and the decoded video picture as output.

38. A computer readable medium having computer readable program code embodied thereon, the computer readable program code comprising:

program code for generating information indicating how multiple pictures included in a video picture are combined into a single picture;

program code for encoding the video picture to provide an encoded representation of the combined multiple pictures; and

program code for providing the generated information and encoded video picture as output.

39. An apparatus comprising a processor configured to perform at least the following:

accessing a video picture that includes multiple pictures combined into a single picture;

accessing information indicating how the multiple pictures in the accessed video picture are combined;

decoding the video picture to provide a decoded representation of the combined multiple pictures; and

providing the accessed information and the decoded video picture as output.

40. An apparatus comprising a processor configured to perform at least the following:

generating information indicating how multiple pictures included in a video picture are combined into a single picture;

encoding the video picture to provide an encoded representation of the combined multiple pictures; and

providing the generated information and encoded video picture as output.

41. A method, comprising:

accessing a video picture that includes multiple pictures combined into a single picture accessing information indicating how the multiple pictures in the accessed video picture are combined;

decoding the video picture to provide a decoded representation of at least one of the multiple pictures; and

providing the accessed information and the decoded representation as output.

42. A method, comprising:

accessing a video picture that includes multiple pictures combined into a single picture;

accessing information indicating how the multiple pictures in the accessed video picture are combined;

decoding the video picture to provide a decoded representation of the combined multiple pictures;

receiving user input selecting at least one of the multiple pictures for display

providing a decoded output of the at least one selected picture, the decoded output being provided based on the accessed information, the decoded representation, and the user input.

43. An apparatus, comprising:

a decoder for accessing a video picture that includes multiple pictures combined into a single picture, accessing information indicating how the multiple pictures in the accessed video picture are combined, and decoding the video picture to provide a decoded representation of the combined multiple pictures;

an interface to receive user input selecting at least one of the multiple pictures for display; and

means for providing a decoded output of the at least one selected picture, the decoded output being provided based on the accessed information, the decoded representation, and the user input.