VIDEO AND DEPTH CODING

• US 20100284466A1
• Filed: 12/18/2008
• Published: 11/11/2010
• Est. Priority Date: 01/11/2008
• Status: Abandoned Application

• Current Assignee: Thomson Licensing (Vantiva SA)
• Original Assignee: Thomson Licensing (Vantiva SA)
• Inventors: Yin, Peng, Tian, Dong, Pandit, Purvin Bibhas
• Application Number:
  US12/735,393
• Publication Number:
  US 20100284466A1
• Time in Patent Office: Days
• US Class Current: 375/240.16
• CPC Class Codes: H04N 19/513 Processing of motion vectors
• CPC Class Codes: H04N 19/577 Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

Various implementations are described. Several implementations relate to video and depth coding. One method includes selecting a component of video information for a picture. A motion vector is determined for the selected video information or for depth information for the picture. The selected video information is coded based on the determined motion vector. The depth information is coded based on the determined motion vector. An indicator is generated that the selected video information and the depth information are coded based on the determined motion vector. One or more data structures are generated that collectively include the coded video information, the coded depth information, and the generated indicator.

Claims

1. A method, comprising:

selecting a component of video information for a picture;

determining a motion vector for the selected video information or for depth information for the picture;

coding the selected video information based on the determined motion vector;

coding the depth information based on the determined motion vector;

generating an indicator that the selected video information and the depth information are coded based on the determined motion vector; and

generating one or more data structures that collectively include the coded video information, the coded depth information, and the generated indicator.

2. The method of claim 1, wherein:

coding the selected video information based on the determined motion vector comprises determining a residue between the selected video information and video information in a reference video picture, the video information in the reference video picture being pointed to by the determined motion vector, and

coding the depth information based on the determined motion vector comprises determining a residue between the depth information and depth information in a reference depth picture, the depth information in the reference depth picture being pointed to by the determined motion vector.

3. The method of claim 1, wherein:

determining the motion vector comprises determining the motion vector for the selected video information,

coding the selected video information based on the determined motion vector comprises determining a residue between the selected video information and video information in a reference video picture, the video information in the reference video picture being pointed to by the determined motion vector, and

coding the depth information based on the determined motion vector comprises;

refining the determined motion vector to produce a refined motion vector; and

determining a residue between the depth information and depth information in a reference depth picture, the depth information in the reference depth picture being pointed to by the refined motion vector.

4. The method of claim 3, further comprising:

generating a refinement indicator that indicates a difference between the determined motion vector and the refined motion vector; and

including the refinement indicator in the generated data structure.

5. The method of claim 1, wherein the picture is a macroblock of a frame.

6. The method of claim 1, further comprising generating an indication that a particular slice of the picture belongs to the selected video information or the depth information, and wherein the data structure further includes the generated indication for the particular slice.

7. The method of claim 6, wherein the indication is provided using at least one high level syntax element.

8. The method of claim 1, wherein the picture corresponds to multi-view video content, and the data structure is generated by interleaving the depth information and the selected video information of a given view of the picture such that the depth information of the given view of the picture follows the selected video information of the given view of the picture.

9. The method of claim 1, wherein the picture corresponds to multi-view video content, and the data structure is generated by interleaving the depth information and the selected video information of a given view of the picture at a given time instance, such that the interleaved depth information and selected video information of the given view of the picture at the given time instance precedes interleaved depth information and selected video information of another view of the picture at the given time instance.

10. The method of claim 1, wherein the picture corresponds to multi-view video content, and the data structure is generated by interleaving the depth information and the selected video information such that the depth information and the selected video information are interleaved by view for each time instance.

11. The method of claim 1, wherein the picture corresponds to multi-view video content, and the data structure is generated by interleaving the depth information and the selected video information such that depth information for multiple views and selected video information for multiple views are interleaved for each time instance.

12. The method of claim 1, wherein the data structure is generated by arranging the depth information as an additional component of the selected video information, the selected video information further including at least one luma component and at least one chroma component.

13. The method of claim 1, wherein a same sampling is used for the depth information and the selected component of video information.

14. The method of claim 13, wherein the selected component of video information is a luminance component or a chrominance component.

15. The method of claim 1, wherein the method is performed by an encoder.

16. An apparatus, comprising:

means for selecting a component of video information for a picture;

means for determining a motion vector for the selected video information or for depth information for the picture;

means for coding the selected video information based on the determined motion vector;

means for coding the depth information based on the determined motion vector;

generating an indicator that the selected video information and the depth information are coded based on the determined motion vector; and

means for generating one or more data structures that collectively include the coded video information, the coded depth information, and the generated indicator.

17. A processor readable medium having stored thereon instructions for causing a processor to perform at least the following:

selecting a component of video information for a picture;

determining a motion vector for the selected video information or for depth information for the picture;

coding the selected video information based on the determined motion vector;

coding the depth information based on the determined motion vector;

generating an indicator that the selected video information and the depth information are coded based on the determined motion vector; and

generating one or more data structures that collectively include the coded video information, the coded depth information, and the generated indicator.

18. An apparatus, comprising a processor configured to perform at the least the following:

selecting a component of video information for a picture;

determining a motion vector for the selected video information or for depth information for the picture;

coding the selected video information based on the determined motion vector;

coding the depth information based on the determined motion vector;

generating an indicator that the selected video information and the depth information are coded based on the determined motion vector; and

generating one or more data structures that collectively include the coded video information, the coded depth information, and the generated indicator.

19. An apparatus, comprising:

a selector for selecting a component of video information for a picture;

a motion vector generator for determining a motion vector for the selected video information or for depth information for the picture;

a coder for coding the selected video information based on the determined motion vector, and for coding the depth information based on the determined motion vector; and

a generator for generating an indicator that the selected video information and the depth information are coded based on the determined motion vector, and for generating one or more data structures that collectively include the coded video information, the coded depth information, and the generated indicator.

20. The apparatus of claim 19, wherein the apparatus comprises an encoder that includes the selector, the motion vector generator, the coder, the indicator generator, and the stream generator.

21. A signal formatted to include a data structure including coded video information for a picture, coded depth information for the picture, and an indicator that the coded video information and the coded depth information are coded based on a motion vector determined for the video information or for the depth information.

22. A processor-readable medium having stored thereon a data structure including coded video information for a picture, coded depth information for the picture, and an indicator that the coded video information and the coded depth information are coded based on a motion vector determined for the video information or for the depth information.

23. A method comprising:

receiving data that includes coded video information for a video component of a picture, coded depth information for the picture, and an indicator that the coded video information and the coded depth information are coded based on a motion vector determined for the video information or for the depth information;

generating the motion vector for use in decoding both the coded video information and the coded depth information;

decoding the coded video information based on the generated motion vector, to produce decoded video information for the picture; and

decoding the coded depth information based on the generated motion vector, to produce decoded depth information for the picture.

24. The method of claim 23, further comprising:

generating a data structure that includes the decoded video information and the decoded depth information;

storing the data structure for use in at least one decoding; and

displaying at least a portion of the picture.

25. The method of claim 23, further comprising receiving an indication, in the received data structure, that a particular slice of the picture belongs to the coded video information or the coded depth information.

26. The method of claim 25, wherein the indication is provided using at least one high level syntax element.

27. The method of claim 23, wherein the received data is received with the coded depth information arranged as an additional video component of the picture.

28. The method of claim 23, wherein the method is performed by a decoder.

29. A method comprising:

means for receiving data that includes coded video information for a video component of a picture, coded depth information for the picture, and an indicator that the coded video information and the coded depth information are coded based on a motion vector determined for the video information or for the depth information;

means for generating the motion vector for use in decoding both the coded video information and the coded depth information;

means for decoding the coded video information based on the generated motion vector, to produce decoded video information for the picture; and

means for decoding the coded depth information based on the generated motion vector, to produce decoded depth information for the picture.

30. A processor readable medium having stored thereon instructions for causing a processor to perform at least the following:

receiving data that includes coded video information for a video component of a picture, coded depth information for the picture, and an indicator that the coded video information and the coded depth information are coded based on a motion vector determined for the video information or for the depth information;

generating the motion vector for use in decoding both the coded video information and the coded depth information;

decoding the coded video information based on the generated motion vector, to produce decoded video information for the picture; and

decoding the coded depth information based on the generated motion vector, to produce decoded depth information for the picture.

31. An apparatus, comprising a processor configured to perform at the least the following:

receiving a data structure that includes coded video information for a video component of a picture, coded depth information for the picture, and an indicator that the coded video information and the coded depth information are coded based on a motion vector determined for the video information or for the depth information;

generating the motion vector for use in decoding both the coded video information and the coded depth information;

decoding the coded video information based on the generated motion vector, to produce decoded video information for the picture; and

decoding the coded depth information based on the generated motion vector, to produce decoded depth information for the picture.

32. An apparatus comprising:

a buffer for receiving data that includes coded video information for a video component of a picture, coded depth information for the picture, and an indicator that the coded video information and the coded depth information are coded based on a motion vector determined for the video information or for the depth information;

a motion vector generator for generating the motion vector for use in decoding both the coded video information and the coded depth information; and

a decoder for decoding the coded video information based on the generated motion vector to produce decoded video information for the picture, and for decoding the coded depth information based on the generated motion vector to produce decoded depth information for the picture.

33. The apparatus of claim 32, further comprising an assembler for generating a data structure that includes the decoded video information and the decoded depth information.

34. The apparatus of claim 32, wherein the apparatus comprises a decoder that includes the buffer, the motion vector generator, and the decoder.

35. An apparatus comprising:

a demodulator configured to receive and demodulate a signal, the signal including coded video information for a video component of a picture, coded depth information for the picture, and an indicator that the coded video information and the coded depth information are coded based on a motion vector determined for the video information or for the depth information; and

a decoder configured to perform at least the following;

generating the motion vector for use in decoding both the coded video information and the coded depth information,

decoding the coded video information based on the generated motion vector, to produce decoded video information for the picture, and

decoding the coded depth information based on the generated motion vector, to produce decoded depth information for the picture.

36. An apparatus comprising:

an encoder configured to perform the following;

selecting a component of video information for a picture, determining a motion vector for the selected video information or for depth information for the picture,

coding the selected video information based on the determined motion vector,

coding the depth information based on the determined motion vector,

generating an indicator that the selected video information and the depth information are coded based on the determined motion vector, and

generating one or more data structures that collectively include the coded video information, the coded depth information, and the generated indicator; and

a modulator configured to modulate and transmit the data structure.