METHOD AND SYSTEM FOR 3D VIDEO CODING USING SVC TEMPORAL AND SPATIAL SCALABILITIES

• US 20110134214A1
• Filed: 07/21/2010
• Published: 06/09/2011
• Est. Priority Date: 12/04/2009
• Status: Active Grant

• Current Assignee: Avago Technologies International Sales Pte Limited (Broadcom, Inc.)
• Original Assignee: Broadcom Corporation (Broadcom, Inc.)
• Inventors: English, Daniel, Yang, Zhijie, Chen, Xuemin, Heng, Brian, Wan, Wade
• Granted Patent: US 9,014,276 B2
• Time in Patent Office: Days
• US Class Current: 348/43
• CPC Class Codes: H04N 19/33 in the spatial domain
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

A 3-dimensional (3D) video transmitter may be operable to encode a 3D video to generate a scalable video coding (SVC) base layer and a SVC enhancement layer. A first view such as a first high-resolution view and a second view such as a second high-resolution view of the 3D video in the SVC enhancement layer may be separate frames. A first half-resolution view and a second half-resolution view of the 3D video in the SVC base layer may be packed in a single frame. The first half-resolution view in the SVC base layer may be a base-layer reference for the first high-resolution view in the SVC enhancement layer for inter-layer prediction of spatial scalable coding. The first high-resolution view in the SVC enhancement layer may be an intra-layer reference for the second high-resolution view in the SVC enhancement layer for intra-layer prediction of temporal scalable coding.

Claims

1. A method for processing video, the method comprising:

in a 3-dimensional (3D) video transmitter;

encoding a 3D video to generate a scalable video coding (SVC) base layer; and

encoding said 3D video to generate a SVC enhancement layer, wherein a first view and a second view of said 3D video in said SVC enhancement layer are separate frames.

2. The method according to claim 1, wherein:

a first half-resolution view and a second half-resolution view of said 3D video in said SVC base layer are packed in a single frame;

said first view in said SVC enhancement layer comprises a first high-resolution view and said second view in said SVC enhancement layer comprises a second high-resolution view, and said high-resolution comprises a resolution that is greater than half resolution;

said first half-resolution view in said SVC base layer is a base-layer reference for said first high-resolution view in said SVC enhancement layer for inter-layer prediction of spatial scalable coding; and

said first high-resolution view in said SVC enhancement layer is an intra-layer reference for said second high-resolution view in said SVC enhancement layer for intra-layer prediction of temporal scalable coding.

3. The method according to claim 2, wherein a total number of bits for said first half-resolution view is different from a total number of bits for said second half-resolution view.

4. The method according to claim 2, wherein a total number of bits for said first high-resolution view is different from a total number of bits for said second high-resolution view.

5. The method according to claim 2, comprising transmitting said first half-resolution view and said second half-resolution view in a single elementary stream to a 3D video receiver.

6. The method according to claim 2, comprising transmitting said first half-resolution view in a first elementary stream and said second half-resolution view in a second elementary stream to a 3D video receiver.

7. The method according to claim 2, comprising transmitting said first high-resolution view and said second high-resolution view in a single elementary stream to a 3D video receiver.

8. The method according to claim 2, comprising transmitting said first high-resolution view in a first elementary stream and said second high-resolution view in a second elementary stream to a 3D video receiver.

9. The method according to claim 2, comprising transmitting said SVC base layer, which comprises said first half-resolution view and said second half-resolution view, and said SVC enhancement layer, which comprises said first high-resolution view and said second high-resolution view, to a 3D video receiver, wherein said transmitted first half-resolution view is independently decoded by said 3D video receiver without a reference from other views.

10. The method according to claim 2, comprising, when operating in film mode:

encoding said 3D video to generate said SVC base layer, which comprises said first half-resolution view and said second half-resolution view, in an interlaced format at a higher frame rate that is higher than original frame rate of said 3D video, using pulldown;

encoding said 3D video to generate said SVC enhancement layer, which comprises said first high-resolution view and said second high-resolution view, in a progressive format at said original frame rate; and

transmitting said SVC base layer and said SVC enhancement layer to a 3D video receiver, wherein;

said transmitted SVC base layer is decoded, by said 3D video receiver, to generate a decompressed 3D video with said half-resolution in said interlaced format at said higher frame rate; and

said transmitted SVC enhancement layer is decoded, by said 3D video receiver, to generate a decompressed 3D video with said high-resolution in said progressive format at said original frame rate.

11. A system for processing video, the system comprising:

one or more processors and/or circuits for use in a 3-dimensional (3D) video transmitter, said one or more processors and/or circuits being operable to;

encode a 3D video to generate a scalable video coding (SVC) base layer; and

encode said 3D video to generate a SVC enhancement layer, wherein a first view and a second view of said 3D video in said SVC enhancement layer are separate frames.

12. The system according to claim 11, wherein:

a first half-resolution view and a second half-resolution view of said 3D video in said SVC base layer are packed in a single frame;

said first view in said SVC enhancement layer comprises a first high-resolution view and said second view in said SVC enhancement layer comprises a second high-resolution view, and said high-resolution comprises a resolution that is greater than half resolution;

said first half-resolution view in said SVC base layer is a base-layer reference for said first high-resolution view in said SVC enhancement layer for inter-layer prediction of spatial scalable coding; and

said first high-resolution view in said SVC enhancement layer is an intra-layer reference for said second high-resolution view in said SVC enhancement layer for intra-layer prediction of temporal scalable coding.

13. The system according to claim 12, wherein a total number of bits for said first half-resolution view is different from a total number of bits for said second half-resolution view.

14. The system according to claim 12, wherein a total number of bits for said first high-resolution view is different from a total number of bits for said second high-resolution view.

15. The system according to claim 12, wherein said one or more processors and/or circuits are operable to transmit said first half-resolution view and said second half-resolution view in a single elementary stream to a 3D video receiver.

16. The system according to claim 12, wherein said one or more processors and/or circuits are operable to transmit said first half-resolution view in a first elementary stream and said second half-resolution view in a second elementary stream to a 3D video receiver.

17. The system according to claim 12, wherein said one or more processors and/or circuits are operable to transmit said first high-resolution view and said second high-resolution view in a single elementary stream to a 3D video receiver.

18. The system according to claim 12, wherein said one or more processors and/or circuits are operable to transmit said first high-resolution view in a first elementary stream and said second high-resolution view in a second elementary stream to a 3D video receiver.

19. The system according to claim 12, wherein said one or more processors and/or circuits are operable to transmit said SVC base layer, which comprises said first half-resolution view and said second half-resolution view, and said SVC enhancement layer, which comprises said first high-resolution view and said second high-resolution view, to a 3D video receiver, and said transmitted first half-resolution view is independently decoded by said 3D video receiver without a reference from other views.

20. The system according to claim 12, wherein, when operating in film mode, said one or more processors and/or circuits are operable to:

encode said 3D video to generate said SVC base layer, which comprises said first half-resolution view and said second half-resolution view, in an interlaced format at a higher frame rate that is higher than original frame rate of said 3D video, using pulldown;

encode said 3D video to generate said SVC enhancement layer, which comprises said first high-resolution view and said second high-resolution view, in a progressive format at said original frame rate; and

transmit said SVC base layer and said SVC enhancement layer to a 3D video receiver, and;

said transmitted SVC base layer is decoded, by said 3D video receiver, to generate a decompressed 3D video with said half-resolution in said interlaced format at said higher frame rate; and

said transmitted SVC enhancement layer is decoded, by said 3D video receiver, to generate a decompressed 3D video with said high-resolution in said progressive format at said original frame rate.