Method and system for 3D video coding using SVC temporal and spatial scalabilities

• US 9,014,276 B2
• Filed: 07/21/2010
• Issued: 04/21/2015
• Est. Priority Date: 12/04/2009
• Status: Active Grant

• Current Assignee: Avago Technologies International Sales Pte Limited (Broadcom, Inc.)
• Original Assignee: Broadcom Corporation (Broadcom, Inc.)
• Inventors: Chen, Xuemin, Heng, Brian, Wan, Wade, English, Daniel, Yang, Zhijie
• Primary Examiner(s): Rao, Andy
• Application Number:
  US12/840,557
• Publication Number:
  US 20110134214A1
• Time in Patent Office: 1,735 Days
• Field of Search: 37524001-24029, 348 42- 60
• US Class Current: 375/240.26
• CPC Class Codes: H04N 19/33 in the spatial domain
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

A 3-dimensional (3D) video transmitter may be operable to encode a 3D video to generate a scalable video coding (SVC) base layer and a SVC enhancement layer. A first view such as a first high-resolution view and a second view such as a second high-resolution view of the 3D video in the SVC enhancement layer may be separate frames. A first half-resolution view and a second half-resolution view of the 3D video in the SVC base layer may be packed in a single frame. The first half-resolution view in the SVC base layer may be a base-layer reference for the first high-resolution view in the SVC enhancement layer for inter-layer prediction of spatial scalable coding. The first high-resolution view in the SVC enhancement layer may be an intra-layer reference for the second high-resolution view in the SVC enhancement layer for intra-layer prediction of temporal scalable coding.

Claims

1. A method for processing video, the method comprising:

in a 3-dimensional (3D) video transmitter;

encoding a 3D video to generate a scalable video coding (SVC) base layer, a frame in said SVC base layer comprising a right half-resolution view of said 3D video and a left half-resolution view of said 3D video; and

encoding said 3D video to generate an SVC enhancement layer, a first frame in said SVC enhancement layer comprising a right high-resolution view and a second frame in said SVC enhancement layer comprising a left high-resolution view, wherein said first and second frames of said SVC enhancement layer each comprises a separate frame in said SVC enhancement layer and has a higher spatial resolution than said frame in said SVC base layer;

wherein;

said right half-resolution view in said SVC base layer is a reference for said right high-resolution view in said SVC enhancement layer for interlayer prediction of spatial scalable coding; and

said right high-resolution view in said SVC enhancement layer is an intra-layer reference for said left high-resolution view in said SVC enhancement layer for intra-layer prediction of temporal scalable coding.

2. The method according to claim 1, wherein a total number of bits for said right half-resolution view is different from a total number of bits for said left half-resolution view.

3. The method according to claim 1, wherein a total number of bits for said right high-resolution view is different from a total number of bits for said left high resolution view.

4. The method according to claim 1, comprising transmitting said right half-resolution view and said left half-resolution view in a single elementary stream to a 3D video receiver.

5. The method according to claim 1, comprising transmitting said right half-resolution view in a first elementary stream and said left half-resolution view in a second elementary stream to a 3D video receiver.

6. The method according to claim 1, comprising transmitting said right high-resolution view and said left high-resolution view in a single elementary stream to a 3D video receiver.

7. The method according to claim 1, comprising transmitting said right high-resolution view in a first elementary stream and said left high-resolution view in a second elementary stream to a 3D video receiver.

8. The method according to claim 1, comprising transmitting said frame in said SVC base layer comprising said right half-resolution view and said left half-resolution view, said first frame in said SVC enhancement layer comprising said right high-resolution view, and said second frame in said SVC enhancement layer comprising said left high-resolution view to a 3D video receiver, wherein said transmitted right half-resolution view is independently decoded by said 3D video receiver without a reference from other views.

9. The method according to claim 1, wherein:

encoding said 3D video to generate said SVC base layer comprises encoding said 3D video in an interlaced format at a higher frame rate than an original frame rate of said 3D video, using pulldown;

encoding said 3D video to generate said SVC enhancement layer comprises encoding said 3D video in a progressive format at said original frame rate of said 3D video; and

said method further comprises transmitting said SVC base layer and said SVC enhancement layer to a 3D video receiver, wherein;

said SVC base layer is decoded, with said 3D video receiver, to generate a decompressed 3D video at said half-resolution in said interlaced format at said higher frame rate; and

said SVC enhancement layer is decoded, with said 3D video receiver, to generate a decompressed 3D video at said high-resolution in said progressive format at said original frame rate.

10. A system for processing video, the system comprising:

one or more processors, one or more circuits, or any combination thereof for use in a 3-dimensional (3D) video transmitter, operable to;

encode a 3D video to generate a scalable video coding (SVC) base layer, a frame in said SVC base layer comprising a right half-resolution view and a left half-resolution view; and

encode said 3D video to generate a SVC enhancement layer, a first frame in said SVC enhancement layer comprising a right high-resolution view and a second frame in said SVC enhancement layer comprising a left high-resolution view, wherein said first and second frames of said SVC enhancement layer each comprises a separate frame in said SVC enhancement layer and has a higher spatial resolution than said frame in said SVC base laver;

wherein

said right half-resolution view in said SVC base layer is a base-layer reference for said right high-resolution view in said SVC enhancement layer for interlayer prediction of spatial scalable coding; and

said right high-resolution view in said SVC enhancement layer is an intra-layer reference for said left high-resolution view in said SVC enhancement layer for intra-layer prediction of temporal scalable coding.

11. The system according to claim 10, wherein a total number of bits for said right half-resolution view is different from a total number of bits for said left half-resolution view.

12. The system according to claim 10, wherein a total number of bits for said right high-resolution view is different from a total number of bits for said left high-resolution view.

13. The system according to claim 10, wherein said one or more processors, one or more circuits, or any combination thereof is operable to transmit said right half-resolution view and said left half-resolution view in a single elementary stream to a 3D video receiver.

14. The system according to claim 10, wherein said one or more processors, one or more circuits, or any combination thereof is operable to transmit said right half-resolution view in a first elementary stream and said left half-resolution view in a second elementary stream to a 3D video receiver.

15. The system according to claim 10, wherein said one or more processors, one or more circuits, or any combination thereof is operable to transmit said right high-resolution view and said left high-resolution view in a single elementary stream to a 3D video receiver.

16. The system according to claim 10, wherein said one or more processors, one or more circuits, or any combination thereof is operable to transmit said right high-resolution view in a first elementary stream and said left high-resolution view in a second elementary stream to a 3D video receiver.

17. The system according to claim 10, wherein said one or more processors, one or more circuits, or any combination thereof is operable to transmit said frame in said SVC base layer comprising said right half-resolution view and said left half-resolution view, said first frame in said SVC enhancement layer comprising said right high-resolution view, and said second frame in said SVC enhancement layer comprising said left high-resolution view to a 3D video receiver, wherein said transmitted right half-resolution view is independently decoded by said 3D video receiver without a reference from other views.

18. The system according to claim 10, wherein said one or more processors, one or more circuits, or any combination thereof is operable to:

encode said 3D video to generate said SVC base layer in an interlaced format at a higher frame rate than an original frame rate of said 3D video, using pulldown;

encode said 3D video to generate said SVC enhancement layer in a progressive format at said original frame rate of said 3D video; and

transmit said SVC base layer and said SVC enhancement layer to a 3D video receiver,

wherein;

said SVC base layer is decoded, with said 3D video receiver, to generate a decompressed 3D video at said half-resolution in said interlaced format at said higher frame rate; and

said SVC enhancement layer is decoded, with said 3D video receiver, to generate a decompressed 3D video at said high-resolution in said progressive format at said original frame rate.

19. A method for processing video, the method comprising:

encoding, with a 3-dimensional (3D) video encoder, a 3D video to generate a base layer, a frame in said base layer comprising a right half-resolution view and a left half-resolution view; and

encoding, with said 3D video encoder, said 3D video to generate an enhancement layer, a first frame in said enhancement layer comprising a right high-resolution view and a second frame in said enhancement layer comprising a left high-resolution view, said first and second frames of said enhancement layer each having a higher spatial resolution than said right half-resolution view and said left half-resolution view in said base layer;

wherein;

said right half-resolution view in said base layer is a reference for said right high-resolution view in said enhancement layer for interlayer prediction of spatial scalable coding; and

said right high-resolution view in said enhancement layer is an intra-layer reference for said left high-resolution view in said enhancement layer for intra-layer prediction of temporal scalable coding.

20. The method according to claim 19, wherein:

encoding said 3D video to generate said base layer comprises encoding said 3D video in an interlaced format at a higher frame rate than an original frame rate of said 3D video;

encoding said 3D video to generate said enhancement layer comprises encoding said 3D video in a progressive format at said original frame rate of said 3D video; and

said method further comprises transmitting said base and enhancement layers to a 3D video receiver, wherein;

said transmitted base layer is decoded, with said 3D video receiver, to generate a decompressed 3D video at said half-resolution in said interlaced format at said higher frame rate; and

said transmitted enhancement layer is decoded, by with said 3D video receiver, to generate a decompressed 3D video at said high-resolution in said progressive format at said original frame rate.