Bandwidth saving architecture for scalable video coding spatial mode

• US 10,659,796 B2
• Filed: 09/10/2018
• Issued: 05/19/2020
• Est. Priority Date: 11/29/2012
• Status: Active Grant

• Current Assignee: Advanced Micro Devices, Inc.
• Original Assignee: Advanced Micro Devices, Inc.
• Inventors: Zhang, Lei, Zhou, Ji, Chen, Zhen, Yu, Min
• Primary Examiner(s): Habib, Irfan
• Application Number:
  US16/126,704
• Publication Number:
  US 20190028725A1
• Time in Patent Office: 617 Days
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/159 Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/33 in the spatial domain
• CPC Class Codes: H04N 19/423 characterised by memory arrangements H04N19/433 takes precedence
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 19/80 Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation H04N19/635, H04N19/86 take precedence

Abstract

A system and method for scalable video coding that includes base layer having lower resolution encoding, enhanced layer having higher resolution encoding and the data transferring between two layers. The system and method provides several methods to reduce bandwidth of inter-layer transfers while at the same time reducing memory requirements. Due to less memory access, the system clock frequency can be lowered so that system power consumption is lowered as well. The system avoids having prediction data from base layer to enhanced layer to be up-sampled for matching resolution in the enhanced layer as transferring up-sampled data can impose a big burden on memory bandwidth.

Claims

1. A system configured to perform scalable video encoding comprising:

a memory; and

a processing unit, wherein the processing unit is configured to;

receive video data, wherein the video data includes one or more frames;

encode at least one frame to a base layer;

generate inter-layer data based on the at least one frame, wherein the inter-layer data includes any one or a combination of residual data, reconstruction data, and motion data, wherein the inter-layer data includes a bit indicating whether the inter-layer data includes residual data;

upsample the inter-layer data; and

encode the at least one frame to an enhanced layer using the upsampled inter-layer data based on a block type of the base layer, wherein the block type of the base layer indicates whether the inter-layer data includes either residual data or reconstruction data, wherein the resolution of the enhanced layer is greater than the resolution of the base layer.

2. The system of claim 1, wherein the processing unit includes one encoder.

3. The system of claim 1, wherein the processing unit includes a base layer encoder and an enhanced layer encoder.

4. The system of claim 3, wherein the base layer encoder is configured to generate the inter-layer data based on the at least one frame and transmit the inter-layer data to the enhanced layer encoder.

5. The system of claim 4, wherein the inter-layer data is transmitted to the enhanced layer decoder over a plurality of data channels.

6. The system of claim 5, wherein a same number of the plurality data channels are used for the transmission of the residual data or the reconstruction data included in the inter-layer data.

7. The system of claim 3, wherein the enhanced layer encoder is configured to upsample the inter-layer data and encode the at least one frame to the enhanced layer using the upsampled inter-layer data based on the block type of the base layer.

8. A method for use in a processing system for performing scalable video encoding comprising:

receiving video data, wherein the video data includes one or more frames;

encoding at least one frame to a base layer;

generating inter-layer data based on the at least one frame, wherein the inter-layer data includes any one or a combination of residual data, reconstruction data, and motion data, wherein the inter-layer data includes a bit indicating whether the inter-layer data includes residual data;

upsampling the inter-layer data; and

encoding the at least one frame to an enhanced layer using the upsampled inter-layer data based on a block type of the base layer, wherein the block type of the base layer indicates whether the inter-layer data includes either residual data or reconstruction data, wherein the resolution of the enhanced layer is greater than the resolution of the base layer.

9. The method of claim 8, wherein the processing system includes one encoder.

10. The method of claim 8, wherein the processing system includes a base layer encoder and an enhanced layer encoder.

11. The method of claim 10 further comprising generating, by the base layer encoder, the inter-layer data based on the at least one frame and transmit the inter-layer data to the enhanced layer encoder.

12. The method of claim 10, wherein the inter-layer data is transmitted to the enhanced layer decoder over a plurality of data channels.

13. The method of claim 12, wherein a same number of the plurality data channels are used for the transmission of the residual data or the reconstruction data included in the inter-layer data.

14. The method of claim 10 further comprising upsampling, by the enhanced layer encoder, the inter-layer data and encoding the at least one frame to the enhanced layer using the upsampled inter-layer data based on the block type of the base layer.

15. A non-transitory computer readable medium storing instructions that, when executed in a processing system, cause the processing system to perform instructions for performing scalable video encoding comprising:

receiving video data, wherein the video data includes one or more frames;

encoding at least one frame to a base layer;

generating inter-layer data based on the at least one frame, wherein the inter-layer data includes any one or a combination of residual data, reconstruction data, and motion data, wherein the inter-layer data includes a bit indicating whether the inter-layer data includes residual data;

upsampling the inter-layer data; and

encoding the at least one frame to an enhanced layer using the upsampled inter-layer data based on a block type of the base layer, wherein the block type of the base layer indicates whether the inter-layer data includes either residual data or reconstruction data, wherein the resolution of the enhanced layer is greater than the resolution of the base layer.

16. The non-transitory computer readable medium of claim 15, wherein the processing system includes one encoder.

17. The non-transitory computer readable medium of claim 15, wherein the processing system includes a base layer encoder and an enhanced layer encoder.

18. The non-transitory computer readable medium of claim 17 further comprising generating, by the base layer encoder, the inter-layer data based on the at least one frame and transmit the inter-layer data to the enhanced layer encoder.

19. The non-transitory computer readable medium of claim 17, wherein the inter-layer data is transmitted to the enhanced layer decoder over a plurality of data channels.

20. The non-transitory computer readable medium of claim 19, wherein a same number of the plurality data channels are used for the transmission of the residual data or the reconstruction data included in the inter-layer data.

21. The non-transitory computer readable medium of claim 17 further comprising upsampling, by the enhanced layer encoder, the inter-layer data and encoding the at least one frame to the enhanced layer using the upsampled inter-layer data based on the block type of the base layer.