System and method for transcoding between scalable and non-scalable video codecs

• US 8,681,865 B2
• Filed: 08/31/2011
• Issued: 03/25/2014
• Est. Priority Date: 03/29/2006
• Status: Active Grant

• Current Assignee: Vidyo Incorporated (Enghouse Systems Limited)
• Original Assignee: Vidyo Incorporated (Enghouse Systems Limited)
• Inventors: Eleftheriadis, Alexandros, Hong, Danny, Shapiro, Ofer, Wiegand, Thomas
• Primary Examiner(s): PEARSON, DAVID J
• Application Number:
  US13/222,472
• Publication Number:
  US 20120002728A1
• Time in Patent Office: 937 Days
• Field of Search: None
• US Class Current: 375/240.12
• CPC Class Codes: H04N 19/31 in the temporal domain
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/48 using compressed domain processing techniques other than decoding, e.g. modification of transform coefficients, variable length coding [VLC] data or run-length data motion estimation in a transform domain H04N19/547; processing of decoded motion vectors H04N19/513
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

Systems and methods are provided for performing transcoding in video communication system that use scalable video coding. The systems and methods can be used to transcode or convert input signals having certain characteristics into desired output signals having different characteristics requirements. The systems and methods are based on compressed domain processing, partial decoding-reencoding, or full decoding-reencoding with side information, depending on the specific characteristics of the input and desired output signals.

Claims

1. A digital video signal processing system comprising:

a video processing unit (“

transcoder”

) with at least one digital video signal input and at least one digital video signal output,

wherein the input video coding format of the transcoder is SVC, wherein the output video coding format of the transcoder is SVC and contains the same temporal, and quality resolutions of the input video coding format and the spatial resolutions of the input video coding format up to and including the one closest (“

closest input resolution”

) to a desired highest spatial resolution (“

desired output resolution”

) of the output video coding format, and wherein the transcoder is configured to upsample or downsample the input video signal layer having the closest input resolution to the desired output resolution, as appropriate, and to encode the upsampled or downsampled data using predictors from the coded data of the input video signal layer having the closest input resolution that are appropriately scaled to the desired output resolution and include residuals that are encoded to compensate for the drift introduced.

2. The system of claim 1, wherein the transcoder is further configured to encode the residuals using rate-distortion optimization, wherein the distortion corresponds to the drift.

3. The system of claim 1 wherein to minimize transcoding drift at least one of periodic intra macroblocks and a threaded temporal prediction structure is used in encoding is used in encoding of the input video signal.

4. The system of claim 1 wherein the predictors include motion vector data, and wherein the encoding of the at least one output video signal is done without performing any additional motion estimation.

5. A digital video signal processing system comprising:

a video processing unit (“

transcoder”

) with at least one digital video signal input and at least one digital video signal output,

wherein the input video coding format of the transcoder supports temporal scalability, wherein the output video coding format of the transcoder supports temporal scalability with at least one of the temporal resolutions of the input video coding format being included in desired temporal resolutions of the output video coding format,

and wherein the transcoder is configured to produce a desired set of temporal resolutions for the at least one output video signal by eliminating as unnecessary temporal layers of the at least one input video signal that do not correspond to any desired output temporal resolutions, copying in the at least one output video signal picture data from the at least one input video signal when the data corresponds to desired output temporal resolutions, and transmitting pre-coded information for desired output temporal resolutions that are not present in the at least one input video signal.

6. The system of claim 5 wherein the pre-coded information consists of skip data.

7. A method for transcoding at least one digital video signal input and at least one digital video signal output, wherein the input video coding format is SVC, wherein the output video coding format is SVC and contains the same temporal, and quality resolutions of the input video coding format and the spatial resolutions of the input video coding format up to and including the one closest (“

closest input resolution”

) to a desired highest spatial resolution (“

desired output resolution”

) of the output video coding format, the method comprising;

upsampling or downsampling the input video signal layer having the closest input resolution to the desired output resolution, as appropriate; and

encoding the upsampled or downsampled data using predictors from the coded data of the input video signal layer having the closest input resolution that are appropriately scaled to the desired output resolution and include residuals that are encoded to compensate for the drift introduced.

8. The method of claim 7, further comprising encoding the residuals using rate-distortion optimization, wherein the distortion corresponds to the drift.

9. The method of claim 7 further comprising to minimize transcoding drift using at least one of periodic intra macroblocks and a threaded temporal prediction structure in encoding of the input video signal.

10. The method of claim 7 wherein the predictors include motion vector data, and wherein the encoding of the at least one output video signal is done without performing any additional motion estimation.

17. Non-transitory computer readable media comprising a set of executable instructions for performing the steps of any of claims 7-12 and 15-16.

11. A method for transcoding at least one digital video signal input and at least one digital video signal output, wherein the input video coding format supports temporal scalability, wherein the output video coding format supports temporal scalability with at least one of the temporal resolutions of the input video coding format being included in desired temporal resolutions of the output video coding format, the method comprising:

producing a desired set of temporal resolutions for the at least one output video signal by eliminating as unnecessary temporal layers of the at least one input video signal that do not correspond to any desired output temporal resolutions;

copying in the at least one output video signal picture data from the at least one input video signal when the data corresponds to desired output temporal resolutions; and

transmitting pre-coded information for desired output temporal resolutions that are not present in the at least one input video signal.

12. The method of claim 11 wherein the pre-coded information consists of skip data.

13. A digital video signal processing system comprising:

a video processing unit (“

transcoder”

) with at least one digital video signal input and at least one digital video signal output,

wherein the output video coding format of the transcoder supports temporal scalability, and wherein the transcoder is configured to produce a desired set of temporal resolutions for the at least one output video signal by copying in the at least one output video signal picture data from the at least one input video signal when the data corresponds to desired output temporal resolutions, and decoding picture data form the at least one input video signal and encoding them in the output video signal for desired output temporal resolutions that are not present in the at least one input video signal.

14. The system of claim 13, wherein the output video signal temporal resolutions are threaded.

15. A method for transcoding at least one digital video signal input and at least one digital video signal output, wherein the output video coding format supports temporal scalability, the method comprising:

producing a desired set of temporal resolutions for the at least one output video signal by copying in the at least one output video signal picture data from the at least one input video signal when the data corresponds to desired output temporal resolutions; and

decoding picture data from the at least one input video signal and re-encoding them to the at least one output video signal to produce desired output temporal resolutions that are not present in the at least one input video signal.

16. The method of claim 15, where the output video signal temporal resolutions are threaded.