Method, apparatus, and system for enhancing robustness of predictive video codecs using a side-channel based on distributed source coding techniques

• US 8,379,716 B2
• Filed: 05/15/2008
• Issued: 02/19/2013
• Est. Priority Date: 06/01/2004
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Garudadri, Harinath, Srinivasamurthy, Naveen B., Chung, Hyukjune, Ramachandran, Kannan, Majumdar, Abhik
• Primary Examiner(s): Torres, Joseph D
• Application Number:
  US12/120,906
• Publication Number:
  US 20080267288A1
• Time in Patent Office: 1,741 Days
• Field of Search: 375/240.12
• US Class Current: 375/240.12
• CPC Class Codes: H04L 1/0014 by adapting the source coding
• CPC Class Codes: H04L 1/22 using redundant apparatus to increase reliability
• CPC Class Codes: H04L 2001/0096 Channel splitting in point-to-point links
• CPC Class Codes: H04N 19/39 involving multiple description coding [MDC], i.e. with separate layers being structured as independently decodable descriptions of input picture data
• CPC Class Codes: H04N 19/395 involving distributed video coding [DVC], e.g. Wyner-Ziv video coding or Slepian-Wolf video coding

Abstract

A method, apparatus, and system for providing distributed source coding techniques that improve data coding performance, such as video data coding, when channel errors or losses occur. Errors in the reconstruction of the data is eliminated or reduced by sending extra information. Correlation between a predicted sequence and an original sequence can be used to design codebooks and find the cosets required to represent the original image. This information may be sent over another channel, or a secondary channel.

Claims

1. A wireless communication device comprising:

a predictive decoder configured to receive an inter-predictive encoded bit-stream representative of an original signal, decode the inter-predictive encoded bit-stream according to a predictive decoding technique, and output a reconstructed signal; and

a secondary channel decoder configured to receive a secondary channel encoded bit-stream, the reconstructed signal, and information that includes the number of cosets used for encoding the secondary channel encoded bit-stream,

wherein the secondary channel encoded bit-stream is representative of the original signal,

wherein the number of cosets used for encoding the secondary channel encoded bit-stream is based on a correlation noise estimate for a video block calculated during encoding of the secondary channel encoded bit-stream based on data associated with the video block and a packet loss probability, and

wherein the secondary channel decoder is further configured to decode the secondary channel encoded bit-stream, based on the number of cosets used for encoding the secondary channel encoded bit-stream, according to a secondary channel decoding technique, and combine the decoded secondary channel encoded bit-stream and the reconstructed signal to generate and output a final reconstruction of the original signal.

2. A wireless communication device as defined in claim 1, wherein the inter-predictive encoded bit-stream is received over a main communication channel.

3. A wireless communication device as defined in claim 1, wherein the secondary channel encoded bit-stream is received over a secondary channel communication channel.

4. A wireless communication device as defined in claim 1, wherein the predictive decoding technique is a technique compatible with MPEG-4 standard.

5. A wireless communication device as defined in claim 1, wherein the predictive decoding technique is a technique compatible with H.26x standard.

6. A wireless communication device as defined in claim 1, wherein the secondary channel decoding technique is a technique compatible with Wyner Ziv techniques.

7. A wireless communication device as defined in claim 1, wherein the original signal is a video signal.

8. A wireless communication device as defined in claim 1, wherein the original signal comprises intra-coded blocks of data and inter-coded blocks of data.

9. A wireless communication device as defined in claim 8, wherein Wyner-Ziv techniques are applied to the inter-coded data blocks.

10. A wireless communication device as defined in claim 1, wherein the number of cosets is included within a header of the secondary channel encoded bit-stream.

11. The wireless communication device as defined in claim 1, further comprising a receiver that receives the predictive encoded bit-stream and the secondary channel encoded bit-stream over a single wireless communication channel, and transmits the predictive encoded bit-stream to the predictive decoder and the secondary channel encoded bit-stream to the secondary channel decoder.

12. The wireless communication device as defined in claim 11,

wherein the predictive encoded bit-stream is received from a first logical channel within the single wireless communication channel, and

wherein the secondary channel encoded bit-stream is received from a second logical channel within the single wireless communication channel.

13. The wireless communication device as defined in claim 1, wherein the inter-predictive encoded bit-stream is received from a main communication channel, and wherein the packet loss probability comprises a probability of losing a packet over the main communication channel.

14. The wireless communication device as defined in claim 1, wherein the secondary channel encoded bit-stream is received from a secondary communication channel, and wherein the packet loss probability comprises a probability of losing a packet over the secondary communication channel.

15. The wireless communication device as defined in claim 1, wherein the correlation noise estimate comprises an expected distortion that is calculated based on the data associated with the video block and an expected reconstructed predictor block, and wherein the expected reconstructed predictor block is calculated during encoding of the secondary channel encoded bit-stream based on the packet loss probability.

16. The wireless communication device as defined in claim 15, wherein the expected reconstructed predictor block comprises expected reconstructed discrete cosine transform (DCT) coefficients that are calculated during encoding of the secondary channel encoded bit-stream based on the packet loss probability.

17. A method of decoding data, the method comprising:

receiving an inter-predictive encoded bit-stream representative of an original signal;

decoding the inter-predictive encoded bit-stream according to a predictive decoding technique, and outputting a reconstructed signal;

receiving a secondary channel encoded hit-stream, the reconstructed signal, and information that includes the number of cosets used for encoding the secondary channel encoded bit-stream, wherein the secondary channel encoded bit-stream is representative of the original signal, and wherein the number of cosets used for encoding the secondary channel encoded bit-stream is based on a correlation noise estimate for a video block calculated during encoding of the secondary channel encoded bit-stream based on data associated with the video block and a packet loss probability; and

decoding the secondary channel encoded bit-stream, based on the number of cosets used for encoding the secondary channel encoded bit-stream, according to a secondary channel encoding technique, and combining the decoded secondary channel encoded bit-stream and the reconstructed signal to generate and output a final reconstruction of the original signal.

18. A method of decoding as defined in claim 17, wherein the predictive decoding technique is a technique compatible with MPEG-4 standard.

19. A method of decoding as defined in claim 17, wherein the predictive decoding technique is a technique compatible with H.26x standard.

20. A method of decoding as defined in claim 17, wherein the secondary channel decoding technique is a technique compatible with Wyner Ziv techniques.

21. A method of decoding as defined in claim 17, wherein the original signal is a video signal.

22. A method of decoding as defined in claim 17, wherein the original signal comprises intra-coded blocks of data and inter-coded blocks of data.

23. A method of decoding as defined in claim 22, wherein Wyner Ziv techniques are applied to the inter-coded data blocks.

24. A method of decoding as defined in claim 17, wherein the number of cosets is included within a header of the secondary channel encoded bit-stream.

25. A non-transitory computer-readable medium comprising instructions that upon execution by a processor cause the processor to:

receive a first bit-stream representative of an original signal, wherein the first bit-stream is an inter-predictive encoded bit-stream;

decode the first bit-stream according to a predictive decoding technique, and output a reconstructed signal;

receive a second bit-stream, the reconstructed signal, and information that includes the number of cosets used for encoding the second bit-stream, wherein the second bit-stream is representative of the original signal, and wherein the number of cosets used for encoding the second bit-stream is based on a correlation noise estimate for a video block calculated during encoding of the second bit-stream based on data associated with the video block and a packet loss probability; and

decode the second bit-stream, based on the number of cosets used for encoding the second bit-stream, according to a secondary channel decoding technique, and combine the decoded second bit-stream and the reconstructed signal to generate and output a final reconstruction of the original signal.

26. The non-transitory computer-readable medium as defined in claim 25, wherein the first bit-stream is encoded according to a predictive encoding technique.

27. The non-transitory computer-readable medium as defined in claim 25, wherein the second bit-stream is encoded according to a secondary channel encoding technique.

28. A wireless communication device comprising:

means for receiving a first bit-stream representative of an original signal, wherein the first bit-stream is an inter-predictive encoded bit-stream;

means for decoding the first bit-stream according to a predictive decoding technique, and outputting a reconstructed signal;

means for receiving a second bit-stream, the reconstructed signal, and information that includes the number of cosets used for encoding the second bit-stream, wherein the second bit-stream is representative of the original signal, and wherein the number of cosets used for encoding the second bit-stream is based on a correlation noise estimate for a video block calculated during encoding of the second bit-stream based on data associated with the video block and a packet loss probability; and

means for decoding the second bit-stream, based on the number of cosets used for encoding the second bit-stream, according to a secondary channel encoding technique, and combining the decoded second bit-stream and the reconstructed signal to generate and output a final reconstruction of the original signal.