Method, apparatus, and system for enhancing robustness of predictive video codecs using a side-channel based on distributed source coding techniques

• US 20050268200A1
• Filed: 05/27/2005
• Published: 12/01/2005
• Est. Priority Date: 06/01/2004
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Garudadri, Harinath, Srinivasamurthy, Naveen B., Majumdar, Abhik, Chung, Hyukjune, Ramachandran, Kannan
• Granted Patent: US 8,331,445 B2
• Time in Patent Office: Days
• US Class Current: 714/746
• CPC Class Codes: H04L 1/0014 by adapting the source coding
• CPC Class Codes: H04L 1/22 using redundant apparatus to increase reliability
• CPC Class Codes: H04L 2001/0096 Channel splitting in point-to-point links
• CPC Class Codes: H04N 19/39 involving multiple description coding [MDC], i.e. with separate layers being structured as independently decodable descriptions of input picture data
• CPC Class Codes: H04N 19/395 involving distributed video coding [DVC], e.g. Wyner-Ziv video coding or Slepian-Wolf video coding

Abstract

A method, apparatus, and system for providing distributed source coding techniques that improve data coding performance, such as video data coding, when channel errors or losses occur. Errors in the reconstruction of the data is eliminated or reduced by sending extra information. Correlation between a predicted sequence and an original sequence can be used to design codebooks and find the cosets required to represent the original image. This information may be sent over another channel, or a secondary channel.

Claims

1. A wireless communication device comprising:

a predictive encoder configured to receive an input signal, encode the signal according to a predictive encoding standard, and to output a predictive encoded bit-stream;

a secondary channel encoder configured to receive the input signal, encode the signal according to a secondary channel encoding standard, and to output a secondary channel encoded bit-stream.

2. A wireless communication device as defined in claim 1, wherein the predictive encoded bit-stream is transmitted over a main communication channel.

3. A wireless communication device as defined in claim 1, wherein the secondary channel encoded bit-stream is transmitted over a secondary channel communication channel.

4. A wireless communication device as defined in claim 1, wherein the predictive encoding standard is a standard compatible with MPEG-4 standard.

5. A wireless communication device as defined in claim 1, wherein the predictive encoding standard is a standard compatible with H.26x standard.

6. A wireless communication device as defined in claim 1, wherein the secondary channel encoding standard is a standard compatible with Wyner Ziv techniques.

7. A wireless communication device as defined in claim 1, wherein the input signal is a video signal.

8. A wireless communication device as defined in claim 1, wherein the input signal comprises intra-coded blocks of data and inter-coded blocks of data.

9. A wireless communication device as defined in claim 8, wherein Wyner Ziv techniques are applied to the inter-coded data blocks.

10. A wireless communication device as defined in claim 1, wherein the secondary channel encoder will encode the input signal using a predetermined number of cosets.

11. A wireless communication device as defined in claim 10, wherein the number of predetermined cosets is included within a header of the secondary channel encoded bit-stream.

12. A wireless communication device comprising:

a predictive decoder configured to receive a bit-stream representation of an original signal, decode the bit stream according to a predictive decoding standard, and to output a reconstructed signal;

a secondary channel decoder configured to receive a bit-stream representation of the original signal and the reconstructed signal, decode the bit-stream according to a secondary channel decoding standard, and to combine the decoded secondary channel bit stream and the reconstructed signal to generate and output a final reconstruction of the original signal.

13. A wireless communication device as defined in claim 12, wherein the bit-stream decoded by the predictive decoder is received over a main communication channel.

14. A wireless communication device as defined in claim 12, wherein the bit-stream decoded by the secondary channel decoder is received over a secondary channel communication channel.

15. A wireless communication device as defined in claim 12, wherein the predictive decoding standard is a standard compatible with MPEG-4 standard.

16. A wireless communication device as defined in claim 12, wherein the predictive decoding standard is a standard compatible with H.26x standard.

17. A wireless communication device as defined in claim 12, wherein the secondary channel decoding standard is a standard compatible with Wyner Ziv techniques.

18. A wireless communication device as defined in claim 12, wherein the original signal is a video signal.

19. A wireless communication device as defined in claim 12, wherein the original signal comprises intra-coded blocks of data and inter-coded blocks of data.

20. A wireless communication device as defined in claim 19, wherein Wyner-Ziv techniques are applied to the inter-coded data blocks.

21. A wireless communication device as defined in claim 12, wherein the secondary channel decoder will decode the secondary channel bit-stream using a predetermined number of cosets.

22. A wireless communication device as defined in claim 21, wherein the number of predetermined cosets is included within a header of the secondary channel encoded bit-stream.

23. A wireless communication device comprising:

an encoder comprising;

a predictive encoder configured to receive an input signal, encode the signal according to a predictive encoding standard, and to output a predictive encoded bit-stream;

a secondary channel encoder configured to receive the input signal, encode the signal according to a secondary channel encoding standard, and to output a secondary channel encoded bit-stream.

a decoder comprising;

a predictive decoder configured to receive a bit-stream, decode the bit stream according to the predictive decoding standard, and to output a reconstructed signal; and

a secondary channel decoder configured to receive a bit-stream and the reconstructed signal, decode the bit-stream according to a secondary channel decoding standard, and to combine the decoded bit-stream and the reconstructed signal to generate and output a final reconstruction of an original signal.

24. A wireless communication device as defined in claim 23, wherein the predictive decoding standard is a standard compatible with MPEG-4 standard.

25. A wireless communication device as defined in claim 23, wherein the predictive decoding standard is a standard compatible with H.26x standard.

26. A wireless communication device as defined in claim 23, wherein the secondary channel decoding standard is a standard compatible with Wyner Ziv techniques.

27. A wireless communication device as defined in claim 23, wherein the input signal is a video signal.

28. A wireless communication device as defined in claim 23, wherein the wireless communication device is a cell phone.

29. A wireless communication device as defined in claim 23, wherein the wireless device is part of a wireless infrastructure.

30. A wireless communication system comprising:

a first wireless device comprising;

a predictive encoder configured to receive an input signal, encode the signal according to a predictive encoding standard, and to output a predictive encoded bit-stream representation of the input signal;

a secondary channel encoder configured to receive the input signal, encode the signal according to a secondary channel encoding standard, and to output a secondary channel encoded bit-stream representation of the input signal.

a second wireless device comprising;

a predictive decoder configured to receive the bit-stream output by the predictive encoder, decode the bit-stream according to the predictive decoding standard, and to output a reconstruction of the input signal; and

a secondary channel decoder configured to receive the bit-stream output by the secondary channel encoder, decode the bit-stream according to a secondary channel decoding standard, and to combine the decoded secondary channel bit stream and the reconstructed signal to generate and output a final reconstruction of the input signal.

31. A wireless communication system as defined in claim 30, wherein the predictive decoding standard is a standard compatible with MPEG-4 standard.

32. A wireless communication system as defined in claim 30, wherein the predictive decoding standard is a standard compatible with H.26x standard.

33. A wireless communication system as defined in claim 30, wherein the secondary channel decoding standard is a standard compatible with Wyner Ziv techniques.

34. A wireless communication system as defined in claim 30, wherein the first wireless communication device is a cell phone.

35. A wireless communication system as defined in claim 30, wherein the first wireless device is part of a wireless communication infrastructure device.

36. A wireless communication system as defined in claim 30, wherein the second wireless communication device is a cell phone.

37. A wireless communication system as defined in claim 30, wherein the second wireless device is part of a wireless communication infrastructure device.

38. A method of encoding data, the method comprising:

receiving an input signal;

encoding the signal according to a predictive encoding standard, and outputting a predictive encoded bit-stream; and

encoding the signal according to a secondary channel encoding standard, and to outputting a secondary channel encoded bit-stream.

39. A method of encoding as defined in claim 38, wherein the predictive encoding standard is a standard compatible with MPEG-4 standard.

40. A method of encoding as defined in claim 38, wherein the predictive encoding standard is a standard compatible with H.26x standard.

41. A method of encoding as defined in claim 38, wherein the secondary channel encoding standard is a standard compatible with Wyner Ziv techniques.

42. A method of encoding as defined in claim 38, wherein the input signal is a video signal.

43. A method of encoding as defined in claim 38, wherein the input signal comprises intra-coded blocks of data and inter-coded blocks of data.

44. A method of encoding as defined in claim 43, wherein Wyner Ziv techniques are applied to the inter-coded data blocks.

45. A method of encoding as defined in claim 38, wherein the secondary channel encoder will encode the input signal using a predetermined number of cosets.

46. A method of encoding as defined in claim 45, wherein the number of predetermined cosets is included within a header of the secondary channel encoded bit-stream.

47. A method of decoding data, the method comprising:

receiving a predictive encoded bit-stream representation of an original signal;

decoding the predictive encoded bit stream according to a predictive decoding standard, and to output a reconstructed signal;

receiving a secondary channel encoded bit-stream representation of the original signal and the reconstructed signal; and

decoding the secondary channel encoded bit-stream according to a secondary channel encoding standard, and combining the decoded secondary channel bit stream and the reconstructed signal to generate and output a final reconstruction of the original signal.

48. A method of decoding as defined in claim 47, wherein the predictive decoding standard is a standard compatible with MPEG-4 standard.

49. A method of decoding as defined in claim 47, wherein the predictive decoding standard is a standard compatible with H.26x standard.

50. A method of decoding as defined in claim 47, wherein the secondary channel decoding standard is a standard compatible with Wyner Ziv techniques.

51. A method of decoding as defined in claim 47, wherein the original signal is a video signal.

52. A method of decoding as defined in claim 47, wherein the original signal comprises intra-coded blocks of data and inter-coded blocks of data.

53. A method of decoding as defined in claim 52, wherein Wyner Ziv techniques are applied to the inter-coded data blocks.

54. A method of decoding as defined in claim 47, wherein the secondary channel decoder will decode the secondary channel bit-stream using a predetermined number of cosets.

55. A method of decoding as defined in claim 54, wherein the number of predetermined cosets is included within a header of the secondary channel encoded bit-stream.

56. A method of determining intra-frame bit allocation to a secondary channel encoder, the method comprising:

examining an entire frame of data;

determining which blocks of data within the frame of data need protection; and

determining an amount of data within the frame to be allocated to, and transmitted by, a secondary channel based upon the blocks of data that need protection.

57. A method of determining partitions of a source codebook, the method comprising:

determining a correlation noise estimate; and

determining a number of partitions of a source cookbook based upon the estimate of correlation noise estimate.

58. A computer readable media embodying a method of encoding data, the method comprising:

receiving an input signal;

encoding the signal according to a predictive encoding standard, and outputting a predictive encoded bit-stream; and

encoding the signal according to a secondary channel encoding standard, and to outputting a secondary channel encoded bit-stream.

59. A computer readable media embodying a method of decoding data, the method comprising:

receiving a first bit-stream representation of an original signal;

decoding the first bit stream according to a predictive decoding standard, and to output a reconstructed signal;

receiving a second bit-stream representation of the original signal and the reconstructed signal; and

decoding the second bit-stream according to a secondary channel decoding standard, and combining the secondary channel decoded bit stream and the reconstructed signal to generate and output a final reconstruction of the original signal.

60. A method as defined in claim 59, wherein the first bit-stream is encoded according to a predictive encoding standard.

61. A method as defined in claim 59, wherein the second bit-stream is encoded according to a secondary channel encoding standard.

62. A wireless communication device comprising:

means for receiving an input signal;

means for encoding the signal according to a predictive encoding standard, and outputting a predictive encoded bit-stream; and

means for encoding the signal according to a secondary channel encoding standard, and to outputting a secondary channel encoded bit-stream.

63. A wireless communication device comprising:

means for receiving a first bit-stream representation of an original signal;

means for decoding the bit stream according to a predictive decoding standard, and to output a reconstructed signal;

means for receiving a second bit-stream representation of the original signal and the reconstructed signal; and

means for decoding the second bit-stream according to a secondary channel encoding standard, and combining the secondary channel decoded bit stream and the reconstructed signal to generate and output a final reconstruction of the original signal.