Video demultiplexer and decoder with efficient data recovery

• US 20060062312A1
• Filed: 09/22/2004
• Published: 03/23/2006
• Est. Priority Date: 09/22/2004
• Status: Abandoned Application

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: El-Maleh, Khaled Helmi, Lee, Yen-Chi, Tsai, Ming-Chang, Ling, Fan, Ye, Yan
• Application Number:
  US10/947,981
• Publication Number:
  US 20060062312A1
• Time in Patent Office: Days
• US Class Current: 375/240.270
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 67/04 specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability
• CPC Class Codes: H04N 19/895 in combination with error concealment
• CPC Class Codes: H04N 21/4382 Demodulation or channel decoding, e.g. QPSK demodulation analog front ends or means for connecting modulators, demodulators or transceivers to a transmission line H04L27/0002
• CPC Class Codes: H04N 21/8455 involving pointers to the content, e.g. pointers to the I-frames of the video stream

Abstract

A video demultiplexer and video decoder include features for efficient video data recovery in the event of channel error. The demultiplexer detects a boundary between physical layer data units and adds boundary information to the bitstream produced by the demultiplexer. The demultiplexer produces adaptation layer data units, which are processed by the adaptation layer to produce an application layer bitstream. When the video decoder encounters an error in the bitstream, it uses the boundary information to limit the amount of data that must be concealed. In particular, the boundary information permits the error to be associated with a small segment of data. The video decoder conceals data from the beginning of the segment of data, rather than an entire slice or frame in which the segment resides. In this manner, the video decoder provides efficient data recovery, limiting the loss of useful data that otherwise would be purposely discarded for concealment purposes.

Claims

1. A video decoding method comprising:

generating multiplex layer data units containing video data based on physical layer data units;

embedding a boundary marker in the multiplex layer data units to indicate a boundary between the physical layer data units;

demultiplexing the multiplex layer data units to generate a video data frame; and

associating a detected decoding error with a segment of the video data frame using the boundary markers.

2. The method of claim 1, wherein the boundary marker identifies a start of a lost physical layer data unit.

3. The method of claim 1, wherein embedding a boundary marker includes embedding a plurality of the boundary markers to identify boundaries between a plurality of the physical layer data units.

4. The method of claim 1, wherein the video data frame includes macroblocks of video data, the method further comprising concealing macroblocks within the segment of the video data frame.

5. The method of claim 1, wherein the video data frame includes resynchronization markers, the method further comprising concealing macroblocks within the segment of the video data frame and macroblocks up to a next one of the resynchronization markers following the detected decoding error in the video data frame.

6. The method of claim 1, further comprising demultiplexing the multiplex layer data units to generate adaptation layer data units, and generating the video data frame based on the adaptation layer data units.

7. The method of claim 1, further comprising receiving the physical layer data units via wireless communication.

8. The method of claim 1, further comprising demultiplexing the multiplex layer units according to the ITU H.223 multiplexing/demultiplexing protocol.

9. The method of claim 1, further comprising demultiplexing the multiplex layer units according to the RTP/UDP/IP multiplexing/demultiplexing protocol.

10. The method of claim 1, wherein the video data frame includes macroblocks of video data conforming to the MPEG-4 standard.

11. The method of claim 1, wherein the video data frame includes macroblocks of video data conforming to one of the ITU H.263, ITU H.264 and MPEG-2 protocols.

12. The method of claim 1, wherein the physical layer data units include W-CDMA radio link control packet data units (RLC PDUs).

13. The method of claim 12, wherein the multiplex layer data units conform to the H.223 multiplexing/demultiplexing protocol.

14. The method of claim 1, wherein the physical layer data units include CDMA2000 1×

radio link protocol packet data units (RLP PDUs), CDMA2000 1×

EV-DO RLP PDUs, or CDMA2000 EV-DV RLP PDUs.

15. The method of claim 1, wherein the multiplex layer data units conform to the RTP/UDP/IP multiplexing/demultiplexing protocol.

16. The method of claim 1, wherein the physical layer data units include audio and video data, and embedding boundary markers includes embedding boundary markers in the multiplex layer data units to indicate boundaries between video information in the physical layer data units.

17. A video decoding system comprising:

a demultiplexing engine to generate multiplex layer data units containing video data based on physical layer data units, and demultiplex the multiplex layer data units;

a boundary generator to embed a boundary marker in the multiplex layer data units to indicate a boundary between the physical layer data units; and

a video decoding engine to decode a video data frame containing the video data, and associate a detected decoding error with a segment of the video data frame using the boundary markers.

18. The system of claim 17, wherein the boundary marker identifies a start of a lost physical layer data unit.

19. The system of claim 17, wherein the boundary generator embeds a plurality of the boundary markers to identify boundaries between a plurality of the physical layer data units.

20. The system of claim 17, further comprising a boundary detector to detect the boundaries between the physical layer data units.

21. The system of claim 17, wherein the video data frame includes macroblocks of video data, and the decoding engine conceals macroblocks within the segment of the video data frame.

22. The system of claim 17, wherein the video data frame includes resyncrhonization markers, and the decoding engine conceals macroblocks within the segment of the video data frame and macroblocks up to a next one of the resynchronization markers following the detected decoding error in the video data frame.

23. The system of claim 17, further comprising an adaptation layer module to generate adaptation layer data units based on the demultiplexed multiplex layer data units, and generate the video data frame based on the adaptation layer data units.

24. The system of claim 17, further comprising a wireless receiver to receive the physical layer data units via wireless communication.

25. The system of claim 17, wherein the demultiplexing engine demultiplexes the multiplex layer units according to the ITU H.223 multiplexing/demultiplexing protocol.

26. The system of claim 17, wherein the demultiplexing engine demultiplexes the multiplex layer units according to the RTP/UDP/IP multiplexing/demultiplexing protocol.

27. The system of claim 17, wherein the video data frame includes macroblocks of video data conforming to the MPEG-4 standard.

28. The system of claim 17, wherein the video data frame includes macroblocks of video data conforming to one of the ITU H.263, ITU H.264 and MPEG-2 protocols

29. The system of claim 17, wherein the physical layer data units include W-CDMA radio link control packet data units (RLC PDUs).

30. The system of claim 29, wherein the multiplex layer data units conform to the H.223 multiplexing/demultiplexing protocol.

31. The system of claim 17, wherein the physical layer data units include CDMA2000 1×

radio link protocol packet data units (RLP PDUs), CDMA2000 1×

EV-DO RLP PDUs, or CDMA2000 EV-DV RLP PDUs.

32. The system of claim 17, wherein the multiplex layer data units conform to the RTP/UDP/IP multiplexing/demultiplexing protocol.

33. The system of claim 17, wherein the physical layer data units include audio and video data, and the boundary generator embeds the boundary markers in the multiplex layer data units to indicate boundaries between video information in the physical layer data units.

34. A video demultiplexer comprising:

a demultiplexing engine to generate multiplex layer data units containing video data based on physical layer data units, and demultiplex the multiplex layer data units; and

a boundary generator to embed a boundary marker in the multiplex layer data units to indicate a boundary between the physical layer data units to permit a video decoder to associate a detected decoding error with a segment of a video data frame using the boundary markers.

35. The demultiplexer of claim 34, wherein the boundary marker identifies a start of a lost physical layer data unit.

36. The demultiplexer of claim 34, wherein the boundary generator embeds a plurality of the boundary markers to identify boundaries between a plurality of the physical layer data units.

37. The demultiplexer of claim 34, further comprising a boundary detector to detect the boundaries between the physical layer data units.

38. The demultiplexer of claim 34, wherein the video data frame includes macroblocks of video data, and the decoding engine conceals macroblocks within the segment of the video data frame.

39. The demultiplexer of claim 34, wherein the demultiplexing engine demultiplexes the multiplex layer data units according to the H.223 multiplexing/demultiplexing protocol.

40. The demultiplexer of claim 34, wherein the demultiplexing engine demultiplexes the multiplex layer data units according to the RTP/UDP/IP multiplexing/demultiplexing protocol.

41. The demultiplexer of claim 34, wherein the video data frame includes macroblocks of video data conforming to the MPEG-4 standard.

42. The demultiplexer of claim 34, wherein the video data frame includes macroblocks of video data conforming to one of the ITU H.263, ITU H.264 and MPEG-2 protocols

43. The demultiplexer of claim 34, wherein the physical layer data units include W-CDMA radio link control packet data units (RLC PDUs).

44. The demultiplexer of claim 43, wherein the multiplex layer data units conform to the H.223 multiplexing/demultiplexing protocol.

45. The demultiplexer of claim 34, wherein the physical layer data units include CDMA2000 1×

radio link protocol packet data units (RLP PDUs), CDMA2000 1×

EV-DO RLP PDUs, or CDMA2000 EV-DV RLP PDUs.

46. The demultiplexer of claim 34, wherein the multiplex layer data units conform to the RTP/UDP/IP multiplexing/demultiplexing protocol.

47. The demultiplexer of claim 34, wherein the physical layer data units include audio and video data, and the boundary generator embeds the boundary markers in the multiplex layer data units to indicate boundaries between video information in the physical layer data units.

48. A wireless communication device comprising:

a wireless receiver to receive physical layer data units via wireless communication, the physical layer data units containing video data;

a demultiplexing engine to generate multiplex layer data units based on the physical layer data units, and demultiplex the multiplex layer data units;

a boundary generator to embed a boundary marker in the multiplex layer data units to indicate a boundary between the physical layer data units; and

a video decoding engine to decode a video data frame containing the video data, and associate a detected decoding error with a segment of the video data frame using the boundary markers.

49. The device of claim 48, wherein the boundary marker identifies a start of a lost physical layer data unit.

50. The device of claim 48, wherein the boundary generator embeds a plurality of the boundary markers to identify boundaries between a plurality of the physical layer data units.

51. A video decoding system comprising:

means for generating multiplex layer data units containing video data based on physical layer data units;

means for embedding a boundary marker in the multiplex layer data units to indicate a boundary between the physical layer data units;

means for demultiplexing the multiplex layer data units to generate a video data frame; and

means for associating a detected decoding error with a segment of the video data frame using the boundary markers.

52. The system of claim 51, wherein the boundary marker identifies a start of a lost physical layer data unit.

53. The system of claim 51, wherein the embedding means includes means for embedding a plurality of the boundary markers to identify boundaries between a plurality of the physical layer data units.

54. The system of claim 51, wherein the video data frame includes macroblocks of video data, the system further comprising means for concealing macroblocks within the segment of the video data frame.

55. The system of claim 51, wherein the video data frame includes resynchronization markers, the system further comprising means for concealing macroblocks within the segment of the video data frame and macroblocks up to a next one of the resynchronization markers following the detected decoding error in the video data frame.

56. The system of claim 51, wherein the demultiplexing means demultiplexes the multiplex layer units according to the ITU H.223 or RTP/UDP/IP multiplexing/demultiplexing protocols.

57. The system of claim 51, wherein the video data frame includes macroblocks of video data conforming to the MPEG-4, ITU H.263, ITU H.264 or MPEG-2 protocols.

58. The system of claim 51, wherein the physical layer data units include W-CDMA radio link control packet data units (RLC PDUS), CDMA2000 1×

radio link protocol packet data units (RLP PDUs), CDMA2000 1×

EV-DO RLP PDUs, or CDMA2000 EV-DV RLP PDUs.

59. A computer-readable medium comprising instructions to cause one or more processors to:

generate multiplex layer data units containing video data based on physical layer data units;

embed a boundary marker in the multiplex layer data units to indicate a boundary between the physical layer data units;

demultiplex the multiplex layer data units to generate a video data frame; and

associate a detected decoding error with a segment of the video data frame using the boundary markers.

60. The computer-readable medium of claim 59, wherein the boundary marker identifies a start of a lost physical layer data unit.

61. The computer-readable medium of claim 59, further comprising instructions to cause the processor to embed a plurality of the boundary markers to identify boundaries between a plurality of the physical layer data units.

62. The computer-readable medium of claim 59, wherein the video data frame includes macroblocks of video data, further comprising instructions to cause the processor to conceal macroblocks within the segment of the video data frame.

63. The computer-readable medium of claim 59, wherein the video data frame includes resynchronization markers, further comprising instructions to cause the processor to conceal macroblocks within the segment of the video data frame and macroblocks up to a next one of the resynchronization markers following the detected decoding error in the video data frame.

64. The computer-readable medium of claim 59, wherein the instructions cause the processor to demultiplex the multiplex layer units according to the ITU H.223 or RTP/UDP/IP multiplexing/demultiplexing protocol.

65. The computer-readable medium of claim 59, wherein the video data frame includes macroblocks of video data conforming to the MPEG-4, ITU H.263, ITU H.264 or MPEG-2 protocols.

66. The computer-readable medium of claim 59, wherein the physical layer data units include W-CDMA radio link control packet data units (RLC PDUs), CDMA2000 1×

radio link protocol packet data units (RLP PDUs), CDMA2000 1×

EV-DO RLP PDUs, or CDMA2000 EV-DV RLP PDUs.