Error filter to differentiate between reverse link and forward link video data errors

• US 8,767,839 B2
• Filed: 01/22/2007
• Issued: 07/01/2014
• Est. Priority Date: 01/22/2007
• Status: Expired due to Fees

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Lee, Yen-Chi, Leung, Nikolai Konrad Nepomuceno
• Primary Examiner(s): Arani, Taghi
• Assistant Examiner(s): CHANG, KENNETH W
• Application Number:
  US11/625,787
• Publication Number:
  US 20080176517A1
• Time in Patent Office: 2,717 Days
• Field of Search: 375/240
• US Class Current: 375/240.27
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/166 concerning the amount of transmission errors, e.g. bit error rate [BER]
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/895 in combination with error concealment
• CPC Class Codes: H04N 21/6131 involving transmission via a mobile phone network wireless downlink channel access H04W74/006
• CPC Class Codes: H04N 21/6181 involving transmission via a mobile phone network arrangements for providing broadcast or conference services to substation in data switching networks in combination with wireless systems H04L12/189; wireless uplink channel access H04W74/004
• CPC Class Codes: H04N 21/6473 Monitoring network processes errors for recovering from a failure of a protocol instance or entity H04L69/40
• CPC Class Codes: H04N 21/64776 for requesting retransmission, e.g. of data packets lost or corrupted during transmission from server ARQ protocols H04L1/18; implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP] H04L69/16

Abstract

One technique for implementing error control in response to a video data error comprises receiving an indication of a video data error from a video decoder, determining whether the video data error occurred on a reverse link of a wireless network between a video encoder and a network device, and applying error control in response to the video data error if the video data error did not occur on the reverse link. For example, the indication of the video data error may include a first sequence number (SN) of a packet comprising lost data, and determining whether the video data error occurred on the reverse link may include comparing first SN with a second SN of a packet associated with a most recent RL error.

Claims

1. A method comprising:

storing information for a video data error prior to receiving an indication of the video data error from a video decoder, said video data error occurring on a reverse link of a wireless network between a video encoder and a network device, the network device separated from and coupled between the video decoder and the video encoder;

receiving the indication of the video data error detected by the video decoder;

determining whether the indicated video data error occurred on the reverse link of the wireless network between the video encoder and the network device based on the stored information; and

applying error control in response to the received indication of the video data error if the indicated video data error did not occur on the reverse link and not applying error control in response to the received indication of the video data error if the indicated video data error occurred on the reverse link.

2. The method of claim 1, further comprising applying error control in response to the video data error prior to receiving the indication of the video data error from the video decoder.

3. The method of claim 1, wherein the video data error is a first video data error, and the method further comprises storing information relating to a second video data error that occurred on the reverse link of the wireless network prior to receiving the indication of the video data error from the video decoder, and wherein determining whether the first video data error occurred on the reverse link is based on the stored information.

4. The method of claim 3, further comprising applying error control in response to the second video data error.

5. The method of claim 3, wherein the indication of the first video data error includes a first sequence number of a first packet associated with the first video data error, and the information comprises a second sequence number of a second packet associated with the second video data error, and determining whether the first video data error occurred on the reverse link comprises comparing the first and second sequence numbers.

6. The method of claim 5, wherein the first packet comprises the first video data error.

7. The method of claim 5, wherein the second packet is a last packet of an encoded frame of video data, wherein the second video data error occurred within the encoded frame.

8. The method of claim 5, wherein the second packet comprises the second video data error.

9. The method of claim 3, wherein storing the information relating to the second video data error comprises:

assigning a sequence number to a last packet of an encoded frame of video data;

transmitting the encoded frame across the wireless network;

determining whether transmission of the encoded frame across the reverse link of the wireless network resulted in the second video data error; and

storing the sequence number if the transmission of the encoded frame across the reverse link of the wireless network resulted in the second video data error.

10. The method of claim 9, wherein determining whether transmission of the encoded frame resulted in the second video data error comprises checking whether a flag is set in a radio link protocol module.

11. The method of claim 1, wherein applying error control in response to the video data error if the video data error did not occur on the reverse link comprises selecting an error control technique based on an available bandwidth of the wireless network.

12. The method of claim 1, further comprising:

encoding a frame of video data to generate an encoded frame;

generating a packet with at least a portion of the encoded frame; and

transmitting the packet across the wireless network to the video decoder, wherein the video data error occurred within the encoded frame.

13. The method of claim 12, wherein before encoding a subsequent frame of video data, the method comprises determining whether transmitting the packet across the reverse link of the wireless network resulted in the video data error.

14. The method of claim 13, wherein determining whether transmitting the packet across the reverse link of the wireless network resulted in the video data error comprises:

determining whether a medium access control (MAC) layer received a negative acknowledgement (NAK) from the wireless network; and

determining whether the received NAK is associated with the packet.

15. The method of claim 14, wherein determining whether the MAC layer received the NAK from the wireless network comprises checking whether a flag is set in a radio link protocol (RLP) module.

16. The method of claim 1, wherein the error control comprises at least one of encoding a frame of video data as an intra-frame, increasing a percentage of intra-coded macroblocks or using a first encoded frame of video data that was encoded before a second frame of video data comprising the video data error as a reference for motion estimation.

17. A system comprising:

a video encoder;

an error filter configured to store information for a video data error prior to receiving an indication of the video data error from a video decoder, said video data error occurring on a reverse link of a wireless network between the video encoder and a network device, the network device separated from and coupled between the video decoder and the video encoder;

a transceiver to receive the indication of the video data error detected by the video decoder,

wherein the error filter is configured to determine whether the indicated video data error occurred on the reverse link of the wireless network between the video encoder and the network device based on the stored information, and,

wherein the video encoder is configured to apply error control in response to the received indication of the video data error if the indicated video data error did not occur on the reverse link.

18. The system of claim 17, wherein the video encoder is configured to encode a frame of video data and the system further comprises a module to generate a packet with at least a portion of the encoded frame, the transceiver being configured to transmit the packet across a wireless network to the video decoder and the information comprises a sequence number of a last packet of the encoded frame.

19. The system of claim 17, wherein the video data error is a first video data error, and the error filter is configured to store information relating to a second video data error that occurred on the reverse link of the wireless network and determine whether the first video data error occurred on the reverse link based on the stored information.

20. The system of claim 17, wherein the video encoder is configured to encode a frame of video data and the system further comprises a module to generate a packet with at least a portion of the encoded frame, the transceiver being configured to transmit the packet across a wireless network to the video decoder and the information comprising a sequence number of a last packet of the encoded frame if the transmission of the encoded video frame across the wireless network resulted in the second video data error.

21. The system of claim 20, the system further comprising a radio link protocol (RLP) module and a medium access control (MAC) layer, wherein the RLP module is configured to determine whether the MAC layer received a negative acknowledgement (NAK) from the network device and determine whether the NAK is associated with the packet in order to determine whether the second video data error occurred when the packet was transmitted across the wireless network.

22. The system of claim 17, wherein the packet is a first packet, and the indication of the video data error comprises a sequence number of a second packet including lost data.

23. The system of claim 22, wherein the video data error is a first video data error and the sequence number is a first sequence number, the error filter comprising:

a first module to receive the first sequence number from the transceiver; and

a second module to receive a second sequence number identifying a last packet of a most recently encoded frame of video data comprising a second video data error that occurred on the reverse link,

wherein the error filter is configured to compare the first and second sequence numbers to determine whether the first video data error occurred on the reverse link.

24. The system of claim 23, the system further comprising a real-time transport protocol (RTP) layer to assign the second sequence number to the last packet and provide the second sequence number to the second module, wherein the second module determines whether the second video data error occurred by checking whether a flag is set in a radio link protocol module.

25. The system of claim 22, wherein the video encoder is configured to encode a frame of video data and the system further comprises a module to generate a packet with at least a portion of the encoded frame, the transceiver being configured to transmit the packet across a wireless network to the video decoder, wherein the video data error is a first video data error and the sequence number is a first sequence number, and the error filter comprises:

a first module to receive the first sequence number from the transceiver; and

a second module to receive a second sequence number identifying the packet of the frame of video data if transmission of the packet across the reverse link of the wireless network resulted in a second video data error,

wherein the error filter is configured to compare the first and second sequence numbers to determine whether the first video data error occurred on the reverse link.

26. The system of claim 22, wherein the video data error is a first video data error, the packet is a first packet, and the sequence number is a first sequence number, the error filter comprising:

a first module to receive the first sequence number from the transceiver; and

a second module to receive a second sequence number identifying a second packet comprising a second video data error that occurred on the reverse link,

wherein the error filter is configured to compare the first and second sequence numbers to determine whether the first video data error occurred on the reverse link.

27. The system of claim 17, further comprising:

a first module to monitor a condition of the wireless network; and

a second module to select an error control technique applied by the video encoder based on the condition of the wireless network.

28. The system of claim 17, wherein the error control comprises at least one of encoding a frame of video data as an intra-frame, increasing a percentage of intra-coded macroblocks or using a first frame of video data that was encoded before a second frame of video data comprising the video data error as a reference for motion estimation.

29. A computer program product comprising:

a non-transitory computer-readable medium comprising;

instructions to cause a computer to store information for a video data error prior to receiving an indication of the video data error from a video decoder, said video data error occurring on a reverse link of a wireless network between a video encoder and a network device, the network device separated from and coupled between the video decoder and the video encoder;

instructions to cause a computer to receive the indication of the video data error detected by the video decoder;

instructions to cause a computer to determine whether the indicate video data error occurred on the reverse link of the wireless network between the video encoder and the network device based on the stored information; and

instructions to cause a computer to apply error control in response to the received indication of the video data error if the indicated video data error did not occur on the reverse link and not apply error control in response to the received indication of the video data error if the indicated video data error occurred on the reverse link.

30. The computer program product of claim 29, the computer-readable medium further comprising instructions to cause a computer to monitor a condition of the wireless network and select the error control based on the condition of the wireless network.

31. A system comprising:

means for storing information for a video data error prior to receiving an indication of the video data error from a video decoder, said video data error occurring on a reverse link of a wireless network between a video encoder and a network device, the network device separated from and coupled between the video decoder and the video encoder;

means for receiving the indication of the video data error detected by the video decoder;

said means for storing further capable of determining whether the video data error occurred on the reverse link of the wireless network between the video encoder and the network device based on the stored information; and

means for applying error control in response to the indicated video data error if the indicated video data error did not occur on the reverse link and not applying error control in response to the indicated video data error if the indicated video data error occurred on the reverse link.