System and method for low-latency content-sensitive forward error correction

• US 20060029065A1
• Filed: 07/19/2005
• Published: 02/09/2006
• Est. Priority Date: 07/07/2004
• Status: Active Grant

• Current Assignee: Qvidium Technologies, Inc.
• Original Assignee: Qvidium Technologies, Inc.
• Inventors: Fellman, Ronald D.
• Granted Patent: US 7,539,187 B2
• Time in Patent Office: Days
• US Class Current: 370/389
• CPC Class Codes: H04L 1/004 by using forward error control H04L1/0618 takes precedence; coding, decoding or code conversion, for error detection or correction H03M13/00
• CPC Class Codes: H04L 1/0057 Block codes H04L1/0061, H04L1/0064 take precedence
• CPC Class Codes: H04L 1/0071 Use of interleaving interleaving per se H03M13/27
• CPC Class Codes: H04L 1/0072 Error control for data other than payload data, e.g. control data
• CPC Class Codes: H04L 1/0083 Formatting with frames or packets; Protocol or part of protocol for error control
• CPC Class Codes: H04L 2001/0098 Unequal error protection
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/2416 Real-time traffic
• CPC Class Codes: H04L 47/283 in response to processing delays, e.g. caused by jitter or round trip time [RTT]
• CPC Class Codes: H04L 47/38 by adapting coding or compression rate

Abstract

A forward error correction (FEC) encoding system and method optimized for protecting real-time audio-video streams for transmission over packet-switched networks with minimal latency. Embodiments of this invention provide bandwidth-efficient and low-latency FEC for both variable and constant bit-rate MPEG-encoded audio and video streams. To maximize bandwidth-efficiency and playable frame rate for recovered media streams, embodiments of the invention may sort packets by content type and aggregate them into FEC blocks weighted by sensitivity in the recovered stream to packet loss of a particular content type. Embodiments of this invention may use temporal constraints to limit FEC block size and thereby facilitate their use in the transport of VBR streams.

Claims

1. A system for low-latency content-sensitive forward error correction comprising:

a network;

a first node selected from a group of nodes wherein said first node is coupled with said network and wherein said first node comprises;

at least one packetizer;

a checksum generator;

a forward error correction module coupled with said checksum generator;

a time clock to time stamp a first packet and a second packet wherein said time clock is coupled with said checksum generator;

a packet multiplexer timestamper module coupled with said at least one packetizer and further coupled with said time clock and further coupled with said checksum generator and further coupled with said forward error correction module;

said packet multiplexer timestamper module configured to filter packets based on a first packet type for processing by said forward error correction module and wherein said packet multiplexer timestamper is configured to transmit checksum packets based on a time obtained from said time clock;

a plurality of second nodes selected from said group of nodes wherein said plurality of second nodes are coupled with said network and wherein said plurality of second nodes comprises;

a receiver timestamper;

a receiver time clock coupled with said receiver timestamper;

a forward error correction processing and recovery module coupled with said timestamper comprising a packet filter coupled with at least one packet queue and at least one checksum queue wherein said forward error correction processing and recovery module further comprises a forward error correction engine coupled with said at least one packet queue and said at least one checksum queue;

said forward error correction engine configured to output received packets in correct order with minimal latency; and

,

said first node configured to transmit to said plurality of said second nodes.

2. The system of claim 1 further comprising an audio packetizer selected from said at least one packetizer and a video packetizer selected from said at least one packetizer.

3. The system of claim 1 wherein said first packet comprises video data and said second packet comprises audio data.

4. The system of claim 1 wherein said checksum generator comprises a Galois Field forward error corrector.

5. The system of claim 1 wherein said checksum generator comprises a parity forward error corrector.

6. The system of claim 1 wherein said checksum generator is configured to produce a percentage of checksum packets based on a packet type associated with said first packet.

7. The system of claim 1 wherein said first node comprises a network enabled computing device.

8. The system of claim 7 wherein said network enabled computing device comprises a video conference server.

9. The system of claim 7 wherein said network enabled computing device comprises a real-time video streaming server.

10. The system of claim 7 wherein said network enabled computing device comprises a live video streaming server.

11. The system of claim 7 wherein said network enabled computing device comprises a laptop, a personal computer, a personal digital assistant or a cell phone.

12. A method for low-latency content-sensitive forward error correction comprising:

packetizing data into a first packet in a first node selected from a group of nodes wherein said first node is coupled with a network;

packetizing data into a second packet in said first node;

time stamping said first packet in said first node;

time stamping said second packet in said first node;

generating a checksum packet based on said first packet and said second packet based on a packet type of said first packet and said second packet;

transmitting said first packet and said second packet and said checksum packet over said network;

providing software to a plurality of second nodes selected from said group of nodes wherein said plurality of second nodes are coupled with said network and wherein said plurality of second nodes are configured to forward error correct data sent from said first node wherein said software comprises the steps of;

filtering a first received packet and a second received packet into a packet queue and a checksum queue based on a packet type associated with said first received packet and a second packet type associated with said second received packet;

reconstructing a missing packet and placing said missing packet in correct time order in said packet queue; and

,

outputting said first received packet, said second received packet and said missing packet in a corrected order with minimal latency.

13. The method of claim 12 wherein said packetizing data into said first packet comprises packetizing video data.

14. The method of claim 12 wherein said packetizing data into said second packet comprises packetizing audio data.

15. The method of claim 12 wherein said packetizing data into said first packet and packetizing data into said second packet comprises packetizing data into a single queue comprising audio and video data.

16. The method of claim 12 further comprising holding said first packet, said second packet and said checksum packet for predetermined output packet release times.

17. The method of claim 12 wherein said generating said checksum packet occurs as a percentage of transmitted packets based on a packet type associated with said first packet.

18. The method of claim 12 wherein said generating said checksum packet occurs based on a time threshold to minimize latency.

19. A system for low-latency content-sensitive forward error correction comprising:

means for packetizing data into a first packet in a first node selected from a group of nodes wherein

said first node is coupled with a network;

means for packetizing data into a second packet in said first node;

means for time stamping said first packet in said first node;

means for time stamping said second packet in said first node;

means for generating a checksum packet based on said first packet and said second packet;

means for transmitting said first packet and said second packet and said checksum packet over said network;

means for providing software to a plurality of second nodes selected from said group of nodes wherein said plurality of second nodes are coupled with said network and wherein said plurality of second nodes are configured to forward error correct data sent from said first node wherein said software comprises the steps of;

means for filtering a first received packet and a second received packet into a packet queue and a checksum queue based on a packet type associated with said first received packet and a second packet type associated with said second received packet;

means for reconstructing a missing packet and placing said missing packet in correct time order in said packet queue; and

,

means for outputting said first received packet, said second received packet and said missing packet in a corrected order with minimal latency.

20. The system of claim 19 wherein said means for generating said checksum packet utilizes a time clock for limiting the number of packets utilized in constructing a checksum packet to minimize latency.