LATE FRAME RECOVERY METHOD

• US 20090080415A1
• Filed: 12/02/2008
• Published: 03/26/2009
• Est. Priority Date: 12/09/1999
• Status: Active Grant

• Current Assignee: Avago Technologies International Sales Pte Limited (Broadcom, Inc.)
• Original Assignee: Wilfrid Leblanc
• Inventors: LeBlanc, Wilfrid
• Granted Patent: US 8,174,981 B2
• Time in Patent Office: Days
• US Class Current: 370/352
• CPC Class Codes: H04B 3/23 using a replica of transmitted signal in the time domain, e.g. echo cancellers
• CPC Class Codes: H04J 3/0632 Synchronisation of packets and cells, e.g. transmission of voice via a packet network, circuit emulation service [CES] queuing arrangements in packet switching elements H04L49/90; synchronising systems for the synchronous transmission of a pulse code modulated video signal with one or more other pulse code modulated signals H04N7/56
• CPC Class Codes: H04L 12/2801 Broadband local area networks
• CPC Class Codes: H04L 12/66 Arrangements for connecting between networks having differing types of switching systems, e.g. gateways
• CPC Class Codes: H04L 2001/0093 Point-to-multipoint
• CPC Class Codes: H04L 2012/5671 Support of voice
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/11 Identifying congestion
• CPC Class Codes: H04L 47/263 Rate modification at the source after receiving feedback
• CPC Class Codes: H04L 47/28 in relation to timing considerations
• CPC Class Codes: H04L 65/1026 at the edge
• CPC Class Codes: H04L 65/1036 at the edge
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/61 taking into account QoS or priority requirements
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 69/40 for recovering from a failure of a protocol instance or entity, e.g. service redundancy protocols, protocol state redundancy or protocol service redirection management of faults, events, alarms or notifications in data switching networks H04L41/06
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: H04M 2201/40 : using speech recognition speech recognition per se G10L15/00
• CPC Class Codes: H04M 2203/2027 : Live party detection
• CPC Class Codes: H04M 2203/2066 : Call type detection of indication, e.g. voice or fax, mobile of fixed, PSTN or IP
• CPC Class Codes: H04M 3/002 : Applications of echo suppressors or cancellers in telephonic connections in two-way loud-speaking telephone systems H04M9/08, echo suppressors or cancellers per se H04B3/20
• CPC Class Codes: H04M 3/22 : Arrangements for supervision, monitoring or testing
• CPC Class Codes: H04M 3/2209 : for lines also used for data transmission
• CPC Class Codes: H04M 3/2272 : Subscriber line supervision circuits, e.g. call detection circuits
• CPC Class Codes: H04M 7/006 : Networks other than PSTN/ISDN providing telephone service, e.g. Voice over Internet Protocol (VoIP) , including next generation networks with a packet-switched transport layer H04L65/00 takes precedence; aspects not specific to the type of network H04M3/00; special services in those networks H04M3/42
• CPC Class Codes: H04M 7/0069 : comprising a residential gateway, e.g. those which provide an adapter for POTS or ISDN terminals
• CPC Class Codes: H04M 7/0072 : Speech codec negotiation H04L65/1069 takes precedence
• CPC Class Codes: H04Q 1/45 : using multi-frequency signalling H04Q1/46 takes precedence

Abstract

Method of processing a transmitted encoded media data stream is received. If a data element arrives prior to, or at, a predetermined playout deadline, the data element is decoded, the media represented by the decoded data element is played, and the data element is provided to a decoder state machine to update a decoder state. If a data element arrives after the predetermined playout deadline, the data element is provided to the decoder state machine to update the decoder state. In one embodiment, if the specified data element fails to arrive by the playout deadline, a subsequently received data element is saved in memory. Then, if the specified data element arrives after the predetermined playout deadline, the specified data element and the saved, subsequently received, data element are provided to the decoder state machine to update the decoder state.

Claims

1. A method of processing communication signals, comprising

(a) receiving a transmitted encoded media data stream comprising a plurality of data elements, each data element representing a portion of a transmitted media session;

(b) if a data element arrives prior to, or at, a predetermined playout deadline, performing steps of;

(b)(i) decoding the data element; and

(b)(ii) providing the data element to a decoder state machine to update a decoder state; and

(c) if a data element arrives after the predetermined playout deadline, providing the data element to the decoder state machine to update the decoder state.

2. The method of claim 1 wherein if a data element arrives after the predetermined playout deadline, pursuant to step (c), the data element is not decoded.

3. The method of claim 1 wherein the media data stream is an encoded audio data stream comprising a plurality of audio data elements, each representing a portion of a transmitted audio session.

4. The method of claim 3 wherein the media data stream is an encoded voice data stream comprising a plurality of voice data elements, each representing a portion of a transmitted voice session.

5. The method of claim 1 wherein the media data stream is an encoded video data stream comprising a plurality of video data elements, each representing a portion of a transmitted video session.

6. The method of claim 1 wherein the playout deadline comprises an end of a predetermined interval that starts at an expected arrival time of the data element.

7. The method of claim 1 wherein the playout deadline comprises an end of a predetermined interval that starts when a previous data element in the data stream is received.

8. The method of claim 1 wherein decoding step (b)(i) comprises releasing the data element to a decoder that decodes the data element and wherein the playout deadline comprises an end of a predetermined interval that starts when a previous data element in the data stream is released to the decoder.

9. The method of claim 1 wherein the playout deadline comprises an end of a predetermined interval that starts when a first data element in the data stream is received.

10. The method of claim 1 wherein the data elements are packets of encoded data.

11. The method of claim 1 wherein the data elements are frames of encoded data.

17. The method of claim 1 wherein the data elements are cells of encoded data.

51. The method of claim 1, wherein step (b) further comprises, if a data element arrives prior to, or at, the playout deadline, providing the decoded data element to an output element for playout.

52. The method of claim 51, wherein if a data element arrives after the predetermined playout deadline, pursuant to step (c), the data element is not decoded and not provided to the output element for playout.

12-16. -16. (canceled)

18. A method of processing communication signals, comprising:

(a) receiving a transmitted encoded media data stream comprising a plurality of data elements, each data element representing a portion of a transmitted media session;

(b) if a specified data element arrives prior to, or at, a predetermined playout deadline, performing steps of;

(b)(i) decoding the data element; and

(b)(ii) providing the data element to a decoder state machine to update a decoder state; and

(c) if the specified data element fails to arrive prior to, or at, the playout deadline, performing steps of;

(c)(i) saving a subsequently received data element in memory; and

(c)(ii) if the specified data element arrives after the predetermined playout deadline, providing the specified data element and the saved, subsequently received, data element to the decoder state machine to update the decoder state.

19. The method of claim 18 wherein saving step (c)(i) comprises saving a plurality of subsequently received data elements in memory and wherein step (c)(ii) comprises:

if the specified data element arrives after the predetermined playout deadline, providing the specified data element and the saved, subsequently received, data elements to the decoder state machine to update the decoder state.

20. The method of claim 19 wherein saving step (c)(i) comprises saving all data elements that are received subsequent to the playout deadline but before the arrival of the specified data element and wherein step (c)(ii) comprises:

if the specified data element arrives after the predetermined playout deadline, providing the specified data element and the saved, subsequently received, data elements to the decoder state machine to update the decoder state.

21. The method of claim 18 wherein if the specified data element arrives after the predetermined playout deadline, pursuant to step (c)(ii), the specified data element is not decoded.

22. The method of claim 18 wherein the media data stream is an encoded audio data stream comprising a plurality of audio data elements, each representing a portion of a transmitted audio session.

23. The method of claim 22 wherein the media data stream is an encoded voice data stream comprising a plurality of voice data elements, each representing a portion of a transmitted voice session.

24. The method of claim 18 wherein the media data stream is an encoded video data stream comprising a plurality of video data elements, each representing a portion of a transmitted video session.

25. The method of claim 18 wherein the playout deadline comprises an end of a predetermined interval that starts at an expected arrival time of the specified data element.

26. The method of claim 18 wherein the playout deadline comprises an end of a predetermined interval that starts when a previous data element in the data stream is received.

27. The method of claim 18 wherein decoding step (b)(i) comprises releasing the data element to a decoder that decodes the data element and wherein the playout deadline comprises an end of a predetermined interval that starts when a previous data element in the data stream is released to the decoder.

28. The method of claim 18 wherein the playout deadline comprises an end of a predetermined interval that starts when a first data element in the data stream is received.

29. The method of claim 18 wherein the data elements are packets of encoded data.

30. The method of claim 18 wherein the data elements are frames of encoded data.

53. The method of claim 18, wherein step (b) further comprises, if the specified data element arrives prior to, or at, the playout deadline, providing the decoded data element to an output element for playout.

54. The method of claim 53, wherein if the specified data element arrives after the predetermined playout deadline, pursuant to step (c)(ii), the specified data element is not decoded and not provided to the output element for playout.

31-34. -34. (canceled)

35. A communication system for processing a transmitted encoded media data stream comprising a plurality of data elements, each data element representing a portion of a transmitted media session, the communication system comprising:

a jitter buffer operable to receive the data stream and to store each data element until a playout deadline for the data element is reached, at which time the data element is provided to a decoder and to a decoder state machine, wherein if the jitter buffer receives a late data element after the playout deadline, the late data element is provided to the decoder state machine;

a decoder operable to decode media data elements provided by the jitter buffer; and

a decoder state machine operable to maintain and update a decoder state based on data elements provided by the jitter buffer.

36. The communication system of claim 35 wherein if the jitter buffer receives a data element after the playout deadline, the data element is not decoded.

37. The communication system of claim 35 wherein the media data stream is an encoded audio data stream comprising a plurality of audio data elements, each representing a portion of a transmitted audio session.

38. The communication system of claim 35 wherein the media data stream is an encoded voice data stream comprising a plurality of voice data elements, each representing a portion of a transmitted voice session.

39. The communication system of claim 35 wherein the media data stream is an encoded video data stream comprising a plurality of video data elements, each representing a portion of a transmitted video session.

40. The communication system of claim 35 wherein the playout deadline for each data element comprises an end of a predetermined interval that starts at an expected arrival time of the data element.

41. The communication system of claim 35 wherein the playout deadline for each data element comprises an end of a predetermined interval that starts when a previous data element in the data stream is received by the jitter buffer.

42. The communication system of claim 35 wherein the playout deadline for each data element comprises an end of a predetermined interval that starts when the jitter buffer provides the previous data element in the data stream to the decoder.

43. The communication system of claim 35 wherein the playout deadline for each data element comprises an end of a predetermined interval that starts when the jitter buffer receives a first data element in the data stream.

44. The communication system of claim 35 wherein the data elements are packets of encoded data.

45. The communication system of claim 35 wherein the data elements are frames of encoded data.

55. The communication system of claim 35, further comprising an output element operable to receive decoded data elements from the decoder and to play the media represented by the decoded data elements.

56. The communication system of claim 55, wherein if the jitter buffer receives a data element after the playout deadline, the data element is not decoded and the media represented by the decoded data element is not played.

46-50. -50. (canceled)

57. A method of processing communication signals, comprising:

receiving a transmitted encoded media data stream comprising a plurality of data elements, each data element representing a portion of a transmitted media session;

if a late data element is not received by a specified deadline, generating an estimated media sample corresponding to the late data element;

updating a decoder state based on the estimated media sample; and

if the late data element is subsequently received after the specified deadline, updating the decoder state based on the late data element.

58. A receiver for processing transmitted media data, comprising:

a decoder operable to decode transmitted media data elements, the decoder being operable to store and update a state of the decoder; and

a late data element recovery engine, wherein if a late data element is not received by a specified deadline, the late data element recovery engine is operable to generate an estimated media sample corresponding to the late data element and the decoder is operable to update the decoder state based on the estimated media sample;

wherein if the late data element is subsequently received after the specified deadline, the decoder is operable to update the decoder state based on the late data element.