Adaptive jitter buffer for internet telephony

• US 6,862,298 B1
• Filed: 07/28/2000
• Issued: 03/01/2005
• Est. Priority Date: 07/28/2000
• Status: Expired due to Term

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: CrystalVoice Communications, Inc. (Alphabet Inc.)
• Inventors: Cromack, Mark R., Smith, Shawn W.
• Primary Examiner(s): Ngo, Ricky
• Assistant Examiner(s): MEW, KEVIN D
• Application Number:
  US09/627,956
• Time in Patent Office: 1,677 Days
• Field of Search: 370/412, 370/235, 370/236, 370/252, 370/253, 370/428, 370/429
• US Class Current: 370/516
• CPC Class Codes: H04J 3/0632 Synchronisation of packets and cells, e.g. transmission of voice via a packet network, circuit emulation service [CES] queuing arrangements in packet switching elements H04L49/90; synchronising systems for the synchronous transmission of a pulse code modulated video signal with one or more other pulse code modulated signals H04N7/56
• CPC Class Codes: H04L 1/205 jitter monitoring
• CPC Class Codes: H04L 43/087 Jitter
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/80 Responding to QoS

Abstract

In an improved system for receiving digital voice signals from a data network, a jitter buffer manager monitors packet arrival times, determines a time varying transit delay variation parameter and adaptively controls jitter buffer size in response to the variation parameter. A speed control module responds to a control signal from the jitter buffer manager by modifying the rate of data consumption from the jitter buffer, to compensate for changes in buffer size, preferably in a manner which maintains audio output with acceptable, natural human speech characteristics. Preferably, the manager also calculates average packet delay and controls the speed control module to adaptively align the jitter buffer'"'"'s center with the average packet delay time.

Claims

1. A system for receiving digital voice signals transmitted over a data network, comprising:

a jitter buffer, having a variable storage size, arranged to receive packets of data comprising the digital voice signals, to store said packets, and to serially output said packets;

a jitter buffer manager which (a) monitors the arrival of said packets, (b) determines at least one variation parameter which measures the variation in transit delay among said arriving packets, and (c) controls the jitter buffer size in response to the variation parameter; and

a speed control module, which responds to a control signal from said jitter buffer manager by modifying a rate of consumption of packets serially output from said jitter buffer, to compensate for changes in said jitter buffer'"'"'s storage size comprising

comparing an average packet delay with a reference delay corresponding to a temporally centered position in said buffer; and

adjusting said variable rate of transfer of packets from said buffer when said average packet delay deviates from said centered position by more than a threshold amount, thereby moving said centered position to align with said average packet delay.

2. The system of claim 1, wherein the at least one variation parameter comprises a measure of variance between (a) actual packet arrival times, for a predetermined number of packets, and (b) a synchronous, average packet arrival time;

and wherein said jitter buffer manager controls said jitter buffer storage size in relation to said measure of variance.

3. The system of claim 2 wherein said buffer size is controlled to a size determined to allow capture of a predetermined fraction of packets within a predetermined time window, based upon the calculated measure of variance;

and

wherein said predetermined fraction is less than or substantially equal to 1.

4. The system of claim 2 wherein said speed control module responds to a control signal from said jitter buffer manager by reducing the rate of data consumption when said jitter buffer size is increasing, while augmenting the data to maintain a predetermined rate of audio output.

5. The system of claim 4, wherein said data is augmented by selectively duplicating data corresponding to silent periods.

6. The system of claim 2, wherein said speed control module responds to a control signal from said jitter buffer manager by increasing the rate of data consumption when said jitter buffer size is decreasing, while selectively discarding data to maintain a predetermined rate of audio output.

7. The system of claim 6, wherein said jitter buffer manager selectively discards data corresponding to silent periods.

8. The system of claim 2 wherein said speed control module adjusts the rate of data consumption from said jitter buffer while maintaining audio output which substantially corresponds to natural human speech characteristics.

9. The system of claim 1 further comprising:

an audio decoder, arranged to receive packets from said speed control module, to convert said packets into audio output.

10. A method of receiving digitally encoded, packetized audio transmitted across a data network, comprising the steps of:

monitoring the arrival times of audio packets as they are received from the network;

loading said packets into a buffer having an adjustable size;

calculating an average packet delay relative to a synchronous serial output from said buffer,

calculating a time-varying variance parameter which quantifies deviations in packet delay from said average packet delay;

adjusting said size of said buffer in response to a calculated value of said time-varying variance parameter,

transferring said packets serially from said buffer at a variable rate to compensate for changes in size of said buffer,

comparing an average packet delay with a reference delay which corresponds to a temporally centered position in said buffer, and

adjusting said variable rate of transfer of packets from said buffer when said average packet delay deviates from said centered position by more than a threshold amount, thereby moving said centered position to align with said average packet delay.

11. The method of claim 10, comprising the further step of selectively modifying a decoded speech signal with a speed control module, to mask changes in said variable rate of transfer of said packets.

12. The method of claim 10, wherein said variance parameter is calculated as a sum of absolute values of deviations from a moving average of packet delay.

13. The method of claim 10, wherein said variance parameter is compared to a growth threshold, and said step of adjusting the size of said buffer comprises increasing said size when said variance parameter exceeds said growth threshold.

14. The method of claim 10, wherein said variance parameter is compared to a shrink threshold, and said step of adjusting the size of said buffer comprises decreasing said size when said variance parameter is less than said shrink threshold.

15. The method of claim 10, wherein said buffer size is adjusted to a size which will be statistically likely to accept a predetermined fraction of packets, based upon said calculated variance parameter, where said predetermined fraction is selected to produce a predetermined subjective audio quality in an audio signal decoded from said packets.