Latency differential mitigation for real time data streams

• US 9,742,820 B2
• Filed: 05/02/2016
• Issued: 08/22/2017
• Est. Priority Date: 09/29/2006
• Status: Active Grant

• Current Assignee: Avaya ECS Ltd. (Avaya Incorporated)
• Original Assignee: Avaya ECS Ltd. (Avaya Incorporated)
• Inventors: Hughes, Simon Derek, Douglas, Jim Patrick
• Primary Examiner(s): Taha, Shaq
• Assistant Examiner(s): KAVLESKI, RYAN C
• Application Number:
  US15/144,121
• Publication Number:
  US 20160248822A1
• Time in Patent Office: 477 Days
• Field of Search: 370236, 370252, 370291, 370508, 370516
• CPC Class Codes: H04L 43/0852 Delays
• CPC Class Codes: H04L 65/1083 In-session procedures
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/1104 Session initiation protocol [SIP]
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 65/80 Responding to QoS

Abstract

Techniques for mitigating effects of differing latencies associated with real time data streams in multimedia communication networks. For example, a technique for mitigating a latency differential between a first media path and a second media path, over which a first device and a second device are able to communicate, includes the following steps. A training phase is performed to determine a latency differential between the first media path and the second media path. Prior to the first device switching a media stream, being communicated to the second device, from the first media path to the second media path, the first device synchronizes the media stream based on the determined latency differential such that a latency associated with the switched media stream is made to be substantially consistent with a latency of the second media path.

Claims

1. A method for mitigating a latency differential between a first path and a second path over which a transmitting device and a receiving device communicate, comprising:

participating in a training phase, initiated by the transmitting device, to determine the latency differential between the first path and the second path, wherein the training phase commences upon receipt, by the receiving device, of a first packet over the second path and wherein the training phase terminates upon receipt, by the receiving device, of a first Silence Insertion Descriptor (SID) frame over the second path;

following termination of the training phase, switching, by the transmitting device, a media stream from the first path to the second path;

delaying, by the transmitting device, transmission of packets from the media stream along the second path by a time interval, wherein a magnitude of the time interval depends on the latency differential; and

preventing, by the transmitting device, an introduction of a media artifact when switching the media stream from the first path to the second path by the delaying of the transmission of the packets along the second path by the time interval.

2. The method of claim 1, wherein participating in a training phase comprises:

selecting, by the transmitting device, one or more data samples from the media stream being transmitted over the first path.

3. The method of claim 2, further comprising:

creating, by the transmitting device, a respective training sample corresponding to each of the one or more data samples; and

transmitting, by the transmitting device, each respective training sample to the receiving device over the second path.

4. The method of claim 3, further comprising:

receiving, by the receiving device, the transmitted training samples;

determining, by the receiving device, a match between each of the one of the one or more data samples transmitted over the first path and its corresponding respective training sample received over the second path.

5. The method of claim 4, further comprising:

computing, by the receiving device, a latency difference between at least one matching data sample and its corresponding respective training sample.

6. The method of claim 5, wherein the receiving device computes a latency differential measure based on an average of latency differences computed for two or more matching data samples and their corresponding respective training samples.

7. The method of claim 6, further comprising:

computing, by the receiving device, the latency differential measure for all matching data samples and their corresponding respective training samples; and

determining, by the receiving device, a statistical measure of variability of the latency differential measure.

8. The method of claim 1, wherein participating in a training phase comprises:

simultaneously sending, by the transmitting device, the media stream over the first path and the second path;

receiving, by the receiving device, a plurality of first data packets over the first path and a plurality of second data packets over the second path, wherein each of the first data packets corresponds to one of the second data packets; and

computing, by the receiving device, a latency difference between at least one first data packet and its corresponding second data packet.

9. A method for mitigating a latency differential between a first path and a second path over which a transmitting device and a receiving device communicate, the method comprising:

initiating, by the transmitting device, a training phase to determine the latency differential between the first path and the second path, wherein the training phase commences upon receipt, by the receiving device, of a first packet over the second path and wherein the training phase terminates upon receipt, by the receiving device, of a first Silence Insertion Descriptor (SID) frame over the second path;

after termination of the training phase and prior to switching a media stream from one of the first path and the second path to the other of the first path and the second path, synchronizing, by the transmitting device, the media stream based on the latency differential by delaying transmission of packets from the media stream by a time interval, wherein the magnitude of the time interval depends on the latency differential; and

preventing, by the transmitting device, an introduction of a media artifact when switching the media stream from the first path to the second path by the delaying of the transmission of the packets along the second path by the time interval.

10. A method for mitigating a latency differential between a first path and a second path over which a transmitting device and a receiving device communicate, comprising:

identifying, by the transmitting device, the latency differential between the first path and the second path;

switching, by the transmitting device, a media stream from the first path to the second path;

delaying, by the transmitting device, transmission of packets from the media stream along the second path by a time interval, wherein a magnitude of the time interval depends on the latency differential; and

synchronizing, by the transmitting device, the media stream based on the latency differential such that a latency associated with the media stream is made to be substantially consistent with a latency of the second path;

wherein synchronizing the media stream comprises;

identifying, by the transmitting device, one or more periods of silence in the media stream transmitted from the transmitting device to the receiving device; and

incrementally shortening, by the transmitting device, the time interval by which the transmission of the packets is delayed along the second path for each identified one or more periods of silence.

11. The method of claim 10, further comprising:

participating, by the receiving device, in a training phase initiated by the transmitting device, to determine the latency differential between the first path and the second path, wherein the training phase occurs prior to switching of the media stream.

12. The method of claim 11, wherein identifying the latency differential comprises:

receiving, by the transmitting device, from the receiving device, a value indicative of the determined latency differential.

13. The method of claim 10, further comprising:

initiating, by the transmitting device, a training phase to determine the latency differential between the first path and the second path, wherein the training phase occurs prior to switching of the media stream;

ending, by the transmitting device, the training phase;

detecting, by the transmitting device, a first period of silence in the media stream after the training phase is ended; and

triggering, by the transmitting device, switching of the media stream based on detecting the first period of silence.

14. The method of claim 10, wherein synchronizing the media stream further comprises:

concurrently transmitting, by the transmitting device, the media stream over the first data path and the second data path; and

detecting, by the transmitting device, when the time interval by which the transmission of the packets is delayed along the second path has been shortened to be substantially zero;

wherein switching the media stream is performed after the time interval has been shortened to be substantially zero.

15. The method of claim 10, wherein switching the media stream is performed prior to synchronizing the media stream.

16. The method of claim 10,

wherein each of the identified one or more periods of silence corresponds to a respective Silence Insertion Descriptor (SID) frame lasting for a frame period, and

wherein incrementally shortening the time interval comprises:

incrementally shortening the time interval by a period of time equal to the frame period.

17. The method of claim 16, wherein incrementally shortening the time interval by a period of time equal to the frame period comprises:

dropping, by the transmitting device, each Silence Insertion Descriptor (SID) frame.