Reduced system latency for dominant speaker

• US 9,426,087 B2
• Filed: 06/20/2013
• Issued: 08/23/2016
• Est. Priority Date: 06/28/2012
• Status: Active Grant

• Current Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Original Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Inventors: Zealey, James, Costa, Brendon, Dickins, Glenn N.
• Primary Examiner(s): Ramakrishnaiah, Melur
• Application Number:
  US14/406,800
• Publication Number:
  US 20150172202A1
• Time in Patent Office: 1,160 Days
• Field of Search: 348 1401- 1416, 379/202.01
• US Class Current: 1/1
• CPC Class Codes: H04L 47/6275 based on priority
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

Digital media communication systems and methods are disclosed in which a set of end points and/or clients are in communication with a set of servers. The system is capable of determining which end point is a dominant user and/or speaker. When the system determines that an end point is dominant, then the digital data that emanates from dominant end point is preferred. Such preferred digital data may be forwarded asynchronously and possible ahead of digital data from other, non-dominant end points. Synchronous and/or substantially contemporaneous digital data from other end points may be mixed that such that, when rendered, gives substantially the same effect real life superposition of signals. The system may also toggle on or off between states of asynchronous forward and synchronous-only modes.

Claims

1. A method for reducing latency within a digital media system, said system further comprising a set of servers, at least one of said servers further comprising a buffer and said servers receiving digital data from a set of end points, the steps of said method comprising:

determining at least one end point as dominant;

indicating said digital data from said dominant end point is preferred;

mixing synchronous digital data from end points not determined as dominant;

putting the synchronous digital data in a queue; and

forwarding said preferred digital data from said dominant end point asynchronously, said forwarding comprising forwarding said preferred digital data from said dominant end point outside of the queue.

2. The method of claim 1 wherein said step of determining at least one endpoint as dominant further comprises the step of:

sampling digital data from said set of end points; and

determining at least one dominant end point depending upon the satisfaction of a condition and further comprises the step of satisfying one of a condition, said condition being one of a group, said group comprising;

a condition of energy, a condition of frequency, a condition set by a voice activity detector and a condition set by a signal activity detector.

3. The method of claim 1 wherein the step of mixing synchronous digital data from end points not determined as dominant further comprises the step of:

mixing packets from different end points that are substantially contemporaneous.

4. The method of claim 3 wherein the step of mixing packets from different end points that are substantially contemporaneous further comprises the step of:

mixing packets from different end points that are renderable as a superposition of audio signals.

5. The method of claim 1 wherein said step of forwarding preferred digital data from said dominant end point asynchronously further comprises the step of:

forwarding preferred digital data from said dominant end points in a least hop scheme.

6. The method of claim 5 wherein said forwarding preferred digital data from said dominant end points in a least hop scheme further comprises:

modifying said least hop scheme depending on network congestion.

7. The method of claim 1 wherein said method further comprises the step of:

toggling the step of forwarding preferred digital data from said dominant end point asynchronously, wherein said step of toggling the step of forwarding preferred digital data from said dominant end point asynchronously further comprises;

continuing mixing synchronous digital data when said step of forwarding preferred digital data is toggled off.

8. The method of claim 1 wherein said step of forwarding preferred digital data from said dominant end points ahead of queued packets further comprises the step of:

sending a flag to indicated that the digital data is preferred.

9. The method of claim 8 wherein said step of sending a flag to indicate that the digital data is preferred further comprises the step of:

sending the flag via a signaling path between one of a group, said group comprising;

a set of servers and a set of servers and clients.

10. The method of claim 8 wherein said step of sending a flag to indicate that the digital data is preferred further comprises the step of:

sending the flag via a set of dedicated bits within digital data packets, wherein said step of sending a flag to indicate that the digital data is preferred further comprises the step of;

sending information regarding the jitter characteristics on the network link via a set of dedicated bits within digital data packets.

11. The method of claim 10 wherein said step of sending information regarding the jitter characteristics on the network link via a set of dedicated bits within digital data packets further comprises the step of:

indicating the number of blocks in the server jitter buffer.

12. The method of claim 10 wherein said step of sending information regarding the jitter characteristics on the network link via a set of dedicated bits within digital data packets further comprises the step of:

indicating the timing advance expected on the stream.

13. The method of claim 1 wherein said step of forwarding preferred digital data from said dominant end points ahead of queued packets further comprises the step of:

sending repeat packets for a desired period of time around the time of a transition between asynchronous forwarding and synchronous-only processing.

14. A system for providing digital data communication, said system comprising:

a set of servers, at least one said server comprising a jitter buffer and said servers in communication with each other according to a desired topology, wherein said set of servers is in communication with a set of end points, and each said end points in communication with at least one said server and said end points inputting digital data into said system;

a controller, said controller capable of determining which end point is preferred;

wherein at least one of said servers capable of mixing synchronous digital data from end points not determined as preferred; and

wherein further at least one of said servers capable of putting the synchronous digital data in a queue; and

wherein further at least one of said servers is capable of forwarding preferred digital data from said preferred end point outside of the queue.

15. The system of claim 14 wherein said controller is capable of toggling the step of forwarding preferred digital data from said dominant end point asynchronously, wherein said controller is capable of continuing mixing synchronous digital data when said step of forwarding preferred digital data is toggled off.

16. The system of claim 14 wherein said controller is capable of sending a flag to indicate the digital data is preferred, wherein said controller is capable of sending repeat packets for a desired period of time around the time repeat packets for a desired period of time around the time of a transition between asynchronous forwarding and synchronous-only processing.

17. A method for reducing latency within a digital media system, said system further comprising a set of servers, at least one of said servers further comprising a buffer and said servers receiving digital data from a set of end points, the steps of said method comprising:

determining at least one receiving endpoint as having a preferred path from a source endpoint;

indicating said digital data from said source end point is to be conveyed to said receiving endpoint as preferred;

mixing synchronous digital data from end points not determined as preferred;

putting the synchronous digital data in a queue; and

forwarding preferred digital data from said preferred source end point to said receiving end point asynchronously, said forwarding comprising forwarding preferred digital data from said dominant end point outside of the queue.

18. The method of claim 17 wherein said step of forwarding preferred digital data from said preferred source end point to said receiving end point asynchronously further comprises setting preferred forwarding paths to reduce latency between said preferred end point and at least one non-preferred end point where the cost of contention is substantially high.