Method and system for precise synchronization of audio and video streams during a distributed communication session with multiple participants

• US 8,225,127 B2
• Filed: 04/14/2011
• Issued: 07/17/2012
• Est. Priority Date: 01/31/2007
• Status: Active Grant

• Current Assignee: Wickr Inc. (Amazon.com, Inc.)
• Original Assignee: Net Power & Light, Inc (Amazon.com, Inc.)
• Inventors: Vonog, Stanislav, Surin, Nikolay, Iskhodzhanov, Timur, Shtayura, Vadim
• Primary Examiner(s): Cao, Chun
• Assistant Examiner(s): NGUYEN, PHIL K
• Application Number:
  US13/087,167
• Publication Number:
  US 20110258474A1
• Time in Patent Office: 460 Days
• Field of Search: 713/400, 713/500, 704/221
• US Class Current: 713/400
• CPC Class Codes: G06F 1/14 Time supervision arrangements, e.g. real time clock
• CPC Class Codes: H04J 3/0632 Synchronisation of packets and cells, e.g. transmission of voice via a packet network, circuit emulation service [CES] queuing arrangements in packet switching elements H04L49/90; synchronising systems for the synchronous transmission of a pulse code modulated video signal with one or more other pulse code modulated signals H04N7/56
• CPC Class Codes: H04N 5/0736 using digital storage buffer techniques
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

Described are the architecture of such a system, algorithms for time synchronization during a multiway conferencing session, methods to fight with network imperfections such as jitter to improve synchronization, methods of introducing buffering delays to create handicaps for players with faster connections, methods which help players with synchronization (such as a synchronized metronome during a music conferencing session), methods for synchronized recording and live delivery of synchronized data to the audience watching the distributed interaction live over the Internet.

Claims

1. A computer implemented method for a selection of a time shift interval for smooth splicing wave fragment, the method for use in filling a gap in an audio signal, the method comprising:

minimizing a value calculated by a function

2. The method of claim 1, wherein the weight function P is a function

3. A computer system operating as a component in a multi-way audio conferencing system audio pipeline architecture, the computer system including:

an audio buffer instantiated on the computer system, the audio buffer providing an audio signal;

a playout buffer module instantiated on the computer system, the playout buffer module operable to address gaps in the audio signal by execution of a signal smoothing action including;

for a selection of a time shift interval for smooth splicing a wave fragment, minimizing a value calculated by a function

4. The computer system of claim 3, wherein the weight function P is a function

5. A computer system for determining a selection of a time shift interval for smooth splicing wave fragment, the determination for use in filling a gap in an audio signal, the computer system comprising:

means for minimizing a value calculated by a function