Audio and video buffer synchronization based on actual output feedback

• US 7,657,829 B2
• Filed: 01/20/2005
• Issued: 02/02/2010
• Est. Priority Date: 01/20/2005
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Chandley, Adrian, Panabaker, Ruston J. D.
• Primary Examiner(s): HUYNH, CONG LAC T
• Application Number:
  US11/040,546
• Publication Number:
  US 20060161835A1
• Time in Patent Office: 1,839 Days
• Field of Search: 715/500.1, 715/723, 715/808, 715/722, 715/202, 715/203
• US Class Current: 715/203
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: H04N 21/4135 external recorder interface circuits between an apparatus for recording television signals and a television receiver H04N5/775
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/4325 by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44231 Monitoring of peripheral device or external card, e.g. to detect processing problems in a handheld device or the failure of an external recording device configuring of peripheral devices in general G06F9/4411; reporting information sensed by appliance or service execution status of appliance services in a home automation network H04L12/2823; monitoring the status of connected device in data switched networks H04L43/0817
• CPC Class Codes: H04N 21/6332 directed to client
• CPC Class Codes: H04N 21/654 Transmission by server directed to the client

Abstract

A method and system for keeping endpoints such as speakers and displays synchronized via feedback based on the actual output of the endpoints. A source of audiovisual content transmits corresponding digital data to one or more endpoints, such as over a home network, where it may be buffered and/or decoded for playback. Microphones or the like sense actual (post-buffering/decoding) output from one or more endpoints and feed it back to a synchronization mechanism. The synchronization mechanism employs pattern matching or similar techniques to determine whether and how to adjust the timing of endpoints to synchronize their actual outputs. Synchronization may be accomplished by controllably delaying transmission and/or other processing, by controllably changing the rate of advancing in a buffer, and/or by jumping ahead in a buffer. The synchronization mechanism may adjust multiple endpoints, e.g., when limited buffer size limits the amount of adjustment a single device can provide.

Claims

1. In a system that includes a first device for transmitting audio signals to a remote endpoint, wherein the first device and the remote endpoint both buffer the audio signals before outputting the audio signals, a method for synchronizing the output of the audio signals between the first device and the remote endpoint, comprising:

the first device transmitting audio signals to the remote endpoint such that the remote endpoint buffers the audio signals in a buffer at the remote endpoint prior to outputting the signals, the first device also buffering the same audio signals in a buffer of the first device;

the first device and the remote endpoint outputting the audio signals; and

receiving input from a user at either the first device or the remote endpoint, the user input causing the first device or the remote endpoint to either jump ahead or back in its buffer, or speed up or slow down the rate of output of the audio signals in its buffer.

2. In a system that includes a first device for transmitting audio signals to a remote endpoint, wherein the first device and the remote endpoint both buffer the audio signals before outputting the audio signals, a method for synchronizing the output of the audio signals between the first device and the remote endpoint, comprising:

the first device encoding and transmitting audio signals to the remote endpoint such that the remote endpoint buffers the audio signals in a buffer at the remote endpoint prior to outputting the signals, the first device also buffering the same audio signals in a buffer of the first device;

the first device and the remote endpoint outputting the audio signals; and

receiving input from a user at the first device, the user input causing the first device to add data to the audio signals that are encoded and transmitted to the remote endpoint.

3. The method of claim 2, further comprising the user input causing the first device to remove data from the audio signals that are encoded and transmitted to the remote endpoint.

4. The method of claim 2, further comprising the user input causing the first device to temporarily pause the output of the audio signals at the first device.