System and method to assist synchronization of distributed play out of content

• US 10,284,887 B2
• Filed: 06/20/2013
• Issued: 05/07/2019
• Est. Priority Date: 06/20/2013
• Status: Active Grant

• Current Assignee: InterDigital Patent Holdings, Inc. (InterDigital, Inc.)
• Original Assignee: InterDigital Patent Holdings, Inc. (InterDigital, Inc.)
• Inventors: Francis, Scott, Redmann, William Gibbens
• Primary Examiner(s): Chokshi, Pinkal R
• Application Number:
  US14/896,755
• Publication Number:
  US 20160142749A1
• Time in Patent Office: 2,147 Days
• CPC Class Codes: H04H 20/18 Arrangements for synchronising broadcast or distribution via plural systems
• CPC Class Codes: H04N 21/233 Processing of audio elementary streams monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/4302 Content synchronisation processes, e.g. decoder synchronisation
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection

Abstract

A method for synchronizing content undergoing play out at first and second stations commences by comparing audio within content undergoing play out on the first station to the audio within content undergoing play out on the second station to determine if a latency exists between the first and second stations. If such a latency exists, then at least one of a pause or jump operations is performed in connection with content playing out by at least one of the first and second stations for an interval corresponding to an interval by which one station leads the other station to bring the two stations into substantial synchronism.

Claims

1. A method comprising:

extracting, at a first station, at least a plurality of first features from audio captured by a first microphone at the first station;

receiving, at the first station from a communication network, at least a plurality of second features of audio captured by a second microphone at a second station, the second features being extracted at the second station, each of the first features and the second features forming an identifiable representation of aspects of the corresponding captured audio;

storing the received plurality of second features in a buffer at the first station;

comparing the extracted plurality of first and second audio features to determine if a latency exists between the first and second stations, and if so, then

generating synchronization information to initiate at least one of a pause or jump operation in connection with content playing out by at least one of the first and second stations for an interval corresponding to an interval by which one station leads the other station to synchronize content undergoing play out at the first and second stations; and

purging the buffer once said content undergoing play out at the first and second stations is synchronized, said purging being a different event from an end of the content play out, and being performed in response to a reset message indicating the content play out being synchronized.

2. The method according to claim 1, wherein the comparing further comprises:

matching at least some of the plurality of the first plurality of first features with at least some of the plurality of the plurality of second features; and

determining from the matched first and second features which of the first and second stations leads the other.

3. The method according to claim 2, wherein the matching further comprises matching a first number of the first features with second number of the second features.

4. The method according to claim 1, wherein the at least one of the pause or jump operations is performed manually by an operator in response to a display of a message commanding the operator to perform such operation for the interval corresponding to an interval by which the one of the first and second stations leads the other station.

5. The method according to claim 1, wherein one of a pause or jump backwards operations is performed by a leading one of the first and second stations.

6. The method according to claim 1, wherein a lagging one of the first and second stations performs a jump forward.

7. The method according to claim 1, wherein both a leading one of the first and second stations performs one of a pause or jump backwards operations while a lagging one of the first and second stations performs a jump forward operation.

8. An apparatus at a first station, the apparatus comprising:

a first microphone, a network interface and a processor configured to;

extract at least a plurality of first features of audio captured by the first microphone from the content undergoing play out at the first station;

receive from the network interface at least a plurality of second features from audio captured by a second microphone from the content undergoing play out at a second station, wherein the second features are extracted at the second station, each of the first features and the second features forming an identifiable representation of aspects of the corresponding captured audio;

store the received plurality of second features in a buffer at the first station;

compare the extracted first and second plurality of audio features to determine if a latency exists between the first and second stations;

generate synchronization information to initiate at least one of a pause or jump operations in connection with content play out at one of the first and second stations leading station for an interval corresponding to an interval by which one station leads the other station to synchronize content undergoing play out at the first station with content undergoing play out at the second station; and

purge the buffer once said content undergoing play out at the first and second stations is synchronized, said purging being a different event from an end of the content play out, and being performed in response to a reset message indicating the content play out being synchronized.

9. The apparatus according to claim 8, wherein the processor is further configured to compare the extracted pluralities of first and second audio features by matching a first number of the first features with a second number of the second features.

10. The apparatus according to claim 8, wherein the synchronization information comprises a display message to an operator to signal the operator to manually perform one of the pause or jump operations is for the interval corresponding to an interval by which the one of the first and second stations leads the other station.

11. The apparatus according to claim 8, wherein the synchronization information comprises a command to a content player at the first station to perform one a pause or jump backward operations when first station leads the second station.

12. The apparatus according to claim 8, wherein the synchronization information comprises a command to a content player at the second station to perform a jump forward operation when first station leads the second station.

13. The apparatus according to claim 8, wherein the synchronization information comprises a first command to a content player at the first station to perform one a pause or jump backward operations when first station leads the second station and second command to a content player at the second station to perform a jump forward operations when first station leads the second station.