Systems and Methods for Syncronizing Multiple Electronic Devices

• US 20140323036A1
• Filed: 07/18/2013
• Published: 10/30/2014
• Est. Priority Date: 04/29/2013
• Status: Active Grant

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Motorola Mobility LLC (Lenovo Group Ltd.)
• Inventors: Daley, Michael J., Bolinger, Travis, O'Neal, Heath
• Granted Patent: US 9,307,508 B2
• Time in Patent Office: Days
• US Class Current: 455/3.06
• CPC Class Codes: H04H 20/08 among terminal devices
• CPC Class Codes: H04H 20/18 Arrangements for synchronising broadcast or distribution via plural systems
• CPC Class Codes: H04H 20/38 Arrangements for distribution where lower stations, e.g. receivers, interact with the broadcast
• CPC Class Codes: H04H 20/57 for mobile receivers
• CPC Class Codes: H04H 20/61 for local area broadcast, e.g. instore broadcast
• CPC Class Codes: H04H 20/63 to plural spots in a confined site, e.g. MATV [Master Antenna Television]
• CPC Class Codes: H04H 60/80 characterised by transmission among terminal devices
• CPC Class Codes: H04H 60/88 which are wireless networks
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/43 Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware real-time communication protocols in data switching networks H04L65/00
• CPC Class Codes: H04W 56/0015 one node acting as a reference for the others
• CPC Class Codes: H04W 56/0065 using measurement of signal travel time

Abstract

Embodiments are provided for syncing multiple electronic devices for collective audio playback. According to certain aspects, a master device connects (218) to a slave device via a wireless connection. The master device calculates (224) a network latency via a series of network latency pings with the slave device and sends (225) the network latency to the slave device. Further, the master devices sends (232) a portion of an audio file as well as a timing instruction including a system time to the slave device. The master device initiates (234) playback of the portion of the audio file and the slave devices initiates (236) playback of the portion of the audio file according to the timing instruction and a calculated system clock offset value.

Claims

1. An audio playback device comprising:

a communication component adapted to connect the audio playback device to a slave device via a wireless connection;

an audio output component adapted to output audio; and

a controller module configured to interface with the communication component and the audio output component, and further configured to;

send a request to the slave device including a first system time via the wireless connection,

receive a response from the slave device via the wireless connection at a second system time,

calculate a one-way network latency time value for the slave device based on the first system time and the second system time,

send the one-way network latency time value to the slave device for calculation of a system clock offset value,

establish an audio playback session with the slave device via the wireless connection, the audio playback session using a data socket of the slave device,

send, using the audio playback session, at least a portion of an audio file to the slave device and a playback timing instruction indicating a current system time, the audio file for playback on the slave device according to the playback timing instruction and the system clock offset value, and

initiate playback of the audio file from the audio output component.

2. The audio playback device of claim 1, wherein the response from the slave device indicates a successful connection.

3. The audio playback device of claim 1, wherein the wireless connection is one of a Wi-Fi Direct connection or a Wi-Fi connection.

4. The audio playback device of claim 1, further comprising:

a user interface adapted to receive input from a user,

wherein the controller module is further configured to;

detect user input, via the user interface, corresponding to a playback command for the audio file,

modify the playback of the audio file from the audio output component according to the playback command, and

send the playback command and command timing instructions to the slave device for modification of the playback of the audio file on the slave device according to the playback command, the command timing instructions, and the system clock offset value.

5. The audio playback device of claim 1, wherein the controller module is further configured to:

send an additional portion of the audio file to the slave device for playback on the slave device according to the system clock offset value.

6. The audio playback device of claim 1, wherein the controller module is further configured to:

send, to the slave device, a current elapsed time of the playback of the audio file from the audio output component,

receive, from the slave device, an indication that the playback on the slave device is out of sync, and

repeat the send a request, the receive a response, the calculate a one-way network latency time value, and the send a one-way network latency time value.

7. The audio playback device of claim 1, wherein the controller module is further configured to:

receive, from an additional slave device via the wireless connection, a request to join the audio playback session,

send an additional request to the additional slave device including a third system time via the wireless connection,

receive an additional response from the additional slave device via the wireless connection at a fourth system time,

calculate an additional one-way network latency time value for the additional slave device based on the third system time and the fourth system time,

send the additional one-way network latency time value to the additional slave device for calculation of an additional system clock offset value,

add the additional slave device to the audio playback session using an additional data socket of the additional slave device, and

send, using the audio playback session, an additional portion of the audio file and a current elapsed time of the playback of the audio file to the additional slave device for playback of the audio file on the additional slave device according to the current elapsed time and the additional system clock offset value.

8. The audio playback device of claim 1, further comprising:

a user interface adapted to receive input from a user,

wherein the controller module is further configured to;

annunciate, via the user interface, an audio latency time value for the audio playback device,

detect, via the user interface, an adjustment request to the audio latency time value, and

modify the playback timing instruction according to the adjustment request.

9. The audio playback device of claim 1, wherein the controller module is further configured to:

determine a computing audio latency time value reflecting an elapsed time for the audio file to propagate through the audio playback device from the controller module to the audio output component, and

modify the playback timing instruction based on the computing audio latency time value.

10. The audio playback device of claim 1, further comprising:

an audio input component adapted to detect audio,

wherein the controller module is further configured to;

send, using the audio playback session, a sync playback instruction to the slave device for playback of audio sync data on the slave device at a specified time,

initiate playback of the audio sync data from the audio output component at the specified time,

calculate, from audio detected by the audio input component, an audio latency time value reflecting a time difference in the playback of the audio sync data on the slave device and the playback of the audio sync data from the audio output component, and

modify the playback timing instruction based on the audio latency time value.

11. An audio playback device comprising:

a communication component adapted to connect the audio playback device to a master device via a wireless connection;

an audio output component adapted to output audio;

a data socket; and

a controller module configured to interface with the communication component and the audio output component, and further configured to;

receive a request from the master device including a first system time via the wireless connection,

send a response to the master device via the wireless connection,

receive a one-way network latency time value from the master device,

calculate a system clock offset value based on the one-way network latency time value, the first system time, and a slave system time,

join an audio playback session with the master device using the data socket via the wireless connection,

receive, using the audio playback session, at least a portion of an audio file and a playback timing instruction indicating a second system time, and

initiate playback of at least the portion of the audio file from the audio output component according to the playback timing instruction and the system clock offset value.

12. The audio playback device of claim 11, wherein the wireless connection is one of a Wi-Fi Direct connection or a Wi-Fi connection.

13. The audio playback device of claim 11, further comprising:

a user interface adapted to receive input from a user,

wherein the controller module is further configured to;

detect user input, via the user interface, corresponding to a playback command request for the audio file,

send the playback command request to the master device,

receive a playback command and command timing instructions from the master device, and

modify the playback from the audio output component according to the playback command, the command timing instructions, and the system clock offset value.

14. The audio playback device of claim 13, wherein the playback command request is to skip to a next audio track, wherein the controller module modifies the playback by:

receiving, using the audio playback session, at least a portion of another audio file and another playback timing instruction from the master device, and

initiating playback of at least the portion of the another audio file from the audio output component according to the another playback timing instruction and the system clock offset value.

15. The audio playback device of claim 11, further comprising:

a user interface adapted to receive input from a user,

wherein the controller module is further configured to;

detect a selection of another audio file via the user interface,

send a request to the master device via the wireless connection to switch roles,

receive, from the master device via the wireless connection, a notification that the audio playback device and the master device will switch roles.

16. The audio playback device of claim 11, wherein the controller module is further configured to:

receive, using the audio playback session, an additional portion of the audio file from the master device, and

initiate playback of the additional portion of the audio file from the audio output component according to the playback timing instruction and the system clock offset value.

17. The audio playback device of claim 11, wherein the controller module is further configured to:

receive, from the master device, a first elapsed time of playback of the audio file on the master device,

compare the first elapsed time of playback to a current second elapsed time of playback of the audio file from the audio output component,

determine that a difference between the first elapsed time of playback and the current second elapsed time of playback exceeds a threshold amount, the threshold amount based on at least a predetermined threshold and the playback timing instruction, and

send, to the master device, an indication that the playback from the audio output component is out of sync.

18. The audio playback device of claim 11, further comprising:

a user interface adapted to receive input from a user,

wherein the controller module is further configured to;

annunciate, via the user interface, a computing audio latency time value for the audio playback device,

detect, via the user interface, an adjustment request to the computing audio latency time value, and

adjust the playback of at least the portion of the audio file from the audio output component according to the adjustment request.

19. The audio playback device of claim 11, wherein the controller module is further configured to:

measure a computing audio latency time value reflecting an elapsed time for the audio file to propagate through the audio playback device from the controller module to the audio output component, and

adjust the playback of at least the portion of the audio file from the audio output component based on the computing audio latency time value.

20. The audio playback device of claim 11, further comprising:

an audio input component adapted to detect audio,

wherein the controller module is further configured to;

receive, using the audio playback session, a sync playback instruction from the master device for playback of audio sync data at a specified time, wherein the master device initiates playback of the audio sync data at the specified time,

initiate playback of the audio sync data from the audio output component at the specified time, and

calculate, from audio detected by the audio input component, an audio latency time value reflecting a time difference in the playback of the audio sync data on the master device and the playback of the audio sync data from the audio output component.