SYSTEMS AND METHODS FOR SYNCRONIZING MULTIPLE ELECTRONIC DEVICES

• US 20160174180A1
• Filed: 02/24/2016
• Published: 06/16/2016
• Est. Priority Date: 04/29/2013
• Status: Active Grant

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Inventors: Bolinger, Travis, O'Neal, Heath, Daley, Michael J.
• Granted Patent: US 9,769,778 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04H 20/08 among terminal devices
• CPC Class Codes: H04H 20/18 Arrangements for synchronising broadcast or distribution via plural systems
• CPC Class Codes: H04H 20/38 Arrangements for distribution where lower stations, e.g. receivers, interact with the broadcast
• CPC Class Codes: H04H 20/57 for mobile receivers
• CPC Class Codes: H04H 20/61 for local area broadcast, e.g. instore broadcast
• CPC Class Codes: H04H 20/63 to plural spots in a confined site, e.g. MATV [Master Antenna Television]
• CPC Class Codes: H04H 60/80 characterised by transmission among terminal devices
• CPC Class Codes: H04H 60/88 which are wireless networks
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/43 Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware real-time communication protocols in data switching networks H04L65/00
• CPC Class Codes: H04W 56/0015 one node acting as a reference for the others
• CPC Class Codes: H04W 56/0065 using measurement of signal travel time

Abstract

Embodiments are provided for syncing multiple electronic devices for collective audio playback. According to certain aspects, a master device connects (218) to a slave device via a wireless connection. The master device calculates (224) a network latency via a series of network latency pings with the slave device and sends (225) the network latency to the slave device. Further, the master devices sends (232) a portion of an audio file as well as a timing instruction including a system time to the slave device. The master device initiates (234) playback of the portion of the audio file and the slave devices initiates (236) playback of the portion of the audio file according to the timing instruction and a calculated system clock offset value.

Claims

1. An audio playback device comprising:

a communication component adapted to connect the audio playback device to a slave device via a wireless connection;

an audio output component adapted to output audio; and

a controller module configured to interface with the communication component and the audio output component, and further configured to;

send, via the wireless connection at a first system time of the audio playback device, a network latency request to the slave device, the network latency request including the first system time of the audio playback device,

receive, via the wireless connection at a second system time of the audio playback device, a response to the network latency request from the slave device,

calculate a one-way network latency time value for the slave device based at least in part on a difference between the first system time and the second system time,

send the one-way network latency time value to the slave device for calculation of a system clock offset value,

establish an audio playback session with the slave device via the wireless connection, the audio playback session using a data socket of the slave device,

send, using the audio playback session, at least a portion of an audio file to the slave device and a playback timing instruction indicating a current system time of the audio playback device, the audio file for playback on the slave device according to the playback timing instruction and the system clock offset value, and

initiate playback of the audio file from the audio output component.

2. The audio playback device of claim 1, wherein the response from the slave device indicates a successful connection.

3. The audio playback device of claim 1, wherein the wireless connection is one of a Wi-Fi Direct connection or a Wi-Fi connection.

4. The audio playback device of claim 1, further comprising:

a user interface adapted to receive input from a user,

wherein the controller module is further configured to;

detect user input, via the user interface, corresponding to a playback command for the audio file,

modify the playback of the audio file from the audio output component according to the playback command, and

send the playback command and command timing instructions to the slave device for modification of the playback of the audio file on the slave device according to the playback command, the command timing instructions, and the system clock offset value.

5. The audio playback device of claim 1, wherein the controller module is further configured to:

send an additional portion of the audio file to the slave device for playback on the slave device according to the system clock offset value.

6. The audio playback device of claim 1, wherein the controller module is further configured to:

send, to the slave device, a current elapsed time of the playback of the audio file from the audio output component,

receive, from the slave device, an indication that the playback on the slave device is out of sync, and

repeat the send a network latency request, the receive a response, the calculate a one-way network latency time value, and the send a one-way network latency time value.

7. The audio playback device of claim 1, wherein the controller module is further configured to:

receive, from an additional slave device via the wireless connection, a request to join the audio playback session,

send, via the wireless connection at a third system time of the audio playback device, an additional network latency request to the additional slave device, the additional network latency request including the third system time of the audio playback device,

receive, via the wireless connection at a fourth system time of the audio playback device, an additional response to the additional network latency request from the additional slave device,

calculate an additional one-way network latency time value for the additional slave device based at least in part on an additional difference between the third system time and the fourth system time,

send the additional one-way network latency time value to the additional slave device for calculation of an additional system clock offset value,

add the additional slave device to the audio playback session using an additional data socket of the additional slave device, and

send, using the audio playback session, an additional portion of the audio file and a current elapsed time of the playback of the audio file to the additional slave device for playback of the audio file on the additional slave device according to the current elapsed time and the additional system clock offset value.

8. The audio playback device of claim 1, further comprising:

a user interface adapted to receive input from a user,

wherein the controller module is further configured to;

annunciate, via the user interface, an audio latency time value for the audio playback device,

detect, via the user interface, an adjustment request to the audio latency time value, and

modify the playback timing instruction according to the adjustment request.

9. The audio playback device of claim 1, wherein the controller module is further configured to:

determine a computing audio latency time value reflecting an elapsed time for the audio file to propagate through the audio playback device from the controller module to the audio output component, and

modify the playback timing instruction based on the computing audio latency time value.

10. The audio playback device of claim 1, further comprising:

an audio input component adapted to detect audio,

wherein the controller module is further configured to;

send, using the audio playback session, a sync playback instruction to the slave device for playback of audio sync data on the slave device at a specified time,

initiate playback of the audio sync data from the audio output component at the specified time,

calculate, from audio detected by the audio input component, an audio latency time value reflecting a time difference in the playback of the audio sync data on the slave device and the playback of the audio sync data from the audio output component, and

modify the playback timing instruction based on the audio latency time value.

11. A method in an audio playback device, the method comprising:

sending, via a wireless connection at a first system time of the audio playback device, a network latency request to a slave device, the network latency request including the first system time of the audio playback device;

receiving, via the wireless connection at a second system time of the audio playback device, a response to the network latency request from the slave device;

calculating a one-way network latency time value for the slave device based at least in part on a difference between the first system time and the second system time;

sending the one-way network latency time value to the slave device for calculation of a system clock offset value;

establishing an audio playback session with the slave device via the wireless connection, the audio playback session using a data socket of the slave device;

sending, using the audio playback session, at least a portion of an audio file to the slave device and a playback timing instruction indicating a current system time of the audio playback device, the audio file for playback on the slave device according to the playback timing instruction and the system clock offset value; and

initiating playback of the audio file from an audio output component.

12. The method of claim 11, wherein the response from the slave device indicates a successful connection.

13. The method of claim 11, wherein sending the network latency request to the slave device comprises:

sending, via one of a Wi-Fi Direct connection or a Wi-Fi connection at the first system time of the audio playback device, the network latency request to the slave device.

14. The method of claim 11, further comprising:

detecting user input, via a user interface of the audio playback device, corresponding to a playback command for the audio file;

modifying the playback of the audio file from the audio output component according to the playback command; and

sending the playback command and command timing instructions to the slave device for modification of the playback of the audio file on the slave device according to the playback command, the command timing instructions, and the system clock offset value.

15. The method of claim 11, further comprising:

sending an additional portion of the audio file to the slave device for playback on the slave device according to the system clock offset value.

16. The method of claim 11, further comprising:

sending, to the slave device, a current elapsed time of the playback of the audio file from the audio output component;

receiving, from the slave device, an indication that the playback on the slave device is out of sync; and

repeating the sending a network latency request, the receiving a response, the calculating a one-way network latency time value, and the sending a one-way network latency time value.

17. The method of claim 11, further comprising:

receiving, from an additional slave device via the wireless connection, a request to join the audio playback session;

sending, via the wireless connection at a third system time of the audio playback device, an additional network latency request to the additional slave device, the additional network latency request including the third system time of the audio playback device;

receiving, via the wireless connection at a fourth system time of the audio playback device, an additional response to the additional network latency request from the additional slave device;

calculating an additional one-way network latency time value for the additional slave device based at least in part on an additional difference between the third system time and the fourth system time;

sending the additional one-way network latency time value to the additional slave device for calculation of an additional system clock offset value;

adding the additional slave device to the audio playback session using an additional data socket of the additional slave device; and

sending, using the audio playback session, an additional portion of the audio file and a current elapsed time of the playback of the audio file to the additional slave device for playback of the audio file on the additional slave device according to the current elapsed time and the additional system clock offset value.

18. The method of claim 11, further comprising:

annunciating, via a user interface of the audio playback device, an audio latency time value for the audio playback device;

detecting, via the user interface, an adjustment request to the audio latency time value; and

modifying the playback timing instruction according to the adjustment request.

19. The method of claim 11, further comprising:

determining a computing audio latency time value reflecting an elapsed time for the audio file to propagate through the audio playback device from a controller module to the audio output component; and

modifying the playback timing instruction based on the computing audio latency time value.

20. The method of claim 11, further comprising:

sending, using the audio playback session, a sync playback instruction to the slave device for playback of audio sync data on the slave device at a specified time;

initiating playback of the audio sync data from the audio output component at the specified time;

calculating, from audio detected by an audio input component, an audio latency time value reflecting a time difference in the playback of the audio sync data on the slave device and the playback of the audio sync data from the audio output component; and

modifying the playback timing instruction based on the audio latency time value.