Systems and methods for syncronizing multiple electronic devices

• US 9,961,656 B2
• Filed: 10/26/2017
• Issued: 05/01/2018
• Est. Priority Date: 04/29/2013
• Status: Active Grant

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Inventors: Daley, Michael J., Bolinger, Travis, O'Neal, Heath
• Primary Examiner(s): HINDI, NABIL Z
• Application Number:
  US15/794,739
• Publication Number:
  US 20180049145A1
• Time in Patent Office: 187 Days
• Field of Search: 360 64, 455 305, 455 306, 4554121, 455502, 455 511, 370260, 370350, 370392, 370432, 370503, 370516, 370528, 375262, 381 2, 381 79, 381 80, 381 82, 386201, 386211, 386219, 700 94, 704260, 709204, 709208, 709219, 709231, 713500
• CPC Class Codes: H04H 20/08 among terminal devices
• CPC Class Codes: H04H 20/18 Arrangements for synchronising broadcast or distribution via plural systems
• CPC Class Codes: H04H 20/38 Arrangements for distribution where lower stations, e.g. receivers, interact with the broadcast
• CPC Class Codes: H04H 20/57 for mobile receivers
• CPC Class Codes: H04H 20/61 for local area broadcast, e.g. instore broadcast
• CPC Class Codes: H04H 20/63 to plural spots in a confined site, e.g. MATV [Master Antenna Television]
• CPC Class Codes: H04H 60/80 characterised by transmission among terminal devices
• CPC Class Codes: H04H 60/88 which are wireless networks
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/43 Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware real-time communication protocols in data switching networks H04L65/00
• CPC Class Codes: H04W 56/0015 one node acting as a reference for the others
• CPC Class Codes: H04W 56/0065 using measurement of signal travel time

Abstract

Embodiments are provided for syncing multiple electronic devices for collective audio playback. According to certain aspects, a master device connects (218) to a slave device via a wireless connection. The master device calculates (224) a network latency via a series of network latency pings with the slave device and sends (225) the network latency to the slave device. Further, the master devices sends (232) a portion of an audio file as well as a timing instruction including a system time to the slave device. The master device initiates (234) playback of the portion of the audio file and the slave devices initiates (236) playback of the portion of the audio file according to the timing instruction and a calculated system clock offset value.

Claims

1. A method comprising:

receiving, by a first audio playback device from a second audio playback device, a first time corresponding to audio data to be played by the first audio playback device as part of an audio playback group with the second audio playback device;

receiving, by the first audio playback device from the second audio playback device, a timing signal;

determining, by the first audio playback device based on the timing signal, a first difference between a clock of the first audio playback device and a clock of the second audio playback device;

determining, by the first audio playback device, a second time based on (i) the first time and (ii) the first difference between the clock of the first audio playback device and the clock of the second audio playback device;

playing, by the first audio playback device, the audio data at the second time according to the clock of the first audio playback device;

after playing the audio data, determining a second difference between the clock of the first audio playback device and the clock of the second audio playback device, wherein the second difference is different from the first difference; and

storing, in memory, data representing the second difference.

2. The method of claim 1, further comprising:

before receiving the first time corresponding to the audio data to be played by the first audio playback device, connecting to the second audio playback device by the first audio playback device; and

after connecting to the second audio playback device, retrieving from the memory, by the first audio playback device, data representing the first difference between the clock of the first audio playback device and the clock of the second audio playback device.

3. The method of claim 1, wherein the second audio playback device has a master role within the audio playback group.

4. The method of claim 1, further comprising:

receiving, by the first audio playback device from the second audio playback device, a first elapsed playback time of the audio data associated with the second audio playback device; and

determining that playback of the audio data is out of sync based on comparing the first elapsed playback time to a second elapsed playback time of the audio data associated with the first audio playback device.

5. The method of claim 4, further comprising:

sending, by the first audio playback device to the second audio playback device, an indication that the playback is out of sync.

6. The method of claim 1, wherein determining the second difference comprises:

receiving, by the first audio playback device from the second audio playback device, an additional timing signal; and

determining, based on the additional timing signal, the second difference between the clock of the first audio playback device and the clock of the second audio playback device.

7. The method of claim 6, wherein receiving the additional timing signal comprises:

receiving, by the first audio playback device from the second audio playback device, at least one network latency ping indicating the clock of the second audio playback device.

8. A first audio playback device comprising:

a processor;

a memory storing computer-readable program code executable by the processor to cause the first audio playback device to;

receive, from a second audio playback device, a first time corresponding to audio data to be played by the first audio playback device as part of an audio playback group with the second audio playback device,

receive, from the second audio playback device, a timing signal,

determine, based on the timing signal, a first difference between a clock of the first audio playback device and a clock of the second audio playback device,

determine a second time based on (i) the first time and (ii) the first difference between the clock of the first audio playback device and the clock of the second audio playback device,

play the audio data at the second time according to the clock of the first audio playback device,

after playing the audio data, determine a second difference between the clock of the first audio playback device and the clock of the second audio playback device, wherein the second difference is different from the first difference, and

store, in memory, data representing the second difference.

9. The first audio playback device of claim 8, wherein the computer-readable program code is executable by the processor to further cause the first audio playback device to:

before receiving the first time corresponding to the audio data to be played by the first audio playback device, connect to the second audio playback device, and

after connecting to the second audio playback device, retrieve, from the memory, data representing the first difference between the clock of the first audio playback device and the clock of the second audio playback device.

10. The first audio playback device of claim 8, wherein the second audio playback device has a master role within the audio playback group.

11. The first audio playback device of claim 8, wherein the computer-readable program code is executable by the processor to further cause the first audio playback device to:

receive, from the second audio playback device, a first elapsed playback time of the audio data associated with the second audio playback device, and

determine that playback of the audio data is out of sync based on comparing the first elapsed playback time to a second elapsed playback time of the audio data associated with the first audio playback device.

12. The first audio playback device of claim 11, wherein the computer-readable program code is executable by the processor to further cause the first audio playback device to:

send, to the second audio playback device, an indication that the playback is out of sync.

13. The first audio playback device of claim 8, wherein to determine the second difference, the first audio playback device is configured to:

receive, from the second audio playback device, an additional timing signal, and

determine, based on the additional timing signal, the second difference between the clock of the first audio playback device and the clock of the second audio playback device.

14. The first audio playback device of claim 13, wherein the first audio playback device receives the additional timing signal as at least one network latency ping indicating the clock of the second audio playback device.

15. A method comprising:

receiving, by a first audio playback device from a second audio playback device, a first time corresponding to audio data to be played by the first audio playback device as part of an audio playback group with the second audio playback device;

determining, by the first audio playback device, a second time based on (i) the first time and (ii) a first difference between a clock of the first audio playback device and a clock of the second audio playback device;

playing, by the first audio playback device, the audio data at the second time according to the clock of the first audio playback device;

after playing the audio data, determining a second difference between the clock of the first audio playback device and the clock of the second audio playback device, wherein the second difference is different from the first difference; and

storing, in memory, data representing the second difference.

16. The method of claim 15, further comprising:

receiving, by the first audio playback device from the second audio playback device, a timing signal; and

determining, by the first audio playback device based on the timing signal, the first difference between the clock of the first audio playback device and the clock of the second audio playback device.

17. The method of claim 15, further comprising:

before receiving the first time corresponding to the audio data to be played by the first audio playback device, connecting to the second audio playback device by the first audio playback device; and

after connecting to the second audio playback device, retrieving from the memory, by the first audio playback device, data representing the first difference between the clock of the first audio playback device and the clock of the second audio playback device.

18. The method of claim 15, further comprising:

receiving, by the first audio playback device from the second audio playback device, a first elapsed playback time of the audio data associated with the second audio playback device; and

determining that playback of the audio data is out of sync based on comparing the first elapsed playback time to a second elapsed playback time of the audio data associated with the first audio playback device.

19. The method of claim 18, further comprising:

sending, by the first audio playback device to the second audio playback device, an indication that the playback is out of sync.

20. The method of claim 15, wherein determining the second difference comprises:

receiving, by the first audio playback device from the second audio playback device, an additional timing signal; and

determining, based on the additional timing signal, the second difference between the clock of the first audio playback device and the clock of the second audio playback device.