Method and apparatus for obtaining audio content and providing the audio content to a plurality of audio devices in a multi-zone system

• US 9,164,533 B2
• Filed: 12/05/2012
• Issued: 10/20/2015
• Est. Priority Date: 07/28/2003
• Status: Active Grant

• Current Assignee: Sonos, Inc.
• Original Assignee: Sonos, Inc.
• Inventors: Millington, Nicholas A. J.
• Primary Examiner(s): Survillo, Oleg
• Application Number:
  US13/705,177
• Publication Number:
  US 20130097505A1
• Time in Patent Office: 1,049 Days
• Field of Search: 709/219, 709/220, 709/231
• US Class Current: 1/1
• CPC Class Codes: G05B 15/02 electric
• CPC Class Codes: G06F 1/00 Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00 architectures of general purpose stored program computers G06F15/76
• CPC Class Codes: G06F 1/12 Synchronisation of different clock signals provided by a plurality of clock generators
• CPC Class Codes: G06F 16/2322 using timestamps
• CPC Class Codes: G06F 16/60 of audio data
• CPC Class Codes: G06F 16/63 Querying
• CPC Class Codes: G06F 16/635 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/638 Presentation of query results
• CPC Class Codes: G06F 16/639 using playlists
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 17/00 Digital computing or data processing equipment or methods, specially adapted for specific functions information retrieval, database structures or file system structures therefor G06F16/00
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06F 3/162 Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G11B 20/10527 : Audio or video recording; Data buffering arrangements G11B20/12 - G11B20/18 take precedence
• CPC Class Codes: G11B 2020/10592 : specifically adapted for recording or reproducing multichannel signals
• CPC Class Codes: H03G 3/00 : Gain control in amplifiers or frequency changers
• CPC Class Codes: H03G 3/20 : Automatic control H03G3/005 takes precedence; combined with volume compression or expansion H03G7/00
• CPC Class Codes: H04H 20/103 : Transmitter-side switching
• CPC Class Codes: H04H 20/26 : Arrangements for switching distribution systems
• CPC Class Codes: H04H 2201/20 : digital audio broadcasting [DAB]
• CPC Class Codes: H04J 3/0644 : External master-clock
• CPC Class Codes: H04J 3/0664 : unidirectional timestamps
• CPC Class Codes: H04L 12/2854 : Wide area networks, e.g. public data networks
• CPC Class Codes: H04L 65/1069 : Session establishment or de-establishment
• CPC Class Codes: H04L 65/1094 : Inter-user-equipment sessions transfer or sharing
• CPC Class Codes: H04L 65/60 : Network streaming of media packets
• CPC Class Codes: H04L 65/61 : for supporting one-way streaming services, e.g. Internet radio
• CPC Class Codes: H04L 65/611 : for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/612 : for unicast
• CPC Class Codes: H04L 65/613 : for the control of the source by the destination control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637
• CPC Class Codes: H04L 65/75 : Media network packet handling
• CPC Class Codes: H04L 65/80 : Responding to QoS
• CPC Class Codes: H04L 67/1095 : Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 67/12 : specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 67/55 : Push-based network services
• CPC Class Codes: H04L 69/28 : Timers or timing mechanisms used in protocols
• CPC Class Codes: H04N 21/4307 : Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
• CPC Class Codes: H04N 21/43076 : of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
• CPC Class Codes: H04N 21/43615 : Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 5/04 : Synchronising for television systems using pulse code modulation H04N7/56
• CPC Class Codes: H04N 9/7904 : using intermediate digital signal processing
• CPC Class Codes: H04R 2227/003 : Digital PA systems using, e.g. LAN or internet
• CPC Class Codes: H04R 2227/005 : Audio distribution systems for home, i.e. multi-room use
• CPC Class Codes: H04R 27/00 : Public address systems circuits for preventing acoustic reaction H04R3/02; circuits for distributing signals to loudspeakers H04R3/12; monitoring or testing arrangements for public address systems H04R29/007; amplifiers H03F
• CPC Class Codes: H04R 3/12 : for distributing signals to two or more loudspeakers specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04W 56/0015 : one node acting as a reference for the others
• CPC Class Codes: H04W 84/20 : Master-slave selection or change arrangements
• CPC Class Codes: H05K 999/99 : dummy group

Abstract

An audio processing device comprising: a network interface configured to receive audio information from a network; a user interface module that includes a display configured to display a plurality of audio information sources available via the network; a control module configured to receive control input from the user interface module indicating a selection of one of the plurality of audio information sources; an audio information channelization device connected to the network interface configured (i) to receive a list of audio tracks to be played, (ii) to request the audio information from the selected one of the plurality of audio information sources according to the list, and (iii) to transmit the audio information in packet form via the network interface to two or more audio playback devices.

Claims

1. A method performed by a computing device, the method comprising:

configuring two or more audio playback devices to playback audio in synchrony;

transmitting computing device clock information to the two or more audio playback devices;

receiving a control input indicating a selection of one of a plurality of audio information sources, wherein each of the plurality of audio information sources is accessible over a network; and

in response to receiving the control input, (i) requesting audio information from the selected audio information source, (ii) receiving the requested audio information from the selected audio information source, (iii) after receiving at least some of the requested audio information, generating a plurality of frames comprising the requested audio information and playback timing information, wherein at least one packet comprises at least a portion of the requested audio information and playback timing information for the at least one packet, and (iv) streaming the generated frames comprising the audio information and the playback timing information from a network interface to the two or more audio playback devices for playback in synchrony by the two or more audio playback devices, wherein the two or more audio playback devices remain independently clocked while playing back the requested audio information in synchrony.

2. The method of claim 1, wherein the method further comprises:

configuring the two or more audio playback devices to play audio in synchrony with each other before streaming the plurality of generated frames to the two or more audio playback devices.

3. The method of claim 1, wherein the method further comprises:

transmitting one or more unicast control information packets containing a multicast address to the two or more audio playback devices; and

wherein streaming the generated frames to the two or more audio playback devices comprises streaming the generated frames to the multicast address.

4. The method of claim 1, wherein the method further comprises:

determining the playback timing information relative to the computing device clock, wherein the computing device and each of the two or more audio playback devices remain independently clocked while the computing device performs the step of streaming the generated frames to the two or more audio playback devices.

5. A method performed by an audio processing device, the method comprising:

displaying, on a screen, a plurality of audio information sources available at a plurality of corresponding network locations;

configuring two or more audio playback devices to playback audio in synchrony;

transmitting device clock information of the audio processing device to the two or more audio playback devices;

receiving a selection of one of the plurality of audio information sources; and

in response to receiving the selection, (i) requesting audio information from the selected audio information source, (ii) receiving the requested audio information from the selected audio information source, (iii) generating a plurality of frames, wherein an individual frame comprises a portion of the requested audio information and playback timing information for the individual frame, and (iv) streaming the plurality of generated frames to the two or more audio playback devices for playback in synchrony by the two or more audio playback devices, wherein the two or more audio playback devices remain independently clocked while playing back the requested audio information in synchrony.

6. The method of claim 5, wherein streaming the plurality of generated frames to the two or more audio playback devices comprises streaming the plurality of generated frames to a multicast address.

7. The method of claim 5, wherein receiving the requested audio information from the selected audio information source comprises receiving the requested audio information from the selected audio information source as at least one of (i) streaming digital audio information or (ii) a file transfer of one or more audio files from the selected audio information source.

8. The method of claim 5, wherein the audio processing device is a mobile device or a PDA device.

9. The method of claim 5, wherein the method further comprises determining the playback timing information relative to the device clock of the audio processing device.

10. A method performed by a computing device, the method comprising:

displaying, on a screen, a plurality of audio information sources, wherein each audio information source is available via a network;

configuring two or more audio playback devices to playback audio in synchrony;

transmitting device clock information of the computing device to the two or more audio playback devices;

receiving a selection of one of the plurality of audio information sources;

in response to receiving the selection of the audio information source, obtaining a list of audio tracks from the selected audio information source;

receiving a selection of an audio track from the list of audio tracks; and

in response to receiving the selection of the audio track, (i) requesting the selected audio track from the selected audio information source;

(ii) receiving the selected audio track from the selected audio information source;

(iii) generating a plurality of packets, wherein at least one packet comprises at least a portion of the selected audio track and playback timing information for the at least one packet; and

(iv) streaming the plurality of generated packets from a network interface of the computing device to the two or more audio playback devices for playback in synchrony by the two or more audio playback devices, wherein the two or more audio playback devices remain independently clocked while playing back the selected audio track in synchrony.

11. The method of claim 10, wherein the method further comprises:

configuring the two or more audio playback devices to playback audio in synchrony with each other before streaming the plurality of generated packets from the network interface of the computing device to the two or more audio playback devices.

12. The method of claim 10, wherein the method further comprises:

transmitting one or more unicast control information packets containing a multicast address to the two or more audio playback devices; and

wherein streaming the plurality of generated packets from the network interface of the computing device to the two or more audio playback devices comprises streaming the plurality of generated packets to the multicast address.

13. The method of claim 10, wherein the computing device receives the selected audio track as at least one of (i) streaming digital audio information from the selected audio information source or (ii) one or more audio files transferred from the selected audio information source.

14. The method of claim 10, wherein the method further comprises determining the playback timing information relative to the device clock of the computing device.

15. A tangible, non-transitory computer-readable memory comprising instructions encoded therein, wherein the instructions, when executed by one or more processors, cause a computing device to perform a method comprising:

configuring two or more audio playback devices to playback audio in synchrony;

transmitting computing device clock information to the two or more audio playback devices;

receiving control input indicating a selection of one of a plurality of audio information sources, wherein each of the plurality of audio information sources is accessible over a network; and

in response to receiving the control input, (i) requesting audio information from the selected audio information source, (ii) receiving the requested audio information from the selected audio information source, (iii) after receiving at least some of the requested audio information, generating a plurality of frames comprising the requested audio information and playback timing information, wherein at least one frame comprises at least a portion of the requested audio information and playback timing information for the at least one frame, and (iv) streaming the generated frames comprising the audio information and the playback timing information from a network interface to the two or more audio playback devices for playback in synchrony by the two or more audio playback devices, wherein the two or more audio playback devices remain independently clocked while playing back the requested audio information in synchrony.

16. The computer-readable memory of claim 15 wherein the method further comprises:

configuring the two or more audio playback devices to play audio in synchrony with each other before streaming the plurality of generated frames to the two or more audio playback devices.

17. The computer-readable memory of claim 15, wherein the method further comprises:

transmitting one or more unicast control information packets containing a multicast address to the two or more audio playback devices; and

wherein streaming the generated frames to the two or more audio playback devices comprises streaming the generated frames to the multicast address.

18. The computer-readable memory of claim 15, wherein the method further comprises:

determining the playback timing information relative to the computing device clock, wherein the computing device and each of the two or more audio playback devices remain independently clocked while the computing device performs the step of streaming the generated frames to the two or more audio playback devices.

19. The computer-readable memory of claim 15 wherein the computing device is a PDA device or a mobile device.

20. A tangible, non-transitory computer-readable memory with instructions stored therein, wherein the instructions, when executed by one or more processors, cause an audio processing device to perform a method comprising:

displaying, on a screen, a plurality of audio information sources available at a plurality of corresponding network locations;

configuring two or more audio playback devices to playback audio in synchrony;

transmitting device clock information of the audio processing device to the two or more audio playback devices;

receiving a selection of one of the plurality of audio information sources; and

in response to receiving the selection, (i) requesting audio information from the selected audio information source, (ii) receiving the requested audio information from the selected audio information source, (iii) generating a plurality of frames, wherein an individual frame comprises a portion of the requested audio information and playback timing information for the individual frame, and (iv) streaming the plurality of generated frames to the two or more audio playback devices for playback in synchrony by the two or more audio playback devices, wherein the two or more audio playback devices remain independently clocked while playing back the requested audio information in synchrony.

21. The computer-readable memory of claim 20 wherein the method further comprises:

receiving volume control information; and

in response to receiving the volume control information, controlling a volume of at least one of the two or more audio playback devices.

22. The computer-readable memory of claim 21 wherein the volume control information includes device-specific volume control settings for the two or more audio playback devices.

23. The computer-readable memory of claim 20, wherein streaming the plurality of generated frames to the two or more audio playback devices comprises streaming the plurality of generated frames to a multicast address.

24. The computer-readable memory of claim 20 wherein receiving the requested audio information from the selected audio information source comprises:

receiving the requested audio information from the selected audio information source as streaming digital audio information.

25. The computer-readable memory of claim 20 wherein receiving the requested audio information from the selected audio information source comprises:

receiving the requested audio information from the selected audio information source as a file transfer of one or more audio files from the selected audio information source.

26. The computer-readable memory of claim 20 wherein the audio processing device is a mobile device or a PDA device.

27. The computer-readable memory of claim 20, wherein the method further comprises:

determining the playback timing information relative to the device clock of the audio processing device.

28. The computer-readable memory of claim 27 wherein the method further comprises:

transmitting the device clock information to the one or more audio playback devices according to a network timing protocol.

29. A tangible, non-transitory computer-readable memory having instructions stored therein, wherein the instructions, when executed by one or more processors, cause a computing device to perform a method, the method comprising:

displaying, on a screen, a plurality of audio information sources, wherein each audio information source is available via a network;

configuring two or more audio playback devices to playback audio in synchrony;

transmitting device clock information of the computing device to the two or more audio playback devices;

receiving a selection of one of the plurality of audio information sources;

in response to receiving the selection of the audio information source, obtaining a list of audio tracks from the selected audio information source;

receiving a selection of an audio track from the list of audio tracks; and

in response to receiving the selection of the audio track, (i) requesting the selected audio track from the selected audio information source;

(ii) receiving the selected audio track from the selected audio information source;

(iii) generating a plurality of packets, wherein at least one packet comprises at least a portion of the selected audio track and playback timing information for the at least one packet; and

(iv) streaming the plurality of generated packets from a network interface of the computing device to the two or more audio playback devices for playback in synchrony by the two or more audio playback devices, wherein the two or more audio playback devices remain independently clocked while playing back the selected audio track in synchrony.

30. The computer-readable memory of claim 29 wherein the method further comprises:

configuring the two or more audio playback devices to playback audio in synchrony with each other before streaming the plurality of generated packets from the network interface of the computing device to the two or more audio playback devices.

31. The computer-readable memory of claim 29 wherein the method further comprises:

transmitting one or more unicast control information packets containing a multicast address to the two or more audio playback devices; and

wherein streaming the plurality of generated packets from the network interface of the computing device to the two or more audio playback devices comprises streaming the plurality of generated packets to the multicast address.

32. The computer-readable memory of claim 29 wherein the computing device receives the selected audio track as at least one of (i) streaming digital audio information from the selected audio information source or (ii) one or more audio files transferred from the selected audio information source.

33. The computer-readable memory of claim 29 wherein the method further comprises:

determining the playback timing information relative to the device clock of the computing device.

34. The computer-readable memory of claim 29 wherein the method further comprises:

controlling a volume of the two or more audio playback devices, wherein the controlling comprises transmitting volume control information to the two or more audio playback devices from the network interface to at least one of the two or more audio playback devices.

35. A computing device comprising:

one or more processors; and

tangible, non-transitory computer-readable memory comprising instructions encoded therein, wherein the instructions, when executed by one or more processors, cause the computing device to perform a method comprising;

configuring two or more audio playback devices to playback audio in synchrony;

transmitting computing device clock information to the two or more audio playback devices;

receiving control input indicating a selection of one of a plurality of audio information sources, wherein each of the plurality of audio information sources is accessible over a network; and

in response to receiving the control input, (i) requesting audio information from the selected audio information source, (ii) receiving the requested audio information from the selected audio information source, (iii) after receiving at least some of the requested audio information, generating a plurality of frames comprising the requested audio information and playback timing information, wherein at least one frame comprises at least a portion of the requested audio information and playback timing information for the requested audio information, and (iv) streaming the generated frames comprising the audio information and the playback timing information from a network interface to the two or more audio playback devices for playback in synchrony by the two or more audio playback devices, wherein the two or more audio playback devices remain independently clocked while playing back the requested audio information in synchrony.

36. The computing device of claim 35, wherein the method further comprises:

configuring the two or more audio playback devices to play audio in synchrony with each other before streaming the plurality of generated frames to the two or more audio playback devices.

37. The computing device of claim 35, wherein the method further comprises:

transmitting one or more unicast control information packets containing a multicast address to the two or audio more playback devices; and

wherein streaming the generated frames to the two or more audio playback devices comprises streaming the generated frames to the multicast address.

38. The computing device of claim 35, wherein the method further comprises:

determining the playback timing information relative to the computing device clock, wherein the computing device and each of the two or more audio playback devices remain independently clocked while the computing device performs the step of streaming the generated frames to the two or more audio playback devices.

39. An audio processing device comprising:

one or more processors; and

tangible, non-transitory computer-readable memory with instructions stored therein, wherein the instructions, when executed by one or more processors, cause the audio processing device to perform a method comprising;

displaying, on a screen, a plurality of audio information sources available at a plurality of corresponding network locations;

configuring two or more audio playback devices to playback audio in synchrony;

transmitting device clock information of the audio processing device to the two or more audio playback devices;

receiving a selection of one of the plurality of audio information sources; and

in response to receiving the selection, (i) requesting audio information from the selected audio information source, (ii) receiving the requested audio information from the selected audio information source, (iii) generating a plurality of frames, wherein an individual frame comprises a portion of the requested audio information and playback timing information for the portion of the requested audio information, and (iv) streaming the plurality of generated frames to the two or more audio playback devices for playback in synchrony by the two or more audio playback devices, wherein the two or more audio playback devices remain independently clocked while playing the requested audio information in synchrony.

40. The audio processing device of claim 39, wherein streaming the plurality of generated frames to the two or more audio playback devices comprises streaming the plurality of generated frames to a multicast address.

41. The audio processing device of claim 39, wherein receiving the requested audio information from the selected audio information source comprises receiving the requested audio information from the selected audio information source as at least one of (i) streaming digital audio information or (ii) a file transfer of one or more audio files from the selected audio information source.

42. The audio processing device of claim 39, wherein the audio processing device is a mobile device or a PDA device.

43. The audio processing device of claim 39, wherein the method further comprises determining the playback timing information relative to the device clock of the audio processing device.

44. A computing device comprising:

one or more processors; and

tangible, non-transitory computer-readable memory having instructions stored therein, wherein the instructions, when executed by one or more processors, cause the computing device to perform a method, the method comprising;

displaying, on a screen, a plurality of audio information sources, wherein each audio information source is available via a network;

configuring two or more audio playback devices to play back audio in synchrony;

transmitting device clock information of the computing device to the two or more audio playback devices;

receiving a selection of one of the plurality of audio information sources;

in response to receiving the selection of the audio information source, obtaining a list of audio tracks from the selected audio information source;

receiving a selection of an audio track from the list of audio tracks; and

in response to receiving the selection of the audio track, (i) requesting the selected audio track from the selected audio information source;

(ii) receiving the selected audio track from the selected audio information source;

(iii) generating a plurality of packets, wherein at least one packet comprises at least a portion of the selected audio track and playback timing information for the at least one packet; and

(iv) streaming the plurality of generated packets from a network interface of the computing device to the two or more audio playback devices for playback in synchrony by the two or more audio playback devices, wherein the two or more audio playback devices remain independently clocked while playing back the selected audio track in synchrony.

45. The computing device of claim 44, wherein the method further comprises:

configuring the two or more audio playback devices to playback audio in synchrony with each other before streaming the plurality of generated packets from the network interface of the computing device to the two or more audio playback devices.

46. The computing device of claim 44, wherein the method further comprises:

transmitting one or more unicast control information packets containing a multicast address to the two or more audio playback devices; and

wherein streaming the plurality of generated packets from the network interface of the computing device to the two or more audio playback devices comprises streaming the plurality of generated packets to the multicast address.

47. The computing device of claim 44, wherein the computing device receives the selected audio track as at least one of (i) streaming digital audio information from the selected audio information source or (ii) one or more audio files transferred from the selected audio information source.

48. The computing device of claim 44, wherein the method further comprises determining the playback timing information relative to the device clock of the computing device.