Immersive audio in a media playback system

• US 10,028,069 B1
• Filed: 06/22/2017
• Issued: 07/17/2018
• Est. Priority Date: 06/22/2017
• Status: Active Grant

• Current Assignee: Sonos, Inc.
• Original Assignee: Sonos, Inc.
• Inventors: Lang, Jonathan
• Primary Examiner(s): Laekemariam, Yosef K
• Application Number:
  US15/630,214
• Time in Patent Office: 390 Days
• Field of Search: 381 17, 381 18, 381 10, 381 2, 381 80, 381 85, 381 947, 381300
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04N 21/43079 of additional data with content streams on multiple devices
• CPC Class Codes: H04N 21/431 Generation of visual interfaces for content selection or interaction; Content or additional data rendering
• CPC Class Codes: H04N 21/436 Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/4363 Adapting the video stream to a specific local network, e.g. a Bluetooth® network
• CPC Class Codes: H04N 21/8106 involving special audio data, e.g. different tracks for different languages
• CPC Class Codes: H04R 2227/005 Audio distribution systems for home, i.e. multi-room use
• CPC Class Codes: H04R 5/02 Spatial or constructional arrangements of loudspeakers
• CPC Class Codes: H04R 5/027 Spatial or constructional arrangements of microphones, e.g. in dummy heads
• CPC Class Codes: H04R 5/04 Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments combinations of amplifiers H03F3/68; stereophonic systems H04S
• CPC Class Codes: H04S 2400/01 Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
• CPC Class Codes: H04S 2400/11 Positioning of individual sound objects, e.g. moving airplane, within a sound field H04S2420/13 takes precedence
• CPC Class Codes: H04S 2400/13 Aspects of volume control, not necessarily automatic, in stereophonic sound systems
• CPC Class Codes: H04S 2400/15 Aspects of sound capture and related signal processing for recording or reproduction
• CPC Class Codes: H04S 3/002 Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution control circuits for electronic adaptation of the sound field H04S7/30
• CPC Class Codes: H04S 3/008 in which the audio signals are in digital form, i.e. employing more than two discrete digital channels data reduction aspects thereof based on psychoacoustics G10L19/02
• CPC Class Codes: H04S 7/301 Automatic calibration of stereophonic sound system, e.g. with test microphone
• CPC Class Codes: H04S 7/302 Electronic adaptation of stereophonic sound system to listener position or orientation H04S7/301 takes precedence

Abstract

Embodiments described herein involve identifying a primary zone in a network media system for playback of primary audio content, where audio content comprises the primary audio content and auxiliary audio content, and determining respective audio responses of each of one or more auxiliary zones for coordinated playback of the auxiliary audio content with the primary zone. At least one auxiliary zone of the one or more auxiliary zones for coordinated playback of auxiliary audio content may be identified based on the respective audio responses of each of the one or more auxiliary zones. The primary zone can play back the primary audio content, and the at least one auxiliary zone can coordinate playback of the auxiliary audio content with the primary audio content played by the primary zone.

Claims

1. A method, comprising:

a network media system identifying a primary zone in the network media system to play back audio tracks of videos, wherein identifying the primary zone comprises determining that an input interface of a playback device within the primary zone is connected to (a) an output port of a display device or (b) an output port of a media player device that outputs audio and video;

the network media system determining respective audio responses of each of one or more auxiliary zones for coordinated playback of auxiliary audio content with the primary zone;

the network media system identifying at least one auxiliary zone of the one or more auxiliary zones for coordinated playback of auxiliary audio content based on the respective audio responses of each of the one or more auxiliary zones indicating that the at least one auxiliary zone is within audible range of the primary zone; and

while a multi-channel audio track of a given video is playing back, the network media system temporarily forming a playback configuration in which the primary zone plays back primary audio content comprising one or more first audio channels of the multi-channel audio track and the at least one auxiliary zone plays back auxiliary audio content comprising one or more second audio channels of the multi-channel audio track, wherein the primary zone and the at least one auxiliary zone are each configured to play back audio content individually before forming the playback configuration.

2. The method of claim 1, wherein the one or more first audio channels of the multi-channel audio track comprise a center channel audio track and wherein the one or more second audio channels comprise one or more surround audio tracks.

3. The method of claim 1, wherein the one or more first audio channels of the multi-channel audio track comprise a dialogue audio track and wherein the one or more second audio channels comprise one or more non-dialogue audio tracks.

4. The method of claim 1, wherein temporarily forming the playback configuration comprises temporarily forming a bonded zone that includes playback devices of the primary zone and the at least one auxiliary zone, and wherein the method further comprises re-forming the primary zone and the at least one auxiliary zone when the multi-channel audio track of the given video stops playing back.

5. The method of claim 1, wherein identifying the primary zone comprises:

determining types of playback devices in the network media system; and

identifying a zone comprising a playback device corresponding to a first type as the primary zone, wherein the first type corresponds to one of (a) a sound bar-type playback device or (b) a sound base-type playback device.

6. The method of claim 1, wherein determining respective audio responses comprises:

causing a first auxiliary zone to play calibration audio; and

capturing, via a microphone in a listener location of the primary zone, the calibration audio played by the first auxiliary zone.

7. The method of claim 1, wherein the multi-channel audio track comprises surround sound audio content of the given video.

8. A tangible, non-transitory computer-readable medium storing instructions that when executed by at least one processor cause a network media system to perform functions comprising:

identifying a primary zone in the network media system to play back audio tracks of videos, wherein identifying the primary zone comprises determining that an input interface of a playback device within the primary zone is connected to (a) an output port of a display device or (b) an output port of a media player device that outputs audio and video;

determining respective audio responses of each of one or more auxiliary zones for coordinated playback of auxiliary audio content with the primary zone;

identifying at least one auxiliary zone of the one or more auxiliary zones for coordinated playback of auxiliary audio content based on the respective audio responses of each of the one or more auxiliary zones indicating that the at least one auxiliary zone is within audible range of the primary zone; and

while a multi-channel audio track of a given video is playing back, the network media system temporarily forming a playback configuration in which the primary zone plays back primary audio content comprising one or more first audio channels of the multi-channel audio track and the at least one auxiliary zone plays back auxiliary audio content comprising one or more second audio channels of the multi-channel audio track, wherein the primary zone and the at least one auxiliary zone are each configured to play back audio content individually before forming the playback configuration.

9. The computer-readable medium of claim 8, wherein the one or more first audio channels of the multi-channel audio track comprise a center channel audio track and wherein the one or more second audio channels comprise one or more surround audio tracks.

10. The computer-readable medium of claim 9, wherein the one or more first audio channels of the multi-channel audio track comprise a dialogue audio track and wherein the one or more second audio channels comprise one or more non-dialogue audio tracks.

11. The computer-readable medium of claim 8, wherein temporarily forming the playback configuration comprises temporarily forming a bonded zone that includes playback devices of the primary zone and the at least one auxiliary zone, and wherein the functions further comprise re-forming the primary zone and the at least one auxiliary zone when the multi-channel audio track of the given video stops playing back.

12. The computer-readable medium of claim 8, wherein identifying the primary zone comprises:

determining types of playback devices in the network media system; and

identifying a zone comprising a playback device corresponding to a first type as the primary zone, wherein the first type corresponds to one of (a) a sound bar-type playback device or (b) a sound base-type playback device.

13. The computer-readable medium of claim 8, wherein determining respective audio responses comprises:

causing a first auxiliary zone to play calibration audio; and

capturing, via a microphone in a listener location of the primary zone, the calibration audio played by the first auxiliary zone.

14. The computer-readable medium of claim 8, wherein the multi-channel audio track comprises surround sound audio content of the given video.

15. A computing device of a network media system comprising:

at least one processor; and

memory storing instructions that when executed by the at least one processor cause the computing device to perform functions comprising;

identifying a primary zone in the network media system to play back audio tracks of videos, wherein identifying the primary zone comprises determining that an input interface of a playback device within the primary zone is connected to (a) an output port of a display device or (b) an output port of a media player device that outputs audio and video;

determining respective audio responses of each of one or more auxiliary zones for coordinated playback of auxiliary audio content with the primary zone;

identifying at least one auxiliary zone of the one or more auxiliary zones for coordinated playback of auxiliary audio content based on the respective audio responses of each of the one or more auxiliary zones indicating that the at least one auxiliary zone is within audible range of the primary zone; and

while a multi-channel audio track of a given video is playing back, the network media system temporarily forming a playback configuration in which the primary zone plays back primary audio content comprising one or more first audio channels of the multi-channel audio track and the at least one auxiliary zone plays back auxiliary audio content comprising one or more second audio channels of the multi-channel audio track, wherein the primary zone and the at least one auxiliary zone are each configured to play back audio content individually before forming the playback configuration.

16. The computing device of claim 15, wherein the one or more first audio channels of the multi-channel audio track comprise a center channel audio track and wherein the one or more second audio channels comprise one or more surround audio tracks.

17. The computing device of claim 15, wherein the one or more first audio channels of the multi-channel audio track comprise a dialogue audio track and wherein the one or more second audio channels comprise one or more non-dialogue audio tracks.

18. The computing device of claim 15, wherein temporarily forming the playback configuration comprises temporarily forming a bonded zone that includes playback devices of the primary zone and the at least one auxiliary zone, and wherein the functions further comprise re-forming the primary zone and the at least one auxiliary zone when the multi-channel audio track of the given video stops playing back.

19. The computing device of claim 15, wherein identifying the primary zone comprises:

determining types of playback devices in the network media system; and

identifying a zone comprising a playback device corresponding to a first type as the primary zone, wherein the first type corresponds to one of (a) a sound bar-type playback device or (b) a sound base-type playback device.

20. The computing device of claim 15, wherein determining respective audio responses comprises:

causing a first auxiliary zone to play calibration audio; and

capturing, via a microphone in a listener location of the primary zone, the calibration audio played by the first auxiliary zone.