Immersive audio in a media playback system

• US 10,404,768 B2
• Filed: 06/14/2018
• Issued: 09/03/2019
• Est. Priority Date: 06/22/2017
• Status: Active Grant

• Current Assignee: Sonos, Inc.
• Original Assignee: Sonos, Inc.
• Inventors: Lang, Jonathan
• Primary Examiner(s): Laekemariam, Yosef K
• Application Number:
  US16/008,996
• Publication Number:
  US 20180376271A1
• Time in Patent Office: 446 Days
• Field of Search: 381 2, 381 10, 381 17, 381 18, 381 80, 381 85, 381 947, 381300
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04N 21/43079 of additional data with content streams on multiple devices
• CPC Class Codes: H04N 21/431 Generation of visual interfaces for content selection or interaction; Content or additional data rendering
• CPC Class Codes: H04N 21/436 Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/4363 Adapting the video stream to a specific local network, e.g. a Bluetooth® network
• CPC Class Codes: H04N 21/8106 involving special audio data, e.g. different tracks for different languages
• CPC Class Codes: H04R 2227/005 Audio distribution systems for home, i.e. multi-room use
• CPC Class Codes: H04R 5/02 Spatial or constructional arrangements of loudspeakers
• CPC Class Codes: H04R 5/027 Spatial or constructional arrangements of microphones, e.g. in dummy heads
• CPC Class Codes: H04R 5/04 Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments combinations of amplifiers H03F3/68; stereophonic systems H04S
• CPC Class Codes: H04S 2400/01 Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
• CPC Class Codes: H04S 2400/11 Positioning of individual sound objects, e.g. moving airplane, within a sound field H04S2420/13 takes precedence
• CPC Class Codes: H04S 2400/13 Aspects of volume control, not necessarily automatic, in stereophonic sound systems
• CPC Class Codes: H04S 2400/15 Aspects of sound capture and related signal processing for recording or reproduction
• CPC Class Codes: H04S 3/002 Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution control circuits for electronic adaptation of the sound field H04S7/30
• CPC Class Codes: H04S 3/008 in which the audio signals are in digital form, i.e. employing more than two discrete digital channels data reduction aspects thereof based on psychoacoustics G10L19/02
• CPC Class Codes: H04S 7/301 Automatic calibration of stereophonic sound system, e.g. with test microphone
• CPC Class Codes: H04S 7/302 Electronic adaptation of stereophonic sound system to listener position or orientation H04S7/301 takes precedence

Abstract

Embodiments described herein involve a network media system identifying a primary zone in the network media system to play back audio tracks of videos. The system determines respective audio responses of one or more auxiliary zones and identifies a particular auxiliary zone for coordinated playback of auxiliary audio content based on the respective audio responses of the one or more auxiliary zones indicating that the particular auxiliary zone is within audible range of the primary zone and the particular auxiliary zone including a subwoofer. While an audio track of a given video is playing back, the network media system temporarily forms a playback configuration in which the primary zone plays back primary audio content including full frequency range audio content of the audio track and the at least one auxiliary zone plays back auxiliary audio content including low frequency range audio content of the audio track.

Claims

1. A method comprising:

a network media system identifying a primary zone in the network media system to play back audio tracks of videos, wherein identifying the primary zone comprises determining that an input interface of a playback device within the primary zone is connected to (a) an output port of a display device or (b) an output port of a media player device that outputs audio and video;

the network media system determining respective audio responses of one or more auxiliary zones for coordinated playback of auxiliary audio content with the primary zone;

the network media system identifying a particular auxiliary zone for coordinated playback of auxiliary audio content based on (i) the respective audio responses of the one or more auxiliary zones indicating that the particular auxiliary zone is within audible range of the primary zone and (ii) the particular auxiliary zone comprising a subwoofer; and

while an audio track of a given video is playing back, the network media system temporarily forming a playback configuration in which the primary zone plays back primary audio content comprising full frequency range audio content of the audio track and the particular one auxiliary zone plays back auxiliary audio content comprising low frequency range audio content of the audio track, wherein the primary zone and the particular auxiliary zone are each configured to play back audio content individually before forming the playback configuration.

2. The method of claim 1, wherein the particular auxiliary zone consists of the subwoofer and one or more full-range playback devices, and wherein temporarily forming the playback configuration comprises temporarily forming a bonded zone that includes playback devices of the primary zone and the subwoofer of the particular auxiliary zone, wherein the particular auxiliary zone consists of the one or more full-range playback devices while the bonded zone is formed.

3. The method of claim 1, wherein the method further comprises re-forming the primary zone and particular auxiliary zone when the audio track of the given video stops playing back.

4. The method of claim 1, wherein the particular auxiliary zone consists of the subwoofer and one or more full-range playback devices, wherein the audio track is a multi-channel audio track, and wherein the full frequency range audio content comprises a center channel audio track and wherein the auxiliary audio content comprise one or more surround audio tracks.

5. The method of claim 1, the full frequency range audio content comprises portions of the audio track in a first frequency range that includes dialogue and wherein the low frequency range audio content consists of portions of the audio track in a second frequency range that includes bass frequencies.

6. The method of claim 1, wherein identifying the primary zone comprises:

determining types of playback devices in the network media system; and

identifying a zone comprising a playback device corresponding to a first type as the primary zone, wherein the first type corresponds to one of (a) a sound bar-type playback device or (b) a sound base-type playback device.

7. The method of claim 1, wherein determining respective audio responses comprises:

causing a first auxiliary zone to play calibration audio; and

capturing, via a microphone in a listener location of the primary zone, the calibration audio played by the first auxiliary zone.

8. A tangible, non-transitory computer-readable medium storing instructions that when executed by at least one processor cause a network media system to perform functions comprising:

identifying a primary zone in the network media system to play back audio tracks of videos, wherein identifying the primary zone comprises determining that an input interface of a playback device within the primary zone is connected to (a) an output port of a display device or (b) an output port of a media player device that outputs audio and video;

determining respective audio responses of one or more auxiliary zones for coordinated playback of auxiliary audio content with the primary zone;

identifying a particular auxiliary zone for coordinated playback of auxiliary audio content based on (i) the respective audio responses of the one or more auxiliary zones indicating that the particular auxiliary zone is within audible range of the primary zone and (ii) the particular auxiliary zone comprising a subwoofer; and

while an audio track of a given video is playing back, the network media system temporarily forming a playback configuration in which the primary zone plays back primary audio content comprising full frequency range audio content of the audio track and the particular one auxiliary zone plays back auxiliary audio content comprising low frequency range audio content of the audio track, wherein the primary zone and the particular auxiliary zone are each configured to play back audio content individually before forming the playback configuration.

9. The computer-readable medium of claim 8, wherein the particular auxiliary zone consists of the subwoofer and one or more full-range playback devices, and wherein temporarily forming the playback configuration comprises temporarily forming a bonded zone that includes playback devices of the primary zone and the subwoofer of the particular auxiliary zone, wherein the particular auxiliary zone consists of the one or more full-range playback devices while the bonded zone is formed.

10. The computer-readable medium of claim 8, wherein the functions further comprise re-forming the primary zone and particular auxiliary zone when the audio track of the given video stops playing back.

11. The computer-readable medium of claim 8, wherein the particular auxiliary zone consists of the subwoofer and one or more full-range playback devices, wherein the audio track is a multi-channel audio track, and wherein the full frequency range audio content comprises a center channel audio track and wherein the auxiliary audio content comprise one or more surround audio tracks.

12. The computer-readable medium of claim 8, the full frequency range audio content comprises portions of the audio track in a first frequency range that includes dialogue and wherein the low frequency range audio content consists of portions of the audio track in a second frequency range that includes bass frequencies.

13. The computer-readable medium of claim 8, wherein identifying the primary zone comprises:

determining types of playback devices in the network media system; and

identifying a zone comprising a playback device corresponding to a first type as the primary zone, wherein the first type corresponds to one of (a) a sound bar-type playback device or (b) a sound base-type playback device.

14. The computer-readable medium of claim 8, wherein determining respective audio responses comprises:

causing a first auxiliary zone to play calibration audio; and

capturing, via a microphone in a listener location of the primary zone, the calibration audio played by the first auxiliary zone.

15. A computing device of a network media system, the computing device comprising:

at least one processor; and

memory storing instructions that when executed by the at least one processor cause the computing device to perform functions comprising;

identifying a primary zone in the network media system to play back audio tracks of videos, wherein identifying the primary zone comprises determining that an input interface of a playback device within the primary zone is connected to (a) an output port of a display device or (b) an output port of a media player device that outputs audio and video;

determining respective audio responses of one or more auxiliary zones for coordinated playback of auxiliary audio content with the primary zone;

identifying a particular auxiliary zone for coordinated playback of auxiliary audio content based on (i) the respective audio responses of the one or more auxiliary zones indicating that the particular auxiliary zone is within audible range of the primary zone and (ii) the particular auxiliary zone comprising a subwoofer; and

while an audio track of a given video is playing back, the network media system temporarily forming a playback configuration in which the primary zone plays back primary audio content comprising full frequency range audio content of the audio track and the particular auxiliary zone plays back auxiliary audio content comprising low frequency range audio content of the audio track, wherein the primary zone and the particular auxiliary zone are each configured to play back audio content individually before forming the playback configuration.

16. The computing device of claim 15, wherein the particular auxiliary zone consists of the subwoofer and one or more full-range playback devices, and wherein temporarily forming the playback configuration comprises temporarily forming a bonded zone that includes playback devices of the primary zone and the subwoofer of the particular auxiliary zone, wherein the particular auxiliary zone consists of the one or more full-range playback devices while the bonded zone is formed.

17. The computing device of claim 15, wherein the functions further comprise re-forming the primary zone and particular auxiliary zone when the audio track of the given video stops playing back.

18. The computing device of claim 15, wherein the particular auxiliary zone consists of the subwoofer and one or more full-range playback devices, wherein the audio track is a multi-channel audio track, and wherein the full frequency range audio content comprises a center channel audio track and wherein the auxiliary audio content comprise one or more surround audio tracks.

19. The computing device of claim 15, the full frequency range audio content comprises portions of the audio track in a first frequency range that includes dialogue and wherein the low frequency range audio content consists of portions of the audio track in a second frequency range that includes bass frequencies.

20. The computing device of claim 15, wherein identifying the primary zone comprises:

determining types of playback devices in the network media system; and

identifying a zone comprising a playback device corresponding to a first type as the primary zone, wherein the first type corresponds to one of (a) a sound bar-type playback device or (b) a sound base-type playback device.