Spatial mapping of audio playback devices in a listening environment

• US 9,949,054 B2
• Filed: 09/30/2015
• Issued: 04/17/2018
• Est. Priority Date: 09/30/2015
• Status: Active Grant

• Current Assignee: Sonos, Inc.
• Original Assignee: Sonos, Inc.
• Inventors: Kadri, Romi, Davies, Chris
• Primary Examiner(s): Chin, Vivian
• Assistant Examiner(s): HAMID, AMMAR T
• Application Number:
  US14/871,494
• Publication Number:
  US 20170094437A1
• Time in Patent Office: 930 Days
• Field of Search: 381304, 381311
• CPC Class Codes: H04R 2203/12 Beamforming aspects for stereophonic sound reproduction with loudspeaker arrays
• CPC Class Codes: H04R 2227/005 Audio distribution systems for home, i.e. multi-room use
• CPC Class Codes: H04R 2420/07 Applications of wireless loudspeakers or wireless microphones
• CPC Class Codes: H04R 2430/01 Aspects of volume control, not necessarily automatic, in sound systems
• CPC Class Codes: H04R 27/00 Public address systems circuits for preventing acoustic reaction H04R3/02; circuits for distributing signals to loudspeakers H04R3/12; monitoring or testing arrangements for public address systems H04R29/007; amplifiers H03F
• CPC Class Codes: H04R 3/12 for distributing signals to two or more loudspeakers specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04R 5/02 Spatial or constructional arrangements of loudspeakers
• CPC Class Codes: H04S 7/301 Automatic calibration of stereophonic sound system, e.g. with test microphone
• CPC Class Codes: H04S 7/307 Frequency adjustment, e.g. tone control H04S7/301 takes precedence

Abstract

Method and apparatus for spatial mapping of two or more audio playback devices in a listening environment. Two or more playback devices may signal each other. Based on the signaling, a position of the two or more playback devices relative to each other is determined and a device map of the two or more playback devices in the listening environment is generated based on this position.

Claims

1. A method comprising:

sending by a given playback device, a first signal indicative of a position of the given playback device wherein the given playback device is associated with a first channel of a plurality of audio channels;

receiving, via a plurality of microphones of the given playback device, a second signal indicative of a respective position of each of one or more other playback devices, wherein each of the one or more other playback devices is associated with a respective channel of the plurality of audio channels;

determining the position of the given playback device relative to each position of the one or more other playback devices based on the second signal indicative of the respective position of each of the one or more other playback devices;

determining an angular orientation of the given playback device relative to each orientation of the one or more other playback devices based on a difference in time delay of receipt of the second signal by the plurality of microphones;

determining an angle between a listening position in the listening environment and a virtual point, wherein the virtual point is a position in the listening environment between the given playback device and one of the one or more other playback devices;

causing a controller device to output, to a display of the controller device, a device map indicating the positions in the listening environment of the given playback device and the one or more other playback devices, wherein the device map is oriented on the display at the determined angle between the listening position and the virtual point;

comparing the determined position and the determined orientation of the given playback device relative to each position and to each orientation of the one or more other playback devices to a corresponding one or more relative reference positions and reference orientations, respectively, wherein the one or more relative reference positions and the one or more relative reference orientations are defined by a predefined audio standard, and wherein a corresponding relative reference position associated with the given playback device and a given device of the one or more other playback devices is based on the first channel associated with the playback device and the respective channel associated with the given device; and

based on the comparison, causing a controller device to output an indication in the device map on the display that at least one of the given playback device and the one or other more playback devices is not positioned or oriented in accordance with the one or more relative reference positions or with the one or more reference orientations, respectively, such that repositioning or reorienting in accordance with the one or more relative reference positions and the one or more reference orientations will improve playback of audio by the given playback device and the one or more other playback devices, wherein causing the controller device to output the indication comprises displaying one or more alerts indicating improper placement in the device map, wherein individual alerts of the one or more alerts are positioned in the device map adjacent the at least one of the given playback device and the one or more other playback devices not positioned or oriented in accordance with the one or more relative reference positions or with the one or more reference orientations, respectively.

2. The method of claim 1, wherein the angle is a first angle, wherein determining the position of the given playback device comprises performing a triangulation based on the second signal to determine a distance and a second angle between the given playback device and the one or more other playback devices, and wherein a side of a triangle is a signal characteristic of the second signal, the signal characteristic being proportional to a distance between the given playback device and the one or more other playback devices.

3. The method of claim 1, further comprising generating the device map based on the first signal and the second signal.

4. The method of claim 1, wherein determining the position of the one or other more playback devices relative to the given playback device comprises performing a triangulation based on the second signal to determine a distance and angle between the given playback device and the one or more other playback devices.

5. The method of claim 1, wherein the angular orientation is determined based on a timing of receipt of a peak of a beam-formed signal by a microphone of the given playback device.

6. The method of claim 1, wherein determining the angular orientation comprises determining a horizontal angular orientation of the device and a vertical angular orientation of the given playback device.

10. The method of claim 1, wherein the angle between the listening position and the virtual point is an oblique angle.

7. A tangible non-transitory computer readable storage medium including a set of instructions that when executed by a processor cause a media playback system to:

sending by a media playback device, a first signal indicative of a position of the media playback device wherein the given playback device is associated with a first channel of a plurality of audio channels;

receiving, via a plurality of microphones of the given playback device, a second signal indicative of a respective position of each of one or more other playback devices, wherein each of the one or more other playback devices is associated with a respective channel of the plurality of audio channels;

determining the position of the media playback device relative to each position of the one or more other playback devices based on the second signal indicative of the respective position of each of the one or more other playback devices;

determining an angular orientation of the media playback device relative to each orientation of the one or more other playback devices based on a difference in time delay of receipt of the second signal by the plurality of microphones;

determining an angle between a listening position in the listening environment and a virtual point, wherein the virtual point is a position in the listening environment between the media playback device and one of the one or more other playback devices;

causing a controller device to output, to a display of the controller device, a device map indicating the positions in the listening environment of the one or more other playback devices and the media playback device, wherein the device map is oriented on the display at the determined angle between the listening position and the virtual point;

comparing the determined position and the determined orientation of the media playback device relative to each position and to each orientation of the one or more other playback devices to a corresponding one or more relative reference positions and reference orientations, respectively, wherein the one or more relative reference positions and the one or more relative reference orientations are defined by a predefined audio standard, and wherein a corresponding relative reference position associated with the media playback device and a given device of the one or more other playback devices is based on the first channel associated with the playback device and the respective channel associated with the given device; and

based on the comparison, causing a controller device to output an indication in the device map on the display that at least one of the media playback device and the one or other more playback devices is not positioned or oriented in accordance with the one or more relative reference positions or with the one or more reference orientations, respectively, such that repositioning or reorienting in accordance with the one or more relative reference positions and the one or more reference orientations will improve playback of audio by the media playback device and the one or more other playback devices, wherein causing the controller device to output the indication comprises displaying one or more alerts indicating improper placement in the device map, wherein individual alerts of the one or more alerts are positioned in the device map adjacent the at least one of the media playback device and the one or more other playback devices not positioned or oriented in accordance with the one or more relative reference positions or with the one or more reference orientations, respectively.

8. The tangible non-transitory computer readable storage medium of claim 7, wherein the angle is a first angle, wherein the instructions for determining the position comprises performing a triangulation based on the second signal to determine a distance and a second angle between the media playback device and each of the one or more playback other devices, wherein a side of a triangle is a signal characteristic of the second signal, the signal characteristic being proportional to a distance between the media playback device and the one or more other playback devices.

9. The tangible non-transitory computer readable storage medium of claim 7, further comprising instructions for generating the device map based on the first signal and the second signal.

11. The tangible non-transitory computer readable storage medium of claim 7, wherein the angle between the listening position and the virtual point is an oblique angle.

12. A media playback system, comprising:

a first playback device;

one or more other playback devices; and

tangible non-transitory computer readable media storing instructions, that when executed by one or more processors, cause the media playback system to;

sending, by the first playback device, a first signal indicative of a position of the first playback device wherein the given playback device is associated with a first channel of a plurality of audio channels;

receiving, via a plurality of microphones of the given playback device, a second signal indicative of a respective position of each of one or more other playback devices, wherein each of the one or more other playback devices is associated with a respective channel of the plurality of audio channels;

determining the position of the first playback device relative to each position of the one or more other playback devices based on the second signal indicative of the respective position of each of the one or more other playback devices;

determining an angular orientation of the first playback device relative to each orientation of the one or more other playback devices based on a difference in time delay of receipt of the second signal by the plurality of microphones;

determining an angle between a listening position in the listening environment and a virtual point, wherein the virtual point is a position in the listening environment between the first playback device and one of the one or more other playback devices;

causing a controller device to output, to a display of the controller device, a device map indicating the positions in the listening environment of the one or more other playback devices and the first playback device, wherein the device map is oriented on the display at the determined angle between the listening position and the virtual point;

comparing the determined position and the determined orientation of the first playback device relative to each position and to each orientation of the one or more other playback devices to a corresponding one or more relative reference positions and reference orientations, respectively, wherein the one or more relative reference positions and the one or more relative reference orientations are defined by a predefined audio standard, and wherein a corresponding relative reference position associated with the first playback device and a given device of the one or more other playback devices is based on the first channel associated with the playback device and the respective channel associated with the given device; and

based on the comparison, causing a controller device to output an indication in the device map on the display that at least one of the first playback device and the one or other more playback devices is not positioned or oriented in accordance with the one or more relative reference positions or with the one or more reference orientations, respectively, such that repositioning or reorienting in accordance with the one or more relative reference positions and the one or more reference orientations will improve playback of audio by the first playback device and the one or more other playback devices, wherein causing the controller device to output the indication comprises displaying one or more alerts indicating improper placement in the device map, wherein individual alerts of the one or more alerts are positioned in the device map adjacent the at least one of the first playback device and the one or more other playback devices not positioned or oriented in accordance with the one or more relative reference positions or with the one or more reference orientations, respectively.