Validation of audio calibration using multi-dimensional motion check

• US 10,419,864 B2
• Filed: 06/04/2018
• Issued: 09/17/2019
• Est. Priority Date: 09/17/2015
• Status: Active Grant

• Current Assignee: Sonos, Inc.
• Original Assignee: Sonos, Inc.
• Inventors: Downing, Jonathan, Sheen, Timothy, Valente, Daniel
• Primary Examiner(s): Paul, Disler
• Application Number:
  US15/996,878
• Publication Number:
  US 20180359585A1
• Time in Patent Office: 470 Days
• Field of Search: 381 58- 59, 381103, 381122
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G10L 25/06 the extracted parameters being correlation coefficients
• CPC Class Codes: H03G 5/16 Automatic control
• CPC Class Codes: H03G 5/165 Equalizers; Volume or gain control in limited frequency bands
• CPC Class Codes: H04R 1/32 for obtaining desired directional characteristic only specially adapted for hearing aids H04R25/40
• CPC Class Codes: H04R 2227/003 Digital PA systems using, e.g. LAN or internet
• CPC Class Codes: H04R 2227/005 Audio distribution systems for home, i.e. multi-room use
• CPC Class Codes: H04R 2460/07 Use of position data from wide-area or local-area positioning systems in hearing devices, e.g. program or information selection
• CPC Class Codes: H04R 27/00 Public address systems circuits for preventing acoustic reaction H04R3/02; circuits for distributing signals to loudspeakers H04R3/12; monitoring or testing arrangements for public address systems H04R29/007; amplifiers H03F
• CPC Class Codes: H04R 29/001 for loudspeakers H04R29/007 takes precedence
• CPC Class Codes: H04R 29/007 for public address systems public address systems per se H04R27/00
• CPC Class Codes: H04R 29/008 Visual indication of individual signal levels visual indication of stereophonic sound image H04S7/40
• CPC Class Codes: H04R 3/04 for correcting frequency response
• CPC Class Codes: H04S 7/301 Automatic calibration of stereophonic sound system, e.g. with test microphone
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation

Abstract

Examples described herein involve validating motion of a microphone during calibration of a playback device. An example implementation involves a control device receiving an indication that the control device will begin detecting audio signals emitted from playback devices as part of a calibration process. While the control device is detecting audio signals emitted from the playback devices, the control device receives a stream of motion data indicating movement of the control device. The control device processes a first subset of the stream of motion data to determine that the first subset of the stream of motion data indicates sufficient horizontal translation of the control device occurred. Based on determining that the first subset of the stream of motion data indicates sufficient horizontal translation of the control device, the control device processes a second subset of the stream of motion data.

Claims

1. A tangible, non-transitory, computer-readable medium having stored therein instructions executable by one or more processors of a control device to perform a method comprising:

receiving an indication that the control device will begin detecting audio signals emitted from one or more playback devices as part of a calibration process of the one or more playback devices;

while the control device is detecting audio signals emitted from the one or more playback devices, receiving a stream of motion data indicating movement of the control device;

after receiving a first subset of the stream of motion data representing a first portion of the calibration process, processing the first subset of the stream of motion data to determine whether the first subset of the stream of motion data indicates that sufficient horizontal translation of the control device occurred during the first portion of the calibration process;

when the first subset of the stream of motion data indicates that insufficient horizontal translation of the control device occurred during the first portion of the calibration process, displaying, via a graphical display, a prompt to move the control device more during a second portion of the calibration process;

after receiving a second subset of the stream of motion data representing the second portion of the calibration process, processing the second subset of the stream of motion data to determine whether the first subset and second subsets of the stream of motion data indicate that sufficient horizontal translation of the control device occurred during the first and second portions of the calibration process;

when the first subset and second subsets of the stream of motion data indicate that insufficient horizontal translation of the control device occurred during the first and second portions of the calibration process, aborting the calibration process; and

when the first subset and second subsets of the stream of motion data indicate that sufficient horizontal translation of the control device occurred during the first and second portions of the calibration process, calibrating the one or more playback devices with a calibration based on the detected audio signals emitted from the one or more playback devices.

2. The tangible, non-transitory, computer-readable medium of claim 1, wherein processing the first subset of the stream of motion data comprises:

identifying, within the first subset of the stream of motion data, a first component of the first subset that indicates movement of the control device in a vertical direction and one or more second components of the first subset that indicates movement of the control device in respective radial directions from the one or more playback devices;

determining one or more horizontal motion parameters representing motion of the control device in a horizontal direction through a surrounding environment by cross-correlating the first component of the first subset indicating movement of the control device in a vertical direction with the one or more second components of the first subset indicating movement of the control device in respective radial directions from the one or more playback devices; and

determining that the first subset of the stream of motion data indicates sufficient horizontal translation of the control device occurred by determining that at least one of the horizontal motion parameters representing motion in the horizontal direction through the surrounding environment exceeds a correlation threshold.

3. The tangible, non-transitory, computer-readable medium of claim 1, wherein processing the second subset of the stream of motion data comprises:

identifying, within the second subset of the stream of motion data, a first component of the second subset that indicates movement of the control device in a vertical direction and one or more second components of the second subset that indicates movement of the control device in respective radial directions from the one or more playback devices;

determining one or more horizontal motion parameters representing motion of the control device in a horizontal direction through a surrounding environment by cross-correlating the first component of the second subset indicating movement of the control device in a vertical direction with the one or more second components of the second subset indicating movement of the control device in respective radial directions from the one or more playback devices; and

determining whether the second subset of the stream of motion data indicates insufficient horizontal translation of the control device occurred by determining whether at least one of the horizontal motion parameters representing motion in the horizontal direction through the surrounding environment exceeds a correlation threshold.

4. The tangible, non-transitory, computer-readable medium of claim 1, wherein aborting the calibration process comprises:

causing the control device to stop detecting audio signals; and

causing the one or more playback devices to stop emitting the audio signals.

5. The tangible, non-transitory, computer-readable medium of claim 1, wherein the method further comprises:

when the first subset and second subsets of the stream of motion data indicate that insufficient horizontal translation of the control device occurred during the first and second portions of the calibration process, displaying a message on the control device indicating that detection of audio signals has stopped due to insufficient motion.

6. The tangible, non-transitory, computer-readable medium of claim 1, wherein receiving the stream of motion data indicating movement of the control device comprises:

receiving a stream of microphone data indicating respective radial distances from the one or more playback devices to the control device based on respective propagation delays between the one or more playback devices and a microphone coupled to the control device.

7. The tangible, non-transitory, computer-readable medium of claim 1, wherein receiving the stream of motion data indicating movement of the control device comprises:

receiving a stream of sensor data indicating acceleration of the control device.

8. A method to be performed by a control device, the method comprising:

receiving an indication that the control device will begin detecting audio signals emitted from one or more playback devices as part of a calibration process of the one or more playback devices;

while the control device is detecting audio signals emitted from the one or more playback devices, receiving a stream of motion data indicating movement of the control device;

after receiving a first subset of the stream of motion data representing a first portion of the calibration process, processing the first subset of the stream of motion data to determine whether the first subset of the stream of motion data indicates that sufficient horizontal translation of the control device occurred during the first portion of the calibration process;

when the first subset of the stream of motion data indicates that insufficient horizontal translation of the control device occurred during the first portion of the calibration process, displaying, via a graphical display, a prompt to move the control device more during a second portion of the calibration process;

after receiving a second subset of the stream of motion data representing the second portion of the calibration process, processing the second subset of the stream of motion data to determine whether the first subset and second subsets of the stream of motion data indicate that sufficient horizontal translation of the control device occurred during the first and second portions of the calibration process;

when the first subset and second subsets of the stream of motion data indicate that insufficient horizontal translation of the control device occurred during the first and second portions of the calibration process, aborting the calibration process; and

when the first subset and second subsets of the stream of motion data indicate that sufficient horizontal translation of the control device occurred during the first and second portions of the calibration process, calibrating the one or more playback devices with a calibration based on the detected audio signals emitted from the one or more playback devices.

9. The method of claim 8, wherein processing the first subset of the stream of motion data comprises:

identifying, within the first subset of the stream of motion data, a first component of the first subset that indicates movement of the control device in a vertical direction and one or more second components of the first subset that indicates movement of the control device in respective radial directions from the one or more playback devices;

determining one or more horizontal motion parameters representing motion of the control device in a horizontal direction through a surrounding environment by cross-correlating the first component of the first subset indicating movement of the control device in a vertical direction with the one or more second components of the first subset indicating movement of the control device in respective radial directions from the one or more playback devices; and

determining that the first subset of the stream of motion data indicates sufficient horizontal translation of the control device occurred by determining that at least one of the horizontal motion parameters representing motion in the horizontal direction through the surrounding environment exceeds a correlation threshold.

10. The method of claim 8, wherein processing the second subset of the stream of motion data comprises:

identifying, within the second subset of the stream of motion data, a first component of the second subset that indicates movement of the control device in a vertical direction and one or more second components of the second subset that indicates movement of the control device in respective radial directions from the one or more playback devices;

determining one or more horizontal motion parameters representing motion of the control device in a horizontal direction through a surrounding environment by cross-correlating the first component of the second subset indicating movement of the control device in a vertical direction with the one or more second components of the second subset indicating movement of the control device in respective radial directions from the one or more playback devices; and

determining whether the second subset of the stream of motion data indicates insufficient horizontal translation of the control device occurred by determining whether at least one of the horizontal motion parameters representing motion in the horizontal direction through the surrounding environment exceeds a correlation threshold.

11. The method of claim 8, wherein aborting the calibration process comprises:

causing the control device to stop detecting audio signals; and

causing the one or more playback devices to stop emitting the audio signals.

12. The method of claim 8, wherein the method further comprises:

when the first subset and second subsets of the stream of motion data indicate that insufficient horizontal translation of the control device occurred during the first and second portions of the calibration process, displaying a message on the control device indicating that detection of audio signals has stopped due to insufficient motion.

13. The method of claim 8, wherein receiving the stream of motion data indicating movement of the control device comprises:

receiving a stream of microphone data indicating respective radial distances from the one or more playback devices to the control device based on respective propagation delays between the one or more playback devices and a microphone coupled to the control device.

14. The method of claim 8, wherein receiving the stream of motion data indicating movement of the control device comprises:

receiving a stream of sensor data indicating acceleration of the control device.

15. A control device comprising:

one or more microphones;

one or more processors; and

data storage having stored therein instructions executable by the one or more processors to cause the control device to perform a method comprising;

receiving an indication that the control device will begin detecting audio signals emitted from one or more playback devices as part of a calibration process of the one or more playback devices;

while the control device is detecting audio signals emitted from the one or more playback devices, receiving a stream of motion data indicating movement of the control device;

after receiving a first subset of the stream of motion data representing a first portion of the calibration process, processing the first subset of the stream of motion data to determine whether the first subset of the stream of motion data indicates that sufficient horizontal translation of the control device occurred during the first portion of the calibration process;

when the first subset of the stream of motion data indicates that insufficient horizontal translation of the control device occurred during the first portion of the calibration process, displaying, via a graphical display, a prompt to move the control device more during a second portion of the calibration process;

after receiving a second subset of the stream of motion data representing the second portion of the calibration process, processing the second subset of the stream of motion data to determine whether the first subset and second subsets of the stream of motion data indicate that sufficient horizontal translation of the control device occurred during the first and second portions of the calibration process;

when the first subset and second subsets of the stream of motion data indicate that insufficient horizontal translation of the control device occurred during the first and second portions of the calibration process, aborting the calibration process; and

when the first subset and second subsets of the stream of motion data indicate that sufficient horizontal translation of the control device occurred during the first and second portions of the calibration process, calibrating the one or more playback devices with a calibration based on the detected audio signals emitted from the one or more playback devices.

16. The control device of claim 15, wherein processing the first subset of the stream of motion data comprises:

identifying, within the first subset of the stream of motion data, a first component of the first subset that indicates movement of the control device in a vertical direction and one or more second components of the first subset that indicates movement of the control device in respective radial directions from the one or more playback devices;

determining one or more horizontal motion parameters representing motion of the control device in a horizontal direction through a surrounding environment by cross-correlating the first component of the first subset indicating movement of the control device in a vertical direction with the one or more second components of the first subset indicating movement of the control device in respective radial directions from the one or more playback devices; and

determining that the first subset of the stream of motion data indicates sufficient horizontal translation of the control device occurred by determining that at least one of the horizontal motion parameters representing motion in the horizontal direction through the surrounding environment exceeds a correlation threshold.

17. The control device of claim 15, wherein processing the second subset of the stream of motion data comprises:

identifying, within the second subset of the stream of motion data, a first component of the second subset that indicates movement of the control device in a vertical direction and one or more second components of the second subset that indicates movement of the control device in respective radial directions from the one or more playback devices;

determining one or more horizontal motion parameters representing motion of the control device in a horizontal direction through a surrounding environment by cross-correlating the first component of the second subset indicating movement of the control device in a vertical direction with the one or more second components of the second subset indicating movement of the control device in respective radial directions from the one or more playback devices; and

determining whether the second subset of the stream of motion data indicates insufficient horizontal translation of the control device occurred by determining whether at least one of the horizontal motion parameters representing motion in the horizontal direction through the surrounding environment exceeds a correlation threshold.

18. The control device of claim 15, wherein aborting the calibration process comprises:

causing the control device to stop detecting audio signals; and

causing the one or more playback devices to stop emitting the audio signals.

19. The control device of claim 15, wherein the method further comprises:

when the first subset and second subsets of the stream of motion data indicate that insufficient horizontal translation of the control device occurred during the first and second portions of the calibration process, displaying a message on the control device indicating that detection of audio signals has stopped due to insufficient motion.

20. The control device of claim 15, wherein receiving the stream of motion data indicating movement of the control device comprises:

receiving a stream of microphone data indicating respective radial distances from the one or more playback devices to the control device based on respective propagation delays between the one or more playback devices and a microphone coupled to the control device.