Validation of audio calibration using multi-dimensional motion check

• US 9,992,597 B2
• Filed: 04/05/2017
• Issued: 06/05/2018
• Est. Priority Date: 09/17/2015
• Status: Active Grant

• Current Assignee: Sonos, Inc.
• Original Assignee: Sonos, Inc.
• Inventors: Downing, Jonathan, Sheen, Timothy, Valente, Daniel
• Primary Examiner(s): Paul, Disler
• Application Number:
  US15/480,265
• Publication Number:
  US 20170208408A1
• Time in Patent Office: 426 Days
• Field of Search: 381 58- 59
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G10L 25/06 the extracted parameters being correlation coefficients
• CPC Class Codes: H03G 5/16 Automatic control
• CPC Class Codes: H03G 5/165 Equalizers; Volume or gain control in limited frequency bands
• CPC Class Codes: H04R 1/32 for obtaining desired directional characteristic only specially adapted for hearing aids H04R25/40
• CPC Class Codes: H04R 2227/003 Digital PA systems using, e.g. LAN or internet
• CPC Class Codes: H04R 2227/005 Audio distribution systems for home, i.e. multi-room use
• CPC Class Codes: H04R 2460/07 Use of position data from wide-area or local-area positioning systems in hearing devices, e.g. program or information selection
• CPC Class Codes: H04R 27/00 Public address systems circuits for preventing acoustic reaction H04R3/02; circuits for distributing signals to loudspeakers H04R3/12; monitoring or testing arrangements for public address systems H04R29/007; amplifiers H03F
• CPC Class Codes: H04R 29/001 for loudspeakers H04R29/007 takes precedence
• CPC Class Codes: H04R 29/007 for public address systems public address systems per se H04R27/00
• CPC Class Codes: H04R 29/008 Visual indication of individual signal levels visual indication of stereophonic sound image H04S7/40
• CPC Class Codes: H04R 3/04 for correcting frequency response
• CPC Class Codes: H04S 7/301 Automatic calibration of stereophonic sound system, e.g. with test microphone
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation

Abstract

Examples described herein involve validating motion of a microphone during calibration of a playback device. An example implementation involves a control device receiving an indication that the control device will begin detecting audio signals emitted from playback devices as part of a calibration process. While the control device is detecting audio signals emitted from the playback devices, the control device receives a stream of motion data indicating movement of the control device. The control device processes a first subset of the stream of motion data to determine that the first subset of the stream of motion data indicates sufficient horizontal translation of the control device occurred. Based on determining that the first subset of the stream of motion data indicates sufficient horizontal translation of the control device, the control device processes a second subset of the stream of motion data.

Claims

1. A tangible, non-transitory, computer-readable medium having stored therein instructions executable by one or more processors of a control device to perform functions comprising:

receiving an indication that the control device will begin detecting audio signals emitted from one or more playback devices as part of a calibration process of the one or more playback devices;

while the control device is detecting audio signals emitted from the one or more playback devices, receiving a stream of motion data indicating movement of the control device;

after receiving a first subset of the stream of motion data, processing the first subset of the stream of motion data to determine whether the first subset of the stream of motion data indicates sufficient horizontal translation of the control device occurred, wherein processing the first subset of the stream of motion data comprises;

identifying, within the first subset of the stream of motion data, a first component of the first subset that indicates movement of the control device in a vertical direction and one or more second components of the first subset that indicates movement of the control device in respective radial directions from the one or more playback devices;

determining one or more horizontal motion parameters representing motion of the control device in a horizontal direction through a surrounding environment by cross-correlating the first component of the first subset indicating movement of the control device in a vertical direction with the one or more second components of the first subset indicating movement of the control device in respective radial directions from the one or more playback devices; and

determining that the first subset of the stream of motion data indicates sufficient horizontal translation of the control device occurred by determining that at least one of the horizontal motion parameters representing motion in the horizontal direction through the surrounding environment exceeds a correlation threshold;

after processing the first subset of the stream of motion data, processing a second subset of the stream of motion data to determine whether the second subset of the stream of motion data indicates that sufficient horizontal translation of the control device occurred; and

when the second subset of the stream of motion data indicates that insufficient horizontal translation of the control device occurred, aborting the calibration process.

2. The tangible non-transitory computer-readable medium of claim 1, wherein processing the second subset of the stream of motion data comprises:

identifying, within the second subset of the stream of motion data, a first component of the second subset that indicates movement of the control device in a vertical direction and one or more second components of the second subset that indicates movement of the control device in respective radial directions from the one or more playback devices;

determining one or more horizontal motion parameters representing motion of the control device in a horizontal direction through the surrounding environment by cross-correlating the first component of the second subset indicating movement of the control device in a vertical direction with the one or more second components of the second subset indicating movement of the control device in respective radial directions from the one or more playback devices; and

determining that the second subset of the stream of motion data indicates insufficient horizontal translation of the control device occurred by determining that none of the horizontal motion parameters representing motion in the horizontal direction through the surrounding environment exceeds the correlation threshold,

and wherein aborting the calibration process comprises;

after processing the second subset of the stream of motion data and based on determining that the second subset of the stream of motion data indicates insufficient horizontal translation of the control device, causing the control device to stop detecting audio signals.

3. The tangible non-transitory computer-readable medium of claim 2, wherein the functions further comprise:

based on determining that the second subset of the stream of motion data indicates insufficient horizontal translation of the control device, displaying a message on the control device indicating that detection of audio signals has stopped due to insufficient motion.

4. The tangible non-transitory computer-readable medium of claim 1, wherein processing the first subset of the stream of motion data further comprise:

determining a first vertical motion parameter representing a mean of the first subset of the stream of motion data in a vertical direction; and

determining that the first subset of the stream of motion data indicates sufficient vertical translation of the control device occurred by determining that the first vertical motion parameter exceeds a vertical-motion threshold.

5. The tangible non-transitory computer-readable medium of claim 4, wherein processing the second subset of the stream of motion data further comprise:

determining a second vertical motion parameter representing a mean of the first and second subsets of the stream of motion data in a vertical direction; and

determining whether the second subset of the stream of motion data indicates sufficient vertical translation of the control device occurred by determining whether the second vertical motion parameter exceeds the vertical-motion threshold.

6. The tangible non-transitory computer-readable medium of claim 1, wherein receiving the stream of motion data indicating movement of the control device comprises:

receiving a stream of sensor data indicating acceleration of the control device.

7. The tangible non-transitory computer-readable medium of claim 1, wherein receiving the stream of motion data indicating movement of the control device comprises:

receiving a stream of microphone data indicating respective radial distances from the one or more playback devices to the control device based on respective propagation delays between the one or more playback devices and a microphone coupled to the control device.

8. The tangible non-transitory computer-readable medium of claim 1, wherein processing the first subset of the stream of motion data further comprises:

determining that the first subset of the stream of motion data indicates a speed of the control device that does not exceed a speed threshold, and wherein processing the second subset of the stream of motion data comprises;

processing the second subset of the stream of motion data further based on determining that the first subset of the stream of motion data indicates the speed of the control device that does not exceed the speed threshold.

20. The tangible non-transitory computer-readable medium of claim 1, wherein aborting the calibration process comprises causing the one or more playback devices to stop emitting the audio signals.

9. A control device comprising:

one or more processors; and

tangible non-transitory computer-readable medium having stored therein instructions executable by the one or more processors to cause the control device to perform functions comprising;

receiving an indication that the control device will begin detecting audio signals emitted from one or more playback devices as part of a calibration process of the one or more playback devices;

while the control device is detecting audio signals emitted from the one or more playback devices, receiving a stream of motion data indicating movement of the control device;

after receiving a first subset of the stream of motion data, processing the first subset of the stream of motion data, wherein processing the first subset of the stream of motion data comprises;

identifying, within the first subset of the stream of motion data, a first component of the first subset that indicates movement of the control device in a vertical direction and one or more second components of the first subset that indicates movement of the control device in respective radial directions from the one or more playback devices;

determining one or more horizontal motion parameters representing motion of the control device in a horizontal direction through a surrounding environment by cross-correlating the first component of the first subset indicating movement of the control device in a vertical direction with the one or more second components of the first subset indicating movement of the control device in respective radial directions from the one or more playback devices; and

determining that the first subset of the stream of motion data indicates sufficient horizontal translation of the control device occurred by determining that at least one of the horizontal motion parameters representing motion in the horizontal direction through the surrounding environment exceeds a correlation threshold;

after processing the first subset of the stream of motion data, processing a second subset of the stream of motion data to determine whether the second subset of the stream of motion data indicates that sufficient horizontal translation of the control device occurred; and

when the second subset of the stream of motion data indicates that insufficient horizontal translation of the control device occurred, aborting the calibration process.

10. The control device of claim 9, wherein processing the second subset of the stream of motion data comprises:

identifying, within the second subset of the stream of motion data, a first component of the second subset that indicates movement of the control device in a vertical direction and one or more second components of the second subset that indicates movement of the control device in respective radial directions from the one or more playback devices;

determining one or more horizontal motion parameters representing motion of the control device in a horizontal direction through the surrounding environment by cross-correlating the first component of the second subset indicating movement of the control device in a vertical direction with the one or more second components of the second subset indicating movement of the control device in respective radial directions from the one or more playback devices; and

determining that the second subset of the stream of motion data indicates insufficient horizontal translation of the control device occurred by determining that none of the horizontal motion parameters representing motion in the horizontal direction through the surrounding environment exceeds the correlation threshold, and wherein aborting the calibration process comprises;

after processing the second subset of the stream of motion data and based on determining that the second subset of the stream of motion data indicates insufficient horizontal translation of the control device, causing the control device to stop detecting audio signals.

11. The control device of claim 9, wherein processing the first subset of the stream of motion data further comprises:

determining a first vertical motion parameter representing a mean of the first subset of the stream of motion data in a vertical direction; and

determining that the first subset of the stream of motion data indicates sufficient vertical translation of the control device occurred by determining that the first vertical motion parameter exceeds a vertical-motion threshold.

12. The control device of claim 9, wherein receiving the stream of motion data indicating movement of the control device comprises one or more of:

(i) receiving a stream of sensor data indicating acceleration of the control device; and

(ii) receiving a stream of microphone data indicating respective radial distances from the one or more playback devices to the control device based on respective propagation delays between the one or more playback devices and a microphone coupled to the control device.

13. The control device of claim 9, wherein processing the first subset of the stream of motion data further comprises:

determining that the first subset of the stream of motion data indicates a speed of the control device that does not exceed a speed threshold, and wherein processing the second subset of the stream of motion data comprises;

processing the second subset of the stream of motion data further based on determining that the first subset of the stream of motion data indicates the speed of the control device that does not exceed the speed threshold.

14. A method comprising:

receiving, by a control device, an indication that the control device will begin detecting audio signals emitted from one or more playback devices as part of a calibration process of the one or more playback devices;

while the control device is detecting audio signals emitted from the one or more playback devices, receiving, by the control device, a stream of motion data indicating movement of the control device;

after receiving a first subset of the stream of motion data, processing by the control device, the first subset of the stream of motion data, wherein processing the first subset of the stream of motion data comprises;

identifying, within the first subset of the stream of motion data, a first component of the first subset that indicates movement of the control device in a vertical direction and one or more second components of the first subset that indicates movement of the control device in respective radial directions from the one or more playback devices;

determining one or more horizontal motion parameters representing motion of the control device in a horizontal direction through a surrounding environment by cross-correlating the first component of the first subset indicating movement of the control device in a vertical direction with the one or more second components of the first subset indicating movement of the control device in respective radial directions from the one or more playback devices; and

determining that the first subset of the stream of motion data indicates sufficient horizontal translation of the control device occurred by determining that at least one of the horizontal motion parameters representing motion in the horizontal direction through the surrounding environment exceeds a correlation threshold; and

after processing the first subset of the stream of motion data, processing a second subset of the stream of motion data to determine whether the second subset of the stream of motion data indicates that sufficient horizontal translation of the control device occurred; and

when the second subset of the stream of motion data indicates that insufficient horizontal translation of the control device occurred, aborting the calibration process.

15. The method of claim 14, wherein processing the second subset of the stream of motion data comprises:

identifying within the second subset of the stream of motion data a first component of the second subset that indicates movement of the control device in a vertical direction and one or more second components of the second subset that indicates movement of the control device in respective radial directions from the one or more playback devices;

determining one or more horizontal motion parameters representing motion of the control device in a horizontal direction through the surrounding environment by cross-correlating the first component of the second subset indicating movement of the control device in a vertical direction with the one or more second components of the second subset indicating movement of the control device in respective radial directions from the one or more playback devices; and

determining that the second subset of the stream of motion data indicates insufficient horizontal translation of the control device occurred by determining that none of the horizontal motion parameters representing motion in the horizontal direction through the surrounding environment exceeds the correlation threshold, wherein aborting the calibration process comprises;

after processing the second subset of the stream of motion data and based on determining that the second subset of the stream of motion data indicates insufficient horizontal translation of the control device, causing the control device to stop detecting audio signals.

16. The method of claim 14, wherein processing the first subset of the stream of motion data further comprises:

determining a first vertical motion parameter representing a mean of the first subset of the stream of motion data in a vertical direction; and

determining that the first subset of the stream of motion data indicates sufficient vertical translation of the control device occurred by determining that the first vertical motion parameter exceeds a vertical-motion threshold.

17. The method of claim 14, wherein receiving the stream of motion data indicating movement of the control device comprises:

receiving a stream of sensor data indicating acceleration of the control device.

18. The method of claim 14, wherein receiving the stream of motion data indicating movement of the control device comprises:

receiving a stream of microphone data indicating respective radial distances from the one or more playback devices to the control device based on respective propagation delays between the one or more playback devices and a microphone coupled to the control device.

19. The method of claim 14, wherein processing the first subset of the stream of motion data further comprises:

determining that the first subset of the stream of motion data indicates a speed of the control device that does not exceed a speed threshold, and wherein after processing the first subset of the stream of motion data and based on determining that the first subset of the stream of motion data indicates sufficient horizontal translation of the control device, processing a second subset of the stream of motion data comprises;

processing the second subset of the stream of motion data further based on determining that the first subset of the stream of motion data indicates the speed of the control device that does not exceed the speed threshold.